2023-10-06T03:10:39.226 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T03:10:39.227 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196 --verbose --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196/orig.config.yaml 2023-10-06T03:10:39.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:10:39.359 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} email: yweinste@redhat.com first_in_suite: false job_id: '7412196' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - client session with non-allowable root sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxm0D7OhTqMdrf1cqN/QMtrJIuB/luPw9ZIvMy3rzgMSTQ780jYjpbYeXAqiBMgs4ja1v0vOnnlH7mqlPXJ/Gg= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1tlBzZ9Y6G7MiwYE6zznDV/7zzdZ1vz0jw3dy/ZO2zaf5BB8+LaJ3tn14YVd/hWo5VJCG6dhluTklwKA/Y6dA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_sessionmap teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T03:10:39.361 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T03:10:39.361 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T03:10:39.362 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T03:10:39.363 INFO:teuthology.task.internal:Checking packages... 2023-10-06T03:10:39.386 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T03:10:39.386 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T03:10:39.386 INFO:teuthology.packaging:ref: None 2023-10-06T03:10:39.387 INFO:teuthology.packaging:tag: None 2023-10-06T03:10:39.387 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T03:10:39.387 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:10:39.387 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T03:10:39.606 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.gf1e315a9 2023-10-06T03:10:39.606 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T03:10:39.612 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T03:10:39.612 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T03:10:39.617 INFO:teuthology.task.internal:Saving configuration 2023-10-06T03:10:39.633 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T03:10:39.638 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:10:39.662 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:05:37.955068', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxm0D7OhTqMdrf1cqN/QMtrJIuB/luPw9ZIvMy3rzgMSTQ780jYjpbYeXAqiBMgs4ja1v0vOnnlH7mqlPXJ/Gg='} 2023-10-06T03:10:39.686 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:05:37.956807', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1tlBzZ9Y6G7MiwYE6zznDV/7zzdZ1vz0jw3dy/ZO2zaf5BB8+LaJ3tn14YVd/hWo5VJCG6dhluTklwKA/Y6dA='} 2023-10-06T03:10:39.686 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T03:10:39.694 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T03:10:39.694 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T03:10:39.694 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T03:10:39.766 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdafda2bb80>, signals=[15]) 2023-10-06T03:10:39.767 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T03:10:39.772 INFO:teuthology.task.internal:Opening connections... 2023-10-06T03:10:39.772 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:10:39.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:10:39.840 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:10:39.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:10:39.905 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T03:10:39.910 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-10-06T03:10:39.927 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-10-06T03:10:39.928 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-10-06T03:10:39.983 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T03:10:39.983 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T03:10:39.983 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.4" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T03:10:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T03:10:39.985 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T03:10:39.985 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T03:10:39.985 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-10-06T03:10:40.006 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-10-06T03:10:40.023 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-10-06T03:10:40.024 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-10-06T03:10:40.079 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T03:10:40.079 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.4" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T03:10:40.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:10:40.081 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T03:10:40.081 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T03:10:40.081 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T03:10:40.081 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T03:10:40.081 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-10-06T03:10:40.106 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T03:10:40.114 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T03:10:40.119 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T03:10:40.119 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2023-10-06T03:10:40.122 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2023-10-06T03:10:40.136 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T03:10:40.142 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T03:10:40.142 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2023-10-06T03:10:40.177 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2023-10-06T03:10:40.191 INFO:teuthology.orchestra.run.smithi084.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T03:10:40.193 INFO:teuthology.orchestra.run.smithi131.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T03:10:40.194 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T03:10:40.252 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T03:10:40.266 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T03:10:40.267 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-06T03:10:40.267 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-06T03:10:40.267 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T03:10:40.268 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T03:10:40.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:10:40.283 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2023-10-06T03:10:40.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:10:40.284 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-10-06T03:10:40.339 INFO:teuthology.orchestra.run.smithi131.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T03:10:40.339 INFO:teuthology.task.kernel:Running kernel on smithi131: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T03:10:40.339 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum install -y kernel 2023-10-06T03:10:40.340 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T03:10:40.341 INFO:teuthology.task.kernel:Running kernel on smithi084: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T03:10:40.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2023-10-06T03:10:41.813 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-10-06T03:10:41.814 INFO:teuthology.orchestra.run.smithi131.stdout:Unable to read consumer identity 2023-10-06T03:10:41.843 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-10-06T03:10:41.844 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-10-06T03:10:43.175 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-10-06T03:10:43.204 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 37 kB/s | 3.5 kB 00:00 2023-10-06T03:10:43.847 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-10-06T03:10:43.892 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-10-06T03:10:47.143 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-06T03:10:47.180 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-06T03:10:47.888 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T03:10:47.888 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T03:10:47.889 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T03:10:47.938 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T03:10:47.938 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T03:10:47.938 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T03:10:48.052 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-10-06T03:10:48.053 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2023-10-06T03:10:48.053 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-10-06T03:10:48.097 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-10-06T03:10:48.098 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2023-10-06T03:10:48.098 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-10-06T03:10:48.160 DEBUG:teuthology.orchestra.run.smithi131:> echo no | sudo yum reinstall kernel || true 2023-10-06T03:10:48.238 DEBUG:teuthology.orchestra.run.smithi084:> echo no | sudo yum reinstall kernel || true 2023-10-06T03:10:48.503 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-10-06T03:10:48.504 INFO:teuthology.orchestra.run.smithi131.stdout:Unable to read consumer identity 2023-10-06T03:10:48.580 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-10-06T03:10:48.580 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-10-06T03:10:48.800 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 03:10:47 AM UTC. 2023-10-06T03:10:48.878 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 03:10:47 AM UTC. 2023-10-06T03:10:48.929 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T03:10:48.929 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:10:48.929 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:10:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:Error: No packages marked for reinstall. 2023-10-06T03:10:49.007 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum reinstall -y kernel || true 2023-10-06T03:10:49.015 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T03:10:49.016 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:10:49.016 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:10:49.065 INFO:teuthology.orchestra.run.smithi084.stderr:Error: No packages marked for reinstall. 2023-10-06T03:10:49.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum reinstall -y kernel || true 2023-10-06T03:10:49.348 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-10-06T03:10:49.349 INFO:teuthology.orchestra.run.smithi131.stdout:Unable to read consumer identity 2023-10-06T03:10:49.458 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-10-06T03:10:49.458 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-10-06T03:10:49.640 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 03:10:47 AM UTC. 2023-10-06T03:10:49.742 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 03:10:47 AM UTC. 2023-10-06T03:10:49.777 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T03:10:49.778 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:10:49.778 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:10:49.794 INFO:teuthology.orchestra.run.smithi131.stderr:Error: No packages marked for reinstall. 2023-10-06T03:10:49.850 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T03:10:49.887 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T03:10:49.887 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:10:49.887 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:10:49.897 INFO:teuthology.orchestra.run.smithi084.stderr:Error: No packages marked for reinstall. 2023-10-06T03:10:49.946 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T03:10:49.976 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:49.976 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:49.976 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:49.976 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T03:10:49.976 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T03:10:49.976 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T03:10:49.976 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T03:10:49.976 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T03:10:50.071 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:50.071 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:50.071 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:50.071 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T03:10:50.071 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T03:10:50.071 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T03:10:50.071 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T03:10:50.072 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T03:10:50.101 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:50.101 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:50.101 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2023-10-06T03:10:50.128 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2023-10-06T03:10:50.128 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2023-10-06T03:10:50.128 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.02 2023-10-06T03:10:50.128 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 99.el8_4.1 2023-10-06T03:10:50.128 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2023-10-06T03:10:50.128 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T03:10:50.128 INFO:teuthology.orchestra.run.smithi131.stdout:Group : System Environment/Base 2023-10-06T03:10:50.128 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 9264631 2023-10-06T03:10:50.128 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2023-10-06T03:10:50.128 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:Relocations : (not relocatable) 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : Red Hat, Inc. 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : Red Hat, Inc. 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T03:10:50.129 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T03:10:50.130 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T03:10:50.130 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2023-10-06T03:10:50.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:10:50.130 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T03:10:50.131 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T03:10:50.131 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:50.131 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T03:10:50.197 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:50.197 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:50.197 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2023-10-06T03:10:50.224 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2023-10-06T03:10:50.224 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2023-10-06T03:10:50.224 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.02 2023-10-06T03:10:50.224 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 99.el8_4.1 2023-10-06T03:10:50.224 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:Group : System Environment/Base 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 9264631 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:Relocations : (not relocatable) 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : Red Hat, Inc. 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : Red Hat, Inc. 2023-10-06T03:10:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T03:10:50.226 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2023-10-06T03:10:50.226 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2023-10-06T03:10:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:10:50.226 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T03:10:50.226 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T03:10:50.226 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T03:10:50.226 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2023-10-06T03:10:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:10:50.226 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T03:10:50.227 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T03:10:50.227 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:50.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T03:10:51.512 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2023-10-06T03:10:51.654 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2023-10-06T03:10:53.621 INFO:teuthology.orchestra.run.smithi131.stderr:done 2023-10-06T03:10:53.623 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-10-06T03:10:53.666 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.uM8hWtpW1c 2023-10-06T03:10:53.667 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uM8hWtpW1c 2023-10-06T03:10:53.738 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.uM8hWtpW1c 2023-10-06T03:10:54.567 INFO:teuthology.orchestra.run.smithi084.stderr:done 2023-10-06T03:10:54.567 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-10-06T03:10:54.583 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.ZrgMow1jk6 2023-10-06T03:10:54.724 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ZrgMow1jk6 2023-10-06T03:10:54.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.ZrgMow1jk6 2023-10-06T03:10:55.097 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.uM8hWtpW1c is 6KB 2023-10-06T03:10:55.256 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.uM8hWtpW1c 2023-10-06T03:10:55.280 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.ZrgMow1jk6 is 6KB 2023-10-06T03:10:55.292 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T03:10:55.526 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.ZrgMow1jk6 2023-10-06T03:10:55.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T03:10:55.562 INFO:teuthology.orchestra.run.smithi131.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T03:10:55.562 INFO:teuthology.orchestra.run.smithi131.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T03:10:55.562 INFO:teuthology.orchestra.run.smithi131.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T03:10:55.562 INFO:teuthology.orchestra.run.smithi131.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T03:10:55.563 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:55.611 INFO:teuthology.orchestra.run.smithi084.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T03:10:55.611 INFO:teuthology.orchestra.run.smithi084.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T03:10:55.611 INFO:teuthology.orchestra.run.smithi084.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T03:10:55.611 INFO:teuthology.orchestra.run.smithi084.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T03:10:55.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:10:55.744 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2023-10-06T03:10:55.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2023-10-06T03:11:25.774 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T03:11:25.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T03:11:25.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:11:25.829 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T03:11:25.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T03:11:25.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:11:44.250 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-06T03:11:44.251 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-06T03:11:53.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T03:11:53.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:11:53.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T03:11:53.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:11:56.314 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-06T03:11:56.315 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-06T03:12:08.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T03:12:08.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:12:08.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T03:12:08.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:12:26.750 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-06T03:12:40.243 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-10-06T03:12:40.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T03:12:40.770 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T03:12:40.771 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2023-10-06T03:12:40.800 INFO:teuthology.orchestra.run.smithi131.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T03:12:40.800 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:12:40.800 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T03:12:40.800 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T03:12:41.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T03:12:41.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:12:41.801 DEBUG:teuthology.parallel:result is None 2023-10-06T03:12:42.106 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-10-06T03:12:42.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T03:12:42.470 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T03:12:42.473 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-10-06T03:12:42.487 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T03:12:42.488 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:12:42.488 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T03:12:42.488 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T03:12:43.489 DEBUG:teuthology.parallel:result is None 2023-10-06T03:12:43.489 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T03:12:43.498 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T03:12:43.498 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T03:12:43.545 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T03:12:43.799 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T03:12:43.805 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T03:12:43.846 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T03:12:43.846 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T03:12:43.882 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T03:12:44.153 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T03:12:44.159 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T03:12:44.160 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T03:12:44.205 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T03:12:44.294 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:12:44.312 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:12:44.797 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:12:44.971 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:12:44.974 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T03:12:44.982 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T03:12:44.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T03:12:45.036 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T03:12:45.392 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T03:12:45.401 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T03:12:45.401 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T03:12:45.421 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T03:12:45.464 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:12:45.547 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:12:45.613 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:12:45.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:12:45.695 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:12:45.695 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T03:12:45.761 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:12:45.804 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:12:45.877 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:12:45.919 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:12:45.960 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:12:45.960 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T03:12:46.026 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2023-10-06T03:12:46.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2023-10-06T03:12:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:12:46.295 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:12:46.313 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T03:12:46.321 INFO:teuthology.task.internal:Starting timer... 2023-10-06T03:12:46.321 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T03:12:46.331 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T03:12:46.339 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T03:12:46.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2023-10-06T03:12:46.513 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: [ OK ] 2023-10-06T03:12:46.515 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2023-10-06T03:12:46.566 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: [ OK ] 2023-10-06T03:12:46.567 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T03:12:46.567 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2023-10-06T03:12:46.591 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2023-10-06T03:12:46.591 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2023-10-06T03:12:46.617 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2023-10-06T03:12:46.617 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi131.front.sepia.ceph.com': 'permissive'} 2023-10-06T03:12:46.618 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:12:46.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:12:46.657 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:12:46.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:12:46.682 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T03:12:46.682 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2023-10-06T03:12:46.723 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2023-10-06T03:12:46.748 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T03:12:46.757 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T03:12:46.762 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T03:12:46.904 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T03:12:46.919 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T03:12:46.920 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T03:20:52.232 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2023-10-06T03:20:52.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T03:20:52.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:20:52.302 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-10-06T03:20:52.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T03:20:52.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T03:20:52.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:20:52.432 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-10-06T03:20:52.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T03:20:52.500 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T03:20:52.513 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T03:20:52.513 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T03:20:52.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:20:52.516 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T03:20:52.516 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:20:52.542 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T03:20:52.556 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T03:20:52.569 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T03:20:52.583 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T03:20:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2023-10-06T03:20:52.607 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2023-10-06T03:20:52.618 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2023-10-06T03:20:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T03:20:52.629 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2023-10-06T03:20:52.634 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T03:20:52.643 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T03:20:52.657 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T03:20:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2023-10-06T03:20:52.704 INFO:teuthology.orchestra.run.smithi084.stdout:210 Number of sources = 4 2023-10-06T03:20:52.704 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:20:52.704 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-10-06T03:20:52.704 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:52.705 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:52.705 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:52.705 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:52.730 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2023-10-06T03:20:52.733 INFO:teuthology.orchestra.run.smithi131.stdout:210 Number of sources = 4 2023-10-06T03:20:52.733 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:20:52.733 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-10-06T03:20:52.733 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:52.734 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:52.734 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:52.734 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:52.734 INFO:teuthology.run_tasks:Running task install... 2023-10-06T03:20:52.742 DEBUG:teuthology.task.install:project ceph 2023-10-06T03:20:52.742 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T03:20:52.742 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T03:20:52.742 INFO:teuthology.task.install:Using flavor: default 2023-10-06T03:20:52.748 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T03:20:52.748 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T03:20:52.748 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T03:20:52.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:20:52.750 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T03:20:52.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:20:52.893 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T03:20:52.894 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T03:20:52.959 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T03:20:52.959 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T03:20:53.154 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T03:20:53.155 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:20:53.155 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T03:20:53.181 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T03:20:53.181 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T03:20:53.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T03:20:53.278 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T03:20:53.278 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:20:53.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T03:20:53.307 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T03:20:53.307 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T03:20:53.322 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T03:20:53.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T03:20:53.385 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2023-10-06T03:20:53.386 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2023-10-06T03:20:53.450 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T03:20:53.515 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2023-10-06T03:20:53.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2023-10-06T03:20:53.777 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-10-06T03:20:53.907 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-10-06T03:20:54.052 INFO:teuthology.orchestra.run.smithi131.stdout:44 files removed 2023-10-06T03:20:54.109 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T03:20:54.185 INFO:teuthology.orchestra.run.smithi084.stdout:44 files removed 2023-10-06T03:20:54.240 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T03:20:54.458 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-10-06T03:20:54.595 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-10-06T03:20:55.271 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 213 kB/s | 78 kB 00:00 2023-10-06T03:20:55.390 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 241 kB/s | 78 kB 00:00 2023-10-06T03:20:55.568 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 36 kB/s | 9.2 kB 00:00 2023-10-06T03:20:55.757 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 28 kB/s | 9.2 kB 00:00 2023-10-06T03:20:55.889 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 5.0 kB/s | 1.4 kB 00:00 2023-10-06T03:20:55.999 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-06T03:20:56.084 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 4.9 kB/s | 1.4 kB 00:00 2023-10-06T03:20:56.194 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-06T03:20:57.077 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-06T03:20:57.661 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-06T03:21:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-06T03:21:00.741 INFO:teuthology.orchestra.run.smithi131.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 123 MB/s | 38 MB 00:00 2023-10-06T03:21:01.014 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-06T03:21:01.407 INFO:teuthology.orchestra.run.smithi084.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 123 MB/s | 38 MB 00:00 2023-10-06T03:21:06.268 INFO:teuthology.orchestra.run.smithi131.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 121 MB/s | 33 MB 00:00 2023-10-06T03:21:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 121 MB/s | 33 MB 00:00 2023-10-06T03:21:14.155 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:21:14.156 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:21:14.166 INFO:teuthology.orchestra.run.smithi131.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T03:21:14.167 INFO:teuthology.orchestra.run.smithi131.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T03:21:14.167 INFO:teuthology.orchestra.run.smithi131.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T03:21:14.168 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T03:21:14.170 INFO:teuthology.orchestra.run.smithi131.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T03:21:14.172 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T03:21:14.173 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T03:21:14.654 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-10-06T03:21:14.665 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================================== 2023-10-06T03:21:14.666 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2023-10-06T03:21:14.666 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================================== 2023-10-06T03:21:14.666 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2023-10-06T03:21:14.666 INFO:teuthology.orchestra.run.smithi131.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T03:21:14.666 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T03:21:14.666 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T03:21:14.666 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T03:21:14.666 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T03:21:14.666 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T03:21:14.667 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T03:21:14.668 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T03:21:14.669 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T03:21:14.670 INFO:teuthology.orchestra.run.smithi131.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T03:21:14.671 INFO:teuthology.orchestra.run.smithi131.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T03:21:14.672 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T03:21:14.673 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T03:21:14.674 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T03:21:14.675 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T03:21:14.676 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T03:21:14.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:21:14.677 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-10-06T03:21:14.677 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================================== 2023-10-06T03:21:14.677 INFO:teuthology.orchestra.run.smithi131.stdout:Install 118 Packages 2023-10-06T03:21:14.677 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 2 Packages 2023-10-06T03:21:14.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:21:14.677 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 201 M 2023-10-06T03:21:14.678 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-10-06T03:21:14.837 INFO:teuthology.orchestra.run.smithi131.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 70 kB/s | 6.4 kB 00:00 2023-10-06T03:21:14.852 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:21:14.853 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:21:14.864 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T03:21:14.865 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T03:21:14.866 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T03:21:14.867 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T03:21:14.868 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T03:21:14.871 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T03:21:14.872 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T03:21:14.984 INFO:teuthology.orchestra.run.smithi131.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 5.8 MB/s | 876 kB 00:00 2023-10-06T03:21:15.007 INFO:teuthology.orchestra.run.smithi131.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 7.1 MB/s | 162 kB 00:00 2023-10-06T03:21:15.224 INFO:teuthology.orchestra.run.smithi131.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 11 MB/s | 2.3 MB 00:00 2023-10-06T03:21:15.379 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-10-06T03:21:15.390 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================================================== 2023-10-06T03:21:15.390 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2023-10-06T03:21:15.390 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================================================== 2023-10-06T03:21:15.390 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2023-10-06T03:21:15.390 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T03:21:15.390 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T03:21:15.390 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T03:21:15.390 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T03:21:15.391 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T03:21:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T03:21:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T03:21:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T03:21:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T03:21:15.396 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T03:21:15.397 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T03:21:15.399 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T03:21:15.400 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T03:21:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T03:21:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T03:21:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:21:15.401 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2023-10-06T03:21:15.401 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================================================== 2023-10-06T03:21:15.401 INFO:teuthology.orchestra.run.smithi084.stdout:Install 118 Packages 2023-10-06T03:21:15.401 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2023-10-06T03:21:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:21:15.402 INFO:teuthology.orchestra.run.smithi131.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 9.3 MB/s | 1.6 MB 00:00 2023-10-06T03:21:15.402 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 201 M 2023-10-06T03:21:15.402 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2023-10-06T03:21:15.664 INFO:teuthology.orchestra.run.smithi084.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-10-06T03:21:15.777 INFO:teuthology.orchestra.run.smithi131.stdout:(6/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 5.0 MB/s | 5.2 MB 00:01 2023-10-06T03:21:15.822 INFO:teuthology.orchestra.run.smithi131.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 9.1 MB/s | 3.9 MB 00:00 2023-10-06T03:21:16.195 INFO:teuthology.orchestra.run.smithi084.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.6 MB/s | 876 kB 00:00 2023-10-06T03:21:16.255 INFO:teuthology.orchestra.run.smithi084.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 2.6 MB/s | 162 kB 00:00 2023-10-06T03:21:16.872 INFO:teuthology.orchestra.run.smithi084.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 3.7 MB/s | 2.3 MB 00:00 2023-10-06T03:21:17.243 INFO:teuthology.orchestra.run.smithi084.stdout:(5/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 2.9 MB/s | 5.2 MB 00:01 2023-10-06T03:21:17.248 INFO:teuthology.orchestra.run.smithi084.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 4.2 MB/s | 1.6 MB 00:00 2023-10-06T03:21:17.509 INFO:teuthology.orchestra.run.smithi131.stdout:(8/120): ceph-common-17.2.6-1296.g736ac5ba.el8. 8.5 MB/s | 23 MB 00:02 2023-10-06T03:21:17.581 INFO:teuthology.orchestra.run.smithi131.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 337 kB/s | 24 kB 00:00 2023-10-06T03:21:18.195 INFO:teuthology.orchestra.run.smithi131.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 7.1 MB/s | 17 MB 00:02 2023-10-06T03:21:18.265 INFO:teuthology.orchestra.run.smithi131.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 3.6 MB/s | 255 kB 00:00 2023-10-06T03:21:18.311 INFO:teuthology.orchestra.run.smithi084.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 3.7 MB/s | 3.9 MB 00:01 2023-10-06T03:21:18.327 INFO:teuthology.orchestra.run.smithi131.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 404 kB/s | 25 kB 00:00 2023-10-06T03:21:18.598 INFO:teuthology.orchestra.run.smithi131.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 2.9 MB/s | 797 kB 00:00 2023-10-06T03:21:18.715 INFO:teuthology.orchestra.run.smithi131.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 1.5 MB/s | 174 kB 00:00 2023-10-06T03:21:18.830 INFO:teuthology.orchestra.run.smithi131.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 1.1 MB/s | 130 kB 00:00 2023-10-06T03:21:18.983 INFO:teuthology.orchestra.run.smithi131.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 3.2 MB/s | 507 kB 00:00 2023-10-06T03:21:18.999 INFO:teuthology.orchestra.run.smithi084.stdout:(8/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 9.5 MB/s | 17 MB 00:01 2023-10-06T03:21:19.022 INFO:teuthology.orchestra.run.smithi084.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 1.0 MB/s | 24 kB 00:00 2023-10-06T03:21:19.097 INFO:teuthology.orchestra.run.smithi131.stdout:(17/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 5.0 MB/s | 17 MB 00:03 2023-10-06T03:21:19.169 INFO:teuthology.orchestra.run.smithi131.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 624 kB/s | 45 kB 00:00 2023-10-06T03:21:19.244 INFO:teuthology.orchestra.run.smithi131.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 1.5 MB/s | 115 kB 00:00 2023-10-06T03:21:19.322 INFO:teuthology.orchestra.run.smithi131.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 2.4 MB/s | 190 kB 00:00 2023-10-06T03:21:19.472 INFO:teuthology.orchestra.run.smithi131.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 2.4 MB/s | 371 kB 00:00 2023-10-06T03:21:19.623 INFO:teuthology.orchestra.run.smithi131.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 2.3 MB/s | 358 kB 00:00 2023-10-06T03:21:19.701 INFO:teuthology.orchestra.run.smithi131.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 1.3 MB/s | 107 kB 00:00 2023-10-06T03:21:19.778 INFO:teuthology.orchestra.run.smithi131.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.1 MB/s | 90 kB 00:00 2023-10-06T03:21:20.791 INFO:teuthology.orchestra.run.smithi131.stdout:(25/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 3.4 MB/s | 3.5 MB 00:01 2023-10-06T03:21:20.869 INFO:teuthology.orchestra.run.smithi131.stdout:(26/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 2.9 MB/s | 5.6 MB 00:01 2023-10-06T03:21:20.880 INFO:teuthology.orchestra.run.smithi131.stdout:(27/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 1.9 MB/s | 173 kB 00:00 2023-10-06T03:21:20.926 INFO:teuthology.orchestra.run.smithi131.stdout:(28/120): ceph-grafana-dashboards-17.2.6-1296.g 403 kB/s | 23 kB 00:00 2023-10-06T03:21:20.957 INFO:teuthology.orchestra.run.smithi131.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.5 MB/s | 121 kB 00:00 2023-10-06T03:21:21.441 INFO:teuthology.orchestra.run.smithi131.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 3.3 MB/s | 1.7 MB 00:00 2023-10-06T03:21:21.517 INFO:teuthology.orchestra.run.smithi131.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 3.1 MB/s | 238 kB 00:00 2023-10-06T03:21:21.587 INFO:teuthology.orchestra.run.smithi131.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 681 kB/s | 47 kB 00:00 2023-10-06T03:21:21.655 INFO:teuthology.orchestra.run.smithi131.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 214 kB/s | 14 kB 00:00 2023-10-06T03:21:21.732 INFO:teuthology.orchestra.run.smithi131.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.4 MB/s | 267 kB 00:00 2023-10-06T03:21:21.803 INFO:teuthology.orchestra.run.smithi131.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.1 MB/s | 80 kB 00:00 2023-10-06T03:21:21.870 INFO:teuthology.orchestra.run.smithi131.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 271 kB/s | 18 kB 00:00 2023-10-06T03:21:22.618 INFO:teuthology.orchestra.run.smithi131.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 410 kB/s | 306 kB 00:00 2023-10-06T03:21:22.715 INFO:teuthology.orchestra.run.smithi131.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 602 kB/s | 59 kB 00:00 2023-10-06T03:21:22.836 INFO:teuthology.orchestra.run.smithi131.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 622 kB/s | 75 kB 00:00 2023-10-06T03:21:22.931 INFO:teuthology.orchestra.run.smithi131.stdout:(40/120): ceph-mgr-diskprediction-local-17.2.6- 3.7 MB/s | 7.4 MB 00:01 2023-10-06T03:21:22.958 INFO:teuthology.orchestra.run.smithi084.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 3.6 MB/s | 17 MB 00:04 2023-10-06T03:21:23.015 INFO:teuthology.orchestra.run.smithi131.stdout:(41/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.6 MB/s | 476 kB 00:00 2023-10-06T03:21:23.021 INFO:teuthology.orchestra.run.smithi084.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 4.0 MB/s | 255 kB 00:00 2023-10-06T03:21:23.074 INFO:teuthology.orchestra.run.smithi084.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 471 kB/s | 25 kB 00:00 2023-10-06T03:21:23.092 INFO:teuthology.orchestra.run.smithi131.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-10-06T03:21:23.166 INFO:teuthology.orchestra.run.smithi131.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 444 kB/s | 33 kB 00:00 2023-10-06T03:21:23.191 INFO:teuthology.orchestra.run.smithi131.stdout:(44/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 168 kB/s | 44 kB 00:00 2023-10-06T03:21:23.251 INFO:teuthology.orchestra.run.smithi131.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 193 kB/s | 16 kB 00:00 2023-10-06T03:21:23.369 INFO:teuthology.orchestra.run.smithi131.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 971 kB/s | 173 kB 00:00 2023-10-06T03:21:23.379 INFO:teuthology.orchestra.run.smithi131.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 2.9 MB/s | 384 kB 00:00 2023-10-06T03:21:23.446 INFO:teuthology.orchestra.run.smithi084.stdout:(13/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 12 MB/s | 52 MB 00:04 2023-10-06T03:21:23.454 INFO:teuthology.orchestra.run.smithi084.stdout:(14/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 2.0 MB/s | 797 kB 00:00 2023-10-06T03:21:23.459 INFO:teuthology.orchestra.run.smithi131.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 895 kB/s | 81 kB 00:00 2023-10-06T03:21:23.470 INFO:teuthology.orchestra.run.smithi084.stdout:(15/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 7.3 MB/s | 174 kB 00:00 2023-10-06T03:21:23.472 INFO:teuthology.orchestra.run.smithi131.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 119 kB/s | 11 kB 00:00 2023-10-06T03:21:23.479 INFO:teuthology.orchestra.run.smithi084.stdout:(16/120): librados-devel-17.2.6-1296.g736ac5ba. 5.2 MB/s | 130 kB 00:00 2023-10-06T03:21:23.518 INFO:teuthology.orchestra.run.smithi131.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 304 kB/s | 18 kB 00:00 2023-10-06T03:21:23.536 INFO:teuthology.orchestra.run.smithi084.stdout:(17/120): libradosstriper1-17.2.6-1296.g736ac5b 7.6 MB/s | 507 kB 00:00 2023-10-06T03:21:23.564 INFO:teuthology.orchestra.run.smithi084.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.6 MB/s | 45 kB 00:00 2023-10-06T03:21:23.582 INFO:teuthology.orchestra.run.smithi131.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 760 kB/s | 49 kB 00:00 2023-10-06T03:21:23.595 INFO:teuthology.orchestra.run.smithi084.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 3.6 MB/s | 115 kB 00:00 2023-10-06T03:21:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 5.1 MB/s | 190 kB 00:00 2023-10-06T03:21:23.649 INFO:teuthology.orchestra.run.smithi131.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 883 kB/s | 59 kB 00:00 2023-10-06T03:21:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 8.6 MB/s | 371 kB 00:00 2023-10-06T03:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 8.3 MB/s | 358 kB 00:00 2023-10-06T03:21:23.718 INFO:teuthology.orchestra.run.smithi131.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 4.7 MB/s | 1.2 MB 00:00 2023-10-06T03:21:23.719 INFO:teuthology.orchestra.run.smithi131.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 861 kB/s | 60 kB 00:00 2023-10-06T03:21:23.749 INFO:teuthology.orchestra.run.smithi084.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 3.2 MB/s | 107 kB 00:00 2023-10-06T03:21:23.776 INFO:teuthology.orchestra.run.smithi131.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 274 kB/s | 16 kB 00:00 2023-10-06T03:21:23.778 INFO:teuthology.orchestra.run.smithi084.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 3.1 MB/s | 90 kB 00:00 2023-10-06T03:21:23.813 INFO:teuthology.orchestra.run.smithi131.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.9 MB/s | 283 kB 00:00 2023-10-06T03:21:23.870 INFO:teuthology.orchestra.run.smithi131.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 359 kB/s | 34 kB 00:00 2023-10-06T03:21:23.937 INFO:teuthology.orchestra.run.smithi131.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 950 kB/s | 64 kB 00:00 2023-10-06T03:21:23.938 INFO:teuthology.orchestra.run.smithi131.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-10-06T03:21:23.997 INFO:teuthology.orchestra.run.smithi131.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 317 kB/s | 19 kB 00:00 2023-10-06T03:21:24.022 INFO:teuthology.orchestra.run.smithi084.stdout:(25/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 14 MB/s | 3.5 MB 00:00 2023-10-06T03:21:24.026 INFO:teuthology.orchestra.run.smithi131.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 274 kB/s | 24 kB 00:00 2023-10-06T03:21:24.058 INFO:teuthology.orchestra.run.smithi084.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 4.8 MB/s | 173 kB 00:00 2023-10-06T03:21:24.061 INFO:teuthology.orchestra.run.smithi131.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 457 kB/s | 29 kB 00:00 2023-10-06T03:21:24.086 INFO:teuthology.orchestra.run.smithi084.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 814 kB/s | 23 kB 00:00 2023-10-06T03:21:24.113 INFO:teuthology.orchestra.run.smithi131.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 315 kB/s | 27 kB 00:00 2023-10-06T03:21:24.118 INFO:teuthology.orchestra.run.smithi084.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 3.8 MB/s | 121 kB 00:00 2023-10-06T03:21:24.168 INFO:teuthology.orchestra.run.smithi131.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-10-06T03:21:24.214 INFO:teuthology.orchestra.run.smithi131.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-10-06T03:21:24.231 INFO:teuthology.orchestra.run.smithi131.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 969 kB/s | 61 kB 00:00 2023-10-06T03:21:24.240 INFO:teuthology.orchestra.run.smithi084.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 14 MB/s | 1.7 MB 00:00 2023-10-06T03:21:24.289 INFO:teuthology.orchestra.run.smithi131.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 396 kB/s | 23 kB 00:00 2023-10-06T03:21:24.310 INFO:teuthology.orchestra.run.smithi131.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 900 kB/s | 85 kB 00:00 2023-10-06T03:21:24.313 INFO:teuthology.orchestra.run.smithi131.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-10-06T03:21:24.343 INFO:teuthology.orchestra.run.smithi131.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 648 kB/s | 19 kB 00:00 2023-10-06T03:21:24.356 INFO:teuthology.orchestra.run.smithi131.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.2 MB/s | 43 kB 00:00 2023-10-06T03:21:24.370 INFO:teuthology.orchestra.run.smithi131.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 11 MB/s | 155 kB 00:00 2023-10-06T03:21:24.393 INFO:teuthology.orchestra.run.smithi084.stdout:(30/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 6.1 MB/s | 5.6 MB 00:00 2023-10-06T03:21:24.440 INFO:teuthology.orchestra.run.smithi084.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 5.0 MB/s | 238 kB 00:00 2023-10-06T03:21:24.480 INFO:teuthology.orchestra.run.smithi084.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 1.2 MB/s | 47 kB 00:00 2023-10-06T03:21:24.517 INFO:teuthology.orchestra.run.smithi084.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 398 kB/s | 14 kB 00:00 2023-10-06T03:21:24.562 INFO:teuthology.orchestra.run.smithi084.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 5.7 MB/s | 267 kB 00:00 2023-10-06T03:21:24.603 INFO:teuthology.orchestra.run.smithi084.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.9 MB/s | 80 kB 00:00 2023-10-06T03:21:24.636 INFO:teuthology.orchestra.run.smithi084.stdout:(36/120): ceph-mgr-diskprediction-local-17.2.6- 19 MB/s | 7.4 MB 00:00 2023-10-06T03:21:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:(37/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 537 kB/s | 18 kB 00:00 2023-10-06T03:21:24.807 INFO:teuthology.orchestra.run.smithi131.stdout:(73/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 7.1 MB/s | 52 MB 00:07 2023-10-06T03:21:24.812 INFO:teuthology.orchestra.run.smithi131.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 499 kB/s | 220 kB 00:00 2023-10-06T03:21:24.826 INFO:teuthology.orchestra.run.smithi131.stdout:(75/120): thrift-0.13.0-2.el8.x86_64.rpm 3.2 MB/s | 1.7 MB 00:00 2023-10-06T03:21:24.833 INFO:teuthology.orchestra.run.smithi131.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 11 MB/s | 229 kB 00:00 2023-10-06T03:21:24.841 INFO:teuthology.orchestra.run.smithi131.stdout:(77/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.4 MB/s | 48 kB 00:00 2023-10-06T03:21:24.857 INFO:teuthology.orchestra.run.smithi131.stdout:(78/120): python3-requests-oauthlib-1.0.0-1.el8 1.4 MB/s | 43 kB 00:00 2023-10-06T03:21:24.860 INFO:teuthology.orchestra.run.smithi131.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 974 kB/s | 18 kB 00:00 2023-10-06T03:21:24.877 INFO:teuthology.orchestra.run.smithi131.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 53 MB/s | 2.3 MB 00:00 2023-10-06T03:21:24.878 INFO:teuthology.orchestra.run.smithi131.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 4.5 MB/s | 83 kB 00:00 2023-10-06T03:21:24.885 INFO:teuthology.orchestra.run.smithi131.stdout:(82/120): pcre2-devel-10.32-2.el8.x86_64.rpm 22 MB/s | 605 kB 00:00 2023-10-06T03:21:24.895 INFO:teuthology.orchestra.run.smithi131.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 10 MB/s | 169 kB 00:00 2023-10-06T03:21:24.896 INFO:teuthology.orchestra.run.smithi131.stdout:(84/120): elfutils-libelf-devel-0.182-3.el8.x86 3.0 MB/s | 59 kB 00:00 2023-10-06T03:21:24.907 INFO:teuthology.orchestra.run.smithi131.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 1.7 MB/s | 38 kB 00:00 2023-10-06T03:21:24.911 INFO:teuthology.orchestra.run.smithi131.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.8 MB/s | 58 kB 00:00 2023-10-06T03:21:24.918 INFO:teuthology.orchestra.run.smithi131.stdout:(87/120): libsepol-devel-2.9-2.el8.x86_64.rpm 3.7 MB/s | 86 kB 00:00 2023-10-06T03:21:24.923 INFO:teuthology.orchestra.run.smithi131.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.0 MB/s | 47 kB 00:00 2023-10-06T03:21:24.931 INFO:teuthology.orchestra.run.smithi131.stdout:(89/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 28 MB/s | 559 kB 00:00 2023-10-06T03:21:24.941 INFO:teuthology.orchestra.run.smithi131.stdout:(90/120): libgfortran-8.4.1-1.el8.x86_64.rpm 27 MB/s | 639 kB 00:00 2023-10-06T03:21:24.945 INFO:teuthology.orchestra.run.smithi131.stdout:(91/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 3.2 MB/s | 70 kB 00:00 2023-10-06T03:21:24.947 INFO:teuthology.orchestra.run.smithi131.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-06T03:21:24.958 INFO:teuthology.orchestra.run.smithi131.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.8 MB/s | 97 kB 00:00 2023-10-06T03:21:24.960 INFO:teuthology.orchestra.run.smithi131.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 3.2 MB/s | 44 kB 00:00 2023-10-06T03:21:24.972 INFO:teuthology.orchestra.run.smithi131.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.9 MB/s | 27 kB 00:00 2023-10-06T03:21:24.976 INFO:teuthology.orchestra.run.smithi131.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-10-06T03:21:24.989 INFO:teuthology.orchestra.run.smithi131.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-10-06T03:21:24.996 INFO:teuthology.orchestra.run.smithi131.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 23 MB/s | 457 kB 00:00 2023-10-06T03:21:25.009 INFO:teuthology.orchestra.run.smithi131.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.0 MB/s | 39 kB 00:00 2023-10-06T03:21:25.032 INFO:teuthology.orchestra.run.smithi131.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 29 MB/s | 688 kB 00:00 2023-10-06T03:21:25.049 INFO:teuthology.orchestra.run.smithi131.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 16 MB/s | 259 kB 00:00 2023-10-06T03:21:25.074 INFO:teuthology.orchestra.run.smithi131.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 57 MB/s | 4.8 MB 00:00 2023-10-06T03:21:25.076 INFO:teuthology.orchestra.run.smithi131.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 8.0 MB/s | 225 kB 00:00 2023-10-06T03:21:25.088 INFO:teuthology.orchestra.run.smithi131.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.7 MB/s | 126 kB 00:00 2023-10-06T03:21:25.098 INFO:teuthology.orchestra.run.smithi084.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 128 kB/s | 59 kB 00:00 2023-10-06T03:21:25.104 INFO:teuthology.orchestra.run.smithi131.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-06T03:21:25.125 INFO:teuthology.orchestra.run.smithi131.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 26 MB/s | 538 kB 00:00 2023-10-06T03:21:25.147 INFO:teuthology.orchestra.run.smithi131.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 53 MB/s | 3.7 MB 00:00 2023-10-06T03:21:25.197 INFO:teuthology.orchestra.run.smithi084.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 759 kB/s | 75 kB 00:00 2023-10-06T03:21:25.223 INFO:teuthology.orchestra.run.smithi084.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 522 kB/s | 306 kB 00:00 2023-10-06T03:21:25.258 INFO:teuthology.orchestra.run.smithi131.stdout:(108/120): python3-scipy-1.0.0-20.module+el8.1. 46 MB/s | 15 MB 00:00 2023-10-06T03:21:25.260 INFO:teuthology.orchestra.run.smithi131.stdout:(109/120): socat-1.7.3.3-2.el8.x86_64.rpm 2.2 MB/s | 302 kB 00:00 2023-10-06T03:21:25.262 INFO:teuthology.orchestra.run.smithi131.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2023-10-06T03:21:25.273 INFO:teuthology.orchestra.run.smithi084.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 862 kB/s | 44 kB 00:00 2023-10-06T03:21:25.275 INFO:teuthology.orchestra.run.smithi131.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.4 MB/s | 110 kB 00:00 2023-10-06T03:21:25.277 INFO:teuthology.orchestra.run.smithi131.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 20 MB/s | 353 kB 00:00 2023-10-06T03:21:25.283 INFO:teuthology.orchestra.run.smithi131.stdout:(113/120): python3-jsonpointer-1.10-11.el8.noar 932 kB/s | 20 kB 00:00 2023-10-06T03:21:25.293 INFO:teuthology.orchestra.run.smithi131.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.4 MB/s | 54 kB 00:00 2023-10-06T03:21:25.300 INFO:teuthology.orchestra.run.smithi131.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 28 MB/s | 709 kB 00:00 2023-10-06T03:21:25.325 INFO:teuthology.orchestra.run.smithi131.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 28 MB/s | 713 kB 00:00 2023-10-06T03:21:25.340 INFO:teuthology.orchestra.run.smithi084.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-10-06T03:21:25.355 INFO:teuthology.orchestra.run.smithi084.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.9 MB/s | 476 kB 00:00 2023-10-06T03:21:25.369 INFO:teuthology.orchestra.run.smithi131.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 55 MB/s | 4.7 MB 00:00 2023-10-06T03:21:25.385 INFO:teuthology.orchestra.run.smithi131.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 50 MB/s | 4.6 MB 00:00 2023-10-06T03:21:25.390 INFO:teuthology.orchestra.run.smithi084.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 656 kB/s | 33 kB 00:00 2023-10-06T03:21:25.402 INFO:teuthology.orchestra.run.smithi084.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 349 kB/s | 16 kB 00:00 2023-10-06T03:21:25.457 INFO:teuthology.orchestra.run.smithi084.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2023-10-06T03:21:25.473 INFO:teuthology.orchestra.run.smithi084.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.3 MB/s | 384 kB 00:00 2023-10-06T03:21:25.512 INFO:teuthology.orchestra.run.smithi084.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.5 MB/s | 81 kB 00:00 2023-10-06T03:21:25.520 INFO:teuthology.orchestra.run.smithi084.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 234 kB/s | 11 kB 00:00 2023-10-06T03:21:25.560 INFO:teuthology.orchestra.run.smithi084.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 368 kB/s | 18 kB 00:00 2023-10-06T03:21:25.612 INFO:teuthology.orchestra.run.smithi084.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 930 kB/s | 49 kB 00:00 2023-10-06T03:21:25.641 INFO:teuthology.orchestra.run.smithi084.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 9.7 MB/s | 1.2 MB 00:00 2023-10-06T03:21:25.656 INFO:teuthology.orchestra.run.smithi131.stdout:(119/120): librados2-17.2.6-1296.g736ac5ba.el8. 10 MB/s | 3.5 MB 00:00 2023-10-06T03:21:25.668 INFO:teuthology.orchestra.run.smithi084.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-06T03:21:25.749 INFO:teuthology.orchestra.run.smithi084.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.4 MB/s | 283 kB 00:00 2023-10-06T03:21:25.798 INFO:teuthology.orchestra.run.smithi084.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 317 kB/s | 16 kB 00:00 2023-10-06T03:21:25.847 INFO:teuthology.orchestra.run.smithi084.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 685 kB/s | 34 kB 00:00 2023-10-06T03:21:25.915 INFO:teuthology.orchestra.run.smithi084.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 2.8 MB/s | 196 kB 00:00 2023-10-06T03:21:25.918 INFO:teuthology.orchestra.run.smithi131.stdout:(120/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 6.5 MB/s | 3.6 MB 00:00 2023-10-06T03:21:25.922 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-10-06T03:21:25.922 INFO:teuthology.orchestra.run.smithi131.stdout:Total 18 MB/s | 201 MB 00:11 2023-10-06T03:21:25.942 INFO:teuthology.orchestra.run.smithi084.stdout:(58/120): python3-natsort-7.1.1-2.el8.noarch.rp 200 kB/s | 60 kB 00:00 2023-10-06T03:21:25.969 INFO:teuthology.orchestra.run.smithi084.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2023-10-06T03:21:25.969 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-10-06T03:21:25.992 INFO:teuthology.orchestra.run.smithi084.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 377 kB/s | 19 kB 00:00 2023-10-06T03:21:26.019 INFO:teuthology.orchestra.run.smithi084.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 477 kB/s | 24 kB 00:00 2023-10-06T03:21:26.041 INFO:teuthology.orchestra.run.smithi084.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 600 kB/s | 29 kB 00:00 2023-10-06T03:21:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-10-06T03:21:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-10-06T03:21:26.096 INFO:teuthology.orchestra.run.smithi084.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 4.5 MB/s | 255 kB 00:00 2023-10-06T03:21:26.149 INFO:teuthology.orchestra.run.smithi084.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 4.7 MB/s | 251 kB 00:00 2023-10-06T03:21:26.193 INFO:teuthology.orchestra.run.smithi084.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-10-06T03:21:26.241 INFO:teuthology.orchestra.run.smithi084.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-10-06T03:21:26.289 INFO:teuthology.orchestra.run.smithi084.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 484 kB/s | 23 kB 00:00 2023-10-06T03:21:26.326 INFO:teuthology.orchestra.run.smithi084.stdout:(68/120): python3-trustme-0.6.0-4.el8.noarch.rp 90 kB/s | 27 kB 00:00 2023-10-06T03:21:26.331 INFO:teuthology.orchestra.run.smithi084.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2023-10-06T03:21:26.358 INFO:teuthology.orchestra.run.smithi084.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 684 kB/s | 19 kB 00:00 2023-10-06T03:21:26.370 INFO:teuthology.orchestra.run.smithi084.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.6 MB/s | 43 kB 00:00 2023-10-06T03:21:26.379 INFO:teuthology.orchestra.run.smithi084.stdout:(72/120): thrift-0.13.0-2.el8.x86_64.rpm 19 MB/s | 1.7 MB 00:00 2023-10-06T03:21:26.383 INFO:teuthology.orchestra.run.smithi084.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 12 MB/s | 155 kB 00:00 2023-10-06T03:21:26.396 INFO:teuthology.orchestra.run.smithi084.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.7 MB/s | 48 kB 00:00 2023-10-06T03:21:26.409 INFO:teuthology.orchestra.run.smithi084.stdout:(75/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.2 MB/s | 220 kB 00:00 2023-10-06T03:21:26.413 INFO:teuthology.orchestra.run.smithi084.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 14 MB/s | 229 kB 00:00 2023-10-06T03:21:26.426 INFO:teuthology.orchestra.run.smithi084.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.6 MB/s | 43 kB 00:00 2023-10-06T03:21:26.438 INFO:teuthology.orchestra.run.smithi084.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.4 MB/s | 18 kB 00:00 2023-10-06T03:21:26.457 INFO:teuthology.orchestra.run.smithi084.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 53 MB/s | 2.3 MB 00:00 2023-10-06T03:21:26.576 INFO:teuthology.orchestra.run.smithi084.stdout:(80/120): ceph-common-17.2.6-1296.g736ac5ba.el8 2.1 MB/s | 23 MB 00:11 2023-10-06T03:21:26.638 INFO:teuthology.orchestra.run.smithi084.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 457 kB/s | 83 kB 00:00 2023-10-06T03:21:26.649 INFO:teuthology.orchestra.run.smithi084.stdout:(82/120): pcre2-devel-10.32-2.el8.x86_64.rpm 2.8 MB/s | 605 kB 00:00 2023-10-06T03:21:26.658 INFO:teuthology.orchestra.run.smithi084.stdout:(83/120): elfutils-libelf-devel-0.182-3.el8.x86 719 kB/s | 59 kB 00:00 2023-10-06T03:21:26.659 INFO:teuthology.orchestra.run.smithi084.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 10 MB/s | 169 kB 00:00 2023-10-06T03:21:26.666 INFO:teuthology.orchestra.run.smithi084.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.2 MB/s | 38 kB 00:00 2023-10-06T03:21:26.673 INFO:teuthology.orchestra.run.smithi084.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.7 MB/s | 86 kB 00:00 2023-10-06T03:21:26.676 INFO:teuthology.orchestra.run.smithi084.stdout:(87/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.4 MB/s | 58 kB 00:00 2023-10-06T03:21:26.681 INFO:teuthology.orchestra.run.smithi084.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.0 MB/s | 47 kB 00:00 2023-10-06T03:21:26.695 INFO:teuthology.orchestra.run.smithi084.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.1 MB/s | 70 kB 00:00 2023-10-06T03:21:26.697 INFO:teuthology.orchestra.run.smithi084.stdout:(90/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 23 MB/s | 559 kB 00:00 2023-10-06T03:21:26.701 INFO:teuthology.orchestra.run.smithi084.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 25 MB/s | 639 kB 00:00 2023-10-06T03:21:26.710 INFO:teuthology.orchestra.run.smithi084.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-06T03:21:26.714 INFO:teuthology.orchestra.run.smithi084.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.6 MB/s | 97 kB 00:00 2023-10-06T03:21:26.726 INFO:teuthology.orchestra.run.smithi084.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.7 MB/s | 44 kB 00:00 2023-10-06T03:21:26.733 INFO:teuthology.orchestra.run.smithi084.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.4 MB/s | 27 kB 00:00 2023-10-06T03:21:26.741 INFO:teuthology.orchestra.run.smithi084.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 11 MB/s | 161 kB 00:00 2023-10-06T03:21:26.750 INFO:teuthology.orchestra.run.smithi084.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-10-06T03:21:26.760 INFO:teuthology.orchestra.run.smithi084.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 24 MB/s | 457 kB 00:00 2023-10-06T03:21:26.773 INFO:teuthology.orchestra.run.smithi084.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.0 MB/s | 39 kB 00:00 2023-10-06T03:21:26.797 INFO:teuthology.orchestra.run.smithi084.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 29 MB/s | 688 kB 00:00 2023-10-06T03:21:26.814 INFO:teuthology.orchestra.run.smithi084.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 15 MB/s | 259 kB 00:00 2023-10-06T03:21:26.835 INFO:teuthology.orchestra.run.smithi084.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 56 MB/s | 4.8 MB 00:00 2023-10-06T03:21:26.839 INFO:teuthology.orchestra.run.smithi084.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.0 MB/s | 225 kB 00:00 2023-10-06T03:21:26.850 INFO:teuthology.orchestra.run.smithi084.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.2 MB/s | 126 kB 00:00 2023-10-06T03:21:26.866 INFO:teuthology.orchestra.run.smithi084.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-06T03:21:26.887 INFO:teuthology.orchestra.run.smithi084.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 25 MB/s | 538 kB 00:00 2023-10-06T03:21:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 55 MB/s | 3.7 MB 00:00 2023-10-06T03:21:27.009 INFO:teuthology.orchestra.run.smithi084.stdout:(108/120): python3-scipy-1.0.0-20.module+el8.1. 47 MB/s | 15 MB 00:00 2023-10-06T03:21:27.011 INFO:teuthology.orchestra.run.smithi084.stdout:(109/120): socat-1.7.3.3-2.el8.x86_64.rpm 2.4 MB/s | 302 kB 00:00 2023-10-06T03:21:27.012 INFO:teuthology.orchestra.run.smithi084.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-10-06T03:21:27.025 INFO:teuthology.orchestra.run.smithi084.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.5 MB/s | 110 kB 00:00 2023-10-06T03:21:27.027 INFO:teuthology.orchestra.run.smithi084.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.4 MB/s | 20 kB 00:00 2023-10-06T03:21:27.029 INFO:teuthology.orchestra.run.smithi084.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 20 MB/s | 353 kB 00:00 2023-10-06T03:21:27.042 INFO:teuthology.orchestra.run.smithi084.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.6 MB/s | 54 kB 00:00 2023-10-06T03:21:27.046 INFO:teuthology.orchestra.run.smithi084.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 34 MB/s | 709 kB 00:00 2023-10-06T03:21:27.076 INFO:teuthology.orchestra.run.smithi084.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 23 MB/s | 713 kB 00:00 2023-10-06T03:21:27.112 INFO:teuthology.orchestra.run.smithi084.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 57 MB/s | 4.7 MB 00:00 2023-10-06T03:21:27.134 INFO:teuthology.orchestra.run.smithi084.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 50 MB/s | 4.6 MB 00:00 2023-10-06T03:21:27.342 INFO:teuthology.orchestra.run.smithi084.stdout:(119/120): librados2-17.2.6-1296.g736ac5ba.el8. 13 MB/s | 3.5 MB 00:00 2023-10-06T03:21:27.524 INFO:teuthology.orchestra.run.smithi084.stdout:(120/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 8.7 MB/s | 3.6 MB 00:00 2023-10-06T03:21:27.527 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2023-10-06T03:21:27.527 INFO:teuthology.orchestra.run.smithi084.stdout:Total 17 MB/s | 201 MB 00:12 2023-10-06T03:21:27.575 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2023-10-06T03:21:27.688 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2023-10-06T03:21:27.688 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2023-10-06T03:21:27.809 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-10-06T03:21:27.813 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-10-06T03:21:29.380 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2023-10-06T03:21:29.385 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2023-10-06T03:21:33.348 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-10-06T03:21:33.596 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T03:21:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T03:21:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2023-10-06T03:21:33.951 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T03:21:34.074 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T03:21:34.162 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T03:21:34.291 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T03:21:34.435 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T03:21:34.526 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T03:21:34.624 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T03:21:34.745 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:21:34.997 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T03:21:35.145 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:21:35.182 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:21:35.353 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:21:35.508 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:21:35.587 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:21:35.720 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:21:35.774 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:21:35.820 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:21:35.897 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:21:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:21:36.074 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:21:36.157 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:21:36.354 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:21:36.358 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T03:21:36.679 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T03:21:37.063 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T03:21:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:21:37.342 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T03:21:37.419 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:21:37.515 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:21:37.632 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:21:37.869 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T03:21:38.031 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T03:21:38.059 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T03:21:38.215 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:21:38.227 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T03:21:38.323 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:21:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:21:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:21:38.581 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:21:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:21:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:21:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T03:21:39.258 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:21:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T03:21:39.490 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T03:21:39.601 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T03:21:39.751 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T03:21:39.790 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T03:21:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T03:21:39.997 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T03:21:40.094 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T03:21:40.160 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T03:21:40.286 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T03:21:40.323 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T03:21:40.466 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T03:21:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T03:21:40.835 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T03:21:40.986 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T03:21:41.218 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T03:21:41.406 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T03:21:41.517 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T03:21:41.736 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T03:21:41.937 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T03:21:42.147 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T03:21:42.456 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T03:21:42.713 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T03:21:42.890 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T03:21:42.970 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T03:21:43.168 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T03:21:43.408 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T03:21:43.417 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T03:21:43.600 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T03:21:43.652 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T03:21:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T03:21:43.812 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T03:21:43.934 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T03:21:44.013 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T03:21:44.198 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T03:21:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T03:21:44.420 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T03:21:44.578 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T03:21:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T03:21:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T03:21:45.055 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T03:21:46.887 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T03:21:47.154 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T03:21:47.274 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T03:21:47.495 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T03:21:48.297 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T03:21:48.493 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T03:21:48.663 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T03:21:48.811 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T03:21:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T03:21:49.082 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T03:21:49.233 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T03:21:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T03:21:49.472 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T03:21:49.516 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T03:21:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T03:21:49.706 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T03:21:49.891 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T03:21:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T03:21:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T03:21:50.199 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T03:21:50.386 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T03:21:50.433 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T03:21:50.587 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T03:21:50.658 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T03:21:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T03:21:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T03:21:50.974 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T03:21:51.062 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T03:21:51.170 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T03:21:51.247 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T03:21:51.251 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T03:21:51.331 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T03:21:51.404 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T03:21:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T03:21:51.552 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T03:21:51.719 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T03:21:51.738 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T03:21:51.901 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T03:21:51.927 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T03:21:52.080 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T03:21:52.114 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T03:21:52.247 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T03:21:52.302 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T03:21:52.382 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T03:21:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T03:21:52.584 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T03:21:52.638 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T03:21:52.747 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T03:21:52.856 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T03:21:53.026 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T03:21:53.028 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T03:21:53.285 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T03:21:53.347 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T03:21:53.518 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T03:21:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T03:21:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T03:21:53.967 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T03:21:54.142 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T03:21:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T03:21:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T03:21:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T03:21:54.603 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T03:21:54.634 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T03:21:54.802 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T03:21:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T03:21:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T03:21:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T03:21:55.098 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T03:21:55.280 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T03:21:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T03:21:55.491 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T03:21:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T03:21:55.699 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T03:21:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T03:21:55.923 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T03:21:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T03:21:56.102 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T03:21:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T03:21:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T03:21:56.365 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T03:21:56.582 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T03:21:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T03:21:56.792 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T03:21:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T03:21:56.981 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T03:21:57.114 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T03:21:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T03:21:57.344 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T03:21:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T03:21:57.519 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T03:21:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T03:21:57.772 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T03:21:58.054 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T03:21:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T03:21:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T03:21:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T03:21:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T03:21:59.216 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T03:21:59.437 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T03:21:59.760 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T03:22:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T03:22:00.012 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T03:22:00.350 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T03:22:00.405 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T03:22:00.624 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T03:22:00.677 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T03:22:00.811 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T03:22:01.011 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T03:22:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T03:22:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T03:22:01.698 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T03:22:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T03:22:02.216 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T03:22:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T03:22:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:22:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:22:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:22:07.055 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:22:07.142 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:22:07.284 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:22:07.536 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:22:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:22:08.363 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:22:08.661 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:22:08.782 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:22:08.931 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:22:25.105 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:22:25.105 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2023-10-06T03:22:25.105 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2023-10-06T03:22:25.105 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2023-10-06T03:22:25.105 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /run 2023-10-06T03:22:25.105 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2023-10-06T03:22:25.105 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2023-10-06T03:22:25.105 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2023-10-06T03:22:25.105 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2023-10-06T03:22:25.105 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2023-10-06T03:22:25.106 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:25.455 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:22:26.943 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:22:27.092 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:22:27.128 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:22:27.129 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2023-10-06T03:22:27.129 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2023-10-06T03:22:27.129 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2023-10-06T03:22:27.129 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /run 2023-10-06T03:22:27.129 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2023-10-06T03:22:27.129 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2023-10-06T03:22:27.129 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2023-10-06T03:22:27.129 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2023-10-06T03:22:27.129 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2023-10-06T03:22:27.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:27.315 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:22:27.471 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:22:27.496 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:22:27.870 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:22:28.030 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:22:28.047 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:22:28.988 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:22:29.141 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:22:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:22:29.545 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:22:29.939 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:22:30.128 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:22:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:22:30.854 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:22:30.986 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:22:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T03:22:31.385 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T03:22:31.588 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:22:31.805 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:22:32.049 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:22:33.018 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:22:33.057 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:22:33.194 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:22:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:22:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:22:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T03:22:33.653 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T03:22:33.680 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T03:22:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:22:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:22:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:22:34.078 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:22:34.089 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:22:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:22:34.357 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:22:35.332 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:22:35.535 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:22:35.634 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:22:35.689 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T03:22:35.915 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:22:36.008 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:22:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T03:22:36.186 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:22:36.190 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:22:36.227 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:22:36.230 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:22:36.377 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:22:36.419 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:22:36.430 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:22:36.726 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:22:36.902 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:22:38.078 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T03:22:38.323 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:22:38.401 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:22:38.594 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:22:38.638 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:22:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:22:39.167 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:22:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:22:41.841 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:22:42.783 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T03:22:43.118 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T03:22:43.286 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T03:22:43.516 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T03:22:43.667 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T03:22:43.679 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T03:22:43.863 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T03:22:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T03:22:44.209 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T03:22:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:22:44.383 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T03:22:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T03:22:44.867 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T03:22:44.918 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T03:22:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T03:22:45.092 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T03:22:45.224 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T03:22:45.224 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:22:45.308 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T03:22:45.423 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:22:45.423 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:45.736 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T03:22:45.950 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T03:22:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T03:22:46.250 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T03:22:46.251 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T03:22:46.252 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T03:22:46.253 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T03:22:46.253 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T03:22:46.253 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T03:22:46.253 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T03:22:46.263 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T03:22:46.263 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T03:22:46.263 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T03:22:46.263 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T03:22:46.263 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T03:22:46.263 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T03:22:46.263 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T03:22:46.263 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T03:22:46.263 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T03:22:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T03:22:46.265 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T03:22:46.266 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T03:22:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T03:22:46.268 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T03:22:46.269 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T03:22:46.270 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T03:22:46.367 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T03:22:46.378 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T03:22:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T03:22:46.739 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T03:22:46.909 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T03:22:47.125 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T03:22:47.387 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T03:22:47.558 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T03:22:47.637 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T03:22:47.792 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T03:22:47.800 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T03:22:47.986 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T03:22:47.986 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:22:48.194 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:22:48.195 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:48.396 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:48.396 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:42 ago on Fri 06 Oct 2023 03:21:06 AM UTC. 2023-10-06T03:22:49.065 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:49.065 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T03:22:49.065 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T03:22:49.065 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T03:22:49.065 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:22:49.066 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T03:22:49.066 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:22:49.066 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:22:49.066 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T03:22:49.066 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T03:22:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:22:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T03:22:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T03:22:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:22:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T03:22:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T03:22:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T03:22:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T03:22:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T03:22:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T03:22:49.068 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T03:22:49.068 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T03:22:49.068 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T03:22:49.068 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T03:22:49.068 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T03:22:49.068 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T03:22:49.068 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T03:22:49.068 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T03:22:49.080 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T03:22:49.080 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T03:22:49.081 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T03:22:49.081 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T03:22:49.081 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T03:22:49.081 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T03:22:49.081 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T03:22:49.081 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T03:22:49.081 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T03:22:49.082 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T03:22:49.082 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T03:22:49.082 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T03:22:49.082 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T03:22:49.082 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T03:22:49.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T03:22:49.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T03:22:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T03:22:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T03:22:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T03:22:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T03:22:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T03:22:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T03:22:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T03:22:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T03:22:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T03:22:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T03:22:49.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T03:22:49.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T03:22:49.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T03:22:49.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T03:22:49.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T03:22:49.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T03:22:49.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T03:22:49.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T03:22:49.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T03:22:49.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T03:22:49.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T03:22:49.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T03:22:49.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T03:22:49.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T03:22:49.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T03:22:49.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T03:22:49.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T03:22:49.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T03:22:49.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T03:22:49.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T03:22:49.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T03:22:49.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T03:22:49.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T03:22:49.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T03:22:49.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T03:22:49.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T03:22:49.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T03:22:49.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T03:22:49.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T03:22:49.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T03:22:49.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T03:22:49.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T03:22:49.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T03:22:49.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T03:22:49.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T03:22:49.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T03:22:49.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T03:22:50.482 INFO:teuthology.orchestra.run.smithi084.stdout:Installed products updated. 2023-10-06T03:22:50.628 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:50.629 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2023-10-06T03:22:50.629 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.629 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.629 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2023-10-06T03:22:50.629 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T03:22:50.630 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T03:22:50.630 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.630 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.630 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.630 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.631 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:50.631 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.631 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.631 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.631 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:50.631 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:50.632 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:50.632 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:50.632 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:50.632 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.632 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.632 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:50.632 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.632 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.633 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.633 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:50.633 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:50.633 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.633 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:50.633 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T03:22:50.633 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T03:22:50.634 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T03:22:50.634 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T03:22:50.634 INFO:teuthology.orchestra.run.smithi084.stdout: jq-1.5-12.el8.x86_64 2023-10-06T03:22:50.634 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T03:22:50.634 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T03:22:50.634 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T03:22:50.635 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.635 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.635 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.635 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T03:22:50.635 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T03:22:50.635 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T03:22:50.635 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T03:22:50.636 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T03:22:50.636 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.636 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.636 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T03:22:50.636 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.636 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T03:22:50.636 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T03:22:50.636 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T03:22:50.636 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T03:22:50.637 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T03:22:50.637 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T03:22:50.637 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T03:22:50.637 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T03:22:50.637 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T03:22:50.637 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T03:22:50.637 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T03:22:50.637 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T03:22:50.637 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T03:22:50.637 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T03:22:50.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T03:22:50.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T03:22:50.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T03:22:50.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T03:22:50.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T03:22:50.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T03:22:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T03:22:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T03:22:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T03:22:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T03:22:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T03:22:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T03:22:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T03:22:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T03:22:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T03:22:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T03:22:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T03:22:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T03:22:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T03:22:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T03:22:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T03:22:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T03:22:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T03:22:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T03:22:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T03:22:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T03:22:50.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T03:22:50.643 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.643 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.643 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:50.643 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T03:22:50.643 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T03:22:50.643 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T03:22:50.643 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T03:22:50.644 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T03:22:50.644 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:50.644 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-10-06T03:22:50.894 DEBUG:teuthology.parallel:result is None 2023-10-06T03:22:51.272 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:51.272 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:45 ago on Fri 06 Oct 2023 03:21:06 AM UTC. 2023-10-06T03:22:53.590 INFO:teuthology.orchestra.run.smithi131.stdout:Installed products updated. 2023-10-06T03:22:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T03:22:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: jq-1.5-12.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T03:22:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T03:22:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T03:22:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T03:22:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T03:22:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T03:22:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T03:22:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T03:22:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T03:22:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T03:22:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T03:22:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T03:22:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T03:22:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T03:22:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T03:22:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T03:22:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-10-06T03:22:54.032 DEBUG:teuthology.parallel:result is None 2023-10-06T03:22:54.033 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:22:54.248 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T03:22:54.273 INFO:teuthology.orchestra.run.smithi084.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T03:22:54.274 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T03:22:54.274 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T03:22:54.274 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:22:54.426 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T03:22:54.447 INFO:teuthology.orchestra.run.smithi131.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T03:22:54.448 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T03:22:54.448 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T03:22:54.448 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T03:22:54.448 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:54.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T03:22:54.491 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:22:54.491 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T03:22:54.530 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T03:22:54.531 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:54.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T03:22:54.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T03:22:54.624 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:22:54.624 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T03:22:54.649 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T03:22:54.714 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T03:22:54.714 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:54.714 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T03:22:54.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T03:22:54.804 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:22:54.804 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T03:22:54.828 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T03:22:54.892 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T03:22:54.892 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:54.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T03:22:54.916 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T03:22:54.980 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:22:54.980 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T03:22:55.004 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T03:22:55.068 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T03:22:55.124 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T03:22:55.124 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2023-10-06T03:22:55.126 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2023-10-06T03:22:55.150 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T03:22:55.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T03:22:55.191 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T03:22:55.215 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T03:22:55.215 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T03:22:55.256 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T03:22:55.285 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T03:22:55.285 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T03:22:55.285 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T03:22:55.286 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:55.286 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T03:22:55.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T03:22:55.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T03:22:55.472 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:22:55.473 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T03:22:55.487 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T03:22:55.596 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T03:22:55.625 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T03:22:55.625 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'client session with non-allowable root'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T03:22:55.625 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412196', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'client session with non-allowable root'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxm0D7OhTqMdrf1cqN/QMtrJIuB/luPw9ZIvMy3rzgMSTQ780jYjpbYeXAqiBMgs4ja1v0vOnnlH7mqlPXJ/Gg=', 'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1tlBzZ9Y6G7MiwYE6zznDV/7zzdZ1vz0jw3dy/ZO2zaf5BB8+LaJ3tn14YVd/hWo5VJCG6dhluTklwKA/Y6dA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_sessionmap']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T03:22:55.626 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T03:22:55.628 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T03:22:55.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T03:22:55.683 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T03:22:55.738 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:55.738 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T03:22:55.763 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T03:22:55.763 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2023-10-06T03:22:55.818 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T03:22:55.818 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:55.818 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 220823 Links: 1 2023-10-06T03:22:55.818 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:55.818 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:55.819 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-10-06 03:22:45.836062740 +0000 2023-10-06T03:22:55.819 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-10-06 03:20:21.531105718 +0000 2023-10-06T03:22:55.819 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-10-06 03:20:21.531105718 +0000 2023-10-06T03:22:55.819 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-10-06T03:22:55.819 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T03:22:55.881 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-10-06T03:22:55.882 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-10-06T03:22:55.882 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.00023222 s, 2.2 MB/s 2023-10-06T03:22:55.883 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T03:22:55.939 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2023-10-06T03:22:55.994 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T03:22:55.994 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 220896 Links: 1 2023-10-06T03:22:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-10-06 03:22:45.836062740 +0000 2023-10-06T03:22:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-10-06 03:20:22.239093292 +0000 2023-10-06T03:22:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-10-06 03:20:22.239093292 +0000 2023-10-06T03:22:55.995 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-10-06T03:22:55.995 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T03:22:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-10-06T03:22:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-10-06T03:22:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000228009 s, 2.2 MB/s 2023-10-06T03:22:56.058 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T03:22:56.114 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2023-10-06T03:22:56.169 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T03:22:56.169 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:56.169 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 216784 Links: 1 2023-10-06T03:22:56.169 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:56.169 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:56.169 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-10-06 03:22:45.836062740 +0000 2023-10-06T03:22:56.169 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-10-06 03:20:22.715084939 +0000 2023-10-06T03:22:56.169 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-10-06 03:20:22.715084939 +0000 2023-10-06T03:22:56.170 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-10-06T03:22:56.170 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T03:22:56.231 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-10-06T03:22:56.232 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-10-06T03:22:56.232 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000227752 s, 2.2 MB/s 2023-10-06T03:22:56.233 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T03:22:56.288 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2023-10-06T03:22:56.343 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T03:22:56.343 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:56.343 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 218590 Links: 1 2023-10-06T03:22:56.343 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:56.343 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:56.343 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-10-06 03:22:45.836062740 +0000 2023-10-06T03:22:56.343 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-10-06 03:20:23.224076008 +0000 2023-10-06T03:22:56.343 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-10-06 03:20:23.224076008 +0000 2023-10-06T03:22:56.344 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-10-06T03:22:56.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T03:22:56.406 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-10-06T03:22:56.406 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-10-06T03:22:56.406 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000216022 s, 2.4 MB/s 2023-10-06T03:22:56.407 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T03:22:56.463 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:22:56.463 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:22:56.463 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T03:22:56.479 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T03:22:56.479 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2023-10-06T03:22:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T03:22:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:56.588 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 218373 Links: 1 2023-10-06T03:22:56.588 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:56.588 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:56.588 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-10-06 03:22:48.634615405 +0000 2023-10-06T03:22:56.588 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-10-06 03:20:21.507829550 +0000 2023-10-06T03:22:56.589 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-10-06 03:20:21.507829550 +0000 2023-10-06T03:22:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-10-06T03:22:56.589 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T03:22:56.613 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-10-06T03:22:56.613 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-10-06T03:22:56.613 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000339349 s, 1.5 MB/s 2023-10-06T03:22:56.614 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T03:22:56.670 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2023-10-06T03:22:56.724 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T03:22:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 218435 Links: 1 2023-10-06T03:22:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-10-06 03:22:48.634615405 +0000 2023-10-06T03:22:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-10-06 03:20:22.002819534 +0000 2023-10-06T03:22:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-10-06 03:20:22.002819534 +0000 2023-10-06T03:22:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-10-06T03:22:56.725 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T03:22:56.788 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-10-06T03:22:56.788 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-10-06T03:22:56.788 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000318649 s, 1.6 MB/s 2023-10-06T03:22:56.789 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T03:22:56.845 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2023-10-06T03:22:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T03:22:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:56.900 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 221273 Links: 1 2023-10-06T03:22:56.901 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:56.901 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:56.901 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-10-06 03:22:48.634615405 +0000 2023-10-06T03:22:56.901 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-10-06 03:20:22.494809579 +0000 2023-10-06T03:22:56.901 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-10-06 03:20:22.494809579 +0000 2023-10-06T03:22:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-10-06T03:22:56.901 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T03:22:56.963 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-10-06T03:22:56.964 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-10-06T03:22:56.964 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000224651 s, 2.3 MB/s 2023-10-06T03:22:56.964 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T03:22:57.020 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2023-10-06T03:22:57.075 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T03:22:57.076 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 217758 Links: 1 2023-10-06T03:22:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-10-06 03:22:48.634615405 +0000 2023-10-06T03:22:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-10-06 03:20:22.987799603 +0000 2023-10-06T03:22:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-10-06 03:20:22.987799603 +0000 2023-10-06T03:22:57.076 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-10-06T03:22:57.076 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T03:22:57.138 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-10-06T03:22:57.138 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-10-06T03:22:57.138 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000219071 s, 2.3 MB/s 2023-10-06T03:22:57.139 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T03:22:57.194 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:22:57.194 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T03:22:57.194 INFO:tasks.ceph:Generating config... 2023-10-06T03:22:57.196 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T03:22:57.196 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T03:22:57.196 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T03:22:57.196 INFO:tasks.ceph:[client] pid file = 2023-10-06T03:22:57.196 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T03:22:57.196 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T03:22:57.196 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T03:22:57.196 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T03:22:57.196 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T03:22:57.196 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T03:22:57.197 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T03:22:57.197 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T03:22:57.198 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T03:22:57.199 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T03:22:57.199 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T03:22:57.276 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T03:22:57.278 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T03:22:57.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:22:57.384 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84'), ('mon.b', '172.21.15.131'), ('mon.c', '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]')] 2023-10-06T03:22:57.384 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.84,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T03:22:57.385 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:57.385 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T03:22:57.439 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.84 --add b 172.21.15.131 --addv c '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:57.522 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid 3eb6b236-a9b2-4c6a-bc84-749d824186bc 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = octopus 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 3eb6b236-a9b2-4c6a-bc84-749d824186bc 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2023-10-06T03:22:57.521463+0000 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:created 2023-10-06T03:22:57.521463+0000 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 15 (octopus) 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:election_strategy: 1 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2023-10-06T03:22:57.523 INFO:teuthology.orchestra.run.smithi084.stdout:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-10-06T03:22:57.524 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T03:22:57.524 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T03:22:57.577 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3eb6b236-a9b2-4c6a-bc84-749d824186bc... 2023-10-06T03:22:57.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:22:57.619 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:22:57.659 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2023-10-06T03:22:57.660 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.661 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.662 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on skipped message = False 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 3eb6b236-a9b2-4c6a-bc84-749d824186bc 2023-10-06T03:22:57.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2023-10-06T03:22:57.664 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:22:57.665 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:22:57.666 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:22:57.667 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2023-10-06T03:22:57.668 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.669 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:22:57.670 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = "" 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2023-10-06T03:22:57.671 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2023-10-06T03:22:57.672 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:22:57.672 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2023-10-06T03:22:57.672 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2023-10-06T03:22:57.672 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2023-10-06T03:22:57.672 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2023-10-06T03:22:57.672 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-10-06T03:22:57.672 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-10-06T03:22:57.672 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-10-06T03:22:57.673 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2023-10-06T03:22:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2023-10-06T03:22:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:22:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2023-10-06T03:22:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2023-10-06T03:22:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2023-10-06T03:22:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:22:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:22:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.84,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-10-06T03:22:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on skipped message = False 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 3eb6b236-a9b2-4c6a-bc84-749d824186bc 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2023-10-06T03:22:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 20 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 20 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:22:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 10 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-10-06T03:22:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:22:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:22:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = "" 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2023-10-06T03:22:57.684 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2023-10-06T03:22:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2023-10-06T03:22:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:22:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2023-10-06T03:22:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2023-10-06T03:22:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2023-10-06T03:22:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2023-10-06T03:22:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-10-06T03:22:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-10-06T03:22:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-10-06T03:22:57.686 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T03:22:57.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T03:22:57.777 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T03:22:57.777 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:57.777 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T03:22:57.791 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:57.791 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T03:22:57.845 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:22:57.845 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:57.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T03:22:57.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:22:57.919 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:22:57.919 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:57.973 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:22:57.974 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:22:57.974 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T03:22:57.974 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:22:58.008 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:22:58.008 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:58.062 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T03:22:58.063 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T03:22:58.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T03:22:58.110 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T03:22:58.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T03:22:58.213 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T03:22:58.215 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T03:22:58.215 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T03:22:58.263 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T03:22:58.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T03:22:58.289 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T03:22:58.377 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T03:22:58.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T03:22:58.402 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T03:22:58.451 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T03:22:58.453 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T03:22:58.477 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T03:22:58.565 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T03:22:58.567 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T03:22:58.591 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T03:22:58.591 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T03:22:58.629 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T03:22:58.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T03:22:58.719 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T03:22:58.731 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T03:22:58.768 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T03:22:58.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T03:22:58.859 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T03:22:58.871 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T03:22:58.871 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T03:22:58.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T03:22:58.895 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:22:58.895 INFO:tasks.ceph:role: osd.0 2023-10-06T03:22:58.895 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:22:58.895 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:22:58.967 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:22:58.967 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:22:58.967 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:22:58.967 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2023-10-06T03:22:58.967 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:22:58.967 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:22:58.967 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:22:58.968 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:22:58.968 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:22:58.968 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:22:59.395 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-10-06T03:22:59.397 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-10-06T03:22:59.397 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T03:22:59.529 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T03:22:59.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T03:22:59.624 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:22:59.625 INFO:tasks.ceph:role: osd.1 2023-10-06T03:22:59.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:22:59.625 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:22:59.696 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:22:59.696 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:22:59.696 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:22:59.696 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2023-10-06T03:22:59.696 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:22:59.696 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:22:59.696 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:22:59.696 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:22:59.696 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:22:59.697 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:00.127 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-10-06T03:23:00.129 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-10-06T03:23:00.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T03:23:00.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T03:23:00.247 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T03:23:00.313 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:23:00.313 INFO:tasks.ceph:role: osd.2 2023-10-06T03:23:00.314 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:23:00.314 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:23:00.386 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:23:00.386 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:23:00.386 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:23:00.387 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2023-10-06T03:23:00.387 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:23:00.387 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:23:00.387 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:23:00.387 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:23:00.387 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:23:00.387 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:00.829 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-10-06T03:23:00.831 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-10-06T03:23:00.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T03:23:00.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T03:23:00.965 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T03:23:01.031 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:23:01.031 INFO:tasks.ceph:role: osd.3 2023-10-06T03:23:01.032 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:23:01.032 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:23:01.104 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:23:01.104 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:23:01.104 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:23:01.104 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2023-10-06T03:23:01.105 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:23:01.105 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:23:01.105 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:23:01.105 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:23:01.105 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:23:01.105 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:01.541 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-10-06T03:23:01.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-10-06T03:23:01.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T03:23:01.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T03:23:01.745 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:01.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:01.833+0000 7f581ed5e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T03:23:01.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:01.834+0000 7f581ed5e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T03:23:01.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:01.834+0000 7f581ed5e540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:23:01.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:01.834+0000 7f581ed5e540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:23:01.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:01.834+0000 7f581ed5e540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:23:01.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:01.841+0000 7f581ed5e540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T03:23:02.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:02.365+0000 7f581ed5e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:03.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:03.134+0000 7f581ed5e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:03.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:03.895+0000 7f581ed5e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:04.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T03:23:04.723 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:04.801+0000 7fc37a22e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T03:23:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:04.802+0000 7fc37a22e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T03:23:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:04.802+0000 7fc37a22e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:23:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:04.802+0000 7fc37a22e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:23:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:04.802+0000 7fc37a22e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:23:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:04.802+0000 7fc37a22e540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T03:23:05.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:05.329+0000 7fc37a22e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:06.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:06.096+0000 7fc37a22e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:06.859+0000 7fc37a22e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:07.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T03:23:07.724 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:07.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:07.806+0000 7f778cf03540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T03:23:07.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:07.806+0000 7f778cf03540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T03:23:07.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:07.806+0000 7f778cf03540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:23:07.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:07.807+0000 7f778cf03540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:23:07.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:07.807+0000 7f778cf03540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:23:07.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:07.807+0000 7f778cf03540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T03:23:08.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:08.331+0000 7f778cf03540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:09.108+0000 7f778cf03540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:09.878+0000 7f778cf03540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:10.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T03:23:10.749 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:10.834+0000 7f2e2ab26540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T03:23:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:10.834+0000 7f2e2ab26540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T03:23:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:10.834+0000 7f2e2ab26540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:23:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:10.834+0000 7f2e2ab26540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:23:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:10.834+0000 7f2e2ab26540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:23:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:10.835+0000 7f2e2ab26540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T03:23:11.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:11.358+0000 7f2e2ab26540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:12.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:12.120+0000 7f2e2ab26540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:12.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:12.884+0000 7f2e2ab26540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:13.686 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T03:23:13.714 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T03:23:13.743 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:23:13.743 INFO:tasks.ceph:role: osd.4 2023-10-06T03:23:13.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:23:13.743 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:23:13.817 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:23:13.818 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:23:13.818 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:23:13.818 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 2023-10-06T03:23:13.818 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:23:13.818 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:23:13.818 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:23:13.818 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:23:13.818 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:23:13.818 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:14.245 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-10-06T03:23:14.247 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-10-06T03:23:14.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T03:23:14.422 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T03:23:14.456 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T03:23:14.523 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:23:14.523 INFO:tasks.ceph:role: osd.5 2023-10-06T03:23:14.523 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:23:14.523 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:23:14.595 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:23:14.595 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:23:14.595 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:23:14.595 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 2023-10-06T03:23:14.595 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:23:14.595 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:23:14.596 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:23:14.596 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:23:14.596 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:23:14.596 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:15.024 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-10-06T03:23:15.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-10-06T03:23:15.026 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T03:23:15.131 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T03:23:15.160 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T03:23:15.226 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:23:15.226 INFO:tasks.ceph:role: osd.6 2023-10-06T03:23:15.226 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:23:15.226 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:23:15.298 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:23:15.299 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:23:15.299 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:23:15.299 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 2023-10-06T03:23:15.299 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:23:15.299 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:23:15.299 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:23:15.299 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:23:15.299 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:23:15.299 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:15.739 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-10-06T03:23:15.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-10-06T03:23:15.742 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T03:23:15.911 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T03:23:15.946 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T03:23:16.014 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:23:16.014 INFO:tasks.ceph:role: osd.7 2023-10-06T03:23:16.014 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:23:16.015 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:23:16.089 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:23:16.090 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:23:16.090 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:23:16.090 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 2023-10-06T03:23:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:23:16.090 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:23:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:23:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:23:16.090 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:23:16.091 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:16.526 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-10-06T03:23:16.528 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-10-06T03:23:16.528 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T03:23:16.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T03:23:16.751 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:16.855 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:16.854+0000 7fd15f071540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T03:23:16.856 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:16.854+0000 7fd15f071540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T03:23:16.856 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:16.854+0000 7fd15f071540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:23:16.856 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:16.854+0000 7fd15f071540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:23:16.856 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:16.854+0000 7fd15f071540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:23:16.856 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:16.854+0000 7fd15f071540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T03:23:17.380 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:17.379+0000 7fd15f071540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:18.145 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:18.144+0000 7fd15f071540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:18.907 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:18.906+0000 7fd15f071540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:19.700 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T03:23:19.724 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:19.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:19.803+0000 7f2f1d008540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T03:23:19.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:19.804+0000 7f2f1d008540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T03:23:19.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:19.804+0000 7f2f1d008540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:23:19.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:19.804+0000 7f2f1d008540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:23:19.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:19.804+0000 7f2f1d008540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:23:19.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:19.804+0000 7f2f1d008540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T03:23:20.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:20.326+0000 7f2f1d008540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:21.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:21.093+0000 7f2f1d008540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:21.857 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:21.855+0000 7f2f1d008540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:22.659 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T03:23:22.733 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:22.818 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:22.816+0000 7f284a0ea540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T03:23:22.819 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:22.816+0000 7f284a0ea540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T03:23:22.819 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:22.816+0000 7f284a0ea540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:23:22.819 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:22.816+0000 7f284a0ea540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:23:22.819 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:22.816+0000 7f284a0ea540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:23:22.819 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:22.817+0000 7f284a0ea540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T03:23:23.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:23.344+0000 7f284a0ea540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:24.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:24.113+0000 7f284a0ea540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:24.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:24.875+0000 7f284a0ea540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:25.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:23:25.629 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:23:25.675 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T03:23:25.700 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:25.819 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:25.816+0000 7f7110ca7540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T03:23:25.819 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:25.817+0000 7f7110ca7540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T03:23:25.819 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:25.817+0000 7f7110ca7540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:23:25.819 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:25.817+0000 7f7110ca7540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:23:25.820 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:25.817+0000 7f7110ca7540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:23:25.820 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:25.817+0000 7f7110ca7540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T03:23:26.340 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:26.339+0000 7f7110ca7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:27.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:27.101+0000 7f7110ca7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:27.865 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:27.863+0000 7f7110ca7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:28.658 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T03:23:28.724 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T03:23:28.724 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:28.724 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T03:23:28.754 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:28.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T03:23:28.822 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:28.822 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T03:23:28.888 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:28.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T03:23:28.954 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:28.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T03:23:29.019 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:29.019 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T03:23:29.084 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:29.084 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T03:23:29.148 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:29.149 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T03:23:29.173 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:29.174 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T03:23:29.238 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:29.238 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T03:23:29.302 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:29.302 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T03:23:29.365 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:29.366 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T03:23:29.430 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:29.430 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T03:23:29.494 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:29.494 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T03:23:29.557 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:29.558 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T03:23:29.573 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:29.573 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T03:23:29.628 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:29.628 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T03:23:29.643 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:29.644 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T03:23:29.698 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T03:23:29.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:23:29.700 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:23:29.741 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2023-10-06T03:23:29.741 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCSfR9lFqqSBhAA1km5fSJT2+QAdMBBxBWrXQ== 2023-10-06T03:23:29.741 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-10-06T03:23:29.741 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCSfR9lA8KvDxAA2irSaBc/QiMm9oI5GEK1PA== 2023-10-06T03:23:29.741 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-10-06T03:23:29.741 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCSfR9l4w54FhAASOElKyXlWzXB7pDJV5TzVQ== 2023-10-06T03:23:29.741 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2023-10-06T03:23:29.741 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCVfR9lPd++MRAAikRAaM5HcwQgYYfszDoMzQ== 2023-10-06T03:23:29.741 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCYfR9l3ovfLxAAkuD96aBKGZX1SQvItQjbmA== 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCbfR9lsbQpMBAApjEhKZ3RZXIXNFPmGrp3Rg== 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCefR9lOhnPMRAAinzeYJrHzI3Laz+kRo7U9w== 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCSfR9ltUixDBAAQN/x3iVJcTKF7hTMehPYgQ== 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCSfR9lq2TnGhAAOzV6kE1Ji9yvQGuouda9GQ== 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCSfR9lh/61IRAANVLLVFSkTIhlvAyQkmkbqQ== 2023-10-06T03:23:29.742 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCkfR9liYL2MhAAVzzPBy1+K4n9a324eCqKSg== 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCnfR9lEe8GMBAAgXFWAPLix5BkHtrqQazDqA== 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCqfR9lcprFMBAA4/ksqag9gsivr9htt3UDBg== 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCtfR9leIi9MBAAaco3XMawt8uFNMNRbPQAQQ== 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCSfR9lGQaGJRAALZ28ylNKJSf4AhF9KcsrBg== 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout:[client.2] 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCSfR9lY17ZKhAAyLFVSlBM5vWr4LSl+wwWZw== 2023-10-06T03:23:29.743 INFO:teuthology.orchestra.run.smithi084.stdout:[client.1] 2023-10-06T03:23:29.744 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCSfR9ls6nPLRAA/94kuDcXCPlYoYcCuqwN2A== 2023-10-06T03:23:29.744 INFO:teuthology.orchestra.run.smithi084.stdout:[client.3] 2023-10-06T03:23:29.744 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCSfR9lPWYyMxAAmgd5iQq7RQp80iK1oBfUww== 2023-10-06T03:23:29.760 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2023-10-06T03:23:29.760 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCSfR9lFqqSBhAA1km5fSJT2+QAdMBBxBWrXQ== 2023-10-06T03:23:29.760 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2023-10-06T03:23:29.760 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCSfR9lA8KvDxAA2irSaBc/QiMm9oI5GEK1PA== 2023-10-06T03:23:29.761 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2023-10-06T03:23:29.761 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCSfR9l4w54FhAASOElKyXlWzXB7pDJV5TzVQ== 2023-10-06T03:23:29.761 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2023-10-06T03:23:29.761 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCVfR9lPd++MRAAikRAaM5HcwQgYYfszDoMzQ== 2023-10-06T03:23:29.761 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2023-10-06T03:23:29.761 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCYfR9l3ovfLxAAkuD96aBKGZX1SQvItQjbmA== 2023-10-06T03:23:29.761 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2023-10-06T03:23:29.761 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCbfR9lsbQpMBAApjEhKZ3RZXIXNFPmGrp3Rg== 2023-10-06T03:23:29.761 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2023-10-06T03:23:29.761 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCefR9lOhnPMRAAinzeYJrHzI3Laz+kRo7U9w== 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCSfR9ltUixDBAAQN/x3iVJcTKF7hTMehPYgQ== 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCSfR9lq2TnGhAAOzV6kE1Ji9yvQGuouda9GQ== 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCSfR9lh/61IRAANVLLVFSkTIhlvAyQkmkbqQ== 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCkfR9liYL2MhAAVzzPBy1+K4n9a324eCqKSg== 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCnfR9lEe8GMBAAgXFWAPLix5BkHtrqQazDqA== 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2023-10-06T03:23:29.762 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCqfR9lcprFMBAA4/ksqag9gsivr9htt3UDBg== 2023-10-06T03:23:29.763 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2023-10-06T03:23:29.763 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCtfR9leIi9MBAAaco3XMawt8uFNMNRbPQAQQ== 2023-10-06T03:23:29.763 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2023-10-06T03:23:29.763 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCSfR9lGQaGJRAALZ28ylNKJSf4AhF9KcsrBg== 2023-10-06T03:23:29.763 INFO:teuthology.orchestra.run.smithi131.stdout:[client.2] 2023-10-06T03:23:29.763 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCSfR9lY17ZKhAAyLFVSlBM5vWr4LSl+wwWZw== 2023-10-06T03:23:29.763 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2023-10-06T03:23:29.763 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCSfR9ls6nPLRAA/94kuDcXCPlYoYcCuqwN2A== 2023-10-06T03:23:29.763 INFO:teuthology.orchestra.run.smithi131.stdout:[client.3] 2023-10-06T03:23:29.763 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCSfR9lPWYyMxAAmgd5iQq7RQp80iK1oBfUww== 2023-10-06T03:23:29.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:23:29.786 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:23:29.852 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:29.854 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:29.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:29.906 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:29.956 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:29.958 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.007 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.056 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.104 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:23:30.156 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:23:30.204 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:30.206 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:30.256 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:30.258 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:30.308 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.359 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.407 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.409 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.458 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.460 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:30.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:30.510 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:30.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:30.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:30.612 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:30.615 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:30.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:30.667 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:30.716 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T03:23:30.717 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T03:23:30.740 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:23:30.831 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T03:23:30.855 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T03:23:30.880 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:23:30.971 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T03:23:30.995 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T03:23:31.059 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:23:31.150 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T03:23:31.174 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:31.176 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:31.229 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T03:23:31.229 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T03:23:31.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T03:23:31.232 INFO:tasks.ceph.mon.a:Started 2023-10-06T03:23:31.232 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T03:23:31.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T03:23:31.271 INFO:tasks.ceph.mon.b:Started 2023-10-06T03:23:31.271 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T03:23:31.271 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T03:23:31.275 INFO:tasks.ceph.mon.c:Started 2023-10-06T03:23:31.275 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T03:23:31.275 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T03:23:31.275 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T03:23:31.277 INFO:tasks.ceph.mgr.y:Started 2023-10-06T03:23:31.278 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T03:23:31.278 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T03:23:31.279 INFO:tasks.ceph.mgr.x:Started 2023-10-06T03:23:31.280 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T03:23:31.280 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T03:23:31.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.395+0000 7f1485a18700 1 Processor -- start 2023-10-06T03:23:31.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.395+0000 7f1485a18700 1 -- start start 2023-10-06T03:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f1485a18700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 0x7f14800b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f1485a18700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f14800b24f0 0x7f14800ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f1485a18700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14800b1b20 con 0x7f148015aac0 2023-10-06T03:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f1485a18700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800cb670 con 0x7f14800b24f0 2023-10-06T03:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f1485a18700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14800b11f0 con 0x7f148015a6f0 2023-10-06T03:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147e7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f14800b24f0 0x7f14800ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147e7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f14800b24f0 0x7f14800ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44618/0 (socket says 172.21.15.84:44618) 2023-10-06T03:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147e7fc700 1 -- 172.21.15.84:0/3292113918 learned_addr learned my addr 172.21.15.84:0/3292113918 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147e7fc700 1 -- 172.21.15.84:0/3292113918 >> v2:172.21.15.84:3300/0 conn(0x7f14800b24f0 msgr2=0x7f14800ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147e7fc700 1 -- 172.21.15.84:0/3292113918 >> v2:172.21.15.84:3300/0 conn(0x7f14800b24f0 msgr2=0x7f14800ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:23:31.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147e7fc700 1 --2- 172.21.15.84:0/3292113918 >> v2:172.21.15.84:3300/0 conn(0x7f14800b24f0 0x7f14800ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:23:31.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147e7fc700 1 --2- 172.21.15.84:0/3292113918 >> v2:172.21.15.84:3300/0 conn(0x7f14800b24f0 0x7f14800ce290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:23:31.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147effd700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 0x7f14800b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:31.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147effd700 1 -- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 msgr2=0x7f14800b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T03:23:31.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147effd700 1 -- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 msgr2=0x7f14800b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:23:31.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147effd700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 0x7f14800b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:23:31.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.396+0000 7f147effd700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 0x7f14800b1fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:23:31.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353907631 0 0) 0x7f14800b1b20 con 0x7f148015aac0 2023-10-06T03:23:31.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1468003570 con 0x7f148015aac0 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1362258184 0 0) 0x7f1468003570 con 0x7f148015aac0 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 msgr2=0x7f14800b1fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 0x7f14800b1fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 >> v2:172.21.15.84:3300/0 conn(0x7f14800b24f0 msgr2=0x7f14800ce290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 --2- 172.21.15.84:0/3292113918 >> v2:172.21.15.84:3300/0 conn(0x7f14800b24f0 0x7f14800ce290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800b14d0 con 0x7f148015aac0 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f14780017f0 con 0x7f148015aac0 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 >> v1:172.21.15.131:6789/0 conn(0x7f148015aac0 legacy=0x7f14800b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 0x7f1468003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 0x7f1468004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1468004d50 0x7f14680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800cb670 con 0x7f1468004160 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800b11f0 con 0x7f1468004d50 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146800bd20 con 0x7f148015a6f0 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147e7fc700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 0x7f1468004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147f7fe700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1468004d50 0x7f14680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.574+0000 7f147effd700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 0x7f1468003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.575+0000 7f147e7fc700 1 -- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 msgr2=0x7f1468003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.575+0000 7f147e7fc700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f148015a6f0 0x7f1468003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.575+0000 7f147e7fc700 1 -- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1468004d50 msgr2=0x7f14680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.575+0000 7f147e7fc700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1468004d50 0x7f14680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.575+0000 7f147e7fc700 1 -- 172.21.15.84:0/3292113918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1468003570 con 0x7f1468004160 2023-10-06T03:23:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.575+0000 7f147f7fe700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1468004d50 0x7f14680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.575+0000 7f147e7fc700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 0x7f1468004810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1474006fd0 tx=0x7f1474008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cde2d28e95764e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.576+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400c070 con 0x7f1468004160 2023-10-06T03:23:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.576+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147400e5b0 con 0x7f1468004160 2023-10-06T03:23:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.576+0000 7f147dffb700 1 -- 172.21.15.84:0/3292113918 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400e740 con 0x7f1468004160 2023-10-06T03:23:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.577+0000 7f1485a18700 1 -- 172.21.15.84:0/3292113918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 msgr2=0x7f1468004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.577+0000 7f1485a18700 1 --2- 172.21.15.84:0/3292113918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 0x7f1468004810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1474006fd0 tx=0x7f1474008040 comp rx=0 tx=0).stop 2023-10-06T03:23:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.577+0000 7f147f7fe700 1 -- 172.21.15.84:0/3292113918 reap_dead start 2023-10-06T03:23:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.577+0000 7f1485a18700 1 -- 172.21.15.84:0/3292113918 shutdown_connections 2023-10-06T03:23:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.577+0000 7f1485a18700 1 -- 172.21.15.84:0/3292113918 >> 172.21.15.84:0/3292113918 conn(0x7f148006b640 msgr2=0x7f148006ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.577+0000 7f1485a18700 1 -- 172.21.15.84:0/3292113918 shutdown_connections 2023-10-06T03:23:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.577+0000 7f1485a18700 1 -- 172.21.15.84:0/3292113918 wait complete. 2023-10-06T03:23:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.578+0000 7f1485a18700 1 Processor -- start 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.578+0000 7f1485a18700 1 -- start start 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f1485a18700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 0x7f14800c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f147effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 0x7f14800c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f147effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 0x7f14800c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44650/0 (socket says 172.21.15.84:44650) 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f1485a18700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14800adba0 0x7f148016d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f147effd700 1 -- 172.21.15.84:0/2961516039 learned_addr learned my addr 172.21.15.84:0/2961516039 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f1485a18700 1 --2- 172.21.15.84:0/2961516039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1480145990 0x7f1480145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1480146340 con 0x7f1468004160 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800b0aa0 con 0x7f1480145990 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148016e170 con 0x7f14800adba0 2023-10-06T03:23:31.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f147f7fe700 1 --2- 172.21.15.84:0/2961516039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1480145990 0x7f1480145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.579+0000 7f147e7fc700 1 --2- 172.21.15.84:0/2961516039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14800adba0 0x7f148016d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.580+0000 7f147effd700 1 -- 172.21.15.84:0/2961516039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14800adba0 msgr2=0x7f148016d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.580+0000 7f147effd700 1 --2- 172.21.15.84:0/2961516039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14800adba0 0x7f148016d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.580+0000 7f147effd700 1 -- 172.21.15.84:0/2961516039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1480145990 msgr2=0x7f1480145e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.580+0000 7f147effd700 1 --2- 172.21.15.84:0/2961516039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1480145990 0x7f1480145e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.580+0000 7f147effd700 1 -- 172.21.15.84:0/2961516039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800b0200 con 0x7f1468004160 2023-10-06T03:23:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.580+0000 7f147effd700 1 --2- 172.21.15.84:0/2961516039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 0x7f14800c9c60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f147000f910 tx=0x7f1470008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.581+0000 7f1466ffd700 1 -- 172.21.15.84:0/2961516039 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470014670 con 0x7f1468004160 2023-10-06T03:23:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.581+0000 7f1466ffd700 1 -- 172.21.15.84:0/2961516039 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14700147d0 con 0x7f1468004160 2023-10-06T03:23:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.581+0000 7f1466ffd700 1 -- 172.21.15.84:0/2961516039 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470014b70 con 0x7f1468004160 2023-10-06T03:23:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.581+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14800b04e0 con 0x7f1468004160 2023-10-06T03:23:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.581+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14800ae110 con 0x7f1468004160 2023-10-06T03:23:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.582+0000 7f1466ffd700 1 -- 172.21.15.84:0/2961516039 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1470015410 con 0x7f1468004160 2023-10-06T03:23:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.582+0000 7f1466ffd700 1 -- 172.21.15.84:0/2961516039 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f147001e750 con 0x7f1468004160 2023-10-06T03:23:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.582+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1480068790 con 0x7f1468004160 2023-10-06T03:23:31.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.586+0000 7f1466ffd700 1 -- 172.21.15.84:0/2961516039 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f147003d6d0 con 0x7f1468004160 2023-10-06T03:23:31.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.660+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f1480064ad0 con 0x7f1468004160 2023-10-06T03:23:31.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.667+0000 7f1466ffd700 1 -- 172.21.15.84:0/2961516039 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f147002c020 con 0x7f1468004160 2023-10-06T03:23:31.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.668+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 msgr2=0x7f14800c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:31.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.668+0000 7f1485a18700 1 --2- 172.21.15.84:0/2961516039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 0x7f14800c9c60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f147000f910 tx=0x7f1470008040 comp rx=0 tx=0).stop 2023-10-06T03:23:31.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.668+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 shutdown_connections 2023-10-06T03:23:31.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.668+0000 7f1485a18700 1 --2- 172.21.15.84:0/2961516039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1480145990 0x7f1480145e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:31.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.668+0000 7f1485a18700 1 --2- 172.21.15.84:0/2961516039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468004160 0x7f14800c9c60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:31.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.668+0000 7f1485a18700 1 --2- 172.21.15.84:0/2961516039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14800adba0 0x7f148016d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:31.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.668+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 >> 172.21.15.84:0/2961516039 conn(0x7f148006b640 msgr2=0x7f1480158020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.669+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 shutdown_connections 2023-10-06T03:23:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:31.669+0000 7f1485a18700 1 -- 172.21.15.84:0/2961516039 wait complete. 2023-10-06T03:23:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2023-10-06T03:23:31.681 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T03:23:31.681 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:31.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T03:23:31.705 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:31.706 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T03:23:31.770 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:31.770 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T03:23:31.835 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T03:23:31.835 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T03:23:31.899 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:31.900 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T03:23:31.925 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:31.925 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T03:23:31.990 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:31.990 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T03:23:32.056 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T03:23:32.056 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T03:23:32.121 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new ed32e6d1-173a-43d7-9678-c27d62b49b04 0 2023-10-06T03:23:32.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.275+0000 7f77070ef700 1 Processor -- start 2023-10-06T03:23:32.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.275+0000 7f77070ef700 1 -- start start 2023-10-06T03:23:32.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.275+0000 7f77070ef700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f77000cbb50 0x7f77000ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.275+0000 7f77070ef700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000c6610 0x7f77000ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.275+0000 7f77070ef700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77000b2e60 con 0x7f77000b2a90 2023-10-06T03:23:32.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.275+0000 7f77070ef700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000cf5d0 con 0x7f77000cbb50 2023-10-06T03:23:32.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.275+0000 7f77070ef700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77000cf8b0 con 0x7f77000c6610 2023-10-06T03:23:32.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f76fffff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f77000cbb50 0x7f77000ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f770568c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000c6610 0x7f77000ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f770568c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000c6610 0x7f77000ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38838/0 (socket says 172.21.15.131:38838) 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f770568c700 1 -- 172.21.15.131:0/3463556744 learned_addr learned my addr 172.21.15.131:0/3463556744 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f76fffff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f77000cbb50 0x7f77000ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:59782/0 (socket says 172.21.15.131:59782) 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f770568c700 1 -- 172.21.15.131:0/3463556744 >> v2:172.21.15.131:3300/0 conn(0x7f77000cbb50 msgr2=0x7f77000ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f770568c700 1 --2- 172.21.15.131:0/3463556744 >> v2:172.21.15.131:3300/0 conn(0x7f77000cbb50 0x7f77000ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f770568c700 1 -- 172.21.15.131:0/3463556744 >> v1:172.21.15.131:6789/0 conn(0x7f77000b2a90 legacy=0x7f77000cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f770568c700 1 -- 172.21.15.131:0/3463556744 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77000cfb90 con 0x7f77000c6610 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f76ff7fe700 1 -- 172.21.15.131:0/3463556744 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792318576 0 0) 0x7f77000b2e60 con 0x7f77000b2a90 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f76fffff700 1 --2- 172.21.15.131:0/3463556744 >> v2:172.21.15.131:3300/0 conn(0x7f77000cbb50 0x7f77000ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f770568c700 1 --2- 172.21.15.131:0/3463556744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000c6610 0x7f77000ced90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009f20 tx=0x7f76f8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=374b869ea1b8c155 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f76ff7fe700 1 -- 172.21.15.131:0/3463556744 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f800e070 con 0x7f77000c6610 2023-10-06T03:23:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f76ff7fe700 1 -- 172.21.15.131:0/3463556744 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f800b9d0 con 0x7f77000c6610 2023-10-06T03:23:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.276+0000 7f76ff7fe700 1 -- 172.21.15.131:0/3463556744 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f80092e0 con 0x7f77000c6610 2023-10-06T03:23:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.277+0000 7f77070ef700 1 -- 172.21.15.131:0/3463556744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000c6610 msgr2=0x7f77000ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.277+0000 7f77070ef700 1 --2- 172.21.15.131:0/3463556744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000c6610 0x7f77000ced90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009f20 tx=0x7f76f8009840 comp rx=0 tx=0).stop 2023-10-06T03:23:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.277+0000 7f77070ef700 1 -- 172.21.15.131:0/3463556744 shutdown_connections 2023-10-06T03:23:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.277+0000 7f77070ef700 1 --2- 172.21.15.131:0/3463556744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000c6610 0x7f77000ced90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.277+0000 7f77070ef700 1 --2- 172.21.15.131:0/3463556744 >> v2:172.21.15.131:3300/0 conn(0x7f77000cbb50 0x7f77000ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.277+0000 7f77070ef700 1 -- 172.21.15.131:0/3463556744 >> 172.21.15.131:0/3463556744 conn(0x7f7700099740 msgr2=0x7f770006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:32.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.277+0000 7f77070ef700 1 -- 172.21.15.131:0/3463556744 shutdown_connections 2023-10-06T03:23:32.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.277+0000 7f77070ef700 1 -- 172.21.15.131:0/3463556744 wait complete. 2023-10-06T03:23:32.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.278+0000 7f77070ef700 1 Processor -- start 2023-10-06T03:23:32.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.278+0000 7f77070ef700 1 -- start start 2023-10-06T03:23:32.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f77070ef700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000b2a90 0x7f7700157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f77070ef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77000c6610 0x7f770015db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f77070ef700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77000cbb50 0x7f770015e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f77070ef700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770015bb00 con 0x7f77000c6610 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f77070ef700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001575b0 con 0x7f77000cbb50 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f77070ef700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770015aa60 con 0x7f77000b2a90 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f7704e8b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000b2a90 0x7f7700157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f770568c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77000cbb50 0x7f770015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f7704e8b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000b2a90 0x7f7700157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38846/0 (socket says 172.21.15.131:38846) 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f7704e8b700 1 -- 172.21.15.131:0/1006050843 learned_addr learned my addr 172.21.15.131:0/1006050843 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f76fffff700 1 --2- 172.21.15.131:0/1006050843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77000c6610 0x7f770015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f7704e8b700 1 -- 172.21.15.131:0/1006050843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77000cbb50 msgr2=0x7f770015e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f7704e8b700 1 --2- 172.21.15.131:0/1006050843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77000cbb50 0x7f770015e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f7704e8b700 1 -- 172.21.15.131:0/1006050843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77000c6610 msgr2=0x7f770015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f7704e8b700 1 --2- 172.21.15.131:0/1006050843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77000c6610 0x7f770015db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f7704e8b700 1 -- 172.21.15.131:0/1006050843 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec009420 con 0x7f77000b2a90 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f7704e8b700 1 --2- 172.21.15.131:0/1006050843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000b2a90 0x7f7700157070 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c840 tx=0x7f76f4007d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.279+0000 7f76fcff9700 1 -- 172.21.15.131:0/1006050843 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400e4a0 con 0x7f77000b2a90 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.280+0000 7f76fcff9700 1 -- 172.21.15.131:0/1006050843 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f400e620 con 0x7f77000b2a90 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.280+0000 7f77070ef700 1 -- 172.21.15.131:0/1006050843 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f8009ae0 con 0x7f77000b2a90 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.280+0000 7f76fcff9700 1 -- 172.21.15.131:0/1006050843 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400e9e0 con 0x7f77000b2a90 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.280+0000 7f77070ef700 1 -- 172.21.15.131:0/1006050843 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770015b020 con 0x7f77000b2a90 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.280+0000 7f76fcff9700 1 -- 172.21.15.131:0/1006050843 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f76f401c440 con 0x7f77000b2a90 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.280+0000 7f76fcff9700 1 -- 172.21.15.131:0/1006050843 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f76f4012750 con 0x7f77000b2a90 2023-10-06T03:23:32.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.280+0000 7f77070ef700 1 -- 172.21.15.131:0/1006050843 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7700064ad0 con 0x7f77000b2a90 2023-10-06T03:23:32.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.283+0000 7f76fcff9700 1 -- 172.21.15.131:0/1006050843 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f76f4021060 con 0x7f77000b2a90 2023-10-06T03:23:32.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.366+0000 7f77070ef700 1 -- 172.21.15.131:0/1006050843 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ed32e6d1-173a-43d7-9678-c27d62b49b04", "id": 0} v 0) v1 -- 0x7f770004bb80 con 0x7f77000b2a90 2023-10-06T03:23:32.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.372+0000 7f76fcff9700 1 -- 172.21.15.131:0/1006050843 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed32e6d1-173a-43d7-9678-c27d62b49b04", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f76f4017070 con 0x7f77000b2a90 2023-10-06T03:23:32.373 INFO:teuthology.orchestra.run.smithi131.stdout:0 2023-10-06T03:23:32.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.372+0000 7f77070ef700 1 -- 172.21.15.131:0/1006050843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000b2a90 msgr2=0x7f7700157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.373+0000 7f77070ef700 1 --2- 172.21.15.131:0/1006050843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000b2a90 0x7f7700157070 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c840 tx=0x7f76f4007d60 comp rx=0 tx=0).stop 2023-10-06T03:23:32.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.373+0000 7f77070ef700 1 -- 172.21.15.131:0/1006050843 shutdown_connections 2023-10-06T03:23:32.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.373+0000 7f77070ef700 1 --2- 172.21.15.131:0/1006050843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77000cbb50 0x7f770015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.373+0000 7f77070ef700 1 --2- 172.21.15.131:0/1006050843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77000b2a90 0x7f7700157070 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.373+0000 7f77070ef700 1 --2- 172.21.15.131:0/1006050843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77000c6610 0x7f770015db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.373+0000 7f77070ef700 1 -- 172.21.15.131:0/1006050843 >> 172.21.15.131:0/1006050843 conn(0x7f7700099740 msgr2=0x7f7700069470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:32.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.373+0000 7f77070ef700 1 -- 172.21.15.131:0/1006050843 shutdown_connections 2023-10-06T03:23:32.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.373+0000 7f77070ef700 1 -- 172.21.15.131:0/1006050843 wait complete. 2023-10-06T03:23:32.385 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 5d218451-7186-4ae0-b3be-602a19ca5197 1 2023-10-06T03:23:32.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.498+0000 7fb9ea547700 1 Processor -- start 2023-10-06T03:23:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.498+0000 7fb9ea547700 1 -- start start 2023-10-06T03:23:32.509 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.498+0000 7fb9ea547700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40b2a90 0x7fb9e40cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.509 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9ea547700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb9e40c6610 0x7fb9e40cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.509 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9ea547700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40cbdf0 con 0x7fb9e40cb980 2023-10-06T03:23:32.509 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9ea547700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40b2e60 con 0x7fb9e40c6610 2023-10-06T03:23:32.509 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9ea547700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40cf5d0 con 0x7fb9e40b2a90 2023-10-06T03:23:32.509 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e8ae4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb9e40c6610 0x7fb9e40cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40b2a90 0x7fb9e40cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e37fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb9e40cb980 0x7fb9e40ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:59336/0 (socket says 172.21.15.131:59336) 2023-10-06T03:23:32.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e37fe700 1 -- 172.21.15.131:0/3830913623 learned_addr learned my addr 172.21.15.131:0/3830913623 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-10-06T03:23:32.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e3fff700 1 -- 172.21.15.131:0/3830913623 >> v2:172.21.15.131:3300/0 conn(0x7fb9e40c6610 msgr2=0x7fb9e40cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:32.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e3fff700 1 --2- 172.21.15.131:0/3830913623 >> v2:172.21.15.131:3300/0 conn(0x7fb9e40c6610 0x7fb9e40cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e3fff700 1 -- 172.21.15.131:0/3830913623 >> v1:172.21.15.131:6789/0 conn(0x7fb9e40cb980 legacy=0x7fb9e40ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e3fff700 1 -- 172.21.15.131:0/3830913623 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40cf8b0 con 0x7fb9e40b2a90 2023-10-06T03:23:32.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e2ffd700 1 -- 172.21.15.131:0/3830913623 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125362442 0 0) 0x7fb9e40cbdf0 con 0x7fb9e40cb980 2023-10-06T03:23:32.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e8ae4700 1 --2- 172.21.15.131:0/3830913623 >> v2:172.21.15.131:3300/0 conn(0x7fb9e40c6610 0x7fb9e40cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e3fff700 1 --2- 172.21.15.131:0/3830913623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40b2a90 0x7fb9e40cb440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40098d0 tx=0x7fb9d4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33806c579a90cfeb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e2ffd700 1 -- 172.21.15.131:0/3830913623 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4005c10 con 0x7fb9e40b2a90 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e2ffd700 1 -- 172.21.15.131:0/3830913623 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d4005d70 con 0x7fb9e40b2a90 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.499+0000 7fb9e2ffd700 1 -- 172.21.15.131:0/3830913623 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4006260 con 0x7fb9e40b2a90 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.500+0000 7fb9ea547700 1 -- 172.21.15.131:0/3830913623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40b2a90 msgr2=0x7fb9e40cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.500+0000 7fb9ea547700 1 --2- 172.21.15.131:0/3830913623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40b2a90 0x7fb9e40cb440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40098d0 tx=0x7fb9d4009120 comp rx=0 tx=0).stop 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.500+0000 7fb9ea547700 1 -- 172.21.15.131:0/3830913623 shutdown_connections 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.500+0000 7fb9ea547700 1 --2- 172.21.15.131:0/3830913623 >> v2:172.21.15.131:3300/0 conn(0x7fb9e40c6610 0x7fb9e40cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.500+0000 7fb9ea547700 1 --2- 172.21.15.131:0/3830913623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40b2a90 0x7fb9e40cb440 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.500+0000 7fb9ea547700 1 -- 172.21.15.131:0/3830913623 >> 172.21.15.131:0/3830913623 conn(0x7fb9e4099740 msgr2=0x7fb9e406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.500+0000 7fb9ea547700 1 -- 172.21.15.131:0/3830913623 shutdown_connections 2023-10-06T03:23:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.500+0000 7fb9ea547700 1 -- 172.21.15.131:0/3830913623 wait complete. 2023-10-06T03:23:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.501+0000 7fb9ea547700 1 Processor -- start 2023-10-06T03:23:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.501+0000 7fb9ea547700 1 -- start start 2023-10-06T03:23:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9ea547700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9e40b2a90 0x7fb9e416db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9ea547700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40c6610 0x7fb9e4143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9ea547700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e40cb980 0x7fb9e4169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9ea547700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e416d670 con 0x7fb9e40b2a90 2023-10-06T03:23:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9ea547700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e416a570 con 0x7fb9e40cb980 2023-10-06T03:23:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9ea547700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e416a850 con 0x7fb9e40c6610 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e8ae4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e40cb980 0x7fb9e4169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e37fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40c6610 0x7fb9e4143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e8ae4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e40cb980 0x7fb9e4169a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:59796/0 (socket says 172.21.15.131:59796) 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e37fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40c6610 0x7fb9e4143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38858/0 (socket says 172.21.15.131:38858) 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e8ae4700 1 -- 172.21.15.131:0/1201056220 learned_addr learned my addr 172.21.15.131:0/1201056220 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e3fff700 1 --2- 172.21.15.131:0/1201056220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9e40b2a90 0x7fb9e416db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e8ae4700 1 -- 172.21.15.131:0/1201056220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40c6610 msgr2=0x7fb9e4143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e8ae4700 1 --2- 172.21.15.131:0/1201056220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40c6610 0x7fb9e4143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e8ae4700 1 -- 172.21.15.131:0/1201056220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9e40b2a90 msgr2=0x7fb9e416db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e8ae4700 1 --2- 172.21.15.131:0/1201056220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9e40b2a90 0x7fb9e416db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e8ae4700 1 -- 172.21.15.131:0/1201056220 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc009a20 con 0x7fb9e40cb980 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.502+0000 7fb9e3fff700 1 --2- 172.21.15.131:0/1201056220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9e40b2a90 0x7fb9e416db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.503+0000 7fb9e8ae4700 1 --2- 172.21.15.131:0/1201056220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e40cb980 0x7fb9e4169a00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009fc0 tx=0x7fb9dc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.503+0000 7fb9cbfff700 1 -- 172.21.15.131:0/1201056220 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00cc80 con 0x7fb9e40cb980 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.503+0000 7fb9cbfff700 1 -- 172.21.15.131:0/1201056220 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc00f040 con 0x7fb9e40cb980 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.503+0000 7fb9ea547700 1 -- 172.21.15.131:0/1201056220 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d40093c0 con 0x7fb9e40cb980 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.503+0000 7fb9cbfff700 1 -- 172.21.15.131:0/1201056220 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc014480 con 0x7fb9e40cb980 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.503+0000 7fb9ea547700 1 -- 172.21.15.131:0/1201056220 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e416d300 con 0x7fb9e40cb980 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.503+0000 7fb9cbfff700 1 -- 172.21.15.131:0/1201056220 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb9dc003020 con 0x7fb9e40cb980 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.503+0000 7fb9cbfff700 1 -- 172.21.15.131:0/1201056220 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fb9dc01d8f0 con 0x7fb9e40cb980 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.504+0000 7fb9ea547700 1 -- 172.21.15.131:0/1201056220 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e416d7e0 con 0x7fb9e40cb980 2023-10-06T03:23:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.506+0000 7fb9cbfff700 1 -- 172.21.15.131:0/1201056220 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb9dc018030 con 0x7fb9e40cb980 2023-10-06T03:23:32.590 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.588+0000 7fb9ea547700 1 -- 172.21.15.131:0/1201056220 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5d218451-7186-4ae0-b3be-602a19ca5197", "id": 1} v 0) v1 -- 0x7fb9e4064ad0 con 0x7fb9e40cb980 2023-10-06T03:23:32.597 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.596+0000 7fb9cbfff700 1 -- 172.21.15.131:0/1201056220 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5d218451-7186-4ae0-b3be-602a19ca5197", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb9dc014a20 con 0x7fb9e40cb980 2023-10-06T03:23:32.597 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T03:23:32.598 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.597+0000 7fb9ea547700 1 -- 172.21.15.131:0/1201056220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e40cb980 msgr2=0x7fb9e4169a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.598 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.597+0000 7fb9ea547700 1 --2- 172.21.15.131:0/1201056220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e40cb980 0x7fb9e4169a00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009fc0 tx=0x7fb9dc00b040 comp rx=0 tx=0).stop 2023-10-06T03:23:32.598 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.597+0000 7fb9ea547700 1 -- 172.21.15.131:0/1201056220 shutdown_connections 2023-10-06T03:23:32.598 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.597+0000 7fb9ea547700 1 --2- 172.21.15.131:0/1201056220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e40cb980 0x7fb9e4169a00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.598 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.597+0000 7fb9ea547700 1 --2- 172.21.15.131:0/1201056220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9e40b2a90 0x7fb9e416db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.599 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.597+0000 7fb9ea547700 1 --2- 172.21.15.131:0/1201056220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e40c6610 0x7fb9e4143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.599 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.597+0000 7fb9ea547700 1 -- 172.21.15.131:0/1201056220 >> 172.21.15.131:0/1201056220 conn(0x7fb9e4099740 msgr2=0x7fb9e4151fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:32.599 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.597+0000 7fb9ea547700 1 -- 172.21.15.131:0/1201056220 shutdown_connections 2023-10-06T03:23:32.599 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.597+0000 7fb9ea547700 1 -- 172.21.15.131:0/1201056220 wait complete. 2023-10-06T03:23:32.610 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new d169e18c-082c-4110-a7a1-2a831dcb27df 2 2023-10-06T03:23:32.725 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.724+0000 7fac7aef7700 1 Processor -- start 2023-10-06T03:23:32.725 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.724+0000 7fac7aef7700 1 -- start start 2023-10-06T03:23:32.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7aef7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac740b1870 0x7fac74156630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7aef7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fac740b0800 0x7fac74156b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7aef7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7415a640 con 0x7fac741539b0 2023-10-06T03:23:32.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7aef7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac740b0d10 con 0x7fac740b0800 2023-10-06T03:23:32.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7aef7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac74159d10 con 0x7fac740b1870 2023-10-06T03:23:32.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7a6f6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fac740b0800 0x7fac74156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac796f4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac740b1870 0x7fac74156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7a6f6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fac740b0800 0x7fac74156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:59810/0 (socket says 172.21.15.131:59810) 2023-10-06T03:23:32.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac796f4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac740b1870 0x7fac74156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38868/0 (socket says 172.21.15.131:38868) 2023-10-06T03:23:32.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7a6f6700 1 -- 172.21.15.131:0/1822568025 learned_addr learned my addr 172.21.15.131:0/1822568025 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7a6f6700 1 -- 172.21.15.131:0/1822568025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac740b1870 msgr2=0x7fac74156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7a6f6700 1 --2- 172.21.15.131:0/1822568025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac740b1870 0x7fac74156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7a6f6700 1 -- 172.21.15.131:0/1822568025 >> v1:172.21.15.84:6789/0 conn(0x7fac741539b0 legacy=0x7fac740b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7a6f6700 1 -- 172.21.15.131:0/1822568025 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac74159ff0 con 0x7fac740b0800 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac796f4700 1 --2- 172.21.15.131:0/1822568025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac740b1870 0x7fac74156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.725+0000 7fac7a6f6700 1 --2- 172.21.15.131:0/1822568025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b0800 0x7fac74156b70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00d1a0 tx=0x7fac6c00ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab92d0bb3942c43c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac78ef3700 1 -- 172.21.15.131:0/1822568025 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c010070 con 0x7fac740b0800 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac78ef3700 1 -- 172.21.15.131:0/1822568025 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c00de10 con 0x7fac740b0800 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac78ef3700 1 -- 172.21.15.131:0/1822568025 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c00b320 con 0x7fac740b0800 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac7aef7700 1 -- 172.21.15.131:0/1822568025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b0800 msgr2=0x7fac74156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac7aef7700 1 --2- 172.21.15.131:0/1822568025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b0800 0x7fac74156b70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00d1a0 tx=0x7fac6c00ba50 comp rx=0 tx=0).stop 2023-10-06T03:23:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac7aef7700 1 -- 172.21.15.131:0/1822568025 shutdown_connections 2023-10-06T03:23:32.730 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac7aef7700 1 --2- 172.21.15.131:0/1822568025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b0800 0x7fac74156b70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.730 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac7aef7700 1 --2- 172.21.15.131:0/1822568025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac740b1870 0x7fac74156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.730 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac7aef7700 1 -- 172.21.15.131:0/1822568025 >> 172.21.15.131:0/1822568025 conn(0x7fac74069180 msgr2=0x7fac740aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:32.730 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac7aef7700 1 -- 172.21.15.131:0/1822568025 shutdown_connections 2023-10-06T03:23:32.730 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.726+0000 7fac7aef7700 1 -- 172.21.15.131:0/1822568025 wait complete. 2023-10-06T03:23:32.732 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.727+0000 7fac7aef7700 1 Processor -- start 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.727+0000 7fac7aef7700 1 -- start start 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac7aef7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac740b0800 0x7fac7414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac7aef7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b1870 0x7fac74169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac7aef7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac741539b0 0x7fac740cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac7aef7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7416a120 con 0x7fac740b0800 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac7aef7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac740cd060 con 0x7fac740b1870 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac7aef7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7414a160 con 0x7fac741539b0 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac796f4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b1870 0x7fac74169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac7a6f6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac741539b0 0x7fac740cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac796f4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b1870 0x7fac74169be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:59824/0 (socket says 172.21.15.131:59824) 2023-10-06T03:23:32.733 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac7a6f6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac741539b0 0x7fac740cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38884/0 (socket says 172.21.15.131:38884) 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac796f4700 1 -- 172.21.15.131:0/3190461509 learned_addr learned my addr 172.21.15.131:0/3190461509 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac79ef5700 1 --2- 172.21.15.131:0/3190461509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac740b0800 0x7fac7414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac796f4700 1 -- 172.21.15.131:0/3190461509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac741539b0 msgr2=0x7fac740cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac796f4700 1 --2- 172.21.15.131:0/3190461509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac741539b0 0x7fac740cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.728+0000 7fac796f4700 1 -- 172.21.15.131:0/3190461509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac740b0800 msgr2=0x7fac7414f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac796f4700 1 --2- 172.21.15.131:0/3190461509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac740b0800 0x7fac7414f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac796f4700 1 -- 172.21.15.131:0/3190461509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70009420 con 0x7fac740b1870 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac7a6f6700 1 --2- 172.21.15.131:0/3190461509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac741539b0 0x7fac740cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac796f4700 1 --2- 172.21.15.131:0/3190461509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b1870 0x7fac74169be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fac7000ecb0 tx=0x7fac700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac69ffb700 1 -- 172.21.15.131:0/3190461509 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7000c920 con 0x7fac740b1870 2023-10-06T03:23:32.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac69ffb700 1 -- 172.21.15.131:0/3190461509 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7000ca80 con 0x7fac740b1870 2023-10-06T03:23:32.735 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac7aef7700 1 -- 172.21.15.131:0/3190461509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c00bcf0 con 0x7fac740b1870 2023-10-06T03:23:32.735 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac69ffb700 1 -- 172.21.15.131:0/3190461509 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7000ce00 con 0x7fac740b1870 2023-10-06T03:23:32.735 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac7aef7700 1 -- 172.21.15.131:0/3190461509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac740cca10 con 0x7fac740b1870 2023-10-06T03:23:32.735 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac69ffb700 1 -- 172.21.15.131:0/3190461509 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fac70005c80 con 0x7fac740b1870 2023-10-06T03:23:32.735 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.729+0000 7fac69ffb700 1 -- 172.21.15.131:0/3190461509 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fac70013c20 con 0x7fac740b1870 2023-10-06T03:23:32.735 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.730+0000 7fac7aef7700 1 -- 172.21.15.131:0/3190461509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7405f270 con 0x7fac740b1870 2023-10-06T03:23:32.735 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:32.734+0000 7f6e691d5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:23:32.736 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.732+0000 7fac69ffb700 1 -- 172.21.15.131:0/3190461509 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fac70021060 con 0x7fac740b1870 2023-10-06T03:23:32.804 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:32.803+0000 7fdfa112d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:23:32.814 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.813+0000 7fac7aef7700 1 -- 172.21.15.131:0/3190461509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d169e18c-082c-4110-a7a1-2a831dcb27df", "id": 2} v 0) v1 -- 0x7fac740cd1a0 con 0x7fac740b1870 2023-10-06T03:23:32.821 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.820+0000 7fac69ffb700 1 -- 172.21.15.131:0/3190461509 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d169e18c-082c-4110-a7a1-2a831dcb27df", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac70017070 con 0x7fac740b1870 2023-10-06T03:23:32.822 INFO:teuthology.orchestra.run.smithi131.stdout:2 2023-10-06T03:23:32.823 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.821+0000 7fac7aef7700 1 -- 172.21.15.131:0/3190461509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b1870 msgr2=0x7fac74169be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.823 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.821+0000 7fac7aef7700 1 --2- 172.21.15.131:0/3190461509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b1870 0x7fac74169be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fac7000ecb0 tx=0x7fac700091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.823 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.821+0000 7fac7aef7700 1 -- 172.21.15.131:0/3190461509 shutdown_connections 2023-10-06T03:23:32.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.821+0000 7fac7aef7700 1 --2- 172.21.15.131:0/3190461509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac741539b0 0x7fac740cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.821+0000 7fac7aef7700 1 --2- 172.21.15.131:0/3190461509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac740b0800 0x7fac7414f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.821+0000 7fac7aef7700 1 --2- 172.21.15.131:0/3190461509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac740b1870 0x7fac74169be0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.821+0000 7fac7aef7700 1 -- 172.21.15.131:0/3190461509 >> 172.21.15.131:0/3190461509 conn(0x7fac74069180 msgr2=0x7fac7414bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:32.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.821+0000 7fac7aef7700 1 -- 172.21.15.131:0/3190461509 shutdown_connections 2023-10-06T03:23:32.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.822+0000 7fac7aef7700 1 -- 172.21.15.131:0/3190461509 wait complete. 2023-10-06T03:23:32.834 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 304b2650-3d07-4149-a997-640d8bb6ab19 3 2023-10-06T03:23:32.866 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:32.865+0000 7f6e691d5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:23:32.941 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:32.940+0000 7f6e691d5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:23:32.943 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:32.942+0000 7fdfa112d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:23:32.950 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.949+0000 7f0c5be16700 1 Processor -- start 2023-10-06T03:23:32.951 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.949+0000 7f0c5be16700 1 -- start start 2023-10-06T03:23:32.961 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c5be16700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0c540b2a90 0x7f0c540cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c5be16700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c540c6610 0x7f0c540cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c5be16700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c540cbdf0 con 0x7f0c540cb980 2023-10-06T03:23:32.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c5be16700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c540b2e60 con 0x7f0c540c6610 2023-10-06T03:23:32.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c5be16700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c540cf5d0 con 0x7f0c540b2a90 2023-10-06T03:23:32.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c59bb2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0c540b2a90 0x7f0c540cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c593b1700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f0c540cb980 0x7f0c540ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:59348/0 (socket says 172.21.15.131:59348) 2023-10-06T03:23:32.964 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c59bb2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0c540b2a90 0x7f0c540cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:59834/0 (socket says 172.21.15.131:59834) 2023-10-06T03:23:32.964 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c593b1700 1 -- 172.21.15.131:0/3019616954 learned_addr learned my addr 172.21.15.131:0/3019616954 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-10-06T03:23:32.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c5a3b3700 1 --2- 172.21.15.131:0/3019616954 >> v2:172.21.15.84:3300/0 conn(0x7f0c540c6610 0x7f0c540cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c59bb2700 1 -- 172.21.15.131:0/3019616954 >> v2:172.21.15.84:3300/0 conn(0x7f0c540c6610 msgr2=0x7f0c540cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:32.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c59bb2700 1 --2- 172.21.15.131:0/3019616954 >> v2:172.21.15.84:3300/0 conn(0x7f0c540c6610 0x7f0c540cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c59bb2700 1 -- 172.21.15.131:0/3019616954 >> v1:172.21.15.131:6789/0 conn(0x7f0c540cb980 legacy=0x7f0c540ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.967 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c59bb2700 1 -- 172.21.15.131:0/3019616954 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540cf8b0 con 0x7f0c540b2a90 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c59bb2700 1 --2- 172.21.15.131:0/3019616954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c540b2a90 0x7f0c540cb440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c440098d0 tx=0x7f0c44009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b7c9c3a15f82acb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c58bb0700 1 -- 172.21.15.131:0/3019616954 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44005c10 con 0x7f0c540b2a90 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c58bb0700 1 -- 172.21.15.131:0/3019616954 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44005d70 con 0x7f0c540b2a90 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.950+0000 7f0c58bb0700 1 -- 172.21.15.131:0/3019616954 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44006260 con 0x7f0c540b2a90 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.951+0000 7f0c5be16700 1 -- 172.21.15.131:0/3019616954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c540b2a90 msgr2=0x7f0c540cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.951+0000 7f0c5be16700 1 --2- 172.21.15.131:0/3019616954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c540b2a90 0x7f0c540cb440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c440098d0 tx=0x7f0c44009120 comp rx=0 tx=0).stop 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.951+0000 7f0c5be16700 1 -- 172.21.15.131:0/3019616954 shutdown_connections 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.951+0000 7f0c5be16700 1 --2- 172.21.15.131:0/3019616954 >> v2:172.21.15.84:3300/0 conn(0x7f0c540c6610 0x7f0c540cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.951+0000 7f0c5be16700 1 --2- 172.21.15.131:0/3019616954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c540b2a90 0x7f0c540cb440 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.951+0000 7f0c5be16700 1 -- 172.21.15.131:0/3019616954 >> 172.21.15.131:0/3019616954 conn(0x7f0c54099740 msgr2=0x7f0c5406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.951+0000 7f0c5be16700 1 -- 172.21.15.131:0/3019616954 shutdown_connections 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.951+0000 7f0c5be16700 1 -- 172.21.15.131:0/3019616954 wait complete. 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.952+0000 7f0c5be16700 1 Processor -- start 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.952+0000 7f0c5be16700 1 -- start start 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c5be16700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c540b2a90 0x7f0c5415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c5be16700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c540c6610 0x7f0c54156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c5be16700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c540cb980 0x7f0c540cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c5be16700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415d0b0 con 0x7f0c540c6610 2023-10-06T03:23:32.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c5be16700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415d390 con 0x7f0c540cb980 2023-10-06T03:23:32.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c5be16700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415d670 con 0x7f0c540b2a90 2023-10-06T03:23:32.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c59bb2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c540b2a90 0x7f0c5415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.974 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c59bb2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c540b2a90 0x7f0c5415e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38894/0 (socket says 172.21.15.131:38894) 2023-10-06T03:23:32.974 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c5a3b3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c540cb980 0x7f0c540cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.974 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c59bb2700 1 -- 172.21.15.131:0/2455685293 learned_addr learned my addr 172.21.15.131:0/2455685293 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:32.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c593b1700 1 --2- 172.21.15.131:0/2455685293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c540c6610 0x7f0c54156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c59bb2700 1 -- 172.21.15.131:0/2455685293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c540cb980 msgr2=0x7f0c540cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c59bb2700 1 --2- 172.21.15.131:0/2455685293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c540cb980 0x7f0c540cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c59bb2700 1 -- 172.21.15.131:0/2455685293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c540c6610 msgr2=0x7f0c54156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c59bb2700 1 --2- 172.21.15.131:0/2455685293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c540c6610 0x7f0c54156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c59bb2700 1 -- 172.21.15.131:0/2455685293 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440093c0 con 0x7f0c540b2a90 2023-10-06T03:23:32.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c59bb2700 1 --2- 172.21.15.131:0/2455685293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c540b2a90 0x7f0c5415e960 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009f70 tx=0x7f0c44016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c49ffb700 1 -- 172.21.15.131:0/2455685293 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44005c10 con 0x7f0c540b2a90 2023-10-06T03:23:32.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c49ffb700 1 -- 172.21.15.131:0/2455685293 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4401b690 con 0x7f0c540b2a90 2023-10-06T03:23:32.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c49ffb700 1 -- 172.21.15.131:0/2455685293 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4401ba50 con 0x7f0c540b2a90 2023-10-06T03:23:32.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.953+0000 7f0c5be16700 1 -- 172.21.15.131:0/2455685293 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5415d950 con 0x7f0c540b2a90 2023-10-06T03:23:32.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.954+0000 7f0c5be16700 1 -- 172.21.15.131:0/2455685293 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5415eea0 con 0x7f0c540b2a90 2023-10-06T03:23:32.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.954+0000 7f0c49ffb700 1 -- 172.21.15.131:0/2455685293 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0c4402f6c0 con 0x7f0c540b2a90 2023-10-06T03:23:32.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.954+0000 7f0c49ffb700 1 -- 172.21.15.131:0/2455685293 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f0c4401be40 con 0x7f0c540b2a90 2023-10-06T03:23:32.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.955+0000 7f0c5be16700 1 -- 172.21.15.131:0/2455685293 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5415ddf0 con 0x7f0c540b2a90 2023-10-06T03:23:32.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:32.957+0000 7f0c49ffb700 1 -- 172.21.15.131:0/2455685293 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0c4402fab0 con 0x7f0c540b2a90 2023-10-06T03:23:33.023 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:33.021+0000 7fdfa112d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:23:33.041 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.039+0000 7f0c5be16700 1 -- 172.21.15.131:0/2455685293 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "304b2650-3d07-4149-a997-640d8bb6ab19", "id": 3} v 0) v1 -- 0x7f0c54064ad0 con 0x7f0c540b2a90 2023-10-06T03:23:33.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.046+0000 7f0c49ffb700 1 -- 172.21.15.131:0/2455685293 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "304b2650-3d07-4149-a997-640d8bb6ab19", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c4402fd10 con 0x7f0c540b2a90 2023-10-06T03:23:33.048 INFO:teuthology.orchestra.run.smithi131.stdout:3 2023-10-06T03:23:33.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.047+0000 7f0c5be16700 1 -- 172.21.15.131:0/2455685293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c540b2a90 msgr2=0x7f0c5415e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.047+0000 7f0c5be16700 1 --2- 172.21.15.131:0/2455685293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c540b2a90 0x7f0c5415e960 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009f70 tx=0x7f0c44016000 comp rx=0 tx=0).stop 2023-10-06T03:23:33.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.047+0000 7f0c5be16700 1 -- 172.21.15.131:0/2455685293 shutdown_connections 2023-10-06T03:23:33.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.047+0000 7f0c5be16700 1 --2- 172.21.15.131:0/2455685293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c540cb980 0x7f0c540cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.047+0000 7f0c5be16700 1 --2- 172.21.15.131:0/2455685293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c540b2a90 0x7f0c5415e960 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.047+0000 7f0c5be16700 1 --2- 172.21.15.131:0/2455685293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c540c6610 0x7f0c54156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.047+0000 7f0c5be16700 1 -- 172.21.15.131:0/2455685293 >> 172.21.15.131:0/2455685293 conn(0x7f0c54099740 msgr2=0x7f0c54158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:33.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.047+0000 7f0c5be16700 1 -- 172.21.15.131:0/2455685293 shutdown_connections 2023-10-06T03:23:33.050 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.048+0000 7f0c5be16700 1 -- 172.21.15.131:0/2455685293 wait complete. 2023-10-06T03:23:33.065 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 1f73b3ae-0080-4619-9296-e989f4d4980f 4 2023-10-06T03:23:33.124 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:33.123+0000 7f6e691d5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:23:33.187 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.186+0000 7f47d2db8700 1 Processor -- start 2023-10-06T03:23:33.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.186+0000 7f47d2db8700 1 -- start start 2023-10-06T03:23:33.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d2db8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc1559d0 0x7f47cc0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d2db8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f47cc159e60 0x7f47cc06e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d2db8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0ca5f0 con 0x7f47cc155da0 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d2db8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc0cb450 con 0x7f47cc159e60 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d2db8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0ca840 con 0x7f47cc1559d0 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47cbfff700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f47cc155da0 0x7f47cc159750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:59354/0 (socket says 172.21.15.131:59354) 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d0b54700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc1559d0 0x7f47cc0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47cbfff700 1 -- 172.21.15.131:0/178519988 learned_addr learned my addr 172.21.15.131:0/178519988 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d1355700 1 --2- 172.21.15.131:0/178519988 >> v2:172.21.15.84:3300/0 conn(0x7f47cc159e60 0x7f47cc06e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47cb7fe700 1 -- 172.21.15.131:0/178519988 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119748177 0 0) 0x7f47cc0ca5f0 con 0x7f47cc155da0 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d0b54700 1 -- 172.21.15.131:0/178519988 >> v2:172.21.15.84:3300/0 conn(0x7f47cc159e60 msgr2=0x7f47cc06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d0b54700 1 --2- 172.21.15.131:0/178519988 >> v2:172.21.15.84:3300/0 conn(0x7f47cc159e60 0x7f47cc06e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d0b54700 1 -- 172.21.15.131:0/178519988 >> v1:172.21.15.131:6789/0 conn(0x7f47cc155da0 legacy=0x7f47cc159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d0b54700 1 -- 172.21.15.131:0/178519988 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0cab20 con 0x7f47cc1559d0 2023-10-06T03:23:33.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.187+0000 7f47d0b54700 1 --2- 172.21.15.131:0/178519988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc1559d0 0x7f47cc0cb8e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f47c00098e0 tx=0x7f47c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a57b36f7e2c4967 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:33.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47cb7fe700 1 -- 172.21.15.131:0/178519988 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c000b640 con 0x7f47cc1559d0 2023-10-06T03:23:33.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47cb7fe700 1 -- 172.21.15.131:0/178519988 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c000b7a0 con 0x7f47cc1559d0 2023-10-06T03:23:33.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47cb7fe700 1 -- 172.21.15.131:0/178519988 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c000bb40 con 0x7f47cc1559d0 2023-10-06T03:23:33.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47d2db8700 1 -- 172.21.15.131:0/178519988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc1559d0 msgr2=0x7f47cc0cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47d2db8700 1 --2- 172.21.15.131:0/178519988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc1559d0 0x7f47cc0cb8e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f47c00098e0 tx=0x7f47c00091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47d2db8700 1 -- 172.21.15.131:0/178519988 shutdown_connections 2023-10-06T03:23:33.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47d2db8700 1 --2- 172.21.15.131:0/178519988 >> v2:172.21.15.84:3300/0 conn(0x7f47cc159e60 0x7f47cc06e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47d2db8700 1 --2- 172.21.15.131:0/178519988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc1559d0 0x7f47cc0cb8e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47d2db8700 1 -- 172.21.15.131:0/178519988 >> 172.21.15.131:0/178519988 conn(0x7f47cc0cc0d0 msgr2=0x7f47cc0cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:33.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47d2db8700 1 -- 172.21.15.131:0/178519988 shutdown_connections 2023-10-06T03:23:33.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.188+0000 7f47d2db8700 1 -- 172.21.15.131:0/178519988 wait complete. 2023-10-06T03:23:33.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.189+0000 7f47d2db8700 1 Processor -- start 2023-10-06T03:23:33.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.190+0000 7f47d2db8700 1 -- start start 2023-10-06T03:23:33.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47d2db8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc1559d0 0x7f47cc167450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47d2db8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47cc155da0 0x7f47cc0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47d2db8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc159e60 0x7f47cc146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47d2db8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc1683d0 con 0x7f47cc1559d0 2023-10-06T03:23:33.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47d2db8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc16ac80 con 0x7f47cc155da0 2023-10-06T03:23:33.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47d2db8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0ae6d0 con 0x7f47cc159e60 2023-10-06T03:23:33.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47cbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47cc155da0 0x7f47cc0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47d1355700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc159e60 0x7f47cc146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47cbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47cc155da0 0x7f47cc0ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:59860/0 (socket says 172.21.15.131:59860) 2023-10-06T03:23:33.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47d1355700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc159e60 0x7f47cc146ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38912/0 (socket says 172.21.15.131:38912) 2023-10-06T03:23:33.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47cbfff700 1 -- 172.21.15.131:0/3210359733 learned_addr learned my addr 172.21.15.131:0/3210359733 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:33.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47d0b54700 1 --2- 172.21.15.131:0/3210359733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc1559d0 0x7f47cc167450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47cbfff700 1 -- 172.21.15.131:0/3210359733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc159e60 msgr2=0x7f47cc146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47cbfff700 1 --2- 172.21.15.131:0/3210359733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc159e60 0x7f47cc146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47cbfff700 1 -- 172.21.15.131:0/3210359733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc1559d0 msgr2=0x7f47cc167450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47cbfff700 1 --2- 172.21.15.131:0/3210359733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc1559d0 0x7f47cc167450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47cbfff700 1 -- 172.21.15.131:0/3210359733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c0009420 con 0x7f47cc155da0 2023-10-06T03:23:33.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.191+0000 7f47cbfff700 1 --2- 172.21.15.131:0/3210359733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47cc155da0 0x7f47cc0ae190 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f47b800c840 tx=0x7f47b8007db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:33.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.192+0000 7f47c8ff9700 1 -- 172.21.15.131:0/3210359733 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8005c00 con 0x7f47cc155da0 2023-10-06T03:23:33.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.192+0000 7f47c8ff9700 1 -- 172.21.15.131:0/3210359733 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b8005d60 con 0x7f47cc155da0 2023-10-06T03:23:33.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.192+0000 7f47d2db8700 1 -- 172.21.15.131:0/3210359733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc1470e0 con 0x7f47cc155da0 2023-10-06T03:23:33.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.192+0000 7f47c8ff9700 1 -- 172.21.15.131:0/3210359733 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8007300 con 0x7f47cc155da0 2023-10-06T03:23:33.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.192+0000 7f47d2db8700 1 -- 172.21.15.131:0/3210359733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc167e10 con 0x7f47cc155da0 2023-10-06T03:23:33.199 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.192+0000 7f47c8ff9700 1 -- 172.21.15.131:0/3210359733 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f47b801c6c0 con 0x7f47cc155da0 2023-10-06T03:23:33.199 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.192+0000 7f47d2db8700 1 -- 172.21.15.131:0/3210359733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc16aa50 con 0x7f47cc155da0 2023-10-06T03:23:33.199 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.193+0000 7f47c8ff9700 1 -- 172.21.15.131:0/3210359733 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f47b80076f0 con 0x7f47cc155da0 2023-10-06T03:23:33.199 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.195+0000 7f47c8ff9700 1 -- 172.21.15.131:0/3210359733 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f47cc16aa50 con 0x7f47cc155da0 2023-10-06T03:23:33.217 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:33.216+0000 7fdfa112d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:23:33.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.277+0000 7f47d2db8700 1 -- 172.21.15.131:0/3210359733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1f73b3ae-0080-4619-9296-e989f4d4980f", "id": 4} v 0) v1 -- 0x7f47cc064ad0 con 0x7f47cc155da0 2023-10-06T03:23:33.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.282+0000 7f47c8ff9700 1 -- 172.21.15.131:0/3210359733 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f73b3ae-0080-4619-9296-e989f4d4980f", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47b8017070 con 0x7f47cc155da0 2023-10-06T03:23:33.284 INFO:teuthology.orchestra.run.smithi131.stdout:4 2023-10-06T03:23:33.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.283+0000 7f47d2db8700 1 -- 172.21.15.131:0/3210359733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47cc155da0 msgr2=0x7f47cc0ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.283+0000 7f47d2db8700 1 --2- 172.21.15.131:0/3210359733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47cc155da0 0x7f47cc0ae190 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f47b800c840 tx=0x7f47b8007db0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.283+0000 7f47d2db8700 1 -- 172.21.15.131:0/3210359733 shutdown_connections 2023-10-06T03:23:33.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.283+0000 7f47d2db8700 1 --2- 172.21.15.131:0/3210359733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47cc159e60 0x7f47cc146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.283+0000 7f47d2db8700 1 --2- 172.21.15.131:0/3210359733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc1559d0 0x7f47cc167450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.283+0000 7f47d2db8700 1 --2- 172.21.15.131:0/3210359733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47cc155da0 0x7f47cc0ae190 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.283+0000 7f47d2db8700 1 -- 172.21.15.131:0/3210359733 >> 172.21.15.131:0/3210359733 conn(0x7f47cc0cc0d0 msgr2=0x7f47cc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:33.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.283+0000 7f47d2db8700 1 -- 172.21.15.131:0/3210359733 shutdown_connections 2023-10-06T03:23:33.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.283+0000 7f47d2db8700 1 -- 172.21.15.131:0/3210359733 wait complete. 2023-10-06T03:23:33.296 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 1830956c-00c4-4992-af84-7472db118490 5 2023-10-06T03:23:33.297 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:33.296+0000 7f6e691d5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:23:33.372 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:33.371+0000 7f6e691d5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:23:33.397 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:33.395+0000 7fdfa112d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:23:33.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.414+0000 7f96cab01700 1 Processor -- start 2023-10-06T03:23:33.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.415+0000 7f96cab01700 1 -- start start 2023-10-06T03:23:33.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.415+0000 7f96cab01700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96c40cbb50 0x7f96c40ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.415+0000 7f96cab01700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c40ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.415+0000 7f96cab01700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40b2e60 con 0x7f96c40b2a90 2023-10-06T03:23:33.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.415+0000 7f96cab01700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40cf5d0 con 0x7f96c40cbb50 2023-10-06T03:23:33.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.415+0000 7f96cab01700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cf8b0 con 0x7f96c40c6610 2023-10-06T03:23:33.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.415+0000 7f96c909e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c40ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c909e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c40ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38914/0 (socket says 172.21.15.131:38914) 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c909e700 1 -- 172.21.15.131:0/511962267 learned_addr learned my addr 172.21.15.131:0/511962267 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c3fff700 1 --2- 172.21.15.131:0/511962267 >> v2:172.21.15.84:3300/0 conn(0x7f96c40cbb50 0x7f96c40ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c909e700 1 -- 172.21.15.131:0/511962267 >> v2:172.21.15.84:3300/0 conn(0x7f96c40cbb50 msgr2=0x7f96c40ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c909e700 1 --2- 172.21.15.131:0/511962267 >> v2:172.21.15.84:3300/0 conn(0x7f96c40cbb50 0x7f96c40ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c909e700 1 -- 172.21.15.131:0/511962267 >> v1:172.21.15.84:6789/0 conn(0x7f96c40b2a90 legacy=0x7f96c40cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c909e700 1 -- 172.21.15.131:0/511962267 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40cfb90 con 0x7f96c40c6610 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c3fff700 1 --2- 172.21.15.131:0/511962267 >> v2:172.21.15.84:3300/0 conn(0x7f96c40cbb50 0x7f96c40ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c909e700 1 --2- 172.21.15.131:0/511962267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c40ced90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009f20 tx=0x7f96bc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=348abd142edcde9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c37fe700 1 -- 172.21.15.131:0/511962267 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00e070 con 0x7f96c40c6610 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c37fe700 1 -- 172.21.15.131:0/511962267 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc00ba80 con 0x7f96c40c6610 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.416+0000 7f96c37fe700 1 -- 172.21.15.131:0/511962267 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0092e0 con 0x7f96c40c6610 2023-10-06T03:23:33.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.417+0000 7f96cab01700 1 -- 172.21.15.131:0/511962267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 msgr2=0x7f96c40ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.417+0000 7f96cab01700 1 --2- 172.21.15.131:0/511962267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c40ced90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009f20 tx=0x7f96bc009840 comp rx=0 tx=0).stop 2023-10-06T03:23:33.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.417+0000 7f96cab01700 1 -- 172.21.15.131:0/511962267 shutdown_connections 2023-10-06T03:23:33.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.417+0000 7f96cab01700 1 --2- 172.21.15.131:0/511962267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c40ced90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.417+0000 7f96cab01700 1 --2- 172.21.15.131:0/511962267 >> v2:172.21.15.84:3300/0 conn(0x7f96c40cbb50 0x7f96c40ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.417+0000 7f96cab01700 1 -- 172.21.15.131:0/511962267 >> 172.21.15.131:0/511962267 conn(0x7f96c4099740 msgr2=0x7f96c406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:33.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.417+0000 7f96cab01700 1 -- 172.21.15.131:0/511962267 shutdown_connections 2023-10-06T03:23:33.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.417+0000 7f96cab01700 1 -- 172.21.15.131:0/511962267 wait complete. 2023-10-06T03:23:33.422 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.418+0000 7f96cab01700 1 Processor -- start 2023-10-06T03:23:33.422 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.418+0000 7f96cab01700 1 -- start start 2023-10-06T03:23:33.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96cab01700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c40b2a90 0x7f96c409dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96cab01700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c41511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96cab01700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96c40cbb50 0x7f96c40caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96cab01700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c409c110 con 0x7f96c40cbb50 2023-10-06T03:23:33.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96cab01700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4155fb0 con 0x7f96c40b2a90 2023-10-06T03:23:33.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96cab01700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c409b870 con 0x7f96c40c6610 2023-10-06T03:23:33.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c41511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c41511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38922/0 (socket says 172.21.15.131:38922) 2023-10-06T03:23:33.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c889d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c40b2a90 0x7f96c409dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c3fff700 1 -- 172.21.15.131:0/1901307806 learned_addr learned my addr 172.21.15.131:0/1901307806 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:33.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c909e700 1 --2- 172.21.15.131:0/1901307806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96c40cbb50 0x7f96c40caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c3fff700 1 -- 172.21.15.131:0/1901307806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c40b2a90 msgr2=0x7f96c409dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c3fff700 1 --2- 172.21.15.131:0/1901307806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c40b2a90 0x7f96c409dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c3fff700 1 -- 172.21.15.131:0/1901307806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96c40cbb50 msgr2=0x7f96c40caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c3fff700 1 --2- 172.21.15.131:0/1901307806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96c40cbb50 0x7f96c40caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c3fff700 1 -- 172.21.15.131:0/1901307806 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc009ae0 con 0x7f96c40c6610 2023-10-06T03:23:33.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c3fff700 1 --2- 172.21.15.131:0/1901307806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c41511b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f96b000d860 tx=0x7f96b0008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:33.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c0ff9700 1 -- 172.21.15.131:0/1901307806 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00125f0 con 0x7f96c40c6610 2023-10-06T03:23:33.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c0ff9700 1 -- 172.21.15.131:0/1901307806 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b0012750 con 0x7f96c40c6610 2023-10-06T03:23:33.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96cab01700 1 -- 172.21.15.131:0/1901307806 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c409bb50 con 0x7f96c40c6610 2023-10-06T03:23:33.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96c0ff9700 1 -- 172.21.15.131:0/1901307806 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b0012af0 con 0x7f96c40c6610 2023-10-06T03:23:33.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.419+0000 7f96cab01700 1 -- 172.21.15.131:0/1901307806 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c409e130 con 0x7f96c40c6610 2023-10-06T03:23:33.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.420+0000 7f96c0ff9700 1 -- 172.21.15.131:0/1901307806 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f96b0014430 con 0x7f96c40c6610 2023-10-06T03:23:33.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.420+0000 7f96c0ff9700 1 -- 172.21.15.131:0/1901307806 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f96b0013390 con 0x7f96c40c6610 2023-10-06T03:23:33.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.420+0000 7f96cab01700 1 -- 172.21.15.131:0/1901307806 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c4155d80 con 0x7f96c40c6610 2023-10-06T03:23:33.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.422+0000 7f96c0ff9700 1 -- 172.21.15.131:0/1901307806 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f96c4155d80 con 0x7f96c40c6610 2023-10-06T03:23:33.477 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:33.476+0000 7fdfa112d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:23:33.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.504+0000 7f96cab01700 1 -- 172.21.15.131:0/1901307806 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1830956c-00c4-4992-af84-7472db118490", "id": 5} v 0) v1 -- 0x7f96c4064ad0 con 0x7f96c40c6610 2023-10-06T03:23:33.509 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.508+0000 7f96c0ff9700 1 -- 172.21.15.131:0/1901307806 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1830956c-00c4-4992-af84-7472db118490", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f96b0005a00 con 0x7f96c40c6610 2023-10-06T03:23:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:5 2023-10-06T03:23:33.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.509+0000 7f96cab01700 1 -- 172.21.15.131:0/1901307806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 msgr2=0x7f96c41511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.509+0000 7f96cab01700 1 --2- 172.21.15.131:0/1901307806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c41511b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f96b000d860 tx=0x7f96b0008040 comp rx=0 tx=0).stop 2023-10-06T03:23:33.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.509+0000 7f96cab01700 1 -- 172.21.15.131:0/1901307806 shutdown_connections 2023-10-06T03:23:33.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.509+0000 7f96cab01700 1 --2- 172.21.15.131:0/1901307806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c40b2a90 0x7f96c409dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.509+0000 7f96cab01700 1 --2- 172.21.15.131:0/1901307806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96c40cbb50 0x7f96c40caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.509+0000 7f96cab01700 1 --2- 172.21.15.131:0/1901307806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96c40c6610 0x7f96c41511b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.509+0000 7f96cab01700 1 -- 172.21.15.131:0/1901307806 >> 172.21.15.131:0/1901307806 conn(0x7f96c4099740 msgr2=0x7f96c4151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:33.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.509+0000 7f96cab01700 1 -- 172.21.15.131:0/1901307806 shutdown_connections 2023-10-06T03:23:33.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.509+0000 7f96cab01700 1 -- 172.21.15.131:0/1901307806 wait complete. 2023-10-06T03:23:33.515 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:33.514+0000 7f6e691d5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:23:33.523 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 16dd47a4-ee93-4ac1-b8d5-12761767b047 6 2023-10-06T03:23:33.611 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:33.611+0000 7f6e691d5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:23:33.620 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:33.619+0000 7fdfa112d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:23:33.643 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.641+0000 7fdef750f700 1 Processor -- start 2023-10-06T03:23:33.643 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.641+0000 7fdef750f700 1 -- start start 2023-10-06T03:23:33.655 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.642+0000 7fdef750f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00b2a90 0x7fdef00cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.655 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.642+0000 7fdef750f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdef00cb980 0x7fdef00ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.656 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.642+0000 7fdef750f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef00cbdf0 con 0x7fdef00ced90 2023-10-06T03:23:33.656 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.642+0000 7fdef750f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef00b2e60 con 0x7fdef00cb980 2023-10-06T03:23:33.656 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.642+0000 7fdef750f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef00cf5d0 con 0x7fdef00b2a90 2023-10-06T03:23:33.656 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.642+0000 7fdef52ab700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00b2a90 0x7fdef00cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.656 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.642+0000 7fdef5aac700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fdef00ced90 0x7fdef00c5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:59362/0 (socket says 172.21.15.131:59362) 2023-10-06T03:23:33.657 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.642+0000 7fdef5aac700 1 -- 172.21.15.131:0/2921993666 learned_addr learned my addr 172.21.15.131:0/2921993666 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-10-06T03:23:33.657 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.642+0000 7fdef4aaa700 1 --2- 172.21.15.131:0/2921993666 >> v2:172.21.15.84:3300/0 conn(0x7fdef00cb980 0x7fdef00ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.657 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdee7fff700 1 -- 172.21.15.131:0/2921993666 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455222967 0 0) 0x7fdef00cbdf0 con 0x7fdef00ced90 2023-10-06T03:23:33.658 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdef52ab700 1 -- 172.21.15.131:0/2921993666 >> v2:172.21.15.84:3300/0 conn(0x7fdef00cb980 msgr2=0x7fdef00ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:33.658 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdef52ab700 1 --2- 172.21.15.131:0/2921993666 >> v2:172.21.15.84:3300/0 conn(0x7fdef00cb980 0x7fdef00ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.658 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdef52ab700 1 -- 172.21.15.131:0/2921993666 >> v1:172.21.15.131:6789/0 conn(0x7fdef00ced90 legacy=0x7fdef00c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.658 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdef52ab700 1 -- 172.21.15.131:0/2921993666 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef00cf8b0 con 0x7fdef00b2a90 2023-10-06T03:23:33.658 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdef52ab700 1 --2- 172.21.15.131:0/2921993666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00b2a90 0x7fdef00cb440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdee00098d0 tx=0x7fdee0009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa994394dde96d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:33.658 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdee7fff700 1 -- 172.21.15.131:0/2921993666 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0009e70 con 0x7fdef00b2a90 2023-10-06T03:23:33.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdee7fff700 1 -- 172.21.15.131:0/2921993666 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee0005c10 con 0x7fdef00b2a90 2023-10-06T03:23:33.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdee7fff700 1 -- 172.21.15.131:0/2921993666 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee000b650 con 0x7fdef00b2a90 2023-10-06T03:23:33.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdef750f700 1 -- 172.21.15.131:0/2921993666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00b2a90 msgr2=0x7fdef00cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.643+0000 7fdef750f700 1 --2- 172.21.15.131:0/2921993666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00b2a90 0x7fdef00cb440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdee00098d0 tx=0x7fdee0009120 comp rx=0 tx=0).stop 2023-10-06T03:23:33.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.644+0000 7fdef750f700 1 -- 172.21.15.131:0/2921993666 shutdown_connections 2023-10-06T03:23:33.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.644+0000 7fdef750f700 1 --2- 172.21.15.131:0/2921993666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00b2a90 0x7fdef00cb440 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.644+0000 7fdef750f700 1 --2- 172.21.15.131:0/2921993666 >> v2:172.21.15.84:3300/0 conn(0x7fdef00cb980 0x7fdef00ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.644+0000 7fdef750f700 1 -- 172.21.15.131:0/2921993666 >> 172.21.15.131:0/2921993666 conn(0x7fdef0099740 msgr2=0x7fdef006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:33.660 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.644+0000 7fdef750f700 1 -- 172.21.15.131:0/2921993666 shutdown_connections 2023-10-06T03:23:33.660 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.644+0000 7fdef750f700 1 -- 172.21.15.131:0/2921993666 wait complete. 2023-10-06T03:23:33.660 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.645+0000 7fdef750f700 1 Processor -- start 2023-10-06T03:23:33.660 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.645+0000 7fdef750f700 1 -- start start 2023-10-06T03:23:33.660 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef750f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef00b2a90 0x7fdef015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.660 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef750f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00cb980 0x7fdef016a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.660 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef750f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef00ced90 0x7fdef014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.660 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef750f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef015ce20 con 0x7fdef00ced90 2023-10-06T03:23:33.661 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef750f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef016aa90 con 0x7fdef00b2a90 2023-10-06T03:23:33.661 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef750f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef0150540 con 0x7fdef00cb980 2023-10-06T03:23:33.661 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef52ab700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef00b2a90 0x7fdef015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.661 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef4aaa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00cb980 0x7fdef016a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.661 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef4aaa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00cb980 0x7fdef016a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38950/0 (socket says 172.21.15.131:38950) 2023-10-06T03:23:33.662 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef52ab700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef00b2a90 0x7fdef015d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:59874/0 (socket says 172.21.15.131:59874) 2023-10-06T03:23:33.662 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef4aaa700 1 -- 172.21.15.131:0/2015554417 learned_addr learned my addr 172.21.15.131:0/2015554417 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:33.662 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef5aac700 1 --2- 172.21.15.131:0/2015554417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef00ced90 0x7fdef014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.663 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef4aaa700 1 -- 172.21.15.131:0/2015554417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef00b2a90 msgr2=0x7fdef015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.663 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef4aaa700 1 --2- 172.21.15.131:0/2015554417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef00b2a90 0x7fdef015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.663 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef4aaa700 1 -- 172.21.15.131:0/2015554417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef00ced90 msgr2=0x7fdef014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.663 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef4aaa700 1 --2- 172.21.15.131:0/2015554417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef00ced90 0x7fdef014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.664 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef4aaa700 1 -- 172.21.15.131:0/2015554417 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee00093c0 con 0x7fdef00cb980 2023-10-06T03:23:33.664 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef52ab700 1 --2- 172.21.15.131:0/2015554417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef00b2a90 0x7fdef015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:33.664 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef4aaa700 1 --2- 172.21.15.131:0/2015554417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00cb980 0x7fdef016a550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00d890 tx=0x7fdeec008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:33.664 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdee57fa700 1 -- 172.21.15.131:0/2015554417 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0125f0 con 0x7fdef00cb980 2023-10-06T03:23:33.664 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdee57fa700 1 -- 172.21.15.131:0/2015554417 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec012750 con 0x7fdef00cb980 2023-10-06T03:23:33.664 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef750f700 1 -- 172.21.15.131:0/2015554417 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef0150050 con 0x7fdef00cb980 2023-10-06T03:23:33.664 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdee57fa700 1 -- 172.21.15.131:0/2015554417 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec012af0 con 0x7fdef00cb980 2023-10-06T03:23:33.665 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdef750f700 1 -- 172.21.15.131:0/2015554417 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef015c4f0 con 0x7fdef00cb980 2023-10-06T03:23:33.665 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.646+0000 7fdee57fa700 1 -- 172.21.15.131:0/2015554417 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdeec01e460 con 0x7fdef00cb980 2023-10-06T03:23:33.665 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.647+0000 7fdee57fa700 1 -- 172.21.15.131:0/2015554417 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fdeec014a30 con 0x7fdef00cb980 2023-10-06T03:23:33.665 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.647+0000 7fdef750f700 1 -- 172.21.15.131:0/2015554417 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef015d7f0 con 0x7fdef00cb980 2023-10-06T03:23:33.666 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.649+0000 7fdee57fa700 1 -- 172.21.15.131:0/2015554417 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdeec012e60 con 0x7fdef00cb980 2023-10-06T03:23:33.720 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:33.719+0000 7fdfa112d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:23:33.734 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.733+0000 7fdef750f700 1 -- 172.21.15.131:0/2015554417 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "16dd47a4-ee93-4ac1-b8d5-12761767b047", "id": 6} v 0) v1 -- 0x7fdef015cfd0 con 0x7fdef00cb980 2023-10-06T03:23:33.740 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.739+0000 7fdee57fa700 1 -- 172.21.15.131:0/2015554417 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16dd47a4-ee93-4ac1-b8d5-12761767b047", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdef015cfd0 con 0x7fdef00cb980 2023-10-06T03:23:33.740 INFO:teuthology.orchestra.run.smithi131.stdout:6 2023-10-06T03:23:33.741 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.740+0000 7fdef750f700 1 -- 172.21.15.131:0/2015554417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00cb980 msgr2=0x7fdef016a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.741 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.740+0000 7fdef750f700 1 --2- 172.21.15.131:0/2015554417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00cb980 0x7fdef016a550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00d890 tx=0x7fdeec008040 comp rx=0 tx=0).stop 2023-10-06T03:23:33.741 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.740+0000 7fdef750f700 1 -- 172.21.15.131:0/2015554417 shutdown_connections 2023-10-06T03:23:33.741 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.740+0000 7fdef750f700 1 --2- 172.21.15.131:0/2015554417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef00b2a90 0x7fdef015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.741 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.740+0000 7fdef750f700 1 --2- 172.21.15.131:0/2015554417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef00ced90 0x7fdef014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.742 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.740+0000 7fdef750f700 1 --2- 172.21.15.131:0/2015554417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef00cb980 0x7fdef016a550 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.742 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.740+0000 7fdef750f700 1 -- 172.21.15.131:0/2015554417 >> 172.21.15.131:0/2015554417 conn(0x7fdef0099740 msgr2=0x7fdef0069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:33.742 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.740+0000 7fdef750f700 1 -- 172.21.15.131:0/2015554417 shutdown_connections 2023-10-06T03:23:33.742 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.740+0000 7fdef750f700 1 -- 172.21.15.131:0/2015554417 wait complete. 2023-10-06T03:23:33.753 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 12050f82-8d6e-4afd-97d2-6ee7290c9416 7 2023-10-06T03:23:33.868 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.867+0000 7f4e625fc700 1 Processor -- start 2023-10-06T03:23:33.868 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.867+0000 7f4e625fc700 1 -- start start 2023-10-06T03:23:33.870 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e625fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e625fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4e5c0cea30 0x7f4e5c0ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e625fc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c0cf3f0 con 0x7f4e5c157130 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e625fc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c15ad70 con 0x7f4e5c0cea30 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e625fc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c15a160 con 0x7f4e5c157500 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e60b99700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4e5c0cea30 0x7f4e5c0ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e5b7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e60b99700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4e5c0cea30 0x7f4e5c0ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:59886/0 (socket says 172.21.15.131:59886) 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e5b7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:38966/0 (socket says 172.21.15.131:38966) 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e60b99700 1 -- 172.21.15.131:0/2998254535 learned_addr learned my addr 172.21.15.131:0/2998254535 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e60b99700 1 -- 172.21.15.131:0/2998254535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 msgr2=0x7f4e5c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:33.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e60b99700 1 --2- 172.21.15.131:0/2998254535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e60b99700 1 -- 172.21.15.131:0/2998254535 >> v1:172.21.15.84:6789/0 conn(0x7f4e5c157130 legacy=0x7f4e5c0cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e60b99700 1 -- 172.21.15.131:0/2998254535 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c15a440 con 0x7f4e5c0cea30 2023-10-06T03:23:33.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e5b7fe700 1 --2- 172.21.15.131:0/2998254535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:33.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.868+0000 7f4e60b99700 1 --2- 172.21.15.131:0/2998254535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 0x7f4e5c0ceeb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009f20 tx=0x7f4e54009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e003b914a8ccb558 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:33.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e5affd700 1 -- 172.21.15.131:0/2998254535 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400e070 con 0x7f4e5c0cea30 2023-10-06T03:23:33.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e5affd700 1 -- 172.21.15.131:0/2998254535 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400b9d0 con 0x7f4e5c0cea30 2023-10-06T03:23:33.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e5affd700 1 -- 172.21.15.131:0/2998254535 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e540092e0 con 0x7f4e5c0cea30 2023-10-06T03:23:33.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e625fc700 1 -- 172.21.15.131:0/2998254535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 msgr2=0x7f4e5c0ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e625fc700 1 --2- 172.21.15.131:0/2998254535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 0x7f4e5c0ceeb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009f20 tx=0x7f4e54009840 comp rx=0 tx=0).stop 2023-10-06T03:23:33.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e625fc700 1 -- 172.21.15.131:0/2998254535 shutdown_connections 2023-10-06T03:23:33.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e625fc700 1 --2- 172.21.15.131:0/2998254535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 0x7f4e5c0ceeb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e625fc700 1 --2- 172.21.15.131:0/2998254535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e625fc700 1 -- 172.21.15.131:0/2998254535 >> 172.21.15.131:0/2998254535 conn(0x7f4e5c06ed20 msgr2=0x7f4e5c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:33.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e625fc700 1 -- 172.21.15.131:0/2998254535 shutdown_connections 2023-10-06T03:23:33.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.869+0000 7f4e625fc700 1 -- 172.21.15.131:0/2998254535 wait complete. 2023-10-06T03:23:33.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.870+0000 7f4e625fc700 1 Processor -- start 2023-10-06T03:23:33.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.870+0000 7f4e625fc700 1 -- start start 2023-10-06T03:23:33.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e625fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 0x7f4e5c144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e625fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5c157130 0x7f4e5c0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e625fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:33.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e625fc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0b2c00 con 0x7f4e5c157130 2023-10-06T03:23:33.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e625fc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0c9a70 con 0x7f4e5c0cea30 2023-10-06T03:23:33.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e625fc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c145190 con 0x7f4e5c157500 2023-10-06T03:23:33.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e5bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 0x7f4e5c144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e60b99700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e5bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 0x7f4e5c144c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:59890/0 (socket says 172.21.15.131:59890) 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e5bfff700 1 -- 172.21.15.131:0/3023147159 learned_addr learned my addr 172.21.15.131:0/3023147159 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.871+0000 7f4e5b7fe700 1 --2- 172.21.15.131:0/3023147159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5c157130 0x7f4e5c0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e60b99700 1 -- 172.21.15.131:0/3023147159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 msgr2=0x7f4e5c144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e60b99700 1 --2- 172.21.15.131:0/3023147159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 0x7f4e5c144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e60b99700 1 -- 172.21.15.131:0/3023147159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5c157130 msgr2=0x7f4e5c0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e60b99700 1 --2- 172.21.15.131:0/3023147159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5c157130 0x7f4e5c0b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e60b99700 1 -- 172.21.15.131:0/3023147159 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50009420 con 0x7f4e5c157500 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e5bfff700 1 --2- 172.21.15.131:0/3023147159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 0x7f4e5c144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:33.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e60b99700 1 --2- 172.21.15.131:0/3023147159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0b18e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4e54015000 tx=0x7f4e54018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:33.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e43fff700 1 -- 172.21.15.131:0/3023147159 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54008ad0 con 0x7f4e5c157500 2023-10-06T03:23:33.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e43fff700 1 -- 172.21.15.131:0/3023147159 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e54008c30 con 0x7f4e5c157500 2023-10-06T03:23:33.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e43fff700 1 -- 172.21.15.131:0/3023147159 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54026460 con 0x7f4e5c157500 2023-10-06T03:23:33.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e625fc700 1 -- 172.21.15.131:0/3023147159 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e54009ae0 con 0x7f4e5c157500 2023-10-06T03:23:33.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e625fc700 1 -- 172.21.15.131:0/3023147159 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c0b2260 con 0x7f4e5c157500 2023-10-06T03:23:33.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e43fff700 1 -- 172.21.15.131:0/3023147159 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4e54003040 con 0x7f4e5c157500 2023-10-06T03:23:33.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.872+0000 7f4e43fff700 1 -- 172.21.15.131:0/3023147159 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f4e54026cd0 con 0x7f4e5c157500 2023-10-06T03:23:33.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.873+0000 7f4e625fc700 1 -- 172.21.15.131:0/3023147159 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c064ad0 con 0x7f4e5c157500 2023-10-06T03:23:33.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.875+0000 7f4e43fff700 1 -- 172.21.15.131:0/3023147159 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4e5402b020 con 0x7f4e5c157500 2023-10-06T03:23:33.956 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.955+0000 7f4e625fc700 1 -- 172.21.15.131:0/3023147159 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "12050f82-8d6e-4afd-97d2-6ee7290c9416", "id": 7} v 0) v1 -- 0x7f4e5c0ccfb0 con 0x7f4e5c157500 2023-10-06T03:23:33.964 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.963+0000 7f4e43fff700 1 -- 172.21.15.131:0/3023147159 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12050f82-8d6e-4afd-97d2-6ee7290c9416", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e54021070 con 0x7f4e5c157500 2023-10-06T03:23:33.964 INFO:teuthology.orchestra.run.smithi131.stdout:7 2023-10-06T03:23:33.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.964+0000 7f4e625fc700 1 -- 172.21.15.131:0/3023147159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 msgr2=0x7f4e5c0b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.964+0000 7f4e625fc700 1 --2- 172.21.15.131:0/3023147159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0b18e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4e54015000 tx=0x7f4e54018000 comp rx=0 tx=0).stop 2023-10-06T03:23:33.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.964+0000 7f4e625fc700 1 -- 172.21.15.131:0/3023147159 shutdown_connections 2023-10-06T03:23:33.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.964+0000 7f4e625fc700 1 --2- 172.21.15.131:0/3023147159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e5c0cea30 0x7f4e5c144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.964+0000 7f4e625fc700 1 --2- 172.21.15.131:0/3023147159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e5c157500 0x7f4e5c0b18e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.964+0000 7f4e625fc700 1 --2- 172.21.15.131:0/3023147159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5c157130 0x7f4e5c0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.964+0000 7f4e625fc700 1 -- 172.21.15.131:0/3023147159 >> 172.21.15.131:0/3023147159 conn(0x7f4e5c06ed20 msgr2=0x7f4e5c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:33.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.964+0000 7f4e625fc700 1 -- 172.21.15.131:0/3023147159 shutdown_connections 2023-10-06T03:23:33.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T03:23:33.964+0000 7f4e625fc700 1 -- 172.21.15.131:0/3023147159 wait complete. 2023-10-06T03:23:33.976 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T03:23:33.976 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T03:23:33.978 INFO:tasks.ceph.osd.0:Started 2023-10-06T03:23:33.979 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T03:23:33.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T03:23:33.981 INFO:tasks.ceph.osd.1:Started 2023-10-06T03:23:33.981 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T03:23:33.981 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T03:23:33.983 INFO:tasks.ceph.osd.2:Started 2023-10-06T03:23:33.983 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T03:23:33.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T03:23:33.986 INFO:tasks.ceph.osd.3:Started 2023-10-06T03:23:33.986 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T03:23:33.986 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T03:23:33.988 INFO:tasks.ceph.osd.4:Started 2023-10-06T03:23:33.988 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T03:23:33.988 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T03:23:33.990 INFO:tasks.ceph.osd.5:Started 2023-10-06T03:23:33.990 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T03:23:33.990 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T03:23:33.992 INFO:tasks.ceph.osd.6:Started 2023-10-06T03:23:33.993 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T03:23:33.993 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T03:23:33.994 INFO:tasks.ceph.osd.7:Started 2023-10-06T03:23:33.995 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:34.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.134+0000 7f80232cb700 1 Processor -- start 2023-10-06T03:23:34.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.135+0000 7f80232cb700 1 -- start start 2023-10-06T03:23:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.135+0000 7f80232cb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f801c0ad250 0x7f801c0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.135+0000 7f80232cb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 0x7f801c15d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.135+0000 7f80232cb700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801c0ced30 con 0x7f801c15d980 2023-10-06T03:23:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.135+0000 7f80232cb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801c15de20 con 0x7f801c0ad250 2023-10-06T03:23:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.135+0000 7f80232cb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0cf010 con 0x7f801c0ad620 2023-10-06T03:23:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f8021067700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f801c0ad250 0x7f801c0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f8021067700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f801c0ad250 0x7f801c0cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44666/0 (socket says 172.21.15.84:44666) 2023-10-06T03:23:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f8021067700 1 -- 172.21.15.84:0/1115859408 learned_addr learned my addr 172.21.15.84:0/1115859408 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f8020866700 1 --2- 172.21.15.84:0/1115859408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 0x7f801c15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f8021067700 1 -- 172.21.15.84:0/1115859408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 msgr2=0x7f801c15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f8021067700 1 --2- 172.21.15.84:0/1115859408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 0x7f801c15d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f8021067700 1 -- 172.21.15.84:0/1115859408 >> v1:172.21.15.131:6789/0 conn(0x7f801c15d980 legacy=0x7f801c068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f8021067700 1 -- 172.21.15.84:0/1115859408 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c0ccad0 con 0x7f801c0ad250 2023-10-06T03:23:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f8020866700 1 --2- 172.21.15.84:0/1115859408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 0x7f801c15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f8021067700 1 --2- 172.21.15.84:0/1115859408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 0x7f801c0cd2d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8010009990 tx=0x7f8010009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b283ba1c0252e465 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f800ffff700 1 -- 172.21.15.84:0/1115859408 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010005c10 con 0x7f801c0ad250 2023-10-06T03:23:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f800ffff700 1 -- 172.21.15.84:0/1115859408 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010005d70 con 0x7f801c0ad250 2023-10-06T03:23:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.136+0000 7f800ffff700 1 -- 172.21.15.84:0/1115859408 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000b880 con 0x7f801c0ad250 2023-10-06T03:23:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.137+0000 7f80232cb700 1 -- 172.21.15.84:0/1115859408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 msgr2=0x7f801c0cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.137+0000 7f80232cb700 1 --2- 172.21.15.84:0/1115859408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 0x7f801c0cd2d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8010009990 tx=0x7f8010009220 comp rx=0 tx=0).stop 2023-10-06T03:23:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.137+0000 7f80232cb700 1 -- 172.21.15.84:0/1115859408 shutdown_connections 2023-10-06T03:23:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.137+0000 7f80232cb700 1 --2- 172.21.15.84:0/1115859408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 0x7f801c0cd2d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.137+0000 7f80232cb700 1 --2- 172.21.15.84:0/1115859408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 0x7f801c15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.137+0000 7f80232cb700 1 -- 172.21.15.84:0/1115859408 >> 172.21.15.84:0/1115859408 conn(0x7f801c067dd0 msgr2=0x7f801c0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.137+0000 7f80232cb700 1 -- 172.21.15.84:0/1115859408 shutdown_connections 2023-10-06T03:23:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.137+0000 7f80232cb700 1 -- 172.21.15.84:0/1115859408 wait complete. 2023-10-06T03:23:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.138+0000 7f80232cb700 1 Processor -- start 2023-10-06T03:23:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.138+0000 7f80232cb700 1 -- start start 2023-10-06T03:23:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f80232cb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 0x7f801c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f80232cb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 0x7f801c0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f80232cb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f801c15d980 0x7f801c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f80232cb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0b2ed0 con 0x7f801c0ad250 2023-10-06T03:23:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f80232cb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0b31b0 con 0x7f801c15d980 2023-10-06T03:23:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f80232cb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0b3490 con 0x7f801c0ad620 2023-10-06T03:23:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021067700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 0x7f801c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021067700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 0x7f801c0b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44674/0 (socket says 172.21.15.84:44674) 2023-10-06T03:23:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021067700 1 -- 172.21.15.84:0/2088571955 learned_addr learned my addr 172.21.15.84:0/2088571955 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8020866700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 0x7f801c0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021868700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f801c15d980 0x7f801c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021067700 1 -- 172.21.15.84:0/2088571955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 msgr2=0x7f801c0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021067700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 0x7f801c0b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021067700 1 -- 172.21.15.84:0/2088571955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f801c15d980 msgr2=0x7f801c0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021067700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f801c15d980 0x7f801c0c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021067700 1 -- 172.21.15.84:0/2088571955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8010009480 con 0x7f801c0ad250 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021868700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f801c15d980 0x7f801c0c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8020866700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 0x7f801c0b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f8021067700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 0x7f801c0b2150 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f801000b3c0 tx=0x7f8010016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f800d7fa700 1 -- 172.21.15.84:0/2088571955 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010011980 con 0x7f801c0ad250 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f800d7fa700 1 -- 172.21.15.84:0/2088571955 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010011b00 con 0x7f801c0ad250 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.139+0000 7f80232cb700 1 -- 172.21.15.84:0/2088571955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c0b3770 con 0x7f801c0ad250 2023-10-06T03:23:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.140+0000 7f800d7fa700 1 -- 172.21.15.84:0/2088571955 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801001b430 con 0x7f801c0ad250 2023-10-06T03:23:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.140+0000 7f80232cb700 1 -- 172.21.15.84:0/2088571955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c145470 con 0x7f801c0ad250 2023-10-06T03:23:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.140+0000 7f800d7fa700 1 -- 172.21.15.84:0/2088571955 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f801001baa0 con 0x7f801c0ad250 2023-10-06T03:23:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.140+0000 7f800d7fa700 1 -- 172.21.15.84:0/2088571955 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f801001cc80 con 0x7f801c0ad250 2023-10-06T03:23:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.140+0000 7f80232cb700 1 -- 172.21.15.84:0/2088571955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801c064ad0 con 0x7f801c0ad250 2023-10-06T03:23:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.142+0000 7f800d7fa700 1 -- 172.21.15.84:0/2088571955 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f801002a060 con 0x7f801c0ad250 2023-10-06T03:23:34.162 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:34.160+0000 7f6e691d5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:23:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.211+0000 7f80232cb700 1 -- 172.21.15.84:0/2088571955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f801c0adfb0 con 0x7f801c0ad250 2023-10-06T03:23:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.211+0000 7f800d7fa700 1 -- 172.21.15.84:0/2088571955 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f801001c5a0 con 0x7f801c0ad250 2023-10-06T03:23:34.212 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:23:34.212 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:33.956714+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:34.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.212+0000 7f80232cb700 1 -- 172.21.15.84:0/2088571955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 msgr2=0x7f801c0b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.212+0000 7f80232cb700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 0x7f801c0b2150 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f801000b3c0 tx=0x7f8010016000 comp rx=0 tx=0).stop 2023-10-06T03:23:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.212+0000 7f80232cb700 1 -- 172.21.15.84:0/2088571955 shutdown_connections 2023-10-06T03:23:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.212+0000 7f80232cb700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f801c15d980 0x7f801c0c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.212+0000 7f80232cb700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0ad250 0x7f801c0b2150 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.212+0000 7f80232cb700 1 --2- 172.21.15.84:0/2088571955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ad620 0x7f801c0b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.212+0000 7f80232cb700 1 -- 172.21.15.84:0/2088571955 >> 172.21.15.84:0/2088571955 conn(0x7f801c067dd0 msgr2=0x7f801c06b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.212+0000 7f80232cb700 1 -- 172.21.15.84:0/2088571955 shutdown_connections 2023-10-06T03:23:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:34.212+0000 7f80232cb700 1 -- 172.21.15.84:0/2088571955 wait complete. 2023-10-06T03:23:34.225 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T03:23:34.225 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T03:23:34.240 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:34.240+0000 7f6e691d5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:23:34.285 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:34.285+0000 7fdfa112d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:23:34.318 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:34.318+0000 7f6e691d5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:23:34.365 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:34.362+0000 7fdfa112d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:23:34.442 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:34.441+0000 7fdfa112d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:23:34.580 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-10-06T03:23:34.579+0000 7f588a0bb540 -1 Falling back to public interface 2023-10-06T03:23:34.584 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-10-06T03:23:34.583+0000 7f58d7faa540 -1 Falling back to public interface 2023-10-06T03:23:34.586 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-10-06T03:23:34.585+0000 7f1dd4ef1540 -1 Falling back to public interface 2023-10-06T03:23:34.597 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-10-06T03:23:34.596+0000 7f2207dad540 -1 Falling back to public interface 2023-10-06T03:23:34.602 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-10-06T03:23:34.602+0000 7fef90dca540 -1 Falling back to public interface 2023-10-06T03:23:34.602 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-10-06T03:23:34.602+0000 7fcbcf780540 -1 Falling back to public interface 2023-10-06T03:23:34.614 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-10-06T03:23:34.613+0000 7f1251f8c540 -1 Falling back to public interface 2023-10-06T03:23:34.618 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-10-06T03:23:34.617+0000 7fb1d1c19540 -1 Falling back to public interface 2023-10-06T03:23:34.901 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:34.899+0000 7f6e691d5180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T03:23:35.021 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:35.019+0000 7fdfa112d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T03:23:35.030 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:35.036 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:35.036+0000 7f6e691d5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:23:35.134 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:35.133+0000 7f6e691d5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:23:35.137 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.136+0000 7fa763a15700 1 Processor -- start 2023-10-06T03:23:35.137 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.137+0000 7fa763a15700 1 -- start start 2023-10-06T03:23:35.141 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.137+0000 7fa763a15700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c153be0 0x7fa75c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.141 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.137+0000 7fa763a15700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa75c15aa70 0x7fa75c0d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.141 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.137+0000 7fa763a15700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c0b1a30 con 0x7fa75c153fb0 2023-10-06T03:23:35.141 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa763a15700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c0b0c30 con 0x7fa75c15aa70 2023-10-06T03:23:35.141 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa763a15700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0b0f10 con 0x7fa75c153be0 2023-10-06T03:23:35.141 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa761fb2700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa75c153fb0 0x7fa75c15d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59380/0 (socket says 172.21.15.84:59380) 2023-10-06T03:23:35.141 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa761fb2700 1 -- 172.21.15.84:0/1411620951 learned_addr learned my addr 172.21.15.84:0/1411620951 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:35.141 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa7617b1700 1 --2- 172.21.15.84:0/1411620951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c153be0 0x7fa75c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.142 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa760fb0700 1 --2- 172.21.15.84:0/1411620951 >> v2:172.21.15.131:3300/0 conn(0x7fa75c15aa70 0x7fa75c0d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.142 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa753fff700 1 -- 172.21.15.84:0/1411620951 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639103074 0 0) 0x7fa75c0b1a30 con 0x7fa75c153fb0 2023-10-06T03:23:35.142 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa753fff700 1 -- 172.21.15.84:0/1411620951 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa748003570 con 0x7fa75c153fb0 2023-10-06T03:23:35.142 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa7617b1700 1 -- 172.21.15.84:0/1411620951 >> v2:172.21.15.131:3300/0 conn(0x7fa75c15aa70 msgr2=0x7fa75c0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:35.144 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa7617b1700 1 --2- 172.21.15.84:0/1411620951 >> v2:172.21.15.131:3300/0 conn(0x7fa75c15aa70 0x7fa75c0d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.144 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa7617b1700 1 -- 172.21.15.84:0/1411620951 >> v1:172.21.15.84:6789/0 conn(0x7fa75c153fb0 legacy=0x7fa75c15d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.144 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa7617b1700 1 -- 172.21.15.84:0/1411620951 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c0b11f0 con 0x7fa75c153be0 2023-10-06T03:23:35.144 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa760fb0700 1 --2- 172.21.15.84:0/1411620951 >> v2:172.21.15.131:3300/0 conn(0x7fa75c15aa70 0x7fa75c0d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:35.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.138+0000 7fa7617b1700 1 --2- 172.21.15.84:0/1411620951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c153be0 0x7fa75c0b02c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7580098e0 tx=0x7fa7580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=448712a6ed97e484 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa753fff700 1 -- 172.21.15.84:0/1411620951 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758011630 con 0x7fa75c153be0 2023-10-06T03:23:35.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa753fff700 1 -- 172.21.15.84:0/1411620951 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa758011790 con 0x7fa75c153be0 2023-10-06T03:23:35.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa753fff700 1 -- 172.21.15.84:0/1411620951 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758011b30 con 0x7fa75c153be0 2023-10-06T03:23:35.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa763a15700 1 -- 172.21.15.84:0/1411620951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c153be0 msgr2=0x7fa75c0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa763a15700 1 --2- 172.21.15.84:0/1411620951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c153be0 0x7fa75c0b02c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7580098e0 tx=0x7fa7580091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa763a15700 1 -- 172.21.15.84:0/1411620951 shutdown_connections 2023-10-06T03:23:35.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa763a15700 1 --2- 172.21.15.84:0/1411620951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c153be0 0x7fa75c0b02c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa763a15700 1 --2- 172.21.15.84:0/1411620951 >> v2:172.21.15.131:3300/0 conn(0x7fa75c15aa70 0x7fa75c0d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa763a15700 1 -- 172.21.15.84:0/1411620951 >> 172.21.15.84:0/1411620951 conn(0x7fa75c06c2f0 msgr2=0x7fa75c06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:35.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa763a15700 1 -- 172.21.15.84:0/1411620951 shutdown_connections 2023-10-06T03:23:35.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.139+0000 7fa763a15700 1 -- 172.21.15.84:0/1411620951 wait complete. 2023-10-06T03:23:35.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.140+0000 7fa763a15700 1 Processor -- start 2023-10-06T03:23:35.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.140+0000 7fa763a15700 1 -- start start 2023-10-06T03:23:35.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa763a15700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c153be0 0x7fa75c155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa763a15700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa75c153fb0 0x7fa75c15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa763a15700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c15aa70 0x7fa75c0b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa763a15700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c15ce30 con 0x7fa75c153fb0 2023-10-06T03:23:35.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa763a15700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c156e80 con 0x7fa75c153be0 2023-10-06T03:23:35.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa763a15700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c15c220 con 0x7fa75c15aa70 2023-10-06T03:23:35.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa760fb0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa75c153fb0 0x7fa75c15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa760fb0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa75c153fb0 0x7fa75c15b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44680/0 (socket says 172.21.15.84:44680) 2023-10-06T03:23:35.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa760fb0700 1 -- 172.21.15.84:0/2118285545 learned_addr learned my addr 172.21.15.84:0/2118285545 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:35.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa7617b1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c153be0 0x7fa75c155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.141+0000 7fa761fb2700 1 --2- 172.21.15.84:0/2118285545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c15aa70 0x7fa75c0b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa760fb0700 1 -- 172.21.15.84:0/2118285545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c15aa70 msgr2=0x7fa75c0b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa760fb0700 1 --2- 172.21.15.84:0/2118285545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c15aa70 0x7fa75c0b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa760fb0700 1 -- 172.21.15.84:0/2118285545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c153be0 msgr2=0x7fa75c155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa760fb0700 1 --2- 172.21.15.84:0/2118285545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c153be0 0x7fa75c155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa760fb0700 1 -- 172.21.15.84:0/2118285545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c009420 con 0x7fa75c153fb0 2023-10-06T03:23:35.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa760fb0700 1 --2- 172.21.15.84:0/2118285545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa75c153fb0 0x7fa75c15b960 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00ec80 tx=0x7fa74c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa7517fa700 1 -- 172.21.15.84:0/2118285545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00c850 con 0x7fa75c153fb0 2023-10-06T03:23:35.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa7517fa700 1 -- 172.21.15.84:0/2118285545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c00c9b0 con 0x7fa75c153fb0 2023-10-06T03:23:35.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa7517fa700 1 -- 172.21.15.84:0/2118285545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00cd50 con 0x7fa75c153fb0 2023-10-06T03:23:35.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa763a15700 1 -- 172.21.15.84:0/2118285545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa758009420 con 0x7fa75c153fb0 2023-10-06T03:23:35.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa763a15700 1 -- 172.21.15.84:0/2118285545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c15cac0 con 0x7fa75c153fb0 2023-10-06T03:23:35.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa7517fa700 1 -- 172.21.15.84:0/2118285545 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa74c005a00 con 0x7fa75c153fb0 2023-10-06T03:23:35.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.142+0000 7fa7517fa700 1 -- 172.21.15.84:0/2118285545 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fa74c005fd0 con 0x7fa75c153fb0 2023-10-06T03:23:35.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.143+0000 7fa763a15700 1 -- 172.21.15.84:0/2118285545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75c156ff0 con 0x7fa75c153fb0 2023-10-06T03:23:35.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.145+0000 7fa7517fa700 1 -- 172.21.15.84:0/2118285545 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa75c156ff0 con 0x7fa75c153fb0 2023-10-06T03:23:35.158 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:35.157+0000 7fdfa112d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:23:35.215 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.215+0000 7fa763a15700 1 -- 172.21.15.84:0/2118285545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa75c064ad0 con 0x7fa75c153fb0 2023-10-06T03:23:35.216 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.215+0000 7fa7517fa700 1 -- 172.21.15.84:0/2118285545 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fa74c021060 con 0x7fa75c153fb0 2023-10-06T03:23:35.216 INFO:teuthology.misc.health.smithi084.stdout: 2023-10-06T03:23:35.217 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":10,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:33.956714+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:35.218 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.216+0000 7fa763a15700 1 -- 172.21.15.84:0/2118285545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa75c153fb0 msgr2=0x7fa75c15b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.218 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.216+0000 7fa763a15700 1 --2- 172.21.15.84:0/2118285545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa75c153fb0 0x7fa75c15b960 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00ec80 tx=0x7fa74c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.218 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.216+0000 7fa763a15700 1 -- 172.21.15.84:0/2118285545 shutdown_connections 2023-10-06T03:23:35.218 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.216+0000 7fa763a15700 1 --2- 172.21.15.84:0/2118285545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c153be0 0x7fa75c155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.218 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.216+0000 7fa763a15700 1 --2- 172.21.15.84:0/2118285545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa75c15aa70 0x7fa75c0b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.218 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.216+0000 7fa763a15700 1 --2- 172.21.15.84:0/2118285545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa75c153fb0 0x7fa75c15b960 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.218 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.217+0000 7fa763a15700 1 -- 172.21.15.84:0/2118285545 >> 172.21.15.84:0/2118285545 conn(0x7fa75c06c2f0 msgr2=0x7fa75c0af200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:35.218 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.217+0000 7fa763a15700 1 -- 172.21.15.84:0/2118285545 shutdown_connections 2023-10-06T03:23:35.219 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:35.217+0000 7fa763a15700 1 -- 172.21.15.84:0/2118285545 wait complete. 2023-10-06T03:23:35.228 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T03:23:35.266 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:35.265+0000 7fdfa112d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:23:35.384 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:35.383+0000 7f6e691d5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T03:23:35.463 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:35.462+0000 7f6e691d5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:23:35.515 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:35.514+0000 7fdfa112d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T03:23:35.592 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:35.591+0000 7fdfa112d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:23:36.281 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:36.280+0000 7f6e691d5180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T03:23:36.353 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:36.353+0000 7f6e691d5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:23:36.410 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:36.408+0000 7fdfa112d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T03:23:36.427 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:36.426+0000 7f6e691d5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:23:36.483 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:36.482+0000 7fdfa112d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:23:36.558 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:36.557+0000 7fdfa112d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:23:36.560 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:36.559+0000 7f6e691d5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:23:36.643 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:36.643+0000 7f6e691d5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:23:36.691 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:36.690+0000 7fdfa112d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:23:36.776 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:36.775+0000 7fdfa112d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:23:36.792 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:36.791+0000 7f6e691d5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:23:36.868 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:36.867+0000 7f6e691d5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:23:36.930 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:36.929+0000 7fdfa112d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:23:36.946 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:36.946+0000 7f6e691d5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:23:37.005 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:37.004+0000 7fdfa112d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:23:37.020 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:37.019+0000 7f6e691d5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:23:37.090 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:37.089+0000 7fdfa112d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:23:37.177 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T03:23:37.176+0000 7fdfa112d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:23:37.857 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-10-06T03:23:37.856+0000 7f588a0bb540 -1 osd.4 0 log_to_monitors true 2023-10-06T03:23:38.044 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:38.043+0000 7f6e225d6700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T03:23:38.045 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T03:23:38.045+0000 7f6e225d6700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T03:23:38.078 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-10-06T03:23:38.076+0000 7f58d7faa540 -1 osd.6 0 log_to_monitors true 2023-10-06T03:23:38.121 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-10-06T03:23:38.120+0000 7f2207dad540 -1 osd.1 0 log_to_monitors true 2023-10-06T03:23:38.122 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-10-06T03:23:38.121+0000 7fb1d1c19540 -1 osd.7 0 log_to_monitors true 2023-10-06T03:23:38.124 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-10-06T03:23:38.123+0000 7f1251f8c540 -1 osd.5 0 log_to_monitors true 2023-10-06T03:23:38.128 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-10-06T03:23:38.127+0000 7fef90dca540 -1 osd.0 0 log_to_monitors true 2023-10-06T03:23:38.133 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-10-06T03:23:38.133+0000 7fcbcf780540 -1 osd.2 0 log_to_monitors true 2023-10-06T03:23:38.137 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-10-06T03:23:38.136+0000 7f1dd4ef1540 -1 osd.3 0 log_to_monitors true 2023-10-06T03:23:41.314 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-10-06T03:23:41.312+0000 7f21fe9cf700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T03:23:41.317 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-10-06T03:23:41.317+0000 7f21f77c6700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:41.318 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-10-06T03:23:41.317+0000 7f1248bae700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T03:23:41.325 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-10-06T03:23:41.324+0000 7f12419a5700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:41.326 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-10-06T03:23:41.325+0000 7f58824e0700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T03:23:41.332 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-10-06T03:23:41.331+0000 7fb1c883b700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T03:23:41.333 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-10-06T03:23:41.332+0000 7f5879ad4700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:41.335 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-10-06T03:23:41.334+0000 7f58cebcc700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T03:23:41.336 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-10-06T03:23:41.335+0000 7fb1c1632700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:41.341 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-10-06T03:23:41.338+0000 7f58c79c3700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:41.348 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-10-06T03:23:41.347+0000 7fcbc63a2700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T03:23:41.355 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-10-06T03:23:41.355+0000 7fcbbf199700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:41.371 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-10-06T03:23:41.371+0000 7fef879ec700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T03:23:41.377 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-10-06T03:23:41.376+0000 7fef807e3700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:41.402 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-10-06T03:23:41.402+0000 7f1dcd316700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T03:23:41.406 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-10-06T03:23:41.406+0000 7f1dc490a700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:42.036 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:42.142 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.142+0000 7fca5b24c700 1 Processor -- start 2023-10-06T03:23:42.143 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.142+0000 7fca5b24c700 1 -- start start 2023-10-06T03:23:42.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5b24c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca54153810 0x7fca54153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5b24c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca540cd0a0 0x7fca5415a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5b24c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5415d5f0 con 0x7fca5415d170 2023-10-06T03:23:42.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5b24c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca540cbdc0 con 0x7fca54153810 2023-10-06T03:23:42.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5b24c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5415aad0 con 0x7fca540cd0a0 2023-10-06T03:23:42.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5a24a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca54153810 0x7fca54153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5a24a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca54153810 0x7fca54153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34392/0 (socket says 172.21.15.84:34392) 2023-10-06T03:23:42.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5a24a700 1 -- 172.21.15.84:0/3249255109 learned_addr learned my addr 172.21.15.84:0/3249255109 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:42.145 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5aa4b700 1 --2- 172.21.15.84:0/3249255109 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca540cd0a0 0x7fca5415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5a24a700 1 -- 172.21.15.84:0/3249255109 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca540cd0a0 msgr2=0x7fca5415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:42.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5a24a700 1 --2- 172.21.15.84:0/3249255109 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca540cd0a0 0x7fca5415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5a24a700 1 -- 172.21.15.84:0/3249255109 >> v1:172.21.15.131:6789/0 conn(0x7fca5415d170 legacy=0x7fca540cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:42.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5a24a700 1 -- 172.21.15.84:0/3249255109 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540ce8f0 con 0x7fca54153810 2023-10-06T03:23:42.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca5a24a700 1 --2- 172.21.15.84:0/3249255109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 0x7fca54153be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fca500099b0 tx=0x7fca50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776110242d531ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:42.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.143+0000 7fca59248700 1 -- 172.21.15.84:0/3249255109 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5000b860 con 0x7fca54153810 2023-10-06T03:23:42.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.144+0000 7fca59248700 1 -- 172.21.15.84:0/3249255109 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5000b9c0 con 0x7fca54153810 2023-10-06T03:23:42.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.144+0000 7fca59248700 1 -- 172.21.15.84:0/3249255109 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5000bd80 con 0x7fca54153810 2023-10-06T03:23:42.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.144+0000 7fca5b24c700 1 -- 172.21.15.84:0/3249255109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 msgr2=0x7fca54153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:42.146 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.144+0000 7fca5b24c700 1 --2- 172.21.15.84:0/3249255109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 0x7fca54153be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fca500099b0 tx=0x7fca50009250 comp rx=0 tx=0).stop 2023-10-06T03:23:42.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.144+0000 7fca5b24c700 1 -- 172.21.15.84:0/3249255109 shutdown_connections 2023-10-06T03:23:42.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.144+0000 7fca5b24c700 1 --2- 172.21.15.84:0/3249255109 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca540cd0a0 0x7fca5415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.144+0000 7fca5b24c700 1 --2- 172.21.15.84:0/3249255109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 0x7fca54153be0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.144+0000 7fca5b24c700 1 -- 172.21.15.84:0/3249255109 >> 172.21.15.84:0/3249255109 conn(0x7fca5406ed80 msgr2=0x7fca5406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:42.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.144+0000 7fca5b24c700 1 -- 172.21.15.84:0/3249255109 shutdown_connections 2023-10-06T03:23:42.147 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.144+0000 7fca5b24c700 1 -- 172.21.15.84:0/3249255109 wait complete. 2023-10-06T03:23:42.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.145+0000 7fca5b24c700 1 Processor -- start 2023-10-06T03:23:42.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.145+0000 7fca5b24c700 1 -- start start 2023-10-06T03:23:42.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca5b24c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca540cd0a0 0x7fca540b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca5b24c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 0x7fca541567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca5b24c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca5415d170 0x7fca541514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca5b24c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca540b0720 con 0x7fca54153810 2023-10-06T03:23:42.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca5b24c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca54156d00 con 0x7fca5415d170 2023-10-06T03:23:42.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca5b24c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca541542b0 con 0x7fca540cd0a0 2023-10-06T03:23:42.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca59a49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 0x7fca541567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.150 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca59a49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 0x7fca541567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34406/0 (socket says 172.21.15.84:34406) 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca59a49700 1 -- 172.21.15.84:0/2712243600 learned_addr learned my addr 172.21.15.84:0/2712243600 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca5aa4b700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca5415d170 0x7fca541514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca5a24a700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca540cd0a0 0x7fca540b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca59a49700 1 -- 172.21.15.84:0/2712243600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca540cd0a0 msgr2=0x7fca540b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca59a49700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca540cd0a0 0x7fca540b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca59a49700 1 -- 172.21.15.84:0/2712243600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca5415d170 msgr2=0x7fca541514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca59a49700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca5415d170 0x7fca541514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca59a49700 1 -- 172.21.15.84:0/2712243600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca500094f0 con 0x7fca54153810 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca5aa4b700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca5415d170 0x7fca541514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.146+0000 7fca59a49700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 0x7fca541567c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c590 tx=0x7fca4400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.147+0000 7fca4a7fc700 1 -- 172.21.15.84:0/2712243600 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44011590 con 0x7fca54153810 2023-10-06T03:23:42.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.147+0000 7fca4a7fc700 1 -- 172.21.15.84:0/2712243600 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca440116f0 con 0x7fca54153810 2023-10-06T03:23:42.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.147+0000 7fca5b24c700 1 -- 172.21.15.84:0/2712243600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca540b0970 con 0x7fca54153810 2023-10-06T03:23:42.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.147+0000 7fca4a7fc700 1 -- 172.21.15.84:0/2712243600 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44011ab0 con 0x7fca54153810 2023-10-06T03:23:42.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.147+0000 7fca5b24c700 1 -- 172.21.15.84:0/2712243600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca540b11b0 con 0x7fca54153810 2023-10-06T03:23:42.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.148+0000 7fca5b24c700 1 -- 172.21.15.84:0/2712243600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca54071740 con 0x7fca54153810 2023-10-06T03:23:42.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.148+0000 7fca4a7fc700 1 -- 172.21.15.84:0/2712243600 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fca4401b3b0 con 0x7fca54153810 2023-10-06T03:23:42.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.148+0000 7fca4a7fc700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca38066ea0 0x7fca38069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.148+0000 7fca5a24a700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca38066ea0 0x7fca38069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.149+0000 7fca4a7fc700 1 -- 172.21.15.84:0/2712243600 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7fca44082ba0 con 0x7fca54153810 2023-10-06T03:23:42.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.149+0000 7fca5a24a700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca38066ea0 0x7fca38069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca500099b0 tx=0x7fca50017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:42.153 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.153+0000 7fca4a7fc700 1 -- 172.21.15.84:0/2712243600 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca44050c80 con 0x7fca54153810 2023-10-06T03:23:42.344 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.344+0000 7fca5b24c700 1 -- 172.21.15.84:0/2712243600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca54154420 con 0x7fca54153810 2023-10-06T03:23:42.345 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.344+0000 7fca4a7fc700 1 -- 172.21.15.84:0/2712243600 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7fca44017030 con 0x7fca54153810 2023-10-06T03:23:42.345 INFO:teuthology.misc.health.smithi084.stdout: 2023-10-06T03:23:42.345 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":13,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:42.323203+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:42.347 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.346+0000 7fca5b24c700 1 -- 172.21.15.84:0/2712243600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca38066ea0 msgr2=0x7fca38069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:42.348 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.346+0000 7fca5b24c700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca38066ea0 0x7fca38069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca500099b0 tx=0x7fca50017000 comp rx=0 tx=0).stop 2023-10-06T03:23:42.348 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.346+0000 7fca5b24c700 1 -- 172.21.15.84:0/2712243600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 msgr2=0x7fca541567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:42.348 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.346+0000 7fca5b24c700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 0x7fca541567c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c590 tx=0x7fca4400c950 comp rx=0 tx=0).stop 2023-10-06T03:23:42.348 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.346+0000 7fca5b24c700 1 -- 172.21.15.84:0/2712243600 shutdown_connections 2023-10-06T03:23:42.348 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.346+0000 7fca5b24c700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca38066ea0 0x7fca38069350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.348 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.346+0000 7fca5b24c700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca5415d170 0x7fca541514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.348 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.346+0000 7fca5b24c700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca540cd0a0 0x7fca540b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.348 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.346+0000 7fca5b24c700 1 --2- 172.21.15.84:0/2712243600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca54153810 0x7fca541567c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.348 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.346+0000 7fca5b24c700 1 -- 172.21.15.84:0/2712243600 >> 172.21.15.84:0/2712243600 conn(0x7fca5406ed80 msgr2=0x7fca54152390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:42.348 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.347+0000 7fca5b24c700 1 -- 172.21.15.84:0/2712243600 shutdown_connections 2023-10-06T03:23:42.349 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T03:23:42.347+0000 7fca5b24c700 1 -- 172.21.15.84:0/2712243600 wait complete. 2023-10-06T03:23:42.358 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T03:23:42.358 INFO:tasks.ceph:Creating RBD pool 2023-10-06T03:23:42.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T03:23:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.471+0000 7f61f6560700 1 Processor -- start 2023-10-06T03:23:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.471+0000 7f61f6560700 1 -- start start 2023-10-06T03:23:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61f6560700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61f0159510 0x7f61f00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61f6560700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61f01598e0 0x7f61f00cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61f6560700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f00cf350 con 0x7f61f00ce820 2023-10-06T03:23:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61f6560700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f00cf610 con 0x7f61f0159510 2023-10-06T03:23:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61f6560700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00cf8f0 con 0x7f61f01598e0 2023-10-06T03:23:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61effff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61f0159510 0x7f61f00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61f4afd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f61f00ce820 0x7f61f00cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41612/0 (socket says 172.21.15.84:41612) 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61f4afd700 1 -- 172.21.15.84:0/3775583905 learned_addr learned my addr 172.21.15.84:0/3775583905 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61ef7fe700 1 --2- 172.21.15.84:0/3775583905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61f01598e0 0x7f61f00cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61effff700 1 -- 172.21.15.84:0/3775583905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61f01598e0 msgr2=0x7f61f00cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61effff700 1 --2- 172.21.15.84:0/3775583905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61f01598e0 0x7f61f00cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61effff700 1 -- 172.21.15.84:0/3775583905 >> v1:172.21.15.84:6789/0 conn(0x7f61f00ce820 legacy=0x7f61f00cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61effff700 1 -- 172.21.15.84:0/3775583905 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f00cfbd0 con 0x7f61f0159510 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61eeffd700 1 -- 172.21.15.84:0/3775583905 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777113014 0 0) 0x7f61f00cf350 con 0x7f61f00ce820 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.472+0000 7f61effff700 1 --2- 172.21.15.84:0/3775583905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f0159510 0x7f61f00cb5a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f61e00098e0 tx=0x7f61e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5cc6a8a27aa80b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61eeffd700 1 -- 172.21.15.84:0/3775583905 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000b640 con 0x7f61f0159510 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61eeffd700 1 -- 172.21.15.84:0/3775583905 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e000b7a0 con 0x7f61f0159510 2023-10-06T03:23:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61eeffd700 1 -- 172.21.15.84:0/3775583905 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000bb40 con 0x7f61f0159510 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61f6560700 1 -- 172.21.15.84:0/3775583905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f0159510 msgr2=0x7f61f00cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61f6560700 1 --2- 172.21.15.84:0/3775583905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f0159510 0x7f61f00cb5a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f61e00098e0 tx=0x7f61e00091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61f6560700 1 -- 172.21.15.84:0/3775583905 shutdown_connections 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61f6560700 1 --2- 172.21.15.84:0/3775583905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f0159510 0x7f61f00cb5a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61f6560700 1 --2- 172.21.15.84:0/3775583905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61f01598e0 0x7f61f00cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61f6560700 1 -- 172.21.15.84:0/3775583905 >> 172.21.15.84:0/3775583905 conn(0x7f61f0089e90 msgr2=0x7f61f00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61f6560700 1 -- 172.21.15.84:0/3775583905 shutdown_connections 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.473+0000 7f61f6560700 1 -- 172.21.15.84:0/3775583905 wait complete. 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.474+0000 7f61f6560700 1 Processor -- start 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.474+0000 7f61f6560700 1 -- start start 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f6560700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61f00ce820 0x7f61f014eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f6560700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61f0159510 0x7f61f015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f6560700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f01598e0 0x7f61f015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f6560700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f016a750 con 0x7f61f01598e0 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f6560700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0169e20 con 0x7f61f00ce820 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f6560700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f016a100 con 0x7f61f0159510 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f4afd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f01598e0 0x7f61f015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f4afd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f01598e0 0x7f61f015a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34428/0 (socket says 172.21.15.84:34428) 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f4afd700 1 -- 172.21.15.84:0/1551920879 learned_addr learned my addr 172.21.15.84:0/1551920879 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61ef7fe700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61f0159510 0x7f61f015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61effff700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61f00ce820 0x7f61f014eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f4afd700 1 -- 172.21.15.84:0/1551920879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61f0159510 msgr2=0x7f61f015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f4afd700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61f0159510 0x7f61f015a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f4afd700 1 -- 172.21.15.84:0/1551920879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61f00ce820 msgr2=0x7f61f014eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f4afd700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61f00ce820 0x7f61f014eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61f4afd700 1 -- 172.21.15.84:0/1551920879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0009420 con 0x7f61f01598e0 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.475+0000 7f61effff700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61f00ce820 0x7f61f014eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.476+0000 7f61f4afd700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f01598e0 0x7f61f015a660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f61e800cc90 tx=0x7f61e8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.476+0000 7f61d7fff700 1 -- 172.21.15.84:0/1551920879 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800a960 con 0x7f61f01598e0 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.476+0000 7f61d7fff700 1 -- 172.21.15.84:0/1551920879 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e800aac0 con 0x7f61f01598e0 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.476+0000 7f61f6560700 1 -- 172.21.15.84:0/1551920879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f016a3e0 con 0x7f61f01598e0 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.476+0000 7f61d7fff700 1 -- 172.21.15.84:0/1551920879 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800ae80 con 0x7f61f01598e0 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.476+0000 7f61f6560700 1 -- 172.21.15.84:0/1551920879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f009c7a0 con 0x7f61f01598e0 2023-10-06T03:23:42.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.477+0000 7f61f6560700 1 -- 172.21.15.84:0/1551920879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f016aae0 con 0x7f61f01598e0 2023-10-06T03:23:42.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.477+0000 7f61d7fff700 1 -- 172.21.15.84:0/1551920879 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f61e8007300 con 0x7f61f01598e0 2023-10-06T03:23:42.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.478+0000 7f61d7fff700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61dc066ea0 0x7f61dc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:42.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.478+0000 7f61d7fff700 1 -- 172.21.15.84:0/1551920879 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f61e8084320 con 0x7f61f01598e0 2023-10-06T03:23:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.478+0000 7f61effff700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61dc066ea0 0x7f61dc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.478+0000 7f61effff700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61dc066ea0 0x7f61dc069350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61e00093f0 tx=0x7f61e0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.482+0000 7f61d7fff700 1 -- 172.21.15.84:0/1551920879 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61e8051bc0 con 0x7f61f01598e0 2023-10-06T03:23:42.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:42.666+0000 7f61f6560700 1 -- 172.21.15.84:0/1551920879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f61f0064ad0 con 0x7f61f01598e0 2023-10-06T03:23:43.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.501+0000 7f61d7fff700 1 -- 172.21.15.84:0/1551920879 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f61e80551e0 con 0x7f61f01598e0 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 -- 172.21.15.84:0/1551920879 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61dc066ea0 msgr2=0x7f61dc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61dc066ea0 0x7f61dc069350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61e00093f0 tx=0x7f61e0017000 comp rx=0 tx=0).stop 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 -- 172.21.15.84:0/1551920879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f01598e0 msgr2=0x7f61f015a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f01598e0 0x7f61f015a660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f61e800cc90 tx=0x7f61e8001a80 comp rx=0 tx=0).stop 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 -- 172.21.15.84:0/1551920879 shutdown_connections 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61dc066ea0 0x7f61dc069350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61f00ce820 0x7f61f014eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f01598e0 0x7f61f015a660 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 --2- 172.21.15.84:0/1551920879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61f0159510 0x7f61f015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 -- 172.21.15.84:0/1551920879 >> 172.21.15.84:0/1551920879 conn(0x7f61f0089e90 msgr2=0x7f61f00683b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 -- 172.21.15.84:0/1551920879 shutdown_connections 2023-10-06T03:23:43.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.504+0000 7f61f6560700 1 -- 172.21.15.84:0/1551920879 wait complete. 2023-10-06T03:23:43.506 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'rbd' created 2023-10-06T03:23:43.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T03:23:43.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.634+0000 7f9674ff7700 1 Processor -- start 2023-10-06T03:23:43.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.634+0000 7f9674ff7700 1 -- start start 2023-10-06T03:23:43.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.634+0000 7f9674ff7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 0x7f96700b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.634+0000 7f9674ff7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96700aee20 0x7f96700af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.634+0000 7f9674ff7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96700b2d20 con 0x7f967006f0f0 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.634+0000 7f9674ff7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967006fb80 con 0x7f96700aee20 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.634+0000 7f9674ff7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700b0450 con 0x7f967006ed20 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.634+0000 7f966ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96700aee20 0x7f96700af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.634+0000 7f9665d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f967006f0f0 0x7f96700b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41618/0 (socket says 172.21.15.84:41618) 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.634+0000 7f9665d9b700 1 -- 172.21.15.84:0/3871066503 learned_addr learned my addr 172.21.15.84:0/3871066503 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966e59c700 1 --2- 172.21.15.84:0/3871066503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 0x7f96700b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966ed9d700 1 -- 172.21.15.84:0/3871066503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 msgr2=0x7f96700b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966ed9d700 1 --2- 172.21.15.84:0/3871066503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 0x7f96700b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966ed9d700 1 -- 172.21.15.84:0/3871066503 >> v1:172.21.15.84:6789/0 conn(0x7f967006f0f0 legacy=0x7f96700b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966ed9d700 1 -- 172.21.15.84:0/3871066503 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96700af7c0 con 0x7f96700aee20 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966e59c700 1 --2- 172.21.15.84:0/3871066503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 0x7f96700b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966dd9b700 1 -- 172.21.15.84:0/3871066503 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256364985 0 0) 0x7f96700b2d20 con 0x7f967006f0f0 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966ed9d700 1 --2- 172.21.15.84:0/3871066503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 0x7f96700af280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e60 tx=0x7f9668009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57da01adf3e1e702 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966dd9b700 1 -- 172.21.15.84:0/3871066503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800e070 con 0x7f96700aee20 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966dd9b700 1 -- 172.21.15.84:0/3871066503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800bc30 con 0x7f96700aee20 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f966dd9b700 1 -- 172.21.15.84:0/3871066503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668012430 con 0x7f96700aee20 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f9674ff7700 1 -- 172.21.15.84:0/3871066503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 msgr2=0x7f96700af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.635+0000 7f9674ff7700 1 --2- 172.21.15.84:0/3871066503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 0x7f96700af280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e60 tx=0x7f9668009780 comp rx=0 tx=0).stop 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.636+0000 7f9674ff7700 1 -- 172.21.15.84:0/3871066503 shutdown_connections 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.636+0000 7f9674ff7700 1 --2- 172.21.15.84:0/3871066503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 0x7f96700af280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.636+0000 7f9674ff7700 1 --2- 172.21.15.84:0/3871066503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 0x7f96700b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.636+0000 7f9674ff7700 1 -- 172.21.15.84:0/3871066503 >> 172.21.15.84:0/3871066503 conn(0x7f9670068330 msgr2=0x7f9670068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:43.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.636+0000 7f9674ff7700 1 -- 172.21.15.84:0/3871066503 shutdown_connections 2023-10-06T03:23:43.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.636+0000 7f9674ff7700 1 -- 172.21.15.84:0/3871066503 wait complete. 2023-10-06T03:23:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.637+0000 7f9674ff7700 1 Processor -- start 2023-10-06T03:23:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.637+0000 7f9674ff7700 1 -- start start 2023-10-06T03:23:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.637+0000 7f9674ff7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 0x7f9670149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.637+0000 7f9674ff7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f967006f0f0 0x7f967015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.637+0000 7f9674ff7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 0x7f9670159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f9674ff7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967015ce90 con 0x7f96700aee20 2023-10-06T03:23:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f9674ff7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700c85e0 con 0x7f967006f0f0 2023-10-06T03:23:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f9674ff7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9670149e40 con 0x7f967006ed20 2023-10-06T03:23:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f966ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 0x7f9670159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f966ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 0x7f9670159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34454/0 (socket says 172.21.15.84:34454) 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f966ed9d700 1 -- 172.21.15.84:0/414191586 learned_addr learned my addr 172.21.15.84:0/414191586 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f966e59c700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 0x7f9670149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f9665d9b700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f967006f0f0 0x7f967015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f966ed9d700 1 -- 172.21.15.84:0/414191586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 msgr2=0x7f9670149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f966ed9d700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 0x7f9670149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f966ed9d700 1 -- 172.21.15.84:0/414191586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f967006f0f0 msgr2=0x7f967015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f966ed9d700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f967006f0f0 0x7f967015e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f966ed9d700 1 -- 172.21.15.84:0/414191586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668009a20 con 0x7f96700aee20 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f9665d9b700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f967006f0f0 0x7f967015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f966ed9d700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 0x7f9670159940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9668012580 tx=0x7f9668019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f9666ffd700 1 -- 172.21.15.84:0/414191586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668027470 con 0x7f96700aee20 2023-10-06T03:23:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f9666ffd700 1 -- 172.21.15.84:0/414191586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96680275f0 con 0x7f96700aee20 2023-10-06T03:23:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f9674ff7700 1 -- 172.21.15.84:0/414191586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967015e810 con 0x7f96700aee20 2023-10-06T03:23:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f9666ffd700 1 -- 172.21.15.84:0/414191586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96680279b0 con 0x7f96700aee20 2023-10-06T03:23:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.638+0000 7f9674ff7700 1 -- 172.21.15.84:0/414191586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9670158900 con 0x7f96700aee20 2023-10-06T03:23:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.639+0000 7f9674ff7700 1 -- 172.21.15.84:0/414191586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9670064ad0 con 0x7f96700aee20 2023-10-06T03:23:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.640+0000 7f9666ffd700 1 -- 172.21.15.84:0/414191586 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f9668024070 con 0x7f96700aee20 2023-10-06T03:23:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.640+0000 7f9666ffd700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9650066ea0 0x7f9650069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.640+0000 7f9666ffd700 1 -- 172.21.15.84:0/414191586 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f96680869d0 con 0x7f96700aee20 2023-10-06T03:23:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.640+0000 7f966e59c700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9650066ea0 0x7f9650069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.640+0000 7f966e59c700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9650066ea0 0x7f9650069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9660006f00 tx=0x7f9660008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:43.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.645+0000 7f9666ffd700 1 -- 172.21.15.84:0/414191586 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9668053f30 con 0x7f96700aee20 2023-10-06T03:23:43.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:43.826+0000 7f9674ff7700 1 -- 172.21.15.84:0/414191586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f967004bb80 con 0x7f96700aee20 2023-10-06T03:23:44.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.502+0000 7f9666ffd700 1 -- 172.21.15.84:0/414191586 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9668057550 con 0x7f96700aee20 2023-10-06T03:23:44.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.504+0000 7f9674ff7700 1 -- 172.21.15.84:0/414191586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9650066ea0 msgr2=0x7f9650069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.504+0000 7f9674ff7700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9650066ea0 0x7f9650069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9660006f00 tx=0x7f9660008040 comp rx=0 tx=0).stop 2023-10-06T03:23:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.505+0000 7f9674ff7700 1 -- 172.21.15.84:0/414191586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 msgr2=0x7f9670159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.505+0000 7f9674ff7700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 0x7f9670159940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9668012580 tx=0x7f9668019000 comp rx=0 tx=0).stop 2023-10-06T03:23:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.505+0000 7f9674ff7700 1 -- 172.21.15.84:0/414191586 shutdown_connections 2023-10-06T03:23:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.505+0000 7f9674ff7700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9650066ea0 0x7f9650069350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.505+0000 7f9674ff7700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96700aee20 0x7f9670159940 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.505+0000 7f9674ff7700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f967006ed20 0x7f9670149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.505+0000 7f9674ff7700 1 --2- 172.21.15.84:0/414191586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f967006f0f0 0x7f967015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.505+0000 7f9674ff7700 1 -- 172.21.15.84:0/414191586 >> 172.21.15.84:0/414191586 conn(0x7f9670068330 msgr2=0x7f96701564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.505+0000 7f9674ff7700 1 -- 172.21.15.84:0/414191586 shutdown_connections 2023-10-06T03:23:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.505+0000 7f9674ff7700 1 -- 172.21.15.84:0/414191586 wait complete. 2023-10-06T03:23:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T03:23:44.520 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T03:23:44.520 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:23:44.520 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:23:44.522 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:23:44.523 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:23:44.523 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:23:44.524 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:23:44.525 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:23:44.525 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:23:44.527 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:23:44.527 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:23:44.527 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:23:44.529 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:23:44.529 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T03:23:44.529 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:44.607 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:23:44.607 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:23:44.612 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:23:44.612 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:23:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.660+0000 7f8e00903700 1 Processor -- start 2023-10-06T03:23:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.660+0000 7f8e00903700 1 -- start start 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8e00903700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dfc156390 0x7f8dfc0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8e00903700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc06c780 con 0x7f8dfc06c370 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8e00903700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc06c9e0 con 0x7f8dfc0cc750 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8e00903700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0ccbd0 con 0x7f8dfc156390 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8dfa59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dfc156390 0x7f8dfc0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8dfa59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dfc156390 0x7f8dfc0cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34514/0 (socket says 172.21.15.84:34514) 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8dfa59c700 1 -- 172.21.15.84:0/3547708772 learned_addr learned my addr 172.21.15.84:0/3547708772 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8dfad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8dfc06c370 0x7f8dfc0c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41656/0 (socket says 172.21.15.84:41656) 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8df9d9b700 1 --1- 172.21.15.84:0/3547708772 >> v1:172.21.15.131:6789/0 conn(0x7f8dfc0cc750 0x7f8dfc06bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:42716/0 (socket says 172.21.15.84:42716) 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8dfa59c700 1 -- 172.21.15.84:0/3547708772 >> v1:172.21.15.131:6789/0 conn(0x7f8dfc0cc750 legacy=0x7f8dfc06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8dfa59c700 1 -- 172.21.15.84:0/3547708772 >> v1:172.21.15.84:6789/0 conn(0x7f8dfc06c370 legacy=0x7f8dfc0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8dfa59c700 1 -- 172.21.15.84:0/3547708772 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc156b60 con 0x7f8dfc156390 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8df959a700 1 -- 172.21.15.84:0/3547708772 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918891691 0 0) 0x7f8dfc06c780 con 0x7f8dfc06c370 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8dfa59c700 1 --2- 172.21.15.84:0/3547708772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc156390 0x7f8dfc0cc210 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0099b0 tx=0x7f8dec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df44b9e8b504748 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8df959a700 1 -- 172.21.15.84:0/3547708772 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00b860 con 0x7f8dfc156390 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.661+0000 7f8df959a700 1 -- 172.21.15.84:0/3547708772 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec00b9c0 con 0x7f8dfc156390 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.662+0000 7f8df959a700 1 -- 172.21.15.84:0/3547708772 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00bd60 con 0x7f8dfc156390 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.662+0000 7f8e00903700 1 -- 172.21.15.84:0/3547708772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc156390 msgr2=0x7f8dfc0cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.662+0000 7f8e00903700 1 --2- 172.21.15.84:0/3547708772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc156390 0x7f8dfc0cc210 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0099b0 tx=0x7f8dec009250 comp rx=0 tx=0).stop 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.662+0000 7f8e00903700 1 -- 172.21.15.84:0/3547708772 shutdown_connections 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.662+0000 7f8e00903700 1 --2- 172.21.15.84:0/3547708772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc156390 0x7f8dfc0cc210 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.662+0000 7f8e00903700 1 -- 172.21.15.84:0/3547708772 >> 172.21.15.84:0/3547708772 conn(0x7f8dfc0cdef0 msgr2=0x7f8dfc0c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.662+0000 7f8e00903700 1 -- 172.21.15.84:0/3547708772 shutdown_connections 2023-10-06T03:23:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.662+0000 7f8e00903700 1 -- 172.21.15.84:0/3547708772 wait complete. 2023-10-06T03:23:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.663+0000 7f8e00903700 1 Processor -- start 2023-10-06T03:23:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.663+0000 7f8e00903700 1 -- start start 2023-10-06T03:23:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8e00903700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc06c370 0x7f8dfc14f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8e00903700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dfc0cc750 0x7f8dfc0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8e00903700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dfc156390 0x7f8dfc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8e00903700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0b29b0 con 0x7f8dfc06c370 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8e00903700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc14f7e0 con 0x7f8dfc156390 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8e00903700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0b1da0 con 0x7f8dfc0cc750 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc06c370 0x7f8dfc14f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc06c370 0x7f8dfc14f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34522/0 (socket says 172.21.15.84:34522) 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfa59c700 1 -- 172.21.15.84:0/927645131 learned_addr learned my addr 172.21.15.84:0/927645131 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfad9d700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dfc156390 0x7f8dfc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8df9d9b700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dfc0cc750 0x7f8dfc0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfa59c700 1 -- 172.21.15.84:0/927645131 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dfc0cc750 msgr2=0x7f8dfc0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfa59c700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dfc0cc750 0x7f8dfc0c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfa59c700 1 -- 172.21.15.84:0/927645131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dfc156390 msgr2=0x7f8dfc0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfa59c700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dfc156390 0x7f8dfc0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfa59c700 1 -- 172.21.15.84:0/927645131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec0094f0 con 0x7f8dfc06c370 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8df9d9b700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dfc0cc750 0x7f8dfc0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfad9d700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dfc156390 0x7f8dfc0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.664+0000 7f8dfa59c700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc06c370 0x7f8dfc14f2a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8dec006f50 tx=0x7f8dec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.665+0000 7f8dea7fc700 1 -- 172.21.15.84:0/927645131 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec01f070 con 0x7f8dfc06c370 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.665+0000 7f8dea7fc700 1 -- 172.21.15.84:0/927645131 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec011d10 con 0x7f8dfc06c370 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.665+0000 7f8e00903700 1 -- 172.21.15.84:0/927645131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc0b2080 con 0x7f8dfc06c370 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.665+0000 7f8dea7fc700 1 -- 172.21.15.84:0/927645131 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec025650 con 0x7f8dfc06c370 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.665+0000 7f8e00903700 1 -- 172.21.15.84:0/927645131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc0b2640 con 0x7f8dfc06c370 2023-10-06T03:23:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.665+0000 7f8e00903700 1 -- 172.21.15.84:0/927645131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc064ad0 con 0x7f8dfc06c370 2023-10-06T03:23:44.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.666+0000 7f8dea7fc700 1 -- 172.21.15.84:0/927645131 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f8dec023070 con 0x7f8dfc06c370 2023-10-06T03:23:44.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.666+0000 7f8dea7fc700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8ddc066ea0 0x7f8ddc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:44.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.666+0000 7f8dea7fc700 1 -- 172.21.15.84:0/927645131 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8dec085780 con 0x7f8dfc06c370 2023-10-06T03:23:44.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.666+0000 7f8df9d9b700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8ddc066ea0 0x7f8ddc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:44.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.667+0000 7f8df9d9b700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8ddc066ea0 0x7f8ddc069350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8df0007fd0 tx=0x7f8df0007e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:44.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.671+0000 7f8dea7fc700 1 -- 172.21.15.84:0/927645131 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8dec052cc0 con 0x7f8dfc06c370 2023-10-06T03:23:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.871+0000 7f8e00903700 1 -- 172.21.15.84:0/927645131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dfc156e40 con 0x7f8dfc06c370 2023-10-06T03:23:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.872+0000 7f8dea7fc700 1 -- 172.21.15.84:0/927645131 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13674 (secure 0 0 0) 0x7f8dec009350 con 0x7f8dfc06c370 2023-10-06T03:23:44.872 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:23:44.872 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":15,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:44.498921+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 -- 172.21.15.84:0/927645131 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8ddc066ea0 msgr2=0x7f8ddc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8ddc066ea0 0x7f8ddc069350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8df0007fd0 tx=0x7f8df0007e10 comp rx=0 tx=0).stop 2023-10-06T03:23:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 -- 172.21.15.84:0/927645131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc06c370 msgr2=0x7f8dfc14f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc06c370 0x7f8dfc14f2a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8dec006f50 tx=0x7f8dec017000 comp rx=0 tx=0).stop 2023-10-06T03:23:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 -- 172.21.15.84:0/927645131 shutdown_connections 2023-10-06T03:23:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8ddc066ea0 0x7f8ddc069350 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dfc156390 0x7f8dfc0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dfc06c370 0x7f8dfc14f2a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 --2- 172.21.15.84:0/927645131 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dfc0cc750 0x7f8dfc0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 -- 172.21.15.84:0/927645131 >> 172.21.15.84:0/927645131 conn(0x7f8dfc0cdef0 msgr2=0x7f8dfc0c3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 -- 172.21.15.84:0/927645131 shutdown_connections 2023-10-06T03:23:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:44.874+0000 7f8e00903700 1 -- 172.21.15.84:0/927645131 wait complete. 2023-10-06T03:23:44.887 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:23:44.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:23:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.006+0000 7fb38ffff700 1 Processor -- start 2023-10-06T03:23:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.006+0000 7fb38ffff700 1 -- start start 2023-10-06T03:23:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb3900b2660 0x7fb3900cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 0x7fb3900cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38ffff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb3900ceae0 0x7fb3900cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900cc9b0 con 0x7fb3900b2660 2023-10-06T03:23:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38ffff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900cf4c0 con 0x7fb3900ceae0 2023-10-06T03:23:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900cbda0 con 0x7fb3900b2a30 2023-10-06T03:23:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb3900b2660 0x7fb3900cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb3900b2660 0x7fb3900cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34526/0 (socket says 172.21.15.84:34526) 2023-10-06T03:23:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38effd700 1 -- 172.21.15.84:0/1071471434 learned_addr learned my addr 172.21.15.84:0/1071471434 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb3867fc700 1 --2- 172.21.15.84:0/1071471434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 0x7fb3900cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38f7fe700 1 --2- 172.21.15.84:0/1071471434 >> v2:172.21.15.131:3300/0 conn(0x7fb3900ceae0 0x7fb3900cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38effd700 1 -- 172.21.15.84:0/1071471434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 msgr2=0x7fb3900cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38effd700 1 --2- 172.21.15.84:0/1071471434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 0x7fb3900cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38effd700 1 -- 172.21.15.84:0/1071471434 >> v2:172.21.15.131:3300/0 conn(0x7fb3900ceae0 msgr2=0x7fb3900cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38effd700 1 --2- 172.21.15.84:0/1071471434 >> v2:172.21.15.131:3300/0 conn(0x7fb3900ceae0 0x7fb3900cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38effd700 1 -- 172.21.15.84:0/1071471434 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3900cc080 con 0x7fb3900b2660 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb38f7fe700 1 --2- 172.21.15.84:0/1071471434 >> v2:172.21.15.131:3300/0 conn(0x7fb3900ceae0 0x7fb3900cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.007+0000 7fb3867fc700 1 --2- 172.21.15.84:0/1071471434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 0x7fb3900cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38effd700 1 --2- 172.21.15.84:0/1071471434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900b2660 0x7fb3900cccf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb390089690 tx=0x7fb380009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdab3f1814e609f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38e7fc700 1 -- 172.21.15.84:0/1071471434 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380005c10 con 0x7fb3900b2660 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38e7fc700 1 -- 172.21.15.84:0/1071471434 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb380005d70 con 0x7fb3900b2660 2023-10-06T03:23:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38e7fc700 1 -- 172.21.15.84:0/1071471434 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38000b880 con 0x7fb3900b2660 2023-10-06T03:23:45.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38ffff700 1 -- 172.21.15.84:0/1071471434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900b2660 msgr2=0x7fb3900cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38ffff700 1 --2- 172.21.15.84:0/1071471434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900b2660 0x7fb3900cccf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb390089690 tx=0x7fb380009220 comp rx=0 tx=0).stop 2023-10-06T03:23:45.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38ffff700 1 -- 172.21.15.84:0/1071471434 shutdown_connections 2023-10-06T03:23:45.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38ffff700 1 --2- 172.21.15.84:0/1071471434 >> v2:172.21.15.131:3300/0 conn(0x7fb3900ceae0 0x7fb3900cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38ffff700 1 --2- 172.21.15.84:0/1071471434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900b2660 0x7fb3900cccf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38ffff700 1 --2- 172.21.15.84:0/1071471434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 0x7fb3900cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38ffff700 1 -- 172.21.15.84:0/1071471434 >> 172.21.15.84:0/1071471434 conn(0x7fb390099560 msgr2=0x7fb39006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:45.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38ffff700 1 -- 172.21.15.84:0/1071471434 shutdown_connections 2023-10-06T03:23:45.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.008+0000 7fb38ffff700 1 -- 172.21.15.84:0/1071471434 wait complete. 2023-10-06T03:23:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.009+0000 7fb38ffff700 1 Processor -- start 2023-10-06T03:23:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.009+0000 7fb38ffff700 1 -- start start 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3900b2660 0x7fb3900c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 0x7fb3900c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900ceae0 0x7fb390155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38ffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb390169550 con 0x7fb3900ceae0 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38ffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c9010 con 0x7fb3900b2660 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c82d0 con 0x7fb3900b2a30 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900ceae0 0x7fb390155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900ceae0 0x7fb390155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34538/0 (socket says 172.21.15.84:34538) 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38f7fe700 1 -- 172.21.15.84:0/3337814632 learned_addr learned my addr 172.21.15.84:0/3337814632 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb3867fc700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 0x7fb3900c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38effd700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3900b2660 0x7fb3900c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.010+0000 7fb38f7fe700 1 -- 172.21.15.84:0/3337814632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 msgr2=0x7fb3900c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.011+0000 7fb38f7fe700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 0x7fb3900c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.011+0000 7fb38f7fe700 1 -- 172.21.15.84:0/3337814632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3900b2660 msgr2=0x7fb3900c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.011+0000 7fb38f7fe700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3900b2660 0x7fb3900c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.011+0000 7fb38f7fe700 1 -- 172.21.15.84:0/3337814632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380009480 con 0x7fb3900ceae0 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.011+0000 7fb38f7fe700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900ceae0 0x7fb390155230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb38800d0d0 tx=0x7fb3880099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.011+0000 7fb3877fe700 1 -- 172.21.15.84:0/3337814632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38800dc10 con 0x7fb3900ceae0 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.011+0000 7fb3877fe700 1 -- 172.21.15.84:0/3337814632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38800f040 con 0x7fb3900ceae0 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.011+0000 7fb38ffff700 1 -- 172.21.15.84:0/3337814632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3901697d0 con 0x7fb3900ceae0 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.011+0000 7fb3877fe700 1 -- 172.21.15.84:0/3337814632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388015440 con 0x7fb3900ceae0 2023-10-06T03:23:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.011+0000 7fb38ffff700 1 -- 172.21.15.84:0/3337814632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3900c7a30 con 0x7fb3900ceae0 2023-10-06T03:23:45.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.012+0000 7fb38ffff700 1 -- 172.21.15.84:0/3337814632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb390169960 con 0x7fb3900ceae0 2023-10-06T03:23:45.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.012+0000 7fb3877fe700 1 -- 172.21.15.84:0/3337814632 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fb38801e3b0 con 0x7fb3900ceae0 2023-10-06T03:23:45.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.013+0000 7fb3877fe700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb370066ea0 0x7fb370069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.013+0000 7fb3877fe700 1 -- 172.21.15.84:0/3337814632 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb3880846e0 con 0x7fb3900ceae0 2023-10-06T03:23:45.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.017+0000 7fb3877fe700 1 -- 172.21.15.84:0/3337814632 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb388051b80 con 0x7fb3900ceae0 2023-10-06T03:23:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.023+0000 7fb38effd700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb370066ea0 0x7fb370069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.023+0000 7fb38effd700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb370066ea0 0x7fb370069350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb380009260 tx=0x7fb380016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.205+0000 7fb38ffff700 1 -- 172.21.15.84:0/3337814632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb3900682f0 con 0x7fb3900ceae0 2023-10-06T03:23:45.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.205+0000 7fb3877fe700 1 -- 172.21.15.84:0/3337814632 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb38801a0a0 con 0x7fb3900ceae0 2023-10-06T03:23:45.206 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:23:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 -- 172.21.15.84:0/3337814632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb370066ea0 msgr2=0x7fb370069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb370066ea0 0x7fb370069350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb380009260 tx=0x7fb380016000 comp rx=0 tx=0).stop 2023-10-06T03:23:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 -- 172.21.15.84:0/3337814632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900ceae0 msgr2=0x7fb390155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900ceae0 0x7fb390155230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb38800d0d0 tx=0x7fb3880099d0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 -- 172.21.15.84:0/3337814632 shutdown_connections 2023-10-06T03:23:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb370066ea0 0x7fb370069350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3900b2660 0x7fb3900c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3900ceae0 0x7fb390155230 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 --2- 172.21.15.84:0/3337814632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3900b2a30 0x7fb3900c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 -- 172.21.15.84:0/3337814632 >> 172.21.15.84:0/3337814632 conn(0x7fb390099560 msgr2=0x7fb3900689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 -- 172.21.15.84:0/3337814632 shutdown_connections 2023-10-06T03:23:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.207+0000 7fb38ffff700 1 -- 172.21.15.84:0/3337814632 wait complete. 2023-10-06T03:23:45.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:23:45.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.340+0000 7f5f20392700 1 Processor -- start 2023-10-06T03:23:45.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.340+0000 7f5f20392700 1 -- start start 2023-10-06T03:23:45.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.341+0000 7f5f20392700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 0x7f5f180ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.341+0000 7f5f20392700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f180cbcb0 0x7f5f180ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.341+0000 7f5f20392700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f180cf610 con 0x7f5f18159510 2023-10-06T03:23:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.341+0000 7f5f20392700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f180cf8f0 con 0x7f5f180cbcb0 2023-10-06T03:23:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.341+0000 7f5f20392700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180cfbd0 con 0x7f5f181598e0 2023-10-06T03:23:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.341+0000 7f5f1e12e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5f18159510 0x7f5f180cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41660/0 (socket says 172.21.15.84:41660) 2023-10-06T03:23:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.341+0000 7f5f1e12e700 1 -- 172.21.15.84:0/1017114694 learned_addr learned my addr 172.21.15.84:0/1017114694 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.341+0000 7f5f1e92f700 1 --2- 172.21.15.84:0/1017114694 >> v2:172.21.15.84:3300/0 conn(0x7f5f180cbcb0 0x7f5f180ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.341+0000 7f5f1d92d700 1 --2- 172.21.15.84:0/1017114694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 0x7f5f180ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f1e92f700 1 -- 172.21.15.84:0/1017114694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 msgr2=0x7f5f180ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f1e92f700 1 --2- 172.21.15.84:0/1017114694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 0x7f5f180ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f1e92f700 1 -- 172.21.15.84:0/1017114694 >> v1:172.21.15.84:6789/0 conn(0x7f5f18159510 legacy=0x7f5f180cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f1e92f700 1 -- 172.21.15.84:0/1017114694 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180cfeb0 con 0x7f5f180cbcb0 2023-10-06T03:23:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f1d12c700 1 -- 172.21.15.84:0/1017114694 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349251107 0 0) 0x7f5f180cf610 con 0x7f5f18159510 2023-10-06T03:23:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f1e92f700 1 --2- 172.21.15.84:0/1017114694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f180cbcb0 0x7f5f180ced60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009e60 tx=0x7f5f10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1a832e8ecc60bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f1d12c700 1 -- 172.21.15.84:0/1017114694 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1000e070 con 0x7f5f180cbcb0 2023-10-06T03:23:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f1d12c700 1 -- 172.21.15.84:0/1017114694 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1000bb60 con 0x7f5f180cbcb0 2023-10-06T03:23:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f1d12c700 1 -- 172.21.15.84:0/1017114694 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10012430 con 0x7f5f180cbcb0 2023-10-06T03:23:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f20392700 1 -- 172.21.15.84:0/1017114694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f180cbcb0 msgr2=0x7f5f180ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f20392700 1 --2- 172.21.15.84:0/1017114694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f180cbcb0 0x7f5f180ced60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009e60 tx=0x7f5f10009780 comp rx=0 tx=0).stop 2023-10-06T03:23:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f20392700 1 -- 172.21.15.84:0/1017114694 shutdown_connections 2023-10-06T03:23:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f20392700 1 --2- 172.21.15.84:0/1017114694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f180cbcb0 0x7f5f180ced60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.342+0000 7f5f20392700 1 --2- 172.21.15.84:0/1017114694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 0x7f5f180ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.343+0000 7f5f20392700 1 -- 172.21.15.84:0/1017114694 >> 172.21.15.84:0/1017114694 conn(0x7f5f18089e90 msgr2=0x7f5f180997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.343+0000 7f5f20392700 1 -- 172.21.15.84:0/1017114694 shutdown_connections 2023-10-06T03:23:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.343+0000 7f5f20392700 1 -- 172.21.15.84:0/1017114694 wait complete. 2023-10-06T03:23:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f20392700 1 Processor -- start 2023-10-06T03:23:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f20392700 1 -- start start 2023-10-06T03:23:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f20392700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f180cbcb0 0x7f5f1815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f20392700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18159510 0x7f5f18139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f20392700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 0x7f5f180c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f20392700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180ca430 con 0x7f5f18159510 2023-10-06T03:23:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f20392700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1815a1a0 con 0x7f5f180cbcb0 2023-10-06T03:23:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f20392700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1814b290 con 0x7f5f181598e0 2023-10-06T03:23:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f1d92d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18159510 0x7f5f18139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f1d92d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18159510 0x7f5f18139620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34578/0 (socket says 172.21.15.84:34578) 2023-10-06T03:23:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.344+0000 7f5f1d92d700 1 -- 172.21.15.84:0/1150064902 learned_addr learned my addr 172.21.15.84:0/1150064902 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f1e92f700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 0x7f5f180c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f1e12e700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f180cbcb0 0x7f5f1815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f1d92d700 1 -- 172.21.15.84:0/1150064902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 msgr2=0x7f5f180c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f1d92d700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 0x7f5f180c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f1d92d700 1 -- 172.21.15.84:0/1150064902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f180cbcb0 msgr2=0x7f5f1815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f1d92d700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f180cbcb0 0x7f5f1815c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f1d92d700 1 -- 172.21.15.84:0/1150064902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f10009a20 con 0x7f5f18159510 2023-10-06T03:23:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f1e92f700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 0x7f5f180c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f1d92d700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18159510 0x7f5f18139620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800e930 tx=0x7f5f080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f0e7fc700 1 -- 172.21.15.84:0/1150064902 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800eed0 con 0x7f5f18159510 2023-10-06T03:23:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f0e7fc700 1 -- 172.21.15.84:0/1150064902 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0800c850 con 0x7f5f18159510 2023-10-06T03:23:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f20392700 1 -- 172.21.15.84:0/1150064902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f180c9e70 con 0x7f5f18159510 2023-10-06T03:23:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f0e7fc700 1 -- 172.21.15.84:0/1150064902 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800cc10 con 0x7f5f18159510 2023-10-06T03:23:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.345+0000 7f5f20392700 1 -- 172.21.15.84:0/1150064902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f18159e30 con 0x7f5f18159510 2023-10-06T03:23:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.346+0000 7f5f20392700 1 -- 172.21.15.84:0/1150064902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1815a330 con 0x7f5f18159510 2023-10-06T03:23:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.347+0000 7f5f0e7fc700 1 -- 172.21.15.84:0/1150064902 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f5f08013470 con 0x7f5f18159510 2023-10-06T03:23:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.347+0000 7f5f0e7fc700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5efc066ea0 0x7f5efc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.347+0000 7f5f1e12e700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5efc066ea0 0x7f5efc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.347+0000 7f5f0e7fc700 1 -- 172.21.15.84:0/1150064902 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5f080843e0 con 0x7f5f18159510 2023-10-06T03:23:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.347+0000 7f5f1e12e700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5efc066ea0 0x7f5efc069350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f14007fd0 tx=0x7f5f14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.351+0000 7f5f0e7fc700 1 -- 172.21.15.84:0/1150064902 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f08051920 con 0x7f5f18159510 2023-10-06T03:23:45.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.541+0000 7f5f20392700 1 -- 172.21.15.84:0/1150064902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f18064ad0 con 0x7f5f18159510 2023-10-06T03:23:45.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.542+0000 7f5f0e7fc700 1 -- 172.21.15.84:0/1150064902 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f08054f40 con 0x7f5f18159510 2023-10-06T03:23:45.543 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:23:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 -- 172.21.15.84:0/1150064902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5efc066ea0 msgr2=0x7f5efc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5efc066ea0 0x7f5efc069350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f14007fd0 tx=0x7f5f14009040 comp rx=0 tx=0).stop 2023-10-06T03:23:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 -- 172.21.15.84:0/1150064902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18159510 msgr2=0x7f5f18139620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18159510 0x7f5f18139620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800e930 tx=0x7f5f080091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 -- 172.21.15.84:0/1150064902 shutdown_connections 2023-10-06T03:23:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5efc066ea0 0x7f5efc069350 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f180cbcb0 0x7f5f1815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f181598e0 0x7f5f180c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 --2- 172.21.15.84:0/1150064902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18159510 0x7f5f18139620 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 -- 172.21.15.84:0/1150064902 >> 172.21.15.84:0/1150064902 conn(0x7f5f18089e90 msgr2=0x7f5f1814c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:45.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 -- 172.21.15.84:0/1150064902 shutdown_connections 2023-10-06T03:23:45.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.544+0000 7f5f20392700 1 -- 172.21.15.84:0/1150064902 wait complete. 2023-10-06T03:23:45.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:23:45.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.674+0000 7f0fce1a3700 1 Processor -- start 2023-10-06T03:23:45.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.674+0000 7f0fce1a3700 1 -- start start 2023-10-06T03:23:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fce1a3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 0x7f0fc80aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fce1a3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0fc80b07a0 0x7f0fc80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fce1a3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc80b0ca0 con 0x7f0fc81595a0 2023-10-06T03:23:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fce1a3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc80b0f80 con 0x7f0fc80b07a0 2023-10-06T03:23:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fce1a3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80b1260 con 0x7f0fc80b49e0 2023-10-06T03:23:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc6ffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 0x7f0fc80aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc7fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0fc80b07a0 0x7f0fc80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc7fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0fc80b07a0 0x7f0fc80b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56920/0 (socket says 172.21.15.84:56920) 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc6ffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 0x7f0fc80aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:35292/0 (socket says 172.21.15.84:35292) 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc7fff700 1 -- 172.21.15.84:0/4131282543 learned_addr learned my addr 172.21.15.84:0/4131282543 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc77fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f0fc81595a0 0x7f0fc80aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:42718/0 (socket says 172.21.15.84:42718) 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc7fff700 1 -- 172.21.15.84:0/4131282543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 msgr2=0x7f0fc80aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc7fff700 1 --2- 172.21.15.84:0/4131282543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 0x7f0fc80aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc7fff700 1 -- 172.21.15.84:0/4131282543 >> v1:172.21.15.131:6789/0 conn(0x7f0fc81595a0 legacy=0x7f0fc80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc7fff700 1 -- 172.21.15.84:0/4131282543 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc80b1540 con 0x7f0fc80b07a0 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc67fc700 1 -- 172.21.15.84:0/4131282543 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497021802 0 0) 0x7f0fc80b0ca0 con 0x7f0fc81595a0 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.675+0000 7f0fc6ffd700 1 --2- 172.21.15.84:0/4131282543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 0x7f0fc80aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fc7fff700 1 --2- 172.21.15.84:0/4131282543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fc80b07a0 0x7f0fc80b1c00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009f20 tx=0x7f0fc0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72df6fdc8ad5e950 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fc67fc700 1 -- 172.21.15.84:0/4131282543 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000e070 con 0x7f0fc80b07a0 2023-10-06T03:23:45.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fc67fc700 1 -- 172.21.15.84:0/4131282543 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc000b9d0 con 0x7f0fc80b07a0 2023-10-06T03:23:45.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fc67fc700 1 -- 172.21.15.84:0/4131282543 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc00092e0 con 0x7f0fc80b07a0 2023-10-06T03:23:45.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4131282543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fc80b07a0 msgr2=0x7f0fc80b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fce1a3700 1 --2- 172.21.15.84:0/4131282543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fc80b07a0 0x7f0fc80b1c00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009f20 tx=0x7f0fc0009840 comp rx=0 tx=0).stop 2023-10-06T03:23:45.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4131282543 shutdown_connections 2023-10-06T03:23:45.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fce1a3700 1 --2- 172.21.15.84:0/4131282543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fc80b07a0 0x7f0fc80b1c00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fce1a3700 1 --2- 172.21.15.84:0/4131282543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 0x7f0fc80aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4131282543 >> 172.21.15.84:0/4131282543 conn(0x7f0fc8099830 msgr2=0x7f0fc806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:45.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4131282543 shutdown_connections 2023-10-06T03:23:45.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.676+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4131282543 wait complete. 2023-10-06T03:23:45.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fce1a3700 1 Processor -- start 2023-10-06T03:23:45.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fce1a3700 1 -- start start 2023-10-06T03:23:45.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fce1a3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc80b07a0 0x7f0fc81559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fce1a3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 0x7f0fc8159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fce1a3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fc81595a0 0x7f0fc80cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fce1a3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc815b130 con 0x7f0fc80b07a0 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fce1a3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8169c10 con 0x7f0fc81595a0 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fce1a3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8169eb0 con 0x7f0fc80b49e0 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fc77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc80b07a0 0x7f0fc81559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fc77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc80b07a0 0x7f0fc81559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34586/0 (socket says 172.21.15.84:34586) 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.678+0000 7f0fc77fe700 1 -- 172.21.15.84:0/4112361064 learned_addr learned my addr 172.21.15.84:0/4112361064 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fc7fff700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fc81595a0 0x7f0fc80cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fc6ffd700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 0x7f0fc8159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fc77fe700 1 -- 172.21.15.84:0/4112361064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 msgr2=0x7f0fc8159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fc77fe700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 0x7f0fc8159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fc77fe700 1 -- 172.21.15.84:0/4112361064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fc81595a0 msgr2=0x7f0fc80cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fc77fe700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fc81595a0 0x7f0fc80cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fc77fe700 1 -- 172.21.15.84:0/4112361064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc009420 con 0x7f0fc80b07a0 2023-10-06T03:23:45.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fc7fff700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fc81595a0 0x7f0fc80cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:45.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fc77fe700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc80b07a0 0x7f0fc81559a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800c5e0 tx=0x7f0fb8001030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0faf7fe700 1 -- 172.21.15.84:0/4112361064 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8005ac0 con 0x7f0fc80b07a0 2023-10-06T03:23:45.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0faf7fe700 1 -- 172.21.15.84:0/4112361064 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8005c40 con 0x7f0fc80b07a0 2023-10-06T03:23:45.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4112361064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc0009ae0 con 0x7f0fc80b07a0 2023-10-06T03:23:45.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0faf7fe700 1 -- 172.21.15.84:0/4112361064 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80070d0 con 0x7f0fc80b07a0 2023-10-06T03:23:45.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.679+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4112361064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc815a910 con 0x7f0fc80b07a0 2023-10-06T03:23:45.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.680+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4112361064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc8064ad0 con 0x7f0fc80b07a0 2023-10-06T03:23:45.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.680+0000 7f0faf7fe700 1 -- 172.21.15.84:0/4112361064 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f0fb8007480 con 0x7f0fc80b07a0 2023-10-06T03:23:45.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.681+0000 7f0faf7fe700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fb4066ea0 0x7f0fb4069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.681+0000 7f0fc6ffd700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fb4066ea0 0x7f0fb4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.681+0000 7f0faf7fe700 1 -- 172.21.15.84:0/4112361064 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0fb8083730 con 0x7f0fc80b07a0 2023-10-06T03:23:45.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.681+0000 7f0fc6ffd700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fb4066ea0 0x7f0fb4069350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0093f0 tx=0x7f0fbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.685+0000 7f0faf7fe700 1 -- 172.21.15.84:0/4112361064 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fb8050c70 con 0x7f0fc80b07a0 2023-10-06T03:23:45.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.909+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4112361064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fc80b1820 con 0x7f0fc80b07a0 2023-10-06T03:23:45.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.910+0000 7f0faf7fe700 1 -- 172.21.15.84:0/4112361064 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f0fb8017020 con 0x7f0fc80b07a0 2023-10-06T03:23:45.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:23:45.911 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T03:23:45.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4112361064 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fb4066ea0 msgr2=0x7f0fb4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fb4066ea0 0x7f0fb4069350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0093f0 tx=0x7f0fbc008040 comp rx=0 tx=0).stop 2023-10-06T03:23:45.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4112361064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc80b07a0 msgr2=0x7f0fc81559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc80b07a0 0x7f0fc81559a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800c5e0 tx=0x7f0fb8001030 comp rx=0 tx=0).stop 2023-10-06T03:23:45.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4112361064 shutdown_connections 2023-10-06T03:23:45.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fb4066ea0 0x7f0fb4069350 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fc81595a0 0x7f0fc80cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc80b07a0 0x7f0fc81559a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 --2- 172.21.15.84:0/4112361064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fc80b49e0 0x7f0fc8159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4112361064 >> 172.21.15.84:0/4112361064 conn(0x7f0fc8099830 msgr2=0x7f0fc81587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:45.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4112361064 shutdown_connections 2023-10-06T03:23:45.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:45.912+0000 7f0fce1a3700 1 -- 172.21.15.84:0/4112361064 wait complete. 2023-10-06T03:23:45.914 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2023-10-06T03:23:45.925 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:46.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.036+0000 7f8792651700 1 Processor -- start 2023-10-06T03:23:46.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.036+0000 7f8792651700 1 -- start start 2023-10-06T03:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.036+0000 7f8792651700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f878c1595a0 0x7f878c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.036+0000 7f8792651700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f878c0b07a0 0x7f878c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.036+0000 7f8792651700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c0b0ca0 con 0x7f878c0b49e0 2023-10-06T03:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.036+0000 7f8792651700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c0b0f80 con 0x7f878c0b07a0 2023-10-06T03:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.036+0000 7f8792651700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0b1260 con 0x7f878c1595a0 2023-10-06T03:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f8790bee700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f878c0b07a0 0x7f878c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f8790bee700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f878c0b07a0 0x7f878c0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34588/0 (socket says 172.21.15.84:34588) 2023-10-06T03:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f878b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f878c0b49e0 0x7f878c0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41670/0 (socket says 172.21.15.84:41670) 2023-10-06T03:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f8790bee700 1 -- 172.21.15.84:0/1401343040 learned_addr learned my addr 172.21.15.84:0/1401343040 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f878bfff700 1 --2- 172.21.15.84:0/1401343040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f878c1595a0 0x7f878c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f8790bee700 1 -- 172.21.15.84:0/1401343040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f878c1595a0 msgr2=0x7f878c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f8790bee700 1 --2- 172.21.15.84:0/1401343040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f878c1595a0 0x7f878c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f8790bee700 1 -- 172.21.15.84:0/1401343040 >> v1:172.21.15.84:6789/0 conn(0x7f878c0b49e0 legacy=0x7f878c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f8790bee700 1 -- 172.21.15.84:0/1401343040 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c0b1540 con 0x7f878c0b07a0 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f878affd700 1 -- 172.21.15.84:0/1401343040 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417905784 0 0) 0x7f878c0b0ca0 con 0x7f878c0b49e0 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f8790bee700 1 --2- 172.21.15.84:0/1401343040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c0b07a0 0x7f878c0b1c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8784009f20 tx=0x7f8784009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643ab12901a0dfe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f878affd700 1 -- 172.21.15.84:0/1401343040 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878400e070 con 0x7f878c0b07a0 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f878affd700 1 -- 172.21.15.84:0/1401343040 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878400ba80 con 0x7f878c0b07a0 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.037+0000 7f878affd700 1 -- 172.21.15.84:0/1401343040 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840092e0 con 0x7f878c0b07a0 2023-10-06T03:23:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.038+0000 7f8792651700 1 -- 172.21.15.84:0/1401343040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c0b07a0 msgr2=0x7f878c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.038+0000 7f8792651700 1 --2- 172.21.15.84:0/1401343040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c0b07a0 0x7f878c0b1c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8784009f20 tx=0x7f8784009840 comp rx=0 tx=0).stop 2023-10-06T03:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.038+0000 7f8792651700 1 -- 172.21.15.84:0/1401343040 shutdown_connections 2023-10-06T03:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.038+0000 7f8792651700 1 --2- 172.21.15.84:0/1401343040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c0b07a0 0x7f878c0b1c00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.038+0000 7f8792651700 1 --2- 172.21.15.84:0/1401343040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f878c1595a0 0x7f878c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.038+0000 7f8792651700 1 -- 172.21.15.84:0/1401343040 >> 172.21.15.84:0/1401343040 conn(0x7f878c099830 msgr2=0x7f878c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.038+0000 7f8792651700 1 -- 172.21.15.84:0/1401343040 shutdown_connections 2023-10-06T03:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.038+0000 7f8792651700 1 -- 172.21.15.84:0/1401343040 wait complete. 2023-10-06T03:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.039+0000 7f8792651700 1 Processor -- start 2023-10-06T03:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.039+0000 7f8792651700 1 -- start start 2023-10-06T03:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8792651700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f878c0b07a0 0x7f878c0acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8792651700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f878c0b49e0 0x7f878c16db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8792651700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c1595a0 0x7f878c09d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8792651700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c16e0a0 con 0x7f878c1595a0 2023-10-06T03:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8792651700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0ad240 con 0x7f878c0b49e0 2023-10-06T03:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8792651700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0ad520 con 0x7f878c0b07a0 2023-10-06T03:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8790bee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c1595a0 0x7f878c09d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8790bee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c1595a0 0x7f878c09d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34598/0 (socket says 172.21.15.84:34598) 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8790bee700 1 -- 172.21.15.84:0/2100564084 learned_addr learned my addr 172.21.15.84:0/2100564084 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f878bfff700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f878c0b07a0 0x7f878c0acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8790bee700 1 -- 172.21.15.84:0/2100564084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f878c0b07a0 msgr2=0x7f878c0acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8790bee700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f878c0b07a0 0x7f878c0acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f878b7fe700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f878c0b49e0 0x7f878c16db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8790bee700 1 -- 172.21.15.84:0/2100564084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f878c0b49e0 msgr2=0x7f878c16db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8790bee700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f878c0b49e0 0x7f878c16db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8790bee700 1 -- 172.21.15.84:0/2100564084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8784009ae0 con 0x7f878c1595a0 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8790bee700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c1595a0 0x7f878c09d230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f878c067c60 tx=0x7f8784018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8773fff700 1 -- 172.21.15.84:0/2100564084 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840032f0 con 0x7f878c1595a0 2023-10-06T03:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8773fff700 1 -- 172.21.15.84:0/2100564084 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8784026460 con 0x7f878c1595a0 2023-10-06T03:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8792651700 1 -- 172.21.15.84:0/2100564084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c0ad800 con 0x7f878c1595a0 2023-10-06T03:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8773fff700 1 -- 172.21.15.84:0/2100564084 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784026800 con 0x7f878c1595a0 2023-10-06T03:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.040+0000 7f8792651700 1 -- 172.21.15.84:0/2100564084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c0addc0 con 0x7f878c1595a0 2023-10-06T03:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.041+0000 7f8792651700 1 -- 172.21.15.84:0/2100564084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c0adfe0 con 0x7f878c1595a0 2023-10-06T03:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.042+0000 7f8773fff700 1 -- 172.21.15.84:0/2100564084 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f8784003040 con 0x7f878c1595a0 2023-10-06T03:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.042+0000 7f8773fff700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8778066ea0 0x7f8778069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.042+0000 7f8773fff700 1 -- 172.21.15.84:0/2100564084 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f87840860d0 con 0x7f878c1595a0 2023-10-06T03:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.042+0000 7f878bfff700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8778066ea0 0x7f8778069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.043+0000 7f878bfff700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8778066ea0 0x7f8778069350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f877c008900 tx=0x7f877c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.046+0000 7f8773fff700 1 -- 172.21.15.84:0/2100564084 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87840536c0 con 0x7f878c1595a0 2023-10-06T03:23:46.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.054+0000 7f8773fff700 1 -- 172.21.15.84:0/2100564084 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8784053a90 con 0x7f878c1595a0 2023-10-06T03:23:46.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.233+0000 7f8792651700 1 -- 172.21.15.84:0/2100564084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f878c064ad0 con 0x7f878c1595a0 2023-10-06T03:23:46.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.233+0000 7f8773fff700 1 -- 172.21.15.84:0/2100564084 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13648 (secure 0 0 0) 0x7f8784021090 con 0x7f878c1595a0 2023-10-06T03:23:46.235 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:23:46.235 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:45.500348+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:46.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 -- 172.21.15.84:0/2100564084 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8778066ea0 msgr2=0x7f8778069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8778066ea0 0x7f8778069350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f877c008900 tx=0x7f877c008040 comp rx=0 tx=0).stop 2023-10-06T03:23:46.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 -- 172.21.15.84:0/2100564084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c1595a0 msgr2=0x7f878c09d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c1595a0 0x7f878c09d230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f878c067c60 tx=0x7f8784018000 comp rx=0 tx=0).stop 2023-10-06T03:23:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 -- 172.21.15.84:0/2100564084 shutdown_connections 2023-10-06T03:23:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8778066ea0 0x7f8778069350 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f878c1595a0 0x7f878c09d230 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f878c0b07a0 0x7f878c0acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 --2- 172.21.15.84:0/2100564084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f878c0b49e0 0x7f878c16db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 -- 172.21.15.84:0/2100564084 >> 172.21.15.84:0/2100564084 conn(0x7f878c099830 msgr2=0x7f878c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.235+0000 7f8792651700 1 -- 172.21.15.84:0/2100564084 shutdown_connections 2023-10-06T03:23:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.236+0000 7f8792651700 1 -- 172.21.15.84:0/2100564084 wait complete. 2023-10-06T03:23:46.249 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:23:46.249 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:23:46.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.366+0000 7f475debe700 1 Processor -- start 2023-10-06T03:23:46.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.366+0000 7f475debe700 1 -- start start 2023-10-06T03:23:46.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f475debe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4758159510 0x7f47580cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f475debe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f47580cbae0 0x7f47580cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f475debe700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580cbf20 con 0x7f47581598e0 2023-10-06T03:23:46.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f475debe700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47580cf610 con 0x7f4758159510 2023-10-06T03:23:46.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f475debe700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47580cf8f0 con 0x7f47580cbae0 2023-10-06T03:23:46.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f47577fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4758159510 0x7f47580cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f4756ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f47581598e0 0x7f47580ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41678/0 (socket says 172.21.15.84:41678) 2023-10-06T03:23:46.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f4756ffd700 1 -- 172.21.15.84:0/2221119298 learned_addr learned my addr 172.21.15.84:0/2221119298 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f4757fff700 1 --2- 172.21.15.84:0/2221119298 >> v2:172.21.15.131:3300/0 conn(0x7f47580cbae0 0x7f47580cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f47577fe700 1 -- 172.21.15.84:0/2221119298 >> v2:172.21.15.131:3300/0 conn(0x7f47580cbae0 msgr2=0x7f47580cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f47577fe700 1 --2- 172.21.15.84:0/2221119298 >> v2:172.21.15.131:3300/0 conn(0x7f47580cbae0 0x7f47580cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f47577fe700 1 -- 172.21.15.84:0/2221119298 >> v1:172.21.15.84:6789/0 conn(0x7f47581598e0 legacy=0x7f47580ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f47577fe700 1 -- 172.21.15.84:0/2221119298 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580cfbd0 con 0x7f4758159510 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f47567fc700 1 -- 172.21.15.84:0/2221119298 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236382338 0 0) 0x7f47580cbf20 con 0x7f47581598e0 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f47577fe700 1 --2- 172.21.15.84:0/2221119298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4758159510 0x7f47580cb5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f475806f990 tx=0x7f474c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75df52f75a046332 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f47567fc700 1 -- 172.21.15.84:0/2221119298 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00b6b0 con 0x7f4758159510 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f47567fc700 1 -- 172.21.15.84:0/2221119298 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c00b810 con 0x7f4758159510 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.367+0000 7f47567fc700 1 -- 172.21.15.84:0/2221119298 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00bbb0 con 0x7f4758159510 2023-10-06T03:23:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.368+0000 7f475debe700 1 -- 172.21.15.84:0/2221119298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4758159510 msgr2=0x7f47580cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.368+0000 7f475debe700 1 --2- 172.21.15.84:0/2221119298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4758159510 0x7f47580cb5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f475806f990 tx=0x7f474c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.368+0000 7f475debe700 1 -- 172.21.15.84:0/2221119298 shutdown_connections 2023-10-06T03:23:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.368+0000 7f475debe700 1 --2- 172.21.15.84:0/2221119298 >> v2:172.21.15.131:3300/0 conn(0x7f47580cbae0 0x7f47580cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.368+0000 7f475debe700 1 --2- 172.21.15.84:0/2221119298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4758159510 0x7f47580cb5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.368+0000 7f475debe700 1 -- 172.21.15.84:0/2221119298 >> 172.21.15.84:0/2221119298 conn(0x7f4758089e90 msgr2=0x7f47580997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.368+0000 7f475debe700 1 -- 172.21.15.84:0/2221119298 shutdown_connections 2023-10-06T03:23:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.368+0000 7f475debe700 1 -- 172.21.15.84:0/2221119298 wait complete. 2023-10-06T03:23:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.369+0000 7f475debe700 1 Processor -- start 2023-10-06T03:23:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.369+0000 7f475debe700 1 -- start start 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f475debe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47580cbae0 0x7f47581699f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f475debe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4758159510 0x7f47580ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f475debe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47581598e0 0x7f475816a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f475debe700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475814c8f0 con 0x7f47581598e0 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f475debe700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475816a390 con 0x7f47580cbae0 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f475debe700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4758069b50 con 0x7f4758159510 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f4757fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47581598e0 0x7f475816a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f4757fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47581598e0 0x7f475816a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34616/0 (socket says 172.21.15.84:34616) 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f4757fff700 1 -- 172.21.15.84:0/1667466796 learned_addr learned my addr 172.21.15.84:0/1667466796 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f4757fff700 1 -- 172.21.15.84:0/1667466796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4758159510 msgr2=0x7f47580ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f47577fe700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47580cbae0 0x7f47581699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f4757fff700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4758159510 0x7f47580ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f4757fff700 1 -- 172.21.15.84:0/1667466796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47580cbae0 msgr2=0x7f47581699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f4757fff700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47580cbae0 0x7f47581699f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f4757fff700 1 -- 172.21.15.84:0/1667466796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c009420 con 0x7f47581598e0 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.370+0000 7f4757fff700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47581598e0 0x7f475816a820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f475000ceb0 tx=0x7f4750007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.371+0000 7f473f7fe700 1 -- 172.21.15.84:0/1667466796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475000ae40 con 0x7f47581598e0 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.371+0000 7f473f7fe700 1 -- 172.21.15.84:0/1667466796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750016430 con 0x7f47581598e0 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.371+0000 7f473f7fe700 1 -- 172.21.15.84:0/1667466796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47500167d0 con 0x7f47581598e0 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.371+0000 7f475debe700 1 -- 172.21.15.84:0/1667466796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4758069e30 con 0x7f47581598e0 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.371+0000 7f475debe700 1 -- 172.21.15.84:0/1667466796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475816a020 con 0x7f47581598e0 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.372+0000 7f475debe700 1 -- 172.21.15.84:0/1667466796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475816a540 con 0x7f47581598e0 2023-10-06T03:23:46.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.372+0000 7f473f7fe700 1 -- 172.21.15.84:0/1667466796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4750003020 con 0x7f47581598e0 2023-10-06T03:23:46.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.372+0000 7f473f7fe700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4744066f30 0x7f47440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.372+0000 7f473f7fe700 1 -- 172.21.15.84:0/1667466796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4750012070 con 0x7f47581598e0 2023-10-06T03:23:46.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.372+0000 7f47577fe700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4744066f30 0x7f47440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.373+0000 7f47577fe700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4744066f30 0x7f47440693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4758158c20 tx=0x7f474c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.377+0000 7f473f7fe700 1 -- 172.21.15.84:0/1667466796 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f475816a540 con 0x7f47581598e0 2023-10-06T03:23:46.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.561+0000 7f475debe700 1 -- 172.21.15.84:0/1667466796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f475816a500 con 0x7f47581598e0 2023-10-06T03:23:46.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.561+0000 7f473f7fe700 1 -- 172.21.15.84:0/1667466796 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4750056150 con 0x7f47581598e0 2023-10-06T03:23:46.563 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:23:46.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 -- 172.21.15.84:0/1667466796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4744066f30 msgr2=0x7f47440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4744066f30 0x7f47440693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4758158c20 tx=0x7f474c017000 comp rx=0 tx=0).stop 2023-10-06T03:23:46.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 -- 172.21.15.84:0/1667466796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47581598e0 msgr2=0x7f475816a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47581598e0 0x7f475816a820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f475000ceb0 tx=0x7f4750007870 comp rx=0 tx=0).stop 2023-10-06T03:23:46.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 -- 172.21.15.84:0/1667466796 shutdown_connections 2023-10-06T03:23:46.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4744066f30 0x7f47440693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47580cbae0 0x7f47581699f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47581598e0 0x7f475816a820 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 --2- 172.21.15.84:0/1667466796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4758159510 0x7f47580ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 -- 172.21.15.84:0/1667466796 >> 172.21.15.84:0/1667466796 conn(0x7f4758089e90 msgr2=0x7f47580c68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:46.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 -- 172.21.15.84:0/1667466796 shutdown_connections 2023-10-06T03:23:46.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.563+0000 7f475debe700 1 -- 172.21.15.84:0/1667466796 wait complete. 2023-10-06T03:23:46.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:23:46.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.693+0000 7f7fb2e46700 1 Processor -- start 2023-10-06T03:23:46.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.693+0000 7f7fb2e46700 1 -- start start 2023-10-06T03:23:46.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.693+0000 7f7fb2e46700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac159510 0x7f7fac0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.693+0000 7f7fb2e46700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fac0cbae0 0x7f7fac0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.693+0000 7f7fb2e46700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0cbf00 con 0x7f7fac1598e0 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.693+0000 7f7fb2e46700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0cf610 con 0x7f7fac0cbae0 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.693+0000 7f7fb2e46700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0cf8f0 con 0x7f7fac159510 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.693+0000 7f7fb13e3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fac0cbae0 0x7f7fac0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fb13e3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fac0cbae0 0x7f7fac0cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34618/0 (socket says 172.21.15.84:34618) 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fb13e3700 1 -- 172.21.15.84:0/2753950691 learned_addr learned my addr 172.21.15.84:0/2753950691 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fb0be2700 1 --2- 172.21.15.84:0/2753950691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac159510 0x7f7fac0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fb13e3700 1 -- 172.21.15.84:0/2753950691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac159510 msgr2=0x7f7fac0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fb13e3700 1 --2- 172.21.15.84:0/2753950691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac159510 0x7f7fac0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fb13e3700 1 -- 172.21.15.84:0/2753950691 >> v1:172.21.15.131:6789/0 conn(0x7f7fac1598e0 legacy=0x7f7fac0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:46.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fb13e3700 1 -- 172.21.15.84:0/2753950691 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0cfbd0 con 0x7f7fac0cbae0 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fb0be2700 1 --2- 172.21.15.84:0/2753950691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac159510 0x7f7fac0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fb13e3700 1 --2- 172.21.15.84:0/2753950691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 0x7f7fac0cef30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009f20 tx=0x7f7fa4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e471c788420201c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fa37fe700 1 -- 172.21.15.84:0/2753950691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400e070 con 0x7f7fac0cbae0 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fa37fe700 1 -- 172.21.15.84:0/2753950691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400ba40 con 0x7f7fac0cbae0 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.694+0000 7f7fa37fe700 1 -- 172.21.15.84:0/2753950691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40092e0 con 0x7f7fac0cbae0 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.695+0000 7f7fb2e46700 1 -- 172.21.15.84:0/2753950691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 msgr2=0x7f7fac0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.695+0000 7f7fb2e46700 1 --2- 172.21.15.84:0/2753950691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 0x7f7fac0cef30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009f20 tx=0x7f7fa4009840 comp rx=0 tx=0).stop 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.695+0000 7f7fb2e46700 1 -- 172.21.15.84:0/2753950691 shutdown_connections 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.695+0000 7f7fb2e46700 1 --2- 172.21.15.84:0/2753950691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 0x7f7fac0cef30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.695+0000 7f7fb2e46700 1 --2- 172.21.15.84:0/2753950691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac159510 0x7f7fac0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.695+0000 7f7fb2e46700 1 -- 172.21.15.84:0/2753950691 >> 172.21.15.84:0/2753950691 conn(0x7f7fac089e90 msgr2=0x7f7fac0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:46.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.695+0000 7f7fb2e46700 1 -- 172.21.15.84:0/2753950691 shutdown_connections 2023-10-06T03:23:46.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.695+0000 7f7fb2e46700 1 -- 172.21.15.84:0/2753950691 wait complete. 2023-10-06T03:23:46.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.696+0000 7f7fb2e46700 1 Processor -- start 2023-10-06T03:23:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.696+0000 7f7fb2e46700 1 -- start start 2023-10-06T03:23:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb2e46700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 0x7f7fac149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb2e46700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac159510 0x7f7fac16a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb2e46700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac1598e0 0x7f7fac15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb2e46700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac15ac80 con 0x7f7fac0cbae0 2023-10-06T03:23:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb2e46700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac16a850 con 0x7f7fac159510 2023-10-06T03:23:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb2e46700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac15a070 con 0x7f7fac1598e0 2023-10-06T03:23:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb0be2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 0x7f7fac149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb0be2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 0x7f7fac149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34620/0 (socket says 172.21.15.84:34620) 2023-10-06T03:23:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb0be2700 1 -- 172.21.15.84:0/1335511323 learned_addr learned my addr 172.21.15.84:0/1335511323 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb13e3700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac1598e0 0x7f7fac15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb0be2700 1 -- 172.21.15.84:0/1335511323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac1598e0 msgr2=0x7f7fac15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb0be2700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac1598e0 0x7f7fac15b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb0be2700 1 -- 172.21.15.84:0/1335511323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac159510 msgr2=0x7f7fac16a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fa3fff700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac159510 0x7f7fac16a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb0be2700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac159510 0x7f7fac16a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb0be2700 1 -- 172.21.15.84:0/1335511323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009ae0 con 0x7f7fac0cbae0 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb13e3700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac1598e0 0x7f7fac15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fa3fff700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac159510 0x7f7fac16a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb0be2700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 0x7f7fac149d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800c830 tx=0x7f7fa8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fa0ff9700 1 -- 172.21.15.84:0/1335511323 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8011600 con 0x7f7fac0cbae0 2023-10-06T03:23:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fa0ff9700 1 -- 172.21.15.84:0/1335511323 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa8011760 con 0x7f7fac0cbae0 2023-10-06T03:23:46.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb2e46700 1 -- 172.21.15.84:0/1335511323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac15a350 con 0x7f7fac0cbae0 2023-10-06T03:23:46.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fa0ff9700 1 -- 172.21.15.84:0/1335511323 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8011b20 con 0x7f7fac0cbae0 2023-10-06T03:23:46.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.697+0000 7f7fb2e46700 1 -- 172.21.15.84:0/1335511323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac15a910 con 0x7f7fac0cbae0 2023-10-06T03:23:46.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.698+0000 7f7fb2e46700 1 -- 172.21.15.84:0/1335511323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac064ad0 con 0x7f7fac0cbae0 2023-10-06T03:23:46.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.699+0000 7f7fa0ff9700 1 -- 172.21.15.84:0/1335511323 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fa800a3e0 con 0x7f7fac0cbae0 2023-10-06T03:23:46.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.699+0000 7f7fa0ff9700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7f98066f30 0x7f7f980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.699+0000 7f7fa3fff700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7f98066f30 0x7f7f980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.699+0000 7f7fa0ff9700 1 -- 172.21.15.84:0/1335511323 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7fa8084850 con 0x7f7fac0cbae0 2023-10-06T03:23:46.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.700+0000 7f7fa3fff700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7f98066f30 0x7f7f980693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fac14bb00 tx=0x7f7f9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.703+0000 7f7fa0ff9700 1 -- 172.21.15.84:0/1335511323 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fa8051cb0 con 0x7f7fac0cbae0 2023-10-06T03:23:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.885+0000 7f7fb2e46700 1 -- 172.21.15.84:0/1335511323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fac0cfeb0 con 0x7f7fac0cbae0 2023-10-06T03:23:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.885+0000 7f7fa0ff9700 1 -- 172.21.15.84:0/1335511323 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fa80150a0 con 0x7f7fac0cbae0 2023-10-06T03:23:46.887 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:23:46.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 -- 172.21.15.84:0/1335511323 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7f98066f30 msgr2=0x7f7f980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7f98066f30 0x7f7f980693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fac14bb00 tx=0x7f7f9c009040 comp rx=0 tx=0).stop 2023-10-06T03:23:46.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 -- 172.21.15.84:0/1335511323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 msgr2=0x7f7fac149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 0x7f7fac149d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800c830 tx=0x7f7fa8008040 comp rx=0 tx=0).stop 2023-10-06T03:23:46.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 -- 172.21.15.84:0/1335511323 shutdown_connections 2023-10-06T03:23:46.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7f98066f30 0x7f7f980693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac1598e0 0x7f7fac15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac0cbae0 0x7f7fac149d40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 --2- 172.21.15.84:0/1335511323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac159510 0x7f7fac16a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 -- 172.21.15.84:0/1335511323 >> 172.21.15.84:0/1335511323 conn(0x7f7fac089e90 msgr2=0x7f7fac14ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:46.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 -- 172.21.15.84:0/1335511323 shutdown_connections 2023-10-06T03:23:46.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:46.887+0000 7f7fb2e46700 1 -- 172.21.15.84:0/1335511323 wait complete. 2023-10-06T03:23:46.901 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:23:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.012+0000 7f58cf940700 1 Processor -- start 2023-10-06T03:23:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.013+0000 7f58cf940700 1 -- start start 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.013+0000 7f58cf940700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58c8156390 0x7f58c80cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.013+0000 7f58cf940700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58c80cc750 0x7f58c806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.013+0000 7f58cf940700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f58c806c1a0 0x7f58c80caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.013+0000 7f58cf940700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c80ccbc0 con 0x7f58c80cc750 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.013+0000 7f58cf940700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c806c9e0 con 0x7f58c806c1a0 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.013+0000 7f58cf940700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8156b60 con 0x7f58c8156390 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58ccedb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58c80cc750 0x7f58c806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58ccedb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58c80cc750 0x7f58c806bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34630/0 (socket says 172.21.15.84:34630) 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58ccedb700 1 -- 172.21.15.84:0/2358175695 learned_addr learned my addr 172.21.15.84:0/2358175695 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58cdedd700 1 --2- 172.21.15.84:0/2358175695 >> v2:172.21.15.131:3300/0 conn(0x7f58c806c1a0 0x7f58c80caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58cd6dc700 1 --2- 172.21.15.84:0/2358175695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58c8156390 0x7f58c80cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58ccedb700 1 -- 172.21.15.84:0/2358175695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58c8156390 msgr2=0x7f58c80cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58ccedb700 1 --2- 172.21.15.84:0/2358175695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58c8156390 0x7f58c80cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58ccedb700 1 -- 172.21.15.84:0/2358175695 >> v2:172.21.15.131:3300/0 conn(0x7f58c806c1a0 msgr2=0x7f58c80caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58ccedb700 1 --2- 172.21.15.84:0/2358175695 >> v2:172.21.15.131:3300/0 conn(0x7f58c806c1a0 0x7f58c80caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58ccedb700 1 -- 172.21.15.84:0/2358175695 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c8156e40 con 0x7f58c80cc750 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58ccedb700 1 --2- 172.21.15.84:0/2358175695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c80cc750 0x7f58c806bc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58c80712d0 tx=0x7f58b800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be96196ae667ea9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58bffff700 1 -- 172.21.15.84:0/2358175695 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800dc50 con 0x7f58c80cc750 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58bffff700 1 -- 172.21.15.84:0/2358175695 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b800ddb0 con 0x7f58c80cc750 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.014+0000 7f58bffff700 1 -- 172.21.15.84:0/2358175695 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80196d0 con 0x7f58c80cc750 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.015+0000 7f58cf940700 1 -- 172.21.15.84:0/2358175695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c80cc750 msgr2=0x7f58c806bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.015+0000 7f58cf940700 1 --2- 172.21.15.84:0/2358175695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c80cc750 0x7f58c806bc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58c80712d0 tx=0x7f58b800b4f0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.015+0000 7f58cf940700 1 -- 172.21.15.84:0/2358175695 shutdown_connections 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.015+0000 7f58cf940700 1 --2- 172.21.15.84:0/2358175695 >> v2:172.21.15.131:3300/0 conn(0x7f58c806c1a0 0x7f58c80caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.015+0000 7f58cf940700 1 --2- 172.21.15.84:0/2358175695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58c8156390 0x7f58c80cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.015+0000 7f58cf940700 1 --2- 172.21.15.84:0/2358175695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c80cc750 0x7f58c806bc60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.015+0000 7f58cf940700 1 -- 172.21.15.84:0/2358175695 >> 172.21.15.84:0/2358175695 conn(0x7f58c80cdef0 msgr2=0x7f58c80c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.015+0000 7f58cf940700 1 -- 172.21.15.84:0/2358175695 shutdown_connections 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.015+0000 7f58cf940700 1 -- 172.21.15.84:0/2358175695 wait complete. 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.016+0000 7f58cf940700 1 Processor -- start 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.016+0000 7f58cf940700 1 -- start start 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cf940700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c806c1a0 0x7f58c81434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cf940700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58c80cc750 0x7f58c80c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cf940700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58c8156390 0x7f58c80c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cf940700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80c73c0 con 0x7f58c806c1a0 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cf940700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80c58a0 con 0x7f58c8156390 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cf940700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80c5b80 con 0x7f58c80cc750 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cd6dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c806c1a0 0x7f58c81434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cd6dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c806c1a0 0x7f58c81434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34632/0 (socket says 172.21.15.84:34632) 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cd6dc700 1 -- 172.21.15.84:0/1124710533 learned_addr learned my addr 172.21.15.84:0/1124710533 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58ccedb700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58c80cc750 0x7f58c80c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cd6dc700 1 -- 172.21.15.84:0/1124710533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58c80cc750 msgr2=0x7f58c80c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cd6dc700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58c80cc750 0x7f58c80c6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cd6dc700 1 -- 172.21.15.84:0/1124710533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58c8156390 msgr2=0x7f58c80c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cd6dc700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58c8156390 0x7f58c80c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cd6dc700 1 -- 172.21.15.84:0/1124710533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b800b790 con 0x7f58c806c1a0 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cd6dc700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c806c1a0 0x7f58c81434f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009fa0 tx=0x7f58c4009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58bd7fa700 1 -- 172.21.15.84:0/1124710533 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c400ed20 con 0x7f58c806c1a0 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58bd7fa700 1 -- 172.21.15.84:0/1124710533 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c400ee80 con 0x7f58c806c1a0 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cf940700 1 -- 172.21.15.84:0/1124710533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c80c5e60 con 0x7f58c806c1a0 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58bd7fa700 1 -- 172.21.15.84:0/1124710533 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4014670 con 0x7f58c806c1a0 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.017+0000 7f58cf940700 1 -- 172.21.15.84:0/1124710533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c80c6420 con 0x7f58c806c1a0 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.018+0000 7f58cf940700 1 -- 172.21.15.84:0/1124710533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c8064ad0 con 0x7f58c806c1a0 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.019+0000 7f58bd7fa700 1 -- 172.21.15.84:0/1124710533 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58c40149e0 con 0x7f58c806c1a0 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.019+0000 7f58bd7fa700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f58ac066f30 0x7f58ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.019+0000 7f58ccedb700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f58ac066f30 0x7f58ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.019+0000 7f58bd7fa700 1 -- 172.21.15.84:0/1124710533 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f58c4084af0 con 0x7f58c806c1a0 2023-10-06T03:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.019+0000 7f58ccedb700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f58ac066f30 0x7f58ac0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58c80712d0 tx=0x7f58b801b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.023+0000 7f58bd7fa700 1 -- 172.21.15.84:0/1124710533 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58c4051f50 con 0x7f58c806c1a0 2023-10-06T03:23:47.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.209+0000 7f58cf940700 1 -- 172.21.15.84:0/1124710533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f58c8157120 con 0x7f58c806c1a0 2023-10-06T03:23:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.210+0000 7f58bd7fa700 1 -- 172.21.15.84:0/1124710533 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7f58c4055570 con 0x7f58c806c1a0 2023-10-06T03:23:47.212 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:23:47.212 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T03:23:47.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:23:47.212 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T03:23:47.212 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T03:23:47.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:23:47.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:23:47.212 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T03:23:47.212 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T03:23:47.213 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:23:47.213 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T03:23:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 -- 172.21.15.84:0/1124710533 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f58ac066f30 msgr2=0x7f58ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f58ac066f30 0x7f58ac0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58c80712d0 tx=0x7f58b801b000 comp rx=0 tx=0).stop 2023-10-06T03:23:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 -- 172.21.15.84:0/1124710533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c806c1a0 msgr2=0x7f58c81434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c806c1a0 0x7f58c81434f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009fa0 tx=0x7f58c4009880 comp rx=0 tx=0).stop 2023-10-06T03:23:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 -- 172.21.15.84:0/1124710533 shutdown_connections 2023-10-06T03:23:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f58ac066f30 0x7f58ac0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58c8156390 0x7f58c80c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c806c1a0 0x7f58c81434f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 --2- 172.21.15.84:0/1124710533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58c80cc750 0x7f58c80c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 -- 172.21.15.84:0/1124710533 >> 172.21.15.84:0/1124710533 conn(0x7f58c80cdef0 msgr2=0x7f58c80cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 -- 172.21.15.84:0/1124710533 shutdown_connections 2023-10-06T03:23:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.212+0000 7f58cf940700 1 -- 172.21.15.84:0/1124710533 wait complete. 2023-10-06T03:23:47.225 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:23:47.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:23:47.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.342+0000 7ff1b32b3700 1 Processor -- start 2023-10-06T03:23:47.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.342+0000 7ff1b32b3700 1 -- start start 2023-10-06T03:23:47.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b32b3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac06ed20 0x7ff1ac0b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b32b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff1ac06f0f0 0x7ff1ac0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b32b3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac0b2d20 con 0x7ff1ac0aee20 2023-10-06T03:23:47.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b32b3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac06fb80 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b32b3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0b0450 con 0x7ff1ac06ed20 2023-10-06T03:23:47.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b084e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff1ac06f0f0 0x7ff1ac0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b1850700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff1ac0aee20 0x7ff1ac0af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41688/0 (socket says 172.21.15.84:41688) 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b1850700 1 -- 172.21.15.84:0/3317179304 learned_addr learned my addr 172.21.15.84:0/3317179304 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b104f700 1 --2- 172.21.15.84:0/3317179304 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac06ed20 0x7ff1ac0b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b084e700 1 -- 172.21.15.84:0/3317179304 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac06ed20 msgr2=0x7ff1ac0b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b084e700 1 --2- 172.21.15.84:0/3317179304 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac06ed20 0x7ff1ac0b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b084e700 1 -- 172.21.15.84:0/3317179304 >> v1:172.21.15.84:6789/0 conn(0x7ff1ac0aee20 legacy=0x7ff1ac0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1abfff700 1 -- 172.21.15.84:0/3317179304 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549329590 0 0) 0x7ff1ac0b2d20 con 0x7ff1ac0aee20 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b084e700 1 -- 172.21.15.84:0/3317179304 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0b2a40 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b104f700 1 --2- 172.21.15.84:0/3317179304 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac06ed20 0x7ff1ac0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1b084e700 1 --2- 172.21.15.84:0/3317179304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 0x7ff1ac0b08e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009910 tx=0x7ff1a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae488f570255b41c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1abfff700 1 -- 172.21.15.84:0/3317179304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a000b820 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1abfff700 1 -- 172.21.15.84:0/3317179304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a000b980 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.343+0000 7ff1abfff700 1 -- 172.21.15.84:0/3317179304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a000bd20 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.344+0000 7ff1b32b3700 1 -- 172.21.15.84:0/3317179304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 msgr2=0x7ff1ac0b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.344+0000 7ff1b32b3700 1 --2- 172.21.15.84:0/3317179304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 0x7ff1ac0b08e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009910 tx=0x7ff1a00091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.344+0000 7ff1b32b3700 1 -- 172.21.15.84:0/3317179304 shutdown_connections 2023-10-06T03:23:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.344+0000 7ff1b32b3700 1 --2- 172.21.15.84:0/3317179304 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac06ed20 0x7ff1ac0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.344+0000 7ff1b32b3700 1 --2- 172.21.15.84:0/3317179304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 0x7ff1ac0b08e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.344+0000 7ff1b32b3700 1 -- 172.21.15.84:0/3317179304 >> 172.21.15.84:0/3317179304 conn(0x7ff1ac068330 msgr2=0x7ff1ac068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.344+0000 7ff1b32b3700 1 -- 172.21.15.84:0/3317179304 shutdown_connections 2023-10-06T03:23:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.344+0000 7ff1b32b3700 1 -- 172.21.15.84:0/3317179304 wait complete. 2023-10-06T03:23:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.345+0000 7ff1b32b3700 1 Processor -- start 2023-10-06T03:23:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.345+0000 7ff1b32b3700 1 -- start start 2023-10-06T03:23:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b32b3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1ac06ed20 0x7ff1ac157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b32b3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 0x7ff1ac0cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b32b3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac0aee20 0x7ff1ac0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b32b3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac16d2a0 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b32b3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac16a140 con 0x7ff1ac06ed20 2023-10-06T03:23:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b32b3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac16a420 con 0x7ff1ac0aee20 2023-10-06T03:23:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b084e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 0x7ff1ac0cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b084e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 0x7ff1ac0cc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34652/0 (socket says 172.21.15.84:34652) 2023-10-06T03:23:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b084e700 1 -- 172.21.15.84:0/1621768451 learned_addr learned my addr 172.21.15.84:0/1621768451 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b1850700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac0aee20 0x7ff1ac0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b104f700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1ac06ed20 0x7ff1ac157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b084e700 1 -- 172.21.15.84:0/1621768451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac0aee20 msgr2=0x7ff1ac0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b084e700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac0aee20 0x7ff1ac0c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b084e700 1 -- 172.21.15.84:0/1621768451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1ac06ed20 msgr2=0x7ff1ac157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b084e700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1ac06ed20 0x7ff1ac157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b084e700 1 -- 172.21.15.84:0/1621768451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a0009420 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b1850700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac0aee20 0x7ff1ac0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b104f700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1ac06ed20 0x7ff1ac157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.346+0000 7ff1b084e700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 0x7ff1ac0cc490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000b3c0 tx=0x7ff1a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.347+0000 7ff1a97fa700 1 -- 172.21.15.84:0/1621768451 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0011e50 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.347+0000 7ff1a97fa700 1 -- 172.21.15.84:0/1621768451 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a0024440 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.347+0000 7ff1b32b3700 1 -- 172.21.15.84:0/1621768451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac16a700 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.347+0000 7ff1a97fa700 1 -- 172.21.15.84:0/1621768451 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0024800 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.347+0000 7ff1b32b3700 1 -- 172.21.15.84:0/1621768451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac157c70 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.348+0000 7ff1b32b3700 1 -- 172.21.15.84:0/1621768451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac16d410 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.348+0000 7ff1a97fa700 1 -- 172.21.15.84:0/1621768451 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1a001a420 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.348+0000 7ff1a97fa700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff198066f30 0x7ff1980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.349+0000 7ff1b104f700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff198066f30 0x7ff1980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.349+0000 7ff1a97fa700 1 -- 172.21.15.84:0/1621768451 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff1a0086260 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.349+0000 7ff1b104f700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff198066f30 0x7ff1980693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40094d0 tx=0x7ff1a400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.353+0000 7ff1a97fa700 1 -- 172.21.15.84:0/1621768451 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1a00536c0 con 0x7ff1ac06f0f0 2023-10-06T03:23:47.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:47.536+0000 7ff1b32b3700 1 -- 172.21.15.84:0/1621768451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff1ac064ad0 con 0x7ff1ac06f0f0 2023-10-06T03:23:48.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.524+0000 7ff1a97fa700 1 -- 172.21.15.84:0/1621768451 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff1a0056ce0 con 0x7ff1ac06f0f0 2023-10-06T03:23:48.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.527+0000 7ff1b32b3700 1 -- 172.21.15.84:0/1621768451 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff198066f30 msgr2=0x7ff1980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.527+0000 7ff1b32b3700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff198066f30 0x7ff1980693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40094d0 tx=0x7ff1a400b040 comp rx=0 tx=0).stop 2023-10-06T03:23:48.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.527+0000 7ff1b32b3700 1 -- 172.21.15.84:0/1621768451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 msgr2=0x7ff1ac0cc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.527+0000 7ff1b32b3700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 0x7ff1ac0cc490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000b3c0 tx=0x7ff1a0017000 comp rx=0 tx=0).stop 2023-10-06T03:23:48.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.528+0000 7ff1b32b3700 1 -- 172.21.15.84:0/1621768451 shutdown_connections 2023-10-06T03:23:48.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.528+0000 7ff1b32b3700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff198066f30 0x7ff1980693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.528+0000 7ff1b32b3700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1ac06ed20 0x7ff1ac157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.528+0000 7ff1b32b3700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1ac0aee20 0x7ff1ac0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.528+0000 7ff1b32b3700 1 --2- 172.21.15.84:0/1621768451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac06f0f0 0x7ff1ac0cc490 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.528+0000 7ff1b32b3700 1 -- 172.21.15.84:0/1621768451 >> 172.21.15.84:0/1621768451 conn(0x7ff1ac068330 msgr2=0x7ff1ac068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:48.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.528+0000 7ff1b32b3700 1 -- 172.21.15.84:0/1621768451 shutdown_connections 2023-10-06T03:23:48.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.528+0000 7ff1b32b3700 1 -- 172.21.15.84:0/1621768451 wait complete. 2023-10-06T03:23:48.532 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T03:23:48.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T03:23:48.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.670+0000 7fbcfe862700 1 Processor -- start 2023-10-06T03:23:48.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.670+0000 7fbcfe862700 1 -- start start 2023-10-06T03:23:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.671+0000 7fbcfe862700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbcf81598e0 0x7fbcf80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.671+0000 7fbcfe862700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 0x7fbcf80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.671+0000 7fbcfe862700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf80cf610 con 0x7fbcf8159510 2023-10-06T03:23:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.671+0000 7fbcfe862700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf80cf8f0 con 0x7fbcf81598e0 2023-10-06T03:23:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.671+0000 7fbcfe862700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80cfbd0 con 0x7fbcf80cbcb0 2023-10-06T03:23:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.671+0000 7fbcf77fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbcf81598e0 0x7fbcf80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.671+0000 7fbcfcdff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 0x7fbcf80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcfcdff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 0x7fbcf80ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:35398/0 (socket says 172.21.15.84:35398) 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf77fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbcf81598e0 0x7fbcf80ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:57008/0 (socket says 172.21.15.84:57008) 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcfcdff700 1 -- 172.21.15.84:0/1002140339 learned_addr learned my addr 172.21.15.84:0/1002140339 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf7fff700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fbcf8159510 0x7fbcf80cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:42736/0 (socket says 172.21.15.84:42736) 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf77fe700 1 -- 172.21.15.84:0/1002140339 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 msgr2=0x7fbcf80ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf77fe700 1 --2- 172.21.15.84:0/1002140339 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 0x7fbcf80ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf77fe700 1 -- 172.21.15.84:0/1002140339 >> v1:172.21.15.131:6789/0 conn(0x7fbcf8159510 legacy=0x7fbcf80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf6ffd700 1 -- 172.21.15.84:0/1002140339 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163194648 0 0) 0x7fbcf80cf610 con 0x7fbcf8159510 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf77fe700 1 -- 172.21.15.84:0/1002140339 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf80cfeb0 con 0x7fbcf81598e0 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcfcdff700 1 --2- 172.21.15.84:0/1002140339 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 0x7fbcf80ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf77fe700 1 --2- 172.21.15.84:0/1002140339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf81598e0 0x7fbcf80ce820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0098e0 tx=0x7fbcec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d859f18c909d61a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf6ffd700 1 -- 172.21.15.84:0/1002140339 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00b640 con 0x7fbcf81598e0 2023-10-06T03:23:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf6ffd700 1 -- 172.21.15.84:0/1002140339 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec00b7a0 con 0x7fbcf81598e0 2023-10-06T03:23:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.672+0000 7fbcf6ffd700 1 -- 172.21.15.84:0/1002140339 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00bb40 con 0x7fbcf81598e0 2023-10-06T03:23:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.673+0000 7fbcfe862700 1 -- 172.21.15.84:0/1002140339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf81598e0 msgr2=0x7fbcf80ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.673+0000 7fbcfe862700 1 --2- 172.21.15.84:0/1002140339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf81598e0 0x7fbcf80ce820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0098e0 tx=0x7fbcec0091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.673+0000 7fbcfe862700 1 -- 172.21.15.84:0/1002140339 shutdown_connections 2023-10-06T03:23:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.673+0000 7fbcfe862700 1 --2- 172.21.15.84:0/1002140339 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 0x7fbcf80ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.673+0000 7fbcfe862700 1 --2- 172.21.15.84:0/1002140339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf81598e0 0x7fbcf80ce820 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.673+0000 7fbcfe862700 1 -- 172.21.15.84:0/1002140339 >> 172.21.15.84:0/1002140339 conn(0x7fbcf8089e90 msgr2=0x7fbcf80997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.673+0000 7fbcfe862700 1 -- 172.21.15.84:0/1002140339 shutdown_connections 2023-10-06T03:23:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.673+0000 7fbcfe862700 1 -- 172.21.15.84:0/1002140339 wait complete. 2023-10-06T03:23:48.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.674+0000 7fbcfe862700 1 Processor -- start 2023-10-06T03:23:48.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.674+0000 7fbcfe862700 1 -- start start 2023-10-06T03:23:48.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcfe862700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 0x7fbcf8148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcfe862700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcf8159510 0x7fbcf8148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcfe862700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf81598e0 0x7fbcf8157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcfe862700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf815abb0 con 0x7fbcf8159510 2023-10-06T03:23:48.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcfe862700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf8159e30 con 0x7fbcf81598e0 2023-10-06T03:23:48.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcfe862700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf815a0d0 con 0x7fbcf80cbcb0 2023-10-06T03:23:48.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcf8159510 0x7fbcf8148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcf8159510 0x7fbcf8148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34656/0 (socket says 172.21.15.84:34656) 2023-10-06T03:23:48.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcf77fe700 1 -- 172.21.15.84:0/2054515249 learned_addr learned my addr 172.21.15.84:0/2054515249 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:48.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcf7fff700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 0x7fbcf8148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcfcdff700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf81598e0 0x7fbcf8157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcf77fe700 1 -- 172.21.15.84:0/2054515249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 msgr2=0x7fbcf8148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcf77fe700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 0x7fbcf8148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcf77fe700 1 -- 172.21.15.84:0/2054515249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf81598e0 msgr2=0x7fbcf8157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcf77fe700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf81598e0 0x7fbcf8157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcf77fe700 1 -- 172.21.15.84:0/2054515249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0009ae0 con 0x7fbcf8159510 2023-10-06T03:23:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.675+0000 7fbcf77fe700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcf8159510 0x7fbcf8148c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8067c60 tx=0x7fbcec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.676+0000 7fbcdffff700 1 -- 172.21.15.84:0/2054515249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00b910 con 0x7fbcf8159510 2023-10-06T03:23:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.676+0000 7fbcdffff700 1 -- 172.21.15.84:0/2054515249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec00ba70 con 0x7fbcf8159510 2023-10-06T03:23:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.676+0000 7fbcfe862700 1 -- 172.21.15.84:0/2054515249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec009420 con 0x7fbcf8159510 2023-10-06T03:23:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.676+0000 7fbcdffff700 1 -- 172.21.15.84:0/2054515249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec024670 con 0x7fbcf8159510 2023-10-06T03:23:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.676+0000 7fbcfe862700 1 -- 172.21.15.84:0/2054515249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf815a690 con 0x7fbcf8159510 2023-10-06T03:23:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.677+0000 7fbcfe862700 1 -- 172.21.15.84:0/2054515249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf8064ad0 con 0x7fbcf8159510 2023-10-06T03:23:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.677+0000 7fbcdffff700 1 -- 172.21.15.84:0/2054515249 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbcec02d440 con 0x7fbcf8159510 2023-10-06T03:23:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.677+0000 7fbcdffff700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbce4066f30 0x7fbce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.678+0000 7fbcdffff700 1 -- 172.21.15.84:0/2054515249 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fbcec085cf0 con 0x7fbcf8159510 2023-10-06T03:23:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.678+0000 7fbcf7fff700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbce4066f30 0x7fbce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.678+0000 7fbcf7fff700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbce4066f30 0x7fbce40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbce8007fd0 tx=0x7fbce8007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.682+0000 7fbcdffff700 1 -- 172.21.15.84:0/2054515249 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcec08a070 con 0x7fbcf8159510 2023-10-06T03:23:48.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:48.863+0000 7fbcfe862700 1 -- 172.21.15.84:0/2054515249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fbcf80cf2a0 con 0x7fbcf8159510 2023-10-06T03:23:49.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.530+0000 7fbcdffff700 1 -- 172.21.15.84:0/2054515249 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fbcec053060 con 0x7fbcf8159510 2023-10-06T03:23:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.540+0000 7fbcfe862700 1 -- 172.21.15.84:0/2054515249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbce4066f30 msgr2=0x7fbce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.540+0000 7fbcfe862700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbce4066f30 0x7fbce40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbce8007fd0 tx=0x7fbce8007d50 comp rx=0 tx=0).stop 2023-10-06T03:23:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.540+0000 7fbcfe862700 1 -- 172.21.15.84:0/2054515249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcf8159510 msgr2=0x7fbcf8148c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.540+0000 7fbcfe862700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcf8159510 0x7fbcf8148c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8067c60 tx=0x7fbcec017000 comp rx=0 tx=0).stop 2023-10-06T03:23:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.540+0000 7fbcfe862700 1 -- 172.21.15.84:0/2054515249 shutdown_connections 2023-10-06T03:23:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.540+0000 7fbcfe862700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbce4066f30 0x7fbce40693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.540+0000 7fbcfe862700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf81598e0 0x7fbcf8157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.540+0000 7fbcfe862700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcf80cbcb0 0x7fbcf8148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.540+0000 7fbcfe862700 1 --2- 172.21.15.84:0/2054515249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcf8159510 0x7fbcf8148c50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.540+0000 7fbcfe862700 1 -- 172.21.15.84:0/2054515249 >> 172.21.15.84:0/2054515249 conn(0x7fbcf8089e90 msgr2=0x7fbcf80997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:49.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.543+0000 7fbcfe862700 1 -- 172.21.15.84:0/2054515249 shutdown_connections 2023-10-06T03:23:49.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.543+0000 7fbcfe862700 1 -- 172.21.15.84:0/2054515249 wait complete. 2023-10-06T03:23:49.549 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T03:23:49.561 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:23:49.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.678+0000 7f4eb99b9700 1 Processor -- start 2023-10-06T03:23:49.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.679+0000 7f4eb99b9700 1 -- start start 2023-10-06T03:23:49.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.679+0000 7f4eb99b9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb4159510 0x7f4eb40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:49.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.679+0000 7f4eb99b9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4eb40cbae0 0x7f4eb40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:49.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.679+0000 7f4eb99b9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb40cbf00 con 0x7f4eb41598e0 2023-10-06T03:23:49.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.679+0000 7f4eb99b9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb40cf610 con 0x7f4eb40cbae0 2023-10-06T03:23:49.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.679+0000 7f4eb99b9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40cf8f0 con 0x7f4eb4159510 2023-10-06T03:23:49.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eaa7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4eb41598e0 0x7f4eb40ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41698/0 (socket says 172.21.15.84:41698) 2023-10-06T03:23:49.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eaa7fc700 1 -- 172.21.15.84:0/2092121095 learned_addr learned my addr 172.21.15.84:0/2092121095 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:49.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb2ffd700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb4159510 0x7f4eb40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:49.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb37fe700 1 --2- 172.21.15.84:0/2092121095 >> v2:172.21.15.131:3300/0 conn(0x7f4eb40cbae0 0x7f4eb40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344813789 0 0) 0x7f4eb40cbf00 con 0x7f4eb41598e0 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ea0003570 con 0x7f4eb41598e0 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 271953985 0 0) 0x7f4ea0003570 con 0x7f4eb41598e0 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb4159510 msgr2=0x7f4eb40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb4159510 0x7f4eb40cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 >> v2:172.21.15.131:3300/0 conn(0x7f4eb40cbae0 msgr2=0x7f4eb40cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 --2- 172.21.15.84:0/2092121095 >> v2:172.21.15.131:3300/0 conn(0x7f4eb40cbae0 0x7f4eb40cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40cfbd0 con 0x7f4eb41598e0 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f4e9c001470 con 0x7f4eb41598e0 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 >> v1:172.21.15.84:6789/0 conn(0x7f4eb41598e0 legacy=0x7f4eb40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:49.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 0x7f4ea0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea0004810 0x7f4ea0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb4159510 0x7f4ea00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40cf610 con 0x7f4ea0003a60 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40cf8f0 con 0x7f4ea0004810 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea000ba60 con 0x7f4eb4159510 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb2ffd700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 0x7f4ea0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eaa7fc700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea0004810 0x7f4ea0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb37fe700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb4159510 0x7f4ea00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb2ffd700 1 -- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb4159510 msgr2=0x7f4ea00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb2ffd700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb4159510 0x7f4ea00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb2ffd700 1 -- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea0004810 msgr2=0x7f4ea0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:49.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.680+0000 7f4eb2ffd700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea0004810 0x7f4ea0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb2ffd700 1 -- 172.21.15.84:0/2092121095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea0003570 con 0x7f4ea0003a60 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb2ffd700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 0x7f4ea0003e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4009c30 tx=0x7f4ea40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c252aba479c3858 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400e710 con 0x7f4ea0003a60 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400e870 con 0x7f4ea0003a60 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb27fc700 1 -- 172.21.15.84:0/2092121095 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400ec30 con 0x7f4ea0003a60 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb99b9700 1 -- 172.21.15.84:0/2092121095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 msgr2=0x7f4ea0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb99b9700 1 --2- 172.21.15.84:0/2092121095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 0x7f4ea0003e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4009c30 tx=0x7f4ea40091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb37fe700 1 -- 172.21.15.84:0/2092121095 reap_dead start 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb99b9700 1 -- 172.21.15.84:0/2092121095 shutdown_connections 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb99b9700 1 -- 172.21.15.84:0/2092121095 >> 172.21.15.84:0/2092121095 conn(0x7f4eb4089e90 msgr2=0x7f4eb40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb99b9700 1 -- 172.21.15.84:0/2092121095 shutdown_connections 2023-10-06T03:23:49.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.681+0000 7f4eb99b9700 1 -- 172.21.15.84:0/2092121095 wait complete. 2023-10-06T03:23:49.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb99b9700 1 Processor -- start 2023-10-06T03:23:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb99b9700 1 -- start start 2023-10-06T03:23:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb99b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 0x7f4eb41587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb99b9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4eb40c9cd0 0x7f4eb40ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb99b9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb416d720 0x7f4eb416db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb99b9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb416e0d0 con 0x7f4ea0003a60 2023-10-06T03:23:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb99b9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40c76a0 con 0x7f4eb40c9cd0 2023-10-06T03:23:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb99b9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40c7980 con 0x7f4eb416d720 2023-10-06T03:23:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 0x7f4eb41587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 0x7f4eb41587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34672/0 (socket says 172.21.15.84:34672) 2023-10-06T03:23:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.683+0000 7f4eb2ffd700 1 -- 172.21.15.84:0/4119451345 learned_addr learned my addr 172.21.15.84:0/4119451345 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eb2ffd700 1 -- 172.21.15.84:0/4119451345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb416d720 msgr2=0x7f4eb416db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eb37fe700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb416d720 0x7f4eb416db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eaa7fc700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4eb40c9cd0 0x7f4eb40ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eb2ffd700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb416d720 0x7f4eb416db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eb2ffd700 1 -- 172.21.15.84:0/4119451345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4eb40c9cd0 msgr2=0x7f4eb40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eb2ffd700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4eb40c9cd0 0x7f4eb40ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eb2ffd700 1 -- 172.21.15.84:0/4119451345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40c7c60 con 0x7f4ea0003a60 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eb2ffd700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 0x7f4eb41587b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00046d0 tx=0x7f4ea401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eab7fe700 1 -- 172.21.15.84:0/4119451345 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4022070 con 0x7f4ea0003a60 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eab7fe700 1 -- 172.21.15.84:0/4119451345 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400e9e0 con 0x7f4ea0003a60 2023-10-06T03:23:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eab7fe700 1 -- 172.21.15.84:0/4119451345 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea401c450 con 0x7f4ea0003a60 2023-10-06T03:23:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eb99b9700 1 -- 172.21.15.84:0/4119451345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb40c7f40 con 0x7f4ea0003a60 2023-10-06T03:23:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.684+0000 7f4eb99b9700 1 -- 172.21.15.84:0/4119451345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb40b6070 con 0x7f4ea0003a60 2023-10-06T03:23:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.685+0000 7f4eb99b9700 1 -- 172.21.15.84:0/4119451345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb40c83e0 con 0x7f4ea0003a60 2023-10-06T03:23:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.685+0000 7f4eab7fe700 1 -- 172.21.15.84:0/4119451345 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ea401c880 con 0x7f4ea0003a60 2023-10-06T03:23:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.686+0000 7f4eab7fe700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4e94066f30 0x7f4e940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.686+0000 7f4eab7fe700 1 -- 172.21.15.84:0/4119451345 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f4ea4085e40 con 0x7f4ea0003a60 2023-10-06T03:23:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.686+0000 7f4eaa7fc700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4e94066f30 0x7f4e940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.686+0000 7f4eaa7fc700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4e94066f30 0x7f4e940693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40b5860 tx=0x7f4e9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:49.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.690+0000 7f4eab7fe700 1 -- 172.21.15.84:0/4119451345 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ea4052fb0 con 0x7f4ea0003a60 2023-10-06T03:23:49.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:49.915+0000 7f4eb99b9700 1 -- 172.21.15.84:0/4119451345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4eb40c8590 con 0x7f4ea0003a60 2023-10-06T03:23:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.531+0000 7f4eab7fe700 1 -- 172.21.15.84:0/4119451345 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4ea402b0c0 con 0x7f4ea0003a60 2023-10-06T03:23:50.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.536+0000 7f4eb99b9700 1 -- 172.21.15.84:0/4119451345 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4e94066f30 msgr2=0x7f4e940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:50.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.536+0000 7f4eb99b9700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4e94066f30 0x7f4e940693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40b5860 tx=0x7f4e9c009040 comp rx=0 tx=0).stop 2023-10-06T03:23:50.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.536+0000 7f4eb99b9700 1 -- 172.21.15.84:0/4119451345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 msgr2=0x7f4eb41587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:50.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.536+0000 7f4eb99b9700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 0x7f4eb41587b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00046d0 tx=0x7f4ea401a000 comp rx=0 tx=0).stop 2023-10-06T03:23:50.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.537+0000 7f4eb99b9700 1 -- 172.21.15.84:0/4119451345 shutdown_connections 2023-10-06T03:23:50.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.537+0000 7f4eb99b9700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4e94066f30 0x7f4e940693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:50.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.537+0000 7f4eb99b9700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4eb416d720 0x7f4eb416db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:50.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.537+0000 7f4eb99b9700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ea0003a60 0x7f4eb41587b0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00046d0 tx=0x7f4ea401a000 comp rx=0 tx=0).stop 2023-10-06T03:23:50.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.537+0000 7f4eb99b9700 1 --2- 172.21.15.84:0/4119451345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4eb40c9cd0 0x7f4eb40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:50.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.537+0000 7f4eb99b9700 1 -- 172.21.15.84:0/4119451345 >> 172.21.15.84:0/4119451345 conn(0x7f4eb4089e90 msgr2=0x7f4eb4068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:50.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.541+0000 7f4eb99b9700 1 -- 172.21.15.84:0/4119451345 shutdown_connections 2023-10-06T03:23:50.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.545+0000 7f4eb99b9700 1 -- 172.21.15.84:0/4119451345 wait complete. 2023-10-06T03:23:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T03:23:50.568 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T03:23:50.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T03:23:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.685+0000 7eff79194700 1 Processor -- start 2023-10-06T03:23:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.685+0000 7eff79194700 1 -- start start 2023-10-06T03:23:50.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff79194700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cb80 0x7eff740ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:50.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff79194700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7eff7415cf50 0x7eff740cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:50.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff79194700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff740ccce0 0x7eff740cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:50.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff79194700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff740cd6a0 con 0x7eff740ccce0 2023-10-06T03:23:50.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff79194700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff740c8970 con 0x7eff7415cf50 2023-10-06T03:23:50.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff79194700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff740c8f30 con 0x7eff7415cb80 2023-10-06T03:23:50.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff7359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff740ccce0 0x7eff740cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:50.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff7359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff740ccce0 0x7eff740cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51170/0 (socket says 172.21.15.84:51170) 2023-10-06T03:23:50.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff7359e700 1 -- 172.21.15.84:0/1481650106 learned_addr learned my addr 172.21.15.84:0/1481650106 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:50.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff6a59c700 1 --2- 172.21.15.84:0/1481650106 >> v2:172.21.15.131:3300/0 conn(0x7eff7415cf50 0x7eff740cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:50.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff72d9d700 1 --2- 172.21.15.84:0/1481650106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cb80 0x7eff740ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:50.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff7359e700 1 -- 172.21.15.84:0/1481650106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cb80 msgr2=0x7eff740ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:50.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff7359e700 1 --2- 172.21.15.84:0/1481650106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cb80 0x7eff740ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:50.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff7359e700 1 -- 172.21.15.84:0/1481650106 >> v2:172.21.15.131:3300/0 conn(0x7eff7415cf50 msgr2=0x7eff740cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:50.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff7359e700 1 --2- 172.21.15.84:0/1481650106 >> v2:172.21.15.131:3300/0 conn(0x7eff7415cf50 0x7eff740cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:50.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.686+0000 7eff7359e700 1 -- 172.21.15.84:0/1481650106 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff740cf290 con 0x7eff740ccce0 2023-10-06T03:23:50.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff7359e700 1 --2- 172.21.15.84:0/1481650106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 0x7eff740cd160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7eff7406f370 tx=0x7eff6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15b820417ff6add server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:50.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff7259c700 1 -- 172.21.15.84:0/1481650106 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00e070 con 0x7eff740ccce0 2023-10-06T03:23:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff7259c700 1 -- 172.21.15.84:0/1481650106 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c00b970 con 0x7eff740ccce0 2023-10-06T03:23:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff7259c700 1 -- 172.21.15.84:0/1481650106 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0092e0 con 0x7eff740ccce0 2023-10-06T03:23:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff79194700 1 -- 172.21.15.84:0/1481650106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 msgr2=0x7eff740cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff79194700 1 --2- 172.21.15.84:0/1481650106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 0x7eff740cd160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7eff7406f370 tx=0x7eff6c009840 comp rx=0 tx=0).stop 2023-10-06T03:23:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff79194700 1 -- 172.21.15.84:0/1481650106 shutdown_connections 2023-10-06T03:23:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff79194700 1 --2- 172.21.15.84:0/1481650106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 0x7eff740cd160 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff79194700 1 --2- 172.21.15.84:0/1481650106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cb80 0x7eff740ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff79194700 1 --2- 172.21.15.84:0/1481650106 >> v2:172.21.15.131:3300/0 conn(0x7eff7415cf50 0x7eff740cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:50.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff79194700 1 -- 172.21.15.84:0/1481650106 >> 172.21.15.84:0/1481650106 conn(0x7eff74088000 msgr2=0x7eff740ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:50.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff79194700 1 -- 172.21.15.84:0/1481650106 shutdown_connections 2023-10-06T03:23:50.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.687+0000 7eff79194700 1 -- 172.21.15.84:0/1481650106 wait complete. 2023-10-06T03:23:50.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.688+0000 7eff79194700 1 Processor -- start 2023-10-06T03:23:50.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff79194700 1 -- start start 2023-10-06T03:23:50.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff79194700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 0x7eff740c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff79194700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7415cb80 0x7eff7415f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff79194700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cf50 0x7eff7415fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff79194700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff740c63d0 con 0x7eff740ccce0 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff79194700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff740c66b0 con 0x7eff7415cb80 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff79194700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff740c6990 con 0x7eff7415cf50 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff72d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 0x7eff740c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff72d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 0x7eff740c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51176/0 (socket says 172.21.15.84:51176) 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff72d9d700 1 -- 172.21.15.84:0/1704155261 learned_addr learned my addr 172.21.15.84:0/1704155261 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.689+0000 7eff7359e700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cf50 0x7eff7415fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff72d9d700 1 -- 172.21.15.84:0/1704155261 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cf50 msgr2=0x7eff7415fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff72d9d700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cf50 0x7eff7415fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff6a59c700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7415cb80 0x7eff7415f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff72d9d700 1 -- 172.21.15.84:0/1704155261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7415cb80 msgr2=0x7eff7415f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff72d9d700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7415cb80 0x7eff7415f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff72d9d700 1 -- 172.21.15.84:0/1704155261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c009ae0 con 0x7eff740ccce0 2023-10-06T03:23:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff7359e700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cf50 0x7eff7415fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff72d9d700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 0x7eff740c5df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff6400ea00 tx=0x7eff64009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff6b7fe700 1 -- 172.21.15.84:0/1704155261 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6400c8e0 con 0x7eff740ccce0 2023-10-06T03:23:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff6b7fe700 1 -- 172.21.15.84:0/1704155261 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6400ca40 con 0x7eff740ccce0 2023-10-06T03:23:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff79194700 1 -- 172.21.15.84:0/1704155261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff740c6c70 con 0x7eff740ccce0 2023-10-06T03:23:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff6b7fe700 1 -- 172.21.15.84:0/1704155261 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6400cdc0 con 0x7eff740ccce0 2023-10-06T03:23:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.690+0000 7eff79194700 1 -- 172.21.15.84:0/1704155261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7415ff50 con 0x7eff740ccce0 2023-10-06T03:23:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.691+0000 7eff79194700 1 -- 172.21.15.84:0/1704155261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff740b23f0 con 0x7eff740ccce0 2023-10-06T03:23:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.691+0000 7eff6b7fe700 1 -- 172.21.15.84:0/1704155261 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff64013680 con 0x7eff740ccce0 2023-10-06T03:23:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.691+0000 7eff6b7fe700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 0x7eff540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:50.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.692+0000 7eff6b7fe700 1 -- 172.21.15.84:0/1704155261 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff64084dd0 con 0x7eff740ccce0 2023-10-06T03:23:50.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.692+0000 7eff6a59c700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 0x7eff540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:50.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.692+0000 7eff6a59c700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 0x7eff540693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0093f0 tx=0x7eff5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:50.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.696+0000 7eff6b7fe700 1 -- 172.21.15.84:0/1704155261 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff740b23f0 con 0x7eff740ccce0 2023-10-06T03:23:50.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:50.887+0000 7eff79194700 1 -- 172.21.15.84:0/1704155261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7eff740b23f0 con 0x7eff740ccce0 2023-10-06T03:23:51.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.545+0000 7eff6b7fe700 1 -- 172.21.15.84:0/1704155261 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7eff740b23f0 con 0x7eff740ccce0 2023-10-06T03:23:51.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 -- 172.21.15.84:0/1704155261 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 msgr2=0x7eff540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 0x7eff540693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0093f0 tx=0x7eff5c008040 comp rx=0 tx=0).stop 2023-10-06T03:23:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 -- 172.21.15.84:0/1704155261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 msgr2=0x7eff740c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 0x7eff740c5df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff6400ea00 tx=0x7eff64009120 comp rx=0 tx=0).stop 2023-10-06T03:23:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 -- 172.21.15.84:0/1704155261 shutdown_connections 2023-10-06T03:23:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 0x7eff540693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff7415cf50 0x7eff7415fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff740ccce0 0x7eff740c5df0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 --2- 172.21.15.84:0/1704155261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7415cb80 0x7eff7415f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 -- 172.21.15.84:0/1704155261 >> 172.21.15.84:0/1704155261 conn(0x7eff74088000 msgr2=0x7eff740ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 -- 172.21.15.84:0/1704155261 shutdown_connections 2023-10-06T03:23:51.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.548+0000 7eff79194700 1 -- 172.21.15.84:0/1704155261 wait complete. 2023-10-06T03:23:51.562 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:23:51.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.685+0000 7f26cb59e700 1 Processor -- start 2023-10-06T03:23:51.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.685+0000 7f26cb59e700 1 -- start start 2023-10-06T03:23:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26cb59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26cc0b2660 0x7f26cc0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26cb59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26cc0cf1f0 0x7f26cc0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26cb59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0cc9b0 con 0x7f26cc0b2a30 2023-10-06T03:23:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26cb59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0cbda0 con 0x7f26cc0b2660 2023-10-06T03:23:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26cb59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0cc080 con 0x7f26cc0cf1f0 2023-10-06T03:23:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26ca59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26cc0b2660 0x7f26cc0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26ca59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26cc0b2660 0x7f26cc0cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51186/0 (socket says 172.21.15.84:51186) 2023-10-06T03:23:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26ca59c700 1 -- 172.21.15.84:0/2943346856 learned_addr learned my addr 172.21.15.84:0/2943346856 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26ca59c700 1 -- 172.21.15.84:0/2943346856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26cc0cf1f0 msgr2=0x7f26cc0cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26ca59c700 1 --2- 172.21.15.84:0/2943346856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26cc0cf1f0 0x7f26cc0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26ca59c700 1 -- 172.21.15.84:0/2943346856 >> v1:172.21.15.131:6789/0 conn(0x7f26cc0b2a30 legacy=0x7f26cc0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26ca59c700 1 -- 172.21.15.84:0/2943346856 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0cc360 con 0x7f26cc0b2660 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26ca59c700 1 --2- 172.21.15.84:0/2943346856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2660 0x7f26cc0cccf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009f70 tx=0x7f26c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1055d4a0a4a1817 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26c959a700 1 -- 172.21.15.84:0/2943346856 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c400e070 con 0x7f26cc0b2660 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26c959a700 1 -- 172.21.15.84:0/2943346856 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c400ba90 con 0x7f26cc0b2660 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.686+0000 7f26c959a700 1 -- 172.21.15.84:0/2943346856 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40092e0 con 0x7f26cc0b2660 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.687+0000 7f26cb59e700 1 -- 172.21.15.84:0/2943346856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2660 msgr2=0x7f26cc0cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.687+0000 7f26cb59e700 1 --2- 172.21.15.84:0/2943346856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2660 0x7f26cc0cccf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009f70 tx=0x7f26c4009840 comp rx=0 tx=0).stop 2023-10-06T03:23:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.687+0000 7f26cb59e700 1 -- 172.21.15.84:0/2943346856 shutdown_connections 2023-10-06T03:23:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.687+0000 7f26cb59e700 1 --2- 172.21.15.84:0/2943346856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26cc0cf1f0 0x7f26cc0cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.687+0000 7f26cb59e700 1 --2- 172.21.15.84:0/2943346856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2660 0x7f26cc0cccf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.687+0000 7f26cb59e700 1 -- 172.21.15.84:0/2943346856 >> 172.21.15.84:0/2943346856 conn(0x7f26cc099560 msgr2=0x7f26cc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.687+0000 7f26cb59e700 1 -- 172.21.15.84:0/2943346856 shutdown_connections 2023-10-06T03:23:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.687+0000 7f26cb59e700 1 -- 172.21.15.84:0/2943346856 wait complete. 2023-10-06T03:23:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.688+0000 7f26cb59e700 1 Processor -- start 2023-10-06T03:23:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.688+0000 7f26cb59e700 1 -- start start 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26cb59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26cc0b2660 0x7f26cc16dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26cb59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2a30 0x7f26cc15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26cb59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26cc0cf1f0 0x7f26cc15d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26cb59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc16d950 con 0x7f26cc0b2a30 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26cb59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc15b6c0 con 0x7f26cc0b2660 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26cb59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc15b9a0 con 0x7f26cc0cf1f0 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2a30 0x7f26cc15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2a30 0x7f26cc15adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51198/0 (socket says 172.21.15.84:51198) 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c9d9b700 1 -- 172.21.15.84:0/2417074969 learned_addr learned my addr 172.21.15.84:0/2417074969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26cad9d700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26cc0cf1f0 0x7f26cc15d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26ca59c700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26cc0b2660 0x7f26cc16dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c9d9b700 1 -- 172.21.15.84:0/2417074969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26cc0cf1f0 msgr2=0x7f26cc15d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c9d9b700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26cc0cf1f0 0x7f26cc15d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c9d9b700 1 -- 172.21.15.84:0/2417074969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26cc0b2660 msgr2=0x7f26cc16dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c9d9b700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26cc0b2660 0x7f26cc16dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c9d9b700 1 -- 172.21.15.84:0/2417074969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c4009ae0 con 0x7f26cc0b2a30 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26ca59c700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26cc0b2660 0x7f26cc16dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c9d9b700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2a30 0x7f26cc15adc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26b400b7e0 tx=0x7f26b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c27fc700 1 -- 172.21.15.84:0/2417074969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b400f510 con 0x7f26cc0b2a30 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c27fc700 1 -- 172.21.15.84:0/2417074969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b400f670 con 0x7f26cc0b2a30 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26cb59e700 1 -- 172.21.15.84:0/2417074969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc16d300 con 0x7f26cc0b2a30 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.689+0000 7f26c27fc700 1 -- 172.21.15.84:0/2417074969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b400fa10 con 0x7f26cc0b2a30 2023-10-06T03:23:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.690+0000 7f26cb59e700 1 -- 172.21.15.84:0/2417074969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc15b300 con 0x7f26cc0b2a30 2023-10-06T03:23:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.690+0000 7f26cb59e700 1 -- 172.21.15.84:0/2417074969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc05f270 con 0x7f26cc0b2a30 2023-10-06T03:23:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.691+0000 7f26c27fc700 1 -- 172.21.15.84:0/2417074969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26b401a400 con 0x7f26cc0b2a30 2023-10-06T03:23:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.691+0000 7f26c27fc700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f26ac066f30 0x7f26ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.691+0000 7f26c27fc700 1 -- 172.21.15.84:0/2417074969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f26b40842e0 con 0x7f26cc0b2a30 2023-10-06T03:23:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.691+0000 7f26ca59c700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f26ac066f30 0x7f26ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.691+0000 7f26ca59c700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f26ac066f30 0x7f26ac0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009880 tx=0x7f26c4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.695+0000 7f26c27fc700 1 -- 172.21.15.84:0/2417074969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26b4051390 con 0x7f26cc0b2a30 2023-10-06T03:23:51.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:51.876+0000 7f26cb59e700 1 -- 172.21.15.84:0/2417074969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f26cc16da90 con 0x7f26cc0b2a30 2023-10-06T03:23:53.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.552+0000 7f26c27fc700 1 -- 172.21.15.84:0/2417074969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f26b40549b0 con 0x7f26cc0b2a30 2023-10-06T03:23:53.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.559+0000 7f26cb59e700 1 -- 172.21.15.84:0/2417074969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f26ac066f30 msgr2=0x7f26ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:53.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.559+0000 7f26cb59e700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f26ac066f30 0x7f26ac0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009880 tx=0x7f26c4017000 comp rx=0 tx=0).stop 2023-10-06T03:23:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.559+0000 7f26cb59e700 1 -- 172.21.15.84:0/2417074969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2a30 msgr2=0x7f26cc15adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.559+0000 7f26cb59e700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2a30 0x7f26cc15adc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26b400b7e0 tx=0x7f26b40091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.560+0000 7f26cb59e700 1 -- 172.21.15.84:0/2417074969 shutdown_connections 2023-10-06T03:23:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.560+0000 7f26cb59e700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f26ac066f30 0x7f26ac0693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.560+0000 7f26cb59e700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26cc0b2660 0x7f26cc16dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.560+0000 7f26cb59e700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26cc0cf1f0 0x7f26cc15d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.560+0000 7f26cb59e700 1 --2- 172.21.15.84:0/2417074969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26cc0b2a30 0x7f26cc15adc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.560+0000 7f26cb59e700 1 -- 172.21.15.84:0/2417074969 >> 172.21.15.84:0/2417074969 conn(0x7f26cc099560 msgr2=0x7f26cc0ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:53.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.560+0000 7f26cb59e700 1 -- 172.21.15.84:0/2417074969 shutdown_connections 2023-10-06T03:23:53.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.560+0000 7f26cb59e700 1 -- 172.21.15.84:0/2417074969 wait complete. 2023-10-06T03:23:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' created 2023-10-06T03:23:53.579 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T03:23:53.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.700+0000 7f2d56889700 1 Processor -- start 2023-10-06T03:23:53.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.700+0000 7f2d56889700 1 -- start start 2023-10-06T03:23:53.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.701+0000 7f2d56889700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d5006ed20 0x7f2d500b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:53.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.701+0000 7f2d56889700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d500b2d20 con 0x7f2d500aee20 2023-10-06T03:23:53.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.701+0000 7f2d56889700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d500b0450 con 0x7f2d5006f0f0 2023-10-06T03:23:53.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.701+0000 7f2d56889700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5006fb80 con 0x7f2d5006ed20 2023-10-06T03:23:53.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.701+0000 7f2d54e26700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2d500aee20 0x7f2d500af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:60800/0 (socket says 172.21.15.84:60800) 2023-10-06T03:23:53.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.701+0000 7f2d54e26700 1 -- 172.21.15.84:0/2916921116 learned_addr learned my addr 172.21.15.84:0/2916921116 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.701+0000 7f2d4ffff700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d5006ed20 0x7f2d500b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.701+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273388920 0 0) 0x7f2d500b2d20 con 0x7f2d500aee20 2023-10-06T03:23:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d38003570 con 0x7f2d500aee20 2023-10-06T03:23:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497180913 0 0) 0x7f2d500b0450 con 0x7f2d5006f0f0 2023-10-06T03:23:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d500b2d20 con 0x7f2d5006f0f0 2023-10-06T03:23:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2454683631 0 0) 0x7f2d38003570 con 0x7f2d500aee20 2023-10-06T03:23:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d5006ed20 msgr2=0x7f2d500b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d5006ed20 0x7f2d500b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 >> v1:172.21.15.131:6789/0 conn(0x7f2d5006f0f0 legacy=0x7f2d500b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500b2a40 con 0x7f2d500aee20 2023-10-06T03:23:53.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f2d480017f0 con 0x7f2d500aee20 2023-10-06T03:23:53.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 >> v1:172.21.15.84:6789/0 conn(0x7f2d500aee20 legacy=0x7f2d500af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:53.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d5006ed20 0x7f2d38003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:53.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d38004180 0x7f2d38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:53.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d38004d50 0x7f2d380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:53.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3800bb70 con 0x7f2d38004180 2023-10-06T03:23:53.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3800bce0 con 0x7f2d38004d50 2023-10-06T03:23:53.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3800bea0 con 0x7f2d5006ed20 2023-10-06T03:23:53.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4f7fe700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d38004180 0x7f2d38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:53.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4ffff700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d5006ed20 0x7f2d38003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d54e26700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d38004d50 0x7f2d380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4f7fe700 1 -- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d5006ed20 msgr2=0x7f2d38003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4f7fe700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d5006ed20 0x7f2d38003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4f7fe700 1 -- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d38004d50 msgr2=0x7f2d380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4f7fe700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d38004d50 0x7f2d380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4f7fe700 1 -- 172.21.15.84:0/2916921116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d38003570 con 0x7f2d38004180 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.702+0000 7f2d4f7fe700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d38004180 0x7f2d38004810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2d44001a10 tx=0x7f2d44007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd04f9582f0b2c29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.703+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400c5d0 con 0x7f2d38004180 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.703+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4400c730 con 0x7f2d38004180 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.703+0000 7f2d4effd700 1 -- 172.21.15.84:0/2916921116 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400cad0 con 0x7f2d38004180 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.703+0000 7f2d56889700 1 -- 172.21.15.84:0/2916921116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d38004180 msgr2=0x7f2d38004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:53.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.703+0000 7f2d56889700 1 --2- 172.21.15.84:0/2916921116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d38004180 0x7f2d38004810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2d44001a10 tx=0x7f2d44007d30 comp rx=0 tx=0).stop 2023-10-06T03:23:53.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.703+0000 7f2d54e26700 1 -- 172.21.15.84:0/2916921116 reap_dead start 2023-10-06T03:23:53.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.703+0000 7f2d56889700 1 -- 172.21.15.84:0/2916921116 shutdown_connections 2023-10-06T03:23:53.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.703+0000 7f2d56889700 1 -- 172.21.15.84:0/2916921116 >> 172.21.15.84:0/2916921116 conn(0x7f2d50068330 msgr2=0x7f2d50068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:53.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.703+0000 7f2d56889700 1 -- 172.21.15.84:0/2916921116 shutdown_connections 2023-10-06T03:23:53.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.703+0000 7f2d56889700 1 -- 172.21.15.84:0/2916921116 wait complete. 2023-10-06T03:23:53.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.704+0000 7f2d56889700 1 Processor -- start 2023-10-06T03:23:53.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.704+0000 7f2d56889700 1 -- start start 2023-10-06T03:23:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d56889700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d38004180 0x7f2d5015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d56889700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d50154be0 0x7f2d500c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d56889700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d500c7020 0x7f2d501695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d56889700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5015aea0 con 0x7f2d500c7020 2023-10-06T03:23:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d56889700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5016a490 con 0x7f2d50154be0 2023-10-06T03:23:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d56889700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5015a290 con 0x7f2d38004180 2023-10-06T03:23:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d54e26700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d500c7020 0x7f2d501695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d54e26700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d500c7020 0x7f2d501695f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51216/0 (socket says 172.21.15.84:51216) 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d54e26700 1 -- 172.21.15.84:0/2430825358 learned_addr learned my addr 172.21.15.84:0/2430825358 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d4ffff700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d38004180 0x7f2d5015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d4f7fe700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d50154be0 0x7f2d500c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d54e26700 1 -- 172.21.15.84:0/2430825358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d38004180 msgr2=0x7f2d5015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d54e26700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d38004180 0x7f2d5015b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d54e26700 1 -- 172.21.15.84:0/2430825358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d50154be0 msgr2=0x7f2d500c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.705+0000 7f2d54e26700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d50154be0 0x7f2d500c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.706+0000 7f2d54e26700 1 -- 172.21.15.84:0/2430825358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5015a570 con 0x7f2d500c7020 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.706+0000 7f2d54e26700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d500c7020 0x7f2d501695f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d48000f80 tx=0x7f2d48002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.706+0000 7f2d37fff700 1 -- 172.21.15.84:0/2430825358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4800ac90 con 0x7f2d500c7020 2023-10-06T03:23:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.706+0000 7f2d37fff700 1 -- 172.21.15.84:0/2430825358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4800adf0 con 0x7f2d500c7020 2023-10-06T03:23:53.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.706+0000 7f2d56889700 1 -- 172.21.15.84:0/2430825358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5015a850 con 0x7f2d500c7020 2023-10-06T03:23:53.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.706+0000 7f2d37fff700 1 -- 172.21.15.84:0/2430825358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48013640 con 0x7f2d500c7020 2023-10-06T03:23:53.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.706+0000 7f2d56889700 1 -- 172.21.15.84:0/2430825358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d50159f40 con 0x7f2d500c7020 2023-10-06T03:23:53.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.707+0000 7f2d56889700 1 -- 172.21.15.84:0/2430825358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5015b050 con 0x7f2d500c7020 2023-10-06T03:23:53.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.707+0000 7f2d37fff700 1 -- 172.21.15.84:0/2430825358 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d48013a30 con 0x7f2d500c7020 2023-10-06T03:23:53.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.708+0000 7f2d37fff700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d3c066f30 0x7f2d3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:53.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.708+0000 7f2d37fff700 1 -- 172.21.15.84:0/2430825358 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f2d48085150 con 0x7f2d500c7020 2023-10-06T03:23:53.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.708+0000 7f2d4ffff700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d3c066f30 0x7f2d3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:53.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.708+0000 7f2d4ffff700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d3c066f30 0x7f2d3c0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d40006f00 tx=0x7f2d400091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:53.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.712+0000 7f2d37fff700 1 -- 172.21.15.84:0/2430825358 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d5015b050 con 0x7f2d500c7020 2023-10-06T03:23:53.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:53.892+0000 7f2d56889700 1 -- 172.21.15.84:0/2430825358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f2d50064ad0 con 0x7f2d500c7020 2023-10-06T03:23:54.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.558+0000 7f2d37fff700 1 -- 172.21.15.84:0/2430825358 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2d48055a20 con 0x7f2d500c7020 2023-10-06T03:23:54.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.566+0000 7f2d56889700 1 -- 172.21.15.84:0/2430825358 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d3c066f30 msgr2=0x7f2d3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.566+0000 7f2d56889700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d3c066f30 0x7f2d3c0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d40006f00 tx=0x7f2d400091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.566+0000 7f2d56889700 1 -- 172.21.15.84:0/2430825358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d500c7020 msgr2=0x7f2d501695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.566+0000 7f2d56889700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d500c7020 0x7f2d501695f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d48000f80 tx=0x7f2d48002170 comp rx=0 tx=0).stop 2023-10-06T03:23:54.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.569+0000 7f2d56889700 1 -- 172.21.15.84:0/2430825358 shutdown_connections 2023-10-06T03:23:54.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.569+0000 7f2d56889700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d3c066f30 0x7f2d3c0693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.569+0000 7f2d56889700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d500c7020 0x7f2d501695f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.569+0000 7f2d56889700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d38004180 0x7f2d5015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.569+0000 7f2d56889700 1 --2- 172.21.15.84:0/2430825358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d50154be0 0x7f2d500c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.569+0000 7f2d56889700 1 -- 172.21.15.84:0/2430825358 >> 172.21.15.84:0/2430825358 conn(0x7f2d50068330 msgr2=0x7f2d500cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:54.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.573+0000 7f2d56889700 1 -- 172.21.15.84:0/2430825358 shutdown_connections 2023-10-06T03:23:54.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.579+0000 7f2d56889700 1 -- 172.21.15.84:0/2430825358 wait complete. 2023-10-06T03:23:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T03:23:54.599 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T03:23:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.719+0000 7f524363b700 1 Processor -- start 2023-10-06T03:23:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.719+0000 7f524363b700 1 -- start start 2023-10-06T03:23:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f524363b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f523c0cbb50 0x7f523c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f524363b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c0b2e60 con 0x7f523c0c6610 2023-10-06T03:23:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f524363b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c0cf5d0 con 0x7f523c0b2a90 2023-10-06T03:23:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f524363b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c0cf8b0 con 0x7f523c0cbb50 2023-10-06T03:23:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f5240bd6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f523c0cbb50 0x7f523c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f5240bd6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f523c0cbb50 0x7f523c0ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51232/0 (socket says 172.21.15.84:51232) 2023-10-06T03:23:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f5240bd6700 1 -- 172.21.15.84:0/1195808499 learned_addr learned my addr 172.21.15.84:0/1195808499 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f5240bd6700 1 -- 172.21.15.84:0/1195808499 >> v1:172.21.15.131:6789/0 conn(0x7f523c0b2a90 legacy=0x7f523c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f5240bd6700 1 -- 172.21.15.84:0/1195808499 >> v1:172.21.15.84:6789/0 conn(0x7f523c0c6610 legacy=0x7f523c0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f5240bd6700 1 -- 172.21.15.84:0/1195808499 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c0cfb90 con 0x7f523c0cbb50 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f523bfff700 1 -- 172.21.15.84:0/1195808499 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019610300 0 0) 0x7f523c0b2e60 con 0x7f523c0c6610 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f5240bd6700 1 --2- 172.21.15.84:0/1195808499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0cbb50 0x7f523c0ce850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f52280099b0 tx=0x7f5228009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f48a48817327f3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f523bfff700 1 -- 172.21.15.84:0/1195808499 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800b860 con 0x7f523c0cbb50 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f523bfff700 1 -- 172.21.15.84:0/1195808499 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800b9c0 con 0x7f523c0cbb50 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.720+0000 7f523bfff700 1 -- 172.21.15.84:0/1195808499 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800bd80 con 0x7f523c0cbb50 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.721+0000 7f524363b700 1 -- 172.21.15.84:0/1195808499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0cbb50 msgr2=0x7f523c0ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.721+0000 7f524363b700 1 --2- 172.21.15.84:0/1195808499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0cbb50 0x7f523c0ce850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f52280099b0 tx=0x7f5228009250 comp rx=0 tx=0).stop 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.721+0000 7f524363b700 1 -- 172.21.15.84:0/1195808499 shutdown_connections 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.721+0000 7f524363b700 1 --2- 172.21.15.84:0/1195808499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0cbb50 0x7f523c0ce850 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.721+0000 7f524363b700 1 -- 172.21.15.84:0/1195808499 >> 172.21.15.84:0/1195808499 conn(0x7f523c099740 msgr2=0x7f523c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.721+0000 7f524363b700 1 -- 172.21.15.84:0/1195808499 shutdown_connections 2023-10-06T03:23:54.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.721+0000 7f524363b700 1 -- 172.21.15.84:0/1195808499 wait complete. 2023-10-06T03:23:54.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.722+0000 7f524363b700 1 Processor -- start 2023-10-06T03:23:54.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.722+0000 7f524363b700 1 -- start start 2023-10-06T03:23:54.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f524363b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0b2a90 0x7f523c09c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f524363b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c0c6610 0x7f523c148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f524363b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0cbb50 0x7f523c1494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f524363b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c09cef0 con 0x7f523c0b2a90 2023-10-06T03:23:54.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f524363b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c09d1d0 con 0x7f523c0cbb50 2023-10-06T03:23:54.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f524363b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c09d4b0 con 0x7f523c0c6610 2023-10-06T03:23:54.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f52413d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0b2a90 0x7f523c09c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f52413d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0b2a90 0x7f523c09c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51234/0 (socket says 172.21.15.84:51234) 2023-10-06T03:23:54.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f52413d7700 1 -- 172.21.15.84:0/1415714476 learned_addr learned my addr 172.21.15.84:0/1415714476 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:54.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f5241bd8700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0cbb50 0x7f523c1494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f5240bd6700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c0c6610 0x7f523c148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f52413d7700 1 -- 172.21.15.84:0/1415714476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c0c6610 msgr2=0x7f523c148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f52413d7700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c0c6610 0x7f523c148f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f52413d7700 1 -- 172.21.15.84:0/1415714476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0cbb50 msgr2=0x7f523c1494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f52413d7700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0cbb50 0x7f523c1494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f52413d7700 1 -- 172.21.15.84:0/1415714476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280094f0 con 0x7f523c0b2a90 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.723+0000 7f5241bd8700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0cbb50 0x7f523c1494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.724+0000 7f52413d7700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0b2a90 0x7f523c09c430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f523000c7c0 tx=0x7f5230007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.724+0000 7f52397fa700 1 -- 172.21.15.84:0/1415714476 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230012630 con 0x7f523c0b2a90 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.724+0000 7f52397fa700 1 -- 172.21.15.84:0/1415714476 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52300127b0 con 0x7f523c0b2a90 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.724+0000 7f52397fa700 1 -- 172.21.15.84:0/1415714476 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230012b70 con 0x7f523c0b2a90 2023-10-06T03:23:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.724+0000 7f524363b700 1 -- 172.21.15.84:0/1415714476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c09d790 con 0x7f523c0b2a90 2023-10-06T03:23:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.724+0000 7f524363b700 1 -- 172.21.15.84:0/1415714476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c1591e0 con 0x7f523c0b2a90 2023-10-06T03:23:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.725+0000 7f524363b700 1 -- 172.21.15.84:0/1415714476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c09dc30 con 0x7f523c0b2a90 2023-10-06T03:23:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.725+0000 7f52397fa700 1 -- 172.21.15.84:0/1415714476 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f523001b400 con 0x7f523c0b2a90 2023-10-06T03:23:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.725+0000 7f52397fa700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5220066f30 0x7f52200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.726+0000 7f5240bd6700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5220066f30 0x7f52200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.726+0000 7f52397fa700 1 -- 172.21.15.84:0/1415714476 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f52300844c0 con 0x7f523c0b2a90 2023-10-06T03:23:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.726+0000 7f5240bd6700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5220066f30 0x7f52200693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f52280099b0 tx=0x7f5228017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:54.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.730+0000 7f52397fa700 1 -- 172.21.15.84:0/1415714476 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5230051300 con 0x7f523c0b2a90 2023-10-06T03:23:54.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:54.957+0000 7f524363b700 1 -- 172.21.15.84:0/1415714476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f523c064ad0 con 0x7f523c0b2a90 2023-10-06T03:23:55.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.564+0000 7f52397fa700 1 -- 172.21.15.84:0/1415714476 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f5230054920 con 0x7f523c0b2a90 2023-10-06T03:23:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 -- 172.21.15.84:0/1415714476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5220066f30 msgr2=0x7f52200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5220066f30 0x7f52200693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f52280099b0 tx=0x7f5228017000 comp rx=0 tx=0).stop 2023-10-06T03:23:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 -- 172.21.15.84:0/1415714476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0b2a90 msgr2=0x7f523c09c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0b2a90 0x7f523c09c430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f523000c7c0 tx=0x7f5230007f70 comp rx=0 tx=0).stop 2023-10-06T03:23:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 -- 172.21.15.84:0/1415714476 shutdown_connections 2023-10-06T03:23:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5220066f30 0x7f52200693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0cbb50 0x7f523c1494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f523c0b2a90 0x7f523c09c430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 --2- 172.21.15.84:0/1415714476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c0c6610 0x7f523c148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 -- 172.21.15.84:0/1415714476 >> 172.21.15.84:0/1415714476 conn(0x7f523c099740 msgr2=0x7f523c068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:55.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 -- 172.21.15.84:0/1415714476 shutdown_connections 2023-10-06T03:23:55.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.566+0000 7f524363b700 1 -- 172.21.15.84:0/1415714476 wait complete. 2023-10-06T03:23:55.569 INFO:teuthology.orchestra.run.smithi084.stderr:added data pool 5 to fsmap 2023-10-06T03:23:55.580 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:23:55.620 INFO:tasks.ceph.mds.d.smithi131.stderr:2023-10-06T03:23:55.619+0000 7fb48a2ed700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:23:55.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.692+0000 7f4b3ceea700 1 Processor -- start 2023-10-06T03:23:55.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.692+0000 7f4b3ceea700 1 -- start start 2023-10-06T03:23:55.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b3ceea700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4b380b1870 0x7f4b380c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b3ceea700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3815ad90 con 0x7f4b38156050 2023-10-06T03:23:55.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b3ceea700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b38159ea0 con 0x7f4b38156420 2023-10-06T03:23:55.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b3ceea700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3815a180 con 0x7f4b380b1870 2023-10-06T03:23:55.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b377fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4b38156050 0x7f4b380b07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:60826/0 (socket says 172.21.15.84:60826) 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b377fe700 1 -- 172.21.15.84:0/2134531702 learned_addr learned my addr 172.21.15.84:0/2134531702 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583094411 0 0) 0x7f4b3815ad90 con 0x7f4b38156050 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b20003570 con 0x7f4b38156050 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3197828642 0 0) 0x7f4b20003570 con 0x7f4b38156050 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 >> v2:172.21.15.131:3300/0 conn(0x7f4b380b1870 msgr2=0x7f4b380c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 --2- 172.21.15.84:0/2134531702 >> v2:172.21.15.131:3300/0 conn(0x7f4b380b1870 0x7f4b380c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 >> v1:172.21.15.131:6789/0 conn(0x7f4b38156420 legacy=0x7f4b380b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3815a460 con 0x7f4b38156050 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f4b280017f0 con 0x7f4b38156050 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 >> v1:172.21.15.84:6789/0 conn(0x7f4b38156050 legacy=0x7f4b380b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 --2- 172.21.15.84:0/2134531702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20003a60 0x7f4b20003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.693+0000 7f4b367fc700 1 --2- 172.21.15.84:0/2134531702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b20004810 0x7f4b20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b367fc700 1 --2- 172.21.15.84:0/2134531702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b20005310 0x7f4b2000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3815a180 con 0x7f4b20003a60 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2000e440 con 0x7f4b20004810 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2000e600 con 0x7f4b20005310 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b377fe700 1 --2- 172.21.15.84:0/2134531702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20003a60 0x7f4b20003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b377fe700 1 -- 172.21.15.84:0/2134531702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b20005310 msgr2=0x7f4b2000dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b377fe700 1 --2- 172.21.15.84:0/2134531702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b20005310 0x7f4b2000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b377fe700 1 -- 172.21.15.84:0/2134531702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b20004810 msgr2=0x7f4b20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b377fe700 1 --2- 172.21.15.84:0/2134531702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b20004810 0x7f4b20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b37fff700 1 -- 172.21.15.84:0/2134531702 reap_dead start 2023-10-06T03:23:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b377fe700 1 -- 172.21.15.84:0/2134531702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20003570 con 0x7f4b20003a60 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b377fe700 1 --2- 172.21.15.84:0/2134531702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20003a60 0x7f4b20003e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800a950 tx=0x7f4b280021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787ec93fb5a3b058 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280070d0 con 0x7f4b20003a60 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28007250 con 0x7f4b20003a60 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.694+0000 7f4b367fc700 1 -- 172.21.15.84:0/2134531702 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28007610 con 0x7f4b20003a60 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.695+0000 7f4b3ceea700 1 -- 172.21.15.84:0/2134531702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20003a60 msgr2=0x7f4b20003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.695+0000 7f4b3ceea700 1 --2- 172.21.15.84:0/2134531702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20003a60 0x7f4b20003e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800a950 tx=0x7f4b280021f0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.695+0000 7f4b3ceea700 1 -- 172.21.15.84:0/2134531702 shutdown_connections 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.695+0000 7f4b3ceea700 1 --2- 172.21.15.84:0/2134531702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20003a60 0x7f4b20003e50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.695+0000 7f4b3ceea700 1 -- 172.21.15.84:0/2134531702 >> 172.21.15.84:0/2134531702 conn(0x7f4b380691d0 msgr2=0x7f4b380aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.695+0000 7f4b3ceea700 1 -- 172.21.15.84:0/2134531702 shutdown_connections 2023-10-06T03:23:55.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.695+0000 7f4b3ceea700 1 -- 172.21.15.84:0/2134531702 wait complete. 2023-10-06T03:23:55.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.696+0000 7f4b3ceea700 1 Processor -- start 2023-10-06T03:23:55.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.696+0000 7f4b3ceea700 1 -- start start 2023-10-06T03:23:55.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b3ceea700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b20003a60 0x7f4b38151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b3ceea700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b3806a490 0x7f4b3806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b3ceea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b380c6dc0 0x7f4b380c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b3ceea700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3806ae40 con 0x7f4b380c6dc0 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b3ceea700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b380c8730 con 0x7f4b3806a490 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b3ceea700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b38151540 con 0x7f4b20003a60 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b37fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b380c6dc0 0x7f4b380c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b37fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b380c6dc0 0x7f4b380c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51256/0 (socket says 172.21.15.84:51256) 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b37fff700 1 -- 172.21.15.84:0/1962825851 learned_addr learned my addr 172.21.15.84:0/1962825851 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b377fe700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b20003a60 0x7f4b38151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b36ffd700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b3806a490 0x7f4b3806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b37fff700 1 -- 172.21.15.84:0/1962825851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b20003a60 msgr2=0x7f4b38151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b37fff700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b20003a60 0x7f4b38151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b37fff700 1 -- 172.21.15.84:0/1962825851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b3806a490 msgr2=0x7f4b3806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b37fff700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b3806a490 0x7f4b3806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b37fff700 1 -- 172.21.15.84:0/1962825851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b380c7b20 con 0x7f4b380c6dc0 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b377fe700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b20003a60 0x7f4b38151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b36ffd700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b3806a490 0x7f4b3806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b37fff700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b380c6dc0 0x7f4b380c7260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4b380648f0 tx=0x7f4b3000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b1f7fe700 1 -- 172.21.15.84:0/1962825851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b300059b0 con 0x7f4b380c6dc0 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b1f7fe700 1 -- 172.21.15.84:0/1962825851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b30005b10 con 0x7f4b380c6dc0 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b3ceea700 1 -- 172.21.15.84:0/1962825851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b380c7e00 con 0x7f4b380c6dc0 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b1f7fe700 1 -- 172.21.15.84:0/1962825851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b300070f0 con 0x7f4b380c6dc0 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.697+0000 7f4b3ceea700 1 -- 172.21.15.84:0/1962825851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b380c83c0 con 0x7f4b380c6dc0 2023-10-06T03:23:55.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.698+0000 7f4b3ceea700 1 -- 172.21.15.84:0/1962825851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3805f270 con 0x7f4b380c6dc0 2023-10-06T03:23:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.699+0000 7f4b1f7fe700 1 -- 172.21.15.84:0/1962825851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b300074e0 con 0x7f4b380c6dc0 2023-10-06T03:23:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.699+0000 7f4b1f7fe700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4b24066f30 0x7f4b240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.699+0000 7f4b1f7fe700 1 -- 172.21.15.84:0/1962825851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4b300838f0 con 0x7f4b380c6dc0 2023-10-06T03:23:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.699+0000 7f4b377fe700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4b24066f30 0x7f4b240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.699+0000 7f4b377fe700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4b24066f30 0x7f4b240693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b28002250 tx=0x7f4b28015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.703+0000 7f4b1f7fe700 1 -- 172.21.15.84:0/1962825851 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b30050790 con 0x7f4b380c6dc0 2023-10-06T03:23:55.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:23:55.742 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:23:55.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.936+0000 7f4b3ceea700 1 -- 172.21.15.84:0/1962825851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b3815a740 con 0x7f4b380c6dc0 2023-10-06T03:23:55.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.937+0000 7f4b1f7fe700 1 -- 172.21.15.84:0/1962825851 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f4b30017090 con 0x7f4b380c6dc0 2023-10-06T03:23:55.939 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:23:55.939 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:49.917332+0000","modified":"2023-10-06T03:23:55.556500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T03:23:55.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 -- 172.21.15.84:0/1962825851 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4b24066f30 msgr2=0x7f4b240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4b24066f30 0x7f4b240693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b28002250 tx=0x7f4b28015000 comp rx=0 tx=0).stop 2023-10-06T03:23:55.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 -- 172.21.15.84:0/1962825851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b380c6dc0 msgr2=0x7f4b380c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b380c6dc0 0x7f4b380c7260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4b380648f0 tx=0x7f4b3000a060 comp rx=0 tx=0).stop 2023-10-06T03:23:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 -- 172.21.15.84:0/1962825851 shutdown_connections 2023-10-06T03:23:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4b24066f30 0x7f4b240693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b380c6dc0 0x7f4b380c7260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b20003a60 0x7f4b38151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 --2- 172.21.15.84:0/1962825851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b3806a490 0x7f4b3806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 -- 172.21.15.84:0/1962825851 >> 172.21.15.84:0/1962825851 conn(0x7f4b380691d0 msgr2=0x7f4b380caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 -- 172.21.15.84:0/1962825851 shutdown_connections 2023-10-06T03:23:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:55.939+0000 7f4b3ceea700 1 -- 172.21.15.84:0/1962825851 wait complete. 2023-10-06T03:23:55.943 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 6 2023-10-06T03:23:55.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:56.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.065+0000 7f0ea4d4e700 1 Processor -- start 2023-10-06T03:23:56.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.065+0000 7f0ea4d4e700 1 -- start start 2023-10-06T03:23:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0ea4d4e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0ea00cb630 0x7f0ea00691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0ea4d4e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015a220 0x7f0ea00ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0ea4d4e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea0068d50 con 0x7f0ea0069720 2023-10-06T03:23:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0ea4d4e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea0154060 con 0x7f0ea00cb630 2023-10-06T03:23:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0ea4d4e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015a6b0 con 0x7f0ea015a220 2023-10-06T03:23:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e95d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0ea0069720 0x7f0ea0159b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:60836/0 (socket says 172.21.15.84:60836) 2023-10-06T03:23:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e95d9b700 1 -- 172.21.15.84:0/1115219766 learned_addr learned my addr 172.21.15.84:0/1115219766 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e9e59c700 1 --2- 172.21.15.84:0/1115219766 >> v2:172.21.15.131:3300/0 conn(0x7f0ea00cb630 0x7f0ea00691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e9ed9d700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015a220 0x7f0ea00ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182754258 0 0) 0x7f0ea0068d50 con 0x7f0ea0069720 2023-10-06T03:23:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e8c003570 con 0x7f0ea0069720 2023-10-06T03:23:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2428233749 0 0) 0x7f0e8c003570 con 0x7f0ea0069720 2023-10-06T03:23:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015a220 msgr2=0x7f0ea00ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e9dd9b700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015a220 0x7f0ea00ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 >> v2:172.21.15.131:3300/0 conn(0x7f0ea00cb630 msgr2=0x7f0ea00691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.066+0000 7f0e9dd9b700 1 --2- 172.21.15.84:0/1115219766 >> v2:172.21.15.131:3300/0 conn(0x7f0ea00cb630 0x7f0ea00691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea015a990 con 0x7f0ea0069720 2023-10-06T03:23:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f0e88001470 con 0x7f0ea0069720 2023-10-06T03:23:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9e59c700 1 --2- 172.21.15.84:0/1115219766 >> v2:172.21.15.131:3300/0 conn(0x7f0ea00cb630 0x7f0ea00691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 >> v1:172.21.15.84:6789/0 conn(0x7f0ea0069720 legacy=0x7f0ea0159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015a220 0x7f0e8c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e8c003fe0 0x7f0e8c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e8c004d50 0x7f0e8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea0154060 con 0x7f0e8c004d50 2023-10-06T03:23:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015a6b0 con 0x7f0e8c003fe0 2023-10-06T03:23:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c00ba90 con 0x7f0ea015a220 2023-10-06T03:23:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9ed9d700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e8c004d50 0x7f0e8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9e59c700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015a220 0x7f0e8c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e95d9b700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e8c003fe0 0x7f0e8c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9ed9d700 1 -- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015a220 msgr2=0x7f0e8c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9ed9d700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015a220 0x7f0e8c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9ed9d700 1 -- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e8c003fe0 msgr2=0x7f0e8c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9ed9d700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e8c003fe0 0x7f0e8c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9ed9d700 1 -- 172.21.15.84:0/1115219766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c003570 con 0x7f0e8c004d50 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9ed9d700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e8c004d50 0x7f0e8c0051c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800e210 tx=0x7f0e9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949c6cbd00de899d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800ea60 con 0x7f0e8c004d50 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9800f040 con 0x7f0e8c004d50 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.067+0000 7f0e9dd9b700 1 -- 172.21.15.84:0/1115219766 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800ee10 con 0x7f0e8c004d50 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.068+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/1115219766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e8c004d50 msgr2=0x7f0e8c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.068+0000 7f0ea4d4e700 1 --2- 172.21.15.84:0/1115219766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e8c004d50 0x7f0e8c0051c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800e210 tx=0x7f0e9800b040 comp rx=0 tx=0).stop 2023-10-06T03:23:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.068+0000 7f0e9ed9d700 1 -- 172.21.15.84:0/1115219766 reap_dead start 2023-10-06T03:23:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.068+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/1115219766 shutdown_connections 2023-10-06T03:23:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.068+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/1115219766 >> 172.21.15.84:0/1115219766 conn(0x7f0ea0070810 msgr2=0x7f0ea0070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.068+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/1115219766 shutdown_connections 2023-10-06T03:23:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.068+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/1115219766 wait complete. 2023-10-06T03:23:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.069+0000 7f0ea4d4e700 1 Processor -- start 2023-10-06T03:23:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.069+0000 7f0ea4d4e700 1 -- start start 2023-10-06T03:23:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0ea4d4e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea0152a00 0x7f0ea00b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0ea4d4e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015abd0 0x7f0ea015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0ea4d4e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea00b27f0 0x7f0ea00b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0ea4d4e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015b580 con 0x7f0ea0152a00 2023-10-06T03:23:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0ea4d4e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00b2360 con 0x7f0ea00b27f0 2023-10-06T03:23:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0ea4d4e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00b1750 con 0x7f0ea015abd0 2023-10-06T03:23:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea0152a00 0x7f0ea00b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea0152a00 0x7f0ea00b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51278/0 (socket says 172.21.15.84:51278) 2023-10-06T03:23:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9e59c700 1 -- 172.21.15.84:0/729894469 learned_addr learned my addr 172.21.15.84:0/729894469 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9ed9d700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea00b27f0 0x7f0ea00b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e95d9b700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015abd0 0x7f0ea015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9e59c700 1 -- 172.21.15.84:0/729894469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015abd0 msgr2=0x7f0ea015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9e59c700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015abd0 0x7f0ea015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9e59c700 1 -- 172.21.15.84:0/729894469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea00b27f0 msgr2=0x7f0ea00b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9e59c700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea00b27f0 0x7f0ea00b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9e59c700 1 -- 172.21.15.84:0/729894469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea00b1a30 con 0x7f0ea0152a00 2023-10-06T03:23:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9ed9d700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea00b27f0 0x7f0ea00b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e95d9b700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015abd0 0x7f0ea015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.070+0000 7f0e9e59c700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea0152a00 0x7f0ea00b10c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e90011d70 tx=0x7f0e900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.071+0000 7f0e96ffd700 1 -- 172.21.15.84:0/729894469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000fcd0 con 0x7f0ea0152a00 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.071+0000 7f0e96ffd700 1 -- 172.21.15.84:0/729894469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9000fe30 con 0x7f0ea0152a00 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.071+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/729894469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea00b1d10 con 0x7f0ea0152a00 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.071+0000 7f0e96ffd700 1 -- 172.21.15.84:0/729894469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9001d6d0 con 0x7f0ea0152a00 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.071+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/729894469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea0152dd0 con 0x7f0ea0152a00 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.072+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/729894469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea0064ad0 con 0x7f0ea0152a00 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.072+0000 7f0e96ffd700 1 -- 172.21.15.84:0/729894469 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e9001dac0 con 0x7f0ea0152a00 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.072+0000 7f0e96ffd700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.072+0000 7f0e95d9b700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.073+0000 7f0e96ffd700 1 -- 172.21.15.84:0/729894469 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0e90018070 con 0x7f0ea0152a00 2023-10-06T03:23:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.073+0000 7f0e95d9b700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e88000fd0 tx=0x7f0e88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.077+0000 7f0e96ffd700 1 -- 172.21.15.84:0/729894469 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e90052690 con 0x7f0ea0152a00 2023-10-06T03:23:56.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.258+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/729894469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ea00b2640 con 0x7f0ea0152a00 2023-10-06T03:23:56.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.259+0000 7f0e96ffd700 1 -- 172.21.15.84:0/729894469 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f0e90055cb0 con 0x7f0ea0152a00 2023-10-06T03:23:56.261 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:23:56.261 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:56.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.261+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/729894469 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e80066f30 msgr2=0x7f0e800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.261+0000 7f0ea4d4e700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e88000fd0 tx=0x7f0e88009040 comp rx=0 tx=0).stop 2023-10-06T03:23:56.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.261+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/729894469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea0152a00 msgr2=0x7f0ea00b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.261+0000 7f0ea4d4e700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea0152a00 0x7f0ea00b10c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e90011d70 tx=0x7f0e900091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.262+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/729894469 shutdown_connections 2023-10-06T03:23:56.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.262+0000 7f0ea4d4e700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.262+0000 7f0ea4d4e700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea00b27f0 0x7f0ea00b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.262+0000 7f0ea4d4e700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea0152a00 0x7f0ea00b10c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.262+0000 7f0ea4d4e700 1 --2- 172.21.15.84:0/729894469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ea015abd0 0x7f0ea015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.262+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/729894469 >> 172.21.15.84:0/729894469 conn(0x7f0ea0070810 msgr2=0x7f0ea0070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:56.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.262+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/729894469 shutdown_connections 2023-10-06T03:23:56.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.262+0000 7f0ea4d4e700 1 -- 172.21.15.84:0/729894469 wait complete. 2023-10-06T03:23:56.275 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:56.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.388+0000 7f992478e700 1 Processor -- start 2023-10-06T03:23:56.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.388+0000 7f992478e700 1 -- start start 2023-10-06T03:23:56.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.389+0000 7f992478e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f991c0b07a0 0x7f991c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.389+0000 7f992478e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0b0ca0 con 0x7f991c1595a0 2023-10-06T03:23:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.389+0000 7f992478e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0b0f80 con 0x7f991c0b49e0 2023-10-06T03:23:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.389+0000 7f992478e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c0ab390 con 0x7f991c0b07a0 2023-10-06T03:23:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.389+0000 7f992252a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f991c1595a0 0x7f991c0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:60844/0 (socket says 172.21.15.84:60844) 2023-10-06T03:23:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.389+0000 7f992252a700 1 -- 172.21.15.84:0/2463343906 learned_addr learned my addr 172.21.15.84:0/2463343906 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.389+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656478046 0 0) 0x7f991c0b0ca0 con 0x7f991c1595a0 2023-10-06T03:23:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.389+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9908003570 con 0x7f991c1595a0 2023-10-06T03:23:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.389+0000 7f9922d2b700 1 --2- 172.21.15.84:0/2463343906 >> v2:172.21.15.131:3300/0 conn(0x7f991c0b07a0 0x7f991c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2395344171 0 0) 0x7f9908003570 con 0x7f991c1595a0 2023-10-06T03:23:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 >> v2:172.21.15.131:3300/0 conn(0x7f991c0b07a0 msgr2=0x7f991c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 --2- 172.21.15.84:0/2463343906 >> v2:172.21.15.131:3300/0 conn(0x7f991c0b07a0 0x7f991c0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 >> v1:172.21.15.131:6789/0 conn(0x7f991c0b49e0 legacy=0x7f991c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0b1260 con 0x7f991c1595a0 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f99180015f0 con 0x7f991c1595a0 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 >> v1:172.21.15.84:6789/0 conn(0x7f991c1595a0 legacy=0x7f991c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9908003a60 0x7f9908003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908004810 0x7f9908004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99080051c0 0x7f990800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0ab390 con 0x7f9908004810 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990800c0d0 con 0x7f9908003a60 2023-10-06T03:23:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990800c290 con 0x7f99080051c0 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921d29700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908004810 0x7f9908004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f992252a700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9908003a60 0x7f9908003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9922d2b700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99080051c0 0x7f990800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921d29700 1 -- 172.21.15.84:0/2463343906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99080051c0 msgr2=0x7f990800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921d29700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99080051c0 0x7f990800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921d29700 1 -- 172.21.15.84:0/2463343906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9908003a60 msgr2=0x7f9908003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921d29700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9908003a60 0x7f9908003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921d29700 1 -- 172.21.15.84:0/2463343906 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908003570 con 0x7f9908004810 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9922d2b700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99080051c0 0x7f990800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9922d2b700 1 -- 172.21.15.84:0/2463343906 reap_dead start 2023-10-06T03:23:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921d29700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908004810 0x7f9908004c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f991c088e20 tx=0x7f990c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59c69b9095301f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c012420 con 0x7f9908004810 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c0125a0 con 0x7f9908004810 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.390+0000 7f9921528700 1 -- 172.21.15.84:0/2463343906 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c012960 con 0x7f9908004810 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.391+0000 7f992478e700 1 -- 172.21.15.84:0/2463343906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908004810 msgr2=0x7f9908004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.391+0000 7f992478e700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908004810 0x7f9908004c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f991c088e20 tx=0x7f990c007d30 comp rx=0 tx=0).stop 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.391+0000 7f992478e700 1 -- 172.21.15.84:0/2463343906 shutdown_connections 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.391+0000 7f992478e700 1 --2- 172.21.15.84:0/2463343906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908004810 0x7f9908004c80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.391+0000 7f992478e700 1 -- 172.21.15.84:0/2463343906 >> 172.21.15.84:0/2463343906 conn(0x7f991c099830 msgr2=0x7f991c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.391+0000 7f992478e700 1 -- 172.21.15.84:0/2463343906 shutdown_connections 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.391+0000 7f992478e700 1 -- 172.21.15.84:0/2463343906 wait complete. 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.392+0000 7f992478e700 1 Processor -- start 2023-10-06T03:23:56.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.392+0000 7f992478e700 1 -- start start 2023-10-06T03:23:56.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f992478e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9908004810 0x7f991c16aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f992478e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991c157b00 0x7f991c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f992478e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f991c0b3c30 0x7f991c16d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f992478e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c16b030 con 0x7f991c157b00 2023-10-06T03:23:56.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f992478e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0b40a0 con 0x7f9908004810 2023-10-06T03:23:56.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f992478e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c09b060 con 0x7f991c0b3c30 2023-10-06T03:23:56.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f9921d29700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991c157b00 0x7f991c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f9921d29700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991c157b00 0x7f991c0b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51286/0 (socket says 172.21.15.84:51286) 2023-10-06T03:23:56.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f9921d29700 1 -- 172.21.15.84:0/411945645 learned_addr learned my addr 172.21.15.84:0/411945645 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:56.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f992252a700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9908004810 0x7f991c16aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f9922d2b700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f991c0b3c30 0x7f991c16d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f9921d29700 1 -- 172.21.15.84:0/411945645 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f991c0b3c30 msgr2=0x7f991c16d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f9921d29700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f991c0b3c30 0x7f991c16d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f9921d29700 1 -- 172.21.15.84:0/411945645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9908004810 msgr2=0x7f991c16aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f9921d29700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9908004810 0x7f991c16aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f9921d29700 1 -- 172.21.15.84:0/411945645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c09a450 con 0x7f991c157b00 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f9921d29700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991c157b00 0x7f991c0b36f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f990800c0a0 tx=0x7f990c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.393+0000 7f99127fc700 1 -- 172.21.15.84:0/411945645 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c012420 con 0x7f991c157b00 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.394+0000 7f99127fc700 1 -- 172.21.15.84:0/411945645 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c012cd0 con 0x7f991c157b00 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.394+0000 7f992478e700 1 -- 172.21.15.84:0/411945645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c09a730 con 0x7f991c157b00 2023-10-06T03:23:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.394+0000 7f99127fc700 1 -- 172.21.15.84:0/411945645 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c012960 con 0x7f991c157b00 2023-10-06T03:23:56.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.394+0000 7f992478e700 1 -- 172.21.15.84:0/411945645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c09acf0 con 0x7f991c157b00 2023-10-06T03:23:56.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.394+0000 7f992478e700 1 -- 172.21.15.84:0/411945645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c0ad8b0 con 0x7f991c157b00 2023-10-06T03:23:56.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.395+0000 7f99127fc700 1 -- 172.21.15.84:0/411945645 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f990c019070 con 0x7f991c157b00 2023-10-06T03:23:56.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.395+0000 7f99127fc700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.395+0000 7f992252a700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.395+0000 7f99127fc700 1 -- 172.21.15.84:0/411945645 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f990c085f80 con 0x7f991c157b00 2023-10-06T03:23:56.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.396+0000 7f992252a700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9900066f30 0x7f99000693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9918001720 tx=0x7f9918009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.400+0000 7f99127fc700 1 -- 172.21.15.84:0/411945645 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f990c0b75a0 con 0x7f991c157b00 2023-10-06T03:23:56.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.587+0000 7f992478e700 1 -- 172.21.15.84:0/411945645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f991c064ad0 con 0x7f991c157b00 2023-10-06T03:23:56.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.588+0000 7f99127fc700 1 -- 172.21.15.84:0/411945645 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f990c017090 con 0x7f991c157b00 2023-10-06T03:23:56.591 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:23:56.591 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 -- 172.21.15.84:0/411945645 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9900066f30 msgr2=0x7f99000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9900066f30 0x7f99000693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9918001720 tx=0x7f9918009040 comp rx=0 tx=0).stop 2023-10-06T03:23:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 -- 172.21.15.84:0/411945645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991c157b00 msgr2=0x7f991c0b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991c157b00 0x7f991c0b36f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f990800c0a0 tx=0x7f990c015000 comp rx=0 tx=0).stop 2023-10-06T03:23:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 -- 172.21.15.84:0/411945645 shutdown_connections 2023-10-06T03:23:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9908004810 0x7f991c16aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f991c0b3c30 0x7f991c16d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 --2- 172.21.15.84:0/411945645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991c157b00 0x7f991c0b36f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 -- 172.21.15.84:0/411945645 >> 172.21.15.84:0/411945645 conn(0x7f991c099830 msgr2=0x7f991c158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 -- 172.21.15.84:0/411945645 shutdown_connections 2023-10-06T03:23:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.590+0000 7f992478e700 1 -- 172.21.15.84:0/411945645 wait complete. 2023-10-06T03:23:56.618 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:23:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.730+0000 7f1d43f5f700 1 Processor -- start 2023-10-06T03:23:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.730+0000 7f1d43f5f700 1 -- start start 2023-10-06T03:23:56.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.731+0000 7f1d43f5f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 0x7f1d3c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.731+0000 7f1d43f5f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c0cbfe0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.731+0000 7f1d43f5f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c0cb3d0 con 0x7f1d3c159870 2023-10-06T03:23:56.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.731+0000 7f1d43f5f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0cb6b0 con 0x7f1d3c0b2620 2023-10-06T03:23:56.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.731+0000 7f1d414fa700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1d3c0b29f0 0x7f1d3c159160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:60860/0 (socket says 172.21.15.84:60860) 2023-10-06T03:23:56.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.731+0000 7f1d414fa700 1 -- 172.21.15.84:0/3985341419 learned_addr learned my addr 172.21.15.84:0/3985341419 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:56.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.731+0000 7f1d41cfb700 1 --2- 172.21.15.84:0/3985341419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 0x7f1d3c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d40cf9700 1 -- 172.21.15.84:0/3985341419 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119883622 0 0) 0x7f1d3c0cbfe0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d40cf9700 1 -- 172.21.15.84:0/3985341419 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d28003570 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d40cf9700 1 -- 172.21.15.84:0/3985341419 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006214666 0 0) 0x7f1d3c0cb3d0 con 0x7f1d3c159870 2023-10-06T03:23:56.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d40cf9700 1 -- 172.21.15.84:0/3985341419 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d3c0cbfe0 con 0x7f1d3c159870 2023-10-06T03:23:56.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d41cfb700 1 -- 172.21.15.84:0/3985341419 >> v1:172.21.15.131:6789/0 conn(0x7f1d3c159870 legacy=0x7f1d3c0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d41cfb700 1 -- 172.21.15.84:0/3985341419 >> v1:172.21.15.84:6789/0 conn(0x7f1d3c0b29f0 legacy=0x7f1d3c159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d41cfb700 1 -- 172.21.15.84:0/3985341419 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0cb990 con 0x7f1d3c0b2620 2023-10-06T03:23:56.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d41cfb700 1 --2- 172.21.15.84:0/3985341419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 0x7f1d3c0b06d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009900 tx=0x7f1d38009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba356c6fa9f17492 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d40cf9700 1 -- 172.21.15.84:0/3985341419 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38005c10 con 0x7f1d3c0b2620 2023-10-06T03:23:56.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d40cf9700 1 -- 172.21.15.84:0/3985341419 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d38005d70 con 0x7f1d3c0b2620 2023-10-06T03:23:56.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.732+0000 7f1d40cf9700 1 -- 172.21.15.84:0/3985341419 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38006240 con 0x7f1d3c0b2620 2023-10-06T03:23:56.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.733+0000 7f1d43f5f700 1 -- 172.21.15.84:0/3985341419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 msgr2=0x7f1d3c0b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.733+0000 7f1d43f5f700 1 --2- 172.21.15.84:0/3985341419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 0x7f1d3c0b06d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009900 tx=0x7f1d38009120 comp rx=0 tx=0).stop 2023-10-06T03:23:56.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.733+0000 7f1d43f5f700 1 -- 172.21.15.84:0/3985341419 shutdown_connections 2023-10-06T03:23:56.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.733+0000 7f1d43f5f700 1 --2- 172.21.15.84:0/3985341419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 0x7f1d3c0b06d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.733+0000 7f1d43f5f700 1 -- 172.21.15.84:0/3985341419 >> 172.21.15.84:0/3985341419 conn(0x7f1d3c06ed20 msgr2=0x7f1d3c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:56.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.733+0000 7f1d43f5f700 1 -- 172.21.15.84:0/3985341419 shutdown_connections 2023-10-06T03:23:56.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.733+0000 7f1d43f5f700 1 -- 172.21.15.84:0/3985341419 wait complete. 2023-10-06T03:23:56.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.734+0000 7f1d43f5f700 1 Processor -- start 2023-10-06T03:23:56.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.734+0000 7f1d43f5f700 1 -- start start 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.734+0000 7f1d43f5f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 0x7f1d3c153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d43f5f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b29f0 0x7f1d3c0c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d43f5f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c159870 0x7f1d3c0c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d43f5f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c156540 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d43f5f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c155930 con 0x7f1d3c159870 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d43f5f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c155c10 con 0x7f1d3c0b2620 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d414fa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b29f0 0x7f1d3c0c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d414fa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b29f0 0x7f1d3c0c3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51288/0 (socket says 172.21.15.84:51288) 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d414fa700 1 -- 172.21.15.84:0/2891850150 learned_addr learned my addr 172.21.15.84:0/2891850150 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d41cfb700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 0x7f1d3c153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d424fc700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c159870 0x7f1d3c0c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d414fa700 1 -- 172.21.15.84:0/2891850150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 msgr2=0x7f1d3c153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d414fa700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 0x7f1d3c153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d414fa700 1 -- 172.21.15.84:0/2891850150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c159870 msgr2=0x7f1d3c0c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d414fa700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c159870 0x7f1d3c0c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d414fa700 1 -- 172.21.15.84:0/2891850150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d380093c0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d424fc700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c159870 0x7f1d3c0c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:56.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d414fa700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b29f0 0x7f1d3c0c3f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c790 tx=0x7f1d2c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d31ffb700 1 -- 172.21.15.84:0/2891850150 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c005b30 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d31ffb700 1 -- 172.21.15.84:0/2891850150 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c005c90 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d31ffb700 1 -- 172.21.15.84:0/2891850150 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0072e0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d43f5f700 1 -- 172.21.15.84:0/2891850150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c155ef0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.735+0000 7f1d43f5f700 1 -- 172.21.15.84:0/2891850150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c0c69a0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.736+0000 7f1d43f5f700 1 -- 172.21.15.84:0/2891850150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c1566b0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.737+0000 7f1d31ffb700 1 -- 172.21.15.84:0/2891850150 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d2c01b3b0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.737+0000 7f1d31ffb700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.737+0000 7f1d31ffb700 1 -- 172.21.15.84:0/2891850150 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1d2c083cc0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.737+0000 7f1d41cfb700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.738+0000 7f1d41cfb700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1d20066f30 0x7f1d200693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009160 tx=0x7f1d38016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.741+0000 7f1d31ffb700 1 -- 172.21.15.84:0/2891850150 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d2c04b5a0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.966+0000 7f1d43f5f700 1 -- 172.21.15.84:0/2891850150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d3c064ad0 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.966+0000 7f1d31ffb700 1 -- 172.21.15.84:0/2891850150 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f1d2c017070 con 0x7f1d3c0b29f0 2023-10-06T03:23:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:23:56.969 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:49.917332+0000","modified":"2023-10-06T03:23:55.556500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T03:23:56.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 -- 172.21.15.84:0/2891850150 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1d20066f30 msgr2=0x7f1d200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1d20066f30 0x7f1d200693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009160 tx=0x7f1d38016000 comp rx=0 tx=0).stop 2023-10-06T03:23:56.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 -- 172.21.15.84:0/2891850150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b29f0 msgr2=0x7f1d3c0c3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b29f0 0x7f1d3c0c3f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c790 tx=0x7f1d2c007ea0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 -- 172.21.15.84:0/2891850150 shutdown_connections 2023-10-06T03:23:56.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c159870 0x7f1d3c0c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b2620 0x7f1d3c153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 --2- 172.21.15.84:0/2891850150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b29f0 0x7f1d3c0c3f60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 -- 172.21.15.84:0/2891850150 >> 172.21.15.84:0/2891850150 conn(0x7f1d3c06ed20 msgr2=0x7f1d3c15ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:56.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 -- 172.21.15.84:0/2891850150 shutdown_connections 2023-10-06T03:23:56.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:56.969+0000 7f1d43f5f700 1 -- 172.21.15.84:0/2891850150 wait complete. 2023-10-06T03:23:56.972 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 6 2023-10-06T03:23:56.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.095+0000 7fd6d3fff700 1 Processor -- start 2023-10-06T03:23:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.095+0000 7fd6d3fff700 1 -- start start 2023-10-06T03:23:57.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.096+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d4159480 0x7fd6d40b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.096+0000 7fd6d3fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd6d40b3610 0x7fd6d40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.096+0000 7fd6d3fff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d40cb7e0 con 0x7fd6d40cc1b0 2023-10-06T03:23:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.096+0000 7fd6d3fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d40b08a0 con 0x7fd6d40b3610 2023-10-06T03:23:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.096+0000 7fd6d3fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40cb190 con 0x7fd6d4159480 2023-10-06T03:23:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.096+0000 7fd6d2ffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d4159480 0x7fd6d40b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.096+0000 7fd6d37fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd6d40cc1b0 0x7fd6d40b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:43222/0 (socket says 172.21.15.84:43222) 2023-10-06T03:23:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.096+0000 7fd6d37fe700 1 -- 172.21.15.84:0/2397803467 learned_addr learned my addr 172.21.15.84:0/2397803467 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.096+0000 7fd6ca7fc700 1 --2- 172.21.15.84:0/2397803467 >> v2:172.21.15.131:3300/0 conn(0x7fd6d40b3610 0x7fd6d40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d27fc700 1 -- 172.21.15.84:0/2397803467 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961079550 0 0) 0x7fd6d40cb7e0 con 0x7fd6d40cc1b0 2023-10-06T03:23:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d2ffd700 1 -- 172.21.15.84:0/2397803467 >> v2:172.21.15.131:3300/0 conn(0x7fd6d40b3610 msgr2=0x7fd6d40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d2ffd700 1 --2- 172.21.15.84:0/2397803467 >> v2:172.21.15.131:3300/0 conn(0x7fd6d40b3610 0x7fd6d40cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d2ffd700 1 -- 172.21.15.84:0/2397803467 >> v1:172.21.15.131:6789/0 conn(0x7fd6d40cc1b0 legacy=0x7fd6d40b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d2ffd700 1 -- 172.21.15.84:0/2397803467 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d40cb470 con 0x7fd6d4159480 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d2ffd700 1 --2- 172.21.15.84:0/2397803467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d4159480 0x7fd6d40b30d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40098e0 tx=0x7fd6c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c1aef88a85e2026 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d27fc700 1 -- 172.21.15.84:0/2397803467 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4009e80 con 0x7fd6d4159480 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d27fc700 1 -- 172.21.15.84:0/2397803467 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c400b860 con 0x7fd6d4159480 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d27fc700 1 -- 172.21.15.84:0/2397803467 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400bbe0 con 0x7fd6d4159480 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d3fff700 1 -- 172.21.15.84:0/2397803467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d4159480 msgr2=0x7fd6d40b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d3fff700 1 --2- 172.21.15.84:0/2397803467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d4159480 0x7fd6d40b30d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40098e0 tx=0x7fd6c40091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d3fff700 1 -- 172.21.15.84:0/2397803467 shutdown_connections 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d3fff700 1 --2- 172.21.15.84:0/2397803467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d4159480 0x7fd6d40b30d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d3fff700 1 --2- 172.21.15.84:0/2397803467 >> v2:172.21.15.131:3300/0 conn(0x7fd6d40b3610 0x7fd6d40cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d3fff700 1 -- 172.21.15.84:0/2397803467 >> 172.21.15.84:0/2397803467 conn(0x7fd6d406ed20 msgr2=0x7fd6d406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d3fff700 1 -- 172.21.15.84:0/2397803467 shutdown_connections 2023-10-06T03:23:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.097+0000 7fd6d3fff700 1 -- 172.21.15.84:0/2397803467 wait complete. 2023-10-06T03:23:57.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.099+0000 7fd6d3fff700 1 Processor -- start 2023-10-06T03:23:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.099+0000 7fd6d3fff700 1 -- start start 2023-10-06T03:23:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.099+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d40b3610 0x7fd6d415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.099+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d40cc1b0 0x7fd6d41547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.099+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6d4159480 0x7fd6d4156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.099+0000 7fd6d3fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d415a580 con 0x7fd6d4159480 2023-10-06T03:23:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.099+0000 7fd6d3fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40af1e0 con 0x7fd6d40b3610 2023-10-06T03:23:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.099+0000 7fd6d3fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4159c50 con 0x7fd6d40cc1b0 2023-10-06T03:23:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.099+0000 7fd6d37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6d4159480 0x7fd6d4156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6d4159480 0x7fd6d4156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51296/0 (socket says 172.21.15.84:51296) 2023-10-06T03:23:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d37fe700 1 -- 172.21.15.84:0/1571296786 learned_addr learned my addr 172.21.15.84:0/1571296786 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d2ffd700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d40b3610 0x7fd6d415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6ca7fc700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d40cc1b0 0x7fd6d41547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d37fe700 1 -- 172.21.15.84:0/1571296786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d40cc1b0 msgr2=0x7fd6d41547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d37fe700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d40cc1b0 0x7fd6d41547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d37fe700 1 -- 172.21.15.84:0/1571296786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d40b3610 msgr2=0x7fd6d415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d37fe700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d40b3610 0x7fd6d415aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d37fe700 1 -- 172.21.15.84:0/1571296786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4009420 con 0x7fd6d4159480 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d2ffd700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d40b3610 0x7fd6d415aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d37fe700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6d4159480 0x7fd6d4156cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00ccc0 tx=0x7fd6cc001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6cb7fe700 1 -- 172.21.15.84:0/1571296786 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00ab30 con 0x7fd6d4159480 2023-10-06T03:23:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6cb7fe700 1 -- 172.21.15.84:0/1571296786 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc00ac90 con 0x7fd6d4159480 2023-10-06T03:23:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6cb7fe700 1 -- 172.21.15.84:0/1571296786 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc007340 con 0x7fd6d4159480 2023-10-06T03:23:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d3fff700 1 -- 172.21.15.84:0/1571296786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4159f30 con 0x7fd6d4159480 2023-10-06T03:23:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.100+0000 7fd6d3fff700 1 -- 172.21.15.84:0/1571296786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d4154d20 con 0x7fd6d4159480 2023-10-06T03:23:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.101+0000 7fd6d3fff700 1 -- 172.21.15.84:0/1571296786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d415af50 con 0x7fd6d4159480 2023-10-06T03:23:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.102+0000 7fd6cb7fe700 1 -- 172.21.15.84:0/1571296786 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6cc0076f0 con 0x7fd6d4159480 2023-10-06T03:23:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.102+0000 7fd6cb7fe700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd6b4066f60 0x7fd6b4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.102+0000 7fd6cb7fe700 1 -- 172.21.15.84:0/1571296786 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd6cc084ed0 con 0x7fd6d4159480 2023-10-06T03:23:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.102+0000 7fd6d2ffd700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd6b4066f60 0x7fd6b4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.102+0000 7fd6d2ffd700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd6b4066f60 0x7fd6b4069410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40091e0 tx=0x7fd6c4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.106+0000 7fd6cb7fe700 1 -- 172.21.15.84:0/1571296786 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6cc051cd0 con 0x7fd6d4159480 2023-10-06T03:23:57.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.289+0000 7fd6d3fff700 1 -- 172.21.15.84:0/1571296786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6d405f270 con 0x7fd6d4159480 2023-10-06T03:23:57.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.290+0000 7fd6cb7fe700 1 -- 172.21.15.84:0/1571296786 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fd6cc0552f0 con 0x7fd6d4159480 2023-10-06T03:23:57.292 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:23:57.292 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 -- 172.21.15.84:0/1571296786 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd6b4066f60 msgr2=0x7fd6b4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd6b4066f60 0x7fd6b4069410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40091e0 tx=0x7fd6c4017000 comp rx=0 tx=0).stop 2023-10-06T03:23:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 -- 172.21.15.84:0/1571296786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6d4159480 msgr2=0x7fd6d4156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6d4159480 0x7fd6d4156cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00ccc0 tx=0x7fd6cc001a80 comp rx=0 tx=0).stop 2023-10-06T03:23:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 -- 172.21.15.84:0/1571296786 shutdown_connections 2023-10-06T03:23:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd6b4066f60 0x7fd6b4069410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d40b3610 0x7fd6d415aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6d4159480 0x7fd6d4156cd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 --2- 172.21.15.84:0/1571296786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6d40cc1b0 0x7fd6d41547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 -- 172.21.15.84:0/1571296786 >> 172.21.15.84:0/1571296786 conn(0x7fd6d406ed20 msgr2=0x7fd6d4158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 -- 172.21.15.84:0/1571296786 shutdown_connections 2023-10-06T03:23:57.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.293+0000 7fd6d3fff700 1 -- 172.21.15.84:0/1571296786 wait complete. 2023-10-06T03:23:57.709 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:23:49.917332+0000', 'modified': '2023-10-06T03:23:55.556500+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6835/3283560838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 3283560838}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 3283560838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T03:23:57.709 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:23:57.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T03:23:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.825+0000 7fa627d96700 1 Processor -- start 2023-10-06T03:23:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.825+0000 7fa627d96700 1 -- start start 2023-10-06T03:23:57.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa627d96700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6201595a0 0x7fa6200aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa627d96700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6200b07a0 0x7fa6200b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa627d96700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6200b0ca0 con 0x7fa6200b49e0 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa627d96700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6200b0f80 con 0x7fa6200b07a0 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa627d96700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6200b1260 con 0x7fa6201595a0 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa626333700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6200b07a0 0x7fa6200b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa625331700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa6200b49e0 0x7fa6200aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:60866/0 (socket says 172.21.15.84:60866) 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa626333700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6200b07a0 0x7fa6200b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51310/0 (socket says 172.21.15.84:51310) 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa625331700 1 -- 172.21.15.84:0/358474909 learned_addr learned my addr 172.21.15.84:0/358474909 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa625b32700 1 --2- 172.21.15.84:0/358474909 >> v2:172.21.15.131:3300/0 conn(0x7fa6201595a0 0x7fa6200aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa626333700 1 -- 172.21.15.84:0/358474909 >> v2:172.21.15.131:3300/0 conn(0x7fa6201595a0 msgr2=0x7fa6200aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa626333700 1 --2- 172.21.15.84:0/358474909 >> v2:172.21.15.131:3300/0 conn(0x7fa6201595a0 0x7fa6200aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa626333700 1 -- 172.21.15.84:0/358474909 >> v1:172.21.15.84:6789/0 conn(0x7fa6200b49e0 legacy=0x7fa6200aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa626333700 1 -- 172.21.15.84:0/358474909 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200b1540 con 0x7fa6200b07a0 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.826+0000 7fa624b30700 1 -- 172.21.15.84:0/358474909 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292061311 0 0) 0x7fa6200b0ca0 con 0x7fa6200b49e0 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa626333700 1 --2- 172.21.15.84:0/358474909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b07a0 0x7fa6200b1c00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa618009e60 tx=0x7fa618009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2230a266c55668b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa624b30700 1 -- 172.21.15.84:0/358474909 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800e070 con 0x7fa6200b07a0 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa624b30700 1 -- 172.21.15.84:0/358474909 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61800bb20 con 0x7fa6200b07a0 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa624b30700 1 -- 172.21.15.84:0/358474909 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618012430 con 0x7fa6200b07a0 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa627d96700 1 -- 172.21.15.84:0/358474909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b07a0 msgr2=0x7fa6200b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa627d96700 1 --2- 172.21.15.84:0/358474909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b07a0 0x7fa6200b1c00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa618009e60 tx=0x7fa618009780 comp rx=0 tx=0).stop 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa627d96700 1 -- 172.21.15.84:0/358474909 shutdown_connections 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa627d96700 1 --2- 172.21.15.84:0/358474909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b07a0 0x7fa6200b1c00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa627d96700 1 --2- 172.21.15.84:0/358474909 >> v2:172.21.15.131:3300/0 conn(0x7fa6201595a0 0x7fa6200aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa627d96700 1 -- 172.21.15.84:0/358474909 >> 172.21.15.84:0/358474909 conn(0x7fa620099830 msgr2=0x7fa62006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa627d96700 1 -- 172.21.15.84:0/358474909 shutdown_connections 2023-10-06T03:23:57.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.827+0000 7fa627d96700 1 -- 172.21.15.84:0/358474909 wait complete. 2023-10-06T03:23:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.828+0000 7fa627d96700 1 Processor -- start 2023-10-06T03:23:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.828+0000 7fa627d96700 1 -- start start 2023-10-06T03:23:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa627d96700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6200b07a0 0x7fa62009db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa627d96700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b49e0 0x7fa6200aa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa627d96700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6201595a0 0x7fa620158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa627d96700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200aa270 con 0x7fa6200b49e0 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa627d96700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200a9660 con 0x7fa6201595a0 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa627d96700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200a9940 con 0x7fa6200b07a0 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa625331700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b49e0 0x7fa6200aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa625331700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b49e0 0x7fa6200aa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51322/0 (socket says 172.21.15.84:51322) 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa625331700 1 -- 172.21.15.84:0/2772210333 learned_addr learned my addr 172.21.15.84:0/2772210333 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa626333700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6201595a0 0x7fa620158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa625b32700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6200b07a0 0x7fa62009db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa625331700 1 -- 172.21.15.84:0/2772210333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6200b07a0 msgr2=0x7fa62009db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa625331700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6200b07a0 0x7fa62009db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa625331700 1 -- 172.21.15.84:0/2772210333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6201595a0 msgr2=0x7fa620158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa625331700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6201595a0 0x7fa620158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa625331700 1 -- 172.21.15.84:0/2772210333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618009a20 con 0x7fa6200b49e0 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.829+0000 7fa626333700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6201595a0 0x7fa620158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.830+0000 7fa625331700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b49e0 0x7fa6200aa700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c7e0 tx=0x7fa610007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.830+0000 7fa615ffb700 1 -- 172.21.15.84:0/2772210333 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610005c00 con 0x7fa6200b49e0 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.830+0000 7fa615ffb700 1 -- 172.21.15.84:0/2772210333 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610005d60 con 0x7fa6200b49e0 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.830+0000 7fa627d96700 1 -- 172.21.15.84:0/2772210333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6200a9c20 con 0x7fa6200b49e0 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.830+0000 7fa615ffb700 1 -- 172.21.15.84:0/2772210333 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100072e0 con 0x7fa6200b49e0 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.830+0000 7fa627d96700 1 -- 172.21.15.84:0/2772210333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62009ce20 con 0x7fa6200b49e0 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.832+0000 7fa615ffb700 1 -- 172.21.15.84:0/2772210333 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa61001b3b0 con 0x7fa6200b49e0 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.832+0000 7fa615ffb700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa604066f30 0x7fa6040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.832+0000 7fa615ffb700 1 -- 172.21.15.84:0/2772210333 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa610083dd0 con 0x7fa6200b49e0 2023-10-06T03:23:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.832+0000 7fa625b32700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa604066f30 0x7fa6040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.832+0000 7fa625b32700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa604066f30 0x7fa6040693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009c90 tx=0x7fa61c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.834+0000 7fa63108eb80 1 Processor -- start 2023-10-06T03:23:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.834+0000 7fa63108eb80 1 -- start start 2023-10-06T03:23:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032ee0ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee0fcc0 0x56032ee5e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee5ec00 0x56032ee5f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa63108eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032ed65a70 con 0x56032ee5ec00 2023-10-06T03:23:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa63108eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032ed63270 con 0x56032ee0e840 2023-10-06T03:23:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa63108eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56032ed5f060 con 0x56032ee0fcc0 2023-10-06T03:23:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa626333700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee5ec00 0x56032ee5f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa626333700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee5ec00 0x56032ee5f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51326/0 (socket says 172.21.15.84:51326) 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa626333700 1 -- 172.21.15.84:0/686854588 learned_addr learned my addr 172.21.15.84:0/686854588 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa626333700 1 -- 172.21.15.84:0/686854588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee0fcc0 msgr2=0x56032ee5e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa626333700 1 --2- 172.21.15.84:0/686854588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee0fcc0 0x56032ee5e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa626333700 1 -- 172.21.15.84:0/686854588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 msgr2=0x56032ee0ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa626333700 1 --2- 172.21.15.84:0/686854588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032ee0ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa626333700 1 -- 172.21.15.84:0/686854588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56032ebf9270 con 0x56032ee5ec00 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa626333700 1 --2- 172.21.15.84:0/686854588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee5ec00 0x56032ee5f050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa620067c60 tx=0x7fa618019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c085687beb2b4d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa60affd700 1 -- 172.21.15.84:0/686854588 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618021070 con 0x56032ee5ec00 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa60affd700 1 -- 172.21.15.84:0/686854588 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61800bd10 con 0x56032ee5ec00 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.835+0000 7fa60affd700 1 -- 172.21.15.84:0/686854588 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618012a40 con 0x56032ee5ec00 2023-10-06T03:23:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 -- 172.21.15.84:0/686854588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee5ec00 msgr2=0x56032ee5f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 --2- 172.21.15.84:0/686854588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee5ec00 0x56032ee5f050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa620067c60 tx=0x7fa618019000 comp rx=0 tx=0).stop 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 -- 172.21.15.84:0/686854588 shutdown_connections 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 --2- 172.21.15.84:0/686854588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032ee0ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 --2- 172.21.15.84:0/686854588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee5ec00 0x56032ee5f050 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 --2- 172.21.15.84:0/686854588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee0fcc0 0x56032ee5e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 -- 172.21.15.84:0/686854588 >> 172.21.15.84:0/686854588 conn(0x56032ee10160 msgr2=0x56032ee10530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 -- 172.21.15.84:0/686854588 shutdown_connections 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 -- 172.21.15.84:0/686854588 wait complete. 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 -- start start 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.836+0000 7fa63108eb80 1 Processor -- start 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.837+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee0e840 0x56032ee4dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.837+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee38810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.837+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee5ec00 0x56032ee38d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.837+0000 7fa63108eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032ed0a890 con 0x56032ee0fcc0 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.837+0000 7fa63108eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032ed25ea0 con 0x56032ee5ec00 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.837+0000 7fa63108eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56032ebe1e30 con 0x56032ee0e840 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.837+0000 7fa63108eb80 10 client.0 _ll_register_callbacks cb 0x56032edd1e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.837+0000 7fa625331700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee38810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.837+0000 7fa625331700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee38810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51332/0 (socket says 172.21.15.84:51332) 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.837+0000 7fa625331700 1 -- 172.21.15.84:0/53603993 learned_addr learned my addr 172.21.15.84:0/53603993 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa625b32700 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee0e840 0x56032ee4dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa626333700 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee5ec00 0x56032ee38d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa625331700 1 -- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee0e840 msgr2=0x56032ee4dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa625331700 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee0e840 0x56032ee4dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa625331700 1 -- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee5ec00 msgr2=0x56032ee38d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa625331700 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee5ec00 0x56032ee38d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa625331700 1 -- 172.21.15.84:0/53603993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6200b1540 con 0x56032ee0fcc0 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa625b32700 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee0e840 0x56032ee4dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa625331700 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee38810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa6100548f0 tx=0x7fa610081e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c7a542a94a8c9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa5fffff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa5fffff700 1 -- 172.21.15.84:0/53603993 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610057b00 con 0x56032ee0fcc0 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa5fffff700 1 -- 172.21.15.84:0/53603993 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa61005b850 con 0x56032ee0fcc0 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa63108eb80 1 -- 172.21.15.84:0/53603993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56032ee03940 con 0x56032ee0fcc0 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa5fffff700 1 -- 172.21.15.84:0/53603993 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa61005b3c0 con 0x56032ee0fcc0 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa63108eb80 10 client.4437 fetch_fsmap learned FSMap version 6 2023-10-06T03:23:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa63108eb80 1 -- 172.21.15.84:0/53603993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x56032eb9bfe0 con 0x56032ee0fcc0 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa5fffff700 1 -- 172.21.15.84:0/53603993 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56032ee03940 con 0x56032ee0fcc0 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa5fffff700 1 -- 172.21.15.84:0/53603993 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 6) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fa610070300 con 0x56032ee0fcc0 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa63108eb80 10 client.4437 fetch_fsmap finished waiting for FSMap version 6 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa63108eb80 10 client.4437 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa63108eb80 20 client.4437 populate_metadata read hostname 'smithi084' 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa63108eb80 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x56032ee507e0 0x56032ee72670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa63108eb80 4 client.4437 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.838+0000 7fa63108eb80 1 -- 172.21.15.84:0/53603993 --> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56032ede0870 con 0x56032ee507e0 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.839+0000 7fa625b32700 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x56032ee507e0 0x56032ee72670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.839+0000 7fa5fffff700 10 client.4437 ms_handle_connect on v2:172.21.15.131:6833/3283560838 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.839+0000 7fa625b32700 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x56032ee507e0 0x56032ee72670 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3519a45ff8875d84 server_cookie=b4fac1d7a1b0159f in_seq=0 out_seq=0 2023-10-06T03:23:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa5fffff700 1 -- 172.21.15.84:0/53603993 <== mds.0 v2:172.21.15.131:6833/3283560838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56032ede0870 con 0x56032ee507e0 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa5fffff700 10 client.4437 handle_command_reply: tid=0 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 client.4437 shutdown 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 -- 172.21.15.84:0/53603993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 msgr2=0x56032ee38810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee38810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa6100548f0 tx=0x7fa610081e00 comp rx=0 tx=0).stop 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 -- 172.21.15.84:0/53603993 shutdown_connections 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x56032ee507e0 0x56032ee72670 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee5ec00 0x56032ee38d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa5fffff700 0 client.4437 ms_handle_reset on v2:172.21.15.131:6833/3283560838 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee0e840 0x56032ee4dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 --2- 172.21.15.84:0/53603993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee38810 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 -- 172.21.15.84:0/53603993 >> 172.21.15.84:0/53603993 conn(0x56032ee10160 msgr2=0x56032ee09a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 -- 172.21.15.84:0/53603993 shutdown_connections 2023-10-06T03:23:57.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 1 -- 172.21.15.84:0/53603993 wait complete. 2023-10-06T03:23:57.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.840+0000 7fa63108eb80 20 client.4437 trim_cache size 0 max 16384 2023-10-06T03:23:57.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.856+0000 7fa63108eb80 1 Processor -- start 2023-10-06T03:23:57.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.856+0000 7fa63108eb80 1 -- start start 2023-10-06T03:23:57.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032ee34c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee37c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee5ec00 0x56032ee38140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa63108eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032ee0bf60 con 0x56032ee0fcc0 2023-10-06T03:23:57.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa63108eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032ee0c9c0 con 0x56032ee0e840 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa63108eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56032ee5e750 con 0x56032ee5ec00 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa625331700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee37c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa625331700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee37c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51344/0 (socket says 172.21.15.84:51344) 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa625331700 1 -- 172.21.15.84:0/3486823457 learned_addr learned my addr 172.21.15.84:0/3486823457 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa625b32700 1 --2- 172.21.15.84:0/3486823457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032ee34c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa625331700 1 -- 172.21.15.84:0/3486823457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee5ec00 msgr2=0x56032ee38140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa625331700 1 --2- 172.21.15.84:0/3486823457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee5ec00 0x56032ee38140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa625331700 1 -- 172.21.15.84:0/3486823457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 msgr2=0x56032ee34c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa625331700 1 --2- 172.21.15.84:0/3486823457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032ee34c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.857+0000 7fa625331700 1 -- 172.21.15.84:0/3486823457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56032ed2d780 con 0x56032ee0fcc0 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa625331700 1 --2- 172.21.15.84:0/3486823457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee37c00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa610054660 tx=0x7fa61006c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86671e7d9e6adaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa60b7fe700 1 -- 172.21.15.84:0/3486823457 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000e040 con 0x56032ee0fcc0 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa60b7fe700 1 -- 172.21.15.84:0/3486823457 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61005b850 con 0x56032ee0fcc0 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa60b7fe700 1 -- 172.21.15.84:0/3486823457 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610057b00 con 0x56032ee0fcc0 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa63108eb80 1 -- 172.21.15.84:0/3486823457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 msgr2=0x56032ee37c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa63108eb80 1 --2- 172.21.15.84:0/3486823457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee37c00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa610054660 tx=0x7fa61006c000 comp rx=0 tx=0).stop 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa63108eb80 1 -- 172.21.15.84:0/3486823457 shutdown_connections 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa63108eb80 1 --2- 172.21.15.84:0/3486823457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032ee34c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa63108eb80 1 --2- 172.21.15.84:0/3486823457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee5ec00 0x56032ee38140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa63108eb80 1 --2- 172.21.15.84:0/3486823457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee37c00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa63108eb80 1 -- 172.21.15.84:0/3486823457 >> 172.21.15.84:0/3486823457 conn(0x56032ee10160 msgr2=0x56032ee07280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa63108eb80 1 -- 172.21.15.84:0/3486823457 shutdown_connections 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.858+0000 7fa63108eb80 1 -- 172.21.15.84:0/3486823457 wait complete. 2023-10-06T03:23:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.859+0000 7fa63108eb80 1 -- start start 2023-10-06T03:23:57.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.859+0000 7fa63108eb80 1 Processor -- start 2023-10-06T03:23:57.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032eeba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee6ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa63108eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee5ec00 0x56032ee6d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa63108eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032ee5bcf0 con 0x56032ee0fcc0 2023-10-06T03:23:57.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa63108eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032ee38610 con 0x56032ee0e840 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa63108eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56032ee38e20 con 0x56032ee5ec00 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa63108eb80 10 client.0 _ll_register_callbacks cb 0x56032edd1e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa625331700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee6ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa625331700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee6ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51352/0 (socket says 172.21.15.84:51352) 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa625331700 1 -- 172.21.15.84:0/293416633 learned_addr learned my addr 172.21.15.84:0/293416633 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa626333700 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee5ec00 0x56032ee6d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa625b32700 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032eeba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa625331700 1 -- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee5ec00 msgr2=0x56032ee6d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa625331700 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee5ec00 0x56032ee6d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa625331700 1 -- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 msgr2=0x56032eeba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa625331700 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032eeba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa625331700 1 -- 172.21.15.84:0/293416633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56032eb9bfe0 con 0x56032ee0fcc0 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa625331700 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee6ce00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa610081f80 tx=0x7fa61005d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4f694cbdda47ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa5fffff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa5fffff700 1 -- 172.21.15.84:0/293416633 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610057b00 con 0x56032ee0fcc0 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa5fffff700 1 -- 172.21.15.84:0/293416633 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa610007650 con 0x56032ee0fcc0 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa63108eb80 1 -- 172.21.15.84:0/293416633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa61800bd10 con 0x56032ee0fcc0 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa5fffff700 1 -- 172.21.15.84:0/293416633 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa610050960 con 0x56032ee0fcc0 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa63108eb80 10 client.4443 fetch_fsmap learned FSMap version 6 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.860+0000 7fa63108eb80 1 -- 172.21.15.84:0/293416633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x56032ed14470 con 0x56032ee0fcc0 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa5fffff700 1 -- 172.21.15.84:0/293416633 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610074020 con 0x56032ee0fcc0 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa5fffff700 1 -- 172.21.15.84:0/293416633 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 6) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fa6100538c0 con 0x56032ee0fcc0 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa63108eb80 10 client.4443 fetch_fsmap finished waiting for FSMap version 6 2023-10-06T03:23:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa63108eb80 10 client.4443 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa63108eb80 20 client.4443 populate_metadata read hostname 'smithi084' 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa63108eb80 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x56032ee63f60 0x56032ee64330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa63108eb80 4 client.4443 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa63108eb80 1 -- 172.21.15.84:0/293416633 --> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56032ed01e00 con 0x56032ee63f60 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa625b32700 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x56032ee63f60 0x56032ee64330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa5fffff700 10 client.4443 ms_handle_connect on v2:172.21.15.131:6833/3283560838 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.861+0000 7fa625b32700 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x56032ee63f60 0x56032ee64330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93e979aebac41cda server_cookie=4f761157630221e6 in_seq=0 out_seq=0 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa5fffff700 1 -- 172.21.15.84:0/293416633 <== mds.0 v2:172.21.15.131:6833/3283560838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x56032ed01e00 con 0x56032ee63f60 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa5fffff700 10 client.4443 handle_command_reply: tid=0 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 client.4443 shutdown 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 -- 172.21.15.84:0/293416633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 msgr2=0x56032ee6ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee6ce00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa610081f80 tx=0x7fa61005d040 comp rx=0 tx=0).stop 2023-10-06T03:23:57.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 -- 172.21.15.84:0/293416633 shutdown_connections 2023-10-06T03:23:57.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x56032ee63f60 0x56032ee64330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56032ee0e840 0x56032eeba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56032ee5ec00 0x56032ee6d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 --2- 172.21.15.84:0/293416633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56032ee0fcc0 0x56032ee6ce00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa5fffff700 0 client.4443 ms_handle_reset on v2:172.21.15.131:6833/3283560838 2023-10-06T03:23:57.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 -- 172.21.15.84:0/293416633 >> 172.21.15.84:0/293416633 conn(0x56032ee10160 msgr2=0x56032ee4f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 -- 172.21.15.84:0/293416633 shutdown_connections 2023-10-06T03:23:57.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 1 -- 172.21.15.84:0/293416633 wait complete. 2023-10-06T03:23:57.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa63108eb80 20 client.4443 trim_cache size 0 max 16384 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4290, 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 7.3326929510000003, 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 6, 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 24, 2023-10-06T03:23:57.871 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 24, 2023-10-06T03:23:57.872 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 13.24936626 2023-10-06T03:23:57.872 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:23:57.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 -- 172.21.15.84:0/2772210333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa604066f30 msgr2=0x7fa6040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa604066f30 0x7fa6040693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009c90 tx=0x7fa61c008040 comp rx=0 tx=0).stop 2023-10-06T03:23:57.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 -- 172.21.15.84:0/2772210333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b49e0 msgr2=0x7fa6200aa700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b49e0 0x7fa6200aa700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c7e0 tx=0x7fa610007d90 comp rx=0 tx=0).stop 2023-10-06T03:23:57.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 -- 172.21.15.84:0/2772210333 shutdown_connections 2023-10-06T03:23:57.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa604066f30 0x7fa6040693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6201595a0 0x7fa620158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6200b07a0 0x7fa62009db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 --2- 172.21.15.84:0/2772210333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6200b49e0 0x7fa6200aa700 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 -- 172.21.15.84:0/2772210333 >> 172.21.15.84:0/2772210333 conn(0x7fa620099830 msgr2=0x7fa6200b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 -- 172.21.15.84:0/2772210333 shutdown_connections 2023-10-06T03:23:57.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.862+0000 7fa627d96700 1 -- 172.21.15.84:0/2772210333 wait complete. 2023-10-06T03:23:57.876 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:23:57.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.988+0000 7f34743be700 1 Processor -- start 2023-10-06T03:23:57.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.988+0000 7f34743be700 1 -- start start 2023-10-06T03:23:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f34743be700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f346c1595a0 0x7f346c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f34743be700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c0b0ca0 con 0x7f346c0b49e0 2023-10-06T03:23:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f34743be700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c0b0f80 con 0x7f346c0b07a0 2023-10-06T03:23:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f34743be700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c0b1260 con 0x7f346c1595a0 2023-10-06T03:23:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471959700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f346c0b49e0 0x7f346c0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:60880/0 (socket says 172.21.15.84:60880) 2023-10-06T03:23:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471959700 1 -- 172.21.15.84:0/839358831 learned_addr learned my addr 172.21.15.84:0/839358831 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:23:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f347215a700 1 --2- 172.21.15.84:0/839358831 >> v2:172.21.15.131:3300/0 conn(0x7f346c1595a0 0x7f346c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522963766 0 0) 0x7f346c0b0ca0 con 0x7f346c0b49e0 2023-10-06T03:23:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3454003570 con 0x7f346c0b49e0 2023-10-06T03:23:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3415484933 0 0) 0x7f3454003570 con 0x7f346c0b49e0 2023-10-06T03:23:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 >> v2:172.21.15.131:3300/0 conn(0x7f346c1595a0 msgr2=0x7f346c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 --2- 172.21.15.84:0/839358831 >> v2:172.21.15.131:3300/0 conn(0x7f346c1595a0 0x7f346c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 >> v1:172.21.15.131:6789/0 conn(0x7f346c0b07a0 legacy=0x7f346c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c0b1540 con 0x7f346c0b49e0 2023-10-06T03:23:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f3460001470 con 0x7f346c0b49e0 2023-10-06T03:23:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 >> v1:172.21.15.84:6789/0 conn(0x7f346c0b49e0 legacy=0x7f346c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3454003a60 0x7f3454003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3454004810 0x7f3454004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34540051c0 0x7f345400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0b1260 con 0x7f34540051c0 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345400c0d0 con 0x7f3454003a60 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345400c290 con 0x7f3454004810 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.989+0000 7f347295b700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34540051c0 0x7f345400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f3471959700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3454004810 0x7f3454004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f347215a700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3454003a60 0x7f3454003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f347295b700 1 -- 172.21.15.84:0/839358831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3454004810 msgr2=0x7f3454004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f347295b700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3454004810 0x7f3454004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f347295b700 1 -- 172.21.15.84:0/839358831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3454003a60 msgr2=0x7f3454003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f347295b700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3454003a60 0x7f3454003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f347295b700 1 -- 172.21.15.84:0/839358831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3454003570 con 0x7f34540051c0 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f347295b700 1 -- 172.21.15.84:0/839358831 reap_dead start 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f347295b700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34540051c0 0x7f345400ba60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f345c0018b0 tx=0x7f345c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567613b46a386ef6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c012420 con 0x7f34540051c0 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c0125a0 con 0x7f34540051c0 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f3471158700 1 -- 172.21.15.84:0/839358831 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c012960 con 0x7f34540051c0 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f34743be700 1 -- 172.21.15.84:0/839358831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34540051c0 msgr2=0x7f345400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.990+0000 7f34743be700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34540051c0 0x7f345400ba60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f345c0018b0 tx=0x7f345c007d30 comp rx=0 tx=0).stop 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.991+0000 7f34743be700 1 -- 172.21.15.84:0/839358831 shutdown_connections 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.991+0000 7f34743be700 1 --2- 172.21.15.84:0/839358831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34540051c0 0x7f345400ba60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.991+0000 7f34743be700 1 -- 172.21.15.84:0/839358831 >> 172.21.15.84:0/839358831 conn(0x7f346c099830 msgr2=0x7f346c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.991+0000 7f34743be700 1 -- 172.21.15.84:0/839358831 shutdown_connections 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.991+0000 7f34743be700 1 -- 172.21.15.84:0/839358831 wait complete. 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.992+0000 7f34743be700 1 Processor -- start 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.992+0000 7f34743be700 1 -- start start 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.992+0000 7f34743be700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34540051c0 0x7f346c16a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.992+0000 7f34743be700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15c240 0x7f346c14a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.992+0000 7f34743be700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c09af80 0x7f346c09c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.992+0000 7f34743be700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c15ca50 con 0x7f346c15c240 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.992+0000 7f34743be700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c09a1c0 con 0x7f34540051c0 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.992+0000 7f34743be700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c09a4a0 con 0x7f346c09af80 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f3471959700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15c240 0x7f346c14a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f3471959700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15c240 0x7f346c14a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51370/0 (socket says 172.21.15.84:51370) 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f3471959700 1 -- 172.21.15.84:0/2961268768 learned_addr learned my addr 172.21.15.84:0/2961268768 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f3471959700 1 -- 172.21.15.84:0/2961268768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c09af80 msgr2=0x7f346c09c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f3471959700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c09af80 0x7f346c09c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f3471959700 1 -- 172.21.15.84:0/2961268768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34540051c0 msgr2=0x7f346c16a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f3471959700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34540051c0 0x7f346c16a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f3471959700 1 -- 172.21.15.84:0/2961268768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c09a780 con 0x7f346c15c240 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f3471959700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15c240 0x7f346c14a770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f34600015a0 tx=0x7f3460001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f346a7fc700 1 -- 172.21.15.84:0/2961268768 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460018030 con 0x7f346c15c240 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f346a7fc700 1 -- 172.21.15.84:0/2961268768 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34600077d0 con 0x7f346c15c240 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f34743be700 1 -- 172.21.15.84:0/2961268768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c09aa60 con 0x7f346c15c240 2023-10-06T03:23:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f346a7fc700 1 -- 172.21.15.84:0/2961268768 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346000fb20 con 0x7f346c15c240 2023-10-06T03:23:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.993+0000 7f34743be700 1 -- 172.21.15.84:0/2961268768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c14acb0 con 0x7f346c15c240 2023-10-06T03:23:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.994+0000 7f34743be700 1 -- 172.21.15.84:0/2961268768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c09aca0 con 0x7f346c15c240 2023-10-06T03:23:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.994+0000 7f346a7fc700 1 -- 172.21.15.84:0/2961268768 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f346001b070 con 0x7f346c15c240 2023-10-06T03:23:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.995+0000 7f346a7fc700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3458066f30 0x7f34580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.995+0000 7f346a7fc700 1 -- 172.21.15.84:0/2961268768 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3460019070 con 0x7f346c15c240 2023-10-06T03:23:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.995+0000 7f347215a700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3458066f30 0x7f34580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.995+0000 7f347215a700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3458066f30 0x7f34580693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f34640099f0 tx=0x7f346400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:57.999+0000 7f346a7fc700 1 -- 172.21.15.84:0/2961268768 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f346c09aca0 con 0x7f346c15c240 2023-10-06T03:23:58.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.222+0000 7f34743be700 1 -- 172.21.15.84:0/2961268768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f346c064ad0 con 0x7f346c15c240 2023-10-06T03:23:58.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.223+0000 7f346a7fc700 1 -- 172.21.15.84:0/2961268768 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3460051730 con 0x7f346c15c240 2023-10-06T03:23:58.224 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:23:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 -- 172.21.15.84:0/2961268768 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3458066f30 msgr2=0x7f34580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3458066f30 0x7f34580693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f34640099f0 tx=0x7f346400b040 comp rx=0 tx=0).stop 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 -- 172.21.15.84:0/2961268768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15c240 msgr2=0x7f346c14a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15c240 0x7f346c14a770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f34600015a0 tx=0x7f3460001e50 comp rx=0 tx=0).stop 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 -- 172.21.15.84:0/2961268768 shutdown_connections 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3458066f30 0x7f34580693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34540051c0 0x7f346c16a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c09af80 0x7f346c09c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 --2- 172.21.15.84:0/2961268768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15c240 0x7f346c14a770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 -- 172.21.15.84:0/2961268768 >> 172.21.15.84:0/2961268768 conn(0x7f346c099830 msgr2=0x7f346c0cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 -- 172.21.15.84:0/2961268768 shutdown_connections 2023-10-06T03:23:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:23:58.225+0000 7f34743be700 1 -- 172.21.15.84:0/2961268768 wait complete. 2023-10-06T03:23:58.238 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:23:58.238 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:23:58.238 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:23:58.238 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T03:23:58.238 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:23:58.239 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:23:58.239 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:23:58.239 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:23:58.239 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T03:23:58.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:58.239 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:23:58.254 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:23:58.254 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:23:58.254 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:23:58.255 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:23:58.255 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:23:58.255 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:23:58.255 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:23:58.255 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:23:58.255 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:23:58.255 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:23:58.255 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:23:58.255 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:23:58.255 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:23:58.256 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:23:58.256 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:23:58.256 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:23:58.256 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:23:58.256 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42516sec preferred_lft 42516sec 2023-10-06T03:23:58.256 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:23:58.256 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:23:58.256 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:23:58.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:58.257 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:23:58.257 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:23:58.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:23:58.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-10-06T03:23:58.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-10-06T03:23:58.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:23:58.257 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:23:58.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:58.422 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:23:58.462 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:23:58.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:58.464 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:23:58.539 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:23:58.539 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:23:58.539 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:23:58.539 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:23:58.540 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:23:58.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:58.540 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:23:58.540 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:23:58.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:23:58.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:23:58.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:23:58.541 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:23:58.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:58.797 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:23:58.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:58.812 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-10-06T03:23:58.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:58.866 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:23:58.866 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:23:58.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T03:23:58.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T03:23:58.867 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:23:58.957 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T03:23:58.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:58.958 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:23:58.958 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:23:58.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T03:23:58.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:23:58.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T03:23:58.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T03:23:58.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T03:23:58.958 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:23:59.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:59.156 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:23:59.156 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:23:59.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:23:59.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:23:59.156 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:23:59.248 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T03:23:59.248 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:23:59.248 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:23:59.263 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T03:23:59.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:23:59.263 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:23:59.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-10-06T03:23:59.382 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:23:59.383 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:23:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:23:59.447 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:23:59.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:23:59.447 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-10-06T03:23:59.502 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:23:59.502 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T03:23:59.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-10-06T03:23:59.568 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:23:59.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:23:59.630 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:2023-10-06T03:23:59.628+0000 7f0cabecc540 -1 init, newargv = 0x55b41adde890 newargc=15 2023-10-06T03:23:59.630 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[98141]: starting ceph client 2023-10-06T03:23:59.633 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:23:59.634 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:23:59.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:23:59.635 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-10-06T03:23:59.636 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[98141]: starting fuse 2023-10-06T03:23:59.650 INFO:teuthology.orchestra.run.smithi084.stdout:46 2023-10-06T03:23:59.651 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T03:23:59.651 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:23:59.651 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-10-06T03:23:59.651 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-10-06T03:23:59.651 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:23:59.651 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-10-06T03:23:59.651 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:23:59.652 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-10-06T03:23:59.653 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:23:59.653 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:23:59.653 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:23:59.653 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-10-06T03:23:59.653 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-10-06T03:23:59.653 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-10-06T03:23:59.653 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:23:59.653 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:23:59.653 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.admin")) 2023-10-06T03:23:59.653 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:23:59.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.admin.98141.asok 2023-10-06T03:23:59.953 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.98141.asok 2023-10-06T03:23:59.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:23:59.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.98141.asok status 2023-10-06T03:24:00.104 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:24:00.104 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "admin", 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "98141", 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4458, 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4458 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 637748252 2023-10-06T03:24:00.109 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:00.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 637748252 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4458 192.168.0.1:0/637748252", 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/637748252", 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 6, 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 24, 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:24:00.111 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-10-06T03:24:00.111 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-10-06T03:24:00.111 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:24:00.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:00.114 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-10-06T03:24:00.114 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:24:00.129 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-10-06T03:24:00.129 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:24:00.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:00.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:24:00.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:00.195 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T03:24:00.304 INFO:teuthology.orchestra.run.smithi084.stdout:# file: . 2023-10-06T03:24:00.304 INFO:teuthology.orchestra.run.smithi084.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T03:24:00.304 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:00.304 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-10-06T03:24:00.304 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:24:00.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:24:00.337 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[98141]: fuse finished with error 0 and tester_r 0 2023-10-06T03:24:00.338 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:24:00.422 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:24:00.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:00.422 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T03:24:00.437 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.590+0000 7fdab3df9700 1 Processor -- start 2023-10-06T03:24:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.590+0000 7fdab3df9700 1 -- start start 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.591+0000 7fdab3df9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdaac1595a0 0x7fdaac0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.591+0000 7fdab3df9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac0b0ca0 con 0x7fdaac0b07a0 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.591+0000 7fdab3df9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac0b0f80 con 0x7fdaac0b49e0 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.591+0000 7fdab3df9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac0b1260 con 0x7fdaac1595a0 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.591+0000 7fdab1b95700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdaac1595a0 0x7fdaac0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.591+0000 7fdab2396700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdaac0b07a0 0x7fdaac0b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48222/0 (socket says 172.21.15.84:48222) 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.591+0000 7fdab2396700 1 -- 172.21.15.84:0/2430979707 learned_addr learned my addr 172.21.15.84:0/2430979707 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.591+0000 7fdab1b95700 1 -- 172.21.15.84:0/2430979707 >> v1:172.21.15.131:6789/0 conn(0x7fdaac0b49e0 legacy=0x7fdaac0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.591+0000 7fdab1b95700 1 -- 172.21.15.84:0/2430979707 >> v1:172.21.15.84:6789/0 conn(0x7fdaac0b07a0 legacy=0x7fdaac0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab1b95700 1 -- 172.21.15.84:0/2430979707 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac0b1540 con 0x7fdaac1595a0 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.591+0000 7fdab0b93700 1 -- 172.21.15.84:0/2430979707 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723426400 0 0) 0x7fdaac0b0ca0 con 0x7fdaac0b07a0 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab1b95700 1 --2- 172.21.15.84:0/2430979707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac1595a0 0x7fdaac0aa570 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009900 tx=0x7fdaa8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dbbb9c0e88687c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab0b93700 1 -- 172.21.15.84:0/2430979707 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8009ea0 con 0x7fdaac1595a0 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab0b93700 1 -- 172.21.15.84:0/2430979707 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa8005c10 con 0x7fdaac1595a0 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab0b93700 1 -- 172.21.15.84:0/2430979707 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800b5d0 con 0x7fdaac1595a0 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab3df9700 1 -- 172.21.15.84:0/2430979707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac1595a0 msgr2=0x7fdaac0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab3df9700 1 --2- 172.21.15.84:0/2430979707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac1595a0 0x7fdaac0aa570 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009900 tx=0x7fdaa8009120 comp rx=0 tx=0).stop 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab3df9700 1 -- 172.21.15.84:0/2430979707 shutdown_connections 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab3df9700 1 --2- 172.21.15.84:0/2430979707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac1595a0 0x7fdaac0aa570 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab3df9700 1 -- 172.21.15.84:0/2430979707 >> 172.21.15.84:0/2430979707 conn(0x7fdaac099830 msgr2=0x7fdaac06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab3df9700 1 -- 172.21.15.84:0/2430979707 shutdown_connections 2023-10-06T03:24:00.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.592+0000 7fdab3df9700 1 -- 172.21.15.84:0/2430979707 wait complete. 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.593+0000 7fdab3df9700 1 Processor -- start 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.593+0000 7fdab3df9700 1 -- start start 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab3df9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac0b07a0 0x7fdaac169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab3df9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaac0b49e0 0x7fdaac15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab3df9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaac1595a0 0x7fdaac1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab3df9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac15bc80 con 0x7fdaac0b07a0 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab3df9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac15bf60 con 0x7fdaac1595a0 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab3df9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac15c240 con 0x7fdaac0b49e0 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab1b95700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac0b07a0 0x7fdaac169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab1b95700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac0b07a0 0x7fdaac169d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33680/0 (socket says 172.21.15.84:33680) 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab1b95700 1 -- 172.21.15.84:0/480371783 learned_addr learned my addr 172.21.15.84:0/480371783 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab2396700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaac1595a0 0x7fdaac1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.594+0000 7fdab1394700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaac0b49e0 0x7fdaac15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdab1b95700 1 -- 172.21.15.84:0/480371783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaac0b49e0 msgr2=0x7fdaac15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdab1b95700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaac0b49e0 0x7fdaac15b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdab1b95700 1 -- 172.21.15.84:0/480371783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaac1595a0 msgr2=0x7fdaac1588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdab1b95700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaac1595a0 0x7fdaac1588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdab1b95700 1 -- 172.21.15.84:0/480371783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80093c0 con 0x7fdaac0b07a0 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdab1b95700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac0b07a0 0x7fdaac169d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8003080 tx=0x7fdaa8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdaa1ffb700 1 -- 172.21.15.84:0/480371783 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8006490 con 0x7fdaac0b07a0 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdaa1ffb700 1 -- 172.21.15.84:0/480371783 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa8006610 con 0x7fdaac0b07a0 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdab3df9700 1 -- 172.21.15.84:0/480371783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac15c520 con 0x7fdaac0b07a0 2023-10-06T03:24:00.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdaa1ffb700 1 -- 172.21.15.84:0/480371783 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa801c430 con 0x7fdaac0b07a0 2023-10-06T03:24:00.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.595+0000 7fdab3df9700 1 -- 172.21.15.84:0/480371783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac158e00 con 0x7fdaac0b07a0 2023-10-06T03:24:00.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.596+0000 7fdab3df9700 1 -- 172.21.15.84:0/480371783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac064ad0 con 0x7fdaac0b07a0 2023-10-06T03:24:00.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.596+0000 7fdaa1ffb700 1 -- 172.21.15.84:0/480371783 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdaa8023070 con 0x7fdaac0b07a0 2023-10-06T03:24:00.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.597+0000 7fdaa1ffb700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda90066f30 0x7fda900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.597+0000 7fdab1394700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda90066f30 0x7fda900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.597+0000 7fdaa1ffb700 1 -- 172.21.15.84:0/480371783 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdaa8086830 con 0x7fdaac0b07a0 2023-10-06T03:24:00.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.597+0000 7fdab1394700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda90066f30 0x7fda900693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0af900 tx=0x7fda9c007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.601+0000 7fdaa1ffb700 1 -- 172.21.15.84:0/480371783 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdaa8053650 con 0x7fdaac0b07a0 2023-10-06T03:24:00.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.785+0000 7fdab3df9700 1 -- 172.21.15.84:0/480371783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdaac0b1820 con 0x7fdaac0b07a0 2023-10-06T03:24:00.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.786+0000 7fdaa1ffb700 1 -- 172.21.15.84:0/480371783 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fdaa8056c70 con 0x7fdaac0b07a0 2023-10-06T03:24:00.788 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:00.788 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:00.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 -- 172.21.15.84:0/480371783 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda90066f30 msgr2=0x7fda900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda90066f30 0x7fda900693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0af900 tx=0x7fda9c007ec0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 -- 172.21.15.84:0/480371783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac0b07a0 msgr2=0x7fdaac169d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac0b07a0 0x7fdaac169d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8003080 tx=0x7fdaa8015000 comp rx=0 tx=0).stop 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 -- 172.21.15.84:0/480371783 shutdown_connections 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda90066f30 0x7fda900693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaac1595a0 0x7fdaac1588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaac0b07a0 0x7fdaac169d00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 --2- 172.21.15.84:0/480371783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaac0b49e0 0x7fdaac15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 -- 172.21.15.84:0/480371783 >> 172.21.15.84:0/480371783 conn(0x7fdaac099830 msgr2=0x7fdaac0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 -- 172.21.15.84:0/480371783 shutdown_connections 2023-10-06T03:24:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.789+0000 7fdab3df9700 1 -- 172.21.15.84:0/480371783 wait complete. 2023-10-06T03:24:00.803 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:00.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.915+0000 7f7dc155e700 1 Processor -- start 2023-10-06T03:24:00.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.915+0000 7f7dc155e700 1 -- start start 2023-10-06T03:24:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.916+0000 7f7dc155e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 0x7f7dbc06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.916+0000 7f7dc155e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7dbc0af6b0 0x7f7dbc157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.916+0000 7f7dc155e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc06b4b0 con 0x7f7dbc1573a0 2023-10-06T03:24:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.916+0000 7f7dc155e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dbc06abb0 con 0x7f7dbc0af6b0 2023-10-06T03:24:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.916+0000 7f7dc155e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0c9800 con 0x7f7dbc0b2860 2023-10-06T03:24:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.916+0000 7f7dc0d5d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7dbc0af6b0 0x7f7dbc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.916+0000 7f7dbb7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 0x7f7dbc06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.916+0000 7f7dc0d5d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7dbc0af6b0 0x7f7dbc157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56140/0 (socket says 172.21.15.84:56140) 2023-10-06T03:24:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.916+0000 7f7dbb7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 0x7f7dbc06eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55000/0 (socket says 172.21.15.84:55000) 2023-10-06T03:24:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.916+0000 7f7dc0d5d700 1 -- 172.21.15.84:0/1056778958 learned_addr learned my addr 172.21.15.84:0/1056778958 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.917+0000 7f7dc0d5d700 1 -- 172.21.15.84:0/1056778958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 msgr2=0x7f7dbc06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.917+0000 7f7dc0d5d700 1 --2- 172.21.15.84:0/1056778958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 0x7f7dbc06eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.917+0000 7f7dc0d5d700 1 -- 172.21.15.84:0/1056778958 >> v1:172.21.15.131:6789/0 conn(0x7f7dbc1573a0 legacy=0x7f7dbc0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.917+0000 7f7dc0d5d700 1 -- 172.21.15.84:0/1056778958 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc06a610 con 0x7f7dbc0af6b0 2023-10-06T03:24:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.917+0000 7f7dc0d5d700 1 --2- 172.21.15.84:0/1056778958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dbc0af6b0 0x7f7dbc157770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009f20 tx=0x7f7db4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81a6a25cbf4294c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.917+0000 7f7dbaffd700 1 -- 172.21.15.84:0/1056778958 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db400e070 con 0x7f7dbc0af6b0 2023-10-06T03:24:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.917+0000 7f7dbaffd700 1 -- 172.21.15.84:0/1056778958 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db400b9d0 con 0x7f7dbc0af6b0 2023-10-06T03:24:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.917+0000 7f7dbaffd700 1 -- 172.21.15.84:0/1056778958 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40092e0 con 0x7f7dbc0af6b0 2023-10-06T03:24:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.918+0000 7f7dc155e700 1 -- 172.21.15.84:0/1056778958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dbc0af6b0 msgr2=0x7f7dbc157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.918+0000 7f7dc155e700 1 --2- 172.21.15.84:0/1056778958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dbc0af6b0 0x7f7dbc157770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009f20 tx=0x7f7db4009840 comp rx=0 tx=0).stop 2023-10-06T03:24:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.918+0000 7f7dc155e700 1 -- 172.21.15.84:0/1056778958 shutdown_connections 2023-10-06T03:24:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.918+0000 7f7dc155e700 1 --2- 172.21.15.84:0/1056778958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dbc0af6b0 0x7f7dbc157770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.918+0000 7f7dc155e700 1 --2- 172.21.15.84:0/1056778958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 0x7f7dbc06eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.918+0000 7f7dc155e700 1 -- 172.21.15.84:0/1056778958 >> 172.21.15.84:0/1056778958 conn(0x7f7dbc0691d0 msgr2=0x7f7dbc0aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.918+0000 7f7dc155e700 1 -- 172.21.15.84:0/1056778958 shutdown_connections 2023-10-06T03:24:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.918+0000 7f7dc155e700 1 -- 172.21.15.84:0/1056778958 wait complete. 2023-10-06T03:24:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.919+0000 7f7dc155e700 1 Processor -- start 2023-10-06T03:24:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.919+0000 7f7dc155e700 1 -- start start 2023-10-06T03:24:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc155e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dbc0af6b0 0x7f7dbc16a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc155e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 0x7f7dbc1679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc155e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dbc1573a0 0x7f7dbc155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc155e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc167ee0 con 0x7f7dbc1573a0 2023-10-06T03:24:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc155e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc150690 con 0x7f7dbc0af6b0 2023-10-06T03:24:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc155e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc151830 con 0x7f7dbc0b2860 2023-10-06T03:24:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc0d5d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dbc1573a0 0x7f7dbc155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc0d5d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dbc1573a0 0x7f7dbc155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33682/0 (socket says 172.21.15.84:33682) 2023-10-06T03:24:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc0d5d700 1 -- 172.21.15.84:0/3329092476 learned_addr learned my addr 172.21.15.84:0/3329092476 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dbbfff700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dbc0af6b0 0x7f7dbc16a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dbb7fe700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 0x7f7dbc1679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc0d5d700 1 -- 172.21.15.84:0/3329092476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 msgr2=0x7f7dbc1679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc0d5d700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 0x7f7dbc1679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc0d5d700 1 -- 172.21.15.84:0/3329092476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dbc0af6b0 msgr2=0x7f7dbc16a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc0d5d700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dbc0af6b0 0x7f7dbc16a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc0d5d700 1 -- 172.21.15.84:0/3329092476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db4009ae0 con 0x7f7dbc1573a0 2023-10-06T03:24:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc0d5d700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dbc1573a0 0x7f7dbc155fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7db400b610 tx=0x7f7db4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7da3fff700 1 -- 172.21.15.84:0/3329092476 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db4008ad0 con 0x7f7dbc1573a0 2023-10-06T03:24:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7da3fff700 1 -- 172.21.15.84:0/3329092476 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db4008c30 con 0x7f7dbc1573a0 2023-10-06T03:24:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7dc155e700 1 -- 172.21.15.84:0/3329092476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc1523b0 con 0x7f7dbc1573a0 2023-10-06T03:24:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.920+0000 7f7da3fff700 1 -- 172.21.15.84:0/3329092476 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db4026460 con 0x7f7dbc1573a0 2023-10-06T03:24:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.921+0000 7f7dc155e700 1 -- 172.21.15.84:0/3329092476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dbc151d60 con 0x7f7dbc1573a0 2023-10-06T03:24:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.922+0000 7f7dc155e700 1 -- 172.21.15.84:0/3329092476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dbc152540 con 0x7f7dbc1573a0 2023-10-06T03:24:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.922+0000 7f7da3fff700 1 -- 172.21.15.84:0/3329092476 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7db4003040 con 0x7f7dbc1573a0 2023-10-06T03:24:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.922+0000 7f7da3fff700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7da8066f30 0x7f7da80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.922+0000 7f7da3fff700 1 -- 172.21.15.84:0/3329092476 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7db40867c0 con 0x7f7dbc1573a0 2023-10-06T03:24:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.922+0000 7f7dbbfff700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7da8066f30 0x7f7da80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.923+0000 7f7dbbfff700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7da8066f30 0x7f7da80693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0039e0 tx=0x7f7dac007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:00.926+0000 7f7da3fff700 1 -- 172.21.15.84:0/3329092476 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7db40535e0 con 0x7f7dbc1573a0 2023-10-06T03:24:01.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.112+0000 7f7dc155e700 1 -- 172.21.15.84:0/3329092476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7dbc05f270 con 0x7f7dbc1573a0 2023-10-06T03:24:01.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.112+0000 7f7da3fff700 1 -- 172.21.15.84:0/3329092476 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f7db4056c00 con 0x7f7dbc1573a0 2023-10-06T03:24:01.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:01.115 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:01.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 -- 172.21.15.84:0/3329092476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7da8066f30 msgr2=0x7f7da80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7da8066f30 0x7f7da80693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0039e0 tx=0x7f7dac007ec0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 -- 172.21.15.84:0/3329092476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dbc1573a0 msgr2=0x7f7dbc155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dbc1573a0 0x7f7dbc155fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7db400b610 tx=0x7f7db4018000 comp rx=0 tx=0).stop 2023-10-06T03:24:01.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 -- 172.21.15.84:0/3329092476 shutdown_connections 2023-10-06T03:24:01.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7da8066f30 0x7f7da80693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dbc0af6b0 0x7f7dbc16a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dbc1573a0 0x7f7dbc155fb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 --2- 172.21.15.84:0/3329092476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dbc0b2860 0x7f7dbc1679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 -- 172.21.15.84:0/3329092476 >> 172.21.15.84:0/3329092476 conn(0x7f7dbc0691d0 msgr2=0x7f7dbc1582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:01.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 -- 172.21.15.84:0/3329092476 shutdown_connections 2023-10-06T03:24:01.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.115+0000 7f7dc155e700 1 -- 172.21.15.84:0/3329092476 wait complete. 2023-10-06T03:24:01.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:24:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.245+0000 7fc79786e700 1 Processor -- start 2023-10-06T03:24:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.245+0000 7fc79786e700 1 -- start start 2023-10-06T03:24:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.245+0000 7fc79786e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc790159510 0x7fc7900cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc79786e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7901598e0 0x7fc7900cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc79786e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7900ce820 0x7fc7900cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc79786e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7900cf610 con 0x7fc7901598e0 2023-10-06T03:24:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc79786e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7900cf8f0 con 0x7fc790159510 2023-10-06T03:24:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc79786e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7900cfbd0 con 0x7fc7900ce820 2023-10-06T03:24:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc794e09700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7901598e0 0x7fc7900cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc794e09700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7901598e0 0x7fc7900cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33690/0 (socket says 172.21.15.84:33690) 2023-10-06T03:24:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc794e09700 1 -- 172.21.15.84:0/2831417718 learned_addr learned my addr 172.21.15.84:0/2831417718 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc795e0b700 1 --2- 172.21.15.84:0/2831417718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7900ce820 0x7fc7900cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc79560a700 1 --2- 172.21.15.84:0/2831417718 >> v2:172.21.15.131:3300/0 conn(0x7fc790159510 0x7fc7900cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc794e09700 1 -- 172.21.15.84:0/2831417718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7900ce820 msgr2=0x7fc7900cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc794e09700 1 --2- 172.21.15.84:0/2831417718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7900ce820 0x7fc7900cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc794e09700 1 -- 172.21.15.84:0/2831417718 >> v2:172.21.15.131:3300/0 conn(0x7fc790159510 msgr2=0x7fc7900cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc794e09700 1 --2- 172.21.15.84:0/2831417718 >> v2:172.21.15.131:3300/0 conn(0x7fc790159510 0x7fc7900cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc794e09700 1 -- 172.21.15.84:0/2831417718 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7900cfeb0 con 0x7fc7901598e0 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc794e09700 1 --2- 172.21.15.84:0/2831417718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7901598e0 0x7fc7900cbae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc790088fb0 tx=0x7fc784009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5af890997e0e4ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc78ffff700 1 -- 172.21.15.84:0/2831417718 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400b640 con 0x7fc7901598e0 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc78ffff700 1 -- 172.21.15.84:0/2831417718 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78400b7a0 con 0x7fc7901598e0 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.246+0000 7fc78ffff700 1 -- 172.21.15.84:0/2831417718 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400bb60 con 0x7fc7901598e0 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.247+0000 7fc79786e700 1 -- 172.21.15.84:0/2831417718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7901598e0 msgr2=0x7fc7900cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.247+0000 7fc79786e700 1 --2- 172.21.15.84:0/2831417718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7901598e0 0x7fc7900cbae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc790088fb0 tx=0x7fc784009250 comp rx=0 tx=0).stop 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.247+0000 7fc79786e700 1 -- 172.21.15.84:0/2831417718 shutdown_connections 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.247+0000 7fc79786e700 1 --2- 172.21.15.84:0/2831417718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7900ce820 0x7fc7900cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.247+0000 7fc79786e700 1 --2- 172.21.15.84:0/2831417718 >> v2:172.21.15.131:3300/0 conn(0x7fc790159510 0x7fc7900cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.247+0000 7fc79786e700 1 --2- 172.21.15.84:0/2831417718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7901598e0 0x7fc7900cbae0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.247+0000 7fc79786e700 1 -- 172.21.15.84:0/2831417718 >> 172.21.15.84:0/2831417718 conn(0x7fc790089e90 msgr2=0x7fc7900997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.247+0000 7fc79786e700 1 -- 172.21.15.84:0/2831417718 shutdown_connections 2023-10-06T03:24:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.247+0000 7fc79786e700 1 -- 172.21.15.84:0/2831417718 wait complete. 2023-10-06T03:24:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.248+0000 7fc79786e700 1 Processor -- start 2023-10-06T03:24:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.248+0000 7fc79786e700 1 -- start start 2023-10-06T03:24:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79786e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7900ce820 0x7fc790153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79786e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc790159510 0x7fc790169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79786e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7901598e0 0x7fc790169b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79786e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc790154be0 con 0x7fc7900ce820 2023-10-06T03:24:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79786e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79015b760 con 0x7fc7901598e0 2023-10-06T03:24:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79786e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc790153fd0 con 0x7fc790159510 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79560a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7900ce820 0x7fc790153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79560a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7900ce820 0x7fc790153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33702/0 (socket says 172.21.15.84:33702) 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79560a700 1 -- 172.21.15.84:0/3889736628 learned_addr learned my addr 172.21.15.84:0/3889736628 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc794e09700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc790159510 0x7fc790169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc795e0b700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7901598e0 0x7fc790169b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79560a700 1 -- 172.21.15.84:0/3889736628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc790159510 msgr2=0x7fc790169610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79560a700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc790159510 0x7fc790169610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79560a700 1 -- 172.21.15.84:0/3889736628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7901598e0 msgr2=0x7fc790169b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79560a700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7901598e0 0x7fc790169b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.249+0000 7fc79560a700 1 -- 172.21.15.84:0/3889736628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840094f0 con 0x7fc7900ce820 2023-10-06T03:24:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.250+0000 7fc79560a700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7900ce820 0x7fc790153580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc780009ef0 tx=0x7fc78000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.250+0000 7fc78d7fa700 1 -- 172.21.15.84:0/3889736628 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78000cb70 con 0x7fc7900ce820 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.250+0000 7fc78d7fa700 1 -- 172.21.15.84:0/3889736628 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78000f040 con 0x7fc7900ce820 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.250+0000 7fc79786e700 1 -- 172.21.15.84:0/3889736628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7901542b0 con 0x7fc7900ce820 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.250+0000 7fc78d7fa700 1 -- 172.21.15.84:0/3889736628 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780014480 con 0x7fc7900ce820 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.250+0000 7fc79786e700 1 -- 172.21.15.84:0/3889736628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc790154870 con 0x7fc7900ce820 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.251+0000 7fc79786e700 1 -- 172.21.15.84:0/3889736628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc790064ad0 con 0x7fc7900ce820 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.251+0000 7fc78d7fa700 1 -- 172.21.15.84:0/3889736628 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7800147f0 con 0x7fc7900ce820 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.251+0000 7fc78d7fa700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc77c066f30 0x7fc77c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.251+0000 7fc78d7fa700 1 -- 172.21.15.84:0/3889736628 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc780085300 con 0x7fc7900ce820 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.251+0000 7fc794e09700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc77c066f30 0x7fc77c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.252+0000 7fc794e09700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc77c066f30 0x7fc77c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc79008a870 tx=0x7fc784017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:01.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.255+0000 7fc78d7fa700 1 -- 172.21.15.84:0/3889736628 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc780052120 con 0x7fc7900ce820 2023-10-06T03:24:01.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:01.482+0000 7fc79786e700 1 -- 172.21.15.84:0/3889736628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc7900cf170 con 0x7fc7900ce820 2023-10-06T03:24:02.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.319+0000 7fc78d7fa700 1 -- 172.21.15.84:0/3889736628 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc780055740 con 0x7fc7900ce820 2023-10-06T03:24:02.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.321+0000 7fc79786e700 1 -- 172.21.15.84:0/3889736628 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc77c066f30 msgr2=0x7fc77c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.321+0000 7fc79786e700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc77c066f30 0x7fc77c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc79008a870 tx=0x7fc784017000 comp rx=0 tx=0).stop 2023-10-06T03:24:02.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.321+0000 7fc79786e700 1 -- 172.21.15.84:0/3889736628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7900ce820 msgr2=0x7fc790153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.321+0000 7fc79786e700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7900ce820 0x7fc790153580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc780009ef0 tx=0x7fc78000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:02.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.322+0000 7fc79786e700 1 -- 172.21.15.84:0/3889736628 shutdown_connections 2023-10-06T03:24:02.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.322+0000 7fc79786e700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc77c066f30 0x7fc77c0693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.322+0000 7fc79786e700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7901598e0 0x7fc790169b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.322+0000 7fc79786e700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7900ce820 0x7fc790153580 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.322+0000 7fc79786e700 1 --2- 172.21.15.84:0/3889736628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc790159510 0x7fc790169610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.322+0000 7fc79786e700 1 -- 172.21.15.84:0/3889736628 >> 172.21.15.84:0/3889736628 conn(0x7fc790089e90 msgr2=0x7fc7900cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.322+0000 7fc79786e700 1 -- 172.21.15.84:0/3889736628 shutdown_connections 2023-10-06T03:24:02.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.322+0000 7fc79786e700 1 -- 172.21.15.84:0/3889736628 wait complete. 2023-10-06T03:24:02.338 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:24:02.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.458+0000 7fca58ddc700 1 Processor -- start 2023-10-06T03:24:02.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.458+0000 7fca58ddc700 1 -- start start 2023-10-06T03:24:02.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.459+0000 7fca58ddc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fca541563b0 0x7fca5406f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.459+0000 7fca58ddc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca5406eae0 0x7fca540adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.459+0000 7fca58ddc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca540c84e0 con 0x7fca54156780 2023-10-06T03:24:02.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.459+0000 7fca58ddc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca540c78d0 con 0x7fca5406eae0 2023-10-06T03:24:02.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.459+0000 7fca58ddc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca540c7bb0 con 0x7fca541563b0 2023-10-06T03:24:02.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.459+0000 7fca52d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca5406eae0 0x7fca540adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca52d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca5406eae0 0x7fca540adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33716/0 (socket says 172.21.15.84:33716) 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca52d9d700 1 -- 172.21.15.84:0/871722736 learned_addr learned my addr 172.21.15.84:0/871722736 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca5259c700 1 --2- 172.21.15.84:0/871722736 >> v2:172.21.15.131:3300/0 conn(0x7fca541563b0 0x7fca5406f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca52d9d700 1 -- 172.21.15.84:0/871722736 >> v2:172.21.15.131:3300/0 conn(0x7fca541563b0 msgr2=0x7fca5406f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca52d9d700 1 --2- 172.21.15.84:0/871722736 >> v2:172.21.15.131:3300/0 conn(0x7fca541563b0 0x7fca5406f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca52d9d700 1 -- 172.21.15.84:0/871722736 >> v1:172.21.15.131:6789/0 conn(0x7fca54156780 legacy=0x7fca5406e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca52d9d700 1 -- 172.21.15.84:0/871722736 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540c7e90 con 0x7fca5406eae0 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca5259c700 1 --2- 172.21.15.84:0/871722736 >> v2:172.21.15.131:3300/0 conn(0x7fca541563b0 0x7fca5406f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca52d9d700 1 --2- 172.21.15.84:0/871722736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 0x7fca540adb70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fca5406df80 tx=0x7fca4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4882725c363b7391 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca5159a700 1 -- 172.21.15.84:0/871722736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00b820 con 0x7fca5406eae0 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca5159a700 1 -- 172.21.15.84:0/871722736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c00b980 con 0x7fca5406eae0 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca5159a700 1 -- 172.21.15.84:0/871722736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00bd20 con 0x7fca5406eae0 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.460+0000 7fca58ddc700 1 -- 172.21.15.84:0/871722736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 msgr2=0x7fca540adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.461+0000 7fca58ddc700 1 --2- 172.21.15.84:0/871722736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 0x7fca540adb70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fca5406df80 tx=0x7fca4c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.461+0000 7fca58ddc700 1 -- 172.21.15.84:0/871722736 shutdown_connections 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.461+0000 7fca58ddc700 1 --2- 172.21.15.84:0/871722736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 0x7fca540adb70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.461+0000 7fca58ddc700 1 --2- 172.21.15.84:0/871722736 >> v2:172.21.15.131:3300/0 conn(0x7fca541563b0 0x7fca5406f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.461+0000 7fca58ddc700 1 -- 172.21.15.84:0/871722736 >> 172.21.15.84:0/871722736 conn(0x7fca54069190 msgr2=0x7fca540cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.461+0000 7fca58ddc700 1 -- 172.21.15.84:0/871722736 shutdown_connections 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.461+0000 7fca58ddc700 1 -- 172.21.15.84:0/871722736 wait complete. 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca58ddc700 1 Processor -- start 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca58ddc700 1 -- start start 2023-10-06T03:24:02.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca58ddc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 0x7fca540c0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca58ddc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca541563b0 0x7fca540c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca58ddc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca54156780 0x7fca540c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca58ddc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca540c2030 con 0x7fca5406eae0 2023-10-06T03:24:02.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca58ddc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca540c1420 con 0x7fca54156780 2023-10-06T03:24:02.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca58ddc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca540c1700 con 0x7fca541563b0 2023-10-06T03:24:02.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca5259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 0x7fca540c0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca5259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 0x7fca540c0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33726/0 (socket says 172.21.15.84:33726) 2023-10-06T03:24:02.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.462+0000 7fca5259c700 1 -- 172.21.15.84:0/2719538841 learned_addr learned my addr 172.21.15.84:0/2719538841 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca52d9d700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca54156780 0x7fca540c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca51d9b700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca541563b0 0x7fca540c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca5259c700 1 -- 172.21.15.84:0/2719538841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca541563b0 msgr2=0x7fca540c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca5259c700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca541563b0 0x7fca540c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca5259c700 1 -- 172.21.15.84:0/2719538841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca54156780 msgr2=0x7fca540c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca5259c700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca54156780 0x7fca540c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca5259c700 1 -- 172.21.15.84:0/2719538841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c0094f0 con 0x7fca5406eae0 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca52d9d700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca54156780 0x7fca540c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca5259c700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 0x7fca540c0960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fca4400a520 tx=0x7fca44007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca427fc700 1 -- 172.21.15.84:0/2719538841 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44008590 con 0x7fca5406eae0 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca427fc700 1 -- 172.21.15.84:0/2719538841 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca440086f0 con 0x7fca5406eae0 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca58ddc700 1 -- 172.21.15.84:0/2719538841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca540c19e0 con 0x7fca5406eae0 2023-10-06T03:24:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca427fc700 1 -- 172.21.15.84:0/2719538841 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44008a90 con 0x7fca5406eae0 2023-10-06T03:24:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.463+0000 7fca58ddc700 1 -- 172.21.15.84:0/2719538841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca540c71a0 con 0x7fca5406eae0 2023-10-06T03:24:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.464+0000 7fca58ddc700 1 -- 172.21.15.84:0/2719538841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca54064ad0 con 0x7fca5406eae0 2023-10-06T03:24:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.464+0000 7fca427fc700 1 -- 172.21.15.84:0/2719538841 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca44014410 con 0x7fca5406eae0 2023-10-06T03:24:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.465+0000 7fca427fc700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca34066f30 0x7fca340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.465+0000 7fca51d9b700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca34066f30 0x7fca340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.465+0000 7fca427fc700 1 -- 172.21.15.84:0/2719538841 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fca44085600 con 0x7fca5406eae0 2023-10-06T03:24:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.465+0000 7fca51d9b700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca34066f30 0x7fca340693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca541620c0 tx=0x7fca48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.469+0000 7fca427fc700 1 -- 172.21.15.84:0/2719538841 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca44052420 con 0x7fca5406eae0 2023-10-06T03:24:02.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:02.701+0000 7fca58ddc700 1 -- 172.21.15.84:0/2719538841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fca540c8170 con 0x7fca5406eae0 2023-10-06T03:24:03.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.589+0000 7fca427fc700 1 -- 172.21.15.84:0/2719538841 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fca44055a40 con 0x7fca5406eae0 2023-10-06T03:24:03.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 -- 172.21.15.84:0/2719538841 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca34066f30 msgr2=0x7fca340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca34066f30 0x7fca340693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca541620c0 tx=0x7fca48008040 comp rx=0 tx=0).stop 2023-10-06T03:24:03.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 -- 172.21.15.84:0/2719538841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 msgr2=0x7fca540c0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 0x7fca540c0960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fca4400a520 tx=0x7fca44007960 comp rx=0 tx=0).stop 2023-10-06T03:24:03.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 -- 172.21.15.84:0/2719538841 shutdown_connections 2023-10-06T03:24:03.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fca34066f30 0x7fca340693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca54156780 0x7fca540c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca5406eae0 0x7fca540c0960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 --2- 172.21.15.84:0/2719538841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca541563b0 0x7fca540c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 -- 172.21.15.84:0/2719538841 >> 172.21.15.84:0/2719538841 conn(0x7fca54069190 msgr2=0x7fca540cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:03.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 -- 172.21.15.84:0/2719538841 shutdown_connections 2023-10-06T03:24:03.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.592+0000 7fca58ddc700 1 -- 172.21.15.84:0/2719538841 wait complete. 2023-10-06T03:24:03.607 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:03.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.722+0000 7f88fa6c1700 1 Processor -- start 2023-10-06T03:24:03.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.722+0000 7f88fa6c1700 1 -- start start 2023-10-06T03:24:03.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88fa6c1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f88f41595a0 0x7f88f40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88fa6c1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88f40b07a0 0x7f88f40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88fa6c1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f40b0ca0 con 0x7f88f40b49e0 2023-10-06T03:24:03.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88fa6c1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40b0f80 con 0x7f88f41595a0 2023-10-06T03:24:03.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88fa6c1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40b1260 con 0x7f88f40b07a0 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f88f40b49e0 0x7f88f40aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48234/0 (socket says 172.21.15.84:48234) 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f37fe700 1 -- 172.21.15.84:0/2267193282 learned_addr learned my addr 172.21.15.84:0/2267193282 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f8c5e700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88f40b07a0 0x7f88f40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001750031 0 0) 0x7f88f40b0ca0 con 0x7f88f40b49e0 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f3fff700 1 --2- 172.21.15.84:0/2267193282 >> v2:172.21.15.131:3300/0 conn(0x7f88f41595a0 0x7f88f40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88dc003570 con 0x7f88f40b49e0 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2274115785 0 0) 0x7f88dc003570 con 0x7f88f40b49e0 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88f40b07a0 msgr2=0x7f88f40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88f40b07a0 0x7f88f40b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 >> v2:172.21.15.131:3300/0 conn(0x7f88f41595a0 msgr2=0x7f88f40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:03.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 --2- 172.21.15.84:0/2267193282 >> v2:172.21.15.131:3300/0 conn(0x7f88f41595a0 0x7f88f40aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40b1540 con 0x7f88f40b49e0 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f88e4001470 con 0x7f88f40b49e0 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f3fff700 1 --2- 172.21.15.84:0/2267193282 >> v2:172.21.15.131:3300/0 conn(0x7f88f41595a0 0x7f88f40aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 >> v1:172.21.15.84:6789/0 conn(0x7f88f40b49e0 legacy=0x7f88f40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88dc003a60 0x7f88dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88dc004810 0x7f88dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88f40b07a0 0x7f88dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40b0f80 con 0x7f88dc003a60 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40b1260 con 0x7f88dc004810 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc00bae0 con 0x7f88f40b07a0 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.723+0000 7f88f3fff700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88dc003a60 0x7f88dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f37fe700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88dc004810 0x7f88dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f8c5e700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88f40b07a0 0x7f88dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f3fff700 1 -- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88f40b07a0 msgr2=0x7f88dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f3fff700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88f40b07a0 0x7f88dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f3fff700 1 -- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88dc004810 msgr2=0x7f88dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f3fff700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88dc004810 0x7f88dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f3fff700 1 -- 172.21.15.84:0/2267193282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc003570 con 0x7f88dc003a60 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f3fff700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88dc003a60 0x7f88dc003e70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009bb0 tx=0x7f88e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e68fa428269c629 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8005ad0 con 0x7f88dc003a60 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e8005c30 con 0x7f88dc003a60 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f2ffd700 1 -- 172.21.15.84:0/2267193282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8005de0 con 0x7f88dc003a60 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88fa6c1700 1 -- 172.21.15.84:0/2267193282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88dc003a60 msgr2=0x7f88dc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88fa6c1700 1 --2- 172.21.15.84:0/2267193282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88dc003a60 0x7f88dc003e70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009bb0 tx=0x7f88e8008040 comp rx=0 tx=0).stop 2023-10-06T03:24:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.724+0000 7f88f8c5e700 1 -- 172.21.15.84:0/2267193282 reap_dead start 2023-10-06T03:24:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.725+0000 7f88fa6c1700 1 -- 172.21.15.84:0/2267193282 shutdown_connections 2023-10-06T03:24:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.725+0000 7f88fa6c1700 1 -- 172.21.15.84:0/2267193282 >> 172.21.15.84:0/2267193282 conn(0x7f88f4099830 msgr2=0x7f88f406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.725+0000 7f88fa6c1700 1 -- 172.21.15.84:0/2267193282 shutdown_connections 2023-10-06T03:24:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.725+0000 7f88fa6c1700 1 -- 172.21.15.84:0/2267193282 wait complete. 2023-10-06T03:24:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.726+0000 7f88fa6c1700 1 Processor -- start 2023-10-06T03:24:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.726+0000 7f88fa6c1700 1 -- start start 2023-10-06T03:24:03.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88fa6c1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc003a60 0x7f88f414c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88fa6c1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88f40ab240 0x7f88f40ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88fa6c1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f415d300 0x7f88f415d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88fa6c1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f414cf00 con 0x7f88f415d300 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88fa6c1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40abd00 con 0x7f88f40ab240 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88fa6c1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f415dcb0 con 0x7f88dc003a60 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f8c5e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f415d300 0x7f88f415d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f8c5e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f415d300 0x7f88f415d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33744/0 (socket says 172.21.15.84:33744) 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f8c5e700 1 -- 172.21.15.84:0/3892988827 learned_addr learned my addr 172.21.15.84:0/3892988827 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f37fe700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88f40ab240 0x7f88f40ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f3fff700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc003a60 0x7f88f414c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f8c5e700 1 -- 172.21.15.84:0/3892988827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc003a60 msgr2=0x7f88f414c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f8c5e700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc003a60 0x7f88f414c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f8c5e700 1 -- 172.21.15.84:0/3892988827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88f40ab240 msgr2=0x7f88f40ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f8c5e700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88f40ab240 0x7f88f40ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f8c5e700 1 -- 172.21.15.84:0/3892988827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f409bc50 con 0x7f88f415d300 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88f8c5e700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f415d300 0x7f88f415d770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f88f40b2f50 tx=0x7f88ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88dbfff700 1 -- 172.21.15.84:0/3892988827 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00e070 con 0x7f88f415d300 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88dbfff700 1 -- 172.21.15.84:0/3892988827 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec011d00 con 0x7f88f415d300 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88fa6c1700 1 -- 172.21.15.84:0/3892988827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f409bea0 con 0x7f88f415d300 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88dbfff700 1 -- 172.21.15.84:0/3892988827 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0166c0 con 0x7f88f415d300 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.727+0000 7f88fa6c1700 1 -- 172.21.15.84:0/3892988827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f409c460 con 0x7f88f415d300 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.728+0000 7f88fa6c1700 1 -- 172.21.15.84:0/3892988827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f4064ad0 con 0x7f88f415d300 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.729+0000 7f88dbfff700 1 -- 172.21.15.84:0/3892988827 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88ec016a70 con 0x7f88f415d300 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.729+0000 7f88dbfff700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f88e0066f30 0x7f88e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.729+0000 7f88f3fff700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f88e0066f30 0x7f88e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.729+0000 7f88dbfff700 1 -- 172.21.15.84:0/3892988827 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f88ec0856a0 con 0x7f88f415d300 2023-10-06T03:24:03.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.730+0000 7f88f3fff700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f88e0066f30 0x7f88e00693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f88e8006d60 tx=0x7f88e801a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:03.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.733+0000 7f88dbfff700 1 -- 172.21.15.84:0/3892988827 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88ec055f50 con 0x7f88f415d300 2023-10-06T03:24:03.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.958+0000 7f88fa6c1700 1 -- 172.21.15.84:0/3892988827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88f40b1820 con 0x7f88f415d300 2023-10-06T03:24:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.959+0000 7f88dbfff700 1 -- 172.21.15.84:0/3892988827 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f88ec055ae0 con 0x7f88f415d300 2023-10-06T03:24:03.961 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:03.961 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:49.917332+0000","modified":"2023-10-06T03:24:03.584509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 -- 172.21.15.84:0/3892988827 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f88e0066f30 msgr2=0x7f88e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f88e0066f30 0x7f88e00693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f88e8006d60 tx=0x7f88e801a000 comp rx=0 tx=0).stop 2023-10-06T03:24:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 -- 172.21.15.84:0/3892988827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f415d300 msgr2=0x7f88f415d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f415d300 0x7f88f415d770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f88f40b2f50 tx=0x7f88ec00b040 comp rx=0 tx=0).stop 2023-10-06T03:24:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 -- 172.21.15.84:0/3892988827 shutdown_connections 2023-10-06T03:24:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f88e0066f30 0x7f88e00693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f415d300 0x7f88f415d770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc003a60 0x7f88f414c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 --2- 172.21.15.84:0/3892988827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88f40ab240 0x7f88f40ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 -- 172.21.15.84:0/3892988827 >> 172.21.15.84:0/3892988827 conn(0x7f88f4099830 msgr2=0x7f88f40cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:03.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.960+0000 7f88fa6c1700 1 -- 172.21.15.84:0/3892988827 shutdown_connections 2023-10-06T03:24:03.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:03.961+0000 7f88fa6c1700 1 -- 172.21.15.84:0/3892988827 wait complete. 2023-10-06T03:24:03.965 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-10-06T03:24:03.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.086+0000 7fc00332d700 1 Processor -- start 2023-10-06T03:24:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.086+0000 7fc00332d700 1 -- start start 2023-10-06T03:24:04.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.087+0000 7fc00332d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbffc1595a0 0x7fbffc0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.087+0000 7fc00332d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbffc0b49e0 0x7fbffc0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.087+0000 7fc00332d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbffc0b0ca0 con 0x7fbffc0b07a0 2023-10-06T03:24:04.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.087+0000 7fc00332d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0b0f80 con 0x7fbffc0b49e0 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.087+0000 7fc00332d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0b1260 con 0x7fbffc1595a0 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.087+0000 7fc0008c8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbffc0b49e0 0x7fbffc0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.087+0000 7fc0008c8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbffc0b49e0 0x7fbffc0aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33746/0 (socket says 172.21.15.84:33746) 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.087+0000 7fc0008c8700 1 -- 172.21.15.84:0/1755728449 learned_addr learned my addr 172.21.15.84:0/1755728449 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.087+0000 7fc0010c9700 1 --2- 172.21.15.84:0/1755728449 >> v2:172.21.15.131:3300/0 conn(0x7fbffc1595a0 0x7fbffc0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc0008c8700 1 -- 172.21.15.84:0/1755728449 >> v2:172.21.15.131:3300/0 conn(0x7fbffc1595a0 msgr2=0x7fbffc0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc0008c8700 1 --2- 172.21.15.84:0/1755728449 >> v2:172.21.15.131:3300/0 conn(0x7fbffc1595a0 0x7fbffc0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc0008c8700 1 -- 172.21.15.84:0/1755728449 >> v1:172.21.15.131:6789/0 conn(0x7fbffc0b07a0 legacy=0x7fbffc0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc0008c8700 1 -- 172.21.15.84:0/1755728449 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc0b1540 con 0x7fbffc0b49e0 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc0008c8700 1 --2- 172.21.15.84:0/1755728449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc0b49e0 0x7fbffc0aaab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbff00099b0 tx=0x7fbff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99639ff651e4418 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fbffbfff700 1 -- 172.21.15.84:0/1755728449 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0009ea0 con 0x7fbffc0b49e0 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fbffbfff700 1 -- 172.21.15.84:0/1755728449 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff000b820 con 0x7fbffc0b49e0 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fbffbfff700 1 -- 172.21.15.84:0/1755728449 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff000bbc0 con 0x7fbffc0b49e0 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc00332d700 1 -- 172.21.15.84:0/1755728449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc0b49e0 msgr2=0x7fbffc0aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc00332d700 1 --2- 172.21.15.84:0/1755728449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc0b49e0 0x7fbffc0aaab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbff00099b0 tx=0x7fbff0009250 comp rx=0 tx=0).stop 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc00332d700 1 -- 172.21.15.84:0/1755728449 shutdown_connections 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc00332d700 1 --2- 172.21.15.84:0/1755728449 >> v2:172.21.15.131:3300/0 conn(0x7fbffc1595a0 0x7fbffc0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc00332d700 1 --2- 172.21.15.84:0/1755728449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc0b49e0 0x7fbffc0aaab0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc00332d700 1 -- 172.21.15.84:0/1755728449 >> 172.21.15.84:0/1755728449 conn(0x7fbffc099830 msgr2=0x7fbffc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:04.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc00332d700 1 -- 172.21.15.84:0/1755728449 shutdown_connections 2023-10-06T03:24:04.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.088+0000 7fc00332d700 1 -- 172.21.15.84:0/1755728449 wait complete. 2023-10-06T03:24:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.089+0000 7fc00332d700 1 Processor -- start 2023-10-06T03:24:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.090+0000 7fc00332d700 1 -- start start 2023-10-06T03:24:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.090+0000 7fc00332d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbffc0b07a0 0x7fbffc141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.090+0000 7fc00332d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbffc0b49e0 0x7fbffc153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.090+0000 7fc00332d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc1595a0 0x7fbffc154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.090+0000 7fc00332d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc140090 con 0x7fbffc1595a0 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.090+0000 7fc00332d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc13f480 con 0x7fbffc0b07a0 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.090+0000 7fc00332d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc13f760 con 0x7fbffc0b49e0 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0018ca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc1595a0 0x7fbffc154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0018ca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc1595a0 0x7fbffc154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33754/0 (socket says 172.21.15.84:33754) 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0018ca700 1 -- 172.21.15.84:0/2371667434 learned_addr learned my addr 172.21.15.84:0/2371667434 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0010c9700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbffc0b07a0 0x7fbffc141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0008c8700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbffc0b49e0 0x7fbffc153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0018ca700 1 -- 172.21.15.84:0/2371667434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbffc0b49e0 msgr2=0x7fbffc153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0018ca700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbffc0b49e0 0x7fbffc153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0018ca700 1 -- 172.21.15.84:0/2371667434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbffc0b07a0 msgr2=0x7fbffc141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0018ca700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbffc0b07a0 0x7fbffc141de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0018ca700 1 -- 172.21.15.84:0/2371667434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00094f0 con 0x7fbffc1595a0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc0018ca700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc1595a0 0x7fbffc154480 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbff400c560 tx=0x7fbff4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fbff97fa700 1 -- 172.21.15.84:0/2371667434 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4011590 con 0x7fbffc1595a0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fbff97fa700 1 -- 172.21.15.84:0/2371667434 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff40116f0 con 0x7fbffc1595a0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fbff97fa700 1 -- 172.21.15.84:0/2371667434 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4011ab0 con 0x7fbffc1595a0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc00332d700 1 -- 172.21.15.84:0/2371667434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc13fa40 con 0x7fbffc1595a0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.091+0000 7fc00332d700 1 -- 172.21.15.84:0/2371667434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc1549c0 con 0x7fbffc1595a0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.092+0000 7fc00332d700 1 -- 172.21.15.84:0/2371667434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc064ad0 con 0x7fbffc1595a0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.093+0000 7fbff97fa700 1 -- 172.21.15.84:0/2371667434 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbff401b3b0 con 0x7fbffc1595a0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.093+0000 7fbff97fa700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 0x7fbfe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.093+0000 7fc0010c9700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 0x7fbfe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.093+0000 7fbff97fa700 1 -- 172.21.15.84:0/2371667434 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbff4083d10 con 0x7fbffc1595a0 2023-10-06T03:24:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.093+0000 7fc0010c9700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 0x7fbfe80693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0b4880 tx=0x7fbfec00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.097+0000 7fbff97fa700 1 -- 172.21.15.84:0/2371667434 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbff4050b30 con 0x7fbffc1595a0 2023-10-06T03:24:04.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.282+0000 7fc00332d700 1 -- 172.21.15.84:0/2371667434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbffc0b1820 con 0x7fbffc1595a0 2023-10-06T03:24:04.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.283+0000 7fbff97fa700 1 -- 172.21.15.84:0/2371667434 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fbff4017070 con 0x7fbffc1595a0 2023-10-06T03:24:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:04.285 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:04.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 -- 172.21.15.84:0/2371667434 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 msgr2=0x7fbfe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 0x7fbfe80693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0b4880 tx=0x7fbfec00b040 comp rx=0 tx=0).stop 2023-10-06T03:24:04.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 -- 172.21.15.84:0/2371667434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc1595a0 msgr2=0x7fbffc154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc1595a0 0x7fbffc154480 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbff400c560 tx=0x7fbff4007ef0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 -- 172.21.15.84:0/2371667434 shutdown_connections 2023-10-06T03:24:04.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 0x7fbfe80693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbffc0b07a0 0x7fbffc141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbffc1595a0 0x7fbffc154480 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 --2- 172.21.15.84:0/2371667434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbffc0b49e0 0x7fbffc153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 -- 172.21.15.84:0/2371667434 >> 172.21.15.84:0/2371667434 conn(0x7fbffc099830 msgr2=0x7fbffc0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:04.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 -- 172.21.15.84:0/2371667434 shutdown_connections 2023-10-06T03:24:04.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.285+0000 7fc00332d700 1 -- 172.21.15.84:0/2371667434 wait complete. 2023-10-06T03:24:04.301 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:24:04.302 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.415+0000 7f5cda0de700 1 Processor -- start 2023-10-06T03:24:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.415+0000 7f5cda0de700 1 -- start start 2023-10-06T03:24:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cda0de700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd40b2620 0x7f5cd40b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cda0de700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5cd40b29f0 0x7f5cd4159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cda0de700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd40cbfe0 con 0x7f5cd41596a0 2023-10-06T03:24:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cda0de700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd40cb3d0 con 0x7f5cd40b29f0 2023-10-06T03:24:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cda0de700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40cb6b0 con 0x7f5cd40b2620 2023-10-06T03:24:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5cd41596a0 0x7f5cd4068580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48250/0 (socket says 172.21.15.84:48250) 2023-10-06T03:24:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd3fff700 1 -- 172.21.15.84:0/2074696219 learned_addr learned my addr 172.21.15.84:0/2074696219 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd37fe700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd40b2620 0x7f5cd40b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5ccaffd700 1 --2- 172.21.15.84:0/2074696219 >> v2:172.21.15.131:3300/0 conn(0x7f5cd40b29f0 0x7f5cd4159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822042669 0 0) 0x7f5cd40cbfe0 con 0x7f5cd41596a0 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc0003570 con 0x7f5cd41596a0 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279303023 0 0) 0x7f5cc0003570 con 0x7f5cd41596a0 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd40b2620 msgr2=0x7f5cd40b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd40b2620 0x7f5cd40b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 >> v2:172.21.15.131:3300/0 conn(0x7f5cd40b29f0 msgr2=0x7f5cd4159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 --2- 172.21.15.84:0/2074696219 >> v2:172.21.15.131:3300/0 conn(0x7f5cd40b29f0 0x7f5cd4159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd40cb990 con 0x7f5cd41596a0 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f5ccc0017f0 con 0x7f5cd41596a0 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 >> v1:172.21.15.84:6789/0 conn(0x7f5cd41596a0 legacy=0x7f5cd4068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd40b2620 0x7f5cc0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cc0003fe0 0x7f5cc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cc0004d50 0x7f5cc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40cb3d0 con 0x7f5cc0004d50 2023-10-06T03:24:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40cb6b0 con 0x7f5cc0003fe0 2023-10-06T03:24:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc000ba90 con 0x7f5cd40b2620 2023-10-06T03:24:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.416+0000 7f5ccaffd700 1 --2- 172.21.15.84:0/2074696219 >> v2:172.21.15.131:3300/0 conn(0x7f5cd40b29f0 0x7f5cd4159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd3fff700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cc0004d50 0x7f5cc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd37fe700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd40b2620 0x7f5cc0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5ccaffd700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cc0003fe0 0x7f5cc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd3fff700 1 -- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd40b2620 msgr2=0x7f5cc0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd3fff700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd40b2620 0x7f5cc0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd3fff700 1 -- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cc0003fe0 msgr2=0x7f5cc0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd3fff700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cc0003fe0 0x7f5cc0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd3fff700 1 -- 172.21.15.84:0/2074696219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc0003570 con 0x7f5cc0004d50 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd3fff700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cc0004d50 0x7f5cc00051c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00a970 tx=0x7f5ccc002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691ab5e40ccdf3f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0070d0 con 0x7f5cc0004d50 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc007270 con 0x7f5cc0004d50 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.417+0000 7f5cd2ffd700 1 -- 172.21.15.84:0/2074696219 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc007630 con 0x7f5cc0004d50 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.418+0000 7f5cda0de700 1 -- 172.21.15.84:0/2074696219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cc0004d50 msgr2=0x7f5cc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.418+0000 7f5cda0de700 1 --2- 172.21.15.84:0/2074696219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cc0004d50 0x7f5cc00051c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00a970 tx=0x7f5ccc002210 comp rx=0 tx=0).stop 2023-10-06T03:24:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.418+0000 7f5cd3fff700 1 -- 172.21.15.84:0/2074696219 reap_dead start 2023-10-06T03:24:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.418+0000 7f5cda0de700 1 -- 172.21.15.84:0/2074696219 shutdown_connections 2023-10-06T03:24:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.418+0000 7f5cda0de700 1 -- 172.21.15.84:0/2074696219 >> 172.21.15.84:0/2074696219 conn(0x7f5cd406ed20 msgr2=0x7f5cd406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.418+0000 7f5cda0de700 1 -- 172.21.15.84:0/2074696219 shutdown_connections 2023-10-06T03:24:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.418+0000 7f5cda0de700 1 -- 172.21.15.84:0/2074696219 wait complete. 2023-10-06T03:24:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.419+0000 7f5cda0de700 1 Processor -- start 2023-10-06T03:24:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.419+0000 7f5cda0de700 1 -- start start 2023-10-06T03:24:04.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cda0de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd415e500 0x7f5cd40c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cda0de700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd4169be0 0x7f5cd40c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cda0de700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cd40c9190 0x7f5cd415be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cda0de700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40c84e0 con 0x7f5cd415e500 2023-10-06T03:24:04.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cda0de700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40c87c0 con 0x7f5cd40c9190 2023-10-06T03:24:04.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cda0de700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd416a3c0 con 0x7f5cd4169be0 2023-10-06T03:24:04.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd415e500 0x7f5cd40c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd415e500 0x7f5cd40c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33774/0 (socket says 172.21.15.84:33774) 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd37fe700 1 -- 172.21.15.84:0/1080402402 learned_addr learned my addr 172.21.15.84:0/1080402402 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd3fff700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cd40c9190 0x7f5cd415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5ccaffd700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd4169be0 0x7f5cd40c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd37fe700 1 -- 172.21.15.84:0/1080402402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd4169be0 msgr2=0x7f5cd40c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd37fe700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd4169be0 0x7f5cd40c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd37fe700 1 -- 172.21.15.84:0/1080402402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cd40c9190 msgr2=0x7f5cd415be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd37fe700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cd40c9190 0x7f5cd415be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd37fe700 1 -- 172.21.15.84:0/1080402402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd416a6a0 con 0x7f5cd415e500 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd3fff700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cd40c9190 0x7f5cd415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5ccaffd700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd4169be0 0x7f5cd40c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cd37fe700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd415e500 0x7f5cd40c9f10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4011b40 tx=0x7f5cc4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5ccbfff700 1 -- 172.21.15.84:0/1080402402 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4005c10 con 0x7f5cd415e500 2023-10-06T03:24:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5ccbfff700 1 -- 172.21.15.84:0/1080402402 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc4005d70 con 0x7f5cd415e500 2023-10-06T03:24:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5ccbfff700 1 -- 172.21.15.84:0/1080402402 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc400fa30 con 0x7f5cd415e500 2023-10-06T03:24:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cda0de700 1 -- 172.21.15.84:0/1080402402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd416a980 con 0x7f5cd415e500 2023-10-06T03:24:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.420+0000 7f5cda0de700 1 -- 172.21.15.84:0/1080402402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd416a050 con 0x7f5cd415e500 2023-10-06T03:24:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.421+0000 7f5cda0de700 1 -- 172.21.15.84:0/1080402402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd4064ad0 con 0x7f5cd415e500 2023-10-06T03:24:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.422+0000 7f5ccbfff700 1 -- 172.21.15.84:0/1080402402 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cc4006050 con 0x7f5cd415e500 2023-10-06T03:24:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.422+0000 7f5ccbfff700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5cb4066f30 0x7f5cb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.422+0000 7f5ccbfff700 1 -- 172.21.15.84:0/1080402402 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5cc4085300 con 0x7f5cd415e500 2023-10-06T03:24:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.422+0000 7f5ccaffd700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5cb4066f30 0x7f5cb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.422+0000 7f5ccaffd700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5cb4066f30 0x7f5cb40693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0093f0 tx=0x7f5cbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.426+0000 7f5ccbfff700 1 -- 172.21.15.84:0/1080402402 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cc4052120 con 0x7f5cd415e500 2023-10-06T03:24:04.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.607+0000 7f5cda0de700 1 -- 172.21.15.84:0/1080402402 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5cd40c8620 con 0x7f5cb4066f30 2023-10-06T03:24:04.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.618+0000 7f5ccbfff700 1 -- 172.21.15.84:0/1080402402 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367651 (secure 0 0 0) 0x7f5cbc0139f0 con 0x7f5cb4066f30 2023-10-06T03:24:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 -- 172.21.15.84:0/1080402402 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5cb4066f30 msgr2=0x7f5cb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5cb4066f30 0x7f5cb40693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0093f0 tx=0x7f5cbc008040 comp rx=0 tx=0).stop 2023-10-06T03:24:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 -- 172.21.15.84:0/1080402402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd415e500 msgr2=0x7f5cd40c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd415e500 0x7f5cd40c9f10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4011b40 tx=0x7f5cc4009120 comp rx=0 tx=0).stop 2023-10-06T03:24:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 -- 172.21.15.84:0/1080402402 shutdown_connections 2023-10-06T03:24:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5cb4066f30 0x7f5cb40693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cd40c9190 0x7f5cd415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd415e500 0x7f5cd40c9f10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 --2- 172.21.15.84:0/1080402402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cd4169be0 0x7f5cd40c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 -- 172.21.15.84:0/1080402402 >> 172.21.15.84:0/1080402402 conn(0x7f5cd406ed20 msgr2=0x7f5cd40b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:04.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 -- 172.21.15.84:0/1080402402 shutdown_connections 2023-10-06T03:24:04.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.622+0000 7f5cda0de700 1 -- 172.21.15.84:0/1080402402 wait complete. 2023-10-06T03:24:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:24:04.639 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-06T03:24:03.042679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":328,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381508,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593212,"statfs":{"total":773094113280,"available":770655449088,"internally_reserved":0,"allocated":3280896,"data_stored":2021677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.486173"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561518+0000","last_change":"2023-10-06T03:23:50.561014+0000","last_active":"2023-10-06T03:23:54.561518+0000","last_peered":"2023-10-06T03:23:54.561518+0000","last_clean":"2023-10-06T03:23:54.561518+0000","last_became_active":"2023-10-06T03:23:50.560752+0000","last_became_peered":"2023-10-06T03:23:50.560752+0000","last_unstale":"2023-10-06T03:23:54.561518+0000","last_undegraded":"2023-10-06T03:23:54.561518+0000","last_fullsized":"2023-10-06T03:23:54.561518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:11.240323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561509+0000","last_change":"2023-10-06T03:23:50.554102+0000","last_active":"2023-10-06T03:23:54.561509+0000","last_peered":"2023-10-06T03:23:54.561509+0000","last_clean":"2023-10-06T03:23:54.561509+0000","last_became_active":"2023-10-06T03:23:50.553890+0000","last_became_peered":"2023-10-06T03:23:50.553890+0000","last_unstale":"2023-10-06T03:23:54.561509+0000","last_undegraded":"2023-10-06T03:23:54.561509+0000","last_fullsized":"2023-10-06T03:23:54.561509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570300+0000","last_change":"2023-10-06T03:23:50.547813+0000","last_active":"2023-10-06T03:23:54.570300+0000","last_peered":"2023-10-06T03:23:54.570300+0000","last_clean":"2023-10-06T03:23:54.570300+0000","last_became_active":"2023-10-06T03:23:50.547300+0000","last_became_peered":"2023-10-06T03:23:50.547300+0000","last_unstale":"2023-10-06T03:23:54.570300+0000","last_undegraded":"2023-10-06T03:23:54.570300+0000","last_fullsized":"2023-10-06T03:23:54.570300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:41.253538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572253+0000","last_change":"2023-10-06T03:23:50.555770+0000","last_active":"2023-10-06T03:23:54.572253+0000","last_peered":"2023-10-06T03:23:54.572253+0000","last_clean":"2023-10-06T03:23:54.572253+0000","last_became_active":"2023-10-06T03:23:50.555523+0000","last_became_peered":"2023-10-06T03:23:50.555523+0000","last_unstale":"2023-10-06T03:23:54.572253+0000","last_undegraded":"2023-10-06T03:23:54.572253+0000","last_fullsized":"2023-10-06T03:23:54.572253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:47.159183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567665+0000","last_change":"2023-10-06T03:23:50.560528+0000","last_active":"2023-10-06T03:23:54.567665+0000","last_peered":"2023-10-06T03:23:54.567665+0000","last_clean":"2023-10-06T03:23:54.567665+0000","last_became_active":"2023-10-06T03:23:50.560247+0000","last_became_peered":"2023-10-06T03:23:50.560247+0000","last_unstale":"2023-10-06T03:23:54.567665+0000","last_undegraded":"2023-10-06T03:23:54.567665+0000","last_fullsized":"2023-10-06T03:23:54.567665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570783+0000","last_change":"2023-10-06T03:23:50.546938+0000","last_active":"2023-10-06T03:23:54.570783+0000","last_peered":"2023-10-06T03:23:54.570783+0000","last_clean":"2023-10-06T03:23:54.570783+0000","last_became_active":"2023-10-06T03:23:50.546653+0000","last_became_peered":"2023-10-06T03:23:50.546653+0000","last_unstale":"2023-10-06T03:23:54.570783+0000","last_undegraded":"2023-10-06T03:23:54.570783+0000","last_fullsized":"2023-10-06T03:23:54.570783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560769+0000","last_change":"2023-10-06T03:23:50.553364+0000","last_active":"2023-10-06T03:23:54.560769+0000","last_peered":"2023-10-06T03:23:54.560769+0000","last_clean":"2023-10-06T03:23:54.560769+0000","last_became_active":"2023-10-06T03:23:50.553098+0000","last_became_peered":"2023-10-06T03:23:50.553098+0000","last_unstale":"2023-10-06T03:23:54.560769+0000","last_undegraded":"2023-10-06T03:23:54.560769+0000","last_fullsized":"2023-10-06T03:23:54.560769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559957+0000","last_change":"2023-10-06T03:23:50.556409+0000","last_active":"2023-10-06T03:23:54.559957+0000","last_peered":"2023-10-06T03:23:54.559957+0000","last_clean":"2023-10-06T03:23:54.559957+0000","last_became_active":"2023-10-06T03:23:50.556162+0000","last_became_peered":"2023-10-06T03:23:50.556162+0000","last_unstale":"2023-10-06T03:23:54.559957+0000","last_undegraded":"2023-10-06T03:23:54.559957+0000","last_fullsized":"2023-10-06T03:23:54.559957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565989+0000","last_change":"2023-10-06T03:23:50.548544+0000","last_active":"2023-10-06T03:23:54.565989+0000","last_peered":"2023-10-06T03:23:54.565989+0000","last_clean":"2023-10-06T03:23:54.565989+0000","last_became_active":"2023-10-06T03:23:50.548294+0000","last_became_peered":"2023-10-06T03:23:50.548294+0000","last_unstale":"2023-10-06T03:23:54.565989+0000","last_undegraded":"2023-10-06T03:23:54.565989+0000","last_fullsized":"2023-10-06T03:23:54.565989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561682+0000","last_change":"2023-10-06T03:23:50.547845+0000","last_active":"2023-10-06T03:23:54.561682+0000","last_peered":"2023-10-06T03:23:54.561682+0000","last_clean":"2023-10-06T03:23:54.561682+0000","last_became_active":"2023-10-06T03:23:50.547570+0000","last_became_peered":"2023-10-06T03:23:50.547570+0000","last_unstale":"2023-10-06T03:23:54.561682+0000","last_undegraded":"2023-10-06T03:23:54.561682+0000","last_fullsized":"2023-10-06T03:23:54.561682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570220+0000","last_change":"2023-10-06T03:23:50.554501+0000","last_active":"2023-10-06T03:23:54.570220+0000","last_peered":"2023-10-06T03:23:54.570220+0000","last_clean":"2023-10-06T03:23:54.570220+0000","last_became_active":"2023-10-06T03:23:50.554323+0000","last_became_peered":"2023-10-06T03:23:50.554323+0000","last_unstale":"2023-10-06T03:23:54.570220+0000","last_undegraded":"2023-10-06T03:23:54.570220+0000","last_fullsized":"2023-10-06T03:23:54.570220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:39.132842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561650+0000","last_change":"2023-10-06T03:23:50.556387+0000","last_active":"2023-10-06T03:23:54.561650+0000","last_peered":"2023-10-06T03:23:54.561650+0000","last_clean":"2023-10-06T03:23:54.561650+0000","last_became_active":"2023-10-06T03:23:50.556160+0000","last_became_peered":"2023-10-06T03:23:50.556160+0000","last_unstale":"2023-10-06T03:23:54.561650+0000","last_undegraded":"2023-10-06T03:23:54.561650+0000","last_fullsized":"2023-10-06T03:23:54.561650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:48.412426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561770+0000","last_change":"2023-10-06T03:23:50.560485+0000","last_active":"2023-10-06T03:23:54.561770+0000","last_peered":"2023-10-06T03:23:54.561770+0000","last_clean":"2023-10-06T03:23:54.561770+0000","last_became_active":"2023-10-06T03:23:50.560194+0000","last_became_peered":"2023-10-06T03:23:50.560194+0000","last_unstale":"2023-10-06T03:23:54.561770+0000","last_undegraded":"2023-10-06T03:23:54.561770+0000","last_fullsized":"2023-10-06T03:23:54.561770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:12.346557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560300+0000","last_change":"2023-10-06T03:23:50.551082+0000","last_active":"2023-10-06T03:23:54.560300+0000","last_peered":"2023-10-06T03:23:54.560300+0000","last_clean":"2023-10-06T03:23:54.560300+0000","last_became_active":"2023-10-06T03:23:50.550756+0000","last_became_peered":"2023-10-06T03:23:50.550756+0000","last_unstale":"2023-10-06T03:23:54.560300+0000","last_undegraded":"2023-10-06T03:23:54.560300+0000","last_fullsized":"2023-10-06T03:23:54.560300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560103+0000","last_change":"2023-10-06T03:23:50.553219+0000","last_active":"2023-10-06T03:23:54.560103+0000","last_peered":"2023-10-06T03:23:54.560103+0000","last_clean":"2023-10-06T03:23:54.560103+0000","last_became_active":"2023-10-06T03:23:50.552954+0000","last_became_peered":"2023-10-06T03:23:50.552954+0000","last_unstale":"2023-10-06T03:23:54.560103+0000","last_undegraded":"2023-10-06T03:23:54.560103+0000","last_fullsized":"2023-10-06T03:23:54.560103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568201+0000","last_change":"2023-10-06T03:23:50.538998+0000","last_active":"2023-10-06T03:23:54.568201+0000","last_peered":"2023-10-06T03:23:54.568201+0000","last_clean":"2023-10-06T03:23:54.568201+0000","last_became_active":"2023-10-06T03:23:50.538721+0000","last_became_peered":"2023-10-06T03:23:50.538721+0000","last_unstale":"2023-10-06T03:23:54.568201+0000","last_undegraded":"2023-10-06T03:23:54.568201+0000","last_fullsized":"2023-10-06T03:23:54.568201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566076+0000","last_change":"2023-10-06T03:23:50.548665+0000","last_active":"2023-10-06T03:23:54.566076+0000","last_peered":"2023-10-06T03:23:54.566076+0000","last_clean":"2023-10-06T03:23:54.566076+0000","last_became_active":"2023-10-06T03:23:50.548379+0000","last_became_peered":"2023-10-06T03:23:50.548379+0000","last_unstale":"2023-10-06T03:23:54.566076+0000","last_undegraded":"2023-10-06T03:23:54.566076+0000","last_fullsized":"2023-10-06T03:23:54.566076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:04.343209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570249+0000","last_change":"2023-10-06T03:23:50.547255+0000","last_active":"2023-10-06T03:23:54.570249+0000","last_peered":"2023-10-06T03:23:54.570249+0000","last_clean":"2023-10-06T03:23:54.570249+0000","last_became_active":"2023-10-06T03:23:50.546952+0000","last_became_peered":"2023-10-06T03:23:50.546952+0000","last_unstale":"2023-10-06T03:23:54.570249+0000","last_undegraded":"2023-10-06T03:23:54.570249+0000","last_fullsized":"2023-10-06T03:23:54.570249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:37.459738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.562026+0000","last_change":"2023-10-06T03:23:50.549274+0000","last_active":"2023-10-06T03:23:54.562026+0000","last_peered":"2023-10-06T03:23:54.562026+0000","last_clean":"2023-10-06T03:23:54.562026+0000","last_became_active":"2023-10-06T03:23:50.549011+0000","last_became_peered":"2023-10-06T03:23:50.549011+0000","last_unstale":"2023-10-06T03:23:54.562026+0000","last_undegraded":"2023-10-06T03:23:54.562026+0000","last_fullsized":"2023-10-06T03:23:54.562026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:21.634023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.571307+0000","last_change":"2023-10-06T03:23:50.553751+0000","last_active":"2023-10-06T03:23:54.571307+0000","last_peered":"2023-10-06T03:23:54.571307+0000","last_clean":"2023-10-06T03:23:54.571307+0000","last_became_active":"2023-10-06T03:23:50.553496+0000","last_became_peered":"2023-10-06T03:23:50.553496+0000","last_unstale":"2023-10-06T03:23:54.571307+0000","last_undegraded":"2023-10-06T03:23:54.571307+0000","last_fullsized":"2023-10-06T03:23:54.571307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:35.855132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561063+0000","last_change":"2023-10-06T03:23:50.549272+0000","last_active":"2023-10-06T03:23:54.561063+0000","last_peered":"2023-10-06T03:23:54.561063+0000","last_clean":"2023-10-06T03:23:54.561063+0000","last_became_active":"2023-10-06T03:23:50.548975+0000","last_became_peered":"2023-10-06T03:23:50.548975+0000","last_unstale":"2023-10-06T03:23:54.561063+0000","last_undegraded":"2023-10-06T03:23:54.561063+0000","last_fullsized":"2023-10-06T03:23:54.561063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.564941+0000","last_change":"2023-10-06T03:23:50.553906+0000","last_active":"2023-10-06T03:23:54.564941+0000","last_peered":"2023-10-06T03:23:54.564941+0000","last_clean":"2023-10-06T03:23:54.564941+0000","last_became_active":"2023-10-06T03:23:50.553657+0000","last_became_peered":"2023-10-06T03:23:50.553657+0000","last_unstale":"2023-10-06T03:23:54.564941+0000","last_undegraded":"2023-10-06T03:23:54.564941+0000","last_fullsized":"2023-10-06T03:23:54.564941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557967+0000","last_change":"2023-10-06T03:23:50.559812+0000","last_active":"2023-10-06T03:23:54.557967+0000","last_peered":"2023-10-06T03:23:54.557967+0000","last_clean":"2023-10-06T03:23:54.557967+0000","last_became_active":"2023-10-06T03:23:50.559490+0000","last_became_peered":"2023-10-06T03:23:50.559490+0000","last_unstale":"2023-10-06T03:23:54.557967+0000","last_undegraded":"2023-10-06T03:23:54.557967+0000","last_fullsized":"2023-10-06T03:23:54.557967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:03.745193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560369+0000","last_change":"2023-10-06T03:23:50.560701+0000","last_active":"2023-10-06T03:23:54.560369+0000","last_peered":"2023-10-06T03:23:54.560369+0000","last_clean":"2023-10-06T03:23:54.560369+0000","last_became_active":"2023-10-06T03:23:50.560415+0000","last_became_peered":"2023-10-06T03:23:50.560415+0000","last_unstale":"2023-10-06T03:23:54.560369+0000","last_undegraded":"2023-10-06T03:23:54.560369+0000","last_fullsized":"2023-10-06T03:23:54.560369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574718+0000","last_change":"2023-10-06T03:23:50.552568+0000","last_active":"2023-10-06T03:23:54.574718+0000","last_peered":"2023-10-06T03:23:54.574718+0000","last_clean":"2023-10-06T03:23:54.574718+0000","last_became_active":"2023-10-06T03:23:50.552323+0000","last_became_peered":"2023-10-06T03:23:50.552323+0000","last_unstale":"2023-10-06T03:23:54.574718+0000","last_undegraded":"2023-10-06T03:23:54.574718+0000","last_fullsized":"2023-10-06T03:23:54.574718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574482+0000","last_change":"2023-10-06T03:23:50.553152+0000","last_active":"2023-10-06T03:23:54.574482+0000","last_peered":"2023-10-06T03:23:54.574482+0000","last_clean":"2023-10-06T03:23:54.574482+0000","last_became_active":"2023-10-06T03:23:50.552841+0000","last_became_peered":"2023-10-06T03:23:50.552841+0000","last_unstale":"2023-10-06T03:23:54.574482+0000","last_undegraded":"2023-10-06T03:23:54.574482+0000","last_fullsized":"2023-10-06T03:23:54.574482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561676+0000","last_change":"2023-10-06T03:23:50.552461+0000","last_active":"2023-10-06T03:23:54.561676+0000","last_peered":"2023-10-06T03:23:54.561676+0000","last_clean":"2023-10-06T03:23:54.561676+0000","last_became_active":"2023-10-06T03:23:50.551071+0000","last_became_peered":"2023-10-06T03:23:50.551071+0000","last_unstale":"2023-10-06T03:23:54.561676+0000","last_undegraded":"2023-10-06T03:23:54.561676+0000","last_fullsized":"2023-10-06T03:23:54.561676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581529+0000","last_change":"2023-10-06T03:23:54.579111+0000","last_active":"2023-10-06T03:23:54.581529+0000","last_peered":"2023-10-06T03:23:54.581529+0000","last_clean":"2023-10-06T03:23:54.581529+0000","last_became_active":"2023-10-06T03:23:54.578715+0000","last_became_peered":"2023-10-06T03:23:54.578715+0000","last_unstale":"2023-10-06T03:23:54.581529+0000","last_undegraded":"2023-10-06T03:23:54.581529+0000","last_fullsized":"2023-10-06T03:23:54.581529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:35.035137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570617+0000","last_change":"2023-10-06T03:23:49.548044+0000","last_active":"2023-10-06T03:23:54.570617+0000","last_peered":"2023-10-06T03:23:54.570617+0000","last_clean":"2023-10-06T03:23:54.570617+0000","last_became_active":"2023-10-06T03:23:49.547760+0000","last_became_peered":"2023-10-06T03:23:49.547760+0000","last_unstale":"2023-10-06T03:23:54.570617+0000","last_undegraded":"2023-10-06T03:23:54.570617+0000","last_fullsized":"2023-10-06T03:23:54.570617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:20.629148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559115+0000","last_change":"2023-10-06T03:23:50.559669+0000","last_active":"2023-10-06T03:23:54.559115+0000","last_peered":"2023-10-06T03:23:54.559115+0000","last_clean":"2023-10-06T03:23:54.559115+0000","last_became_active":"2023-10-06T03:23:50.559405+0000","last_became_peered":"2023-10-06T03:23:50.559405+0000","last_unstale":"2023-10-06T03:23:54.559115+0000","last_undegraded":"2023-10-06T03:23:54.559115+0000","last_fullsized":"2023-10-06T03:23:54.559115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:37.459738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.584345+0000","last_change":"2023-10-06T03:23:54.583216+0000","last_active":"2023-10-06T03:23:54.584345+0000","last_peered":"2023-10-06T03:23:54.584345+0000","last_clean":"2023-10-06T03:23:54.584345+0000","last_became_active":"2023-10-06T03:23:54.582867+0000","last_became_peered":"2023-10-06T03:23:54.582867+0000","last_unstale":"2023-10-06T03:23:54.584345+0000","last_undegraded":"2023-10-06T03:23:54.584345+0000","last_fullsized":"2023-10-06T03:23:54.584345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:39.877535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573373+0000","last_change":"2023-10-06T03:23:49.550360+0000","last_active":"2023-10-06T03:23:54.573373+0000","last_peered":"2023-10-06T03:23:54.573373+0000","last_clean":"2023-10-06T03:23:54.573373+0000","last_became_active":"2023-10-06T03:23:49.550065+0000","last_became_peered":"2023-10-06T03:23:49.550065+0000","last_unstale":"2023-10-06T03:23:54.573373+0000","last_undegraded":"2023-10-06T03:23:54.573373+0000","last_fullsized":"2023-10-06T03:23:54.573373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:20.629148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565240+0000","last_change":"2023-10-06T03:23:50.538560+0000","last_active":"2023-10-06T03:23:54.565240+0000","last_peered":"2023-10-06T03:23:54.565240+0000","last_clean":"2023-10-06T03:23:54.565240+0000","last_became_active":"2023-10-06T03:23:50.538280+0000","last_became_peered":"2023-10-06T03:23:50.538280+0000","last_unstale":"2023-10-06T03:23:54.565240+0000","last_undegraded":"2023-10-06T03:23:54.565240+0000","last_fullsized":"2023-10-06T03:23:54.565240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.587526+0000","last_change":"2023-10-06T03:23:54.577798+0000","last_active":"2023-10-06T03:23:54.587526+0000","last_peered":"2023-10-06T03:23:54.587526+0000","last_clean":"2023-10-06T03:23:54.587526+0000","last_became_active":"2023-10-06T03:23:54.577365+0000","last_became_peered":"2023-10-06T03:23:54.577365+0000","last_unstale":"2023-10-06T03:23:54.587526+0000","last_undegraded":"2023-10-06T03:23:54.587526+0000","last_fullsized":"2023-10-06T03:23:54.587526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:29.084904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558191+0000","last_change":"2023-10-06T03:23:49.541525+0000","last_active":"2023-10-06T03:23:54.558191+0000","last_peered":"2023-10-06T03:23:54.558191+0000","last_clean":"2023-10-06T03:23:54.558191+0000","last_became_active":"2023-10-06T03:23:49.541237+0000","last_became_peered":"2023-10-06T03:23:49.541237+0000","last_unstale":"2023-10-06T03:23:54.558191+0000","last_undegraded":"2023-10-06T03:23:54.558191+0000","last_fullsized":"2023-10-06T03:23:54.558191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572886+0000","last_change":"2023-10-06T03:23:50.559460+0000","last_active":"2023-10-06T03:23:54.572886+0000","last_peered":"2023-10-06T03:23:54.572886+0000","last_clean":"2023-10-06T03:23:54.572886+0000","last_became_active":"2023-10-06T03:23:50.559195+0000","last_became_peered":"2023-10-06T03:23:50.559195+0000","last_unstale":"2023-10-06T03:23:54.572886+0000","last_undegraded":"2023-10-06T03:23:54.572886+0000","last_fullsized":"2023-10-06T03:23:54.572886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586096+0000","last_change":"2023-10-06T03:23:54.584333+0000","last_active":"2023-10-06T03:23:54.586096+0000","last_peered":"2023-10-06T03:23:54.586096+0000","last_clean":"2023-10-06T03:23:54.586096+0000","last_became_active":"2023-10-06T03:23:54.583941+0000","last_became_peered":"2023-10-06T03:23:54.583941+0000","last_unstale":"2023-10-06T03:23:54.586096+0000","last_undegraded":"2023-10-06T03:23:54.586096+0000","last_fullsized":"2023-10-06T03:23:54.586096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:41.482140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566163+0000","last_change":"2023-10-06T03:23:49.544125+0000","last_active":"2023-10-06T03:23:54.566163+0000","last_peered":"2023-10-06T03:23:54.566163+0000","last_clean":"2023-10-06T03:23:54.566163+0000","last_became_active":"2023-10-06T03:23:49.543568+0000","last_became_peered":"2023-10-06T03:23:49.543568+0000","last_unstale":"2023-10-06T03:23:54.566163+0000","last_undegraded":"2023-10-06T03:23:54.566163+0000","last_fullsized":"2023-10-06T03:23:54.566163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558099+0000","last_change":"2023-10-06T03:23:50.555547+0000","last_active":"2023-10-06T03:23:54.558099+0000","last_peered":"2023-10-06T03:23:54.558099+0000","last_clean":"2023-10-06T03:23:54.558099+0000","last_became_active":"2023-10-06T03:23:50.555001+0000","last_became_peered":"2023-10-06T03:23:50.555001+0000","last_unstale":"2023-10-06T03:23:54.558099+0000","last_undegraded":"2023-10-06T03:23:54.558099+0000","last_fullsized":"2023-10-06T03:23:54.558099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582762+0000","last_change":"2023-10-06T03:23:54.576856+0000","last_active":"2023-10-06T03:23:54.582762+0000","last_peered":"2023-10-06T03:23:54.582762+0000","last_clean":"2023-10-06T03:23:54.582762+0000","last_became_active":"2023-10-06T03:23:54.576400+0000","last_became_peered":"2023-10-06T03:23:54.576400+0000","last_unstale":"2023-10-06T03:23:54.582762+0000","last_undegraded":"2023-10-06T03:23:54.582762+0000","last_fullsized":"2023-10-06T03:23:54.582762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:38.847179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561597+0000","last_change":"2023-10-06T03:23:49.546821+0000","last_active":"2023-10-06T03:23:54.561597+0000","last_peered":"2023-10-06T03:23:54.561597+0000","last_clean":"2023-10-06T03:23:54.561597+0000","last_became_active":"2023-10-06T03:23:49.546548+0000","last_became_peered":"2023-10-06T03:23:49.546548+0000","last_unstale":"2023-10-06T03:23:54.561597+0000","last_undegraded":"2023-10-06T03:23:54.561597+0000","last_fullsized":"2023-10-06T03:23:54.561597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557846+0000","last_change":"2023-10-06T03:23:50.555413+0000","last_active":"2023-10-06T03:23:54.557846+0000","last_peered":"2023-10-06T03:23:54.557846+0000","last_clean":"2023-10-06T03:23:54.557846+0000","last_became_active":"2023-10-06T03:23:50.554715+0000","last_became_peered":"2023-10-06T03:23:50.554715+0000","last_unstale":"2023-10-06T03:23:54.557846+0000","last_undegraded":"2023-10-06T03:23:54.557846+0000","last_fullsized":"2023-10-06T03:23:54.557846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:04.343209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.577965+0000","last_change":"2023-10-06T03:23:54.573885+0000","last_active":"2023-10-06T03:23:54.577965+0000","last_peered":"2023-10-06T03:23:54.577965+0000","last_clean":"2023-10-06T03:23:54.577965+0000","last_became_active":"2023-10-06T03:23:54.573501+0000","last_became_peered":"2023-10-06T03:23:54.573501+0000","last_unstale":"2023-10-06T03:23:54.577965+0000","last_undegraded":"2023-10-06T03:23:54.577965+0000","last_fullsized":"2023-10-06T03:23:54.577965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:11.874759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561246+0000","last_change":"2023-10-06T03:23:49.549842+0000","last_active":"2023-10-06T03:23:54.561246+0000","last_peered":"2023-10-06T03:23:54.561246+0000","last_clean":"2023-10-06T03:23:54.561246+0000","last_became_active":"2023-10-06T03:23:49.549552+0000","last_became_peered":"2023-10-06T03:23:49.549552+0000","last_unstale":"2023-10-06T03:23:54.561246+0000","last_undegraded":"2023-10-06T03:23:54.561246+0000","last_fullsized":"2023-10-06T03:23:54.561246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:46.154308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574142+0000","last_change":"2023-10-06T03:23:50.556593+0000","last_active":"2023-10-06T03:23:54.574142+0000","last_peered":"2023-10-06T03:23:54.574142+0000","last_clean":"2023-10-06T03:23:54.574142+0000","last_became_active":"2023-10-06T03:23:50.556291+0000","last_became_peered":"2023-10-06T03:23:50.556291+0000","last_unstale":"2023-10-06T03:23:54.574142+0000","last_undegraded":"2023-10-06T03:23:54.574142+0000","last_fullsized":"2023-10-06T03:23:54.574142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.386684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586726+0000","last_change":"2023-10-06T03:23:54.585687+0000","last_active":"2023-10-06T03:23:54.586726+0000","last_peered":"2023-10-06T03:23:54.586726+0000","last_clean":"2023-10-06T03:23:54.586726+0000","last_became_active":"2023-10-06T03:23:54.585174+0000","last_became_peered":"2023-10-06T03:23:54.585174+0000","last_unstale":"2023-10-06T03:23:54.586726+0000","last_undegraded":"2023-10-06T03:23:54.586726+0000","last_fullsized":"2023-10-06T03:23:54.586726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:28.830749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.571227+0000","last_change":"2023-10-06T03:23:49.542417+0000","last_active":"2023-10-06T03:23:54.571227+0000","last_peered":"2023-10-06T03:23:54.571227+0000","last_clean":"2023-10-06T03:23:54.571227+0000","last_became_active":"2023-10-06T03:23:49.541619+0000","last_became_peered":"2023-10-06T03:23:49.541619+0000","last_unstale":"2023-10-06T03:23:54.571227+0000","last_undegraded":"2023-10-06T03:23:54.571227+0000","last_fullsized":"2023-10-06T03:23:54.571227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570210+0000","last_change":"2023-10-06T03:23:50.553384+0000","last_active":"2023-10-06T03:23:54.570210+0000","last_peered":"2023-10-06T03:23:54.570210+0000","last_clean":"2023-10-06T03:23:54.570210+0000","last_became_active":"2023-10-06T03:23:50.553071+0000","last_became_peered":"2023-10-06T03:23:50.553071+0000","last_unstale":"2023-10-06T03:23:54.570210+0000","last_undegraded":"2023-10-06T03:23:54.570210+0000","last_fullsized":"2023-10-06T03:23:54.570210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582553+0000","last_change":"2023-10-06T03:23:54.576003+0000","last_active":"2023-10-06T03:23:54.582553+0000","last_peered":"2023-10-06T03:23:54.582553+0000","last_clean":"2023-10-06T03:23:54.582553+0000","last_became_active":"2023-10-06T03:23:54.575595+0000","last_became_peered":"2023-10-06T03:23:54.575595+0000","last_unstale":"2023-10-06T03:23:54.582553+0000","last_undegraded":"2023-10-06T03:23:54.582553+0000","last_fullsized":"2023-10-06T03:23:54.582553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:56.213189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561136+0000","last_change":"2023-10-06T03:23:49.553574+0000","last_active":"2023-10-06T03:23:54.561136+0000","last_peered":"2023-10-06T03:23:54.561136+0000","last_clean":"2023-10-06T03:23:54.561136+0000","last_became_active":"2023-10-06T03:23:49.553287+0000","last_became_peered":"2023-10-06T03:23:49.553287+0000","last_unstale":"2023-10-06T03:23:54.561136+0000","last_undegraded":"2023-10-06T03:23:54.561136+0000","last_fullsized":"2023-10-06T03:23:54.561136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:30.660149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558194+0000","last_change":"2023-10-06T03:23:50.559333+0000","last_active":"2023-10-06T03:23:54.558194+0000","last_peered":"2023-10-06T03:23:54.558194+0000","last_clean":"2023-10-06T03:23:54.558194+0000","last_became_active":"2023-10-06T03:23:50.554903+0000","last_became_peered":"2023-10-06T03:23:50.554903+0000","last_unstale":"2023-10-06T03:23:54.558194+0000","last_undegraded":"2023-10-06T03:23:54.558194+0000","last_fullsized":"2023-10-06T03:23:54.558194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.578775+0000","last_change":"2023-10-06T03:23:54.576737+0000","last_active":"2023-10-06T03:23:54.578775+0000","last_peered":"2023-10-06T03:23:54.578775+0000","last_clean":"2023-10-06T03:23:54.578775+0000","last_became_active":"2023-10-06T03:23:54.576315+0000","last_became_peered":"2023-10-06T03:23:54.576315+0000","last_unstale":"2023-10-06T03:23:54.578775+0000","last_undegraded":"2023-10-06T03:23:54.578775+0000","last_fullsized":"2023-10-06T03:23:54.578775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:23.573045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565078+0000","last_change":"2023-10-06T03:23:49.541373+0000","last_active":"2023-10-06T03:23:54.565078+0000","last_peered":"2023-10-06T03:23:54.565078+0000","last_clean":"2023-10-06T03:23:54.565078+0000","last_became_active":"2023-10-06T03:23:49.541117+0000","last_became_peered":"2023-10-06T03:23:49.541117+0000","last_unstale":"2023-10-06T03:23:54.565078+0000","last_undegraded":"2023-10-06T03:23:54.565078+0000","last_fullsized":"2023-10-06T03:23:54.565078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:44.960845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561590+0000","last_change":"2023-10-06T03:23:50.552104+0000","last_active":"2023-10-06T03:23:54.561590+0000","last_peered":"2023-10-06T03:23:54.561590+0000","last_clean":"2023-10-06T03:23:54.561590+0000","last_became_active":"2023-10-06T03:23:50.550706+0000","last_became_peered":"2023-10-06T03:23:50.550706+0000","last_unstale":"2023-10-06T03:23:54.561590+0000","last_undegraded":"2023-10-06T03:23:54.561590+0000","last_fullsized":"2023-10-06T03:23:54.561590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.578733+0000","last_change":"2023-10-06T03:23:54.576258+0000","last_active":"2023-10-06T03:23:54.578733+0000","last_peered":"2023-10-06T03:23:54.578733+0000","last_clean":"2023-10-06T03:23:54.578733+0000","last_became_active":"2023-10-06T03:23:54.575885+0000","last_became_peered":"2023-10-06T03:23:54.575885+0000","last_unstale":"2023-10-06T03:23:54.578733+0000","last_undegraded":"2023-10-06T03:23:54.578733+0000","last_fullsized":"2023-10-06T03:23:54.578733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:34.771595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560193+0000","last_change":"2023-10-06T03:23:49.550646+0000","last_active":"2023-10-06T03:23:54.560193+0000","last_peered":"2023-10-06T03:23:54.560193+0000","last_clean":"2023-10-06T03:23:54.560193+0000","last_became_active":"2023-10-06T03:23:49.550390+0000","last_became_peered":"2023-10-06T03:23:49.550390+0000","last_unstale":"2023-10-06T03:23:54.560193+0000","last_undegraded":"2023-10-06T03:23:54.560193+0000","last_fullsized":"2023-10-06T03:23:54.560193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:26.970739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565649+0000","last_change":"2023-10-06T03:23:50.546312+0000","last_active":"2023-10-06T03:23:54.565649+0000","last_peered":"2023-10-06T03:23:54.565649+0000","last_clean":"2023-10-06T03:23:54.565649+0000","last_became_active":"2023-10-06T03:23:50.546061+0000","last_became_peered":"2023-10-06T03:23:50.546061+0000","last_unstale":"2023-10-06T03:23:54.565649+0000","last_undegraded":"2023-10-06T03:23:54.565649+0000","last_fullsized":"2023-10-06T03:23:54.565649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582076+0000","last_change":"2023-10-06T03:23:54.576371+0000","last_active":"2023-10-06T03:23:54.582076+0000","last_peered":"2023-10-06T03:23:54.582076+0000","last_clean":"2023-10-06T03:23:54.582076+0000","last_became_active":"2023-10-06T03:23:54.576017+0000","last_became_peered":"2023-10-06T03:23:54.576017+0000","last_unstale":"2023-10-06T03:23:54.582076+0000","last_undegraded":"2023-10-06T03:23:54.582076+0000","last_fullsized":"2023-10-06T03:23:54.582076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:38.847179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572371+0000","last_change":"2023-10-06T03:23:49.546273+0000","last_active":"2023-10-06T03:23:54.572371+0000","last_peered":"2023-10-06T03:23:54.572371+0000","last_clean":"2023-10-06T03:23:54.572371+0000","last_became_active":"2023-10-06T03:23:49.546030+0000","last_became_peered":"2023-10-06T03:23:49.546030+0000","last_unstale":"2023-10-06T03:23:54.572371+0000","last_undegraded":"2023-10-06T03:23:54.572371+0000","last_fullsized":"2023-10-06T03:23:54.572371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560122+0000","last_change":"2023-10-06T03:23:50.552633+0000","last_active":"2023-10-06T03:23:54.560122+0000","last_peered":"2023-10-06T03:23:54.560122+0000","last_clean":"2023-10-06T03:23:54.560122+0000","last_became_active":"2023-10-06T03:23:50.552401+0000","last_became_peered":"2023-10-06T03:23:50.552401+0000","last_unstale":"2023-10-06T03:23:54.560122+0000","last_undegraded":"2023-10-06T03:23:54.560122+0000","last_fullsized":"2023-10-06T03:23:54.560122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582883+0000","last_change":"2023-10-06T03:23:54.575577+0000","last_active":"2023-10-06T03:23:54.582883+0000","last_peered":"2023-10-06T03:23:54.582883+0000","last_clean":"2023-10-06T03:23:54.582883+0000","last_became_active":"2023-10-06T03:23:54.575207+0000","last_became_peered":"2023-10-06T03:23:54.575207+0000","last_unstale":"2023-10-06T03:23:54.582883+0000","last_undegraded":"2023-10-06T03:23:54.582883+0000","last_fullsized":"2023-10-06T03:23:54.582883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561649+0000","last_change":"2023-10-06T03:23:49.551635+0000","last_active":"2023-10-06T03:23:54.561649+0000","last_peered":"2023-10-06T03:23:54.561649+0000","last_clean":"2023-10-06T03:23:54.561649+0000","last_became_active":"2023-10-06T03:23:49.551383+0000","last_became_peered":"2023-10-06T03:23:49.551383+0000","last_unstale":"2023-10-06T03:23:54.561649+0000","last_undegraded":"2023-10-06T03:23:54.561649+0000","last_fullsized":"2023-10-06T03:23:54.561649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:28.615722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559800+0000","last_change":"2023-10-06T03:23:50.551380+0000","last_active":"2023-10-06T03:23:54.559800+0000","last_peered":"2023-10-06T03:23:54.559800+0000","last_clean":"2023-10-06T03:23:54.559800+0000","last_became_active":"2023-10-06T03:23:50.551113+0000","last_became_peered":"2023-10-06T03:23:50.551113+0000","last_unstale":"2023-10-06T03:23:54.559800+0000","last_undegraded":"2023-10-06T03:23:54.559800+0000","last_fullsized":"2023-10-06T03:23:54.559800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:28.082470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582682+0000","last_change":"2023-10-06T03:23:54.578999+0000","last_active":"2023-10-06T03:23:54.582682+0000","last_peered":"2023-10-06T03:23:54.582682+0000","last_clean":"2023-10-06T03:23:54.582682+0000","last_became_active":"2023-10-06T03:23:54.578680+0000","last_became_peered":"2023-10-06T03:23:54.578680+0000","last_unstale":"2023-10-06T03:23:54.582682+0000","last_undegraded":"2023-10-06T03:23:54.582682+0000","last_fullsized":"2023-10-06T03:23:54.582682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:46.387578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561434+0000","last_change":"2023-10-06T03:23:49.551746+0000","last_active":"2023-10-06T03:23:54.561434+0000","last_peered":"2023-10-06T03:23:54.561434+0000","last_clean":"2023-10-06T03:23:54.561434+0000","last_became_active":"2023-10-06T03:23:49.551502+0000","last_became_peered":"2023-10-06T03:23:49.551502+0000","last_unstale":"2023-10-06T03:23:54.561434+0000","last_undegraded":"2023-10-06T03:23:54.561434+0000","last_fullsized":"2023-10-06T03:23:54.561434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:16.290952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568892+0000","last_change":"2023-10-06T03:23:50.553384+0000","last_active":"2023-10-06T03:23:54.568892+0000","last_peered":"2023-10-06T03:23:54.568892+0000","last_clean":"2023-10-06T03:23:54.568892+0000","last_became_active":"2023-10-06T03:23:50.553111+0000","last_became_peered":"2023-10-06T03:23:50.553111+0000","last_unstale":"2023-10-06T03:23:54.568892+0000","last_undegraded":"2023-10-06T03:23:54.568892+0000","last_fullsized":"2023-10-06T03:23:54.568892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:29.722975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581802+0000","last_change":"2023-10-06T03:23:54.577157+0000","last_active":"2023-10-06T03:23:54.581802+0000","last_peered":"2023-10-06T03:23:54.581802+0000","last_clean":"2023-10-06T03:23:54.581802+0000","last_became_active":"2023-10-06T03:23:54.576783+0000","last_became_peered":"2023-10-06T03:23:54.576783+0000","last_unstale":"2023-10-06T03:23:54.581802+0000","last_undegraded":"2023-10-06T03:23:54.581802+0000","last_fullsized":"2023-10-06T03:23:54.581802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:07.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561143+0000","last_change":"2023-10-06T03:23:49.548189+0000","last_active":"2023-10-06T03:23:54.561143+0000","last_peered":"2023-10-06T03:23:54.561143+0000","last_clean":"2023-10-06T03:23:54.561143+0000","last_became_active":"2023-10-06T03:23:49.547936+0000","last_became_peered":"2023-10-06T03:23:49.547936+0000","last_unstale":"2023-10-06T03:23:54.561143+0000","last_undegraded":"2023-10-06T03:23:54.561143+0000","last_fullsized":"2023-10-06T03:23:54.561143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:42.983966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572005+0000","last_change":"2023-10-06T03:23:50.554414+0000","last_active":"2023-10-06T03:23:54.572005+0000","last_peered":"2023-10-06T03:23:54.572005+0000","last_clean":"2023-10-06T03:23:54.572005+0000","last_became_active":"2023-10-06T03:23:50.554126+0000","last_became_peered":"2023-10-06T03:23:50.554126+0000","last_unstale":"2023-10-06T03:23:54.572005+0000","last_undegraded":"2023-10-06T03:23:54.572005+0000","last_fullsized":"2023-10-06T03:23:54.572005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582750+0000","last_change":"2023-10-06T03:23:54.577469+0000","last_active":"2023-10-06T03:23:54.582750+0000","last_peered":"2023-10-06T03:23:54.582750+0000","last_clean":"2023-10-06T03:23:54.582750+0000","last_became_active":"2023-10-06T03:23:54.577100+0000","last_became_peered":"2023-10-06T03:23:54.577100+0000","last_unstale":"2023-10-06T03:23:54.582750+0000","last_undegraded":"2023-10-06T03:23:54.582750+0000","last_fullsized":"2023-10-06T03:23:54.582750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:41.482140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560302+0000","last_change":"2023-10-06T03:23:49.551245+0000","last_active":"2023-10-06T03:23:54.560302+0000","last_peered":"2023-10-06T03:23:54.560302+0000","last_clean":"2023-10-06T03:23:54.560302+0000","last_became_active":"2023-10-06T03:23:49.550981+0000","last_became_peered":"2023-10-06T03:23:49.550981+0000","last_unstale":"2023-10-06T03:23:54.560302+0000","last_undegraded":"2023-10-06T03:23:54.560302+0000","last_fullsized":"2023-10-06T03:23:54.560302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567343+0000","last_change":"2023-10-06T03:23:50.546972+0000","last_active":"2023-10-06T03:23:54.567343+0000","last_peered":"2023-10-06T03:23:54.567343+0000","last_clean":"2023-10-06T03:23:54.567343+0000","last_became_active":"2023-10-06T03:23:50.546729+0000","last_became_peered":"2023-10-06T03:23:50.546729+0000","last_unstale":"2023-10-06T03:23:54.567343+0000","last_undegraded":"2023-10-06T03:23:54.567343+0000","last_fullsized":"2023-10-06T03:23:54.567343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581894+0000","last_change":"2023-10-06T03:23:54.576116+0000","last_active":"2023-10-06T03:23:54.581894+0000","last_peered":"2023-10-06T03:23:54.581894+0000","last_clean":"2023-10-06T03:23:54.581894+0000","last_became_active":"2023-10-06T03:23:54.575714+0000","last_became_peered":"2023-10-06T03:23:54.575714+0000","last_unstale":"2023-10-06T03:23:54.581894+0000","last_undegraded":"2023-10-06T03:23:54.581894+0000","last_fullsized":"2023-10-06T03:23:54.581894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:33.745377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558207+0000","last_change":"2023-10-06T03:23:49.549931+0000","last_active":"2023-10-06T03:23:54.558207+0000","last_peered":"2023-10-06T03:23:54.558207+0000","last_clean":"2023-10-06T03:23:54.558207+0000","last_became_active":"2023-10-06T03:23:49.549675+0000","last_became_peered":"2023-10-06T03:23:49.549675+0000","last_unstale":"2023-10-06T03:23:54.558207+0000","last_undegraded":"2023-10-06T03:23:54.558207+0000","last_fullsized":"2023-10-06T03:23:54.558207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569852+0000","last_change":"2023-10-06T03:23:50.560836+0000","last_active":"2023-10-06T03:23:54.569852+0000","last_peered":"2023-10-06T03:23:54.569852+0000","last_clean":"2023-10-06T03:23:54.569852+0000","last_became_active":"2023-10-06T03:23:50.560582+0000","last_became_peered":"2023-10-06T03:23:50.560582+0000","last_unstale":"2023-10-06T03:23:54.569852+0000","last_undegraded":"2023-10-06T03:23:54.569852+0000","last_fullsized":"2023-10-06T03:23:54.569852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:53.298950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582964+0000","last_change":"2023-10-06T03:23:54.580383+0000","last_active":"2023-10-06T03:23:54.582964+0000","last_peered":"2023-10-06T03:23:54.582964+0000","last_clean":"2023-10-06T03:23:54.582964+0000","last_became_active":"2023-10-06T03:23:54.580033+0000","last_became_peered":"2023-10-06T03:23:54.580033+0000","last_unstale":"2023-10-06T03:23:54.582964+0000","last_undegraded":"2023-10-06T03:23:54.582964+0000","last_fullsized":"2023-10-06T03:23:54.582964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:01.313140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572093+0000","last_change":"2023-10-06T03:23:49.551405+0000","last_active":"2023-10-06T03:23:54.572093+0000","last_peered":"2023-10-06T03:23:54.572093+0000","last_clean":"2023-10-06T03:23:54.572093+0000","last_became_active":"2023-10-06T03:23:49.551030+0000","last_became_peered":"2023-10-06T03:23:49.551030+0000","last_unstale":"2023-10-06T03:23:54.572093+0000","last_undegraded":"2023-10-06T03:23:54.572093+0000","last_fullsized":"2023-10-06T03:23:54.572093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569949+0000","last_change":"2023-10-06T03:23:50.547982+0000","last_active":"2023-10-06T03:23:54.569949+0000","last_peered":"2023-10-06T03:23:54.569949+0000","last_clean":"2023-10-06T03:23:54.569949+0000","last_became_active":"2023-10-06T03:23:50.547602+0000","last_became_peered":"2023-10-06T03:23:50.547602+0000","last_unstale":"2023-10-06T03:23:54.569949+0000","last_undegraded":"2023-10-06T03:23:54.569949+0000","last_fullsized":"2023-10-06T03:23:54.569949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:03.745193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582140+0000","last_change":"2023-10-06T03:23:54.575198+0000","last_active":"2023-10-06T03:23:54.582140+0000","last_peered":"2023-10-06T03:23:54.582140+0000","last_clean":"2023-10-06T03:23:54.582140+0000","last_became_active":"2023-10-06T03:23:54.574788+0000","last_became_peered":"2023-10-06T03:23:54.574788+0000","last_unstale":"2023-10-06T03:23:54.582140+0000","last_undegraded":"2023-10-06T03:23:54.582140+0000","last_fullsized":"2023-10-06T03:23:54.582140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:20.930646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568731+0000","last_change":"2023-10-06T03:23:49.538200+0000","last_active":"2023-10-06T03:23:54.568731+0000","last_peered":"2023-10-06T03:23:54.568731+0000","last_clean":"2023-10-06T03:23:54.568731+0000","last_became_active":"2023-10-06T03:23:49.537928+0000","last_became_peered":"2023-10-06T03:23:49.537928+0000","last_unstale":"2023-10-06T03:23:54.568731+0000","last_undegraded":"2023-10-06T03:23:54.568731+0000","last_fullsized":"2023-10-06T03:23:54.568731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570161+0000","last_change":"2023-10-06T03:23:50.552986+0000","last_active":"2023-10-06T03:23:54.570161+0000","last_peered":"2023-10-06T03:23:54.570161+0000","last_clean":"2023-10-06T03:23:54.570161+0000","last_became_active":"2023-10-06T03:23:50.552689+0000","last_became_peered":"2023-10-06T03:23:50.552689+0000","last_unstale":"2023-10-06T03:23:54.570161+0000","last_undegraded":"2023-10-06T03:23:54.570161+0000","last_fullsized":"2023-10-06T03:23:54.570161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.579868+0000","last_change":"2023-10-06T03:23:54.578003+0000","last_active":"2023-10-06T03:23:54.579868+0000","last_peered":"2023-10-06T03:23:54.579868+0000","last_clean":"2023-10-06T03:23:54.579868+0000","last_became_active":"2023-10-06T03:23:54.577637+0000","last_became_peered":"2023-10-06T03:23:54.577637+0000","last_unstale":"2023-10-06T03:23:54.579868+0000","last_undegraded":"2023-10-06T03:23:54.579868+0000","last_fullsized":"2023-10-06T03:23:54.579868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:14.629579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557999+0000","last_change":"2023-10-06T03:23:49.550476+0000","last_active":"2023-10-06T03:23:54.557999+0000","last_peered":"2023-10-06T03:23:54.557999+0000","last_clean":"2023-10-06T03:23:54.557999+0000","last_became_active":"2023-10-06T03:23:49.549380+0000","last_became_peered":"2023-10-06T03:23:49.549380+0000","last_unstale":"2023-10-06T03:23:54.557999+0000","last_undegraded":"2023-10-06T03:23:54.557999+0000","last_fullsized":"2023-10-06T03:23:54.557999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.028565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574909+0000","last_change":"2023-10-06T03:23:50.556274+0000","last_active":"2023-10-06T03:23:54.574909+0000","last_peered":"2023-10-06T03:23:54.574909+0000","last_clean":"2023-10-06T03:23:54.574909+0000","last_became_active":"2023-10-06T03:23:50.555698+0000","last_became_peered":"2023-10-06T03:23:50.555698+0000","last_unstale":"2023-10-06T03:23:54.574909+0000","last_undegraded":"2023-10-06T03:23:54.574909+0000","last_fullsized":"2023-10-06T03:23:54.574909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585484+0000","last_change":"2023-10-06T03:23:54.583261+0000","last_active":"2023-10-06T03:23:54.585484+0000","last_peered":"2023-10-06T03:23:54.585484+0000","last_clean":"2023-10-06T03:23:54.585484+0000","last_became_active":"2023-10-06T03:23:54.582906+0000","last_became_peered":"2023-10-06T03:23:54.582906+0000","last_unstale":"2023-10-06T03:23:54.585484+0000","last_undegraded":"2023-10-06T03:23:54.585484+0000","last_fullsized":"2023-10-06T03:23:54.585484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:49.490384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559423+0000","last_change":"2023-10-06T03:23:49.542977+0000","last_active":"2023-10-06T03:23:54.559423+0000","last_peered":"2023-10-06T03:23:54.559423+0000","last_clean":"2023-10-06T03:23:54.559423+0000","last_became_active":"2023-10-06T03:23:49.541527+0000","last_became_peered":"2023-10-06T03:23:49.541527+0000","last_unstale":"2023-10-06T03:23:54.559423+0000","last_undegraded":"2023-10-06T03:23:54.559423+0000","last_fullsized":"2023-10-06T03:23:54.559423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570117+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:23:54.570117+0000","last_peered":"2023-10-06T03:23:54.570117+0000","last_clean":"2023-10-06T03:23:54.570117+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:23:54.570117+0000","last_undegraded":"2023-10-06T03:23:54.570117+0000","last_fullsized":"2023-10-06T03:23:54.570117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557888+0000","last_change":"2023-10-06T03:23:50.559454+0000","last_active":"2023-10-06T03:23:54.557888+0000","last_peered":"2023-10-06T03:23:54.557888+0000","last_clean":"2023-10-06T03:23:54.557888+0000","last_became_active":"2023-10-06T03:23:50.554761+0000","last_became_peered":"2023-10-06T03:23:50.554761+0000","last_unstale":"2023-10-06T03:23:54.557888+0000","last_undegraded":"2023-10-06T03:23:54.557888+0000","last_fullsized":"2023-10-06T03:23:54.557888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:42.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585917+0000","last_change":"2023-10-06T03:23:54.583446+0000","last_active":"2023-10-06T03:23:54.585917+0000","last_peered":"2023-10-06T03:23:54.585917+0000","last_clean":"2023-10-06T03:23:54.585917+0000","last_became_active":"2023-10-06T03:23:54.583023+0000","last_became_peered":"2023-10-06T03:23:54.583023+0000","last_unstale":"2023-10-06T03:23:54.585917+0000","last_undegraded":"2023-10-06T03:23:54.585917+0000","last_fullsized":"2023-10-06T03:23:54.585917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:03.806535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558092+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:23:54.558092+0000","last_peered":"2023-10-06T03:23:54.558092+0000","last_clean":"2023-10-06T03:23:54.558092+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:23:54.558092+0000","last_undegraded":"2023-10-06T03:23:54.558092+0000","last_fullsized":"2023-10-06T03:23:54.558092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.618705+0000","last_change":"2023-10-06T03:23:49.546452+0000","last_active":"2023-10-06T03:23:54.618705+0000","last_peered":"2023-10-06T03:23:54.618705+0000","last_clean":"2023-10-06T03:23:54.618705+0000","last_became_active":"2023-10-06T03:23:49.545885+0000","last_became_peered":"2023-10-06T03:23:49.545885+0000","last_unstale":"2023-10-06T03:23:54.618705+0000","last_undegraded":"2023-10-06T03:23:54.618705+0000","last_fullsized":"2023-10-06T03:23:54.618705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568810+0000","last_change":"2023-10-06T03:23:50.550474+0000","last_active":"2023-10-06T03:23:54.568810+0000","last_peered":"2023-10-06T03:23:54.568810+0000","last_clean":"2023-10-06T03:23:54.568810+0000","last_became_active":"2023-10-06T03:23:50.550207+0000","last_became_peered":"2023-10-06T03:23:50.550207+0000","last_unstale":"2023-10-06T03:23:54.568810+0000","last_undegraded":"2023-10-06T03:23:54.568810+0000","last_fullsized":"2023-10-06T03:23:54.568810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:42.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582115+0000","last_change":"2023-10-06T03:23:54.574338+0000","last_active":"2023-10-06T03:23:54.582115+0000","last_peered":"2023-10-06T03:23:54.582115+0000","last_clean":"2023-10-06T03:23:54.582115+0000","last_became_active":"2023-10-06T03:23:54.573845+0000","last_became_peered":"2023-10-06T03:23:54.573845+0000","last_unstale":"2023-10-06T03:23:54.582115+0000","last_undegraded":"2023-10-06T03:23:54.582115+0000","last_fullsized":"2023-10-06T03:23:54.582115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574305+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:23:54.574305+0000","last_peered":"2023-10-06T03:23:54.574305+0000","last_clean":"2023-10-06T03:23:54.574305+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:23:54.574305+0000","last_undegraded":"2023-10-06T03:23:54.574305+0000","last_fullsized":"2023-10-06T03:23:54.574305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560457+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:23:54.560457+0000","last_peered":"2023-10-06T03:23:54.560457+0000","last_clean":"2023-10-06T03:23:54.560457+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:23:54.560457+0000","last_undegraded":"2023-10-06T03:23:54.560457+0000","last_fullsized":"2023-10-06T03:23:54.560457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.564914+0000","last_change":"2023-10-06T03:23:49.548108+0000","last_active":"2023-10-06T03:23:54.564914+0000","last_peered":"2023-10-06T03:23:54.564914+0000","last_clean":"2023-10-06T03:23:54.564914+0000","last_became_active":"2023-10-06T03:23:49.547822+0000","last_became_peered":"2023-10-06T03:23:49.547822+0000","last_unstale":"2023-10-06T03:23:54.564914+0000","last_undegraded":"2023-10-06T03:23:54.564914+0000","last_fullsized":"2023-10-06T03:23:54.564914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565572+0000","last_change":"2023-10-06T03:23:50.553282+0000","last_active":"2023-10-06T03:23:54.565572+0000","last_peered":"2023-10-06T03:23:54.565572+0000","last_clean":"2023-10-06T03:23:54.565572+0000","last_became_active":"2023-10-06T03:23:50.553022+0000","last_became_peered":"2023-10-06T03:23:50.553022+0000","last_unstale":"2023-10-06T03:23:54.565572+0000","last_undegraded":"2023-10-06T03:23:54.565572+0000","last_fullsized":"2023-10-06T03:23:54.565572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585122+0000","last_change":"2023-10-06T03:23:54.579225+0000","last_active":"2023-10-06T03:23:54.585122+0000","last_peered":"2023-10-06T03:23:54.585122+0000","last_clean":"2023-10-06T03:23:54.585122+0000","last_became_active":"2023-10-06T03:23:54.578772+0000","last_became_peered":"2023-10-06T03:23:54.578772+0000","last_unstale":"2023-10-06T03:23:54.585122+0000","last_undegraded":"2023-10-06T03:23:54.585122+0000","last_fullsized":"2023-10-06T03:23:54.585122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:20.332751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.562142+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:23:54.562142+0000","last_peered":"2023-10-06T03:23:54.562142+0000","last_clean":"2023-10-06T03:23:54.562142+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:23:54.562142+0000","last_undegraded":"2023-10-06T03:23:54.562142+0000","last_fullsized":"2023-10-06T03:23:54.562142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573464+0000","last_change":"2023-10-06T03:23:49.543301+0000","last_active":"2023-10-06T03:23:54.573464+0000","last_peered":"2023-10-06T03:23:54.573464+0000","last_clean":"2023-10-06T03:23:54.573464+0000","last_became_active":"2023-10-06T03:23:49.543042+0000","last_became_peered":"2023-10-06T03:23:49.543042+0000","last_unstale":"2023-10-06T03:23:54.573464+0000","last_undegraded":"2023-10-06T03:23:54.573464+0000","last_fullsized":"2023-10-06T03:23:54.573464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:01.161389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574803+0000","last_change":"2023-10-06T03:23:50.556439+0000","last_active":"2023-10-06T03:23:54.574803+0000","last_peered":"2023-10-06T03:23:54.574803+0000","last_clean":"2023-10-06T03:23:54.574803+0000","last_became_active":"2023-10-06T03:23:50.556043+0000","last_became_peered":"2023-10-06T03:23:50.556043+0000","last_unstale":"2023-10-06T03:23:54.574803+0000","last_undegraded":"2023-10-06T03:23:54.574803+0000","last_fullsized":"2023-10-06T03:23:54.574803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:28.082470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.583328+0000","last_change":"2023-10-06T03:23:54.577530+0000","last_active":"2023-10-06T03:23:54.583328+0000","last_peered":"2023-10-06T03:23:54.583328+0000","last_clean":"2023-10-06T03:23:54.583328+0000","last_became_active":"2023-10-06T03:23:54.577161+0000","last_became_peered":"2023-10-06T03:23:54.577161+0000","last_unstale":"2023-10-06T03:23:54.583328+0000","last_undegraded":"2023-10-06T03:23:54.583328+0000","last_fullsized":"2023-10-06T03:23:54.583328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:01.313140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560295+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:23:54.560295+0000","last_peered":"2023-10-06T03:23:54.560295+0000","last_clean":"2023-10-06T03:23:54.560295+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:23:54.560295+0000","last_undegraded":"2023-10-06T03:23:54.560295+0000","last_fullsized":"2023-10-06T03:23:54.560295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558696+0000","last_change":"2023-10-06T03:23:49.548616+0000","last_active":"2023-10-06T03:23:54.558696+0000","last_peered":"2023-10-06T03:23:54.558696+0000","last_clean":"2023-10-06T03:23:54.558696+0000","last_became_active":"2023-10-06T03:23:49.548377+0000","last_became_peered":"2023-10-06T03:23:49.548377+0000","last_unstale":"2023-10-06T03:23:54.558696+0000","last_undegraded":"2023-10-06T03:23:54.558696+0000","last_fullsized":"2023-10-06T03:23:54.558696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:44.960845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572427+0000","last_change":"2023-10-06T03:23:50.558690+0000","last_active":"2023-10-06T03:23:54.572427+0000","last_peered":"2023-10-06T03:23:54.572427+0000","last_clean":"2023-10-06T03:23:54.572427+0000","last_became_active":"2023-10-06T03:23:50.558466+0000","last_became_peered":"2023-10-06T03:23:50.558466+0000","last_unstale":"2023-10-06T03:23:54.572427+0000","last_undegraded":"2023-10-06T03:23:54.572427+0000","last_fullsized":"2023-10-06T03:23:54.572427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.386684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.588069+0000","last_change":"2023-10-06T03:23:54.579261+0000","last_active":"2023-10-06T03:23:54.588069+0000","last_peered":"2023-10-06T03:23:54.588069+0000","last_clean":"2023-10-06T03:23:54.588069+0000","last_became_active":"2023-10-06T03:23:54.578854+0000","last_became_peered":"2023-10-06T03:23:54.578854+0000","last_unstale":"2023-10-06T03:23:54.588069+0000","last_undegraded":"2023-10-06T03:23:54.588069+0000","last_fullsized":"2023-10-06T03:23:54.588069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:26.465848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560024+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:23:54.560024+0000","last_peered":"2023-10-06T03:23:54.560024+0000","last_clean":"2023-10-06T03:23:54.560024+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:23:54.560024+0000","last_undegraded":"2023-10-06T03:23:54.560024+0000","last_fullsized":"2023-10-06T03:23:54.560024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570037+0000","last_change":"2023-10-06T03:23:49.547635+0000","last_active":"2023-10-06T03:23:54.570037+0000","last_peered":"2023-10-06T03:23:54.570037+0000","last_clean":"2023-10-06T03:23:54.570037+0000","last_became_active":"2023-10-06T03:23:49.545752+0000","last_became_peered":"2023-10-06T03:23:49.545752+0000","last_unstale":"2023-10-06T03:23:54.570037+0000","last_undegraded":"2023-10-06T03:23:54.570037+0000","last_fullsized":"2023-10-06T03:23:54.570037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574483+0000","last_change":"2023-10-06T03:23:50.549324+0000","last_active":"2023-10-06T03:23:54.574483+0000","last_peered":"2023-10-06T03:23:54.574483+0000","last_clean":"2023-10-06T03:23:54.574483+0000","last_became_active":"2023-10-06T03:23:50.546439+0000","last_became_peered":"2023-10-06T03:23:50.546439+0000","last_unstale":"2023-10-06T03:23:54.574483+0000","last_undegraded":"2023-10-06T03:23:54.574483+0000","last_fullsized":"2023-10-06T03:23:54.574483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:21.033440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.583424+0000","last_change":"2023-10-06T03:23:54.579994+0000","last_active":"2023-10-06T03:23:54.583424+0000","last_peered":"2023-10-06T03:23:54.583424+0000","last_clean":"2023-10-06T03:23:54.583424+0000","last_became_active":"2023-10-06T03:23:54.579608+0000","last_became_peered":"2023-10-06T03:23:54.579608+0000","last_unstale":"2023-10-06T03:23:54.583424+0000","last_undegraded":"2023-10-06T03:23:54.583424+0000","last_fullsized":"2023-10-06T03:23:54.583424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:43.155244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572140+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:23:54.572140+0000","last_peered":"2023-10-06T03:23:54.572140+0000","last_clean":"2023-10-06T03:23:54.572140+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:23:54.572140+0000","last_undegraded":"2023-10-06T03:23:54.572140+0000","last_fullsized":"2023-10-06T03:23:54.572140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574682+0000","last_change":"2023-10-06T03:23:49.545180+0000","last_active":"2023-10-06T03:23:54.574682+0000","last_peered":"2023-10-06T03:23:54.574682+0000","last_clean":"2023-10-06T03:23:54.574682+0000","last_became_active":"2023-10-06T03:23:49.544948+0000","last_became_peered":"2023-10-06T03:23:49.544948+0000","last_unstale":"2023-10-06T03:23:54.574682+0000","last_undegraded":"2023-10-06T03:23:54.574682+0000","last_fullsized":"2023-10-06T03:23:54.574682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567580+0000","last_change":"2023-10-06T03:23:50.550782+0000","last_active":"2023-10-06T03:23:54.567580+0000","last_peered":"2023-10-06T03:23:54.567580+0000","last_clean":"2023-10-06T03:23:54.567580+0000","last_became_active":"2023-10-06T03:23:50.550406+0000","last_became_peered":"2023-10-06T03:23:50.550406+0000","last_unstale":"2023-10-06T03:23:54.567580+0000","last_undegraded":"2023-10-06T03:23:54.567580+0000","last_fullsized":"2023-10-06T03:23:54.567580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.588080+0000","last_change":"2023-10-06T03:23:54.580162+0000","last_active":"2023-10-06T03:23:54.588080+0000","last_peered":"2023-10-06T03:23:54.588080+0000","last_clean":"2023-10-06T03:23:54.588080+0000","last_became_active":"2023-10-06T03:23:54.579792+0000","last_became_peered":"2023-10-06T03:23:54.579792+0000","last_unstale":"2023-10-06T03:23:54.588080+0000","last_undegraded":"2023-10-06T03:23:54.588080+0000","last_fullsized":"2023-10-06T03:23:54.588080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572797+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:23:54.572797+0000","last_peered":"2023-10-06T03:23:54.572797+0000","last_clean":"2023-10-06T03:23:54.572797+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:23:54.572797+0000","last_undegraded":"2023-10-06T03:23:54.572797+0000","last_fullsized":"2023-10-06T03:23:54.572797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561503+0000","last_change":"2023-10-06T03:23:49.544756+0000","last_active":"2023-10-06T03:23:54.561503+0000","last_peered":"2023-10-06T03:23:54.561503+0000","last_clean":"2023-10-06T03:23:54.561503+0000","last_became_active":"2023-10-06T03:23:49.544484+0000","last_became_peered":"2023-10-06T03:23:49.544484+0000","last_unstale":"2023-10-06T03:23:54.561503+0000","last_undegraded":"2023-10-06T03:23:54.561503+0000","last_fullsized":"2023-10-06T03:23:54.561503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573304+0000","last_change":"2023-10-06T03:23:50.553155+0000","last_active":"2023-10-06T03:23:54.573304+0000","last_peered":"2023-10-06T03:23:54.573304+0000","last_clean":"2023-10-06T03:23:54.573304+0000","last_became_active":"2023-10-06T03:23:50.552915+0000","last_became_peered":"2023-10-06T03:23:50.552915+0000","last_unstale":"2023-10-06T03:23:54.573304+0000","last_undegraded":"2023-10-06T03:23:54.573304+0000","last_fullsized":"2023-10-06T03:23:54.573304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581310+0000","last_change":"2023-10-06T03:23:54.580336+0000","last_active":"2023-10-06T03:23:54.581310+0000","last_peered":"2023-10-06T03:23:54.581310+0000","last_clean":"2023-10-06T03:23:54.581310+0000","last_became_active":"2023-10-06T03:23:54.579923+0000","last_became_peered":"2023-10-06T03:23:54.579923+0000","last_unstale":"2023-10-06T03:23:54.581310+0000","last_undegraded":"2023-10-06T03:23:54.581310+0000","last_fullsized":"2023-10-06T03:23:54.581310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:18.254667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567497+0000","last_change":"2023-10-06T03:23:49.551353+0000","last_active":"2023-10-06T03:23:54.567497+0000","last_peered":"2023-10-06T03:23:54.567497+0000","last_clean":"2023-10-06T03:23:54.567497+0000","last_became_active":"2023-10-06T03:23:49.550924+0000","last_became_peered":"2023-10-06T03:23:49.550924+0000","last_unstale":"2023-10-06T03:23:54.567497+0000","last_undegraded":"2023-10-06T03:23:54.567497+0000","last_fullsized":"2023-10-06T03:23:54.567497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561785+0000","last_change":"2023-10-06T03:23:50.548063+0000","last_active":"2023-10-06T03:23:54.561785+0000","last_peered":"2023-10-06T03:23:54.561785+0000","last_clean":"2023-10-06T03:23:54.561785+0000","last_became_active":"2023-10-06T03:23:50.547820+0000","last_became_peered":"2023-10-06T03:23:50.547820+0000","last_unstale":"2023-10-06T03:23:54.561785+0000","last_undegraded":"2023-10-06T03:23:54.561785+0000","last_fullsized":"2023-10-06T03:23:54.561785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:06.967901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.584497+0000","last_change":"2023-10-06T03:23:54.580975+0000","last_active":"2023-10-06T03:23:54.584497+0000","last_peered":"2023-10-06T03:23:54.584497+0000","last_clean":"2023-10-06T03:23:54.584497+0000","last_became_active":"2023-10-06T03:23:54.580530+0000","last_became_peered":"2023-10-06T03:23:54.580530+0000","last_unstale":"2023-10-06T03:23:54.584497+0000","last_undegraded":"2023-10-06T03:23:54.584497+0000","last_fullsized":"2023-10-06T03:23:54.584497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:26.465848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560207+0000","last_change":"2023-10-06T03:23:49.550718+0000","last_active":"2023-10-06T03:23:54.560207+0000","last_peered":"2023-10-06T03:23:54.560207+0000","last_clean":"2023-10-06T03:23:54.560207+0000","last_became_active":"2023-10-06T03:23:49.550451+0000","last_became_peered":"2023-10-06T03:23:49.550451+0000","last_unstale":"2023-10-06T03:23:54.560207+0000","last_undegraded":"2023-10-06T03:23:54.560207+0000","last_fullsized":"2023-10-06T03:23:54.560207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569944+0000","last_change":"2023-10-06T03:23:50.560044+0000","last_active":"2023-10-06T03:23:54.569944+0000","last_peered":"2023-10-06T03:23:54.569944+0000","last_clean":"2023-10-06T03:23:54.569944+0000","last_became_active":"2023-10-06T03:23:50.559762+0000","last_became_peered":"2023-10-06T03:23:50.559762+0000","last_unstale":"2023-10-06T03:23:54.569944+0000","last_undegraded":"2023-10-06T03:23:54.569944+0000","last_fullsized":"2023-10-06T03:23:54.569944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:57.290738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.577962+0000","last_change":"2023-10-06T03:23:54.572457+0000","last_active":"2023-10-06T03:23:54.577962+0000","last_peered":"2023-10-06T03:23:54.577962+0000","last_clean":"2023-10-06T03:23:54.577962+0000","last_became_active":"2023-10-06T03:23:54.571942+0000","last_became_peered":"2023-10-06T03:23:54.571942+0000","last_unstale":"2023-10-06T03:23:54.577962+0000","last_undegraded":"2023-10-06T03:23:54.577962+0000","last_fullsized":"2023-10-06T03:23:54.577962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:04.871504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561406+0000","last_change":"2023-10-06T03:23:49.550646+0000","last_active":"2023-10-06T03:23:54.561406+0000","last_peered":"2023-10-06T03:23:54.561406+0000","last_clean":"2023-10-06T03:23:54.561406+0000","last_became_active":"2023-10-06T03:23:49.550386+0000","last_became_peered":"2023-10-06T03:23:49.550386+0000","last_unstale":"2023-10-06T03:23:54.561406+0000","last_undegraded":"2023-10-06T03:23:54.561406+0000","last_fullsized":"2023-10-06T03:23:54.561406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570428+0000","last_change":"2023-10-06T03:23:50.546985+0000","last_active":"2023-10-06T03:23:54.570428+0000","last_peered":"2023-10-06T03:23:54.570428+0000","last_clean":"2023-10-06T03:23:54.570428+0000","last_became_active":"2023-10-06T03:23:50.546697+0000","last_became_peered":"2023-10-06T03:23:50.546697+0000","last_unstale":"2023-10-06T03:23:54.570428+0000","last_undegraded":"2023-10-06T03:23:54.570428+0000","last_fullsized":"2023-10-06T03:23:54.570428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:14.232265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582421+0000","last_change":"2023-10-06T03:23:54.580064+0000","last_active":"2023-10-06T03:23:54.582421+0000","last_peered":"2023-10-06T03:23:54.582421+0000","last_clean":"2023-10-06T03:23:54.582421+0000","last_became_active":"2023-10-06T03:23:54.579678+0000","last_became_peered":"2023-10-06T03:23:54.579678+0000","last_unstale":"2023-10-06T03:23:54.582421+0000","last_undegraded":"2023-10-06T03:23:54.582421+0000","last_fullsized":"2023-10-06T03:23:54.582421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:35.686057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559611+0000","last_change":"2023-10-06T03:23:49.548219+0000","last_active":"2023-10-06T03:23:54.559611+0000","last_peered":"2023-10-06T03:23:54.559611+0000","last_clean":"2023-10-06T03:23:54.559611+0000","last_became_active":"2023-10-06T03:23:49.547961+0000","last_became_peered":"2023-10-06T03:23:49.547961+0000","last_unstale":"2023-10-06T03:23:54.559611+0000","last_undegraded":"2023-10-06T03:23:54.559611+0000","last_fullsized":"2023-10-06T03:23:54.559611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:26.970739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557859+0000","last_change":"2023-10-06T03:23:50.551706+0000","last_active":"2023-10-06T03:23:54.557859+0000","last_peered":"2023-10-06T03:23:54.557859+0000","last_clean":"2023-10-06T03:23:54.557859+0000","last_became_active":"2023-10-06T03:23:50.551421+0000","last_became_peered":"2023-10-06T03:23:50.551421+0000","last_unstale":"2023-10-06T03:23:54.557859+0000","last_undegraded":"2023-10-06T03:23:54.557859+0000","last_fullsized":"2023-10-06T03:23:54.557859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:16.310349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586634+0000","last_change":"2023-10-06T03:23:54.585084+0000","last_active":"2023-10-06T03:23:54.586634+0000","last_peered":"2023-10-06T03:23:54.586634+0000","last_clean":"2023-10-06T03:23:54.586634+0000","last_became_active":"2023-10-06T03:23:54.584340+0000","last_became_peered":"2023-10-06T03:23:54.584340+0000","last_unstale":"2023-10-06T03:23:54.586634+0000","last_undegraded":"2023-10-06T03:23:54.586634+0000","last_fullsized":"2023-10-06T03:23:54.586634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:56.706198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566271+0000","last_change":"2023-10-06T03:23:49.544298+0000","last_active":"2023-10-06T03:23:54.566271+0000","last_peered":"2023-10-06T03:23:54.566271+0000","last_clean":"2023-10-06T03:23:54.566271+0000","last_became_active":"2023-10-06T03:23:49.543893+0000","last_became_peered":"2023-10-06T03:23:49.543893+0000","last_unstale":"2023-10-06T03:23:54.566271+0000","last_undegraded":"2023-10-06T03:23:54.566271+0000","last_fullsized":"2023-10-06T03:23:54.566271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568117+0000","last_change":"2023-10-06T03:23:50.553611+0000","last_active":"2023-10-06T03:23:54.568117+0000","last_peered":"2023-10-06T03:23:54.568117+0000","last_clean":"2023-10-06T03:23:54.568117+0000","last_became_active":"2023-10-06T03:23:50.553182+0000","last_became_peered":"2023-10-06T03:23:50.553182+0000","last_unstale":"2023-10-06T03:23:54.568117+0000","last_undegraded":"2023-10-06T03:23:54.568117+0000","last_fullsized":"2023-10-06T03:23:54.568117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:16.310349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572471+0000","last_change":"2023-10-06T03:23:50.553726+0000","last_active":"2023-10-06T03:23:54.572471+0000","last_peered":"2023-10-06T03:23:54.572471+0000","last_clean":"2023-10-06T03:23:54.572471+0000","last_became_active":"2023-10-06T03:23:50.553470+0000","last_became_peered":"2023-10-06T03:23:50.553470+0000","last_unstale":"2023-10-06T03:23:54.572471+0000","last_undegraded":"2023-10-06T03:23:54.572471+0000","last_fullsized":"2023-10-06T03:23:54.572471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:29.620598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557956+0000","last_change":"2023-10-06T03:23:50.559351+0000","last_active":"2023-10-06T03:23:54.557956+0000","last_peered":"2023-10-06T03:23:54.557956+0000","last_clean":"2023-10-06T03:23:54.557956+0000","last_became_active":"2023-10-06T03:23:50.554817+0000","last_became_peered":"2023-10-06T03:23:50.554817+0000","last_unstale":"2023-10-06T03:23:54.557956+0000","last_undegraded":"2023-10-06T03:23:54.557956+0000","last_fullsized":"2023-10-06T03:23:54.557956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:29.722975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570702+0000","last_change":"2023-10-06T03:23:50.556578+0000","last_active":"2023-10-06T03:23:54.570702+0000","last_peered":"2023-10-06T03:23:54.570702+0000","last_clean":"2023-10-06T03:23:54.570702+0000","last_became_active":"2023-10-06T03:23:50.556314+0000","last_became_peered":"2023-10-06T03:23:50.556314+0000","last_unstale":"2023-10-06T03:23:54.570702+0000","last_undegraded":"2023-10-06T03:23:54.570702+0000","last_fullsized":"2023-10-06T03:23:54.570702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:00.849101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558641+0000","last_change":"2023-10-06T03:23:50.556963+0000","last_active":"2023-10-06T03:23:54.558641+0000","last_peered":"2023-10-06T03:23:54.558641+0000","last_clean":"2023-10-06T03:23:54.558641+0000","last_became_active":"2023-10-06T03:23:50.555458+0000","last_became_peered":"2023-10-06T03:23:50.555458+0000","last_unstale":"2023-10-06T03:23:54.558641+0000","last_undegraded":"2023-10-06T03:23:54.558641+0000","last_fullsized":"2023-10-06T03:23:54.558641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574585+0000","last_change":"2023-10-06T03:23:50.551327+0000","last_active":"2023-10-06T03:23:54.574585+0000","last_peered":"2023-10-06T03:23:54.574585+0000","last_clean":"2023-10-06T03:23:54.574585+0000","last_became_active":"2023-10-06T03:23:50.551040+0000","last_became_peered":"2023-10-06T03:23:50.551040+0000","last_unstale":"2023-10-06T03:23:54.574585+0000","last_undegraded":"2023-10-06T03:23:54.574585+0000","last_fullsized":"2023-10-06T03:23:54.574585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":698736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":694806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":103639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":106030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":105062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:04.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:04.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.793+0000 7f0e64b01700 1 Processor -- start 2023-10-06T03:24:04.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.793+0000 7f0e64b01700 1 -- start start 2023-10-06T03:24:04.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e64b01700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0e601595a0 0x7f0e600aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e64b01700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600b49e0 0x7f0e600aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e64b01700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600b0ca0 con 0x7f0e600b07a0 2023-10-06T03:24:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e64b01700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600b0f80 con 0x7f0e601595a0 2023-10-06T03:24:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e64b01700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600b1260 con 0x7f0e600b49e0 2023-10-06T03:24:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0e601595a0 0x7f0e600aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0e601595a0 0x7f0e600aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33786/0 (socket says 172.21.15.84:33786) 2023-10-06T03:24:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5e59c700 1 -- 172.21.15.84:0/3094391967 learned_addr learned my addr 172.21.15.84:0/3094391967 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5dd9b700 1 --2- 172.21.15.84:0/3094391967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600b49e0 0x7f0e600aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5e59c700 1 -- 172.21.15.84:0/3094391967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600b49e0 msgr2=0x7f0e600aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5e59c700 1 --2- 172.21.15.84:0/3094391967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600b49e0 0x7f0e600aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5e59c700 1 -- 172.21.15.84:0/3094391967 >> v1:172.21.15.131:6789/0 conn(0x7f0e600b07a0 legacy=0x7f0e600b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5e59c700 1 -- 172.21.15.84:0/3094391967 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600b1540 con 0x7f0e601595a0 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5dd9b700 1 --2- 172.21.15.84:0/3094391967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600b49e0 0x7f0e600aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5e59c700 1 --2- 172.21.15.84:0/3094391967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601595a0 0x7f0e600aa570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009f70 tx=0x7f0e50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79661178529e0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.794+0000 7f0e5d59a700 1 -- 172.21.15.84:0/3094391967 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000e070 con 0x7f0e601595a0 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.795+0000 7f0e5d59a700 1 -- 172.21.15.84:0/3094391967 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000ba90 con 0x7f0e601595a0 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.795+0000 7f0e5d59a700 1 -- 172.21.15.84:0/3094391967 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500092e0 con 0x7f0e601595a0 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.795+0000 7f0e64b01700 1 -- 172.21.15.84:0/3094391967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601595a0 msgr2=0x7f0e600aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.795+0000 7f0e64b01700 1 --2- 172.21.15.84:0/3094391967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601595a0 0x7f0e600aa570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009f70 tx=0x7f0e50009840 comp rx=0 tx=0).stop 2023-10-06T03:24:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.795+0000 7f0e64b01700 1 -- 172.21.15.84:0/3094391967 shutdown_connections 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.795+0000 7f0e64b01700 1 --2- 172.21.15.84:0/3094391967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601595a0 0x7f0e600aa570 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.795+0000 7f0e64b01700 1 --2- 172.21.15.84:0/3094391967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600b49e0 0x7f0e600aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.795+0000 7f0e64b01700 1 -- 172.21.15.84:0/3094391967 >> 172.21.15.84:0/3094391967 conn(0x7f0e60099830 msgr2=0x7f0e6006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.795+0000 7f0e64b01700 1 -- 172.21.15.84:0/3094391967 shutdown_connections 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.795+0000 7f0e64b01700 1 -- 172.21.15.84:0/3094391967 wait complete. 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.796+0000 7f0e64b01700 1 Processor -- start 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.796+0000 7f0e64b01700 1 -- start start 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e64b01700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e600b07a0 0x7f0e60153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e64b01700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e600b49e0 0x7f0e6014fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e64b01700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e601595a0 0x7f0e60157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e64b01700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60159ff0 con 0x7f0e600b07a0 2023-10-06T03:24:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e64b01700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60153740 con 0x7f0e600b49e0 2023-10-06T03:24:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e64b01700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60159a10 con 0x7f0e601595a0 2023-10-06T03:24:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e600b07a0 0x7f0e60153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e600b07a0 0x7f0e60153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33800/0 (socket says 172.21.15.84:33800) 2023-10-06T03:24:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5e59c700 1 -- 172.21.15.84:0/4294167669 learned_addr learned my addr 172.21.15.84:0/4294167669 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5ed9d700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e601595a0 0x7f0e60157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5dd9b700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e600b49e0 0x7f0e6014fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5e59c700 1 -- 172.21.15.84:0/4294167669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e601595a0 msgr2=0x7f0e60157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5e59c700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e601595a0 0x7f0e60157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5e59c700 1 -- 172.21.15.84:0/4294167669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e600b49e0 msgr2=0x7f0e6014fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5e59c700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e600b49e0 0x7f0e6014fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5e59c700 1 -- 172.21.15.84:0/4294167669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50009ae0 con 0x7f0e600b07a0 2023-10-06T03:24:04.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.797+0000 7f0e5e59c700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e600b07a0 0x7f0e60153200 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000b770 tx=0x7f0e50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.798+0000 7f0e567fc700 1 -- 172.21.15.84:0/4294167669 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50012a20 con 0x7f0e600b07a0 2023-10-06T03:24:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.798+0000 7f0e567fc700 1 -- 172.21.15.84:0/4294167669 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50012ba0 con 0x7f0e600b07a0 2023-10-06T03:24:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.798+0000 7f0e64b01700 1 -- 172.21.15.84:0/4294167669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e60155030 con 0x7f0e600b07a0 2023-10-06T03:24:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.798+0000 7f0e567fc700 1 -- 172.21.15.84:0/4294167669 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5001d420 con 0x7f0e600b07a0 2023-10-06T03:24:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.798+0000 7f0e64b01700 1 -- 172.21.15.84:0/4294167669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e60159c80 con 0x7f0e600b07a0 2023-10-06T03:24:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.798+0000 7f0e64b01700 1 -- 172.21.15.84:0/4294167669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e60064ad0 con 0x7f0e600b07a0 2023-10-06T03:24:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.799+0000 7f0e567fc700 1 -- 172.21.15.84:0/4294167669 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e5001d850 con 0x7f0e600b07a0 2023-10-06T03:24:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.799+0000 7f0e567fc700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e40066f30 0x7f0e400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.799+0000 7f0e567fc700 1 -- 172.21.15.84:0/4294167669 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0e50085fe0 con 0x7f0e600b07a0 2023-10-06T03:24:04.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.799+0000 7f0e5dd9b700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e40066f30 0x7f0e400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.800+0000 7f0e5dd9b700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e40066f30 0x7f0e400693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e600b4790 tx=0x7f0e48006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.803+0000 7f0e567fc700 1 -- 172.21.15.84:0/4294167669 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e50052e00 con 0x7f0e600b07a0 2023-10-06T03:24:04.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.981+0000 7f0e64b01700 1 -- 172.21.15.84:0/4294167669 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e600b1820 con 0x7f0e40066f30 2023-10-06T03:24:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.990+0000 7f0e567fc700 1 -- 172.21.15.84:0/4294167669 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367651 (secure 0 0 0) 0x7f0e600b1820 con 0x7f0e40066f30 2023-10-06T03:24:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:05.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 -- 172.21.15.84:0/4294167669 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e40066f30 msgr2=0x7f0e400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e40066f30 0x7f0e400693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e600b4790 tx=0x7f0e48006f90 comp rx=0 tx=0).stop 2023-10-06T03:24:05.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 -- 172.21.15.84:0/4294167669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e600b07a0 msgr2=0x7f0e60153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e600b07a0 0x7f0e60153200 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000b770 tx=0x7f0e50017000 comp rx=0 tx=0).stop 2023-10-06T03:24:05.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 -- 172.21.15.84:0/4294167669 shutdown_connections 2023-10-06T03:24:05.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0e40066f30 0x7f0e400693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e601595a0 0x7f0e60157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e600b07a0 0x7f0e60153200 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 --2- 172.21.15.84:0/4294167669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e600b49e0 0x7f0e6014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 -- 172.21.15.84:0/4294167669 >> 172.21.15.84:0/4294167669 conn(0x7f0e60099830 msgr2=0x7f0e60158180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 -- 172.21.15.84:0/4294167669 shutdown_connections 2023-10-06T03:24:05.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:04.994+0000 7f0e64b01700 1 -- 172.21.15.84:0/4294167669 wait complete. 2023-10-06T03:24:05.006 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:24:05.007 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-06T03:24:03.042679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":328,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381508,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593212,"statfs":{"total":773094113280,"available":770655449088,"internally_reserved":0,"allocated":3280896,"data_stored":2021677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.486173"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561518+0000","last_change":"2023-10-06T03:23:50.561014+0000","last_active":"2023-10-06T03:23:54.561518+0000","last_peered":"2023-10-06T03:23:54.561518+0000","last_clean":"2023-10-06T03:23:54.561518+0000","last_became_active":"2023-10-06T03:23:50.560752+0000","last_became_peered":"2023-10-06T03:23:50.560752+0000","last_unstale":"2023-10-06T03:23:54.561518+0000","last_undegraded":"2023-10-06T03:23:54.561518+0000","last_fullsized":"2023-10-06T03:23:54.561518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:11.240323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561509+0000","last_change":"2023-10-06T03:23:50.554102+0000","last_active":"2023-10-06T03:23:54.561509+0000","last_peered":"2023-10-06T03:23:54.561509+0000","last_clean":"2023-10-06T03:23:54.561509+0000","last_became_active":"2023-10-06T03:23:50.553890+0000","last_became_peered":"2023-10-06T03:23:50.553890+0000","last_unstale":"2023-10-06T03:23:54.561509+0000","last_undegraded":"2023-10-06T03:23:54.561509+0000","last_fullsized":"2023-10-06T03:23:54.561509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570300+0000","last_change":"2023-10-06T03:23:50.547813+0000","last_active":"2023-10-06T03:23:54.570300+0000","last_peered":"2023-10-06T03:23:54.570300+0000","last_clean":"2023-10-06T03:23:54.570300+0000","last_became_active":"2023-10-06T03:23:50.547300+0000","last_became_peered":"2023-10-06T03:23:50.547300+0000","last_unstale":"2023-10-06T03:23:54.570300+0000","last_undegraded":"2023-10-06T03:23:54.570300+0000","last_fullsized":"2023-10-06T03:23:54.570300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:41.253538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572253+0000","last_change":"2023-10-06T03:23:50.555770+0000","last_active":"2023-10-06T03:23:54.572253+0000","last_peered":"2023-10-06T03:23:54.572253+0000","last_clean":"2023-10-06T03:23:54.572253+0000","last_became_active":"2023-10-06T03:23:50.555523+0000","last_became_peered":"2023-10-06T03:23:50.555523+0000","last_unstale":"2023-10-06T03:23:54.572253+0000","last_undegraded":"2023-10-06T03:23:54.572253+0000","last_fullsized":"2023-10-06T03:23:54.572253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:47.159183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567665+0000","last_change":"2023-10-06T03:23:50.560528+0000","last_active":"2023-10-06T03:23:54.567665+0000","last_peered":"2023-10-06T03:23:54.567665+0000","last_clean":"2023-10-06T03:23:54.567665+0000","last_became_active":"2023-10-06T03:23:50.560247+0000","last_became_peered":"2023-10-06T03:23:50.560247+0000","last_unstale":"2023-10-06T03:23:54.567665+0000","last_undegraded":"2023-10-06T03:23:54.567665+0000","last_fullsized":"2023-10-06T03:23:54.567665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570783+0000","last_change":"2023-10-06T03:23:50.546938+0000","last_active":"2023-10-06T03:23:54.570783+0000","last_peered":"2023-10-06T03:23:54.570783+0000","last_clean":"2023-10-06T03:23:54.570783+0000","last_became_active":"2023-10-06T03:23:50.546653+0000","last_became_peered":"2023-10-06T03:23:50.546653+0000","last_unstale":"2023-10-06T03:23:54.570783+0000","last_undegraded":"2023-10-06T03:23:54.570783+0000","last_fullsized":"2023-10-06T03:23:54.570783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560769+0000","last_change":"2023-10-06T03:23:50.553364+0000","last_active":"2023-10-06T03:23:54.560769+0000","last_peered":"2023-10-06T03:23:54.560769+0000","last_clean":"2023-10-06T03:23:54.560769+0000","last_became_active":"2023-10-06T03:23:50.553098+0000","last_became_peered":"2023-10-06T03:23:50.553098+0000","last_unstale":"2023-10-06T03:23:54.560769+0000","last_undegraded":"2023-10-06T03:23:54.560769+0000","last_fullsized":"2023-10-06T03:23:54.560769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559957+0000","last_change":"2023-10-06T03:23:50.556409+0000","last_active":"2023-10-06T03:23:54.559957+0000","last_peered":"2023-10-06T03:23:54.559957+0000","last_clean":"2023-10-06T03:23:54.559957+0000","last_became_active":"2023-10-06T03:23:50.556162+0000","last_became_peered":"2023-10-06T03:23:50.556162+0000","last_unstale":"2023-10-06T03:23:54.559957+0000","last_undegraded":"2023-10-06T03:23:54.559957+0000","last_fullsized":"2023-10-06T03:23:54.559957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565989+0000","last_change":"2023-10-06T03:23:50.548544+0000","last_active":"2023-10-06T03:23:54.565989+0000","last_peered":"2023-10-06T03:23:54.565989+0000","last_clean":"2023-10-06T03:23:54.565989+0000","last_became_active":"2023-10-06T03:23:50.548294+0000","last_became_peered":"2023-10-06T03:23:50.548294+0000","last_unstale":"2023-10-06T03:23:54.565989+0000","last_undegraded":"2023-10-06T03:23:54.565989+0000","last_fullsized":"2023-10-06T03:23:54.565989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561682+0000","last_change":"2023-10-06T03:23:50.547845+0000","last_active":"2023-10-06T03:23:54.561682+0000","last_peered":"2023-10-06T03:23:54.561682+0000","last_clean":"2023-10-06T03:23:54.561682+0000","last_became_active":"2023-10-06T03:23:50.547570+0000","last_became_peered":"2023-10-06T03:23:50.547570+0000","last_unstale":"2023-10-06T03:23:54.561682+0000","last_undegraded":"2023-10-06T03:23:54.561682+0000","last_fullsized":"2023-10-06T03:23:54.561682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570220+0000","last_change":"2023-10-06T03:23:50.554501+0000","last_active":"2023-10-06T03:23:54.570220+0000","last_peered":"2023-10-06T03:23:54.570220+0000","last_clean":"2023-10-06T03:23:54.570220+0000","last_became_active":"2023-10-06T03:23:50.554323+0000","last_became_peered":"2023-10-06T03:23:50.554323+0000","last_unstale":"2023-10-06T03:23:54.570220+0000","last_undegraded":"2023-10-06T03:23:54.570220+0000","last_fullsized":"2023-10-06T03:23:54.570220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:39.132842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561650+0000","last_change":"2023-10-06T03:23:50.556387+0000","last_active":"2023-10-06T03:23:54.561650+0000","last_peered":"2023-10-06T03:23:54.561650+0000","last_clean":"2023-10-06T03:23:54.561650+0000","last_became_active":"2023-10-06T03:23:50.556160+0000","last_became_peered":"2023-10-06T03:23:50.556160+0000","last_unstale":"2023-10-06T03:23:54.561650+0000","last_undegraded":"2023-10-06T03:23:54.561650+0000","last_fullsized":"2023-10-06T03:23:54.561650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:48.412426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561770+0000","last_change":"2023-10-06T03:23:50.560485+0000","last_active":"2023-10-06T03:23:54.561770+0000","last_peered":"2023-10-06T03:23:54.561770+0000","last_clean":"2023-10-06T03:23:54.561770+0000","last_became_active":"2023-10-06T03:23:50.560194+0000","last_became_peered":"2023-10-06T03:23:50.560194+0000","last_unstale":"2023-10-06T03:23:54.561770+0000","last_undegraded":"2023-10-06T03:23:54.561770+0000","last_fullsized":"2023-10-06T03:23:54.561770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:12.346557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560300+0000","last_change":"2023-10-06T03:23:50.551082+0000","last_active":"2023-10-06T03:23:54.560300+0000","last_peered":"2023-10-06T03:23:54.560300+0000","last_clean":"2023-10-06T03:23:54.560300+0000","last_became_active":"2023-10-06T03:23:50.550756+0000","last_became_peered":"2023-10-06T03:23:50.550756+0000","last_unstale":"2023-10-06T03:23:54.560300+0000","last_undegraded":"2023-10-06T03:23:54.560300+0000","last_fullsized":"2023-10-06T03:23:54.560300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560103+0000","last_change":"2023-10-06T03:23:50.553219+0000","last_active":"2023-10-06T03:23:54.560103+0000","last_peered":"2023-10-06T03:23:54.560103+0000","last_clean":"2023-10-06T03:23:54.560103+0000","last_became_active":"2023-10-06T03:23:50.552954+0000","last_became_peered":"2023-10-06T03:23:50.552954+0000","last_unstale":"2023-10-06T03:23:54.560103+0000","last_undegraded":"2023-10-06T03:23:54.560103+0000","last_fullsized":"2023-10-06T03:23:54.560103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568201+0000","last_change":"2023-10-06T03:23:50.538998+0000","last_active":"2023-10-06T03:23:54.568201+0000","last_peered":"2023-10-06T03:23:54.568201+0000","last_clean":"2023-10-06T03:23:54.568201+0000","last_became_active":"2023-10-06T03:23:50.538721+0000","last_became_peered":"2023-10-06T03:23:50.538721+0000","last_unstale":"2023-10-06T03:23:54.568201+0000","last_undegraded":"2023-10-06T03:23:54.568201+0000","last_fullsized":"2023-10-06T03:23:54.568201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566076+0000","last_change":"2023-10-06T03:23:50.548665+0000","last_active":"2023-10-06T03:23:54.566076+0000","last_peered":"2023-10-06T03:23:54.566076+0000","last_clean":"2023-10-06T03:23:54.566076+0000","last_became_active":"2023-10-06T03:23:50.548379+0000","last_became_peered":"2023-10-06T03:23:50.548379+0000","last_unstale":"2023-10-06T03:23:54.566076+0000","last_undegraded":"2023-10-06T03:23:54.566076+0000","last_fullsized":"2023-10-06T03:23:54.566076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:04.343209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570249+0000","last_change":"2023-10-06T03:23:50.547255+0000","last_active":"2023-10-06T03:23:54.570249+0000","last_peered":"2023-10-06T03:23:54.570249+0000","last_clean":"2023-10-06T03:23:54.570249+0000","last_became_active":"2023-10-06T03:23:50.546952+0000","last_became_peered":"2023-10-06T03:23:50.546952+0000","last_unstale":"2023-10-06T03:23:54.570249+0000","last_undegraded":"2023-10-06T03:23:54.570249+0000","last_fullsized":"2023-10-06T03:23:54.570249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:37.459738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.562026+0000","last_change":"2023-10-06T03:23:50.549274+0000","last_active":"2023-10-06T03:23:54.562026+0000","last_peered":"2023-10-06T03:23:54.562026+0000","last_clean":"2023-10-06T03:23:54.562026+0000","last_became_active":"2023-10-06T03:23:50.549011+0000","last_became_peered":"2023-10-06T03:23:50.549011+0000","last_unstale":"2023-10-06T03:23:54.562026+0000","last_undegraded":"2023-10-06T03:23:54.562026+0000","last_fullsized":"2023-10-06T03:23:54.562026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:21.634023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.571307+0000","last_change":"2023-10-06T03:23:50.553751+0000","last_active":"2023-10-06T03:23:54.571307+0000","last_peered":"2023-10-06T03:23:54.571307+0000","last_clean":"2023-10-06T03:23:54.571307+0000","last_became_active":"2023-10-06T03:23:50.553496+0000","last_became_peered":"2023-10-06T03:23:50.553496+0000","last_unstale":"2023-10-06T03:23:54.571307+0000","last_undegraded":"2023-10-06T03:23:54.571307+0000","last_fullsized":"2023-10-06T03:23:54.571307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:35.855132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561063+0000","last_change":"2023-10-06T03:23:50.549272+0000","last_active":"2023-10-06T03:23:54.561063+0000","last_peered":"2023-10-06T03:23:54.561063+0000","last_clean":"2023-10-06T03:23:54.561063+0000","last_became_active":"2023-10-06T03:23:50.548975+0000","last_became_peered":"2023-10-06T03:23:50.548975+0000","last_unstale":"2023-10-06T03:23:54.561063+0000","last_undegraded":"2023-10-06T03:23:54.561063+0000","last_fullsized":"2023-10-06T03:23:54.561063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.564941+0000","last_change":"2023-10-06T03:23:50.553906+0000","last_active":"2023-10-06T03:23:54.564941+0000","last_peered":"2023-10-06T03:23:54.564941+0000","last_clean":"2023-10-06T03:23:54.564941+0000","last_became_active":"2023-10-06T03:23:50.553657+0000","last_became_peered":"2023-10-06T03:23:50.553657+0000","last_unstale":"2023-10-06T03:23:54.564941+0000","last_undegraded":"2023-10-06T03:23:54.564941+0000","last_fullsized":"2023-10-06T03:23:54.564941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557967+0000","last_change":"2023-10-06T03:23:50.559812+0000","last_active":"2023-10-06T03:23:54.557967+0000","last_peered":"2023-10-06T03:23:54.557967+0000","last_clean":"2023-10-06T03:23:54.557967+0000","last_became_active":"2023-10-06T03:23:50.559490+0000","last_became_peered":"2023-10-06T03:23:50.559490+0000","last_unstale":"2023-10-06T03:23:54.557967+0000","last_undegraded":"2023-10-06T03:23:54.557967+0000","last_fullsized":"2023-10-06T03:23:54.557967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:03.745193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560369+0000","last_change":"2023-10-06T03:23:50.560701+0000","last_active":"2023-10-06T03:23:54.560369+0000","last_peered":"2023-10-06T03:23:54.560369+0000","last_clean":"2023-10-06T03:23:54.560369+0000","last_became_active":"2023-10-06T03:23:50.560415+0000","last_became_peered":"2023-10-06T03:23:50.560415+0000","last_unstale":"2023-10-06T03:23:54.560369+0000","last_undegraded":"2023-10-06T03:23:54.560369+0000","last_fullsized":"2023-10-06T03:23:54.560369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574718+0000","last_change":"2023-10-06T03:23:50.552568+0000","last_active":"2023-10-06T03:23:54.574718+0000","last_peered":"2023-10-06T03:23:54.574718+0000","last_clean":"2023-10-06T03:23:54.574718+0000","last_became_active":"2023-10-06T03:23:50.552323+0000","last_became_peered":"2023-10-06T03:23:50.552323+0000","last_unstale":"2023-10-06T03:23:54.574718+0000","last_undegraded":"2023-10-06T03:23:54.574718+0000","last_fullsized":"2023-10-06T03:23:54.574718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574482+0000","last_change":"2023-10-06T03:23:50.553152+0000","last_active":"2023-10-06T03:23:54.574482+0000","last_peered":"2023-10-06T03:23:54.574482+0000","last_clean":"2023-10-06T03:23:54.574482+0000","last_became_active":"2023-10-06T03:23:50.552841+0000","last_became_peered":"2023-10-06T03:23:50.552841+0000","last_unstale":"2023-10-06T03:23:54.574482+0000","last_undegraded":"2023-10-06T03:23:54.574482+0000","last_fullsized":"2023-10-06T03:23:54.574482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561676+0000","last_change":"2023-10-06T03:23:50.552461+0000","last_active":"2023-10-06T03:23:54.561676+0000","last_peered":"2023-10-06T03:23:54.561676+0000","last_clean":"2023-10-06T03:23:54.561676+0000","last_became_active":"2023-10-06T03:23:50.551071+0000","last_became_peered":"2023-10-06T03:23:50.551071+0000","last_unstale":"2023-10-06T03:23:54.561676+0000","last_undegraded":"2023-10-06T03:23:54.561676+0000","last_fullsized":"2023-10-06T03:23:54.561676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581529+0000","last_change":"2023-10-06T03:23:54.579111+0000","last_active":"2023-10-06T03:23:54.581529+0000","last_peered":"2023-10-06T03:23:54.581529+0000","last_clean":"2023-10-06T03:23:54.581529+0000","last_became_active":"2023-10-06T03:23:54.578715+0000","last_became_peered":"2023-10-06T03:23:54.578715+0000","last_unstale":"2023-10-06T03:23:54.581529+0000","last_undegraded":"2023-10-06T03:23:54.581529+0000","last_fullsized":"2023-10-06T03:23:54.581529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:35.035137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570617+0000","last_change":"2023-10-06T03:23:49.548044+0000","last_active":"2023-10-06T03:23:54.570617+0000","last_peered":"2023-10-06T03:23:54.570617+0000","last_clean":"2023-10-06T03:23:54.570617+0000","last_became_active":"2023-10-06T03:23:49.547760+0000","last_became_peered":"2023-10-06T03:23:49.547760+0000","last_unstale":"2023-10-06T03:23:54.570617+0000","last_undegraded":"2023-10-06T03:23:54.570617+0000","last_fullsized":"2023-10-06T03:23:54.570617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:20.629148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559115+0000","last_change":"2023-10-06T03:23:50.559669+0000","last_active":"2023-10-06T03:23:54.559115+0000","last_peered":"2023-10-06T03:23:54.559115+0000","last_clean":"2023-10-06T03:23:54.559115+0000","last_became_active":"2023-10-06T03:23:50.559405+0000","last_became_peered":"2023-10-06T03:23:50.559405+0000","last_unstale":"2023-10-06T03:23:54.559115+0000","last_undegraded":"2023-10-06T03:23:54.559115+0000","last_fullsized":"2023-10-06T03:23:54.559115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:37.459738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.584345+0000","last_change":"2023-10-06T03:23:54.583216+0000","last_active":"2023-10-06T03:23:54.584345+0000","last_peered":"2023-10-06T03:23:54.584345+0000","last_clean":"2023-10-06T03:23:54.584345+0000","last_became_active":"2023-10-06T03:23:54.582867+0000","last_became_peered":"2023-10-06T03:23:54.582867+0000","last_unstale":"2023-10-06T03:23:54.584345+0000","last_undegraded":"2023-10-06T03:23:54.584345+0000","last_fullsized":"2023-10-06T03:23:54.584345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:39.877535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573373+0000","last_change":"2023-10-06T03:23:49.550360+0000","last_active":"2023-10-06T03:23:54.573373+0000","last_peered":"2023-10-06T03:23:54.573373+0000","last_clean":"2023-10-06T03:23:54.573373+0000","last_became_active":"2023-10-06T03:23:49.550065+0000","last_became_peered":"2023-10-06T03:23:49.550065+0000","last_unstale":"2023-10-06T03:23:54.573373+0000","last_undegraded":"2023-10-06T03:23:54.573373+0000","last_fullsized":"2023-10-06T03:23:54.573373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:20.629148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565240+0000","last_change":"2023-10-06T03:23:50.538560+0000","last_active":"2023-10-06T03:23:54.565240+0000","last_peered":"2023-10-06T03:23:54.565240+0000","last_clean":"2023-10-06T03:23:54.565240+0000","last_became_active":"2023-10-06T03:23:50.538280+0000","last_became_peered":"2023-10-06T03:23:50.538280+0000","last_unstale":"2023-10-06T03:23:54.565240+0000","last_undegraded":"2023-10-06T03:23:54.565240+0000","last_fullsized":"2023-10-06T03:23:54.565240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.587526+0000","last_change":"2023-10-06T03:23:54.577798+0000","last_active":"2023-10-06T03:23:54.587526+0000","last_peered":"2023-10-06T03:23:54.587526+0000","last_clean":"2023-10-06T03:23:54.587526+0000","last_became_active":"2023-10-06T03:23:54.577365+0000","last_became_peered":"2023-10-06T03:23:54.577365+0000","last_unstale":"2023-10-06T03:23:54.587526+0000","last_undegraded":"2023-10-06T03:23:54.587526+0000","last_fullsized":"2023-10-06T03:23:54.587526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:29.084904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558191+0000","last_change":"2023-10-06T03:23:49.541525+0000","last_active":"2023-10-06T03:23:54.558191+0000","last_peered":"2023-10-06T03:23:54.558191+0000","last_clean":"2023-10-06T03:23:54.558191+0000","last_became_active":"2023-10-06T03:23:49.541237+0000","last_became_peered":"2023-10-06T03:23:49.541237+0000","last_unstale":"2023-10-06T03:23:54.558191+0000","last_undegraded":"2023-10-06T03:23:54.558191+0000","last_fullsized":"2023-10-06T03:23:54.558191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572886+0000","last_change":"2023-10-06T03:23:50.559460+0000","last_active":"2023-10-06T03:23:54.572886+0000","last_peered":"2023-10-06T03:23:54.572886+0000","last_clean":"2023-10-06T03:23:54.572886+0000","last_became_active":"2023-10-06T03:23:50.559195+0000","last_became_peered":"2023-10-06T03:23:50.559195+0000","last_unstale":"2023-10-06T03:23:54.572886+0000","last_undegraded":"2023-10-06T03:23:54.572886+0000","last_fullsized":"2023-10-06T03:23:54.572886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586096+0000","last_change":"2023-10-06T03:23:54.584333+0000","last_active":"2023-10-06T03:23:54.586096+0000","last_peered":"2023-10-06T03:23:54.586096+0000","last_clean":"2023-10-06T03:23:54.586096+0000","last_became_active":"2023-10-06T03:23:54.583941+0000","last_became_peered":"2023-10-06T03:23:54.583941+0000","last_unstale":"2023-10-06T03:23:54.586096+0000","last_undegraded":"2023-10-06T03:23:54.586096+0000","last_fullsized":"2023-10-06T03:23:54.586096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:41.482140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566163+0000","last_change":"2023-10-06T03:23:49.544125+0000","last_active":"2023-10-06T03:23:54.566163+0000","last_peered":"2023-10-06T03:23:54.566163+0000","last_clean":"2023-10-06T03:23:54.566163+0000","last_became_active":"2023-10-06T03:23:49.543568+0000","last_became_peered":"2023-10-06T03:23:49.543568+0000","last_unstale":"2023-10-06T03:23:54.566163+0000","last_undegraded":"2023-10-06T03:23:54.566163+0000","last_fullsized":"2023-10-06T03:23:54.566163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558099+0000","last_change":"2023-10-06T03:23:50.555547+0000","last_active":"2023-10-06T03:23:54.558099+0000","last_peered":"2023-10-06T03:23:54.558099+0000","last_clean":"2023-10-06T03:23:54.558099+0000","last_became_active":"2023-10-06T03:23:50.555001+0000","last_became_peered":"2023-10-06T03:23:50.555001+0000","last_unstale":"2023-10-06T03:23:54.558099+0000","last_undegraded":"2023-10-06T03:23:54.558099+0000","last_fullsized":"2023-10-06T03:23:54.558099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582762+0000","last_change":"2023-10-06T03:23:54.576856+0000","last_active":"2023-10-06T03:23:54.582762+0000","last_peered":"2023-10-06T03:23:54.582762+0000","last_clean":"2023-10-06T03:23:54.582762+0000","last_became_active":"2023-10-06T03:23:54.576400+0000","last_became_peered":"2023-10-06T03:23:54.576400+0000","last_unstale":"2023-10-06T03:23:54.582762+0000","last_undegraded":"2023-10-06T03:23:54.582762+0000","last_fullsized":"2023-10-06T03:23:54.582762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:38.847179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561597+0000","last_change":"2023-10-06T03:23:49.546821+0000","last_active":"2023-10-06T03:23:54.561597+0000","last_peered":"2023-10-06T03:23:54.561597+0000","last_clean":"2023-10-06T03:23:54.561597+0000","last_became_active":"2023-10-06T03:23:49.546548+0000","last_became_peered":"2023-10-06T03:23:49.546548+0000","last_unstale":"2023-10-06T03:23:54.561597+0000","last_undegraded":"2023-10-06T03:23:54.561597+0000","last_fullsized":"2023-10-06T03:23:54.561597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557846+0000","last_change":"2023-10-06T03:23:50.555413+0000","last_active":"2023-10-06T03:23:54.557846+0000","last_peered":"2023-10-06T03:23:54.557846+0000","last_clean":"2023-10-06T03:23:54.557846+0000","last_became_active":"2023-10-06T03:23:50.554715+0000","last_became_peered":"2023-10-06T03:23:50.554715+0000","last_unstale":"2023-10-06T03:23:54.557846+0000","last_undegraded":"2023-10-06T03:23:54.557846+0000","last_fullsized":"2023-10-06T03:23:54.557846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:04.343209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.577965+0000","last_change":"2023-10-06T03:23:54.573885+0000","last_active":"2023-10-06T03:23:54.577965+0000","last_peered":"2023-10-06T03:23:54.577965+0000","last_clean":"2023-10-06T03:23:54.577965+0000","last_became_active":"2023-10-06T03:23:54.573501+0000","last_became_peered":"2023-10-06T03:23:54.573501+0000","last_unstale":"2023-10-06T03:23:54.577965+0000","last_undegraded":"2023-10-06T03:23:54.577965+0000","last_fullsized":"2023-10-06T03:23:54.577965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:11.874759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561246+0000","last_change":"2023-10-06T03:23:49.549842+0000","last_active":"2023-10-06T03:23:54.561246+0000","last_peered":"2023-10-06T03:23:54.561246+0000","last_clean":"2023-10-06T03:23:54.561246+0000","last_became_active":"2023-10-06T03:23:49.549552+0000","last_became_peered":"2023-10-06T03:23:49.549552+0000","last_unstale":"2023-10-06T03:23:54.561246+0000","last_undegraded":"2023-10-06T03:23:54.561246+0000","last_fullsized":"2023-10-06T03:23:54.561246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:46.154308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574142+0000","last_change":"2023-10-06T03:23:50.556593+0000","last_active":"2023-10-06T03:23:54.574142+0000","last_peered":"2023-10-06T03:23:54.574142+0000","last_clean":"2023-10-06T03:23:54.574142+0000","last_became_active":"2023-10-06T03:23:50.556291+0000","last_became_peered":"2023-10-06T03:23:50.556291+0000","last_unstale":"2023-10-06T03:23:54.574142+0000","last_undegraded":"2023-10-06T03:23:54.574142+0000","last_fullsized":"2023-10-06T03:23:54.574142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.386684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586726+0000","last_change":"2023-10-06T03:23:54.585687+0000","last_active":"2023-10-06T03:23:54.586726+0000","last_peered":"2023-10-06T03:23:54.586726+0000","last_clean":"2023-10-06T03:23:54.586726+0000","last_became_active":"2023-10-06T03:23:54.585174+0000","last_became_peered":"2023-10-06T03:23:54.585174+0000","last_unstale":"2023-10-06T03:23:54.586726+0000","last_undegraded":"2023-10-06T03:23:54.586726+0000","last_fullsized":"2023-10-06T03:23:54.586726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:28.830749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.571227+0000","last_change":"2023-10-06T03:23:49.542417+0000","last_active":"2023-10-06T03:23:54.571227+0000","last_peered":"2023-10-06T03:23:54.571227+0000","last_clean":"2023-10-06T03:23:54.571227+0000","last_became_active":"2023-10-06T03:23:49.541619+0000","last_became_peered":"2023-10-06T03:23:49.541619+0000","last_unstale":"2023-10-06T03:23:54.571227+0000","last_undegraded":"2023-10-06T03:23:54.571227+0000","last_fullsized":"2023-10-06T03:23:54.571227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570210+0000","last_change":"2023-10-06T03:23:50.553384+0000","last_active":"2023-10-06T03:23:54.570210+0000","last_peered":"2023-10-06T03:23:54.570210+0000","last_clean":"2023-10-06T03:23:54.570210+0000","last_became_active":"2023-10-06T03:23:50.553071+0000","last_became_peered":"2023-10-06T03:23:50.553071+0000","last_unstale":"2023-10-06T03:23:54.570210+0000","last_undegraded":"2023-10-06T03:23:54.570210+0000","last_fullsized":"2023-10-06T03:23:54.570210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582553+0000","last_change":"2023-10-06T03:23:54.576003+0000","last_active":"2023-10-06T03:23:54.582553+0000","last_peered":"2023-10-06T03:23:54.582553+0000","last_clean":"2023-10-06T03:23:54.582553+0000","last_became_active":"2023-10-06T03:23:54.575595+0000","last_became_peered":"2023-10-06T03:23:54.575595+0000","last_unstale":"2023-10-06T03:23:54.582553+0000","last_undegraded":"2023-10-06T03:23:54.582553+0000","last_fullsized":"2023-10-06T03:23:54.582553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:56.213189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561136+0000","last_change":"2023-10-06T03:23:49.553574+0000","last_active":"2023-10-06T03:23:54.561136+0000","last_peered":"2023-10-06T03:23:54.561136+0000","last_clean":"2023-10-06T03:23:54.561136+0000","last_became_active":"2023-10-06T03:23:49.553287+0000","last_became_peered":"2023-10-06T03:23:49.553287+0000","last_unstale":"2023-10-06T03:23:54.561136+0000","last_undegraded":"2023-10-06T03:23:54.561136+0000","last_fullsized":"2023-10-06T03:23:54.561136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:30.660149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558194+0000","last_change":"2023-10-06T03:23:50.559333+0000","last_active":"2023-10-06T03:23:54.558194+0000","last_peered":"2023-10-06T03:23:54.558194+0000","last_clean":"2023-10-06T03:23:54.558194+0000","last_became_active":"2023-10-06T03:23:50.554903+0000","last_became_peered":"2023-10-06T03:23:50.554903+0000","last_unstale":"2023-10-06T03:23:54.558194+0000","last_undegraded":"2023-10-06T03:23:54.558194+0000","last_fullsized":"2023-10-06T03:23:54.558194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.578775+0000","last_change":"2023-10-06T03:23:54.576737+0000","last_active":"2023-10-06T03:23:54.578775+0000","last_peered":"2023-10-06T03:23:54.578775+0000","last_clean":"2023-10-06T03:23:54.578775+0000","last_became_active":"2023-10-06T03:23:54.576315+0000","last_became_peered":"2023-10-06T03:23:54.576315+0000","last_unstale":"2023-10-06T03:23:54.578775+0000","last_undegraded":"2023-10-06T03:23:54.578775+0000","last_fullsized":"2023-10-06T03:23:54.578775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:23.573045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565078+0000","last_change":"2023-10-06T03:23:49.541373+0000","last_active":"2023-10-06T03:23:54.565078+0000","last_peered":"2023-10-06T03:23:54.565078+0000","last_clean":"2023-10-06T03:23:54.565078+0000","last_became_active":"2023-10-06T03:23:49.541117+0000","last_became_peered":"2023-10-06T03:23:49.541117+0000","last_unstale":"2023-10-06T03:23:54.565078+0000","last_undegraded":"2023-10-06T03:23:54.565078+0000","last_fullsized":"2023-10-06T03:23:54.565078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:44.960845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561590+0000","last_change":"2023-10-06T03:23:50.552104+0000","last_active":"2023-10-06T03:23:54.561590+0000","last_peered":"2023-10-06T03:23:54.561590+0000","last_clean":"2023-10-06T03:23:54.561590+0000","last_became_active":"2023-10-06T03:23:50.550706+0000","last_became_peered":"2023-10-06T03:23:50.550706+0000","last_unstale":"2023-10-06T03:23:54.561590+0000","last_undegraded":"2023-10-06T03:23:54.561590+0000","last_fullsized":"2023-10-06T03:23:54.561590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.578733+0000","last_change":"2023-10-06T03:23:54.576258+0000","last_active":"2023-10-06T03:23:54.578733+0000","last_peered":"2023-10-06T03:23:54.578733+0000","last_clean":"2023-10-06T03:23:54.578733+0000","last_became_active":"2023-10-06T03:23:54.575885+0000","last_became_peered":"2023-10-06T03:23:54.575885+0000","last_unstale":"2023-10-06T03:23:54.578733+0000","last_undegraded":"2023-10-06T03:23:54.578733+0000","last_fullsized":"2023-10-06T03:23:54.578733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:34.771595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560193+0000","last_change":"2023-10-06T03:23:49.550646+0000","last_active":"2023-10-06T03:23:54.560193+0000","last_peered":"2023-10-06T03:23:54.560193+0000","last_clean":"2023-10-06T03:23:54.560193+0000","last_became_active":"2023-10-06T03:23:49.550390+0000","last_became_peered":"2023-10-06T03:23:49.550390+0000","last_unstale":"2023-10-06T03:23:54.560193+0000","last_undegraded":"2023-10-06T03:23:54.560193+0000","last_fullsized":"2023-10-06T03:23:54.560193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:26.970739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565649+0000","last_change":"2023-10-06T03:23:50.546312+0000","last_active":"2023-10-06T03:23:54.565649+0000","last_peered":"2023-10-06T03:23:54.565649+0000","last_clean":"2023-10-06T03:23:54.565649+0000","last_became_active":"2023-10-06T03:23:50.546061+0000","last_became_peered":"2023-10-06T03:23:50.546061+0000","last_unstale":"2023-10-06T03:23:54.565649+0000","last_undegraded":"2023-10-06T03:23:54.565649+0000","last_fullsized":"2023-10-06T03:23:54.565649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582076+0000","last_change":"2023-10-06T03:23:54.576371+0000","last_active":"2023-10-06T03:23:54.582076+0000","last_peered":"2023-10-06T03:23:54.582076+0000","last_clean":"2023-10-06T03:23:54.582076+0000","last_became_active":"2023-10-06T03:23:54.576017+0000","last_became_peered":"2023-10-06T03:23:54.576017+0000","last_unstale":"2023-10-06T03:23:54.582076+0000","last_undegraded":"2023-10-06T03:23:54.582076+0000","last_fullsized":"2023-10-06T03:23:54.582076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:38.847179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572371+0000","last_change":"2023-10-06T03:23:49.546273+0000","last_active":"2023-10-06T03:23:54.572371+0000","last_peered":"2023-10-06T03:23:54.572371+0000","last_clean":"2023-10-06T03:23:54.572371+0000","last_became_active":"2023-10-06T03:23:49.546030+0000","last_became_peered":"2023-10-06T03:23:49.546030+0000","last_unstale":"2023-10-06T03:23:54.572371+0000","last_undegraded":"2023-10-06T03:23:54.572371+0000","last_fullsized":"2023-10-06T03:23:54.572371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560122+0000","last_change":"2023-10-06T03:23:50.552633+0000","last_active":"2023-10-06T03:23:54.560122+0000","last_peered":"2023-10-06T03:23:54.560122+0000","last_clean":"2023-10-06T03:23:54.560122+0000","last_became_active":"2023-10-06T03:23:50.552401+0000","last_became_peered":"2023-10-06T03:23:50.552401+0000","last_unstale":"2023-10-06T03:23:54.560122+0000","last_undegraded":"2023-10-06T03:23:54.560122+0000","last_fullsized":"2023-10-06T03:23:54.560122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582883+0000","last_change":"2023-10-06T03:23:54.575577+0000","last_active":"2023-10-06T03:23:54.582883+0000","last_peered":"2023-10-06T03:23:54.582883+0000","last_clean":"2023-10-06T03:23:54.582883+0000","last_became_active":"2023-10-06T03:23:54.575207+0000","last_became_peered":"2023-10-06T03:23:54.575207+0000","last_unstale":"2023-10-06T03:23:54.582883+0000","last_undegraded":"2023-10-06T03:23:54.582883+0000","last_fullsized":"2023-10-06T03:23:54.582883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561649+0000","last_change":"2023-10-06T03:23:49.551635+0000","last_active":"2023-10-06T03:23:54.561649+0000","last_peered":"2023-10-06T03:23:54.561649+0000","last_clean":"2023-10-06T03:23:54.561649+0000","last_became_active":"2023-10-06T03:23:49.551383+0000","last_became_peered":"2023-10-06T03:23:49.551383+0000","last_unstale":"2023-10-06T03:23:54.561649+0000","last_undegraded":"2023-10-06T03:23:54.561649+0000","last_fullsized":"2023-10-06T03:23:54.561649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:28.615722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559800+0000","last_change":"2023-10-06T03:23:50.551380+0000","last_active":"2023-10-06T03:23:54.559800+0000","last_peered":"2023-10-06T03:23:54.559800+0000","last_clean":"2023-10-06T03:23:54.559800+0000","last_became_active":"2023-10-06T03:23:50.551113+0000","last_became_peered":"2023-10-06T03:23:50.551113+0000","last_unstale":"2023-10-06T03:23:54.559800+0000","last_undegraded":"2023-10-06T03:23:54.559800+0000","last_fullsized":"2023-10-06T03:23:54.559800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:28.082470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582682+0000","last_change":"2023-10-06T03:23:54.578999+0000","last_active":"2023-10-06T03:23:54.582682+0000","last_peered":"2023-10-06T03:23:54.582682+0000","last_clean":"2023-10-06T03:23:54.582682+0000","last_became_active":"2023-10-06T03:23:54.578680+0000","last_became_peered":"2023-10-06T03:23:54.578680+0000","last_unstale":"2023-10-06T03:23:54.582682+0000","last_undegraded":"2023-10-06T03:23:54.582682+0000","last_fullsized":"2023-10-06T03:23:54.582682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:46.387578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561434+0000","last_change":"2023-10-06T03:23:49.551746+0000","last_active":"2023-10-06T03:23:54.561434+0000","last_peered":"2023-10-06T03:23:54.561434+0000","last_clean":"2023-10-06T03:23:54.561434+0000","last_became_active":"2023-10-06T03:23:49.551502+0000","last_became_peered":"2023-10-06T03:23:49.551502+0000","last_unstale":"2023-10-06T03:23:54.561434+0000","last_undegraded":"2023-10-06T03:23:54.561434+0000","last_fullsized":"2023-10-06T03:23:54.561434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:16.290952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568892+0000","last_change":"2023-10-06T03:23:50.553384+0000","last_active":"2023-10-06T03:23:54.568892+0000","last_peered":"2023-10-06T03:23:54.568892+0000","last_clean":"2023-10-06T03:23:54.568892+0000","last_became_active":"2023-10-06T03:23:50.553111+0000","last_became_peered":"2023-10-06T03:23:50.553111+0000","last_unstale":"2023-10-06T03:23:54.568892+0000","last_undegraded":"2023-10-06T03:23:54.568892+0000","last_fullsized":"2023-10-06T03:23:54.568892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:29.722975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581802+0000","last_change":"2023-10-06T03:23:54.577157+0000","last_active":"2023-10-06T03:23:54.581802+0000","last_peered":"2023-10-06T03:23:54.581802+0000","last_clean":"2023-10-06T03:23:54.581802+0000","last_became_active":"2023-10-06T03:23:54.576783+0000","last_became_peered":"2023-10-06T03:23:54.576783+0000","last_unstale":"2023-10-06T03:23:54.581802+0000","last_undegraded":"2023-10-06T03:23:54.581802+0000","last_fullsized":"2023-10-06T03:23:54.581802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:07.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561143+0000","last_change":"2023-10-06T03:23:49.548189+0000","last_active":"2023-10-06T03:23:54.561143+0000","last_peered":"2023-10-06T03:23:54.561143+0000","last_clean":"2023-10-06T03:23:54.561143+0000","last_became_active":"2023-10-06T03:23:49.547936+0000","last_became_peered":"2023-10-06T03:23:49.547936+0000","last_unstale":"2023-10-06T03:23:54.561143+0000","last_undegraded":"2023-10-06T03:23:54.561143+0000","last_fullsized":"2023-10-06T03:23:54.561143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:42.983966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572005+0000","last_change":"2023-10-06T03:23:50.554414+0000","last_active":"2023-10-06T03:23:54.572005+0000","last_peered":"2023-10-06T03:23:54.572005+0000","last_clean":"2023-10-06T03:23:54.572005+0000","last_became_active":"2023-10-06T03:23:50.554126+0000","last_became_peered":"2023-10-06T03:23:50.554126+0000","last_unstale":"2023-10-06T03:23:54.572005+0000","last_undegraded":"2023-10-06T03:23:54.572005+0000","last_fullsized":"2023-10-06T03:23:54.572005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582750+0000","last_change":"2023-10-06T03:23:54.577469+0000","last_active":"2023-10-06T03:23:54.582750+0000","last_peered":"2023-10-06T03:23:54.582750+0000","last_clean":"2023-10-06T03:23:54.582750+0000","last_became_active":"2023-10-06T03:23:54.577100+0000","last_became_peered":"2023-10-06T03:23:54.577100+0000","last_unstale":"2023-10-06T03:23:54.582750+0000","last_undegraded":"2023-10-06T03:23:54.582750+0000","last_fullsized":"2023-10-06T03:23:54.582750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:41.482140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560302+0000","last_change":"2023-10-06T03:23:49.551245+0000","last_active":"2023-10-06T03:23:54.560302+0000","last_peered":"2023-10-06T03:23:54.560302+0000","last_clean":"2023-10-06T03:23:54.560302+0000","last_became_active":"2023-10-06T03:23:49.550981+0000","last_became_peered":"2023-10-06T03:23:49.550981+0000","last_unstale":"2023-10-06T03:23:54.560302+0000","last_undegraded":"2023-10-06T03:23:54.560302+0000","last_fullsized":"2023-10-06T03:23:54.560302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567343+0000","last_change":"2023-10-06T03:23:50.546972+0000","last_active":"2023-10-06T03:23:54.567343+0000","last_peered":"2023-10-06T03:23:54.567343+0000","last_clean":"2023-10-06T03:23:54.567343+0000","last_became_active":"2023-10-06T03:23:50.546729+0000","last_became_peered":"2023-10-06T03:23:50.546729+0000","last_unstale":"2023-10-06T03:23:54.567343+0000","last_undegraded":"2023-10-06T03:23:54.567343+0000","last_fullsized":"2023-10-06T03:23:54.567343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581894+0000","last_change":"2023-10-06T03:23:54.576116+0000","last_active":"2023-10-06T03:23:54.581894+0000","last_peered":"2023-10-06T03:23:54.581894+0000","last_clean":"2023-10-06T03:23:54.581894+0000","last_became_active":"2023-10-06T03:23:54.575714+0000","last_became_peered":"2023-10-06T03:23:54.575714+0000","last_unstale":"2023-10-06T03:23:54.581894+0000","last_undegraded":"2023-10-06T03:23:54.581894+0000","last_fullsized":"2023-10-06T03:23:54.581894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:33.745377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558207+0000","last_change":"2023-10-06T03:23:49.549931+0000","last_active":"2023-10-06T03:23:54.558207+0000","last_peered":"2023-10-06T03:23:54.558207+0000","last_clean":"2023-10-06T03:23:54.558207+0000","last_became_active":"2023-10-06T03:23:49.549675+0000","last_became_peered":"2023-10-06T03:23:49.549675+0000","last_unstale":"2023-10-06T03:23:54.558207+0000","last_undegraded":"2023-10-06T03:23:54.558207+0000","last_fullsized":"2023-10-06T03:23:54.558207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569852+0000","last_change":"2023-10-06T03:23:50.560836+0000","last_active":"2023-10-06T03:23:54.569852+0000","last_peered":"2023-10-06T03:23:54.569852+0000","last_clean":"2023-10-06T03:23:54.569852+0000","last_became_active":"2023-10-06T03:23:50.560582+0000","last_became_peered":"2023-10-06T03:23:50.560582+0000","last_unstale":"2023-10-06T03:23:54.569852+0000","last_undegraded":"2023-10-06T03:23:54.569852+0000","last_fullsized":"2023-10-06T03:23:54.569852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:53.298950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582964+0000","last_change":"2023-10-06T03:23:54.580383+0000","last_active":"2023-10-06T03:23:54.582964+0000","last_peered":"2023-10-06T03:23:54.582964+0000","last_clean":"2023-10-06T03:23:54.582964+0000","last_became_active":"2023-10-06T03:23:54.580033+0000","last_became_peered":"2023-10-06T03:23:54.580033+0000","last_unstale":"2023-10-06T03:23:54.582964+0000","last_undegraded":"2023-10-06T03:23:54.582964+0000","last_fullsized":"2023-10-06T03:23:54.582964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:01.313140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572093+0000","last_change":"2023-10-06T03:23:49.551405+0000","last_active":"2023-10-06T03:23:54.572093+0000","last_peered":"2023-10-06T03:23:54.572093+0000","last_clean":"2023-10-06T03:23:54.572093+0000","last_became_active":"2023-10-06T03:23:49.551030+0000","last_became_peered":"2023-10-06T03:23:49.551030+0000","last_unstale":"2023-10-06T03:23:54.572093+0000","last_undegraded":"2023-10-06T03:23:54.572093+0000","last_fullsized":"2023-10-06T03:23:54.572093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569949+0000","last_change":"2023-10-06T03:23:50.547982+0000","last_active":"2023-10-06T03:23:54.569949+0000","last_peered":"2023-10-06T03:23:54.569949+0000","last_clean":"2023-10-06T03:23:54.569949+0000","last_became_active":"2023-10-06T03:23:50.547602+0000","last_became_peered":"2023-10-06T03:23:50.547602+0000","last_unstale":"2023-10-06T03:23:54.569949+0000","last_undegraded":"2023-10-06T03:23:54.569949+0000","last_fullsized":"2023-10-06T03:23:54.569949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:03.745193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582140+0000","last_change":"2023-10-06T03:23:54.575198+0000","last_active":"2023-10-06T03:23:54.582140+0000","last_peered":"2023-10-06T03:23:54.582140+0000","last_clean":"2023-10-06T03:23:54.582140+0000","last_became_active":"2023-10-06T03:23:54.574788+0000","last_became_peered":"2023-10-06T03:23:54.574788+0000","last_unstale":"2023-10-06T03:23:54.582140+0000","last_undegraded":"2023-10-06T03:23:54.582140+0000","last_fullsized":"2023-10-06T03:23:54.582140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:20.930646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568731+0000","last_change":"2023-10-06T03:23:49.538200+0000","last_active":"2023-10-06T03:23:54.568731+0000","last_peered":"2023-10-06T03:23:54.568731+0000","last_clean":"2023-10-06T03:23:54.568731+0000","last_became_active":"2023-10-06T03:23:49.537928+0000","last_became_peered":"2023-10-06T03:23:49.537928+0000","last_unstale":"2023-10-06T03:23:54.568731+0000","last_undegraded":"2023-10-06T03:23:54.568731+0000","last_fullsized":"2023-10-06T03:23:54.568731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570161+0000","last_change":"2023-10-06T03:23:50.552986+0000","last_active":"2023-10-06T03:23:54.570161+0000","last_peered":"2023-10-06T03:23:54.570161+0000","last_clean":"2023-10-06T03:23:54.570161+0000","last_became_active":"2023-10-06T03:23:50.552689+0000","last_became_peered":"2023-10-06T03:23:50.552689+0000","last_unstale":"2023-10-06T03:23:54.570161+0000","last_undegraded":"2023-10-06T03:23:54.570161+0000","last_fullsized":"2023-10-06T03:23:54.570161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.579868+0000","last_change":"2023-10-06T03:23:54.578003+0000","last_active":"2023-10-06T03:23:54.579868+0000","last_peered":"2023-10-06T03:23:54.579868+0000","last_clean":"2023-10-06T03:23:54.579868+0000","last_became_active":"2023-10-06T03:23:54.577637+0000","last_became_peered":"2023-10-06T03:23:54.577637+0000","last_unstale":"2023-10-06T03:23:54.579868+0000","last_undegraded":"2023-10-06T03:23:54.579868+0000","last_fullsized":"2023-10-06T03:23:54.579868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:14.629579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557999+0000","last_change":"2023-10-06T03:23:49.550476+0000","last_active":"2023-10-06T03:23:54.557999+0000","last_peered":"2023-10-06T03:23:54.557999+0000","last_clean":"2023-10-06T03:23:54.557999+0000","last_became_active":"2023-10-06T03:23:49.549380+0000","last_became_peered":"2023-10-06T03:23:49.549380+0000","last_unstale":"2023-10-06T03:23:54.557999+0000","last_undegraded":"2023-10-06T03:23:54.557999+0000","last_fullsized":"2023-10-06T03:23:54.557999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.028565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574909+0000","last_change":"2023-10-06T03:23:50.556274+0000","last_active":"2023-10-06T03:23:54.574909+0000","last_peered":"2023-10-06T03:23:54.574909+0000","last_clean":"2023-10-06T03:23:54.574909+0000","last_became_active":"2023-10-06T03:23:50.555698+0000","last_became_peered":"2023-10-06T03:23:50.555698+0000","last_unstale":"2023-10-06T03:23:54.574909+0000","last_undegraded":"2023-10-06T03:23:54.574909+0000","last_fullsized":"2023-10-06T03:23:54.574909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585484+0000","last_change":"2023-10-06T03:23:54.583261+0000","last_active":"2023-10-06T03:23:54.585484+0000","last_peered":"2023-10-06T03:23:54.585484+0000","last_clean":"2023-10-06T03:23:54.585484+0000","last_became_active":"2023-10-06T03:23:54.582906+0000","last_became_peered":"2023-10-06T03:23:54.582906+0000","last_unstale":"2023-10-06T03:23:54.585484+0000","last_undegraded":"2023-10-06T03:23:54.585484+0000","last_fullsized":"2023-10-06T03:23:54.585484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:49.490384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559423+0000","last_change":"2023-10-06T03:23:49.542977+0000","last_active":"2023-10-06T03:23:54.559423+0000","last_peered":"2023-10-06T03:23:54.559423+0000","last_clean":"2023-10-06T03:23:54.559423+0000","last_became_active":"2023-10-06T03:23:49.541527+0000","last_became_peered":"2023-10-06T03:23:49.541527+0000","last_unstale":"2023-10-06T03:23:54.559423+0000","last_undegraded":"2023-10-06T03:23:54.559423+0000","last_fullsized":"2023-10-06T03:23:54.559423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570117+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:23:54.570117+0000","last_peered":"2023-10-06T03:23:54.570117+0000","last_clean":"2023-10-06T03:23:54.570117+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:23:54.570117+0000","last_undegraded":"2023-10-06T03:23:54.570117+0000","last_fullsized":"2023-10-06T03:23:54.570117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557888+0000","last_change":"2023-10-06T03:23:50.559454+0000","last_active":"2023-10-06T03:23:54.557888+0000","last_peered":"2023-10-06T03:23:54.557888+0000","last_clean":"2023-10-06T03:23:54.557888+0000","last_became_active":"2023-10-06T03:23:50.554761+0000","last_became_peered":"2023-10-06T03:23:50.554761+0000","last_unstale":"2023-10-06T03:23:54.557888+0000","last_undegraded":"2023-10-06T03:23:54.557888+0000","last_fullsized":"2023-10-06T03:23:54.557888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:42.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585917+0000","last_change":"2023-10-06T03:23:54.583446+0000","last_active":"2023-10-06T03:23:54.585917+0000","last_peered":"2023-10-06T03:23:54.585917+0000","last_clean":"2023-10-06T03:23:54.585917+0000","last_became_active":"2023-10-06T03:23:54.583023+0000","last_became_peered":"2023-10-06T03:23:54.583023+0000","last_unstale":"2023-10-06T03:23:54.585917+0000","last_undegraded":"2023-10-06T03:23:54.585917+0000","last_fullsized":"2023-10-06T03:23:54.585917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:03.806535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558092+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:23:54.558092+0000","last_peered":"2023-10-06T03:23:54.558092+0000","last_clean":"2023-10-06T03:23:54.558092+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:23:54.558092+0000","last_undegraded":"2023-10-06T03:23:54.558092+0000","last_fullsized":"2023-10-06T03:23:54.558092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.618705+0000","last_change":"2023-10-06T03:23:49.546452+0000","last_active":"2023-10-06T03:23:54.618705+0000","last_peered":"2023-10-06T03:23:54.618705+0000","last_clean":"2023-10-06T03:23:54.618705+0000","last_became_active":"2023-10-06T03:23:49.545885+0000","last_became_peered":"2023-10-06T03:23:49.545885+0000","last_unstale":"2023-10-06T03:23:54.618705+0000","last_undegraded":"2023-10-06T03:23:54.618705+0000","last_fullsized":"2023-10-06T03:23:54.618705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568810+0000","last_change":"2023-10-06T03:23:50.550474+0000","last_active":"2023-10-06T03:23:54.568810+0000","last_peered":"2023-10-06T03:23:54.568810+0000","last_clean":"2023-10-06T03:23:54.568810+0000","last_became_active":"2023-10-06T03:23:50.550207+0000","last_became_peered":"2023-10-06T03:23:50.550207+0000","last_unstale":"2023-10-06T03:23:54.568810+0000","last_undegraded":"2023-10-06T03:23:54.568810+0000","last_fullsized":"2023-10-06T03:23:54.568810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:42.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582115+0000","last_change":"2023-10-06T03:23:54.574338+0000","last_active":"2023-10-06T03:23:54.582115+0000","last_peered":"2023-10-06T03:23:54.582115+0000","last_clean":"2023-10-06T03:23:54.582115+0000","last_became_active":"2023-10-06T03:23:54.573845+0000","last_became_peered":"2023-10-06T03:23:54.573845+0000","last_unstale":"2023-10-06T03:23:54.582115+0000","last_undegraded":"2023-10-06T03:23:54.582115+0000","last_fullsized":"2023-10-06T03:23:54.582115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574305+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:23:54.574305+0000","last_peered":"2023-10-06T03:23:54.574305+0000","last_clean":"2023-10-06T03:23:54.574305+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:23:54.574305+0000","last_undegraded":"2023-10-06T03:23:54.574305+0000","last_fullsized":"2023-10-06T03:23:54.574305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560457+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:23:54.560457+0000","last_peered":"2023-10-06T03:23:54.560457+0000","last_clean":"2023-10-06T03:23:54.560457+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:23:54.560457+0000","last_undegraded":"2023-10-06T03:23:54.560457+0000","last_fullsized":"2023-10-06T03:23:54.560457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.564914+0000","last_change":"2023-10-06T03:23:49.548108+0000","last_active":"2023-10-06T03:23:54.564914+0000","last_peered":"2023-10-06T03:23:54.564914+0000","last_clean":"2023-10-06T03:23:54.564914+0000","last_became_active":"2023-10-06T03:23:49.547822+0000","last_became_peered":"2023-10-06T03:23:49.547822+0000","last_unstale":"2023-10-06T03:23:54.564914+0000","last_undegraded":"2023-10-06T03:23:54.564914+0000","last_fullsized":"2023-10-06T03:23:54.564914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565572+0000","last_change":"2023-10-06T03:23:50.553282+0000","last_active":"2023-10-06T03:23:54.565572+0000","last_peered":"2023-10-06T03:23:54.565572+0000","last_clean":"2023-10-06T03:23:54.565572+0000","last_became_active":"2023-10-06T03:23:50.553022+0000","last_became_peered":"2023-10-06T03:23:50.553022+0000","last_unstale":"2023-10-06T03:23:54.565572+0000","last_undegraded":"2023-10-06T03:23:54.565572+0000","last_fullsized":"2023-10-06T03:23:54.565572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585122+0000","last_change":"2023-10-06T03:23:54.579225+0000","last_active":"2023-10-06T03:23:54.585122+0000","last_peered":"2023-10-06T03:23:54.585122+0000","last_clean":"2023-10-06T03:23:54.585122+0000","last_became_active":"2023-10-06T03:23:54.578772+0000","last_became_peered":"2023-10-06T03:23:54.578772+0000","last_unstale":"2023-10-06T03:23:54.585122+0000","last_undegraded":"2023-10-06T03:23:54.585122+0000","last_fullsized":"2023-10-06T03:23:54.585122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:20.332751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.562142+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:23:54.562142+0000","last_peered":"2023-10-06T03:23:54.562142+0000","last_clean":"2023-10-06T03:23:54.562142+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:23:54.562142+0000","last_undegraded":"2023-10-06T03:23:54.562142+0000","last_fullsized":"2023-10-06T03:23:54.562142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573464+0000","last_change":"2023-10-06T03:23:49.543301+0000","last_active":"2023-10-06T03:23:54.573464+0000","last_peered":"2023-10-06T03:23:54.573464+0000","last_clean":"2023-10-06T03:23:54.573464+0000","last_became_active":"2023-10-06T03:23:49.543042+0000","last_became_peered":"2023-10-06T03:23:49.543042+0000","last_unstale":"2023-10-06T03:23:54.573464+0000","last_undegraded":"2023-10-06T03:23:54.573464+0000","last_fullsized":"2023-10-06T03:23:54.573464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:01.161389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574803+0000","last_change":"2023-10-06T03:23:50.556439+0000","last_active":"2023-10-06T03:23:54.574803+0000","last_peered":"2023-10-06T03:23:54.574803+0000","last_clean":"2023-10-06T03:23:54.574803+0000","last_became_active":"2023-10-06T03:23:50.556043+0000","last_became_peered":"2023-10-06T03:23:50.556043+0000","last_unstale":"2023-10-06T03:23:54.574803+0000","last_undegraded":"2023-10-06T03:23:54.574803+0000","last_fullsized":"2023-10-06T03:23:54.574803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:28.082470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.583328+0000","last_change":"2023-10-06T03:23:54.577530+0000","last_active":"2023-10-06T03:23:54.583328+0000","last_peered":"2023-10-06T03:23:54.583328+0000","last_clean":"2023-10-06T03:23:54.583328+0000","last_became_active":"2023-10-06T03:23:54.577161+0000","last_became_peered":"2023-10-06T03:23:54.577161+0000","last_unstale":"2023-10-06T03:23:54.583328+0000","last_undegraded":"2023-10-06T03:23:54.583328+0000","last_fullsized":"2023-10-06T03:23:54.583328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:01.313140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560295+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:23:54.560295+0000","last_peered":"2023-10-06T03:23:54.560295+0000","last_clean":"2023-10-06T03:23:54.560295+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:23:54.560295+0000","last_undegraded":"2023-10-06T03:23:54.560295+0000","last_fullsized":"2023-10-06T03:23:54.560295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558696+0000","last_change":"2023-10-06T03:23:49.548616+0000","last_active":"2023-10-06T03:23:54.558696+0000","last_peered":"2023-10-06T03:23:54.558696+0000","last_clean":"2023-10-06T03:23:54.558696+0000","last_became_active":"2023-10-06T03:23:49.548377+0000","last_became_peered":"2023-10-06T03:23:49.548377+0000","last_unstale":"2023-10-06T03:23:54.558696+0000","last_undegraded":"2023-10-06T03:23:54.558696+0000","last_fullsized":"2023-10-06T03:23:54.558696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:44.960845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572427+0000","last_change":"2023-10-06T03:23:50.558690+0000","last_active":"2023-10-06T03:23:54.572427+0000","last_peered":"2023-10-06T03:23:54.572427+0000","last_clean":"2023-10-06T03:23:54.572427+0000","last_became_active":"2023-10-06T03:23:50.558466+0000","last_became_peered":"2023-10-06T03:23:50.558466+0000","last_unstale":"2023-10-06T03:23:54.572427+0000","last_undegraded":"2023-10-06T03:23:54.572427+0000","last_fullsized":"2023-10-06T03:23:54.572427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.386684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.588069+0000","last_change":"2023-10-06T03:23:54.579261+0000","last_active":"2023-10-06T03:23:54.588069+0000","last_peered":"2023-10-06T03:23:54.588069+0000","last_clean":"2023-10-06T03:23:54.588069+0000","last_became_active":"2023-10-06T03:23:54.578854+0000","last_became_peered":"2023-10-06T03:23:54.578854+0000","last_unstale":"2023-10-06T03:23:54.588069+0000","last_undegraded":"2023-10-06T03:23:54.588069+0000","last_fullsized":"2023-10-06T03:23:54.588069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:26.465848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560024+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:23:54.560024+0000","last_peered":"2023-10-06T03:23:54.560024+0000","last_clean":"2023-10-06T03:23:54.560024+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:23:54.560024+0000","last_undegraded":"2023-10-06T03:23:54.560024+0000","last_fullsized":"2023-10-06T03:23:54.560024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570037+0000","last_change":"2023-10-06T03:23:49.547635+0000","last_active":"2023-10-06T03:23:54.570037+0000","last_peered":"2023-10-06T03:23:54.570037+0000","last_clean":"2023-10-06T03:23:54.570037+0000","last_became_active":"2023-10-06T03:23:49.545752+0000","last_became_peered":"2023-10-06T03:23:49.545752+0000","last_unstale":"2023-10-06T03:23:54.570037+0000","last_undegraded":"2023-10-06T03:23:54.570037+0000","last_fullsized":"2023-10-06T03:23:54.570037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574483+0000","last_change":"2023-10-06T03:23:50.549324+0000","last_active":"2023-10-06T03:23:54.574483+0000","last_peered":"2023-10-06T03:23:54.574483+0000","last_clean":"2023-10-06T03:23:54.574483+0000","last_became_active":"2023-10-06T03:23:50.546439+0000","last_became_peered":"2023-10-06T03:23:50.546439+0000","last_unstale":"2023-10-06T03:23:54.574483+0000","last_undegraded":"2023-10-06T03:23:54.574483+0000","last_fullsized":"2023-10-06T03:23:54.574483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:21.033440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.583424+0000","last_change":"2023-10-06T03:23:54.579994+0000","last_active":"2023-10-06T03:23:54.583424+0000","last_peered":"2023-10-06T03:23:54.583424+0000","last_clean":"2023-10-06T03:23:54.583424+0000","last_became_active":"2023-10-06T03:23:54.579608+0000","last_became_peered":"2023-10-06T03:23:54.579608+0000","last_unstale":"2023-10-06T03:23:54.583424+0000","last_undegraded":"2023-10-06T03:23:54.583424+0000","last_fullsized":"2023-10-06T03:23:54.583424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:43.155244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572140+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:23:54.572140+0000","last_peered":"2023-10-06T03:23:54.572140+0000","last_clean":"2023-10-06T03:23:54.572140+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:23:54.572140+0000","last_undegraded":"2023-10-06T03:23:54.572140+0000","last_fullsized":"2023-10-06T03:23:54.572140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574682+0000","last_change":"2023-10-06T03:23:49.545180+0000","last_active":"2023-10-06T03:23:54.574682+0000","last_peered":"2023-10-06T03:23:54.574682+0000","last_clean":"2023-10-06T03:23:54.574682+0000","last_became_active":"2023-10-06T03:23:49.544948+0000","last_became_peered":"2023-10-06T03:23:49.544948+0000","last_unstale":"2023-10-06T03:23:54.574682+0000","last_undegraded":"2023-10-06T03:23:54.574682+0000","last_fullsized":"2023-10-06T03:23:54.574682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567580+0000","last_change":"2023-10-06T03:23:50.550782+0000","last_active":"2023-10-06T03:23:54.567580+0000","last_peered":"2023-10-06T03:23:54.567580+0000","last_clean":"2023-10-06T03:23:54.567580+0000","last_became_active":"2023-10-06T03:23:50.550406+0000","last_became_peered":"2023-10-06T03:23:50.550406+0000","last_unstale":"2023-10-06T03:23:54.567580+0000","last_undegraded":"2023-10-06T03:23:54.567580+0000","last_fullsized":"2023-10-06T03:23:54.567580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.588080+0000","last_change":"2023-10-06T03:23:54.580162+0000","last_active":"2023-10-06T03:23:54.588080+0000","last_peered":"2023-10-06T03:23:54.588080+0000","last_clean":"2023-10-06T03:23:54.588080+0000","last_became_active":"2023-10-06T03:23:54.579792+0000","last_became_peered":"2023-10-06T03:23:54.579792+0000","last_unstale":"2023-10-06T03:23:54.588080+0000","last_undegraded":"2023-10-06T03:23:54.588080+0000","last_fullsized":"2023-10-06T03:23:54.588080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572797+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:23:54.572797+0000","last_peered":"2023-10-06T03:23:54.572797+0000","last_clean":"2023-10-06T03:23:54.572797+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:23:54.572797+0000","last_undegraded":"2023-10-06T03:23:54.572797+0000","last_fullsized":"2023-10-06T03:23:54.572797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561503+0000","last_change":"2023-10-06T03:23:49.544756+0000","last_active":"2023-10-06T03:23:54.561503+0000","last_peered":"2023-10-06T03:23:54.561503+0000","last_clean":"2023-10-06T03:23:54.561503+0000","last_became_active":"2023-10-06T03:23:49.544484+0000","last_became_peered":"2023-10-06T03:23:49.544484+0000","last_unstale":"2023-10-06T03:23:54.561503+0000","last_undegraded":"2023-10-06T03:23:54.561503+0000","last_fullsized":"2023-10-06T03:23:54.561503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573304+0000","last_change":"2023-10-06T03:23:50.553155+0000","last_active":"2023-10-06T03:23:54.573304+0000","last_peered":"2023-10-06T03:23:54.573304+0000","last_clean":"2023-10-06T03:23:54.573304+0000","last_became_active":"2023-10-06T03:23:50.552915+0000","last_became_peered":"2023-10-06T03:23:50.552915+0000","last_unstale":"2023-10-06T03:23:54.573304+0000","last_undegraded":"2023-10-06T03:23:54.573304+0000","last_fullsized":"2023-10-06T03:23:54.573304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581310+0000","last_change":"2023-10-06T03:23:54.580336+0000","last_active":"2023-10-06T03:23:54.581310+0000","last_peered":"2023-10-06T03:23:54.581310+0000","last_clean":"2023-10-06T03:23:54.581310+0000","last_became_active":"2023-10-06T03:23:54.579923+0000","last_became_peered":"2023-10-06T03:23:54.579923+0000","last_unstale":"2023-10-06T03:23:54.581310+0000","last_undegraded":"2023-10-06T03:23:54.581310+0000","last_fullsized":"2023-10-06T03:23:54.581310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:18.254667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567497+0000","last_change":"2023-10-06T03:23:49.551353+0000","last_active":"2023-10-06T03:23:54.567497+0000","last_peered":"2023-10-06T03:23:54.567497+0000","last_clean":"2023-10-06T03:23:54.567497+0000","last_became_active":"2023-10-06T03:23:49.550924+0000","last_became_peered":"2023-10-06T03:23:49.550924+0000","last_unstale":"2023-10-06T03:23:54.567497+0000","last_undegraded":"2023-10-06T03:23:54.567497+0000","last_fullsized":"2023-10-06T03:23:54.567497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561785+0000","last_change":"2023-10-06T03:23:50.548063+0000","last_active":"2023-10-06T03:23:54.561785+0000","last_peered":"2023-10-06T03:23:54.561785+0000","last_clean":"2023-10-06T03:23:54.561785+0000","last_became_active":"2023-10-06T03:23:50.547820+0000","last_became_peered":"2023-10-06T03:23:50.547820+0000","last_unstale":"2023-10-06T03:23:54.561785+0000","last_undegraded":"2023-10-06T03:23:54.561785+0000","last_fullsized":"2023-10-06T03:23:54.561785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:06.967901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.584497+0000","last_change":"2023-10-06T03:23:54.580975+0000","last_active":"2023-10-06T03:23:54.584497+0000","last_peered":"2023-10-06T03:23:54.584497+0000","last_clean":"2023-10-06T03:23:54.584497+0000","last_became_active":"2023-10-06T03:23:54.580530+0000","last_became_peered":"2023-10-06T03:23:54.580530+0000","last_unstale":"2023-10-06T03:23:54.584497+0000","last_undegraded":"2023-10-06T03:23:54.584497+0000","last_fullsized":"2023-10-06T03:23:54.584497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:26.465848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560207+0000","last_change":"2023-10-06T03:23:49.550718+0000","last_active":"2023-10-06T03:23:54.560207+0000","last_peered":"2023-10-06T03:23:54.560207+0000","last_clean":"2023-10-06T03:23:54.560207+0000","last_became_active":"2023-10-06T03:23:49.550451+0000","last_became_peered":"2023-10-06T03:23:49.550451+0000","last_unstale":"2023-10-06T03:23:54.560207+0000","last_undegraded":"2023-10-06T03:23:54.560207+0000","last_fullsized":"2023-10-06T03:23:54.560207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569944+0000","last_change":"2023-10-06T03:23:50.560044+0000","last_active":"2023-10-06T03:23:54.569944+0000","last_peered":"2023-10-06T03:23:54.569944+0000","last_clean":"2023-10-06T03:23:54.569944+0000","last_became_active":"2023-10-06T03:23:50.559762+0000","last_became_peered":"2023-10-06T03:23:50.559762+0000","last_unstale":"2023-10-06T03:23:54.569944+0000","last_undegraded":"2023-10-06T03:23:54.569944+0000","last_fullsized":"2023-10-06T03:23:54.569944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:57.290738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.577962+0000","last_change":"2023-10-06T03:23:54.572457+0000","last_active":"2023-10-06T03:23:54.577962+0000","last_peered":"2023-10-06T03:23:54.577962+0000","last_clean":"2023-10-06T03:23:54.577962+0000","last_became_active":"2023-10-06T03:23:54.571942+0000","last_became_peered":"2023-10-06T03:23:54.571942+0000","last_unstale":"2023-10-06T03:23:54.577962+0000","last_undegraded":"2023-10-06T03:23:54.577962+0000","last_fullsized":"2023-10-06T03:23:54.577962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:04.871504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561406+0000","last_change":"2023-10-06T03:23:49.550646+0000","last_active":"2023-10-06T03:23:54.561406+0000","last_peered":"2023-10-06T03:23:54.561406+0000","last_clean":"2023-10-06T03:23:54.561406+0000","last_became_active":"2023-10-06T03:23:49.550386+0000","last_became_peered":"2023-10-06T03:23:49.550386+0000","last_unstale":"2023-10-06T03:23:54.561406+0000","last_undegraded":"2023-10-06T03:23:54.561406+0000","last_fullsized":"2023-10-06T03:23:54.561406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570428+0000","last_change":"2023-10-06T03:23:50.546985+0000","last_active":"2023-10-06T03:23:54.570428+0000","last_peered":"2023-10-06T03:23:54.570428+0000","last_clean":"2023-10-06T03:23:54.570428+0000","last_became_active":"2023-10-06T03:23:50.546697+0000","last_became_peered":"2023-10-06T03:23:50.546697+0000","last_unstale":"2023-10-06T03:23:54.570428+0000","last_undegraded":"2023-10-06T03:23:54.570428+0000","last_fullsized":"2023-10-06T03:23:54.570428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:14.232265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582421+0000","last_change":"2023-10-06T03:23:54.580064+0000","last_active":"2023-10-06T03:23:54.582421+0000","last_peered":"2023-10-06T03:23:54.582421+0000","last_clean":"2023-10-06T03:23:54.582421+0000","last_became_active":"2023-10-06T03:23:54.579678+0000","last_became_peered":"2023-10-06T03:23:54.579678+0000","last_unstale":"2023-10-06T03:23:54.582421+0000","last_undegraded":"2023-10-06T03:23:54.582421+0000","last_fullsized":"2023-10-06T03:23:54.582421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:35.686057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559611+0000","last_change":"2023-10-06T03:23:49.548219+0000","last_active":"2023-10-06T03:23:54.559611+0000","last_peered":"2023-10-06T03:23:54.559611+0000","last_clean":"2023-10-06T03:23:54.559611+0000","last_became_active":"2023-10-06T03:23:49.547961+0000","last_became_peered":"2023-10-06T03:23:49.547961+0000","last_unstale":"2023-10-06T03:23:54.559611+0000","last_undegraded":"2023-10-06T03:23:54.559611+0000","last_fullsized":"2023-10-06T03:23:54.559611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:26.970739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557859+0000","last_change":"2023-10-06T03:23:50.551706+0000","last_active":"2023-10-06T03:23:54.557859+0000","last_peered":"2023-10-06T03:23:54.557859+0000","last_clean":"2023-10-06T03:23:54.557859+0000","last_became_active":"2023-10-06T03:23:50.551421+0000","last_became_peered":"2023-10-06T03:23:50.551421+0000","last_unstale":"2023-10-06T03:23:54.557859+0000","last_undegraded":"2023-10-06T03:23:54.557859+0000","last_fullsized":"2023-10-06T03:23:54.557859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:16.310349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586634+0000","last_change":"2023-10-06T03:23:54.585084+0000","last_active":"2023-10-06T03:23:54.586634+0000","last_peered":"2023-10-06T03:23:54.586634+0000","last_clean":"2023-10-06T03:23:54.586634+0000","last_became_active":"2023-10-06T03:23:54.584340+0000","last_became_peered":"2023-10-06T03:23:54.584340+0000","last_unstale":"2023-10-06T03:23:54.586634+0000","last_undegraded":"2023-10-06T03:23:54.586634+0000","last_fullsized":"2023-10-06T03:23:54.586634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:56.706198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566271+0000","last_change":"2023-10-06T03:23:49.544298+0000","last_active":"2023-10-06T03:23:54.566271+0000","last_peered":"2023-10-06T03:23:54.566271+0000","last_clean":"2023-10-06T03:23:54.566271+0000","last_became_active":"2023-10-06T03:23:49.543893+0000","last_became_peered":"2023-10-06T03:23:49.543893+0000","last_unstale":"2023-10-06T03:23:54.566271+0000","last_undegraded":"2023-10-06T03:23:54.566271+0000","last_fullsized":"2023-10-06T03:23:54.566271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568117+0000","last_change":"2023-10-06T03:23:50.553611+0000","last_active":"2023-10-06T03:23:54.568117+0000","last_peered":"2023-10-06T03:23:54.568117+0000","last_clean":"2023-10-06T03:23:54.568117+0000","last_became_active":"2023-10-06T03:23:50.553182+0000","last_became_peered":"2023-10-06T03:23:50.553182+0000","last_unstale":"2023-10-06T03:23:54.568117+0000","last_undegraded":"2023-10-06T03:23:54.568117+0000","last_fullsized":"2023-10-06T03:23:54.568117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:16.310349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572471+0000","last_change":"2023-10-06T03:23:50.553726+0000","last_active":"2023-10-06T03:23:54.572471+0000","last_peered":"2023-10-06T03:23:54.572471+0000","last_clean":"2023-10-06T03:23:54.572471+0000","last_became_active":"2023-10-06T03:23:50.553470+0000","last_became_peered":"2023-10-06T03:23:50.553470+0000","last_unstale":"2023-10-06T03:23:54.572471+0000","last_undegraded":"2023-10-06T03:23:54.572471+0000","last_fullsized":"2023-10-06T03:23:54.572471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:29.620598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557956+0000","last_change":"2023-10-06T03:23:50.559351+0000","last_active":"2023-10-06T03:23:54.557956+0000","last_peered":"2023-10-06T03:23:54.557956+0000","last_clean":"2023-10-06T03:23:54.557956+0000","last_became_active":"2023-10-06T03:23:50.554817+0000","last_became_peered":"2023-10-06T03:23:50.554817+0000","last_unstale":"2023-10-06T03:23:54.557956+0000","last_undegraded":"2023-10-06T03:23:54.557956+0000","last_fullsized":"2023-10-06T03:23:54.557956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:29.722975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570702+0000","last_change":"2023-10-06T03:23:50.556578+0000","last_active":"2023-10-06T03:23:54.570702+0000","last_peered":"2023-10-06T03:23:54.570702+0000","last_clean":"2023-10-06T03:23:54.570702+0000","last_became_active":"2023-10-06T03:23:50.556314+0000","last_became_peered":"2023-10-06T03:23:50.556314+0000","last_unstale":"2023-10-06T03:23:54.570702+0000","last_undegraded":"2023-10-06T03:23:54.570702+0000","last_fullsized":"2023-10-06T03:23:54.570702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:00.849101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558641+0000","last_change":"2023-10-06T03:23:50.556963+0000","last_active":"2023-10-06T03:23:54.558641+0000","last_peered":"2023-10-06T03:23:54.558641+0000","last_clean":"2023-10-06T03:23:54.558641+0000","last_became_active":"2023-10-06T03:23:50.555458+0000","last_became_peered":"2023-10-06T03:23:50.555458+0000","last_unstale":"2023-10-06T03:23:54.558641+0000","last_undegraded":"2023-10-06T03:23:54.558641+0000","last_fullsized":"2023-10-06T03:23:54.558641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574585+0000","last_change":"2023-10-06T03:23:50.551327+0000","last_active":"2023-10-06T03:23:54.574585+0000","last_peered":"2023-10-06T03:23:54.574585+0000","last_clean":"2023-10-06T03:23:54.574585+0000","last_became_active":"2023-10-06T03:23:50.551040+0000","last_became_peered":"2023-10-06T03:23:50.551040+0000","last_unstale":"2023-10-06T03:23:54.574585+0000","last_undegraded":"2023-10-06T03:23:54.574585+0000","last_fullsized":"2023-10-06T03:23:54.574585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":698736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":694806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":103639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":106030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":105062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:05.015 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:24:05.016 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T03:24:05.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T03:24:05.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T03:24:05.016 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T03:24:05.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.160+0000 7f18f9c66700 1 Processor -- start 2023-10-06T03:24:05.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.160+0000 7f18f9c66700 1 -- start start 2023-10-06T03:24:05.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.161+0000 7f18f9c66700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 0x7f18f40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.161+0000 7f18f9c66700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f40b0ca0 con 0x7f18f40b07a0 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.161+0000 7f18f9c66700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f40b0f80 con 0x7f18f40b49e0 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.161+0000 7f18f9c66700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40b1260 con 0x7f18f41595a0 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.161+0000 7f18f3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f18f40b07a0 0x7f18f40b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48264/0 (socket says 172.21.15.84:48264) 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.161+0000 7f18f3fff700 1 -- 172.21.15.84:0/1578962169 learned_addr learned my addr 172.21.15.84:0/1578962169 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.161+0000 7f18f37fe700 1 --2- 172.21.15.84:0/1578962169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 0x7f18f40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f27fc700 1 -- 172.21.15.84:0/1578962169 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672910397 0 0) 0x7f18f40b0ca0 con 0x7f18f40b07a0 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f27fc700 1 -- 172.21.15.84:0/1578962169 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18dc003570 con 0x7f18f40b07a0 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f27fc700 1 -- 172.21.15.84:0/1578962169 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744663840 0 0) 0x7f18f40b0f80 con 0x7f18f40b49e0 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f27fc700 1 -- 172.21.15.84:0/1578962169 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f40b0ca0 con 0x7f18f40b49e0 2023-10-06T03:24:05.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f37fe700 1 -- 172.21.15.84:0/1578962169 >> v1:172.21.15.131:6789/0 conn(0x7f18f40b49e0 legacy=0x7f18f40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f37fe700 1 -- 172.21.15.84:0/1578962169 >> v1:172.21.15.84:6789/0 conn(0x7f18f40b07a0 legacy=0x7f18f40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f37fe700 1 -- 172.21.15.84:0/1578962169 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f40b1540 con 0x7f18f41595a0 2023-10-06T03:24:05.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f37fe700 1 --2- 172.21.15.84:0/1578962169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 0x7f18f40aa570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009900 tx=0x7f18e4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fb01c8707825a4c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f27fc700 1 -- 172.21.15.84:0/1578962169 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4005c10 con 0x7f18f41595a0 2023-10-06T03:24:05.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f27fc700 1 -- 172.21.15.84:0/1578962169 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e4005d70 con 0x7f18f41595a0 2023-10-06T03:24:05.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.162+0000 7f18f27fc700 1 -- 172.21.15.84:0/1578962169 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4006240 con 0x7f18f41595a0 2023-10-06T03:24:05.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.163+0000 7f18f9c66700 1 -- 172.21.15.84:0/1578962169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 msgr2=0x7f18f40aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.163+0000 7f18f9c66700 1 --2- 172.21.15.84:0/1578962169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 0x7f18f40aa570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009900 tx=0x7f18e4009120 comp rx=0 tx=0).stop 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.163+0000 7f18f9c66700 1 -- 172.21.15.84:0/1578962169 shutdown_connections 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.163+0000 7f18f9c66700 1 --2- 172.21.15.84:0/1578962169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 0x7f18f40aa570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.163+0000 7f18f9c66700 1 -- 172.21.15.84:0/1578962169 >> 172.21.15.84:0/1578962169 conn(0x7f18f4099830 msgr2=0x7f18f406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.163+0000 7f18f9c66700 1 -- 172.21.15.84:0/1578962169 shutdown_connections 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.163+0000 7f18f9c66700 1 -- 172.21.15.84:0/1578962169 wait complete. 2023-10-06T03:24:05.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.164+0000 7f18f9c66700 1 Processor -- start 2023-10-06T03:24:05.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.164+0000 7f18f9c66700 1 -- start start 2023-10-06T03:24:05.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f9c66700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b07a0 0x7f18f40b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f9c66700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18f40b49e0 0x7f18f409cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f9c66700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 0x7f18f41587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f9c66700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4169c50 con 0x7f18f40b49e0 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f9c66700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f409d580 con 0x7f18f40b07a0 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f9c66700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f409d860 con 0x7f18f41595a0 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18f40b49e0 0x7f18f409cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18f40b49e0 0x7f18f409cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33814/0 (socket says 172.21.15.84:33814) 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f2ffd700 1 -- 172.21.15.84:0/2377121970 learned_addr learned my addr 172.21.15.84:0/2377121970 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f37fe700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b07a0 0x7f18f40b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f3fff700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 0x7f18f41587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f2ffd700 1 -- 172.21.15.84:0/2377121970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 msgr2=0x7f18f41587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f2ffd700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 0x7f18f41587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f2ffd700 1 -- 172.21.15.84:0/2377121970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b07a0 msgr2=0x7f18f40b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f2ffd700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b07a0 0x7f18f40b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f2ffd700 1 -- 172.21.15.84:0/2377121970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e40093c0 con 0x7f18f40b49e0 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f2ffd700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18f40b49e0 0x7f18f409cbe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18e800c7c0 tx=0x7f18e8007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18db7fe700 1 -- 172.21.15.84:0/2377121970 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8011680 con 0x7f18f40b49e0 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18db7fe700 1 -- 172.21.15.84:0/2377121970 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e8011800 con 0x7f18f40b49e0 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f9c66700 1 -- 172.21.15.84:0/2377121970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f409db40 con 0x7f18f40b49e0 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18db7fe700 1 -- 172.21.15.84:0/2377121970 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8011bc0 con 0x7f18f40b49e0 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.165+0000 7f18f9c66700 1 -- 172.21.15.84:0/2377121970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f40b43a0 con 0x7f18f40b49e0 2023-10-06T03:24:05.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.166+0000 7f18f9c66700 1 -- 172.21.15.84:0/2377121970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f4169dc0 con 0x7f18f40b49e0 2023-10-06T03:24:05.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.167+0000 7f18db7fe700 1 -- 172.21.15.84:0/2377121970 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18e801c460 con 0x7f18f40b49e0 2023-10-06T03:24:05.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.167+0000 7f18db7fe700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18e0066f30 0x7f18e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.167+0000 7f18db7fe700 1 -- 172.21.15.84:0/2377121970 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f18e8084b20 con 0x7f18f40b49e0 2023-10-06T03:24:05.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.167+0000 7f18f37fe700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18e0066f30 0x7f18e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.167+0000 7f18f37fe700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18e0066f30 0x7f18e00693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009160 tx=0x7f18e4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.171+0000 7f18db7fe700 1 -- 172.21.15.84:0/2377121970 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18f4169dc0 con 0x7f18f40b49e0 2023-10-06T03:24:05.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.406+0000 7f18f9c66700 1 -- 172.21.15.84:0/2377121970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f18f4169d90 con 0x7f18f40b49e0 2023-10-06T03:24:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.408+0000 7f18db7fe700 1 -- 172.21.15.84:0/2377121970 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163698 (secure 0 0 0) 0x7f18e8051940 con 0x7f18f40b49e0 2023-10-06T03:24:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 -- 172.21.15.84:0/2377121970 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18e0066f30 msgr2=0x7f18e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18e0066f30 0x7f18e00693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009160 tx=0x7f18e4016000 comp rx=0 tx=0).stop 2023-10-06T03:24:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 -- 172.21.15.84:0/2377121970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18f40b49e0 msgr2=0x7f18f409cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18f40b49e0 0x7f18f409cbe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18e800c7c0 tx=0x7f18e8007de0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 -- 172.21.15.84:0/2377121970 shutdown_connections 2023-10-06T03:24:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18e0066f30 0x7f18e00693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b07a0 0x7f18f40b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18f41595a0 0x7f18f41587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 --2- 172.21.15.84:0/2377121970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18f40b49e0 0x7f18f409cbe0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 -- 172.21.15.84:0/2377121970 >> 172.21.15.84:0/2377121970 conn(0x7f18f4099830 msgr2=0x7f18f4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 -- 172.21.15.84:0/2377121970 shutdown_connections 2023-10-06T03:24:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.411+0000 7f18f9c66700 1 -- 172.21.15.84:0/2377121970 wait complete. 2023-10-06T03:24:05.424 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":90431},{"type":"v1","addr":"172.21.15.84:6833","nonce":90431}]},"active_addr":"172.21.15.84:6833/90431","active_change":"2023-10-06T03:23:37.033170+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1850169477}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":991454623}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2618960362}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2646050735}]}]} 2023-10-06T03:24:05.429 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T03:24:05.429 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T03:24:05.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:05.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.541+0000 7fe61b184700 1 Processor -- start 2023-10-06T03:24:05.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.541+0000 7fe61b184700 1 -- start start 2023-10-06T03:24:05.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.542+0000 7fe61b184700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 0x7fe61406e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.542+0000 7fe61b184700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe6140ca980 0x7fe6140b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.542+0000 7fe61b184700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61406bd00 con 0x7fe614157640 2023-10-06T03:24:05.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.542+0000 7fe61b184700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140b0720 con 0x7fe6140ca980 2023-10-06T03:24:05.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.542+0000 7fe61b184700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140ca730 con 0x7fe614067d00 2023-10-06T03:24:05.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.542+0000 7fe618f20700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe614157640 0x7fe6140675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48266/0 (socket says 172.21.15.84:48266) 2023-10-06T03:24:05.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.542+0000 7fe618f20700 1 -- 172.21.15.84:0/2904088513 learned_addr learned my addr 172.21.15.84:0/2904088513 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:05.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.542+0000 7fe613fff700 1 --2- 172.21.15.84:0/2904088513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 0x7fe61406e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe619721700 1 --2- 172.21.15.84:0/2904088513 >> v2:172.21.15.131:3300/0 conn(0x7fe6140ca980 0x7fe6140b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe6137fe700 1 -- 172.21.15.84:0/2904088513 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508038358 0 0) 0x7fe61406bd00 con 0x7fe614157640 2023-10-06T03:24:05.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe6137fe700 1 -- 172.21.15.84:0/2904088513 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe604003570 con 0x7fe614157640 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe619721700 1 -- 172.21.15.84:0/2904088513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 msgr2=0x7fe61406e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe619721700 1 --2- 172.21.15.84:0/2904088513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 0x7fe61406e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe619721700 1 -- 172.21.15.84:0/2904088513 >> v1:172.21.15.84:6789/0 conn(0x7fe614157640 legacy=0x7fe6140675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe619721700 1 -- 172.21.15.84:0/2904088513 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61406ed10 con 0x7fe6140ca980 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe613fff700 1 --2- 172.21.15.84:0/2904088513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 0x7fe61406e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe619721700 1 --2- 172.21.15.84:0/2904088513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6140ca980 0x7fe6140b01e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009e60 tx=0x7fe60c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d035ec3e477daba1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe6137fe700 1 -- 172.21.15.84:0/2904088513 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00e070 con 0x7fe6140ca980 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe6137fe700 1 -- 172.21.15.84:0/2904088513 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c00bab0 con 0x7fe6140ca980 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.543+0000 7fe6137fe700 1 -- 172.21.15.84:0/2904088513 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00be70 con 0x7fe6140ca980 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.544+0000 7fe61b184700 1 -- 172.21.15.84:0/2904088513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6140ca980 msgr2=0x7fe6140b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.544+0000 7fe61b184700 1 --2- 172.21.15.84:0/2904088513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6140ca980 0x7fe6140b01e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009e60 tx=0x7fe60c009780 comp rx=0 tx=0).stop 2023-10-06T03:24:05.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.544+0000 7fe61b184700 1 -- 172.21.15.84:0/2904088513 shutdown_connections 2023-10-06T03:24:05.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.544+0000 7fe61b184700 1 --2- 172.21.15.84:0/2904088513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6140ca980 0x7fe6140b01e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.544+0000 7fe61b184700 1 --2- 172.21.15.84:0/2904088513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 0x7fe61406e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.544+0000 7fe61b184700 1 -- 172.21.15.84:0/2904088513 >> 172.21.15.84:0/2904088513 conn(0x7fe6140cdef0 msgr2=0x7fe6140c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.544+0000 7fe61b184700 1 -- 172.21.15.84:0/2904088513 shutdown_connections 2023-10-06T03:24:05.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.544+0000 7fe61b184700 1 -- 172.21.15.84:0/2904088513 wait complete. 2023-10-06T03:24:05.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.545+0000 7fe61b184700 1 Processor -- start 2023-10-06T03:24:05.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.545+0000 7fe61b184700 1 -- start start 2023-10-06T03:24:05.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe61b184700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 0x7fe614168b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe61b184700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6140ca980 0x7fe614154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe61b184700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe614157640 0x7fe614167900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe61b184700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614157a10 con 0x7fe614157640 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe61b184700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614157cf0 con 0x7fe6140ca980 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe61b184700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6141681e0 con 0x7fe614067d00 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe619721700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe614157640 0x7fe614167900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe619721700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe614157640 0x7fe614167900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33826/0 (socket says 172.21.15.84:33826) 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe619721700 1 -- 172.21.15.84:0/3276713568 learned_addr learned my addr 172.21.15.84:0/3276713568 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe618f20700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 0x7fe614168b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.546+0000 7fe613fff700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6140ca980 0x7fe614154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe619721700 1 -- 172.21.15.84:0/3276713568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 msgr2=0x7fe614168b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe619721700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 0x7fe614168b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe619721700 1 -- 172.21.15.84:0/3276713568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6140ca980 msgr2=0x7fe614154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe619721700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6140ca980 0x7fe614154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe619721700 1 -- 172.21.15.84:0/3276713568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600009420 con 0x7fe614157640 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe619721700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe614157640 0x7fe614167900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe61406dd20 tx=0x7fe60c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe610ff9700 1 -- 172.21.15.84:0/3276713568 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c012e10 con 0x7fe614157640 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe610ff9700 1 -- 172.21.15.84:0/3276713568 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c027470 con 0x7fe614157640 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe61b184700 1 -- 172.21.15.84:0/3276713568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c009a20 con 0x7fe614157640 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe610ff9700 1 -- 172.21.15.84:0/3276713568 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c027830 con 0x7fe614157640 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.547+0000 7fe61b184700 1 -- 172.21.15.84:0/3276713568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6141687a0 con 0x7fe614157640 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.548+0000 7fe61b184700 1 -- 172.21.15.84:0/3276713568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe614157e60 con 0x7fe614157640 2023-10-06T03:24:05.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.548+0000 7fe610ff9700 1 -- 172.21.15.84:0/3276713568 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe60c024070 con 0x7fe614157640 2023-10-06T03:24:05.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.549+0000 7fe610ff9700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe5f8066f30 0x7fe5f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.549+0000 7fe610ff9700 1 -- 172.21.15.84:0/3276713568 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe60c087300 con 0x7fe614157640 2023-10-06T03:24:05.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.549+0000 7fe618f20700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe5f8066f30 0x7fe5f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.549+0000 7fe618f20700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe5f8066f30 0x7fe5f80693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe608007fd0 tx=0x7fe608009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.553+0000 7fe610ff9700 1 -- 172.21.15.84:0/3276713568 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe60c054120 con 0x7fe614157640 2023-10-06T03:24:05.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.739+0000 7fe61b184700 1 -- 172.21.15.84:0/3276713568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe614064ad0 con 0x7fe614157640 2023-10-06T03:24:05.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.740+0000 7fe610ff9700 1 -- 172.21.15.84:0/3276713568 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fe60c057740 con 0x7fe614157640 2023-10-06T03:24:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:05.742 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:05.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 -- 172.21.15.84:0/3276713568 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe5f8066f30 msgr2=0x7fe5f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe5f8066f30 0x7fe5f80693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe608007fd0 tx=0x7fe608009040 comp rx=0 tx=0).stop 2023-10-06T03:24:05.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 -- 172.21.15.84:0/3276713568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe614157640 msgr2=0x7fe614167900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe614157640 0x7fe614167900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe61406dd20 tx=0x7fe60c019000 comp rx=0 tx=0).stop 2023-10-06T03:24:05.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 -- 172.21.15.84:0/3276713568 shutdown_connections 2023-10-06T03:24:05.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe5f8066f30 0x7fe5f80693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe614157640 0x7fe614167900 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe614067d00 0x7fe614168b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 --2- 172.21.15.84:0/3276713568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6140ca980 0x7fe614154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 -- 172.21.15.84:0/3276713568 >> 172.21.15.84:0/3276713568 conn(0x7fe6140cdef0 msgr2=0x7fe6141564e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 -- 172.21.15.84:0/3276713568 shutdown_connections 2023-10-06T03:24:05.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.742+0000 7fe61b184700 1 -- 172.21.15.84:0/3276713568 wait complete. 2023-10-06T03:24:05.756 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T03:24:05.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:05.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.868+0000 7f91def43700 1 Processor -- start 2023-10-06T03:24:05.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.868+0000 7f91def43700 1 -- start start 2023-10-06T03:24:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91def43700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f91d8159480 0x7f91d80b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91def43700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d80b3610 0x7f91d80cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91def43700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91d80cc1b0 0x7f91d80b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91def43700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d80cb7e0 con 0x7f91d80cc1b0 2023-10-06T03:24:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91def43700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d80b08a0 con 0x7f91d8159480 2023-10-06T03:24:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91def43700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80cb190 con 0x7f91d80b3610 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91de742700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91d80cc1b0 0x7f91d80b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91de742700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91d80cc1b0 0x7f91d80b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33830/0 (socket says 172.21.15.84:33830) 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91de742700 1 -- 172.21.15.84:0/3203818547 learned_addr learned my addr 172.21.15.84:0/3203818547 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91ddf41700 1 --2- 172.21.15.84:0/3203818547 >> v2:172.21.15.131:3300/0 conn(0x7f91d8159480 0x7f91d80b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91dd740700 1 --2- 172.21.15.84:0/3203818547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d80b3610 0x7f91d80cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91de742700 1 -- 172.21.15.84:0/3203818547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d80b3610 msgr2=0x7f91d80cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91de742700 1 --2- 172.21.15.84:0/3203818547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d80b3610 0x7f91d80cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91de742700 1 -- 172.21.15.84:0/3203818547 >> v2:172.21.15.131:3300/0 conn(0x7f91d8159480 msgr2=0x7f91d80b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91de742700 1 --2- 172.21.15.84:0/3203818547 >> v2:172.21.15.131:3300/0 conn(0x7f91d8159480 0x7f91d80b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.869+0000 7f91de742700 1 -- 172.21.15.84:0/3203818547 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d80cb470 con 0x7f91d80cc1b0 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91de742700 1 --2- 172.21.15.84:0/3203818547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d80cc1b0 0x7f91d80b2140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f91d806fa30 tx=0x7f91d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e959ee27f8e1110f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91dcf3f700 1 -- 172.21.15.84:0/3203818547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d000e070 con 0x7f91d80cc1b0 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91dcf3f700 1 -- 172.21.15.84:0/3203818547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d000ba50 con 0x7f91d80cc1b0 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91dcf3f700 1 -- 172.21.15.84:0/3203818547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00092e0 con 0x7f91d80cc1b0 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91def43700 1 -- 172.21.15.84:0/3203818547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d80cc1b0 msgr2=0x7f91d80b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91def43700 1 --2- 172.21.15.84:0/3203818547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d80cc1b0 0x7f91d80b2140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f91d806fa30 tx=0x7f91d0009840 comp rx=0 tx=0).stop 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91def43700 1 -- 172.21.15.84:0/3203818547 shutdown_connections 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91def43700 1 --2- 172.21.15.84:0/3203818547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d80cc1b0 0x7f91d80b2140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91def43700 1 --2- 172.21.15.84:0/3203818547 >> v2:172.21.15.131:3300/0 conn(0x7f91d8159480 0x7f91d80b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91def43700 1 --2- 172.21.15.84:0/3203818547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d80b3610 0x7f91d80cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91def43700 1 -- 172.21.15.84:0/3203818547 >> 172.21.15.84:0/3203818547 conn(0x7f91d806ed20 msgr2=0x7f91d806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91def43700 1 -- 172.21.15.84:0/3203818547 shutdown_connections 2023-10-06T03:24:05.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.870+0000 7f91def43700 1 -- 172.21.15.84:0/3203818547 wait complete. 2023-10-06T03:24:05.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.871+0000 7f91def43700 1 Processor -- start 2023-10-06T03:24:05.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.871+0000 7f91def43700 1 -- start start 2023-10-06T03:24:05.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91def43700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d80b3610 0x7f91d815e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91def43700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d80cc1b0 0x7f91d81547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91def43700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d8159480 0x7f91d80c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91def43700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d815e0a0 con 0x7f91d8159480 2023-10-06T03:24:05.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91def43700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d8154d00 con 0x7f91d80cc1b0 2023-10-06T03:24:05.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91def43700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d815d490 con 0x7f91d80b3610 2023-10-06T03:24:05.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91de742700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d8159480 0x7f91d80c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91ddf41700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d80b3610 0x7f91d815e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91de742700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d8159480 0x7f91d80c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33844/0 (socket says 172.21.15.84:33844) 2023-10-06T03:24:05.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91de742700 1 -- 172.21.15.84:0/3705889715 learned_addr learned my addr 172.21.15.84:0/3705889715 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:05.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.872+0000 7f91dd740700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d80cc1b0 0x7f91d81547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91de742700 1 -- 172.21.15.84:0/3705889715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d80b3610 msgr2=0x7f91d815e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91de742700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d80b3610 0x7f91d815e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91de742700 1 -- 172.21.15.84:0/3705889715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d80cc1b0 msgr2=0x7f91d81547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91de742700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d80cc1b0 0x7f91d81547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91de742700 1 -- 172.21.15.84:0/3705889715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d0009ae0 con 0x7f91d8159480 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91de742700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d8159480 0x7f91d80c7fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91d8069190 tx=0x7f91d0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91cdffb700 1 -- 172.21.15.84:0/3705889715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00032f0 con 0x7f91d8159480 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91cdffb700 1 -- 172.21.15.84:0/3705889715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0008d20 con 0x7f91d8159480 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91cdffb700 1 -- 172.21.15.84:0/3705889715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00266b0 con 0x7f91d8159480 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91def43700 1 -- 172.21.15.84:0/3705889715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d815d770 con 0x7f91d8159480 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.873+0000 7f91def43700 1 -- 172.21.15.84:0/3705889715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d815dd30 con 0x7f91d8159480 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.874+0000 7f91def43700 1 -- 172.21.15.84:0/3705889715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d815dec0 con 0x7f91d8159480 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.874+0000 7f91cdffb700 1 -- 172.21.15.84:0/3705889715 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91d0003040 con 0x7f91d8159480 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.875+0000 7f91cdffb700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f91bc066f30 0x7f91bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.875+0000 7f91cdffb700 1 -- 172.21.15.84:0/3705889715 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f91d0086960 con 0x7f91d8159480 2023-10-06T03:24:05.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.875+0000 7f91ddf41700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f91bc066f30 0x7f91bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.875+0000 7f91ddf41700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f91bc066f30 0x7f91bc0693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f91d4006fd0 tx=0x7f91d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:05.879+0000 7f91cdffb700 1 -- 172.21.15.84:0/3705889715 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91d0053780 con 0x7f91d8159480 2023-10-06T03:24:06.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.061+0000 7f91def43700 1 -- 172.21.15.84:0/3705889715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91d805f270 con 0x7f91d8159480 2023-10-06T03:24:06.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.062+0000 7f91cdffb700 1 -- 172.21.15.84:0/3705889715 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f91d0009940 con 0x7f91d8159480 2023-10-06T03:24:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:06.064 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:06.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.064+0000 7f91def43700 1 -- 172.21.15.84:0/3705889715 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f91bc066f30 msgr2=0x7f91bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.064+0000 7f91def43700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f91bc066f30 0x7f91bc0693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f91d4006fd0 tx=0x7f91d4008040 comp rx=0 tx=0).stop 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.064+0000 7f91def43700 1 -- 172.21.15.84:0/3705889715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d8159480 msgr2=0x7f91d80c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.064+0000 7f91def43700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d8159480 0x7f91d80c7fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91d8069190 tx=0x7f91d0018000 comp rx=0 tx=0).stop 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.065+0000 7f91def43700 1 -- 172.21.15.84:0/3705889715 shutdown_connections 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.065+0000 7f91def43700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f91bc066f30 0x7f91bc0693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.065+0000 7f91def43700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91d8159480 0x7f91d80c7fa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.065+0000 7f91def43700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d80b3610 0x7f91d815e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.065+0000 7f91def43700 1 --2- 172.21.15.84:0/3705889715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d80cc1b0 0x7f91d81547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.065+0000 7f91def43700 1 -- 172.21.15.84:0/3705889715 >> 172.21.15.84:0/3705889715 conn(0x7f91d806ed20 msgr2=0x7f91d8156620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.065+0000 7f91def43700 1 -- 172.21.15.84:0/3705889715 shutdown_connections 2023-10-06T03:24:06.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.065+0000 7f91def43700 1 -- 172.21.15.84:0/3705889715 wait complete. 2023-10-06T03:24:06.078 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T03:24:06.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T03:24:06.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T03:24:06.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T03:24:06.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T03:24:06.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T03:24:06.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T03:24:06.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T03:24:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.276+0000 7f69b383e700 1 Processor -- start 2023-10-06T03:24:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.277+0000 7f7382625700 1 Processor -- start 2023-10-06T03:24:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.277+0000 7f7382625700 1 -- start start 2023-10-06T03:24:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.277+0000 7f69b383e700 1 -- start start 2023-10-06T03:24:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.277+0000 7f656b696700 1 Processor -- start 2023-10-06T03:24:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.277+0000 7feae2e41700 1 Processor -- start 2023-10-06T03:24:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.277+0000 7fc593660700 1 Processor -- start 2023-10-06T03:24:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.277+0000 7f656b696700 1 -- start start 2023-10-06T03:24:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.277+0000 7fc593660700 1 -- start start 2023-10-06T03:24:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f7382625700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f737c0675f0 0x7f737c06b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f7382625700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 0x7f737c0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f7382625700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c06e9d0 con 0x7f737c06d950 2023-10-06T03:24:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f7382625700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c0af6c0 con 0x7f737c0675f0 2023-10-06T03:24:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f7382625700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c06e130 con 0x7f737c0afb50 2023-10-06T03:24:06.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f1df66f2700 1 Processor -- start 2023-10-06T03:24:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f69b383e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f69ac069c70 0x7f69ac15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f69b383e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f69ac15d920 0x7f69ac15bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f69b383e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ac15b960 con 0x7f69ac159a60 2023-10-06T03:24:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f69b383e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ac15a220 con 0x7f69ac15d920 2023-10-06T03:24:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f69b383e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ac15e2f0 con 0x7f69ac069c70 2023-10-06T03:24:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f69b15da700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f69ac159a60 0x7f69ac069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48280/0 (socket says 172.21.15.84:48280) 2023-10-06T03:24:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f69b15da700 1 -- 172.21.15.84:0/2403361351 learned_addr learned my addr 172.21.15.84:0/2403361351 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f7380bc2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 0x7f737c0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f7380bc2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 0x7f737c0affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55206/0 (socket says 172.21.15.84:55206) 2023-10-06T03:24:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f7380bc2700 1 -- 172.21.15.84:0/3177432112 learned_addr learned my addr 172.21.15.84:0/3177432112 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f737bfff700 1 --2- 172.21.15.84:0/3177432112 >> v2:172.21.15.131:3300/0 conn(0x7f737c0675f0 0x7f737c06b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f656b696700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65640bf360 0x7f65640c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f656b696700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f65640bf730 0x7f6564069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f656b696700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65640c8000 con 0x7f6564069aa0 2023-10-06T03:24:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f656b696700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656415e1d0 con 0x7f65640bf360 2023-10-06T03:24:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f656b696700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6564069ee0 con 0x7f65640bf730 2023-10-06T03:24:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f69b1ddb700 1 --2- 172.21.15.84:0/2403361351 >> v2:172.21.15.84:3300/0 conn(0x7f69ac15d920 0x7f69ac15bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7fc593660700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc58c0b2620 0x7fc58c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7fc593660700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc58c159870 0x7fc58c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7fc593660700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c0cbfe0 con 0x7fc58c0b29f0 2023-10-06T03:24:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7fc593660700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0cb3d0 con 0x7fc58c0b2620 2023-10-06T03:24:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7fc593660700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0cb6b0 con 0x7fc58c159870 2023-10-06T03:24:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7feae2e41700 1 -- start start 2023-10-06T03:24:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7feae2e41700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feadc0bf360 0x7feadc0c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7feae2e41700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feadc0bf730 0x7feadc069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7feae2e41700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc0c8000 con 0x7feadc069aa0 2023-10-06T03:24:06.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7feae2e41700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc069f40 con 0x7feadc0bf730 2023-10-06T03:24:06.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7feae2e41700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc15e1d0 con 0x7feadc0bf360 2023-10-06T03:24:06.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f6569432700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65640bf360 0x7f65640c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f6569432700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65640bf360 0x7f65640c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33852/0 (socket says 172.21.15.84:33852) 2023-10-06T03:24:06.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f6569432700 1 -- 172.21.15.84:0/3167941830 learned_addr learned my addr 172.21.15.84:0/3167941830 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f6568c31700 1 --2- 172.21.15.84:0/3167941830 >> v2:172.21.15.131:3300/0 conn(0x7f65640bf730 0x7f6564069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f69a3fff700 1 -- 172.21.15.84:0/2403361351 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325392128 0 0) 0x7f69ac15b960 con 0x7f69ac159a60 2023-10-06T03:24:06.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f69b0dd9700 1 --2- 172.21.15.84:0/2403361351 >> v2:172.21.15.131:3300/0 conn(0x7f69ac069c70 0x7f69ac15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f69a3fff700 1 -- 172.21.15.84:0/2403361351 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6998003570 con 0x7f69ac159a60 2023-10-06T03:24:06.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f69b1ddb700 1 -- 172.21.15.84:0/2403361351 >> v2:172.21.15.131:3300/0 conn(0x7f69ac069c70 msgr2=0x7f69ac15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f69b1ddb700 1 --2- 172.21.15.84:0/2403361351 >> v2:172.21.15.131:3300/0 conn(0x7f69ac069c70 0x7f69ac15d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f69b1ddb700 1 -- 172.21.15.84:0/2403361351 >> v1:172.21.15.84:6789/0 conn(0x7f69ac159a60 legacy=0x7f69ac069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f69b1ddb700 1 -- 172.21.15.84:0/2403361351 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac15e010 con 0x7f69ac15d920 2023-10-06T03:24:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f69b1ddb700 1 --2- 172.21.15.84:0/2403361351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69ac15d920 0x7f69ac15bdf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f69ac06cb90 tx=0x7f69a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7d609904aef559 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7fc5913fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc58c0b2620 0x7fc58c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7fc5913fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc58c0b2620 0x7fc58c0b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56354/0 (socket says 172.21.15.84:56354) 2023-10-06T03:24:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7fc5913fc700 1 -- 172.21.15.84:0/2646020844 learned_addr learned my addr 172.21.15.84:0/2646020844 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7fc591bfd700 1 --2- 172.21.15.84:0/2646020844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc58c159870 0x7fc58c0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f737affd700 1 -- 172.21.15.84:0/3177432112 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240388186 0 0) 0x7f737c06e9d0 con 0x7f737c06d950 2023-10-06T03:24:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f737affd700 1 -- 172.21.15.84:0/3177432112 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7364003570 con 0x7f737c06d950 2023-10-06T03:24:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f7380bc2700 1 -- 172.21.15.84:0/3177432112 >> v2:172.21.15.131:3300/0 conn(0x7f737c0675f0 msgr2=0x7f737c06b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f7380bc2700 1 --2- 172.21.15.84:0/3177432112 >> v2:172.21.15.131:3300/0 conn(0x7f737c0675f0 0x7f737c06b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f7380bc2700 1 -- 172.21.15.84:0/3177432112 >> v1:172.21.15.84:6789/0 conn(0x7f737c06d950 legacy=0x7f737c0679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f7380bc2700 1 -- 172.21.15.84:0/3177432112 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c06e410 con 0x7f737c0afb50 2023-10-06T03:24:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7feadbfff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feadc0bf730 0x7feadc069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f69a3fff700 1 -- 172.21.15.84:0/2403361351 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a400e070 con 0x7f69ac15d920 2023-10-06T03:24:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f69a3fff700 1 -- 172.21.15.84:0/2403361351 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a400bb60 con 0x7f69ac15d920 2023-10-06T03:24:06.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f69a3fff700 1 -- 172.21.15.84:0/2403361351 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4012430 con 0x7f69ac15d920 2023-10-06T03:24:06.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7fc5913fc700 1 -- 172.21.15.84:0/2646020844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc58c159870 msgr2=0x7fc58c0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7fc5913fc700 1 --2- 172.21.15.84:0/2646020844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc58c159870 0x7fc58c0cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7fc5913fc700 1 -- 172.21.15.84:0/2646020844 >> v1:172.21.15.84:6789/0 conn(0x7fc58c0b29f0 legacy=0x7fc58c159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7fc5913fc700 1 -- 172.21.15.84:0/2646020844 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0cb990 con 0x7fc58c0b2620 2023-10-06T03:24:06.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7feadbfff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feadc0bf730 0x7feadc069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56370/0 (socket says 172.21.15.84:56370) 2023-10-06T03:24:06.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7feadbfff700 1 -- 172.21.15.84:0/2955225910 learned_addr learned my addr 172.21.15.84:0/2955225910 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7feae0bdd700 1 --2- 172.21.15.84:0/2955225910 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feadc0bf360 0x7feadc0c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7feadbfff700 1 -- 172.21.15.84:0/2955225910 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feadc0bf360 msgr2=0x7feadc0c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7feadbfff700 1 --2- 172.21.15.84:0/2955225910 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feadc0bf360 0x7feadc0c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7feadbfff700 1 -- 172.21.15.84:0/2955225910 >> v1:172.21.15.84:6789/0 conn(0x7feadc069aa0 legacy=0x7feadc0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7feadbfff700 1 -- 172.21.15.84:0/2955225910 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0c73f0 con 0x7feadc0bf730 2023-10-06T03:24:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f7380bc2700 1 --2- 172.21.15.84:0/3177432112 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 0x7f737c0affa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f73700099b0 tx=0x7f7370009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d52521a79cf9a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f6569432700 1 -- 172.21.15.84:0/3167941830 >> v2:172.21.15.131:3300/0 conn(0x7f65640bf730 msgr2=0x7f6564069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f6569432700 1 --2- 172.21.15.84:0/3167941830 >> v2:172.21.15.131:3300/0 conn(0x7f65640bf730 0x7f6564069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f6569432700 1 -- 172.21.15.84:0/3167941830 >> v1:172.21.15.131:6789/0 conn(0x7f6564069aa0 legacy=0x7f65640c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f6569432700 1 -- 172.21.15.84:0/3167941830 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640c73f0 con 0x7f65640bf360 2023-10-06T03:24:06.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.278+0000 7f1df66f2700 1 -- start start 2023-10-06T03:24:06.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f1df66f2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1df0156390 0x7f1df00cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f1df66f2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1df006c370 0x7f1df00c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f1df66f2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df006c9e0 con 0x7f1df00cc750 2023-10-06T03:24:06.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f1df66f2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df006c7d0 con 0x7f1df0156390 2023-10-06T03:24:06.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.279+0000 7f1df66f2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00ccbd0 con 0x7f1df006c370 2023-10-06T03:24:06.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f1def7fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f1df00cc750 0x7f1df006bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:50810/0 (socket says 172.21.15.84:50810) 2023-10-06T03:24:06.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f1def7fe700 1 -- 172.21.15.84:0/248567927 learned_addr learned my addr 172.21.15.84:0/248567927 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:06.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f1deffff700 1 --2- 172.21.15.84:0/248567927 >> v2:172.21.15.84:3300/0 conn(0x7f1df0156390 0x7f1df00cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7fc5913fc700 1 --2- 172.21.15.84:0/2646020844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c0b2620 0x7fc58c0b06d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc584009f70 tx=0x7fc584009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=530fb17c0a5d1da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7fc583fff700 1 -- 172.21.15.84:0/2646020844 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58400e070 con 0x7fc58c0b2620 2023-10-06T03:24:06.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7fc583fff700 1 -- 172.21.15.84:0/2646020844 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58400b920 con 0x7fc58c0b2620 2023-10-06T03:24:06.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7fc583fff700 1 -- 172.21.15.84:0/2646020844 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840092e0 con 0x7fc58c0b2620 2023-10-06T03:24:06.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f53990d9700 1 Processor -- start 2023-10-06T03:24:06.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f6569432700 1 --2- 172.21.15.84:0/3167941830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65640bf360 0x7f65640c8490 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f65640cc950 tx=0x7f6560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b5c1485275c7a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7feadbfff700 1 --2- 172.21.15.84:0/2955225910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feadc0bf730 0x7feadc069560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fead00099e0 tx=0x7fead0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=211f24ba02cc710a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f69b383e700 1 -- 172.21.15.84:0/2403361351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69ac15d920 msgr2=0x7f69ac15bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f69b383e700 1 --2- 172.21.15.84:0/2403361351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69ac15d920 0x7f69ac15bdf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f69ac06cb90 tx=0x7f69a4009780 comp rx=0 tx=0).stop 2023-10-06T03:24:06.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f53990d9700 1 -- start start 2023-10-06T03:24:06.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f737affd700 1 -- 172.21.15.84:0/3177432112 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000b680 con 0x7f737c0afb50 2023-10-06T03:24:06.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7feadb7fe700 1 -- 172.21.15.84:0/2955225910 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000b7e0 con 0x7feadc0bf730 2023-10-06T03:24:06.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7feadb7fe700 1 -- 172.21.15.84:0/2955225910 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead000b940 con 0x7feadc0bf730 2023-10-06T03:24:06.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7feadb7fe700 1 -- 172.21.15.84:0/2955225910 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000bce0 con 0x7feadc0bf730 2023-10-06T03:24:06.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f737affd700 1 -- 172.21.15.84:0/3177432112 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737000b7e0 con 0x7f737c0afb50 2023-10-06T03:24:06.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f737affd700 1 -- 172.21.15.84:0/3177432112 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000bb60 con 0x7f737c0afb50 2023-10-06T03:24:06.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f655bfff700 1 -- 172.21.15.84:0/3167941830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000b860 con 0x7f65640bf360 2023-10-06T03:24:06.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f1deffff700 1 -- 172.21.15.84:0/248567927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1df006c370 msgr2=0x7f1df00c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f1deffff700 1 --2- 172.21.15.84:0/248567927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1df006c370 0x7f1df00c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f1deffff700 1 -- 172.21.15.84:0/248567927 >> v1:172.21.15.131:6789/0 conn(0x7f1df00cc750 legacy=0x7f1df006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f1deffff700 1 -- 172.21.15.84:0/248567927 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df0156b60 con 0x7f1df0156390 2023-10-06T03:24:06.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.280+0000 7f1deffff700 1 --2- 172.21.15.84:0/248567927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1df0156390 0x7f1df00cc210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009e60 tx=0x7f1de8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf151c0a09764bbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f655bfff700 1 -- 172.21.15.84:0/3167941830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656000b9c0 con 0x7f65640bf360 2023-10-06T03:24:06.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f655bfff700 1 -- 172.21.15.84:0/3167941830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000bd60 con 0x7f65640bf360 2023-10-06T03:24:06.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7fc593660700 1 -- 172.21.15.84:0/2646020844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c0b2620 msgr2=0x7fc58c0b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7fc593660700 1 --2- 172.21.15.84:0/2646020844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c0b2620 0x7fc58c0b06d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc584009f70 tx=0x7fc584009840 comp rx=0 tx=0).stop 2023-10-06T03:24:06.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7fc593660700 1 -- 172.21.15.84:0/2646020844 shutdown_connections 2023-10-06T03:24:06.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7fc593660700 1 --2- 172.21.15.84:0/2646020844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc58c159870 0x7fc58c0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7fc593660700 1 --2- 172.21.15.84:0/2646020844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c0b2620 0x7fc58c0b06d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7fc593660700 1 -- 172.21.15.84:0/2646020844 >> 172.21.15.84:0/2646020844 conn(0x7fc58c06ed20 msgr2=0x7fc58c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7fc593660700 1 -- 172.21.15.84:0/2646020844 shutdown_connections 2023-10-06T03:24:06.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7fc593660700 1 -- 172.21.15.84:0/2646020844 wait complete. 2023-10-06T03:24:06.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f7382625700 1 -- 172.21.15.84:0/3177432112 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 msgr2=0x7f737c0affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f7382625700 1 --2- 172.21.15.84:0/3177432112 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 0x7f737c0affa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f73700099b0 tx=0x7f7370009250 comp rx=0 tx=0).stop 2023-10-06T03:24:06.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7feae2e41700 1 -- 172.21.15.84:0/2955225910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feadc0bf730 msgr2=0x7feadc069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7feae2e41700 1 --2- 172.21.15.84:0/2955225910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feadc0bf730 0x7feadc069560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fead00099e0 tx=0x7fead0009250 comp rx=0 tx=0).stop 2023-10-06T03:24:06.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f7382625700 1 -- 172.21.15.84:0/3177432112 shutdown_connections 2023-10-06T03:24:06.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f7382625700 1 --2- 172.21.15.84:0/3177432112 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 0x7f737c0affa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f7382625700 1 --2- 172.21.15.84:0/3177432112 >> v2:172.21.15.131:3300/0 conn(0x7f737c0675f0 0x7f737c06b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f7382625700 1 -- 172.21.15.84:0/3177432112 >> 172.21.15.84:0/3177432112 conn(0x7f737c0cc730 msgr2=0x7f737c0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7feae2e41700 1 -- 172.21.15.84:0/2955225910 shutdown_connections 2023-10-06T03:24:06.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7feae2e41700 1 --2- 172.21.15.84:0/2955225910 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feadc0bf360 0x7feadc0c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7feae2e41700 1 --2- 172.21.15.84:0/2955225910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feadc0bf730 0x7feadc069560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7feae2e41700 1 -- 172.21.15.84:0/2955225910 >> 172.21.15.84:0/2955225910 conn(0x7feadc0680c0 msgr2=0x7feadc0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f69b383e700 1 -- 172.21.15.84:0/2403361351 shutdown_connections 2023-10-06T03:24:06.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f69b383e700 1 --2- 172.21.15.84:0/2403361351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69ac15d920 0x7f69ac15bdf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f69b383e700 1 --2- 172.21.15.84:0/2403361351 >> v2:172.21.15.131:3300/0 conn(0x7f69ac069c70 0x7f69ac15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f69b383e700 1 -- 172.21.15.84:0/2403361351 >> 172.21.15.84:0/2403361351 conn(0x7f69ac0680c0 msgr2=0x7f69ac0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f53990d9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53940c82a0 0x7f5394069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f53990d9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f53940cbc60 0x7f5394069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.281+0000 7f53990d9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53940c7e10 con 0x7f5394155860 2023-10-06T03:24:06.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f53990d9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53940acce0 con 0x7f53940cbc60 2023-10-06T03:24:06.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f53990d9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53940c7200 con 0x7f53940c82a0 2023-10-06T03:24:06.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f539259c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53940c82a0 0x7f5394069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f656b696700 1 -- 172.21.15.84:0/3167941830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65640bf360 msgr2=0x7f65640c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f656b696700 1 --2- 172.21.15.84:0/3167941830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65640bf360 0x7f65640c8490 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f65640cc950 tx=0x7f6560009250 comp rx=0 tx=0).stop 2023-10-06T03:24:06.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f539259c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53940c82a0 0x7f5394069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55256/0 (socket says 172.21.15.84:55256) 2023-10-06T03:24:06.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f539259c700 1 -- 172.21.15.84:0/509396533 learned_addr learned my addr 172.21.15.84:0/509396533 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f1deeffd700 1 -- 172.21.15.84:0/248567927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de800e070 con 0x7f1df0156390 2023-10-06T03:24:06.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f7382625700 1 -- 172.21.15.84:0/3177432112 shutdown_connections 2023-10-06T03:24:06.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f656b696700 1 -- 172.21.15.84:0/3167941830 shutdown_connections 2023-10-06T03:24:06.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f656b696700 1 --2- 172.21.15.84:0/3167941830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65640bf360 0x7f65640c8490 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f656b696700 1 --2- 172.21.15.84:0/3167941830 >> v2:172.21.15.131:3300/0 conn(0x7f65640bf730 0x7f6564069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f656b696700 1 -- 172.21.15.84:0/3167941830 >> 172.21.15.84:0/3167941830 conn(0x7f65640680c0 msgr2=0x7f65640cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f69b383e700 1 -- 172.21.15.84:0/2403361351 shutdown_connections 2023-10-06T03:24:06.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7feae2e41700 1 -- 172.21.15.84:0/2955225910 shutdown_connections 2023-10-06T03:24:06.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f539359e700 1 --2- 172.21.15.84:0/509396533 >> v2:172.21.15.84:3300/0 conn(0x7f53940cbc60 0x7f5394069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f656b696700 1 -- 172.21.15.84:0/3167941830 shutdown_connections 2023-10-06T03:24:06.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f539259c700 1 -- 172.21.15.84:0/509396533 >> v2:172.21.15.84:3300/0 conn(0x7f53940cbc60 msgr2=0x7f5394069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f539259c700 1 --2- 172.21.15.84:0/509396533 >> v2:172.21.15.84:3300/0 conn(0x7f53940cbc60 0x7f5394069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f539259c700 1 -- 172.21.15.84:0/509396533 >> v1:172.21.15.84:6789/0 conn(0x7f5394155860 legacy=0x7f53940ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f539259c700 1 -- 172.21.15.84:0/509396533 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53940c74e0 con 0x7f53940c82a0 2023-10-06T03:24:06.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7f539259c700 1 --2- 172.21.15.84:0/509396533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53940c82a0 0x7f5394069560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f538c009f20 tx=0x7f538c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b7674d3ae07b61c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f7382625700 1 -- 172.21.15.84:0/3177432112 wait complete. 2023-10-06T03:24:06.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f69b383e700 1 -- 172.21.15.84:0/2403361351 wait complete. 2023-10-06T03:24:06.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f656b696700 1 -- 172.21.15.84:0/3167941830 wait complete. 2023-10-06T03:24:06.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7f5391d9b700 1 -- 172.21.15.84:0/509396533 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c00e070 con 0x7f53940c82a0 2023-10-06T03:24:06.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7f5391d9b700 1 -- 172.21.15.84:0/509396533 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c00ba40 con 0x7f53940c82a0 2023-10-06T03:24:06.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7f5391d9b700 1 -- 172.21.15.84:0/509396533 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c0092e0 con 0x7f53940c82a0 2023-10-06T03:24:06.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f1deeffd700 1 -- 172.21.15.84:0/248567927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de800bb20 con 0x7f1df0156390 2023-10-06T03:24:06.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.282+0000 7f1deeffd700 1 -- 172.21.15.84:0/248567927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80126e0 con 0x7f1df0156390 2023-10-06T03:24:06.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7f1df66f2700 1 -- 172.21.15.84:0/248567927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1df0156390 msgr2=0x7f1df00cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7f1df66f2700 1 --2- 172.21.15.84:0/248567927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1df0156390 0x7f1df00cc210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009e60 tx=0x7f1de8009780 comp rx=0 tx=0).stop 2023-10-06T03:24:06.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7fc593660700 1 Processor -- start 2023-10-06T03:24:06.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7fc593660700 1 -- start start 2023-10-06T03:24:06.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7f1df66f2700 1 -- 172.21.15.84:0/248567927 shutdown_connections 2023-10-06T03:24:06.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7f1df66f2700 1 --2- 172.21.15.84:0/248567927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1df006c370 0x7f1df00c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7f1df66f2700 1 --2- 172.21.15.84:0/248567927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1df0156390 0x7f1df00cc210 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7f1df66f2700 1 -- 172.21.15.84:0/248567927 >> 172.21.15.84:0/248567927 conn(0x7f1df00cdef0 msgr2=0x7f1df00c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7f1df66f2700 1 -- 172.21.15.84:0/248567927 shutdown_connections 2023-10-06T03:24:06.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7f7382625700 1 Processor -- start 2023-10-06T03:24:06.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7f69b383e700 1 Processor -- start 2023-10-06T03:24:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.283+0000 7feae2e41700 1 -- 172.21.15.84:0/2955225910 wait complete. 2023-10-06T03:24:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7feae2e41700 1 Processor -- start 2023-10-06T03:24:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7feae2e41700 1 -- start start 2023-10-06T03:24:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7f53990d9700 1 -- 172.21.15.84:0/509396533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53940c82a0 msgr2=0x7f5394069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7f53990d9700 1 --2- 172.21.15.84:0/509396533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53940c82a0 0x7f5394069560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f538c009f20 tx=0x7f538c009840 comp rx=0 tx=0).stop 2023-10-06T03:24:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7f7382625700 1 -- start start 2023-10-06T03:24:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f7382625700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f737c0675f0 0x7f737c0bef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f7382625700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f737c06d950 0x7f737c0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f7382625700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 0x7f737c0b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7f656b696700 1 Processor -- start 2023-10-06T03:24:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7f656b696700 1 -- start start 2023-10-06T03:24:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f656b696700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6564069aa0 0x7f65640c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f656b696700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65640bf360 0x7f656416e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f656b696700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65640bf730 0x7f656415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f656b696700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65640c51e0 con 0x7f6564069aa0 2023-10-06T03:24:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f656b696700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65641611b0 con 0x7f65640bf730 2023-10-06T03:24:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f656b696700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65640c48b0 con 0x7f65640bf360 2023-10-06T03:24:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7fc340101700 1 Processor -- start 2023-10-06T03:24:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7fc340101700 1 -- start start 2023-10-06T03:24:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc340101700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc3380bf360 0x7fc3380c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc340101700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc338069c70 0x7fc3380c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc340101700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3380c8000 con 0x7fc3380bf730 2023-10-06T03:24:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc340101700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33815e1d0 con 0x7fc338069c70 2023-10-06T03:24:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc340101700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3380c73f0 con 0x7fc3380bf360 2023-10-06T03:24:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7f69b383e700 1 -- start start 2023-10-06T03:24:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f69b383e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69ac069c70 0x7f69ac0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f69b383e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69ac159a60 0x7f69ac0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f69b383e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69ac15d920 0x7f69ac0af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f69b383e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0c00f0 con 0x7f69ac15d920 2023-10-06T03:24:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f69b383e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0c03d0 con 0x7f69ac069c70 2023-10-06T03:24:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f69b383e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0c06b0 con 0x7f69ac159a60 2023-10-06T03:24:06.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7f1df66f2700 1 -- 172.21.15.84:0/248567927 wait complete. 2023-10-06T03:24:06.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f1df66f2700 1 Processor -- start 2023-10-06T03:24:06.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7fc593660700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc58c0b2620 0x7fc58c0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7fc593660700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc58c0b29f0 0x7fc58c0c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7fc593660700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c159870 0x7fc58c0c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7fc593660700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0c6560 con 0x7fc58c0b29f0 2023-10-06T03:24:06.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7fc593660700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0c5950 con 0x7fc58c159870 2023-10-06T03:24:06.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.284+0000 7fc593660700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0c5c30 con 0x7fc58c0b2620 2023-10-06T03:24:06.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc590bfb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc58c0b29f0 0x7fc58c0c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc590bfb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc58c0b29f0 0x7fc58c0c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33888/0 (socket says 172.21.15.84:33888) 2023-10-06T03:24:06.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc590bfb700 1 -- 172.21.15.84:0/1658283337 learned_addr learned my addr 172.21.15.84:0/1658283337 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc591bfd700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c159870 0x7fc58c0c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc590bfb700 1 -- 172.21.15.84:0/1658283337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc58c0b2620 msgr2=0x7fc58c0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc590bfb700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc58c0b2620 0x7fc58c0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc590bfb700 1 -- 172.21.15.84:0/1658283337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c159870 msgr2=0x7fc58c0c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc590bfb700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c159870 0x7fc58c0c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7fc590bfb700 1 -- 172.21.15.84:0/1658283337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc584009ae0 con 0x7fc58c0b29f0 2023-10-06T03:24:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f7382625700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0bb320 con 0x7f737c0675f0 2023-10-06T03:24:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f7382625700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0bb600 con 0x7f737c06d950 2023-10-06T03:24:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.285+0000 7f7382625700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0bb8e0 con 0x7f737c0afb50 2023-10-06T03:24:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f737bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f737c0675f0 0x7f737c0bef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f737bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f737c0675f0 0x7f737c0bef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33916/0 (socket says 172.21.15.84:33916) 2023-10-06T03:24:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f737bfff700 1 -- 172.21.15.84:0/3068638941 learned_addr learned my addr 172.21.15.84:0/3068638941 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f6568c31700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65640bf360 0x7f656416e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f6568c31700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65640bf360 0x7f656416e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55284/0 (socket says 172.21.15.84:55284) 2023-10-06T03:24:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f6568c31700 1 -- 172.21.15.84:0/4048988542 learned_addr learned my addr 172.21.15.84:0/4048988542 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7fc33e69e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc338069c70 0x7fc3380c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7fc33e69e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc338069c70 0x7fc3380c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33898/0 (socket says 172.21.15.84:33898) 2023-10-06T03:24:06.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7fc33e69e700 1 -- 172.21.15.84:0/1872503516 learned_addr learned my addr 172.21.15.84:0/1872503516 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f69b0dd9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69ac159a60 0x7f69ac0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f6569432700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6564069aa0 0x7f65640c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f69b0dd9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69ac159a60 0x7f69ac0aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55276/0 (socket says 172.21.15.84:55276) 2023-10-06T03:24:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f69b0dd9700 1 -- 172.21.15.84:0/3520510631 learned_addr learned my addr 172.21.15.84:0/3520510631 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f69b1ddb700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69ac15d920 0x7f69ac0af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f69b15da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69ac069c70 0x7f69ac0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7fc33e69e700 1 -- 172.21.15.84:0/1872503516 >> v2:172.21.15.131:3300/0 conn(0x7fc3380bf360 msgr2=0x7fc3380c8490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:24:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7fc33e69e700 1 --2- 172.21.15.84:0/1872503516 >> v2:172.21.15.131:3300/0 conn(0x7fc3380bf360 0x7fc3380c8490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7fc33e69e700 1 -- 172.21.15.84:0/1872503516 >> v1:172.21.15.84:6789/0 conn(0x7fc3380bf730 legacy=0x7fc338069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7fc33e69e700 1 -- 172.21.15.84:0/1872503516 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3380c76d0 con 0x7fc338069c70 2023-10-06T03:24:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f7380bc2700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 0x7f737c0b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f53990d9700 1 -- 172.21.15.84:0/509396533 shutdown_connections 2023-10-06T03:24:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f53990d9700 1 --2- 172.21.15.84:0/509396533 >> v2:172.21.15.84:3300/0 conn(0x7f53940cbc60 0x7f5394069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f53990d9700 1 --2- 172.21.15.84:0/509396533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53940c82a0 0x7f5394069560 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f53990d9700 1 -- 172.21.15.84:0/509396533 >> 172.21.15.84:0/509396533 conn(0x7f53940680c0 msgr2=0x7f53940cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f737b7fe700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f737c06d950 0x7f737c0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f6568c31700 1 -- 172.21.15.84:0/4048988542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65640bf730 msgr2=0x7f656415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f6568c31700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65640bf730 0x7f656415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f6568c31700 1 -- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6564069aa0 msgr2=0x7f65640c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f6568c31700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6564069aa0 0x7f65640c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f6568c31700 1 -- 172.21.15.84:0/4048988542 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65600094f0 con 0x7f65640bf360 2023-10-06T03:24:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f53990d9700 1 -- 172.21.15.84:0/509396533 shutdown_connections 2023-10-06T03:24:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f737bfff700 1 -- 172.21.15.84:0/3068638941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 msgr2=0x7f737c0b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f737bfff700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f737c0afb50 0x7f737c0b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f737bfff700 1 -- 172.21.15.84:0/3068638941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f737c06d950 msgr2=0x7f737c0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f69b0dd9700 1 -- 172.21.15.84:0/3520510631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69ac069c70 msgr2=0x7f69ac0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f69b0dd9700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69ac069c70 0x7f69ac0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f69b0dd9700 1 -- 172.21.15.84:0/3520510631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69ac15d920 msgr2=0x7f69ac0af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f69b0dd9700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69ac15d920 0x7f69ac0af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f69b0dd9700 1 -- 172.21.15.84:0/3520510631 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a4009a20 con 0x7f69ac159a60 2023-10-06T03:24:06.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae2e41700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feadc069aa0 0x7feadc14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f737bfff700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f737c06d950 0x7f737c0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f737bfff700 1 -- 172.21.15.84:0/3068638941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700094f0 con 0x7f737c0675f0 2023-10-06T03:24:06.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f737b7fe700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f737c06d950 0x7f737c0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:06.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae2e41700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feadc0bf360 0x7feadc14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae2e41700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feadc0bf730 0x7feadc17abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae2e41700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc149be0 con 0x7feadc069aa0 2023-10-06T03:24:06.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae2e41700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc14d3a0 con 0x7feadc0bf730 2023-10-06T03:24:06.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae2e41700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc14d680 con 0x7feadc0bf360 2023-10-06T03:24:06.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f69b0dd9700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69ac159a60 0x7f69ac0aeed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c880 tx=0x7f69a8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7fc590bfb700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc58c0b29f0 0x7fc58c0c2b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00c810 tx=0x7fc57c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7fc33e69e700 1 --2- 172.21.15.84:0/1872503516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc338069c70 0x7fc3380c66c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc33806cea0 tx=0x7fc330009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1683df93fd87b587 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae13de700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feadc0bf730 0x7feadc17abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae13de700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feadc0bf730 0x7feadc17abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56434/0 (socket says 172.21.15.84:56434) 2023-10-06T03:24:06.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae13de700 1 -- 172.21.15.84:0/3377995478 learned_addr learned my addr 172.21.15.84:0/3377995478 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feadbfff700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feadc0bf360 0x7feadc14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f69a17fa700 1 -- 172.21.15.84:0/3520510631 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8011600 con 0x7f69ac159a60 2023-10-06T03:24:06.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae0bdd700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feadc069aa0 0x7feadc14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7fc5817fa700 1 -- 172.21.15.84:0/1658283337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c012630 con 0x7fc58c0b29f0 2023-10-06T03:24:06.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7fc5817fa700 1 -- 172.21.15.84:0/1658283337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c0127d0 con 0x7fc58c0b29f0 2023-10-06T03:24:06.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7fc5817fa700 1 -- 172.21.15.84:0/1658283337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c012b90 con 0x7fc58c0b29f0 2023-10-06T03:24:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f1df66f2700 1 -- start start 2023-10-06T03:24:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f1df66f2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1df006c370 0x7f1df00c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f1df66f2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1df00cc750 0x7f1df0169a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f1df66f2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1df0156390 0x7f1df016a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f1df66f2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00b0de0 con 0x7f1df0156390 2023-10-06T03:24:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f1df66f2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00c6ec0 con 0x7f1df00cc750 2023-10-06T03:24:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f1df66f2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00c63a0 con 0x7f1df006c370 2023-10-06T03:24:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f1deffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1df006c370 0x7f1df00c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f1deffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1df006c370 0x7f1df00c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55292/0 (socket says 172.21.15.84:55292) 2023-10-06T03:24:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f1deffff700 1 -- 172.21.15.84:0/2221689018 learned_addr learned my addr 172.21.15.84:0/2221689018 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae13de700 1 -- 172.21.15.84:0/3377995478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feadc0bf360 msgr2=0x7feadc14e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae13de700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feadc0bf360 0x7feadc14e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae13de700 1 -- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feadc069aa0 msgr2=0x7feadc14cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae13de700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feadc069aa0 0x7feadc14cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7feae13de700 1 -- 172.21.15.84:0/3377995478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00094f0 con 0x7feadc0bf730 2023-10-06T03:24:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f1df4c8f700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1df0156390 0x7f1df016a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7feadbfff700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feadc0bf360 0x7feadc14e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f6568c31700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65640bf360 0x7f656416e2e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f655400c880 tx=0x7f6554008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f69a17fa700 1 -- 172.21.15.84:0/3520510631 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a8011760 con 0x7f69ac159a60 2023-10-06T03:24:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7f69a17fa700 1 -- 172.21.15.84:0/3520510631 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8011ae0 con 0x7f69ac159a60 2023-10-06T03:24:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f1deffff700 1 -- 172.21.15.84:0/2221689018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1df00cc750 msgr2=0x7f1df0169a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:24:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f1deffff700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1df00cc750 0x7f1df0169a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f1deffff700 1 -- 172.21.15.84:0/2221689018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1df0156390 msgr2=0x7f1df016a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f1deffff700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1df0156390 0x7f1df016a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f1deffff700 1 -- 172.21.15.84:0/2221689018 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8009a20 con 0x7f1df006c370 2023-10-06T03:24:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f1deffff700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1df006c370 0x7f1df00c5e60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1de800b6c0 tx=0x7f1de801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c0c5f10 con 0x7fc58c0b29f0 2023-10-06T03:24:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.287+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c0c35b0 con 0x7fc58c0b29f0 2023-10-06T03:24:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc58c064ad0 con 0x7fc58c0b29f0 2023-10-06T03:24:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f65597fa700 1 -- 172.21.15.84:0/4048988542 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554011600 con 0x7f65640bf360 2023-10-06T03:24:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7fc33ce9b700 1 -- 172.21.15.84:0/1872503516 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33000e070 con 0x7fc338069c70 2023-10-06T03:24:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7fc33ce9b700 1 -- 172.21.15.84:0/1872503516 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33000ba50 con 0x7fc338069c70 2023-10-06T03:24:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ac0c0990 con 0x7f69ac159a60 2023-10-06T03:24:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ac0b1c50 con 0x7f69ac159a60 2023-10-06T03:24:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7fc33ce9b700 1 -- 172.21.15.84:0/1872503516 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3300092e0 con 0x7fc338069c70 2023-10-06T03:24:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f1dd7fff700 1 -- 172.21.15.84:0/2221689018 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de801a420 con 0x7f1df006c370 2023-10-06T03:24:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.286+0000 7f53990d9700 1 -- 172.21.15.84:0/509396533 wait complete. 2023-10-06T03:24:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f53990d9700 1 Processor -- start 2023-10-06T03:24:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7f1dd7fff700 1 -- 172.21.15.84:0/2221689018 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de801a5a0 con 0x7f1df006c370 2023-10-06T03:24:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7f1dd7fff700 1 -- 172.21.15.84:0/2221689018 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de801a960 con 0x7f1df006c370 2023-10-06T03:24:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7feae13de700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feadc0bf730 0x7feadc17abc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fead400bbb0 tx=0x7fead4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7fead8ff9700 1 -- 172.21.15.84:0/3377995478 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead40092e0 con 0x7feadc0bf730 2023-10-06T03:24:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7fead8ff9700 1 -- 172.21.15.84:0/3377995478 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead400c630 con 0x7feadc0bf730 2023-10-06T03:24:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7fead8ff9700 1 -- 172.21.15.84:0/3377995478 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead400c9f0 con 0x7feadc0bf730 2023-10-06T03:24:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc14d960 con 0x7feadc0bf730 2023-10-06T03:24:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc14ee80 con 0x7feadc0bf730 2023-10-06T03:24:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f737bfff700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f737c0675f0 0x7f737c0bef90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f736c00ec80 tx=0x7f736c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f7363fff700 1 -- 172.21.15.84:0/3068638941 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c00c850 con 0x7f737c0675f0 2023-10-06T03:24:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f7363fff700 1 -- 172.21.15.84:0/3068638941 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c00c9b0 con 0x7f737c0675f0 2023-10-06T03:24:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f7363fff700 1 -- 172.21.15.84:0/3068638941 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c00cd50 con 0x7f737c0675f0 2023-10-06T03:24:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c0bbbc0 con 0x7f737c0675f0 2023-10-06T03:24:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c0bf4d0 con 0x7f737c0675f0 2023-10-06T03:24:06.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f65597fa700 1 -- 172.21.15.84:0/4048988542 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6554011760 con 0x7f65640bf360 2023-10-06T03:24:06.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.288+0000 7f65597fa700 1 -- 172.21.15.84:0/4048988542 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554011b00 con 0x7f65640bf360 2023-10-06T03:24:06.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65640c4b90 con 0x7f65640bf360 2023-10-06T03:24:06.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6564160900 con 0x7f65640bf360 2023-10-06T03:24:06.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7fc340101700 1 -- 172.21.15.84:0/1872503516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc338069c70 msgr2=0x7fc3380c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7fc340101700 1 --2- 172.21.15.84:0/1872503516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc338069c70 0x7fc3380c66c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc33806cea0 tx=0x7fc330009840 comp rx=0 tx=0).stop 2023-10-06T03:24:06.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7fc340101700 1 -- 172.21.15.84:0/1872503516 shutdown_connections 2023-10-06T03:24:06.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7fc340101700 1 --2- 172.21.15.84:0/1872503516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc338069c70 0x7fc3380c66c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7fc340101700 1 --2- 172.21.15.84:0/1872503516 >> v2:172.21.15.131:3300/0 conn(0x7fc3380bf360 0x7fc3380c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7fc340101700 1 -- 172.21.15.84:0/1872503516 >> 172.21.15.84:0/1872503516 conn(0x7fc3380680c0 msgr2=0x7fc3380cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df00c6620 con 0x7f1df006c370 2023-10-06T03:24:06.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df00c6be0 con 0x7f1df006c370 2023-10-06T03:24:06.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7fc5817fa700 1 -- 172.21.15.84:0/1658283337 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc57c025430 con 0x7fc58c0b29f0 2023-10-06T03:24:06.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7fc5817fa700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc570067080 0x7fc570069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f737c0bb770 con 0x7f737c0675f0 2023-10-06T03:24:06.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7fc5817fa700 1 -- 172.21.15.84:0/1658283337 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc57c084fe0 con 0x7fc58c0b29f0 2023-10-06T03:24:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7fc5817fa700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] conn(0x7fc570070d50 0x7fc570073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7fc5817fa700 1 -- 172.21.15.84:0/1658283337 --> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc570073850 con 0x7fc570070d50 2023-10-06T03:24:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7fc5817fa700 1 -- 172.21.15.84:0/1658283337 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc57c085310 con 0x7fc58c0b29f0 2023-10-06T03:24:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feadc1499b0 con 0x7feadc0bf730 2023-10-06T03:24:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7fc340101700 1 -- 172.21.15.84:0/1872503516 shutdown_connections 2023-10-06T03:24:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7fc5913fc700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc570067080 0x7fc570069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7fc591bfd700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] conn(0x7fc570070d50 0x7fc570073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6564064ad0 con 0x7f65640bf360 2023-10-06T03:24:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7fead8ff9700 1 -- 172.21.15.84:0/3377995478 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fead4012070 con 0x7feadc0bf730 2023-10-06T03:24:06.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.289+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69ac064ad0 con 0x7f69ac159a60 2023-10-06T03:24:06.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.290+0000 7f69a17fa700 1 -- 172.21.15.84:0/3520510631 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69a80193b0 con 0x7f69ac159a60 2023-10-06T03:24:06.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7f69a17fa700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6990066f30 0x7f69900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7f69b15da700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6990066f30 0x7f69900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1df00b0bb0 con 0x7f1df006c370 2023-10-06T03:24:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7fc591bfd700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] conn(0x7fc570070d50 0x7fc570073180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7f69a17fa700 1 -- 172.21.15.84:0/3520510631 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f69a8084780 con 0x7f69ac159a60 2023-10-06T03:24:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7f69a17fa700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] conn(0x7f6990070b80 0x7f6990072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7f69a17fa700 1 -- 172.21.15.84:0/3520510631 --> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6990073680 con 0x7f6990070b80 2023-10-06T03:24:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7fead8ff9700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feac8066f30 0x7feac80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.291+0000 7fc340101700 1 -- 172.21.15.84:0/1872503516 wait complete. 2023-10-06T03:24:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7feae0bdd700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feac8066f30 0x7feac80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7fead8ff9700 1 -- 172.21.15.84:0/3377995478 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fead40845d0 con 0x7feadc0bf730 2023-10-06T03:24:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7f69b15da700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6990066f30 0x7f69900693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f699c007fd0 tx=0x7f699c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7fead8ff9700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] conn(0x7feac8070c00 0x7feac8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7fead8ff9700 1 -- 172.21.15.84:0/3377995478 --> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feac8073700 con 0x7feac8070c00 2023-10-06T03:24:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7fead8ff9700 1 -- 172.21.15.84:0/3377995478 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fead4086c10 con 0x7feadc0bf730 2023-10-06T03:24:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7feadbfff700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] conn(0x7feac8070c00 0x7feac8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7f7363fff700 1 -- 172.21.15.84:0/3068638941 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f736c013680 con 0x7f737c0675f0 2023-10-06T03:24:06.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7feae0bdd700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feac8066f30 0x7feac80693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feacc009db0 tx=0x7feacc0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7fc340101700 1 Processor -- start 2023-10-06T03:24:06.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7f65597fa700 1 -- 172.21.15.84:0/4048988542 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6554023430 con 0x7f65640bf360 2023-10-06T03:24:06.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7f69b1ddb700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] conn(0x7f6990070b80 0x7f6990072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7f69a17fa700 1 -- 172.21.15.84:0/3520510631 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69a80515a0 con 0x7f69ac159a60 2023-10-06T03:24:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7fc5817fa700 1 -- 172.21.15.84:0/1658283337 <== osd.7 v2:172.21.15.131:6824/90847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc570073850 con 0x7fc570070d50 2023-10-06T03:24:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f7363fff700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7368066fb0 0x7f7368069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f7363fff700 1 -- 172.21.15.84:0/3068638941 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f736c084d30 con 0x7f737c0675f0 2023-10-06T03:24:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7feadbfff700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] conn(0x7feac8070c00 0x7feac8073030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.292+0000 7f53990d9700 1 -- start start 2023-10-06T03:24:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f53990d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53940c82a0 0x7f5394146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f53990d9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53940cbc60 0x7f53940c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f53990d9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5394155860 0x7f5394153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f53990d9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53940c3880 con 0x7f53940c82a0 2023-10-06T03:24:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f53990d9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539416e240 con 0x7f5394155860 2023-10-06T03:24:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f53990d9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5394146cc0 con 0x7f53940cbc60 2023-10-06T03:24:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f69b1ddb700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] conn(0x7f6990070b80 0x7f6990072fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f65597fa700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6548067080 0x7f6548069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f65597fa700 1 -- 172.21.15.84:0/4048988542 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6554084bd0 con 0x7f65640bf360 2023-10-06T03:24:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f6569432700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6548067080 0x7f6548069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f65597fa700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] conn(0x7f6548070d50 0x7f6548073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f65597fa700 1 -- 172.21.15.84:0/4048988542 --> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6548073850 con 0x7f6548070d50 2023-10-06T03:24:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f65597fa700 1 -- 172.21.15.84:0/4048988542 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6554084f00 con 0x7f65640bf360 2023-10-06T03:24:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f6569c33700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] conn(0x7f6548070d50 0x7f6548073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f7363fff700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] conn(0x7f7368070c80 0x7f73680730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f7363fff700 1 -- 172.21.15.84:0/3068638941 --> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7368073780 con 0x7f7368070c80 2023-10-06T03:24:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f7363fff700 1 -- 172.21.15.84:0/3068638941 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f736c087270 con 0x7f737c0675f0 2023-10-06T03:24:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f69a17fa700 1 -- 172.21.15.84:0/3520510631 <== osd.5 v2:172.21.15.131:6816/90846 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6990073680 con 0x7f6990070b80 2023-10-06T03:24:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f737b7fe700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7368066fb0 0x7f7368069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f7380bc2700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] conn(0x7f7368070c80 0x7f73680730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7fead8ff9700 1 -- 172.21.15.84:0/3377995478 <== osd.0 v2:172.21.15.84:6816/90665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7feac8073700 con 0x7feac8070c00 2023-10-06T03:24:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f737b7fe700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7368066fb0 0x7f7368069460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7374004040 tx=0x7f7374009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f6569432700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6548067080 0x7f6548069530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65640cc950 tx=0x7f6560017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f6569c33700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] conn(0x7f6548070d50 0x7f6548073180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f7380bc2700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] conn(0x7f7368070c80 0x7f73680730b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.296+0000 7f7363fff700 1 -- 172.21.15.84:0/3068638941 <== osd.2 v2:172.21.15.84:6817/90666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7368073780 con 0x7f7368070c80 2023-10-06T03:24:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f5392d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53940c82a0 0x7f5394146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f5392d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53940c82a0 0x7f5394146780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33944/0 (socket says 172.21.15.84:33944) 2023-10-06T03:24:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f5392d9d700 1 -- 172.21.15.84:0/1951774756 learned_addr learned my addr 172.21.15.84:0/1951774756 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f539359e700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5394155860 0x7f5394153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f539359e700 1 -- 172.21.15.84:0/1951774756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53940cbc60 msgr2=0x7f53940c3b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f539359e700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53940cbc60 0x7f53940c3b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f539359e700 1 -- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53940c82a0 msgr2=0x7f5394146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f539359e700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53940c82a0 0x7f5394146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f539359e700 1 -- 172.21.15.84:0/1951774756 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c009ae0 con 0x7f5394155860 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f539359e700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5394155860 0x7f5394153df0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53940cc080 tx=0x7f5384008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f537affd700 1 -- 172.21.15.84:0/1951774756 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384017070 con 0x7f5394155860 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7f537affd700 1 -- 172.21.15.84:0/1951774756 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5384005a50 con 0x7f5394155860 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7f537affd700 1 -- 172.21.15.84:0/1951774756 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384005df0 con 0x7f5394155860 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.301+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53940c35a0 con 0x7f5394155860 2023-10-06T03:24:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.301+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539416ea10 con 0x7f5394155860 2023-10-06T03:24:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7f1dd7fff700 1 -- 172.21.15.84:0/2221689018 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1de801ad50 con 0x7f1df006c370 2023-10-06T03:24:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f1dd7fff700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1ddc067080 0x7f1ddc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f1dd7fff700 1 -- 172.21.15.84:0/2221689018 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1de8016070 con 0x7f1df006c370 2023-10-06T03:24:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f1dd7fff700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] conn(0x7f1ddc070d50 0x7f1ddc073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f1dd7fff700 1 -- 172.21.15.84:0/2221689018 --> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ddc073850 con 0x7f1ddc070d50 2023-10-06T03:24:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f1dd7fff700 1 -- 172.21.15.84:0/2221689018 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1de80872f0 con 0x7f1df006c370 2023-10-06T03:24:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f1df4c8f700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] conn(0x7f1ddc070d50 0x7f1ddc073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7f1def7fe700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1ddc067080 0x7f1ddc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7f1df4c8f700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] conn(0x7f1ddc070d50 0x7f1ddc073180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.296+0000 7f1def7fe700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1ddc067080 0x7f1ddc069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1df00c74d0 tx=0x7f1de0007bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.293+0000 7fc340101700 1 -- start start 2023-10-06T03:24:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7fc340101700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc338069c70 0x7fc33815d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7fc340101700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3380bf360 0x7fc3380c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7fc340101700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3380bf730 0x7fc3380c1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7fc340101700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380c47f0 con 0x7fc338069c70 2023-10-06T03:24:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7fc340101700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380c5ec0 con 0x7fc3380bf730 2023-10-06T03:24:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7fc340101700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380c3be0 con 0x7fc3380bf360 2023-10-06T03:24:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7fc33de9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc338069c70 0x7fc33815d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7fc33de9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc338069c70 0x7fc33815d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33958/0 (socket says 172.21.15.84:33958) 2023-10-06T03:24:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.294+0000 7fc33de9d700 1 -- 172.21.15.84:0/2018716343 learned_addr learned my addr 172.21.15.84:0/2018716343 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc33e69e700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3380bf730 0x7fc3380c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc33de9d700 1 -- 172.21.15.84:0/2018716343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3380bf360 msgr2=0x7fc3380c5980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc33de9d700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3380bf360 0x7fc3380c5980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc33de9d700 1 -- 172.21.15.84:0/2018716343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3380bf730 msgr2=0x7fc3380c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc33de9d700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3380bf730 0x7fc3380c1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc33de9d700 1 -- 172.21.15.84:0/2018716343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc330009ae0 con 0x7fc338069c70 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc33de9d700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc338069c70 0x7fc33815d8b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc32800b600 tx=0x7fc3280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc32dffb700 1 -- 172.21.15.84:0/2018716343 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32800f510 con 0x7fc338069c70 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc32dffb700 1 -- 172.21.15.84:0/2018716343 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32800f6b0 con 0x7fc338069c70 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc32dffb700 1 -- 172.21.15.84:0/2018716343 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32800fa70 con 0x7fc338069c70 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.295+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3380c3ec0 con 0x7fc338069c70 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.296+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3380c4480 con 0x7fc338069c70 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.297+0000 7fc32dffb700 1 -- 172.21.15.84:0/2018716343 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc32801a400 con 0x7fc338069c70 2023-10-06T03:24:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.298+0000 7fc32dffb700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc31c088f40 0x7fc31c08b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.298+0000 7fc32dffb700 1 -- 172.21.15.84:0/2018716343 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc328084520 con 0x7fc338069c70 2023-10-06T03:24:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.299+0000 7fc340101700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] conn(0x7fc3380af590 0x7fc3380af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.299+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 --> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3380c79b0 con 0x7fc3380af590 2023-10-06T03:24:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.301+0000 7fc33d69c700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc31c088f40 0x7fc31c08b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.301+0000 7fc33d69c700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc31c088f40 0x7fc31c08b3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc334007fd0 tx=0x7fc334007b20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.302+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5394064ad0 con 0x7f5394155860 2023-10-06T03:24:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.303+0000 7f537affd700 1 -- 172.21.15.84:0/1951774756 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5384012800 con 0x7f5394155860 2023-10-06T03:24:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.303+0000 7f537affd700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5380066f30 0x7f53800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.303+0000 7f537affd700 1 -- 172.21.15.84:0/1951774756 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f53840851d0 con 0x7f5394155860 2023-10-06T03:24:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.303+0000 7f5392d9d700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5380066f30 0x7f53800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.303+0000 7f537affd700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x7f5380070c00 0x7f5380073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.303+0000 7f537affd700 1 -- 172.21.15.84:0/1951774756 --> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5380073700 con 0x7f5380070c00 2023-10-06T03:24:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.303+0000 7f537affd700 1 -- 172.21.15.84:0/1951774756 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53840855a0 con 0x7f5394155860 2023-10-06T03:24:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.304+0000 7f539259c700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x7f5380070c00 0x7f5380073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.304+0000 7f5392d9d700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5380066f30 0x7f53800693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5388009bb0 tx=0x7f5388009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.304+0000 7f539259c700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x7f5380070c00 0x7f5380073030 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.301+0000 7fc5913fc700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc570067080 0x7fc570069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc584009f70 tx=0x7fc584017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.305+0000 7f1dd7fff700 1 -- 172.21.15.84:0/2221689018 <== osd.6 v2:172.21.15.131:6808/90817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1ddc073850 con 0x7f1ddc070d50 2023-10-06T03:24:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.305+0000 7fc33e69e700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] conn(0x7fc3380af590 0x7fc3380af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.305+0000 7fc33e69e700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] conn(0x7fc3380af590 0x7fc3380af960 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.306+0000 7fc32dffb700 1 -- 172.21.15.84:0/2018716343 <== osd.4 v2:172.21.15.131:6800/90816 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc3380c79b0 con 0x7fc3380af590 2023-10-06T03:24:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.307+0000 7f65597fa700 1 -- 172.21.15.84:0/4048988542 <== osd.3 v2:172.21.15.84:6800/90664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6548073850 con 0x7f6548070d50 2023-10-06T03:24:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.317+0000 7f537affd700 1 -- 172.21.15.84:0/1951774756 <== osd.1 v2:172.21.15.84:6808/90663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5380073700 con 0x7f5380070c00 2023-10-06T03:24:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.320+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 --> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feadc064ad0 con 0x7feac8070c00 2023-10-06T03:24:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.320+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 --> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f737c064ad0 con 0x7f7368070c80 2023-10-06T03:24:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.320+0000 7f7363fff700 1 -- 172.21.15.84:0/3068638941 <== osd.2 v2:172.21.15.84:6817/90666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f737c064ad0 con 0x7f7368070c80 2023-10-06T03:24:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.321+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] conn(0x7f7368070c80 msgr2=0x7f73680730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.321+0000 7f7382625700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] conn(0x7f7368070c80 0x7f73680730b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.322+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 --> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65640c49f0 con 0x7f6548070d50 2023-10-06T03:24:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.322+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7368066fb0 msgr2=0x7f7368069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.322+0000 7f7382625700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7368066fb0 0x7f7368069460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7374004040 tx=0x7f7374009040 comp rx=0 tx=0).stop 2023-10-06T03:24:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.322+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f737c0675f0 msgr2=0x7f737c0bef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.322+0000 7f7382625700 1 --2- 172.21.15.84:0/3068638941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f737c0675f0 0x7f737c0bef90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f736c00ec80 tx=0x7f736c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.322+0000 7f7380bc2700 1 -- 172.21.15.84:0/3068638941 reap_dead start 2023-10-06T03:24:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.322+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 shutdown_connections 2023-10-06T03:24:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.322+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 >> 172.21.15.84:0/3068638941 conn(0x7f737c0cc730 msgr2=0x7f737c0c5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.323+0000 7fead8ff9700 1 -- 172.21.15.84:0/3377995478 <== osd.0 v2:172.21.15.84:6816/90665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feadc064ad0 con 0x7feac8070c00 2023-10-06T03:24:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.324+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 --> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f69ac15b310 con 0x7f6990070b80 2023-10-06T03:24:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7f65597fa700 1 -- 172.21.15.84:0/4048988542 <== osd.3 v2:172.21.15.84:6800/90664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65640c49f0 con 0x7f6548070d50 2023-10-06T03:24:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] conn(0x7feac8070c00 msgr2=0x7feac8073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7feae2e41700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] conn(0x7feac8070c00 0x7feac8073030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 --> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc58c0cbc70 con 0x7fc570070d50 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feac8066f30 msgr2=0x7feac80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7feae2e41700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feac8066f30 0x7feac80693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feacc009db0 tx=0x7feacc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feadc0bf730 msgr2=0x7feadc17abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7feae2e41700 1 --2- 172.21.15.84:0/3377995478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feadc0bf730 0x7feadc17abc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fead400bbb0 tx=0x7fead4009840 comp rx=0 tx=0).stop 2023-10-06T03:24:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7f69a17fa700 1 -- 172.21.15.84:0/3520510631 <== osd.5 v2:172.21.15.131:6816/90846 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f69ac15b310 con 0x7f6990070b80 2023-10-06T03:24:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 shutdown_connections 2023-10-06T03:24:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7f7382625700 1 -- 172.21.15.84:0/3068638941 wait complete. 2023-10-06T03:24:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] conn(0x7f6548070d50 msgr2=0x7f6548073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7f656b696700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] conn(0x7f6548070d50 0x7f6548073180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6548067080 msgr2=0x7f6548069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.325+0000 7f656b696700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6548067080 0x7f6548069530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65640cc950 tx=0x7f6560017000 comp rx=0 tx=0).stop 2023-10-06T03:24:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65640bf360 msgr2=0x7f656416e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7f656b696700 1 --2- 172.21.15.84:0/4048988542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65640bf360 0x7f656416e2e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f655400c880 tx=0x7f6554008040 comp rx=0 tx=0).stop 2023-10-06T03:24:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7f6569c33700 1 -- 172.21.15.84:0/4048988542 reap_dead start 2023-10-06T03:24:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7feae13de700 1 -- 172.21.15.84:0/3377995478 reap_dead start 2023-10-06T03:24:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 shutdown_connections 2023-10-06T03:24:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 >> 172.21.15.84:0/3377995478 conn(0x7feadc0680c0 msgr2=0x7feadc14f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 shutdown_connections 2023-10-06T03:24:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 >> 172.21.15.84:0/4048988542 conn(0x7f65640680c0 msgr2=0x7f6564161df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 shutdown_connections 2023-10-06T03:24:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7fc5817fa700 1 -- 172.21.15.84:0/1658283337 <== osd.7 v2:172.21.15.131:6824/90847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc58c0cbc70 con 0x7fc570070d50 2023-10-06T03:24:06.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7feae2e41700 1 -- 172.21.15.84:0/3377995478 wait complete. 2023-10-06T03:24:06.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 >> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] conn(0x7fc570070d50 msgr2=0x7fc570073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.326+0000 7fc593660700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] conn(0x7fc570070d50 0x7fc570073180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc570067080 msgr2=0x7fc570069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7fc593660700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc570067080 0x7fc570069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc584009f70 tx=0x7fc584017000 comp rx=0 tx=0).stop 2023-10-06T03:24:06.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc58c0b29f0 msgr2=0x7fc58c0c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7fc593660700 1 --2- 172.21.15.84:0/1658283337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc58c0b29f0 0x7fc58c0c2b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00c810 tx=0x7fc57c007ee0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7fc591bfd700 1 -- 172.21.15.84:0/1658283337 reap_dead start 2023-10-06T03:24:06.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 shutdown_connections 2023-10-06T03:24:06.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7f656b696700 1 -- 172.21.15.84:0/4048988542 wait complete. 2023-10-06T03:24:06.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 shutdown_connections 2023-10-06T03:24:06.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 >> 172.21.15.84:0/1658283337 conn(0x7fc58c06ed20 msgr2=0x7fc58c15b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 shutdown_connections 2023-10-06T03:24:06.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.327+0000 7fc593660700 1 -- 172.21.15.84:0/1658283337 wait complete. 2023-10-06T03:24:06.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.333+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 --> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc33804bb80 con 0x7fc3380af590 2023-10-06T03:24:06.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.333+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 --> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1df0064ad0 con 0x7f1ddc070d50 2023-10-06T03:24:06.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.333+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 >> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] conn(0x7f6990070b80 msgr2=0x7f6990072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.333+0000 7f69b383e700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] conn(0x7f6990070b80 0x7f6990072fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.334+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6990066f30 msgr2=0x7f69900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.334+0000 7f69b383e700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6990066f30 0x7f69900693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f699c007fd0 tx=0x7f699c009040 comp rx=0 tx=0).stop 2023-10-06T03:24:06.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.334+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69ac159a60 msgr2=0x7f69ac0aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.334+0000 7f69b383e700 1 --2- 172.21.15.84:0/3520510631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69ac159a60 0x7f69ac0aeed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c880 tx=0x7f69a8008040 comp rx=0 tx=0).stop 2023-10-06T03:24:06.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.334+0000 7f69b1ddb700 1 -- 172.21.15.84:0/3520510631 reap_dead start 2023-10-06T03:24:06.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.334+0000 7f1dd7fff700 1 -- 172.21.15.84:0/2221689018 <== osd.6 v2:172.21.15.131:6808/90817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1df0064ad0 con 0x7f1ddc070d50 2023-10-06T03:24:06.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.334+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 shutdown_connections 2023-10-06T03:24:06.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.334+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 >> 172.21.15.84:0/3520510631 conn(0x7f69ac0680c0 msgr2=0x7f69ac156a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.334+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 shutdown_connections 2023-10-06T03:24:06.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.334+0000 7f69b383e700 1 -- 172.21.15.84:0/3520510631 wait complete. 2023-10-06T03:24:06.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.337+0000 7fc32dffb700 1 -- 172.21.15.84:0/2018716343 <== osd.4 v2:172.21.15.131:6800/90816 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc33804bb80 con 0x7fc3380af590 2023-10-06T03:24:06.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.339+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 >> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] conn(0x7fc3380af590 msgr2=0x7fc3380af960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.339+0000 7fc340101700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] conn(0x7fc3380af590 0x7fc3380af960 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.341+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc31c088f40 msgr2=0x7fc31c08b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.341+0000 7fc340101700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc31c088f40 0x7fc31c08b3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc334007fd0 tx=0x7fc334007b20 comp rx=0 tx=0).stop 2023-10-06T03:24:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.341+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc338069c70 msgr2=0x7fc33815d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.341+0000 7fc340101700 1 --2- 172.21.15.84:0/2018716343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc338069c70 0x7fc33815d8b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc32800b600 tx=0x7fc3280091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.341+0000 7fc33e69e700 1 -- 172.21.15.84:0/2018716343 reap_dead start 2023-10-06T03:24:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 --> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53940c77c0 con 0x7f5380070c00 2023-10-06T03:24:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 >> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] conn(0x7f1ddc070d50 msgr2=0x7f1ddc073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7f1df66f2700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] conn(0x7f1ddc070d50 0x7f1ddc073180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7f537affd700 1 -- 172.21.15.84:0/1951774756 <== osd.1 v2:172.21.15.84:6808/90663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53940c77c0 con 0x7f5380070c00 2023-10-06T03:24:06.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1ddc067080 msgr2=0x7f1ddc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7f1df66f2700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1ddc067080 0x7f1ddc069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1df00c74d0 tx=0x7f1de0007bf0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1df006c370 msgr2=0x7f1df00c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7f1df66f2700 1 --2- 172.21.15.84:0/2221689018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1df006c370 0x7f1df00c5e60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1de800b6c0 tx=0x7f1de801c000 comp rx=0 tx=0).stop 2023-10-06T03:24:06.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 shutdown_connections 2023-10-06T03:24:06.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 >> 172.21.15.84:0/2018716343 conn(0x7fc3380680c0 msgr2=0x7fc3380cb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.344+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 shutdown_connections 2023-10-06T03:24:06.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.345+0000 7fc340101700 1 -- 172.21.15.84:0/2018716343 wait complete. 2023-10-06T03:24:06.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.345+0000 7f1df4c8f700 1 -- 172.21.15.84:0/2221689018 reap_dead start 2023-10-06T03:24:06.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.345+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 shutdown_connections 2023-10-06T03:24:06.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.345+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 >> 172.21.15.84:0/2221689018 conn(0x7f1df00cdef0 msgr2=0x7f1df0155440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.345+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 shutdown_connections 2023-10-06T03:24:06.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.345+0000 7f1df66f2700 1 -- 172.21.15.84:0/2221689018 wait complete. 2023-10-06T03:24:06.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.346+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x7f5380070c00 msgr2=0x7f5380073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.346+0000 7f53990d9700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x7f5380070c00 0x7f5380073030 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.406 INFO:teuthology.orchestra.run.smithi084.stdout:55834574858 2023-10-06T03:24:06.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:24:06.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.346+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5380066f30 msgr2=0x7f53800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.346+0000 7f53990d9700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5380066f30 0x7f53800693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5388009bb0 tx=0x7f5388009120 comp rx=0 tx=0).stop 2023-10-06T03:24:06.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.346+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5394155860 msgr2=0x7f5394153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.346+0000 7f53990d9700 1 --2- 172.21.15.84:0/1951774756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5394155860 0x7f5394153df0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53940cc080 tx=0x7f5384008040 comp rx=0 tx=0).stop 2023-10-06T03:24:06.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.346+0000 7f539359e700 1 -- 172.21.15.84:0/1951774756 reap_dead start 2023-10-06T03:24:06.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.346+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 shutdown_connections 2023-10-06T03:24:06.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.346+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 >> 172.21.15.84:0/1951774756 conn(0x7f53940680c0 msgr2=0x7f53940ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.408 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-10-06T03:24:06.409 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:24:06.410 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T03:24:06.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:24:06.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.351+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 shutdown_connections 2023-10-06T03:24:06.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.351+0000 7f53990d9700 1 -- 172.21.15.84:0/1951774756 wait complete. 2023-10-06T03:24:06.411 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T03:24:06.411 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:24:06.412 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T03:24:06.412 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:24:06.413 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-10-06T03:24:06.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:24:06.414 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-10-06T03:24:06.415 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:24:06.416 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T03:24:06.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:24:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.642+0000 7f206a660700 1 Processor -- start 2023-10-06T03:24:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.642+0000 7f206a660700 1 -- start start 2023-10-06T03:24:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.643+0000 7f206a660700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2064155860 0x7f20640ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.643+0000 7f206a660700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20640c7e10 con 0x7f2064069c70 2023-10-06T03:24:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.643+0000 7f206a660700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20640aea00 con 0x7f20640c82a0 2023-10-06T03:24:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.643+0000 7f206a660700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20640c7200 con 0x7f2064155860 2023-10-06T03:24:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.645+0000 7f20637fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f20640c82a0 0x7f2064069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:50820/0 (socket says 172.21.15.84:50820) 2023-10-06T03:24:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.645+0000 7f20637fe700 1 -- 172.21.15.84:0/842577076 learned_addr learned my addr 172.21.15.84:0/842577076 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.646+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591303896 0 0) 0x7f20640aea00 con 0x7f20640c82a0 2023-10-06T03:24:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.646+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f204c003550 con 0x7f20640c82a0 2023-10-06T03:24:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 980824731 0 0) 0x7f204c003550 con 0x7f20640c82a0 2023-10-06T03:24:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 >> v2:172.21.15.84:3300/0 conn(0x7f2064155860 msgr2=0x7f20640ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 --2- 172.21.15.84:0/842577076 >> v2:172.21.15.84:3300/0 conn(0x7f2064155860 0x7f20640ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 >> v1:172.21.15.84:6789/0 conn(0x7f2064069c70 legacy=0x7f20640abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20640c74e0 con 0x7f20640c82a0 2023-10-06T03:24:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f2054004b20 con 0x7f20640c82a0 2023-10-06T03:24:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 >> v1:172.21.15.131:6789/0 conn(0x7f20640c82a0 legacy=0x7f2064069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f204c003d20 0x7f204c0065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f204c006af0 0x7f204c008f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f204c0095d0 0x7f204c009a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20640c7200 con 0x7f204c006af0 2023-10-06T03:24:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c00a2b0 con 0x7f204c003d20 2023-10-06T03:24:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c00a470 con 0x7f204c0095d0 2023-10-06T03:24:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2068bfd700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f204c0095d0 0x7f204c009a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2063fff700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f204c003d20 0x7f204c0065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f20637fe700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f204c006af0 0x7f204c008f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2063fff700 1 -- 172.21.15.84:0/842577076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f204c0095d0 msgr2=0x7f204c009a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2063fff700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f204c0095d0 0x7f204c009a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.647+0000 7f2063fff700 1 -- 172.21.15.84:0/842577076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f204c006af0 msgr2=0x7f204c008f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.648+0000 7f2063fff700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f204c006af0 0x7f204c008f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.648+0000 7f2063fff700 1 -- 172.21.15.84:0/842577076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20640c74e0 con 0x7f204c003d20 2023-10-06T03:24:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.648+0000 7f2068bfd700 1 -- 172.21.15.84:0/842577076 reap_dead start 2023-10-06T03:24:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.648+0000 7f20637fe700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f204c006af0 0x7f204c008f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.648+0000 7f187f583700 1 Processor -- start 2023-10-06T03:24:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.648+0000 7f2063fff700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f204c003d20 0x7f204c0065b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20580099c0 tx=0x7f2058009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44c03777bbf37c29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.648+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058033430 con 0x7f204c003d20 2023-10-06T03:24:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.648+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2058033590 con 0x7f204c003d20 2023-10-06T03:24:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.648+0000 7f2062ffd700 1 -- 172.21.15.84:0/842577076 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058033950 con 0x7f204c003d20 2023-10-06T03:24:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.648+0000 7f187f583700 1 -- start start 2023-10-06T03:24:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.649+0000 7f206a660700 1 -- 172.21.15.84:0/842577076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f204c003d20 msgr2=0x7f204c0065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.649+0000 7f206a660700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f204c003d20 0x7f204c0065b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20580099c0 tx=0x7f2058009060 comp rx=0 tx=0).stop 2023-10-06T03:24:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.649+0000 7f187f583700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1878157460 0x7f18780ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.649+0000 7f187f583700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18780cae60 con 0x7f18780ac480 2023-10-06T03:24:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.649+0000 7f187f583700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18780aeed0 con 0x7f1878157830 2023-10-06T03:24:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.649+0000 7f187f583700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18780af1b0 con 0x7f1878157460 2023-10-06T03:24:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.649+0000 7f187d31f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1878157460 0x7f18780ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f187d31f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1878157460 0x7f18780ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33976/0 (socket says 172.21.15.84:33976) 2023-10-06T03:24:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f187d31f700 1 -- 172.21.15.84:0/1766342 learned_addr learned my addr 172.21.15.84:0/1766342 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.649+0000 7f187cb1e700 1 --1- 172.21.15.84:0/1766342 >> v1:172.21.15.131:6789/0 conn(0x7f1878157830 0x7f18780cc2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:50822/0 (socket says 172.21.15.84:50822) 2023-10-06T03:24:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f206a660700 1 -- 172.21.15.84:0/842577076 shutdown_connections 2023-10-06T03:24:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f206a660700 1 --2- 172.21.15.84:0/842577076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f204c003d20 0x7f204c0065b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f206a660700 1 -- 172.21.15.84:0/842577076 >> 172.21.15.84:0/842577076 conn(0x7f20640680c0 msgr2=0x7f20640cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f206a660700 1 -- 172.21.15.84:0/842577076 shutdown_connections 2023-10-06T03:24:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f187d31f700 1 -- 172.21.15.84:0/1766342 >> v1:172.21.15.131:6789/0 conn(0x7f1878157830 legacy=0x7f18780cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f187d31f700 1 -- 172.21.15.84:0/1766342 >> v1:172.21.15.84:6789/0 conn(0x7f18780ac480 legacy=0x7f1878068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f187d31f700 1 -- 172.21.15.84:0/1766342 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18780af490 con 0x7f1878157460 2023-10-06T03:24:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f187d31f700 1 --2- 172.21.15.84:0/1766342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1878157460 0x7f18780ae8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1874009990 tx=0x7f1874009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508dbae8cf9e9b94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.650+0000 7f206a660700 1 -- 172.21.15.84:0/842577076 wait complete. 2023-10-06T03:24:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.651+0000 7f206a660700 1 Processor -- start 2023-10-06T03:24:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.651+0000 7f206a660700 1 -- start start 2023-10-06T03:24:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f9618047700 1 Processor -- start 2023-10-06T03:24:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f186ffff700 1 -- 172.21.15.84:0/1766342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874009ed0 con 0x7f1878157460 2023-10-06T03:24:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f186ffff700 1 -- 172.21.15.84:0/1766342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187400b760 con 0x7f1878157460 2023-10-06T03:24:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f186ffff700 1 -- 172.21.15.84:0/1766342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187400bb20 con 0x7f1878157460 2023-10-06T03:24:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f9618047700 1 -- start start 2023-10-06T03:24:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f21f6fb4700 1 Processor -- start 2023-10-06T03:24:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f9618047700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9610157830 0x7f96100ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f9618047700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f96100ac480 0x7f9610068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f9618047700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96100cae60 con 0x7f9610157460 2023-10-06T03:24:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f9618047700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96100aeed0 con 0x7f96100ac480 2023-10-06T03:24:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f9618047700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96100af1b0 con 0x7f9610157830 2023-10-06T03:24:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9615de3700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9610157460 0x7f96100cc2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48372/0 (socket says 172.21.15.84:48372) 2023-10-06T03:24:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9615de3700 1 -- 172.21.15.84:0/4236050760 learned_addr learned my addr 172.21.15.84:0/4236050760 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f96155e2700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9610157830 0x7f96100ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f206a660700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f204c003d20 0x7f20640b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f206a660700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20640b1620 0x7f20641660d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f206a660700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20641577f0 0x7f2064166610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f206a660700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20640b0c50 con 0x7f20640b1620 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f206a660700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20640b0920 con 0x7f20641577f0 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f206a660700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2064165870 con 0x7f204c003d20 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f2068bfd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20641577f0 0x7f2064166610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f2068bfd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20641577f0 0x7f2064166610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56480/0 (socket says 172.21.15.84:56480) 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f2068bfd700 1 -- 172.21.15.84:0/1017731917 learned_addr learned my addr 172.21.15.84:0/1017731917 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f20637fe700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20640b1620 0x7f20641660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f2063fff700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f204c003d20 0x7f20640b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f2068bfd700 1 -- 172.21.15.84:0/1017731917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f204c003d20 msgr2=0x7f20640b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f2068bfd700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f204c003d20 0x7f20640b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f2068bfd700 1 -- 172.21.15.84:0/1017731917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20640b1620 msgr2=0x7f20641660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f2068bfd700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20640b1620 0x7f20641660d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f2068bfd700 1 -- 172.21.15.84:0/1017731917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2064165b50 con 0x7f20641577f0 2023-10-06T03:24:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f0d9db48700 1 Processor -- start 2023-10-06T03:24:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f187f583700 1 -- 172.21.15.84:0/1766342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1878157460 msgr2=0x7f18780ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f187f583700 1 --2- 172.21.15.84:0/1766342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1878157460 0x7f18780ae8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1874009990 tx=0x7f1874009220 comp rx=0 tx=0).stop 2023-10-06T03:24:06.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f187f583700 1 -- 172.21.15.84:0/1766342 shutdown_connections 2023-10-06T03:24:06.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f187f583700 1 --2- 172.21.15.84:0/1766342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1878157460 0x7f18780ae8f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.653+0000 7f187f583700 1 -- 172.21.15.84:0/1766342 >> 172.21.15.84:0/1766342 conn(0x7f187806de80 msgr2=0x7f187806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7fcf2373b700 1 Processor -- start 2023-10-06T03:24:06.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f0d9db48700 1 -- start start 2023-10-06T03:24:06.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.652+0000 7f21f6fb4700 1 -- start start 2023-10-06T03:24:06.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f21f6fb4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f21f015d8f0 0x7f21f015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083355036 0 0) 0x7f96100cae60 con 0x7f9610157460 2023-10-06T03:24:06.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f21f6fb4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21f00b1d50 0x7f21f00b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f21f6fb4700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f00c9750 con 0x7f21f0068600 2023-10-06T03:24:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f21f6fb4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f00c8ef0 con 0x7f21f00b1d50 2023-10-06T03:24:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f21f6fb4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f00b2700 con 0x7f21f015d8f0 2023-10-06T03:24:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95fc003570 con 0x7f9610157460 2023-10-06T03:24:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f21f5551700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f21f0068600 0x7f21f01617c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:50824/0 (socket says 172.21.15.84:50824) 2023-10-06T03:24:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f21f5551700 1 -- 172.21.15.84:0/1554374953 learned_addr learned my addr 172.21.15.84:0/1554374953 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:06.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f21effff700 1 --2- 172.21.15.84:0/1554374953 >> v2:172.21.15.84:3300/0 conn(0x7f21f00b1d50 0x7f21f00b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3351019427 0 0) 0x7f95fc003570 con 0x7f9610157460 2023-10-06T03:24:06.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9610157830 msgr2=0x7f96100ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9610157830 0x7f96100ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 >> v2:172.21.15.131:3300/0 conn(0x7f96100ac480 msgr2=0x7f9610068600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 --2- 172.21.15.84:0/4236050760 >> v2:172.21.15.131:3300/0 conn(0x7f96100ac480 0x7f9610068600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100af490 con 0x7f9610157460 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f96000015f0 con 0x7f9610157460 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 >> v1:172.21.15.84:6789/0 conn(0x7f9610157460 legacy=0x7f96100cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95fc003ae0 0x7f95fc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc004810 0x7f95fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95fc0052e0 0x7f95fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100aeed0 con 0x7f95fc0052e0 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100af1b0 con 0x7f95fc004810 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc00c300 con 0x7f95fc003ae0 2023-10-06T03:24:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f9615de3700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95fc003ae0 0x7f95fc003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f21effff700 1 -- 172.21.15.84:0/1554374953 >> v2:172.21.15.131:3300/0 conn(0x7f21f015d8f0 msgr2=0x7f21f015dcc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:24:06.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f21effff700 1 --2- 172.21.15.84:0/1554374953 >> v2:172.21.15.131:3300/0 conn(0x7f21f015d8f0 0x7f21f015dcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f21effff700 1 -- 172.21.15.84:0/1554374953 >> v1:172.21.15.131:6789/0 conn(0x7f21f0068600 legacy=0x7f21f01617c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f21effff700 1 -- 172.21.15.84:0/1554374953 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f00b2910 con 0x7f21f00b1d50 2023-10-06T03:24:06.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7fcf2373b700 1 -- start start 2023-10-06T03:24:06.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f0d9db48700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0d981562c0 0x7f0d9815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f0d9db48700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d980c9740 con 0x7f0d98068d10 2023-10-06T03:24:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f0d9db48700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d980ad850 con 0x7f0d98156690 2023-10-06T03:24:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f2068bfd700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20641577f0 0x7f2064166610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20640701d0 tx=0x7f205c001580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f204bfff700 1 -- 172.21.15.84:0/1017731917 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c013630 con 0x7f20641577f0 2023-10-06T03:24:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f204bfff700 1 -- 172.21.15.84:0/1017731917 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c013790 con 0x7f20641577f0 2023-10-06T03:24:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.654+0000 7f204bfff700 1 -- 172.21.15.84:0/1017731917 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c013b50 con 0x7f20641577f0 2023-10-06T03:24:06.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f0d9db48700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9815b040 con 0x7f0d981562c0 2023-10-06T03:24:06.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f206a660700 1 -- 172.21.15.84:0/1017731917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2064165e30 con 0x7f20641577f0 2023-10-06T03:24:06.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f206a660700 1 -- 172.21.15.84:0/1017731917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20640cc150 con 0x7f20641577f0 2023-10-06T03:24:06.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f0d97fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0d98068d10 0x7f0d980ac580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48376/0 (socket says 172.21.15.84:48376) 2023-10-06T03:24:06.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f0d97fff700 1 -- 172.21.15.84:0/2939984988 learned_addr learned my addr 172.21.15.84:0/2939984988 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:06.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f187f583700 1 -- 172.21.15.84:0/1766342 shutdown_connections 2023-10-06T03:24:06.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7f187f583700 1 -- 172.21.15.84:0/1766342 wait complete. 2023-10-06T03:24:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f9615de3700 1 -- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc004810 msgr2=0x7f95fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f96155e2700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc004810 0x7f95fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f9615de3700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc004810 0x7f95fc004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f9615de3700 1 -- 172.21.15.84:0/4236050760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95fc0052e0 msgr2=0x7f95fc00ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:24:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f9615de3700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95fc0052e0 0x7f95fc00ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f9615de3700 1 -- 172.21.15.84:0/4236050760 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100af490 con 0x7f95fc003ae0 2023-10-06T03:24:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.655+0000 7f9615de3700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95fc003ae0 0x7f95fc003ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f960000c3e0 tx=0x7f9600007950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d6d157bf3994f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600007c40 con 0x7f95fc003ae0 2023-10-06T03:24:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960000cc90 con 0x7f95fc003ae0 2023-10-06T03:24:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7f9614de1700 1 -- 172.21.15.84:0/4236050760 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600007320 con 0x7f95fc003ae0 2023-10-06T03:24:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf2373b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068850 0x7fcf1c0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf2373b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcf1c068c20 0x7fcf1c155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf2373b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0ac910 con 0x7fcf1c0ac480 2023-10-06T03:24:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf2373b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0acbf0 con 0x7fcf1c068c20 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf2373b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0aced0 con 0x7fcf1c068850 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf20cd6700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fcf1c0ac480 0x7fcf1c155640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:50848/0 (socket says 172.21.15.84:50848) 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf214d7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068850 0x7fcf1c0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf20cd6700 1 -- 172.21.15.84:0/3135587213 learned_addr learned my addr 172.21.15.84:0/3135587213 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf21cd8700 1 --2- 172.21.15.84:0/3135587213 >> v2:172.21.15.131:3300/0 conn(0x7fcf1c068c20 0x7fcf1c155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf13fff700 1 -- 172.21.15.84:0/3135587213 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773045625 0 0) 0x7fcf1c0ac910 con 0x7fcf1c0ac480 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf13fff700 1 -- 172.21.15.84:0/3135587213 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf08003570 con 0x7fcf1c0ac480 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf21cd8700 1 -- 172.21.15.84:0/3135587213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068850 msgr2=0x7fcf1c0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf21cd8700 1 --2- 172.21.15.84:0/3135587213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068850 0x7fcf1c0afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf21cd8700 1 -- 172.21.15.84:0/3135587213 >> v1:172.21.15.131:6789/0 conn(0x7fcf1c0ac480 legacy=0x7fcf1c155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7fcf21cd8700 1 -- 172.21.15.84:0/3135587213 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0ad1b0 con 0x7fcf1c068c20 2023-10-06T03:24:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7f21effff700 1 --2- 172.21.15.84:0/1554374953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f00b1d50 0x7f21f00b21c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f21f006dae0 tx=0x7f21e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233fa4a941a8bb4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f9618047700 1 -- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95fc003ae0 msgr2=0x7f95fc003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f9618047700 1 --2- 172.21.15.84:0/4236050760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95fc003ae0 0x7f95fc003ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f960000c3e0 tx=0x7f9600007950 comp rx=0 tx=0).stop 2023-10-06T03:24:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f96165e4700 1 -- 172.21.15.84:0/4236050760 reap_dead start 2023-10-06T03:24:06.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f204bfff700 1 -- 172.21.15.84:0/1017731917 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f205c0153f0 con 0x7f20641577f0 2023-10-06T03:24:06.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f9618047700 1 -- 172.21.15.84:0/4236050760 shutdown_connections 2023-10-06T03:24:06.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f9618047700 1 -- 172.21.15.84:0/4236050760 >> 172.21.15.84:0/4236050760 conn(0x7f961006de80 msgr2=0x7f961006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7fcf21cd8700 1 --2- 172.21.15.84:0/3135587213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c068c20 0x7fcf1c155d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009e60 tx=0x7fcf14009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=524e2375c6bcfd22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7fcf13fff700 1 -- 172.21.15.84:0/3135587213 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400e070 con 0x7fcf1c068c20 2023-10-06T03:24:06.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7fcf13fff700 1 -- 172.21.15.84:0/3135587213 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1400bb60 con 0x7fcf1c068c20 2023-10-06T03:24:06.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7fcf13fff700 1 -- 172.21.15.84:0/3135587213 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14012430 con 0x7fcf1c068c20 2023-10-06T03:24:06.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f9618047700 1 -- 172.21.15.84:0/4236050760 shutdown_connections 2023-10-06T03:24:06.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f21ef7fe700 1 -- 172.21.15.84:0/1554374953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4011630 con 0x7f21f00b1d50 2023-10-06T03:24:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f21ef7fe700 1 -- 172.21.15.84:0/1554374953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e40117b0 con 0x7f21f00b1d50 2023-10-06T03:24:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f21ef7fe700 1 -- 172.21.15.84:0/1554374953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4011b70 con 0x7f21f00b1d50 2023-10-06T03:24:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766316727 0 0) 0x7f0d980ad850 con 0x7f0d98156690 2023-10-06T03:24:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f187f583700 1 Processor -- start 2023-10-06T03:24:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d80003570 con 0x7f0d98156690 2023-10-06T03:24:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.656+0000 7f0d977fe700 1 --2- 172.21.15.84:0/2939984988 >> v2:172.21.15.84:3300/0 conn(0x7f0d981562c0 0x7f0d9815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3426571434 0 0) 0x7f0d80003570 con 0x7f0d98156690 2023-10-06T03:24:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 >> v2:172.21.15.84:3300/0 conn(0x7f0d981562c0 msgr2=0x7f0d9815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 --2- 172.21.15.84:0/2939984988 >> v2:172.21.15.84:3300/0 conn(0x7f0d981562c0 0x7f0d9815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 >> v1:172.21.15.84:6789/0 conn(0x7f0d98068d10 legacy=0x7f0d980ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9815a7a0 con 0x7f0d98156690 2023-10-06T03:24:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f0d8c001470 con 0x7f0d98156690 2023-10-06T03:24:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 >> v1:172.21.15.131:6789/0 conn(0x7f0d98156690 legacy=0x7f0d98068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 --2- 172.21.15.84:0/2939984988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d80003ae0 0x7f0d80003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 --2- 172.21.15.84:0/2939984988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 --2- 172.21.15.84:0/2939984988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d80005210 0x7f0d80007a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9815b040 con 0x7f0d80005210 2023-10-06T03:24:06.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80008190 con 0x7f0d80003ae0 2023-10-06T03:24:06.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80008350 con 0x7f0d80004810 2023-10-06T03:24:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d96ffd700 1 --2- 172.21.15.84:0/2939984988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f0d977fe700 1 --2- 172.21.15.84:0/2939984988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d80003ae0 0x7f0d80003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f0d96ffd700 1 -- 172.21.15.84:0/2939984988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d80003ae0 msgr2=0x7f0d80003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f0d96ffd700 1 --2- 172.21.15.84:0/2939984988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d80003ae0 0x7f0d80003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f0d96ffd700 1 -- 172.21.15.84:0/2939984988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d80005210 msgr2=0x7f0d80007a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f0d96ffd700 1 --2- 172.21.15.84:0/2939984988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d80005210 0x7f0d80007a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f0d96ffd700 1 -- 172.21.15.84:0/2939984988 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9815a7a0 con 0x7f0d80004810 2023-10-06T03:24:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f204bfff700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2050067000 0x7f20500694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f204bfff700 1 -- 172.21.15.84:0/1017731917 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f205c0846a0 con 0x7f20641577f0 2023-10-06T03:24:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f206a660700 1 -- 172.21.15.84:0/1017731917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2064064ad0 con 0x7f20641577f0 2023-10-06T03:24:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f0d96ffd700 1 --2- 172.21.15.84:0/2939984988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d80004c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c002ee0 tx=0x7f0d8c007830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c4099601929ca90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7fcf2373b700 1 -- 172.21.15.84:0/3135587213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c068c20 msgr2=0x7fcf1c155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7fcf2373b700 1 --2- 172.21.15.84:0/3135587213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c068c20 0x7fcf1c155d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009e60 tx=0x7fcf14009780 comp rx=0 tx=0).stop 2023-10-06T03:24:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00cb70 con 0x7f0d80004810 2023-10-06T03:24:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f9618047700 1 -- 172.21.15.84:0/4236050760 wait complete. 2023-10-06T03:24:06.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c00ccf0 con 0x7f0d80004810 2023-10-06T03:24:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f0d967fc700 1 -- 172.21.15.84:0/2939984988 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c012670 con 0x7f0d80004810 2023-10-06T03:24:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1554374953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f00b1d50 msgr2=0x7f21f00b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.658+0000 7f21f6fb4700 1 --2- 172.21.15.84:0/1554374953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f00b1d50 0x7f21f00b21c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f21f006dae0 tx=0x7f21e40091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7fcf2373b700 1 -- 172.21.15.84:0/3135587213 shutdown_connections 2023-10-06T03:24:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7fcf2373b700 1 --2- 172.21.15.84:0/3135587213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c068c20 0x7fcf1c155d50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7fcf2373b700 1 --2- 172.21.15.84:0/3135587213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068850 0x7fcf1c0afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7fcf2373b700 1 -- 172.21.15.84:0/3135587213 >> 172.21.15.84:0/3135587213 conn(0x7fcf1c06de80 msgr2=0x7fcf1c06e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.657+0000 7f187f583700 1 -- start start 2023-10-06T03:24:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f0d97fff700 1 -- 172.21.15.84:0/2939984988 reap_dead start 2023-10-06T03:24:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7fcf2373b700 1 -- 172.21.15.84:0/3135587213 shutdown_connections 2023-10-06T03:24:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1554374953 shutdown_connections 2023-10-06T03:24:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f21f6fb4700 1 --2- 172.21.15.84:0/1554374953 >> v2:172.21.15.131:3300/0 conn(0x7f21f015d8f0 0x7f21f015dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f21f6fb4700 1 --2- 172.21.15.84:0/1554374953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f00b1d50 0x7f21f00b21c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1554374953 >> 172.21.15.84:0/1554374953 conn(0x7f21f006de80 msgr2=0x7f21f006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f0d9db48700 1 -- 172.21.15.84:0/2939984988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 msgr2=0x7f0d80004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f0d9db48700 1 --2- 172.21.15.84:0/2939984988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d80004c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c002ee0 tx=0x7f0d8c007830 comp rx=0 tx=0).stop 2023-10-06T03:24:06.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f187f583700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18780ac480 0x7f18780a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f187f583700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1878157460 0x7f187816ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f187f583700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1878157830 0x7f18781509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f187f583700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187816f390 con 0x7f1878157460 2023-10-06T03:24:06.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f187f583700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18780a7fa0 con 0x7f1878157830 2023-10-06T03:24:06.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f187f583700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1878150f00 con 0x7f18780ac480 2023-10-06T03:24:06.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f2063fff700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2050067000 0x7f20500694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f187db20700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1878157830 0x7f18781509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f187db20700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1878157830 0x7f18781509c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56522/0 (socket says 172.21.15.84:56522) 2023-10-06T03:24:06.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f187db20700 1 -- 172.21.15.84:0/1846757343 learned_addr learned my addr 172.21.15.84:0/1846757343 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f0d9db48700 1 -- 172.21.15.84:0/2939984988 shutdown_connections 2023-10-06T03:24:06.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f0d9db48700 1 --2- 172.21.15.84:0/2939984988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d80004c80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f0d9db48700 1 -- 172.21.15.84:0/2939984988 >> 172.21.15.84:0/2939984988 conn(0x7f0d9806de80 msgr2=0x7f0d9806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f187db20700 1 -- 172.21.15.84:0/1846757343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18780ac480 msgr2=0x7f18780a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f187db20700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18780ac480 0x7f18780a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f187db20700 1 -- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1878157460 msgr2=0x7f187816ee50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:24:06.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f9618047700 1 Processor -- start 2023-10-06T03:24:06.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f187cb1e700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1878157460 0x7f187816ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f9618047700 1 -- start start 2023-10-06T03:24:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f2063fff700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2050067000 0x7f20500694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2058009780 tx=0x7f2058038000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f0d9db48700 1 -- 172.21.15.84:0/2939984988 shutdown_connections 2023-10-06T03:24:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f0d9db48700 1 -- 172.21.15.84:0/2939984988 wait complete. 2023-10-06T03:24:06.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f187db20700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1878157460 0x7f187816ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f187db20700 1 -- 172.21.15.84:0/1846757343 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1874009480 con 0x7f1878157830 2023-10-06T03:24:06.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f187cb1e700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1878157460 0x7f187816ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:06.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1554374953 shutdown_connections 2023-10-06T03:24:06.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1554374953 wait complete. 2023-10-06T03:24:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7f187db20700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1878157830 0x7f18781509c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f187000cbc0 tx=0x7f1870001820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.659+0000 7fcf2373b700 1 -- 172.21.15.84:0/3135587213 wait complete. 2023-10-06T03:24:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.660+0000 7fcf2373b700 1 Processor -- start 2023-10-06T03:24:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7fcf2373b700 1 -- start start 2023-10-06T03:24:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f21f6fb4700 1 Processor -- start 2023-10-06T03:24:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f9618047700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc003ae0 0x7f961014a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f9618047700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f961014ae50 0x7f96101470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f9618047700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9610147620 0x7f9610147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f9618047700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9610147fb0 con 0x7f961014ae50 2023-10-06T03:24:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f9618047700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961014e420 con 0x7f95fc003ae0 2023-10-06T03:24:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f9618047700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961014b680 con 0x7f9610147620 2023-10-06T03:24:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f96155e2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f961014ae50 0x7f96101470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f96155e2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f961014ae50 0x7f96101470e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34034/0 (socket says 172.21.15.84:34034) 2023-10-06T03:24:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f96155e2700 1 -- 172.21.15.84:0/21980651 learned_addr learned my addr 172.21.15.84:0/21980651 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f9615de3700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc003ae0 0x7f961014a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f96165e4700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9610147620 0x7f9610147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f96155e2700 1 -- 172.21.15.84:0/21980651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9610147620 msgr2=0x7f9610147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f96155e2700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9610147620 0x7f9610147a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f96155e2700 1 -- 172.21.15.84:0/21980651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc003ae0 msgr2=0x7f961014a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f96155e2700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc003ae0 0x7f961014a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f96155e2700 1 -- 172.21.15.84:0/21980651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961014b960 con 0x7f961014ae50 2023-10-06T03:24:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f96155e2700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f961014ae50 0x7f96101470e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f960c00e820 tx=0x7f960c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf2373b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c068850 0x7fcf1c170550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf2373b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068c20 0x7fcf1c176500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf2373b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0ac480 0x7fcf1c06a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf2373b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c170a90 con 0x7fcf1c068850 2023-10-06T03:24:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf2373b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c152990 con 0x7fcf1c0ac480 2023-10-06T03:24:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf2373b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c152c70 con 0x7fcf1c068c20 2023-10-06T03:24:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf21cd8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0ac480 0x7fcf1c06a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.661+0000 7f21f6fb4700 1 -- start start 2023-10-06T03:24:06.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f21f6fb4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f0068600 0x7f21f0138800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f21f6fb4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f00b1d50 0x7f21f015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f21f6fb4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f015d8f0 0x7f21f015ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf21cd8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0ac480 0x7fcf1c06a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56550/0 (socket says 172.21.15.84:56550) 2023-10-06T03:24:06.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf21cd8700 1 -- 172.21.15.84:0/3899528258 learned_addr learned my addr 172.21.15.84:0/3899528258 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf214d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c068850 0x7fcf1c170550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f21f6fb4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f0160350 con 0x7f21f00b1d50 2023-10-06T03:24:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f21f6fb4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f015e740 con 0x7f21f0068600 2023-10-06T03:24:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f21f6fb4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f0160580 con 0x7f21f015d8f0 2023-10-06T03:24:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f0d9db48700 1 Processor -- start 2023-10-06T03:24:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f0d9db48700 1 -- start start 2023-10-06T03:24:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7fcf20cd6700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068c20 0x7fcf1c176500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f21f5551700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f015d8f0 0x7f21f015ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f21f5551700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f015d8f0 0x7f21f015ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55372/0 (socket says 172.21.15.84:55372) 2023-10-06T03:24:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f21f5551700 1 -- 172.21.15.84:0/1422158134 learned_addr learned my addr 172.21.15.84:0/1422158134 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7fcf214d7700 1 -- 172.21.15.84:0/3899528258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068c20 msgr2=0x7fcf1c176500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7fcf214d7700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068c20 0x7fcf1c176500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7fcf214d7700 1 -- 172.21.15.84:0/3899528258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0ac480 msgr2=0x7fcf1c06a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7fcf214d7700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0ac480 0x7fcf1c06a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7fcf214d7700 1 -- 172.21.15.84:0/3899528258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009a20 con 0x7fcf1c068850 2023-10-06T03:24:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f21effff700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f00b1d50 0x7f21f015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7fcf20cd6700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068c20 0x7fcf1c176500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7fcf214d7700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c068850 0x7fcf1c170550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800d860 tx=0x7fcf18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f0d9db48700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d981415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f0d9db48700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d98150620 0x7f0d98151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f0d9db48700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d98152130 0x7f0d981654e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f0d9db48700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98151760 con 0x7f0d98150620 2023-10-06T03:24:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f0d9db48700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98150b50 con 0x7f0d98152130 2023-10-06T03:24:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f0d9db48700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98150e30 con 0x7f0d80004810 2023-10-06T03:24:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f21f4d50700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f0068600 0x7f21f0138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f21f5551700 1 -- 172.21.15.84:0/1422158134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f0068600 msgr2=0x7f21f0138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f21f5551700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f0068600 0x7f21f0138800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f21f5551700 1 -- 172.21.15.84:0/1422158134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f00b1d50 msgr2=0x7f21f015fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f21f5551700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f00b1d50 0x7f21f015fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f21f5551700 1 -- 172.21.15.84:0/1422158134 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e4009420 con 0x7f21f015d8f0 2023-10-06T03:24:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f21f4d50700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f0068600 0x7f21f0138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7fbb3c4d9700 1 Processor -- start 2023-10-06T03:24:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7fbb3c4d9700 1 -- start start 2023-10-06T03:24:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f21f5551700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f015d8f0 0x7f21f015ebd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f21e8002230 tx=0x7f21e8001b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f0d97fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d98152130 0x7f0d981654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f186d7fa700 1 -- 172.21.15.84:0/1846757343 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000a7b0 con 0x7f1878157830 2023-10-06T03:24:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f186d7fa700 1 -- 172.21.15.84:0/1846757343 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187000a930 con 0x7f1878157830 2023-10-06T03:24:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f187f583700 1 -- 172.21.15.84:0/1846757343 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18780a7700 con 0x7f1878157830 2023-10-06T03:24:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f186d7fa700 1 -- 172.21.15.84:0/1846757343 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000acf0 con 0x7f1878157830 2023-10-06T03:24:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f187f583700 1 -- 172.21.15.84:0/1846757343 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18780a7cc0 con 0x7f1878157830 2023-10-06T03:24:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f0d977fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d981415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f0d977fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d981415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55380/0 (socket says 172.21.15.84:55380) 2023-10-06T03:24:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.663+0000 7f0d977fe700 1 -- 172.21.15.84:0/1802780172 learned_addr learned my addr 172.21.15.84:0/1802780172 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f21ecff9700 1 -- 172.21.15.84:0/1422158134 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800ab30 con 0x7f21f015d8f0 2023-10-06T03:24:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f21ecff9700 1 -- 172.21.15.84:0/1422158134 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e800ac90 con 0x7f21f015d8f0 2023-10-06T03:24:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1422158134 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f0160860 con 0x7f21f015d8f0 2023-10-06T03:24:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f0d96ffd700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d98150620 0x7f0d98151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f0d977fe700 1 -- 172.21.15.84:0/1802780172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d98152130 msgr2=0x7f0d981654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f0d977fe700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d98152130 0x7f0d981654e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f0d977fe700 1 -- 172.21.15.84:0/1802780172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d98150620 msgr2=0x7f0d98151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f0d977fe700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d98150620 0x7f0d98151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f0d977fe700 1 -- 172.21.15.84:0/1802780172 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d98151110 con 0x7f0d80004810 2023-10-06T03:24:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f0d977fe700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d981415c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0d90011580 tx=0x7f0d9000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f0d7f7fe700 1 -- 172.21.15.84:0/1802780172 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000e030 con 0x7f0d80004810 2023-10-06T03:24:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7f0d9db48700 1 -- 172.21.15.84:0/1802780172 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d981513f0 con 0x7f0d80004810 2023-10-06T03:24:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7f0d9db48700 1 -- 172.21.15.84:0/1802780172 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9814de50 con 0x7f0d80004810 2023-10-06T03:24:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7fbb3c4d9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb34159a60 0x7fbb34069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7fbb3c4d9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbb34069aa0 0x7fbb3415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7fbb3c4d9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3415b960 con 0x7fbb3415d920 2023-10-06T03:24:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7fbb3c4d9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3415a220 con 0x7fbb34069aa0 2023-10-06T03:24:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7fbb3c4d9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb34069ed0 con 0x7fbb34159a60 2023-10-06T03:24:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7f0d7f7fe700 1 -- 172.21.15.84:0/1802780172 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d90016470 con 0x7f0d80004810 2023-10-06T03:24:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7f0d7f7fe700 1 -- 172.21.15.84:0/1802780172 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90016830 con 0x7f0d80004810 2023-10-06T03:24:06.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7fbb3aa76700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbb3415d920 0x7fbb340c6a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48378/0 (socket says 172.21.15.84:48378) 2023-10-06T03:24:06.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7fbb3aa76700 1 -- 172.21.15.84:0/417243357 learned_addr learned my addr 172.21.15.84:0/417243357 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:06.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7fbb39a74700 1 --2- 172.21.15.84:0/417243357 >> v2:172.21.15.131:3300/0 conn(0x7fbb34069aa0 0x7fbb3415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7fbb39273700 1 -- 172.21.15.84:0/417243357 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100555244 0 0) 0x7fbb3415b960 con 0x7fbb3415d920 2023-10-06T03:24:06.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7fbb39273700 1 -- 172.21.15.84:0/417243357 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb24003570 con 0x7fbb3415d920 2023-10-06T03:24:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f21ecff9700 1 -- 172.21.15.84:0/1422158134 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8007340 con 0x7f21f015d8f0 2023-10-06T03:24:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.664+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1422158134 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f015f110 con 0x7f21f015d8f0 2023-10-06T03:24:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1422158134 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f015e230 con 0x7f21f015d8f0 2023-10-06T03:24:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7f204bfff700 1 -- 172.21.15.84:0/1017731917 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f205c01b020 con 0x7f20641577f0 2023-10-06T03:24:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7fbb3a275700 1 --2- 172.21.15.84:0/417243357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb34159a60 0x7fbb34069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7f21ecff9700 1 -- 172.21.15.84:0/1422158134 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21e80076b0 con 0x7f21f015d8f0 2023-10-06T03:24:06.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7f186d7fa700 1 -- 172.21.15.84:0/1846757343 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1870003030 con 0x7f1878157830 2023-10-06T03:24:06.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7f186d7fa700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f185c066f30 0x7f185c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7f186d7fa700 1 -- 172.21.15.84:0/1846757343 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1870084c20 con 0x7f1878157830 2023-10-06T03:24:06.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7fbb39a74700 1 -- 172.21.15.84:0/417243357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb34159a60 msgr2=0x7fbb34069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7fbb39a74700 1 --2- 172.21.15.84:0/417243357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb34159a60 0x7fbb34069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7fbb39a74700 1 -- 172.21.15.84:0/417243357 >> v1:172.21.15.84:6789/0 conn(0x7fbb3415d920 legacy=0x7fbb340c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7fbb39a74700 1 -- 172.21.15.84:0/417243357 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3415dd80 con 0x7fbb34069aa0 2023-10-06T03:24:06.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7f187d31f700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f185c066f30 0x7f185c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7fbb39a74700 1 --2- 172.21.15.84:0/417243357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb34069aa0 0x7fbb3415d3e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbb200098e0 tx=0x7fbb200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e202074bde557849 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7f21ecff9700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21d4066f30 0x7f21d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f9605ffb700 1 -- 172.21.15.84:0/21980651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c00c070 con 0x7f961014ae50 2023-10-06T03:24:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f9605ffb700 1 -- 172.21.15.84:0/21980651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c013410 con 0x7f961014ae50 2023-10-06T03:24:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f9605ffb700 1 -- 172.21.15.84:0/21980651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c0137f0 con 0x7f961014ae50 2023-10-06T03:24:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f9618047700 1 -- 172.21.15.84:0/21980651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961014bc40 con 0x7f961014ae50 2023-10-06T03:24:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.662+0000 7f9618047700 1 -- 172.21.15.84:0/21980651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9610146690 con 0x7f961014ae50 2023-10-06T03:24:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.665+0000 7f9618047700 1 -- 172.21.15.84:0/21980651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f00052b0 con 0x7f961014ae50 2023-10-06T03:24:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.666+0000 7fcf117fa700 1 -- 172.21.15.84:0/3899528258 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18005c10 con 0x7fcf1c068850 2023-10-06T03:24:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7fcf117fa700 1 -- 172.21.15.84:0/3899528258 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf18005d70 con 0x7fcf1c068850 2023-10-06T03:24:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7fcf117fa700 1 -- 172.21.15.84:0/3899528258 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18006260 con 0x7fcf1c068850 2023-10-06T03:24:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7f0d7f7fe700 1 -- 172.21.15.84:0/1802780172 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d90016be0 con 0x7f0d80004810 2023-10-06T03:24:06.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7f187f583700 1 -- 172.21.15.84:0/1846757343 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1878064ad0 con 0x7f1878157830 2023-10-06T03:24:06.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7fbb39273700 1 -- 172.21.15.84:0/417243357 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20011630 con 0x7fbb34069aa0 2023-10-06T03:24:06.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7fbb39273700 1 -- 172.21.15.84:0/417243357 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb20011790 con 0x7fbb34069aa0 2023-10-06T03:24:06.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7fbb39273700 1 -- 172.21.15.84:0/417243357 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20011b30 con 0x7fbb34069aa0 2023-10-06T03:24:06.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7f0d7f7fe700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d84066fb0 0x7f0d84069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7f0d7f7fe700 1 -- 172.21.15.84:0/1802780172 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0d9000f070 con 0x7f0d80004810 2023-10-06T03:24:06.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7f21ecff9700 1 -- 172.21.15.84:0/1422158134 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f21e8084eb0 con 0x7f21f015d8f0 2023-10-06T03:24:06.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7f21f4d50700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21d4066f30 0x7f21d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.667+0000 7f21f4d50700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21d4066f30 0x7f21d40693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00a900 tx=0x7f21dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7f187d31f700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f185c066f30 0x7f185c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1874009990 tx=0x7f1874016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/417243357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb34069aa0 msgr2=0x7fbb3415d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7fbb3c4d9700 1 --2- 172.21.15.84:0/417243357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb34069aa0 0x7fbb3415d3e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbb200098e0 tx=0x7fbb200091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7f0d96ffd700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d84066fb0 0x7f0d84069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/417243357 shutdown_connections 2023-10-06T03:24:06.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7fbb3c4d9700 1 --2- 172.21.15.84:0/417243357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb34159a60 0x7fbb34069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7fbb3c4d9700 1 --2- 172.21.15.84:0/417243357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb34069aa0 0x7fbb3415d3e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/417243357 >> 172.21.15.84:0/417243357 conn(0x7fbb340680c0 msgr2=0x7fbb340cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/417243357 shutdown_connections 2023-10-06T03:24:06.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/417243357 wait complete. 2023-10-06T03:24:06.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7f0d96ffd700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d84066fb0 0x7f0d84069460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c001050 tx=0x7f0d8c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.668+0000 7fcf2373b700 1 -- 172.21.15.84:0/3899528258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c176de0 con 0x7fcf1c068850 2023-10-06T03:24:06.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.669+0000 7fcf2373b700 1 -- 172.21.15.84:0/3899528258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c1773a0 con 0x7fcf1c068850 2023-10-06T03:24:06.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.669+0000 7f9605ffb700 1 -- 172.21.15.84:0/21980651 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f960c013c20 con 0x7f961014ae50 2023-10-06T03:24:06.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.669+0000 7f9605ffb700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.670+0000 7f9615de3700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.670+0000 7f9605ffb700 1 -- 172.21.15.84:0/21980651 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f960c084a60 con 0x7f961014ae50 2023-10-06T03:24:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.670+0000 7fbb3c4d9700 1 Processor -- start 2023-10-06T03:24:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.670+0000 7fbb3c4d9700 1 -- start start 2023-10-06T03:24:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.670+0000 7f9615de3700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f95f4066f30 0x7f95f40693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9600000ef0 tx=0x7f9600015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7f0d9db48700 1 -- 172.21.15.84:0/1802780172 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d780052b0 con 0x7f0d80004810 2023-10-06T03:24:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb3c4d9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb34069aa0 0x7fbb340c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb3c4d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb34159a60 0x7fbb34154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb3c4d9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb3415d920 0x7fbb340c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb3c4d9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb340c6f10 con 0x7fbb34159a60 2023-10-06T03:24:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb3c4d9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb340c76e0 con 0x7fbb34069aa0 2023-10-06T03:24:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb3c4d9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb340c21b0 con 0x7fbb3415d920 2023-10-06T03:24:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb39a74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb34159a60 0x7fbb34154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb39a74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb34159a60 0x7fbb34154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34072/0 (socket says 172.21.15.84:34072) 2023-10-06T03:24:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb39a74700 1 -- 172.21.15.84:0/3577901769 learned_addr learned my addr 172.21.15.84:0/3577901769 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb3aa76700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb3415d920 0x7fbb340c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb3a275700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb34069aa0 0x7fbb340c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb39a74700 1 -- 172.21.15.84:0/3577901769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb3415d920 msgr2=0x7fbb340c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb39a74700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb3415d920 0x7fbb340c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb39a74700 1 -- 172.21.15.84:0/3577901769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb34069aa0 msgr2=0x7fbb340c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb39a74700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb34069aa0 0x7fbb340c1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7fbb39a74700 1 -- 172.21.15.84:0/3577901769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20009420 con 0x7fbb34159a60 2023-10-06T03:24:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.671+0000 7f21ecff9700 1 -- 172.21.15.84:0/1422158134 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21f015e230 con 0x7f21f015d8f0 2023-10-06T03:24:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.672+0000 7f186d7fa700 1 -- 172.21.15.84:0/1846757343 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18700519a0 con 0x7f1878157830 2023-10-06T03:24:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.672+0000 7fbb39a74700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb34159a60 0x7fbb34154640 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009ed0 tx=0x7fbb20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.673+0000 7fcf2373b700 1 -- 172.21.15.84:0/3899528258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c064ad0 con 0x7fcf1c068850 2023-10-06T03:24:06.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.673+0000 7f0d4f04f700 1 Processor -- start 2023-10-06T03:24:06.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.673+0000 7f0d4f04f700 1 -- start start 2023-10-06T03:24:06.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4f04f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0d4815caf0 0x7f0d4806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4f04f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0d480caad0 0x7f0d480caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4f04f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d480675f0 0x7f0d480679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4f04f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4806ed10 con 0x7f0d4815caf0 2023-10-06T03:24:06.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4f04f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d48067f20 con 0x7f0d480caad0 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4f04f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480cb8b0 con 0x7f0d480675f0 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4cdeb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0d4815caf0 0x7f0d4806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4cdeb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0d4815caf0 0x7f0d4806f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34082/0 (socket says 172.21.15.84:34082) 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4cdeb700 1 -- 172.21.15.84:0/149962015 learned_addr learned my addr 172.21.15.84:0/149962015 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d47fff700 1 --2- 172.21.15.84:0/149962015 >> v2:172.21.15.131:3300/0 conn(0x7f0d480caad0 0x7f0d480caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4d5ec700 1 --2- 172.21.15.84:0/149962015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d480675f0 0x7f0d480679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d47fff700 1 -- 172.21.15.84:0/149962015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d480675f0 msgr2=0x7f0d480679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d47fff700 1 --2- 172.21.15.84:0/149962015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d480675f0 0x7f0d480679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d47fff700 1 -- 172.21.15.84:0/149962015 >> v2:172.21.15.84:3300/0 conn(0x7f0d4815caf0 msgr2=0x7f0d4806f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d47fff700 1 --2- 172.21.15.84:0/149962015 >> v2:172.21.15.84:3300/0 conn(0x7f0d4815caf0 0x7f0d4806f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d47fff700 1 -- 172.21.15.84:0/149962015 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480cbb90 con 0x7f0d480caad0 2023-10-06T03:24:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.675+0000 7f0d4cdeb700 1 --2- 172.21.15.84:0/149962015 >> v2:172.21.15.84:3300/0 conn(0x7f0d4815caf0 0x7f0d4806f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.676+0000 7f0d47fff700 1 --2- 172.21.15.84:0/149962015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d480caad0 0x7f0d480caff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d4806b940 tx=0x7f0d340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d1315070b4b95d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.676+0000 7f0d477fe700 1 -- 172.21.15.84:0/149962015 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34011630 con 0x7f0d480caad0 2023-10-06T03:24:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.676+0000 7f0d477fe700 1 -- 172.21.15.84:0/149962015 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d340117b0 con 0x7f0d480caad0 2023-10-06T03:24:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.676+0000 7f0d477fe700 1 -- 172.21.15.84:0/149962015 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34011b70 con 0x7f0d480caad0 2023-10-06T03:24:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.676+0000 7f0d7f7fe700 1 -- 172.21.15.84:0/1802780172 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d900527d0 con 0x7f0d80004810 2023-10-06T03:24:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.676+0000 7f9605ffb700 1 -- 172.21.15.84:0/21980651 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f960c051900 con 0x7f961014ae50 2023-10-06T03:24:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.677+0000 7f0d4f04f700 1 -- 172.21.15.84:0/149962015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d480caad0 msgr2=0x7f0d480caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.677+0000 7f0d4f04f700 1 --2- 172.21.15.84:0/149962015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d480caad0 0x7f0d480caff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d4806b940 tx=0x7f0d340091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.677+0000 7f0d4f04f700 1 -- 172.21.15.84:0/149962015 shutdown_connections 2023-10-06T03:24:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.677+0000 7f0d4f04f700 1 --2- 172.21.15.84:0/149962015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d480675f0 0x7f0d480679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.677+0000 7f0d4f04f700 1 --2- 172.21.15.84:0/149962015 >> v2:172.21.15.84:3300/0 conn(0x7f0d4815caf0 0x7f0d4806f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.677+0000 7f0d4f04f700 1 --2- 172.21.15.84:0/149962015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d480caad0 0x7f0d480caff0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.677+0000 7f0d4f04f700 1 -- 172.21.15.84:0/149962015 >> 172.21.15.84:0/149962015 conn(0x7f0d480cdef0 msgr2=0x7f0d480c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.677+0000 7f0d4f04f700 1 -- 172.21.15.84:0/149962015 shutdown_connections 2023-10-06T03:24:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.677+0000 7f0d4f04f700 1 -- 172.21.15.84:0/149962015 wait complete. 2023-10-06T03:24:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.679+0000 7f0d4f04f700 1 Processor -- start 2023-10-06T03:24:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.678+0000 7fbb327fc700 1 -- 172.21.15.84:0/3577901769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2001f070 con 0x7fbb34159a60 2023-10-06T03:24:06.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.678+0000 7fbb327fc700 1 -- 172.21.15.84:0/3577901769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb20000bc0 con 0x7fbb34159a60 2023-10-06T03:24:06.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.678+0000 7fbb327fc700 1 -- 172.21.15.84:0/3577901769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20011b30 con 0x7fbb34159a60 2023-10-06T03:24:06.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.678+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/3577901769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb340c2670 con 0x7fbb34159a60 2023-10-06T03:24:06.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.678+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/3577901769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb340c7400 con 0x7fbb34159a60 2023-10-06T03:24:06.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.679+0000 7f0d4f04f700 1 -- start start 2023-10-06T03:24:06.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d4f04f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d480675f0 0x7f0d4816ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d4f04f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d480caad0 0x7f0d480c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d4f04f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d4815caf0 0x7f0d4815b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d4f04f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4816de30 con 0x7f0d4815caf0 2023-10-06T03:24:06.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d4f04f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4815be70 con 0x7f0d480675f0 2023-10-06T03:24:06.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d4f04f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4816d590 con 0x7f0d480caad0 2023-10-06T03:24:06.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d4d5ec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d4815caf0 0x7f0d4815b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d4d5ec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d4815caf0 0x7f0d4815b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34086/0 (socket says 172.21.15.84:34086) 2023-10-06T03:24:06.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d4d5ec700 1 -- 172.21.15.84:0/1966118014 learned_addr learned my addr 172.21.15.84:0/1966118014 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:06.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d4cdeb700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d480675f0 0x7f0d4816ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.680+0000 7f0d47fff700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d480caad0 0x7f0d480c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.681+0000 7f0d4d5ec700 1 -- 172.21.15.84:0/1966118014 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d480caad0 msgr2=0x7f0d480c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.681+0000 7f0d4d5ec700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d480caad0 0x7f0d480c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.681+0000 7f0d4d5ec700 1 -- 172.21.15.84:0/1966118014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d480675f0 msgr2=0x7f0d4816ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.681+0000 7f0d4d5ec700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d480675f0 0x7f0d4816ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.681+0000 7f0d4d5ec700 1 -- 172.21.15.84:0/1966118014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0094f0 con 0x7f0d4815caf0 2023-10-06T03:24:06.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.681+0000 7f0d4d5ec700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d4815caf0 0x7f0d4815b930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009e90 tx=0x7f0d4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.687+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/3577901769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c0052b0 con 0x7fbb34159a60 2023-10-06T03:24:06.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.688+0000 7f0d44ff9700 1 -- 172.21.15.84:0/1966118014 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000cb50 con 0x7f0d4815caf0 2023-10-06T03:24:06.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.688+0000 7f0d44ff9700 1 -- 172.21.15.84:0/1966118014 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000f040 con 0x7f0d4815caf0 2023-10-06T03:24:06.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.688+0000 7f0d44ff9700 1 -- 172.21.15.84:0/1966118014 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40014480 con 0x7f0d4815caf0 2023-10-06T03:24:06.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.688+0000 7fbb327fc700 1 -- 172.21.15.84:0/3577901769 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb20023070 con 0x7fbb34159a60 2023-10-06T03:24:06.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.689+0000 7fbb327fc700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb18067080 0x7fbb18069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.689+0000 7fbb327fc700 1 -- 172.21.15.84:0/3577901769 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbb200858d0 con 0x7fbb34159a60 2023-10-06T03:24:06.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.691+0000 7f0d4f04f700 1 -- 172.21.15.84:0/1966118014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d34009420 con 0x7f0d4815caf0 2023-10-06T03:24:06.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.691+0000 7f0d4f04f700 1 -- 172.21.15.84:0/1966118014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4816db50 con 0x7f0d4815caf0 2023-10-06T03:24:06.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.681+0000 7fcf117fa700 1 -- 172.21.15.84:0/3899528258 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf18006610 con 0x7fcf1c068850 2023-10-06T03:24:06.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.681+0000 7fcf117fa700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf00067080 0x7fcf00069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.681+0000 7fcf117fa700 1 -- 172.21.15.84:0/3899528258 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcf180857c0 con 0x7fcf1c068850 2023-10-06T03:24:06.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.686+0000 7fcf117fa700 1 -- 172.21.15.84:0/3899528258 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf180525c0 con 0x7fcf1c068850 2023-10-06T03:24:06.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.695+0000 7f0d4f04f700 1 -- 172.21.15.84:0/1966118014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d48064ad0 con 0x7f0d4815caf0 2023-10-06T03:24:06.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.695+0000 7fcf20cd6700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf00067080 0x7fcf00069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.698+0000 7fbb3a275700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb18067080 0x7fbb18069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.700+0000 7fcf20cd6700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf00067080 0x7fcf00069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0058d0 tx=0x7fcf0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.701+0000 7fbb3a275700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb18067080 0x7fbb18069530 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb280076c0 tx=0x7fbb2800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.700+0000 7f0d44ff9700 1 -- 172.21.15.84:0/1966118014 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d40014830 con 0x7f0d4815caf0 2023-10-06T03:24:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.700+0000 7f0d44ff9700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d2c067080 0x7f0d2c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.701+0000 7f0d44ff9700 1 -- 172.21.15.84:0/1966118014 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0d40085ac0 con 0x7f0d4815caf0 2023-10-06T03:24:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.702+0000 7fbb327fc700 1 -- 172.21.15.84:0/3577901769 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb200526d0 con 0x7fbb34159a60 2023-10-06T03:24:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.705+0000 7f0d4cdeb700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d2c067080 0x7f0d2c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.705+0000 7f0d4cdeb700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d2c067080 0x7f0d2c069530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:06.713+0000 7f0d44ff9700 1 -- 172.21.15.84:0/1966118014 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d40052940 con 0x7f0d4815caf0 2023-10-06T03:24:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.049+0000 7f206a660700 1 -- 172.21.15.84:0/1017731917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f20640c77c0 con 0x7f20641577f0 2023-10-06T03:24:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.049+0000 7f204bfff700 1 -- 172.21.15.84:0/1017731917 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f205c057090 con 0x7f20641577f0 2023-10-06T03:24:07.054 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-10-06T03:24:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 -- 172.21.15.84:0/1017731917 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2050067000 msgr2=0x7f20500694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2050067000 0x7f20500694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2058009780 tx=0x7f2058038000 comp rx=0 tx=0).stop 2023-10-06T03:24:07.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 -- 172.21.15.84:0/1017731917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20641577f0 msgr2=0x7f2064166610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20641577f0 0x7f2064166610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20640701d0 tx=0x7f205c001580 comp rx=0 tx=0).stop 2023-10-06T03:24:07.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 -- 172.21.15.84:0/1017731917 shutdown_connections 2023-10-06T03:24:07.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2050067000 0x7f20500694b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20641577f0 0x7f2064166610 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f204c003d20 0x7f20640b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 --2- 172.21.15.84:0/1017731917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20640b1620 0x7f20641660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 -- 172.21.15.84:0/1017731917 >> 172.21.15.84:0/1017731917 conn(0x7f20640680c0 msgr2=0x7f206406de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.053+0000 7f206a660700 1 -- 172.21.15.84:0/1017731917 shutdown_connections 2023-10-06T03:24:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.055+0000 7f206a660700 1 -- 172.21.15.84:0/1017731917 wait complete. 2023-10-06T03:24:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.056+0000 7f187f583700 1 -- 172.21.15.84:0/1846757343 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f187804bb80 con 0x7f1878157830 2023-10-06T03:24:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.057+0000 7f186d7fa700 1 -- 172.21.15.84:0/1846757343 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1870054fc0 con 0x7f1878157830 2023-10-06T03:24:07.061 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T03:24:07.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.060+0000 7f187f583700 1 -- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f185c066f30 msgr2=0x7f185c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.060+0000 7f187f583700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f185c066f30 0x7f185c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1874009990 tx=0x7f1874016000 comp rx=0 tx=0).stop 2023-10-06T03:24:07.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.060+0000 7f187f583700 1 -- 172.21.15.84:0/1846757343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1878157830 msgr2=0x7f18781509c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.060+0000 7f187f583700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1878157830 0x7f18781509c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f187000cbc0 tx=0x7f1870001820 comp rx=0 tx=0).stop 2023-10-06T03:24:07.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.061+0000 7f187f583700 1 -- 172.21.15.84:0/1846757343 shutdown_connections 2023-10-06T03:24:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.061+0000 7f187f583700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f185c066f30 0x7f185c0693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.061+0000 7f187f583700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1878157830 0x7f18781509c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.061+0000 7f187f583700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18780ac480 0x7f18780a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.061+0000 7f187f583700 1 --2- 172.21.15.84:0/1846757343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1878157460 0x7f187816ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.061+0000 7f187f583700 1 -- 172.21.15.84:0/1846757343 >> 172.21.15.84:0/1846757343 conn(0x7f187806de80 msgr2=0x7f18780c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.061+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1422158134 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f21f015e230 con 0x7f21f015d8f0 2023-10-06T03:24:07.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.062+0000 7f187f583700 1 -- 172.21.15.84:0/1846757343 shutdown_connections 2023-10-06T03:24:07.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.062+0000 7f187f583700 1 -- 172.21.15.84:0/1846757343 wait complete. 2023-10-06T03:24:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.068+0000 7fcf2373b700 1 -- 172.21.15.84:0/3899528258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcf1c04bb80 con 0x7fcf1c068850 2023-10-06T03:24:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.071+0000 7fcf117fa700 1 -- 172.21.15.84:0/3899528258 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf18055be0 con 0x7fcf1c068850 2023-10-06T03:24:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.064+0000 7f21ecff9700 1 -- 172.21.15.84:0/1422158134 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21f015e230 con 0x7f21f015d8f0 2023-10-06T03:24:07.076 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-10-06T03:24:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.074+0000 7f0d9db48700 1 -- 172.21.15.84:0/1802780172 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0d78005560 con 0x7f0d80004810 2023-10-06T03:24:07.077 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T03:24:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.075+0000 7fcf2373b700 1 -- 172.21.15.84:0/3899528258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf00067080 msgr2=0x7fcf00069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.075+0000 7fcf2373b700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf00067080 0x7fcf00069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0058d0 tx=0x7fcf0c009040 comp rx=0 tx=0).stop 2023-10-06T03:24:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.075+0000 7fcf2373b700 1 -- 172.21.15.84:0/3899528258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c068850 msgr2=0x7fcf1c170550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.075+0000 7fcf2373b700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c068850 0x7fcf1c170550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800d860 tx=0x7fcf18008040 comp rx=0 tx=0).stop 2023-10-06T03:24:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.076+0000 7f0d7f7fe700 1 -- 172.21.15.84:0/1802780172 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d9001a030 con 0x7f0d80004810 2023-10-06T03:24:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.076+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1422158134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21d4066f30 msgr2=0x7f21d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.076+0000 7f21f6fb4700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21d4066f30 0x7f21d40693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00a900 tx=0x7f21dc008040 comp rx=0 tx=0).stop 2023-10-06T03:24:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.076+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1422158134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f015d8f0 msgr2=0x7f21f015ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.076+0000 7f21f6fb4700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f015d8f0 0x7f21f015ebd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f21e8002230 tx=0x7f21e8001b90 comp rx=0 tx=0).stop 2023-10-06T03:24:07.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-10-06T03:24:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7f9618047700 1 -- 172.21.15.84:0/21980651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95f0005830 con 0x7f961014ae50 2023-10-06T03:24:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7fcf2373b700 1 -- 172.21.15.84:0/3899528258 shutdown_connections 2023-10-06T03:24:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7fcf2373b700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf00067080 0x7fcf00069530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7fcf2373b700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0ac480 0x7fcf1c06a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7fcf2373b700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c068850 0x7fcf1c170550 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7fcf2373b700 1 --2- 172.21.15.84:0/3899528258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c068c20 0x7fcf1c176500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7fcf2373b700 1 -- 172.21.15.84:0/3899528258 >> 172.21.15.84:0/3899528258 conn(0x7fcf1c06de80 msgr2=0x7fcf1c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/3577901769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb1c005560 con 0x7fbb34159a60 2023-10-06T03:24:07.082 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T03:24:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7f9605ffb700 1 -- 172.21.15.84:0/21980651 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f960c017020 con 0x7f961014ae50 2023-10-06T03:24:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7fcf2373b700 1 -- 172.21.15.84:0/3899528258 shutdown_connections 2023-10-06T03:24:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7fcf2373b700 1 -- 172.21.15.84:0/3899528258 wait complete. 2023-10-06T03:24:07.084 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-10-06T03:24:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.079+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1422158134 shutdown_connections 2023-10-06T03:24:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.079+0000 7f21f6fb4700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21d4066f30 0x7f21d40693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.079+0000 7f21f6fb4700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f0068600 0x7f21f0138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.079+0000 7f21f6fb4700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f015d8f0 0x7f21f015ebd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.079+0000 7f21f6fb4700 1 --2- 172.21.15.84:0/1422158134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f00b1d50 0x7f21f015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.079+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1422158134 >> 172.21.15.84:0/1422158134 conn(0x7f21f006de80 msgr2=0x7f21f006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.079+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1422158134 shutdown_connections 2023-10-06T03:24:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.080+0000 7f21f6fb4700 1 -- 172.21.15.84:0/1422158134 wait complete. 2023-10-06T03:24:07.087 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-10-06T03:24:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.078+0000 7fbb327fc700 1 -- 172.21.15.84:0/3577901769 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb2002a020 con 0x7fbb34159a60 2023-10-06T03:24:07.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-10-06T03:24:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.081+0000 7f0d9db48700 1 -- 172.21.15.84:0/1802780172 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d84066fb0 msgr2=0x7f0d84069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.081+0000 7f0d9db48700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d84066fb0 0x7f0d84069460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c001050 tx=0x7f0d8c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.081+0000 7f0d9db48700 1 -- 172.21.15.84:0/1802780172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 msgr2=0x7f0d981415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.081+0000 7f0d9db48700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d981415c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0d90011580 tx=0x7f0d9000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.081+0000 7f9618047700 1 -- 172.21.15.84:0/21980651 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f95f4066f30 msgr2=0x7f95f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.081+0000 7f9618047700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f95f4066f30 0x7f95f40693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9600000ef0 tx=0x7f9600015000 comp rx=0 tx=0).stop 2023-10-06T03:24:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.081+0000 7f9618047700 1 -- 172.21.15.84:0/21980651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f961014ae50 msgr2=0x7f96101470e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.081+0000 7f9618047700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f961014ae50 0x7f96101470e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f960c00e820 tx=0x7f960c008040 comp rx=0 tx=0).stop 2023-10-06T03:24:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7f9618047700 1 -- 172.21.15.84:0/21980651 shutdown_connections 2023-10-06T03:24:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7f9618047700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7f9618047700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc003ae0 0x7f961014a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7f9618047700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9610147620 0x7f9610147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7f9618047700 1 --2- 172.21.15.84:0/21980651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f961014ae50 0x7f96101470e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7f9618047700 1 -- 172.21.15.84:0/21980651 >> 172.21.15.84:0/21980651 conn(0x7f961006de80 msgr2=0x7f96100ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7f9618047700 1 -- 172.21.15.84:0/21980651 shutdown_connections 2023-10-06T03:24:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/3577901769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb18067080 msgr2=0x7fbb18069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb18067080 0x7fbb18069530 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb280076c0 tx=0x7fbb2800b040 comp rx=0 tx=0).stop 2023-10-06T03:24:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/3577901769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb34159a60 msgr2=0x7fbb34154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb34159a60 0x7fbb34154640 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009ed0 tx=0x7fbb20017000 comp rx=0 tx=0).stop 2023-10-06T03:24:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7f9618047700 1 -- 172.21.15.84:0/21980651 wait complete. 2023-10-06T03:24:07.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/3577901769 shutdown_connections 2023-10-06T03:24:07.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb18067080 0x7fbb18069530 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb34069aa0 0x7fbb340c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb3415d920 0x7fbb340c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 --2- 172.21.15.84:0/3577901769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb34159a60 0x7fbb34154640 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/3577901769 >> 172.21.15.84:0/3577901769 conn(0x7fbb340680c0 msgr2=0x7fbb34157750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/3577901769 shutdown_connections 2023-10-06T03:24:07.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.082+0000 7fbb3c4d9700 1 -- 172.21.15.84:0/3577901769 wait complete. 2023-10-06T03:24:07.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.092+0000 7f0d9db48700 1 -- 172.21.15.84:0/1802780172 shutdown_connections 2023-10-06T03:24:07.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.092+0000 7f0d9db48700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d84066fb0 0x7f0d84069460 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.092+0000 7f0d9db48700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d98152130 0x7f0d981654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.092+0000 7f0d9db48700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d80004810 0x7f0d981415c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.092+0000 7f0d9db48700 1 --2- 172.21.15.84:0/1802780172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d98150620 0x7f0d98151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.092+0000 7f0d9db48700 1 -- 172.21.15.84:0/1802780172 >> 172.21.15.84:0/1802780172 conn(0x7f0d9806de80 msgr2=0x7f0d980ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.092+0000 7f0d9db48700 1 -- 172.21.15.84:0/1802780172 shutdown_connections 2023-10-06T03:24:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.092+0000 7f0d9db48700 1 -- 172.21.15.84:0/1802780172 wait complete. 2023-10-06T03:24:07.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.096+0000 7f0d4f04f700 1 -- 172.21.15.84:0/1966118014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0d4806e6c0 con 0x7f0d4815caf0 2023-10-06T03:24:07.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.097+0000 7f0d44ff9700 1 -- 172.21.15.84:0/1966118014 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d40055f60 con 0x7f0d4815caf0 2023-10-06T03:24:07.099 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-10-06T03:24:07.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-10-06T03:24:07.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.099+0000 7f0d4f04f700 1 -- 172.21.15.84:0/1966118014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d2c067080 msgr2=0x7f0d2c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.099+0000 7f0d4f04f700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d2c067080 0x7f0d2c069530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c008040 comp rx=0 tx=0).stop 2023-10-06T03:24:07.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.099+0000 7f0d4f04f700 1 -- 172.21.15.84:0/1966118014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d4815caf0 msgr2=0x7f0d4815b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.099+0000 7f0d4f04f700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d4815caf0 0x7f0d4815b930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009e90 tx=0x7f0d4000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:07.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.100+0000 7f0d4f04f700 1 -- 172.21.15.84:0/1966118014 shutdown_connections 2023-10-06T03:24:07.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.100+0000 7f0d4f04f700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0d2c067080 0x7f0d2c069530 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.100+0000 7f0d4f04f700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d480675f0 0x7f0d4816ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.100+0000 7f0d4f04f700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d4815caf0 0x7f0d4815b930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.100+0000 7f0d4f04f700 1 --2- 172.21.15.84:0/1966118014 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d480caad0 0x7f0d480c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.100+0000 7f0d4f04f700 1 -- 172.21.15.84:0/1966118014 >> 172.21.15.84:0/1966118014 conn(0x7f0d480cdef0 msgr2=0x7f0d480b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.101+0000 7f0d4f04f700 1 -- 172.21.15.84:0/1966118014 shutdown_connections 2023-10-06T03:24:07.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:07.101+0000 7f0d4f04f700 1 -- 172.21.15.84:0/1966118014 wait complete. 2023-10-06T03:24:07.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2023-10-06T03:24:07.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-10-06T03:24:07.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-10-06T03:24:07.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-10-06T03:24:07.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-10-06T03:24:08.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:24:08.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:24:08.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:24:08.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:24:08.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:24:08.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:24:08.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:24:08.116 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:24:08.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.263+0000 7fccb29da700 1 Processor -- start 2023-10-06T03:24:08.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.263+0000 7fccb29da700 1 -- start start 2023-10-06T03:24:08.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.265+0000 7fccb29da700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fccac155860 0x7fccac0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.265+0000 7fccb29da700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac0c82a0 0x7fccac069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.265+0000 7fccb29da700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac0c7e10 con 0x7fccac06e410 2023-10-06T03:24:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.265+0000 7fccb29da700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccac0acce0 con 0x7fccac155860 2023-10-06T03:24:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.265+0000 7fccb29da700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0aea00 con 0x7fccac0c82a0 2023-10-06T03:24:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.265+0000 7fccab7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac0c82a0 0x7fccac069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.265+0000 7fccab7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac0c82a0 0x7fccac069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55416/0 (socket says 172.21.15.84:55416) 2023-10-06T03:24:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.265+0000 7fccab7fe700 1 -- 172.21.15.84:0/1851055800 learned_addr learned my addr 172.21.15.84:0/1851055800 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.266+0000 7fccabfff700 1 --2- 172.21.15.84:0/1851055800 >> v2:172.21.15.84:3300/0 conn(0x7fccac155860 0x7fccac0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.267+0000 7fccab7fe700 1 -- 172.21.15.84:0/1851055800 >> v2:172.21.15.84:3300/0 conn(0x7fccac155860 msgr2=0x7fccac0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.267+0000 7fccab7fe700 1 --2- 172.21.15.84:0/1851055800 >> v2:172.21.15.84:3300/0 conn(0x7fccac155860 0x7fccac0ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.267+0000 7fccab7fe700 1 -- 172.21.15.84:0/1851055800 >> v1:172.21.15.84:6789/0 conn(0x7fccac06e410 legacy=0x7fccac06d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.267+0000 7fccab7fe700 1 -- 172.21.15.84:0/1851055800 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0c7200 con 0x7fccac0c82a0 2023-10-06T03:24:08.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.269+0000 7fccab7fe700 1 --2- 172.21.15.84:0/1851055800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac0c82a0 0x7fccac069560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009d10 tx=0x7fcca4009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48b2902c6365c388 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.269+0000 7fccaaffd700 1 -- 172.21.15.84:0/1851055800 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40092e0 con 0x7fccac0c82a0 2023-10-06T03:24:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.269+0000 7fccaaffd700 1 -- 172.21.15.84:0/1851055800 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca4010050 con 0x7fccac0c82a0 2023-10-06T03:24:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.269+0000 7fccaaffd700 1 -- 172.21.15.84:0/1851055800 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4010410 con 0x7fccac0c82a0 2023-10-06T03:24:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.270+0000 7fccb29da700 1 -- 172.21.15.84:0/1851055800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac0c82a0 msgr2=0x7fccac069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.270+0000 7fccb29da700 1 --2- 172.21.15.84:0/1851055800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac0c82a0 0x7fccac069560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009d10 tx=0x7fcca4009f90 comp rx=0 tx=0).stop 2023-10-06T03:24:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.271+0000 7fccb29da700 1 -- 172.21.15.84:0/1851055800 shutdown_connections 2023-10-06T03:24:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.271+0000 7fccb29da700 1 --2- 172.21.15.84:0/1851055800 >> v2:172.21.15.84:3300/0 conn(0x7fccac155860 0x7fccac0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.271+0000 7fccb29da700 1 --2- 172.21.15.84:0/1851055800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac0c82a0 0x7fccac069560 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.271+0000 7fccb29da700 1 -- 172.21.15.84:0/1851055800 >> 172.21.15.84:0/1851055800 conn(0x7fccac0680c0 msgr2=0x7fccac0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.271+0000 7fccb29da700 1 -- 172.21.15.84:0/1851055800 shutdown_connections 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.271+0000 7fccb29da700 1 -- 172.21.15.84:0/1851055800 wait complete. 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.273+0000 7fccb29da700 1 Processor -- start 2023-10-06T03:24:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.273+0000 7fccb29da700 1 -- start start 2023-10-06T03:24:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.274+0000 7fccb29da700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac06e410 0x7fccac0c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.274+0000 7fccb29da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccac0c82a0 0x7fccac147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.274+0000 7fccb29da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccac155860 0x7fccac0bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.274+0000 7fccb29da700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0c1100 con 0x7fccac0c82a0 2023-10-06T03:24:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.274+0000 7fccb29da700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0c04f0 con 0x7fccac155860 2023-10-06T03:24:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.274+0000 7fccb29da700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0c07d0 con 0x7fccac06e410 2023-10-06T03:24:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.275+0000 7fccab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccac0c82a0 0x7fccac147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.275+0000 7fccab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccac0c82a0 0x7fccac147700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34104/0 (socket says 172.21.15.84:34104) 2023-10-06T03:24:08.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.275+0000 7fccab7fe700 1 -- 172.21.15.84:0/1345082953 learned_addr learned my addr 172.21.15.84:0/1345082953 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.275+0000 7fccab7fe700 1 -- 172.21.15.84:0/1345082953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac06e410 msgr2=0x7fccac0c1590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:24:08.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.275+0000 7fccab7fe700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac06e410 0x7fccac0c1590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.275+0000 7fccab7fe700 1 -- 172.21.15.84:0/1345082953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccac155860 msgr2=0x7fccac0bfb80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:24:08.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.275+0000 7fccab7fe700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccac155860 0x7fccac0bfb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.275+0000 7fccab7fe700 1 -- 172.21.15.84:0/1345082953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca4009850 con 0x7fccac0c82a0 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.276+0000 7fccab7fe700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccac0c82a0 0x7fccac147700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fccac0bfb50 tx=0x7fcca401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.276+0000 7fcc93fff700 1 -- 172.21.15.84:0/1345082953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4010390 con 0x7fccac0c82a0 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.276+0000 7fcc93fff700 1 -- 172.21.15.84:0/1345082953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca4010990 con 0x7fccac0c82a0 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.276+0000 7fcc93fff700 1 -- 172.21.15.84:0/1345082953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4010d50 con 0x7fccac0c82a0 2023-10-06T03:24:08.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.276+0000 7fccb29da700 1 -- 172.21.15.84:0/1345082953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac0c0ab0 con 0x7fccac0c82a0 2023-10-06T03:24:08.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.276+0000 7fccb29da700 1 -- 172.21.15.84:0/1345082953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac0c1ad0 con 0x7fccac0c82a0 2023-10-06T03:24:08.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.280+0000 7fcc93fff700 1 -- 172.21.15.84:0/1345082953 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcca400f680 con 0x7fccac0c82a0 2023-10-06T03:24:08.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.280+0000 7fcc93fff700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc940671e0 0x7fcc94069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.281+0000 7fcc93fff700 1 -- 172.21.15.84:0/1345082953 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcca4086160 con 0x7fccac0c82a0 2023-10-06T03:24:08.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.282+0000 7fccabfff700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc940671e0 0x7fcc94069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.282+0000 7fccabfff700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc940671e0 0x7fcc94069690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009a80 tx=0x7fcc9c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.282+0000 7fccb29da700 1 -- 172.21.15.84:0/1345082953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc980052e0 con 0x7fccac0c82a0 2023-10-06T03:24:08.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.291+0000 7fcc93fff700 1 -- 172.21.15.84:0/1345082953 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcca4052f60 con 0x7fccac0c82a0 2023-10-06T03:24:08.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.327+0000 7f9780526700 1 Processor -- start 2023-10-06T03:24:08.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.327+0000 7f9780526700 1 -- start start 2023-10-06T03:24:08.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f9780526700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97781562c0 0x7f977815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f9780526700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9778068d10 0x7f97780abb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f9780526700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97780c9740 con 0x7f9778156690 2023-10-06T03:24:08.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f9780526700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977815b040 con 0x7f9778068d10 2023-10-06T03:24:08.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f9780526700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97780ad850 con 0x7f97781562c0 2023-10-06T03:24:08.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f977dac1700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9778156690 0x7f9778068600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:50860/0 (socket says 172.21.15.84:50860) 2023-10-06T03:24:08.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f977dac1700 1 -- 172.21.15.84:0/2328075784 learned_addr learned my addr 172.21.15.84:0/2328075784 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:08.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f977eac3700 1 --2- 172.21.15.84:0/2328075784 >> v2:172.21.15.131:3300/0 conn(0x7f9778068d10 0x7f97780abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.327+0000 7f54b19ac700 1 Processor -- start 2023-10-06T03:24:08.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.327+0000 7f54b19ac700 1 -- start start 2023-10-06T03:24:08.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f54b19ac700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f54ac06d550 0x7f54ac06d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f54b19ac700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f54ac0878f0 0x7f54ac069c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f54b19ac700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ac0c87c0 con 0x7f54ac0c8320 2023-10-06T03:24:08.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f54b19ac700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac0c8a20 con 0x7f54ac0878f0 2023-10-06T03:24:08.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f54b19ac700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac0c7080 con 0x7f54ac06d550 2023-10-06T03:24:08.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f54ab7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f54ac0878f0 0x7f54ac069c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f54ab7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f54ac0878f0 0x7f54ac069c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34108/0 (socket says 172.21.15.84:34108) 2023-10-06T03:24:08.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f54ab7fe700 1 -- 172.21.15.84:0/4095513573 learned_addr learned my addr 172.21.15.84:0/4095513573 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.328+0000 7f54aaffd700 1 --2- 172.21.15.84:0/4095513573 >> v2:172.21.15.131:3300/0 conn(0x7f54ac06d550 0x7f54ac06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f977e2c2700 1 --2- 172.21.15.84:0/2328075784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97781562c0 0x7f977815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f977eac3700 1 -- 172.21.15.84:0/2328075784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97781562c0 msgr2=0x7f977815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f977eac3700 1 --2- 172.21.15.84:0/2328075784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97781562c0 0x7f977815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f977eac3700 1 -- 172.21.15.84:0/2328075784 >> v1:172.21.15.131:6789/0 conn(0x7f9778156690 legacy=0x7f9778068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f977eac3700 1 -- 172.21.15.84:0/2328075784 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977815a7a0 con 0x7f9778068d10 2023-10-06T03:24:08.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f4190e69700 1 Processor -- start 2023-10-06T03:24:08.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f4190e69700 1 -- start start 2023-10-06T03:24:08.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f4190e69700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c0c82a0 0x7f418c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f4190e69700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0c7e10 con 0x7f418c06e410 2023-10-06T03:24:08.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f4190e69700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0c7200 con 0x7f418c155860 2023-10-06T03:24:08.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f4190e69700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0c74e0 con 0x7f418c0c82a0 2023-10-06T03:24:08.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f54a9ffb700 1 -- 172.21.15.84:0/4095513573 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193835956 0 0) 0x7f54ac0c87c0 con 0x7f54ac0c8320 2023-10-06T03:24:08.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f54a9ffb700 1 -- 172.21.15.84:0/4095513573 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5494003570 con 0x7f54ac0c8320 2023-10-06T03:24:08.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f54ab7fe700 1 -- 172.21.15.84:0/4095513573 >> v2:172.21.15.131:3300/0 conn(0x7f54ac06d550 msgr2=0x7f54ac06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f54ab7fe700 1 --2- 172.21.15.84:0/4095513573 >> v2:172.21.15.131:3300/0 conn(0x7f54ac06d550 0x7f54ac06d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f54ab7fe700 1 -- 172.21.15.84:0/4095513573 >> v1:172.21.15.84:6789/0 conn(0x7f54ac0c8320 legacy=0x7f54ac069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f54ab7fe700 1 -- 172.21.15.84:0/4095513573 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0aff00 con 0x7f54ac0878f0 2023-10-06T03:24:08.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f54ab7fe700 1 --2- 172.21.15.84:0/4095513573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54ac0878f0 0x7f54ac069c70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f54ac06cf40 tx=0x7f54a4007490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ffa4c62d399a49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f54a9ffb700 1 -- 172.21.15.84:0/4095513573 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400e070 con 0x7f54ac0878f0 2023-10-06T03:24:08.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f54a9ffb700 1 -- 172.21.15.84:0/4095513573 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400bbf0 con 0x7f54ac0878f0 2023-10-06T03:24:08.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f54a9ffb700 1 -- 172.21.15.84:0/4095513573 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4007850 con 0x7f54ac0878f0 2023-10-06T03:24:08.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f54b19ac700 1 -- 172.21.15.84:0/4095513573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54ac0878f0 msgr2=0x7f54ac069c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f54b19ac700 1 --2- 172.21.15.84:0/4095513573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54ac0878f0 0x7f54ac069c70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f54ac06cf40 tx=0x7f54a4007490 comp rx=0 tx=0).stop 2023-10-06T03:24:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f54b19ac700 1 -- 172.21.15.84:0/4095513573 shutdown_connections 2023-10-06T03:24:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f54b19ac700 1 --2- 172.21.15.84:0/4095513573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54ac0878f0 0x7f54ac069c70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f54b19ac700 1 --2- 172.21.15.84:0/4095513573 >> v2:172.21.15.131:3300/0 conn(0x7f54ac06d550 0x7f54ac06d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f54b19ac700 1 -- 172.21.15.84:0/4095513573 >> 172.21.15.84:0/4095513573 conn(0x7f54ac0680c0 msgr2=0x7f54ac0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f4189d9b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c0c82a0 0x7f418c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f4189d9b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c0c82a0 0x7f418c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55446/0 (socket says 172.21.15.84:55446) 2023-10-06T03:24:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f4189d9b700 1 -- 172.21.15.84:0/169151815 learned_addr learned my addr 172.21.15.84:0/169151815 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f418ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f418c06e410 0x7f418c0abcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48404/0 (socket says 172.21.15.84:48404) 2023-10-06T03:24:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f977eac3700 1 --2- 172.21.15.84:0/2328075784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9778068d10 0x7f97780abb50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9770009e60 tx=0x7f9770009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20ca676b0d6e4add server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f977d2c0700 1 -- 172.21.15.84:0/2328075784 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977000bb20 con 0x7f9778068d10 2023-10-06T03:24:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f54b19ac700 1 -- 172.21.15.84:0/4095513573 shutdown_connections 2023-10-06T03:24:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f977d2c0700 1 -- 172.21.15.84:0/2328075784 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977000bc80 con 0x7f9778068d10 2023-10-06T03:24:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f977d2c0700 1 -- 172.21.15.84:0/2328075784 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770011460 con 0x7f9778068d10 2023-10-06T03:24:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f4189d9b700 1 -- 172.21.15.84:0/169151815 >> v1:172.21.15.131:6789/0 conn(0x7f418c155860 legacy=0x7f418c0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f4189d9b700 1 -- 172.21.15.84:0/169151815 >> v1:172.21.15.84:6789/0 conn(0x7f418c06e410 legacy=0x7f418c0abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f418959a700 1 -- 172.21.15.84:0/169151815 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611716884 0 0) 0x7f418c0c7e10 con 0x7f418c06e410 2023-10-06T03:24:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f4189d9b700 1 -- 172.21.15.84:0/169151815 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0c77c0 con 0x7f418c0c82a0 2023-10-06T03:24:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f4189d9b700 1 --2- 172.21.15.84:0/169151815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c0c82a0 0x7f418c069560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f417c00d050 tx=0x7f417c0082d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d744d0c270d21fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7fd524288700 1 Processor -- start 2023-10-06T03:24:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7fd524288700 1 -- start start 2023-10-06T03:24:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f418959a700 1 -- 172.21.15.84:0/169151815 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c010070 con 0x7f418c0c82a0 2023-10-06T03:24:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f418959a700 1 -- 172.21.15.84:0/169151815 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c00db20 con 0x7f418c0c82a0 2023-10-06T03:24:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f418959a700 1 -- 172.21.15.84:0/169151815 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c016440 con 0x7f418c0c82a0 2023-10-06T03:24:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd524288700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd51c0c89b0 0x7fd51c0c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd524288700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c069560 0x7fd51c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd524288700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd51c0ce710 0x7fd51c15e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd524288700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c0c92c0 con 0x7fd51c0ce710 2023-10-06T03:24:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd524288700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c0ceb90 con 0x7fd51c0c89b0 2023-10-06T03:24:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd524288700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0690d0 con 0x7fd51c069560 2023-10-06T03:24:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd522024700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd51c0c89b0 0x7fd51c0c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd522024700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd51c0c89b0 0x7fd51c0c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56670/0 (socket says 172.21.15.84:56670) 2023-10-06T03:24:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd522024700 1 -- 172.21.15.84:0/1117596261 learned_addr learned my addr 172.21.15.84:0/1117596261 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd521823700 1 --2- 172.21.15.84:0/1117596261 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c069560 0x7fd51c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f54b19ac700 1 -- 172.21.15.84:0/4095513573 wait complete. 2023-10-06T03:24:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f54b19ac700 1 Processor -- start 2023-10-06T03:24:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f54b19ac700 1 -- start start 2023-10-06T03:24:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd522825700 1 --2- 172.21.15.84:0/1117596261 >> v2:172.21.15.84:3300/0 conn(0x7fd51c0ce710 0x7fd51c15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd522024700 1 -- 172.21.15.84:0/1117596261 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c069560 msgr2=0x7fd51c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd522024700 1 --2- 172.21.15.84:0/1117596261 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c069560 0x7fd51c0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd522024700 1 -- 172.21.15.84:0/1117596261 >> v2:172.21.15.84:3300/0 conn(0x7fd51c0ce710 msgr2=0x7fd51c15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd522024700 1 --2- 172.21.15.84:0/1117596261 >> v2:172.21.15.84:3300/0 conn(0x7fd51c0ce710 0x7fd51c15e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7fd522024700 1 -- 172.21.15.84:0/1117596261 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c15ed70 con 0x7fd51c0c89b0 2023-10-06T03:24:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f4190e69700 1 -- 172.21.15.84:0/169151815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c0c82a0 msgr2=0x7f418c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f4190e69700 1 --2- 172.21.15.84:0/169151815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c0c82a0 0x7f418c069560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f417c00d050 tx=0x7f417c0082d0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f9780526700 1 -- 172.21.15.84:0/2328075784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9778068d10 msgr2=0x7f97780abb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f9780526700 1 --2- 172.21.15.84:0/2328075784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9778068d10 0x7f97780abb50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9770009e60 tx=0x7f9770009780 comp rx=0 tx=0).stop 2023-10-06T03:24:08.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7fd522024700 1 --2- 172.21.15.84:0/1117596261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0c89b0 0x7fd51c0c8d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0cdfb0 tx=0x7fd50c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e1e27db631d9af7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f4190e69700 1 -- 172.21.15.84:0/169151815 shutdown_connections 2023-10-06T03:24:08.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f201ffff700 1 Processor -- start 2023-10-06T03:24:08.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.329+0000 7f201ffff700 1 -- start start 2023-10-06T03:24:08.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f4190e69700 1 --2- 172.21.15.84:0/169151815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c0c82a0 0x7f418c069560 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f4190e69700 1 -- 172.21.15.84:0/169151815 >> 172.21.15.84:0/169151815 conn(0x7f418c0680c0 msgr2=0x7f418c0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f201ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f202015d5f0 0x7f202006d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f201ffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202006a000 con 0x7f20200c9fe0 2023-10-06T03:24:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f201ffff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20200693f0 con 0x7f202015d9c0 2023-10-06T03:24:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f201ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20200696d0 con 0x7f202015d5f0 2023-10-06T03:24:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f201effd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f202015d5f0 0x7f202006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f201f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f20200c9fe0 0x7f20200c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48402/0 (socket says 172.21.15.84:48402) 2023-10-06T03:24:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f201e7fc700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f202015d9c0 0x7f202006a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:50870/0 (socket says 172.21.15.84:50870) 2023-10-06T03:24:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f201f7fe700 1 -- 172.21.15.84:0/1285616 learned_addr learned my addr 172.21.15.84:0/1285616 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f201effd700 1 -- 172.21.15.84:0/1285616 >> v1:172.21.15.131:6789/0 conn(0x7f202015d9c0 legacy=0x7f202006a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f201dffb700 1 -- 172.21.15.84:0/1285616 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065425369 0 0) 0x7f20200693f0 con 0x7f202015d9c0 2023-10-06T03:24:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f201effd700 1 -- 172.21.15.84:0/1285616 >> v1:172.21.15.84:6789/0 conn(0x7f20200c9fe0 legacy=0x7f20200c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f201effd700 1 -- 172.21.15.84:0/1285616 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20200699b0 con 0x7f202015d5f0 2023-10-06T03:24:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f201effd700 1 --2- 172.21.15.84:0/1285616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f202015d5f0 0x7f202006d250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2010009910 tx=0x7f20100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68c9c7968b7768bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f201dffb700 1 -- 172.21.15.84:0/1285616 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000b760 con 0x7f202015d5f0 2023-10-06T03:24:08.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f201dffb700 1 -- 172.21.15.84:0/1285616 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201000b8c0 con 0x7f202015d5f0 2023-10-06T03:24:08.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f201dffb700 1 -- 172.21.15.84:0/1285616 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000bc60 con 0x7f202015d5f0 2023-10-06T03:24:08.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f4190e69700 1 -- 172.21.15.84:0/169151815 shutdown_connections 2023-10-06T03:24:08.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7fd521022700 1 -- 172.21.15.84:0/1117596261 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c009e70 con 0x7fd51c0c89b0 2023-10-06T03:24:08.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7fd521022700 1 -- 172.21.15.84:0/1117596261 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00b860 con 0x7fd51c0c89b0 2023-10-06T03:24:08.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7fd521022700 1 -- 172.21.15.84:0/1117596261 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00bbe0 con 0x7fd51c0c89b0 2023-10-06T03:24:08.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.330+0000 7f39a94fa700 1 Processor -- start 2023-10-06T03:24:08.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.331+0000 7f39a94fa700 1 -- start start 2023-10-06T03:24:08.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f39a94fa700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39a406d550 0x7f39a406d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f39a94fa700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f39a40c8320 0x7f39a40878f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f39a94fa700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a4087e30 con 0x7f39a4069560 2023-10-06T03:24:08.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f39a94fa700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a40c8a20 con 0x7f39a406d550 2023-10-06T03:24:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f39a94fa700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a40c7080 con 0x7f39a40c8320 2023-10-06T03:24:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f39a27fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f39a40c8320 0x7f39a40878f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f39a27fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f39a40c8320 0x7f39a40878f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56658/0 (socket says 172.21.15.84:56658) 2023-10-06T03:24:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.332+0000 7f39a27fc700 1 -- 172.21.15.84:0/944962218 learned_addr learned my addr 172.21.15.84:0/944962218 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f39a2ffd700 1 --2- 172.21.15.84:0/944962218 >> v2:172.21.15.84:3300/0 conn(0x7f39a406d550 0x7f39a406d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.333+0000 7f39a1ffb700 1 -- 172.21.15.84:0/944962218 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374089473 0 0) 0x7f399c0014e0 con 0x7f39a4069560 2023-10-06T03:24:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f39a1ffb700 1 -- 172.21.15.84:0/944962218 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c003570 con 0x7f39a4069560 2023-10-06T03:24:08.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f54b19ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54ac06d550 0x7f54ac0ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f54b19ac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54ac0878f0 0x7f54ac176d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f54b19ac700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54ac0c8320 0x7f54ac177280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f54b19ac700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0aa470 con 0x7f54ac06d550 2023-10-06T03:24:08.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f54b19ac700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac1777c0 con 0x7f54ac0878f0 2023-10-06T03:24:08.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f54b19ac700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0abc60 con 0x7f54ac0c8320 2023-10-06T03:24:08.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f39a2ffd700 1 -- 172.21.15.84:0/944962218 >> v2:172.21.15.131:3300/0 conn(0x7f39a40c8320 msgr2=0x7f39a40878f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f39a2ffd700 1 --2- 172.21.15.84:0/944962218 >> v2:172.21.15.131:3300/0 conn(0x7f39a40c8320 0x7f39a40878f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f39a2ffd700 1 -- 172.21.15.84:0/944962218 >> v1:172.21.15.84:6789/0 conn(0x7f39a4069560 legacy=0x7f39a4069960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f39a2ffd700 1 -- 172.21.15.84:0/944962218 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a40c87c0 con 0x7f39a406d550 2023-10-06T03:24:08.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f201ffff700 1 -- 172.21.15.84:0/1285616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f202015d5f0 msgr2=0x7f202006d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f201ffff700 1 --2- 172.21.15.84:0/1285616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f202015d5f0 0x7f202006d250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2010009910 tx=0x7f20100091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f39a27fc700 1 --2- 172.21.15.84:0/944962218 >> v2:172.21.15.131:3300/0 conn(0x7f39a40c8320 0x7f39a40878f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:08.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.334+0000 7f4190e69700 1 -- 172.21.15.84:0/169151815 wait complete. 2023-10-06T03:24:08.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54aa7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54ac0878f0 0x7f54ac176d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54aa7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54ac0878f0 0x7f54ac176d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56672/0 (socket says 172.21.15.84:56672) 2023-10-06T03:24:08.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54aa7fc700 1 -- 172.21.15.84:0/3942681537 learned_addr learned my addr 172.21.15.84:0/3942681537 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54ab7fe700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54ac0c8320 0x7f54ac177280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54aaffd700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54ac06d550 0x7f54ac0ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54aa7fc700 1 -- 172.21.15.84:0/3942681537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54ac0c8320 msgr2=0x7f54ac177280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7fd524288700 1 -- 172.21.15.84:0/1117596261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0c89b0 msgr2=0x7fd51c0c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7fd524288700 1 --2- 172.21.15.84:0/1117596261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0c89b0 0x7fd51c0c8d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0cdfb0 tx=0x7fd50c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:08.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7fd524288700 1 -- 172.21.15.84:0/1117596261 shutdown_connections 2023-10-06T03:24:08.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7fd524288700 1 --2- 172.21.15.84:0/1117596261 >> v2:172.21.15.84:3300/0 conn(0x7fd51c0ce710 0x7fd51c15e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7fd524288700 1 --2- 172.21.15.84:0/1117596261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0c89b0 0x7fd51c0c8d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7fd524288700 1 --2- 172.21.15.84:0/1117596261 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c069560 0x7fd51c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7fd524288700 1 -- 172.21.15.84:0/1117596261 >> 172.21.15.84:0/1117596261 conn(0x7fd51c070810 msgr2=0x7fd51c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f39a2ffd700 1 --2- 172.21.15.84:0/944962218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a406d550 0x7f39a406d920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f39a4064fe0 tx=0x7f3994009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39e2a1edb49d5fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f9780526700 1 -- 172.21.15.84:0/2328075784 shutdown_connections 2023-10-06T03:24:08.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f9780526700 1 --2- 172.21.15.84:0/2328075784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9778068d10 0x7f97780abb50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f9780526700 1 --2- 172.21.15.84:0/2328075784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97781562c0 0x7f977815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f9780526700 1 -- 172.21.15.84:0/2328075784 >> 172.21.15.84:0/2328075784 conn(0x7f977806de80 msgr2=0x7f977806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f201ffff700 1 -- 172.21.15.84:0/1285616 shutdown_connections 2023-10-06T03:24:08.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f201ffff700 1 --2- 172.21.15.84:0/1285616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f202015d5f0 0x7f202006d250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f201ffff700 1 -- 172.21.15.84:0/1285616 >> 172.21.15.84:0/1285616 conn(0x7f20200680c0 msgr2=0x7f20200cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f201ffff700 1 -- 172.21.15.84:0/1285616 shutdown_connections 2023-10-06T03:24:08.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f201ffff700 1 -- 172.21.15.84:0/1285616 wait complete. 2023-10-06T03:24:08.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54aa7fc700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54ac0c8320 0x7f54ac177280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54aa7fc700 1 -- 172.21.15.84:0/3942681537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54ac06d550 msgr2=0x7f54ac0ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54aa7fc700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54ac06d550 0x7f54ac0ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54aa7fc700 1 -- 172.21.15.84:0/3942681537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a4009b20 con 0x7f54ac0878f0 2023-10-06T03:24:08.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f39a1ffb700 1 -- 172.21.15.84:0/944962218 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399400c690 con 0x7f39a406d550 2023-10-06T03:24:08.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f39a1ffb700 1 -- 172.21.15.84:0/944962218 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399400c7f0 con 0x7f39a406d550 2023-10-06T03:24:08.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f39a1ffb700 1 -- 172.21.15.84:0/944962218 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399400cb70 con 0x7f39a406d550 2023-10-06T03:24:08.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.335+0000 7f54aa7fc700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54ac0878f0 0x7f54ac176d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f54a000c790 tx=0x7f54a0007e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.336+0000 7f5492ffd700 1 -- 172.21.15.84:0/3942681537 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0010510 con 0x7f54ac0878f0 2023-10-06T03:24:08.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.336+0000 7f4190e69700 1 Processor -- start 2023-10-06T03:24:08.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.336+0000 7f5492ffd700 1 -- 172.21.15.84:0/3942681537 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a0010670 con 0x7f54ac0878f0 2023-10-06T03:24:08.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.336+0000 7f5492ffd700 1 -- 172.21.15.84:0/3942681537 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0010a30 con 0x7f54ac0878f0 2023-10-06T03:24:08.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.336+0000 7f54b19ac700 1 -- 172.21.15.84:0/3942681537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac1749c0 con 0x7f54ac0878f0 2023-10-06T03:24:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.336+0000 7f54b19ac700 1 -- 172.21.15.84:0/3942681537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ac0aa190 con 0x7f54ac0878f0 2023-10-06T03:24:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.336+0000 7f39a94fa700 1 -- 172.21.15.84:0/944962218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a406d550 msgr2=0x7f39a406d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.336+0000 7f39a94fa700 1 --2- 172.21.15.84:0/944962218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a406d550 0x7f39a406d920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f39a4064fe0 tx=0x7f3994009a30 comp rx=0 tx=0).stop 2023-10-06T03:24:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.336+0000 7f9780526700 1 -- 172.21.15.84:0/2328075784 shutdown_connections 2023-10-06T03:24:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.336+0000 7f4190e69700 1 -- start start 2023-10-06T03:24:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f4190e69700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c06e410 0x7f418c148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f4190e69700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f418c0c82a0 0x7f418c158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f4190e69700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f418c155860 0x7f418c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f4190e69700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c157570 con 0x7f418c155860 2023-10-06T03:24:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f4190e69700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0ae870 con 0x7f418c0c82a0 2023-10-06T03:24:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f4190e69700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c148aa0 con 0x7f418c06e410 2023-10-06T03:24:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f9780526700 1 -- 172.21.15.84:0/2328075784 wait complete. 2023-10-06T03:24:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f418a59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c06e410 0x7f418c148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f418a59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c06e410 0x7f418c148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55460/0 (socket says 172.21.15.84:55460) 2023-10-06T03:24:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f418a59c700 1 -- 172.21.15.84:0/1825533902 learned_addr learned my addr 172.21.15.84:0/1825533902 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f418ad9d700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f418c155860 0x7f418c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7fd524288700 1 -- 172.21.15.84:0/1117596261 shutdown_connections 2023-10-06T03:24:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f418a59c700 1 -- 172.21.15.84:0/1825533902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f418c0c82a0 msgr2=0x7f418c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f418a59c700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f418c0c82a0 0x7f418c158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f418a59c700 1 -- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f418c155860 msgr2=0x7f418c157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f418a59c700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f418c155860 0x7f418c157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f418a59c700 1 -- 172.21.15.84:0/1825533902 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c008570 con 0x7f418c06e410 2023-10-06T03:24:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f418ad9d700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f418c155860 0x7f418c157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f39a94fa700 1 -- 172.21.15.84:0/944962218 shutdown_connections 2023-10-06T03:24:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f39a94fa700 1 --2- 172.21.15.84:0/944962218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a406d550 0x7f39a406d920 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f39a94fa700 1 --2- 172.21.15.84:0/944962218 >> v2:172.21.15.131:3300/0 conn(0x7f39a40c8320 0x7f39a40878f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f39a94fa700 1 -- 172.21.15.84:0/944962218 >> 172.21.15.84:0/944962218 conn(0x7f39a40680c0 msgr2=0x7f39a40cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f39a94fa700 1 -- 172.21.15.84:0/944962218 shutdown_connections 2023-10-06T03:24:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f418a59c700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c06e410 0x7f418c148560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f418000b5e0 tx=0x7f41800090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f39a94fa700 1 -- 172.21.15.84:0/944962218 wait complete. 2023-10-06T03:24:08.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f9780526700 1 Processor -- start 2023-10-06T03:24:08.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f9780526700 1 -- start start 2023-10-06T03:24:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f5492ffd700 1 -- 172.21.15.84:0/3942681537 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54a001b3b0 con 0x7f54ac0878f0 2023-10-06T03:24:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f5492ffd700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5498066f00 0x7f54980693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f5492ffd700 1 -- 172.21.15.84:0/3942681537 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f54a0084260 con 0x7f54ac0878f0 2023-10-06T03:24:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f54aaffd700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5498066f00 0x7f54980693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f9780526700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9778068d10 0x7f97780ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f9780526700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97781562c0 0x7f977806aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f9780526700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9778156690 0x7f9778140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f9780526700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97780aa7d0 con 0x7f9778156690 2023-10-06T03:24:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f9780526700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97780aba10 con 0x7f97781562c0 2023-10-06T03:24:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f9780526700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97780a98e0 con 0x7f9778068d10 2023-10-06T03:24:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f977e2c2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9778068d10 0x7f97780ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f977e2c2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9778068d10 0x7f97780ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55480/0 (socket says 172.21.15.84:55480) 2023-10-06T03:24:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f977e2c2700 1 -- 172.21.15.84:0/3429442512 learned_addr learned my addr 172.21.15.84:0/3429442512 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f39a94fa700 1 Processor -- start 2023-10-06T03:24:08.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f977e2c2700 1 -- 172.21.15.84:0/3429442512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97781562c0 msgr2=0x7f977806aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:24:08.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f977e2c2700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97781562c0 0x7f977806aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f977e2c2700 1 -- 172.21.15.84:0/3429442512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9778156690 msgr2=0x7f9778140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f977e2c2700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9778156690 0x7f9778140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f977e2c2700 1 -- 172.21.15.84:0/3429442512 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770009a20 con 0x7f9778068d10 2023-10-06T03:24:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f54aaffd700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5498066f00 0x7f54980693b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f549c007ab0 tx=0x7f549c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f417a7fc700 1 -- 172.21.15.84:0/1825533902 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000f510 con 0x7f418c06e410 2023-10-06T03:24:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f417a7fc700 1 -- 172.21.15.84:0/1825533902 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000f690 con 0x7f418c06e410 2023-10-06T03:24:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f4190e69700 1 -- 172.21.15.84:0/1825533902 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c16ef10 con 0x7f418c06e410 2023-10-06T03:24:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f4190e69700 1 -- 172.21.15.84:0/1825533902 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c157200 con 0x7f418c06e410 2023-10-06T03:24:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f977e2c2700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9778068d10 0x7f97780ab4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f977400ec80 tx=0x7f9774009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f417a7fc700 1 -- 172.21.15.84:0/1825533902 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000fa50 con 0x7f418c06e410 2023-10-06T03:24:08.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.340+0000 7f39a94fa700 1 -- start start 2023-10-06T03:24:08.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f39a94fa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39a4069560 0x7f39a40a7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f39a94fa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39a406d550 0x7f39a40a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f39a94fa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a40c8320 0x7f39a40ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f39a94fa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40ab750 con 0x7f39a40c8320 2023-10-06T03:24:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f39a94fa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40ab9f0 con 0x7f39a4069560 2023-10-06T03:24:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f39a94fa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40abcd0 con 0x7f39a406d550 2023-10-06T03:24:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f39a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a40c8320 0x7f39a40ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f39a2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39a4069560 0x7f39a40a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f39a2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39a4069560 0x7f39a40a7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56706/0 (socket says 172.21.15.84:56706) 2023-10-06T03:24:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f39a2ffd700 1 -- 172.21.15.84:0/1321880808 learned_addr learned my addr 172.21.15.84:0/1321880808 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.342+0000 7f4190e69700 1 -- 172.21.15.84:0/1825533902 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41700052b0 con 0x7f418c06e410 2023-10-06T03:24:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.343+0000 7f417a7fc700 1 -- 172.21.15.84:0/1825533902 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f418001a400 con 0x7f418c06e410 2023-10-06T03:24:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f54b19ac700 1 -- 172.21.15.84:0/3942681537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ac0c8160 con 0x7f54ac0878f0 2023-10-06T03:24:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.343+0000 7f39a2ffd700 1 -- 172.21.15.84:0/1321880808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39a406d550 msgr2=0x7f39a40a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.343+0000 7f39a2ffd700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39a406d550 0x7f39a40a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.343+0000 7f39a2ffd700 1 -- 172.21.15.84:0/1321880808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a40c8320 msgr2=0x7f39a40ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.343+0000 7f39a2ffd700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a40c8320 0x7f39a40ac7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.343+0000 7f39a2ffd700 1 -- 172.21.15.84:0/1321880808 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3998007040 con 0x7f39a4069560 2023-10-06T03:24:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.343+0000 7f39a2ffd700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39a4069560 0x7f39a40a7120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3994009a70 tx=0x7f3994018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.342+0000 7f976e7fc700 1 -- 172.21.15.84:0/3429442512 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400c9d0 con 0x7f9778068d10 2023-10-06T03:24:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.342+0000 7f976e7fc700 1 -- 172.21.15.84:0/3429442512 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400cb30 con 0x7f9778068d10 2023-10-06T03:24:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.342+0000 7f976e7fc700 1 -- 172.21.15.84:0/3429442512 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774013470 con 0x7f9778068d10 2023-10-06T03:24:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.342+0000 7f9780526700 1 -- 172.21.15.84:0/3429442512 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97780a9bc0 con 0x7f9778068d10 2023-10-06T03:24:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.342+0000 7f9780526700 1 -- 172.21.15.84:0/3429442512 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97780aa180 con 0x7f9778068d10 2023-10-06T03:24:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f201ffff700 1 Processor -- start 2023-10-06T03:24:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.337+0000 7f201ffff700 1 -- start start 2023-10-06T03:24:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f201ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200c9fe0 0x7f2020148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f201ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202015d5f0 0x7f202014cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f201ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f202015d9c0 0x7f202014d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f201ffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20200c6220 con 0x7f202015d5f0 2023-10-06T03:24:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f201ffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202014fee0 con 0x7f20200c9fe0 2023-10-06T03:24:08.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f201ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202014e0b0 con 0x7f202015d9c0 2023-10-06T03:24:08.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f201e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202015d5f0 0x7f202014cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f201e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202015d5f0 0x7f202014cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34142/0 (socket says 172.21.15.84:34142) 2023-10-06T03:24:08.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f201e7fc700 1 -- 172.21.15.84:0/3251016395 learned_addr learned my addr 172.21.15.84:0/3251016395 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.338+0000 7f201effd700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200c9fe0 0x7f2020148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f201e7fc700 1 -- 172.21.15.84:0/3251016395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f202015d9c0 msgr2=0x7f202014d440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:24:08.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f201e7fc700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f202015d9c0 0x7f202014d440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f201e7fc700 1 -- 172.21.15.84:0/3251016395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200c9fe0 msgr2=0x7f2020148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f201e7fc700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200c9fe0 0x7f2020148b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f201e7fc700 1 -- 172.21.15.84:0/3251016395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2010009420 con 0x7f202015d5f0 2023-10-06T03:24:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f201effd700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200c9fe0 0x7f2020148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f201e7fc700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202015d5f0 0x7f202014cf00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f201400c5d0 tx=0x7f2014007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f2006ffd700 1 -- 172.21.15.84:0/3251016395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014005a70 con 0x7f202015d5f0 2023-10-06T03:24:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f2006ffd700 1 -- 172.21.15.84:0/3251016395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2014005bd0 con 0x7f202015d5f0 2023-10-06T03:24:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f2006ffd700 1 -- 172.21.15.84:0/3251016395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20140070d0 con 0x7f202015d5f0 2023-10-06T03:24:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f201ffff700 1 -- 172.21.15.84:0/3251016395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202014e390 con 0x7f202015d5f0 2023-10-06T03:24:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.339+0000 7f201ffff700 1 -- 172.21.15.84:0/3251016395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20201490d0 con 0x7f202015d5f0 2023-10-06T03:24:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.341+0000 7f201ffff700 1 -- 172.21.15.84:0/3251016395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2020150370 con 0x7f202015d5f0 2023-10-06T03:24:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.344+0000 7f417a7fc700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f416c067080 0x7f416c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.342+0000 7fd524288700 1 -- 172.21.15.84:0/1117596261 wait complete. 2023-10-06T03:24:08.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.344+0000 7f417a7fc700 1 -- 172.21.15.84:0/1825533902 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4180084440 con 0x7f418c06e410 2023-10-06T03:24:08.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.344+0000 7f976e7fc700 1 -- 172.21.15.84:0/3429442512 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9774013820 con 0x7f9778068d10 2023-10-06T03:24:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.344+0000 7fd524288700 1 Processor -- start 2023-10-06T03:24:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.344+0000 7fd524288700 1 -- start start 2023-10-06T03:24:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.344+0000 7ff40d018700 1 Processor -- start 2023-10-06T03:24:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.344+0000 7ff40d018700 1 -- start start 2023-10-06T03:24:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.344+0000 7f976e7fc700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f975c067000 0x7f975c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.344+0000 7f976e7fc700 1 -- 172.21.15.84:0/3429442512 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9774085040 con 0x7f9778068d10 2023-10-06T03:24:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7fd524288700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c069560 0x7fd51c0c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7fd524288700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c0c89b0 0x7fd51c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7fd524288700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0ce710 0x7fd51c15cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7fd524288700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c14bc80 con 0x7fd51c069560 2023-10-06T03:24:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7fd524288700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c14c110 con 0x7fd51c0ce710 2023-10-06T03:24:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7fd524288700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c14b070 con 0x7fd51c0c89b0 2023-10-06T03:24:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7ff40d018700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff408087570 0x7ff408069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7ff40d018700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 0x7ff40816c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7ff40d018700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff408069ec0 con 0x7ff40816eb90 2023-10-06T03:24:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7ff40d018700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40816bfa0 con 0x7ff408087570 2023-10-06T03:24:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7ff40d018700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40816b390 con 0x7ff408069aa0 2023-10-06T03:24:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7f2006ffd700 1 -- 172.21.15.84:0/3251016395 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20140074c0 con 0x7f202015d5f0 2023-10-06T03:24:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7f2006ffd700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f200c067080 0x7f200c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7f2006ffd700 1 -- 172.21.15.84:0/3251016395 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2014084090 con 0x7f202015d5f0 2023-10-06T03:24:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7f201effd700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f200c067080 0x7f200c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7ff40759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 0x7ff40816c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7f9780526700 1 -- 172.21.15.84:0/3429442512 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97600052b0 con 0x7f9778068d10 2023-10-06T03:24:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7f977dac1700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f975c067000 0x7f975c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7ff40759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 0x7ff40816c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55508/0 (socket says 172.21.15.84:55508) 2023-10-06T03:24:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7ff40759e700 1 -- 172.21.15.84:0/4065416915 learned_addr learned my addr 172.21.15.84:0/4065416915 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7fd522825700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0ce710 0x7fd51c15cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7fd522825700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0ce710 0x7fd51c15cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56710/0 (socket says 172.21.15.84:56710) 2023-10-06T03:24:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7fd522825700 1 -- 172.21.15.84:0/785246314 learned_addr learned my addr 172.21.15.84:0/785246314 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7fd521823700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c0c89b0 0x7fd51c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7fd522024700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c069560 0x7fd51c0c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7fd522825700 1 -- 172.21.15.84:0/785246314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c0c89b0 msgr2=0x7fd51c15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7fd522825700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c0c89b0 0x7fd51c15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7fd522825700 1 -- 172.21.15.84:0/785246314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c069560 msgr2=0x7fd51c0c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7fd522825700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c069560 0x7fd51c0c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.345+0000 7ff40659c700 1 --2- 172.21.15.84:0/4065416915 >> v2:172.21.15.84:3300/0 conn(0x7ff408087570 0x7ff408069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7ff40759e700 1 -- 172.21.15.84:0/4065416915 >> v2:172.21.15.84:3300/0 conn(0x7ff408087570 msgr2=0x7ff408069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7ff40759e700 1 --2- 172.21.15.84:0/4065416915 >> v2:172.21.15.84:3300/0 conn(0x7ff408087570 0x7ff408069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7ff40759e700 1 -- 172.21.15.84:0/4065416915 >> v1:172.21.15.84:6789/0 conn(0x7ff40816eb90 legacy=0x7ff40816ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7ff40759e700 1 -- 172.21.15.84:0/4065416915 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40816b670 con 0x7ff408069aa0 2023-10-06T03:24:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7ff40659c700 1 --2- 172.21.15.84:0/4065416915 >> v2:172.21.15.84:3300/0 conn(0x7ff408087570 0x7ff408069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7f201effd700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f200c067080 0x7f200c069530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f20100030c0 tx=0x7f2010016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7fd522825700 1 -- 172.21.15.84:0/785246314 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c0094f0 con 0x7fd51c0ce710 2023-10-06T03:24:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7fd521823700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c0c89b0 0x7fd51c15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7ff40759e700 1 --2- 172.21.15.84:0/4065416915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 0x7ff40816c6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff400009f20 tx=0x7ff400009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4700bd21e7006142 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7f977dac1700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f975c067000 0x7f975c0694b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f97781579f0 tx=0x7f9768006be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7fd522825700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0ce710 0x7fd51c15cd30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd51800d890 tx=0x7fd518008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7f398affd700 1 -- 172.21.15.84:0/1321880808 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399400c960 con 0x7f39a4069560 2023-10-06T03:24:08.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7f398affd700 1 -- 172.21.15.84:0/1321880808 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399400c050 con 0x7f39a4069560 2023-10-06T03:24:08.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7f39a94fa700 1 -- 172.21.15.84:0/1321880808 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3994009cb0 con 0x7f39a4069560 2023-10-06T03:24:08.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7f398affd700 1 -- 172.21.15.84:0/1321880808 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994023b20 con 0x7f39a4069560 2023-10-06T03:24:08.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7f39a94fa700 1 -- 172.21.15.84:0/1321880808 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a40ac290 con 0x7f39a4069560 2023-10-06T03:24:08.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.346+0000 7f5492ffd700 1 -- 172.21.15.84:0/3942681537 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54a0051060 con 0x7f54ac0878f0 2023-10-06T03:24:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.347+0000 7fd5127fc700 1 -- 172.21.15.84:0/785246314 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180125f0 con 0x7fd51c0ce710 2023-10-06T03:24:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.347+0000 7fd5127fc700 1 -- 172.21.15.84:0/785246314 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd518012770 con 0x7fd51c0ce710 2023-10-06T03:24:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.347+0000 7fd5127fc700 1 -- 172.21.15.84:0/785246314 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518012b30 con 0x7fd51c0ce710 2023-10-06T03:24:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.347+0000 7fd524288700 1 -- 172.21.15.84:0/785246314 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c14b350 con 0x7fd51c0ce710 2023-10-06T03:24:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.347+0000 7fd524288700 1 -- 172.21.15.84:0/785246314 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c14b910 con 0x7fd51c0ce710 2023-10-06T03:24:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.347+0000 7f39a94fa700 1 -- 172.21.15.84:0/1321880808 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a4064ad0 con 0x7f39a4069560 2023-10-06T03:24:08.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.348+0000 7f417a7fc700 1 -- 172.21.15.84:0/1825533902 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4180054d50 con 0x7f418c06e410 2023-10-06T03:24:08.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.348+0000 7f398affd700 1 -- 172.21.15.84:0/1321880808 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39940103f0 con 0x7f39a4069560 2023-10-06T03:24:08.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.348+0000 7fd524288700 1 -- 172.21.15.84:0/785246314 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c064ad0 con 0x7fd51c0ce710 2023-10-06T03:24:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.349+0000 7f4189d9b700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f416c067080 0x7f416c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.349+0000 7f398affd700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3990066f30 0x7f39900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.349+0000 7f398affd700 1 -- 172.21.15.84:0/1321880808 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f399408e0f0 con 0x7f39a4069560 2023-10-06T03:24:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.349+0000 7f2006ffd700 1 -- 172.21.15.84:0/3251016395 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2014050fc0 con 0x7f202015d5f0 2023-10-06T03:24:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.349+0000 7f4189d9b700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f416c067080 0x7f416c069530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f417c00d050 tx=0x7f417c01b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.349+0000 7f39a27fc700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3990066f30 0x7f39900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.349+0000 7fd5127fc700 1 -- 172.21.15.84:0/785246314 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd51801e460 con 0x7fd51c0ce710 2023-10-06T03:24:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.349+0000 7fd5127fc700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd500067000 0x7fd5000694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.349+0000 7fd5127fc700 1 -- 172.21.15.84:0/785246314 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd518084ef0 con 0x7fd51c0ce710 2023-10-06T03:24:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.349+0000 7fd522024700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd500067000 0x7fd5000694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.350+0000 7f39a27fc700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3990066f30 0x7f39900693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3998006fd0 tx=0x7f399800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.350+0000 7fd522024700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd500067000 0x7fd5000694b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0cdfb0 tx=0x7fd50c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.352+0000 7ff405d9b700 1 -- 172.21.15.84:0/4065416915 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000e070 con 0x7ff408069aa0 2023-10-06T03:24:08.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.352+0000 7ff405d9b700 1 -- 172.21.15.84:0/4065416915 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000ba40 con 0x7ff408069aa0 2023-10-06T03:24:08.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.352+0000 7ff405d9b700 1 -- 172.21.15.84:0/4065416915 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000092e0 con 0x7ff408069aa0 2023-10-06T03:24:08.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.353+0000 7f976e7fc700 1 -- 172.21.15.84:0/3429442512 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9774051ee0 con 0x7f9778068d10 2023-10-06T03:24:08.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.353+0000 7f398affd700 1 -- 172.21.15.84:0/1321880808 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f399405af10 con 0x7f39a4069560 2023-10-06T03:24:08.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.353+0000 7ff40d018700 1 -- 172.21.15.84:0/4065416915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 msgr2=0x7ff40816c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.353+0000 7ff40d018700 1 --2- 172.21.15.84:0/4065416915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 0x7ff40816c6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff400009f20 tx=0x7ff400009840 comp rx=0 tx=0).stop 2023-10-06T03:24:08.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.357+0000 7ff40d018700 1 -- 172.21.15.84:0/4065416915 shutdown_connections 2023-10-06T03:24:08.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.357+0000 7ff40d018700 1 --2- 172.21.15.84:0/4065416915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 0x7ff40816c6a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.357+0000 7ff40d018700 1 --2- 172.21.15.84:0/4065416915 >> v2:172.21.15.84:3300/0 conn(0x7ff408087570 0x7ff408069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.357+0000 7ff40d018700 1 -- 172.21.15.84:0/4065416915 >> 172.21.15.84:0/4065416915 conn(0x7ff4080680c0 msgr2=0x7ff4080cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.358+0000 7fd5127fc700 1 -- 172.21.15.84:0/785246314 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd518051d90 con 0x7fd51c0ce710 2023-10-06T03:24:08.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.360+0000 7ff40d018700 1 -- 172.21.15.84:0/4065416915 shutdown_connections 2023-10-06T03:24:08.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.361+0000 7ff40d018700 1 -- 172.21.15.84:0/4065416915 wait complete. 2023-10-06T03:24:08.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.363+0000 7ff40d018700 1 Processor -- start 2023-10-06T03:24:08.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.363+0000 7ff40d018700 1 -- start start 2023-10-06T03:24:08.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40d018700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 0x7ff408086df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40d018700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff408087570 0x7ff408167ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40d018700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff40816eb90 0x7ff4080c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40d018700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff408087330 con 0x7ff408087570 2023-10-06T03:24:08.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40d018700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff408168a00 con 0x7ff40816eb90 2023-10-06T03:24:08.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40d018700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff408168ce0 con 0x7ff408069aa0 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff408087570 0x7ff408167ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff40816eb90 0x7ff4080c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff408087570 0x7ff408167ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34192/0 (socket says 172.21.15.84:34192) 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff40816eb90 0x7ff4080c00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:56714/0 (socket says 172.21.15.84:56714) 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff40659c700 1 -- 172.21.15.84:0/1297197099 learned_addr learned my addr 172.21.15.84:0/1297197099 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.364+0000 7ff406d9d700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 0x7ff408086df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.365+0000 7ff40659c700 1 -- 172.21.15.84:0/1297197099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 msgr2=0x7ff408086df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.365+0000 7ff40659c700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 0x7ff408086df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.365+0000 7ff40659c700 1 -- 172.21.15.84:0/1297197099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff40816eb90 msgr2=0x7ff4080c00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.365+0000 7ff40659c700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff40816eb90 0x7ff4080c00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.365+0000 7ff40659c700 1 -- 172.21.15.84:0/1297197099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400009ae0 con 0x7ff408087570 2023-10-06T03:24:08.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.365+0000 7ff40759e700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff40816eb90 0x7ff4080c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:08.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.365+0000 7ff40659c700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff408087570 0x7ff408167ff0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00d860 tx=0x7ff3fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.365+0000 7ff3eeffd700 1 -- 172.21.15.84:0/1297197099 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0125f0 con 0x7ff408087570 2023-10-06T03:24:08.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.365+0000 7ff3eeffd700 1 -- 172.21.15.84:0/1297197099 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc012750 con 0x7ff408087570 2023-10-06T03:24:08.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.365+0000 7ff40d018700 1 -- 172.21.15.84:0/1297197099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff408168fc0 con 0x7ff408087570 2023-10-06T03:24:08.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.366+0000 7ff40d018700 1 -- 172.21.15.84:0/1297197099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4080bfb80 con 0x7ff408087570 2023-10-06T03:24:08.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.366+0000 7ff3eeffd700 1 -- 172.21.15.84:0/1297197099 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc012af0 con 0x7ff408087570 2023-10-06T03:24:08.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.369+0000 7ff3eeffd700 1 -- 172.21.15.84:0/1297197099 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3fc013480 con 0x7ff408087570 2023-10-06T03:24:08.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.369+0000 7ff3eeffd700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff3f4066f30 0x7ff3f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.369+0000 7ff3eeffd700 1 -- 172.21.15.84:0/1297197099 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff3fc084ae0 con 0x7ff408087570 2023-10-06T03:24:08.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.376+0000 7ff406d9d700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff3f4066f30 0x7ff3f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.376+0000 7ff406d9d700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff3f4066f30 0x7ff3f40693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8006fd0 tx=0x7ff3f80090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.376+0000 7ff40d018700 1 -- 172.21.15.84:0/1297197099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e80052b0 con 0x7ff408087570 2023-10-06T03:24:08.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.386+0000 7ff3eeffd700 1 -- 172.21.15.84:0/1297197099 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3fc051900 con 0x7ff408087570 2023-10-06T03:24:08.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.691+0000 7fccb29da700 1 -- 172.21.15.84:0/1345082953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcc98005590 con 0x7fccac0c82a0 2023-10-06T03:24:08.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.708+0000 7fcc93fff700 1 -- 172.21.15.84:0/1345082953 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcca4022090 con 0x7fccac0c82a0 2023-10-06T03:24:08.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.708+0000 7f9780526700 1 -- 172.21.15.84:0/3429442512 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9760005830 con 0x7f9778068d10 2023-10-06T03:24:08.711 INFO:teuthology.orchestra.run.smithi084.stdout:55834574858 2023-10-06T03:24:08.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.710+0000 7f976e7fc700 1 -- 172.21.15.84:0/3429442512 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9774021070 con 0x7f9778068d10 2023-10-06T03:24:08.714 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-10-06T03:24:08.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.713+0000 7f9780526700 1 -- 172.21.15.84:0/3429442512 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f975c067000 msgr2=0x7f975c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.713+0000 7f9780526700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f975c067000 0x7f975c0694b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f97781579f0 tx=0x7f9768006be0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7f9780526700 1 -- 172.21.15.84:0/3429442512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9778068d10 msgr2=0x7f97780ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7f9780526700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9778068d10 0x7f97780ab4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f977400ec80 tx=0x7f9774009120 comp rx=0 tx=0).stop 2023-10-06T03:24:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7fccb29da700 1 -- 172.21.15.84:0/1345082953 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc940671e0 msgr2=0x7fcc94069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7fccb29da700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc940671e0 0x7fcc94069690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009a80 tx=0x7fcc9c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7fccb29da700 1 -- 172.21.15.84:0/1345082953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccac0c82a0 msgr2=0x7fccac147700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7fccb29da700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccac0c82a0 0x7fccac147700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fccac0bfb50 tx=0x7fcca401d000 comp rx=0 tx=0).stop 2023-10-06T03:24:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7f9780526700 1 -- 172.21.15.84:0/3429442512 shutdown_connections 2023-10-06T03:24:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7f9780526700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f975c067000 0x7f975c0694b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7f9780526700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9778156690 0x7f9778140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7f9780526700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9778068d10 0x7f97780ab4d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7f9780526700 1 --2- 172.21.15.84:0/3429442512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97781562c0 0x7f977806aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7f9780526700 1 -- 172.21.15.84:0/3429442512 >> 172.21.15.84:0/3429442512 conn(0x7f977806de80 msgr2=0x7f97780aef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7fccb29da700 1 -- 172.21.15.84:0/1345082953 shutdown_connections 2023-10-06T03:24:08.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7fccb29da700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc940671e0 0x7fcc94069690 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7fccb29da700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccac155860 0x7fccac0bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7fccb29da700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccac06e410 0x7fccac0c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7fccb29da700 1 --2- 172.21.15.84:0/1345082953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccac0c82a0 0x7fccac147700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.714+0000 7fccb29da700 1 -- 172.21.15.84:0/1345082953 >> 172.21.15.84:0/1345082953 conn(0x7fccac0680c0 msgr2=0x7fccac153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.715+0000 7fccb29da700 1 -- 172.21.15.84:0/1345082953 shutdown_connections 2023-10-06T03:24:08.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.715+0000 7f9780526700 1 -- 172.21.15.84:0/3429442512 shutdown_connections 2023-10-06T03:24:08.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.715+0000 7fccb29da700 1 -- 172.21.15.84:0/1345082953 wait complete. 2023-10-06T03:24:08.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.715+0000 7f9780526700 1 -- 172.21.15.84:0/3429442512 wait complete. 2023-10-06T03:24:08.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.715+0000 7f54b19ac700 1 -- 172.21.15.84:0/3942681537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f54ac064ad0 con 0x7f54ac0878f0 2023-10-06T03:24:08.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.722+0000 7f5492ffd700 1 -- 172.21.15.84:0/3942681537 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54a0017020 con 0x7f54ac0878f0 2023-10-06T03:24:08.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.722+0000 7f201ffff700 1 -- 172.21.15.84:0/3251016395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2020150370 con 0x7f202015d5f0 2023-10-06T03:24:08.724 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T03:24:08.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 -- 172.21.15.84:0/3942681537 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5498066f00 msgr2=0x7f54980693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5498066f00 0x7f54980693b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f549c007ab0 tx=0x7f549c00c040 comp rx=0 tx=0).stop 2023-10-06T03:24:08.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 -- 172.21.15.84:0/3942681537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54ac0878f0 msgr2=0x7f54ac176d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54ac0878f0 0x7f54ac176d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f54a000c790 tx=0x7f54a0007e10 comp rx=0 tx=0).stop 2023-10-06T03:24:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f2006ffd700 1 -- 172.21.15.84:0/3251016395 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2020150370 con 0x7f202015d5f0 2023-10-06T03:24:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 -- 172.21.15.84:0/3942681537 shutdown_connections 2023-10-06T03:24:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5498066f00 0x7f54980693b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54ac0c8320 0x7f54ac177280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54ac06d550 0x7f54ac0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 --2- 172.21.15.84:0/3942681537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54ac0878f0 0x7f54ac176d40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 -- 172.21.15.84:0/3942681537 >> 172.21.15.84:0/3942681537 conn(0x7f54ac0680c0 msgr2=0x7f54ac0aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 -- 172.21.15.84:0/3942681537 shutdown_connections 2023-10-06T03:24:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.726+0000 7f54b19ac700 1 -- 172.21.15.84:0/3942681537 wait complete. 2023-10-06T03:24:08.731 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T03:24:08.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.730+0000 7f201ffff700 1 -- 172.21.15.84:0/3251016395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f200c067080 msgr2=0x7f200c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.730+0000 7f201ffff700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f200c067080 0x7f200c069530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f20100030c0 tx=0x7f2010016000 comp rx=0 tx=0).stop 2023-10-06T03:24:08.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.730+0000 7f201ffff700 1 -- 172.21.15.84:0/3251016395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202015d5f0 msgr2=0x7f202014cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.730+0000 7f201ffff700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202015d5f0 0x7f202014cf00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f201400c5d0 tx=0x7f2014007f00 comp rx=0 tx=0).stop 2023-10-06T03:24:08.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-10-06T03:24:08.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.732+0000 7f201ffff700 1 -- 172.21.15.84:0/3251016395 shutdown_connections 2023-10-06T03:24:08.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.732+0000 7f201ffff700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f200c067080 0x7f200c069530 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.732+0000 7f201ffff700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200c9fe0 0x7f2020148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.732+0000 7f201ffff700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f202015d9c0 0x7f202014d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.732+0000 7f201ffff700 1 --2- 172.21.15.84:0/3251016395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202015d5f0 0x7f202014cf00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.732+0000 7f201ffff700 1 -- 172.21.15.84:0/3251016395 >> 172.21.15.84:0/3251016395 conn(0x7f20200680c0 msgr2=0x7f20200ad900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.734 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:08.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-10-06T03:24:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.735+0000 7f201ffff700 1 -- 172.21.15.84:0/3251016395 shutdown_connections 2023-10-06T03:24:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.735+0000 7f201ffff700 1 -- 172.21.15.84:0/3251016395 wait complete. 2023-10-06T03:24:08.738 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:08.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.737+0000 7f4190e69700 1 -- 172.21.15.84:0/1825533902 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4170005560 con 0x7f418c06e410 2023-10-06T03:24:08.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.738+0000 7f417a7fc700 1 -- 172.21.15.84:0/1825533902 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41800548e0 con 0x7f418c06e410 2023-10-06T03:24:08.739 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-10-06T03:24:08.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.741+0000 7f4190e69700 1 -- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f416c067080 msgr2=0x7f416c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.741+0000 7f4190e69700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f416c067080 0x7f416c069530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f417c00d050 tx=0x7f417c01b000 comp rx=0 tx=0).stop 2023-10-06T03:24:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.741+0000 7f4190e69700 1 -- 172.21.15.84:0/1825533902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c06e410 msgr2=0x7f418c148560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.741+0000 7f4190e69700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c06e410 0x7f418c148560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f418000b5e0 tx=0x7f41800090f0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.742+0000 7f4190e69700 1 -- 172.21.15.84:0/1825533902 shutdown_connections 2023-10-06T03:24:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.742+0000 7f4190e69700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f416c067080 0x7f416c069530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.742+0000 7f4190e69700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f418c155860 0x7f418c157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.742+0000 7f4190e69700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f418c06e410 0x7f418c148560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.742+0000 7f4190e69700 1 --2- 172.21.15.84:0/1825533902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f418c0c82a0 0x7f418c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.742+0000 7f4190e69700 1 -- 172.21.15.84:0/1825533902 >> 172.21.15.84:0/1825533902 conn(0x7f418c0680c0 msgr2=0x7f418c14d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.742+0000 7f4190e69700 1 -- 172.21.15.84:0/1825533902 shutdown_connections 2023-10-06T03:24:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.742+0000 7f4190e69700 1 -- 172.21.15.84:0/1825533902 wait complete. 2023-10-06T03:24:08.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-10-06T03:24:08.751 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:08.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.749+0000 7fd524288700 1 -- 172.21.15.84:0/785246314 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd51c14bdc0 con 0x7fd51c0ce710 2023-10-06T03:24:08.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.750+0000 7fd5127fc700 1 -- 172.21.15.84:0/785246314 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5180553b0 con 0x7fd51c0ce710 2023-10-06T03:24:08.752 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-10-06T03:24:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.750+0000 7f39a94fa700 1 -- 172.21.15.84:0/1321880808 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f39a40c7270 con 0x7f39a4069560 2023-10-06T03:24:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.751+0000 7f398affd700 1 -- 172.21.15.84:0/1321880808 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f399405e530 con 0x7f39a4069560 2023-10-06T03:24:08.752 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T03:24:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 -- 172.21.15.84:0/785246314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd500067000 msgr2=0x7fd5000694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd500067000 0x7fd5000694b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0cdfb0 tx=0x7fd50c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 -- 172.21.15.84:0/785246314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0ce710 msgr2=0x7fd51c15cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0ce710 0x7fd51c15cd30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd51800d890 tx=0x7fd518008040 comp rx=0 tx=0).stop 2023-10-06T03:24:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 -- 172.21.15.84:0/785246314 shutdown_connections 2023-10-06T03:24:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd500067000 0x7fd5000694b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd51c0ce710 0x7fd51c15cd30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c069560 0x7fd51c0c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 --2- 172.21.15.84:0/785246314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd51c0c89b0 0x7fd51c15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 -- 172.21.15.84:0/785246314 >> 172.21.15.84:0/785246314 conn(0x7fd51c070810 msgr2=0x7fd51c0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 -- 172.21.15.84:0/785246314 shutdown_connections 2023-10-06T03:24:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.752+0000 7fd524288700 1 -- 172.21.15.84:0/785246314 wait complete. 2023-10-06T03:24:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 -- 172.21.15.84:0/1321880808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3990066f30 msgr2=0x7f39900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3990066f30 0x7f39900693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3998006fd0 tx=0x7f399800b040 comp rx=0 tx=0).stop 2023-10-06T03:24:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 -- 172.21.15.84:0/1321880808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39a4069560 msgr2=0x7f39a40a7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39a4069560 0x7f39a40a7120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3994009a70 tx=0x7f3994018000 comp rx=0 tx=0).stop 2023-10-06T03:24:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 -- 172.21.15.84:0/1321880808 shutdown_connections 2023-10-06T03:24:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3990066f30 0x7f39900693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39a4069560 0x7f39a40a7120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a40c8320 0x7f39a40ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 --2- 172.21.15.84:0/1321880808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39a406d550 0x7f39a40a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 -- 172.21.15.84:0/1321880808 >> 172.21.15.84:0/1321880808 conn(0x7f39a40680c0 msgr2=0x7f39a40c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 -- 172.21.15.84:0/1321880808 shutdown_connections 2023-10-06T03:24:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.753+0000 7f39a94fa700 1 -- 172.21.15.84:0/1321880808 wait complete. 2023-10-06T03:24:08.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-10-06T03:24:08.760 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:08.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.764+0000 7ff40d018700 1 -- 172.21.15.84:0/1297197099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff3e8005830 con 0x7ff408087570 2023-10-06T03:24:08.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-10-06T03:24:08.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.764+0000 7ff3eeffd700 1 -- 172.21.15.84:0/1297197099 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3fc054f20 con 0x7ff408087570 2023-10-06T03:24:08.769 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T03:24:08.769 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.766+0000 7ff40d018700 1 -- 172.21.15.84:0/1297197099 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff3f4066f30 msgr2=0x7ff3f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.766+0000 7ff40d018700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff3f4066f30 0x7ff3f40693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8006fd0 tx=0x7ff3f80090f0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.766+0000 7ff40d018700 1 -- 172.21.15.84:0/1297197099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff408087570 msgr2=0x7ff408167ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.766+0000 7ff40d018700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff408087570 0x7ff408167ff0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00d860 tx=0x7ff3fc008040 comp rx=0 tx=0).stop 2023-10-06T03:24:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.766+0000 7ff40d018700 1 -- 172.21.15.84:0/1297197099 shutdown_connections 2023-10-06T03:24:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.766+0000 7ff40d018700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff3f4066f30 0x7ff3f40693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.766+0000 7ff40d018700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff40816eb90 0x7ff4080c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.766+0000 7ff40d018700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff408069aa0 0x7ff408086df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.766+0000 7ff40d018700 1 --2- 172.21.15.84:0/1297197099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff408087570 0x7ff408167ff0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.766+0000 7ff40d018700 1 -- 172.21.15.84:0/1297197099 >> 172.21.15.84:0/1297197099 conn(0x7ff4080680c0 msgr2=0x7ff4080cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.767+0000 7ff40d018700 1 -- 172.21.15.84:0/1297197099 shutdown_connections 2023-10-06T03:24:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.767+0000 7ff40d018700 1 -- 172.21.15.84:0/1297197099 wait complete. 2023-10-06T03:24:08.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-10-06T03:24:08.773 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:08.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-06T03:24:08.773 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:08.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-10-06T03:24:08.780 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:08.780 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:24:08.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:08.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.933+0000 7fa4bffff700 1 Processor -- start 2023-10-06T03:24:08.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.933+0000 7fa4bffff700 1 -- start start 2023-10-06T03:24:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c0159480 0x7fa4c00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4c00b2140 0x7fa4c00b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c00cb7e0 con 0x7fa4c00b3610 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c00b08a0 con 0x7fa4c00b2140 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00cb190 con 0x7fa4c0159480 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bf7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4c00b2140 0x7fa4c00b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bf7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4c00b2140 0x7fa4c00b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34198/0 (socket says 172.21.15.84:34198) 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4be7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa4c00b3610 0x7fa4c00cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48416/0 (socket says 172.21.15.84:48416) 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bf7fe700 1 -- 172.21.15.84:0/435695582 learned_addr learned my addr 172.21.15.84:0/435695582 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4beffd700 1 --2- 172.21.15.84:0/435695582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c0159480 0x7fa4c00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bf7fe700 1 -- 172.21.15.84:0/435695582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c0159480 msgr2=0x7fa4c00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bf7fe700 1 --2- 172.21.15.84:0/435695582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c0159480 0x7fa4c00b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bf7fe700 1 -- 172.21.15.84:0/435695582 >> v1:172.21.15.84:6789/0 conn(0x7fa4c00b3610 legacy=0x7fa4c00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bf7fe700 1 -- 172.21.15.84:0/435695582 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00cb470 con 0x7fa4c00b2140 2023-10-06T03:24:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.934+0000 7fa4bdffb700 1 -- 172.21.15.84:0/435695582 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956008951 0 0) 0x7fa4c00cb7e0 con 0x7fa4c00b3610 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bf7fe700 1 --2- 172.21.15.84:0/435695582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b2140 0x7fa4c00b25c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80099b0 tx=0x7fa4b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ce094ca8543f5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bdffb700 1 -- 172.21.15.84:0/435695582 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800b860 con 0x7fa4c00b2140 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bdffb700 1 -- 172.21.15.84:0/435695582 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b800b9c0 con 0x7fa4c00b2140 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bdffb700 1 -- 172.21.15.84:0/435695582 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800bd60 con 0x7fa4c00b2140 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bffff700 1 -- 172.21.15.84:0/435695582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b2140 msgr2=0x7fa4c00b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bffff700 1 --2- 172.21.15.84:0/435695582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b2140 0x7fa4c00b25c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80099b0 tx=0x7fa4b8009250 comp rx=0 tx=0).stop 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bffff700 1 -- 172.21.15.84:0/435695582 shutdown_connections 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bffff700 1 --2- 172.21.15.84:0/435695582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b2140 0x7fa4c00b25c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bffff700 1 --2- 172.21.15.84:0/435695582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c0159480 0x7fa4c00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bffff700 1 -- 172.21.15.84:0/435695582 >> 172.21.15.84:0/435695582 conn(0x7fa4c006ed20 msgr2=0x7fa4c006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bffff700 1 -- 172.21.15.84:0/435695582 shutdown_connections 2023-10-06T03:24:08.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.935+0000 7fa4bffff700 1 -- 172.21.15.84:0/435695582 wait complete. 2023-10-06T03:24:08.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4bffff700 1 Processor -- start 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4bffff700 1 -- start start 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4bffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c00b2140 0x7fa4c016a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4bffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b3610 0x7fa4c0151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4bffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c0159480 0x7fa4c00d0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4bffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00c61e0 con 0x7fa4c00b3610 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4bffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00ce620 con 0x7fa4c0159480 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4bffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00c5f00 con 0x7fa4c00b2140 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4be7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b3610 0x7fa4c0151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4be7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b3610 0x7fa4c0151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34204/0 (socket says 172.21.15.84:34204) 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.937+0000 7fa4be7fc700 1 -- 172.21.15.84:0/2372651348 learned_addr learned my addr 172.21.15.84:0/2372651348 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4beffd700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c00b2140 0x7fa4c016a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4bf7fe700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c0159480 0x7fa4c00d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4be7fc700 1 -- 172.21.15.84:0/2372651348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c00b2140 msgr2=0x7fa4c016a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4be7fc700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c00b2140 0x7fa4c016a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4be7fc700 1 -- 172.21.15.84:0/2372651348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c0159480 msgr2=0x7fa4c00d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4be7fc700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c0159480 0x7fa4c00d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4be7fc700 1 -- 172.21.15.84:0/2372651348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80094f0 con 0x7fa4c00b3610 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4beffd700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c00b2140 0x7fa4c016a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4be7fc700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b3610 0x7fa4c0151950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40011e0 tx=0x7fa4b4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4a6ffd700 1 -- 172.21.15.84:0/2372651348 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4007300 con 0x7fa4c00b3610 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4a6ffd700 1 -- 172.21.15.84:0/2372651348 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4007460 con 0x7fa4c00b3610 2023-10-06T03:24:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4a6ffd700 1 -- 172.21.15.84:0/2372651348 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4004830 con 0x7fa4c00b3610 2023-10-06T03:24:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4bffff700 1 -- 172.21.15.84:0/2372651348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c00cdfd0 con 0x7fa4c00b3610 2023-10-06T03:24:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.938+0000 7fa4bffff700 1 -- 172.21.15.84:0/2372651348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c0151e90 con 0x7fa4c00b3610 2023-10-06T03:24:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.939+0000 7fa4bffff700 1 -- 172.21.15.84:0/2372651348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c00cde10 con 0x7fa4c00b3610 2023-10-06T03:24:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.939+0000 7fa4a6ffd700 1 -- 172.21.15.84:0/2372651348 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4b4004be0 con 0x7fa4c00b3610 2023-10-06T03:24:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.940+0000 7fa4a6ffd700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4ac066f30 0x7fa4ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.940+0000 7fa4a6ffd700 1 -- 172.21.15.84:0/2372651348 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa4b4083e90 con 0x7fa4c00b3610 2023-10-06T03:24:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.940+0000 7fa4beffd700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4ac066f30 0x7fa4ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.940+0000 7fa4beffd700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4ac066f30 0x7fa4ac0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009fd0 tx=0x7fa4b0009740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:08.944+0000 7fa4a6ffd700 1 -- 172.21.15.84:0/2372651348 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4b4050d30 con 0x7fa4c00b3610 2023-10-06T03:24:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.121+0000 7fa4bffff700 1 -- 172.21.15.84:0/2372651348 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4c005f270 con 0x7fa4ac066f30 2023-10-06T03:24:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.131+0000 7fa4a6ffd700 1 -- 172.21.15.84:0/2372651348 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367504 (secure 0 0 0) 0x7fa4c005f270 con 0x7fa4ac066f30 2023-10-06T03:24:09.137 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 -- 172.21.15.84:0/2372651348 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4ac066f30 msgr2=0x7fa4ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4ac066f30 0x7fa4ac0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009fd0 tx=0x7fa4b0009740 comp rx=0 tx=0).stop 2023-10-06T03:24:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 -- 172.21.15.84:0/2372651348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b3610 msgr2=0x7fa4c0151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b3610 0x7fa4c0151950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40011e0 tx=0x7fa4b4007e10 comp rx=0 tx=0).stop 2023-10-06T03:24:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 -- 172.21.15.84:0/2372651348 shutdown_connections 2023-10-06T03:24:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4ac066f30 0x7fa4ac0693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c0159480 0x7fa4c00d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c00b2140 0x7fa4c016a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 --2- 172.21.15.84:0/2372651348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c00b3610 0x7fa4c0151950 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 -- 172.21.15.84:0/2372651348 >> 172.21.15.84:0/2372651348 conn(0x7fa4c006ed20 msgr2=0x7fa4c01568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 -- 172.21.15.84:0/2372651348 shutdown_connections 2023-10-06T03:24:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.134+0000 7fa4bffff700 1 -- 172.21.15.84:0/2372651348 wait complete. 2023-10-06T03:24:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:24:09.148 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-10-06T03:24:09.044614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381508,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593212,"statfs":{"total":773094113280,"available":770655449088,"internally_reserved":0,"allocated":3280896,"data_stored":2023855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003345"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561518+0000","last_change":"2023-10-06T03:23:50.561014+0000","last_active":"2023-10-06T03:23:54.561518+0000","last_peered":"2023-10-06T03:23:54.561518+0000","last_clean":"2023-10-06T03:23:54.561518+0000","last_became_active":"2023-10-06T03:23:50.560752+0000","last_became_peered":"2023-10-06T03:23:50.560752+0000","last_unstale":"2023-10-06T03:23:54.561518+0000","last_undegraded":"2023-10-06T03:23:54.561518+0000","last_fullsized":"2023-10-06T03:23:54.561518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:11.240323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561509+0000","last_change":"2023-10-06T03:23:50.554102+0000","last_active":"2023-10-06T03:23:54.561509+0000","last_peered":"2023-10-06T03:23:54.561509+0000","last_clean":"2023-10-06T03:23:54.561509+0000","last_became_active":"2023-10-06T03:23:50.553890+0000","last_became_peered":"2023-10-06T03:23:50.553890+0000","last_unstale":"2023-10-06T03:23:54.561509+0000","last_undegraded":"2023-10-06T03:23:54.561509+0000","last_fullsized":"2023-10-06T03:23:54.561509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570300+0000","last_change":"2023-10-06T03:23:50.547813+0000","last_active":"2023-10-06T03:23:54.570300+0000","last_peered":"2023-10-06T03:23:54.570300+0000","last_clean":"2023-10-06T03:23:54.570300+0000","last_became_active":"2023-10-06T03:23:50.547300+0000","last_became_peered":"2023-10-06T03:23:50.547300+0000","last_unstale":"2023-10-06T03:23:54.570300+0000","last_undegraded":"2023-10-06T03:23:54.570300+0000","last_fullsized":"2023-10-06T03:23:54.570300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:41.253538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572253+0000","last_change":"2023-10-06T03:23:50.555770+0000","last_active":"2023-10-06T03:23:54.572253+0000","last_peered":"2023-10-06T03:23:54.572253+0000","last_clean":"2023-10-06T03:23:54.572253+0000","last_became_active":"2023-10-06T03:23:50.555523+0000","last_became_peered":"2023-10-06T03:23:50.555523+0000","last_unstale":"2023-10-06T03:23:54.572253+0000","last_undegraded":"2023-10-06T03:23:54.572253+0000","last_fullsized":"2023-10-06T03:23:54.572253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:47.159183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567665+0000","last_change":"2023-10-06T03:23:50.560528+0000","last_active":"2023-10-06T03:23:54.567665+0000","last_peered":"2023-10-06T03:23:54.567665+0000","last_clean":"2023-10-06T03:23:54.567665+0000","last_became_active":"2023-10-06T03:23:50.560247+0000","last_became_peered":"2023-10-06T03:23:50.560247+0000","last_unstale":"2023-10-06T03:23:54.567665+0000","last_undegraded":"2023-10-06T03:23:54.567665+0000","last_fullsized":"2023-10-06T03:23:54.567665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570783+0000","last_change":"2023-10-06T03:23:50.546938+0000","last_active":"2023-10-06T03:23:54.570783+0000","last_peered":"2023-10-06T03:23:54.570783+0000","last_clean":"2023-10-06T03:23:54.570783+0000","last_became_active":"2023-10-06T03:23:50.546653+0000","last_became_peered":"2023-10-06T03:23:50.546653+0000","last_unstale":"2023-10-06T03:23:54.570783+0000","last_undegraded":"2023-10-06T03:23:54.570783+0000","last_fullsized":"2023-10-06T03:23:54.570783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560769+0000","last_change":"2023-10-06T03:23:50.553364+0000","last_active":"2023-10-06T03:23:54.560769+0000","last_peered":"2023-10-06T03:23:54.560769+0000","last_clean":"2023-10-06T03:23:54.560769+0000","last_became_active":"2023-10-06T03:23:50.553098+0000","last_became_peered":"2023-10-06T03:23:50.553098+0000","last_unstale":"2023-10-06T03:23:54.560769+0000","last_undegraded":"2023-10-06T03:23:54.560769+0000","last_fullsized":"2023-10-06T03:23:54.560769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559957+0000","last_change":"2023-10-06T03:23:50.556409+0000","last_active":"2023-10-06T03:23:54.559957+0000","last_peered":"2023-10-06T03:23:54.559957+0000","last_clean":"2023-10-06T03:23:54.559957+0000","last_became_active":"2023-10-06T03:23:50.556162+0000","last_became_peered":"2023-10-06T03:23:50.556162+0000","last_unstale":"2023-10-06T03:23:54.559957+0000","last_undegraded":"2023-10-06T03:23:54.559957+0000","last_fullsized":"2023-10-06T03:23:54.559957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565989+0000","last_change":"2023-10-06T03:23:50.548544+0000","last_active":"2023-10-06T03:23:54.565989+0000","last_peered":"2023-10-06T03:23:54.565989+0000","last_clean":"2023-10-06T03:23:54.565989+0000","last_became_active":"2023-10-06T03:23:50.548294+0000","last_became_peered":"2023-10-06T03:23:50.548294+0000","last_unstale":"2023-10-06T03:23:54.565989+0000","last_undegraded":"2023-10-06T03:23:54.565989+0000","last_fullsized":"2023-10-06T03:23:54.565989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561682+0000","last_change":"2023-10-06T03:23:50.547845+0000","last_active":"2023-10-06T03:23:54.561682+0000","last_peered":"2023-10-06T03:23:54.561682+0000","last_clean":"2023-10-06T03:23:54.561682+0000","last_became_active":"2023-10-06T03:23:50.547570+0000","last_became_peered":"2023-10-06T03:23:50.547570+0000","last_unstale":"2023-10-06T03:23:54.561682+0000","last_undegraded":"2023-10-06T03:23:54.561682+0000","last_fullsized":"2023-10-06T03:23:54.561682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570220+0000","last_change":"2023-10-06T03:23:50.554501+0000","last_active":"2023-10-06T03:23:54.570220+0000","last_peered":"2023-10-06T03:23:54.570220+0000","last_clean":"2023-10-06T03:23:54.570220+0000","last_became_active":"2023-10-06T03:23:50.554323+0000","last_became_peered":"2023-10-06T03:23:50.554323+0000","last_unstale":"2023-10-06T03:23:54.570220+0000","last_undegraded":"2023-10-06T03:23:54.570220+0000","last_fullsized":"2023-10-06T03:23:54.570220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:39.132842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561650+0000","last_change":"2023-10-06T03:23:50.556387+0000","last_active":"2023-10-06T03:23:54.561650+0000","last_peered":"2023-10-06T03:23:54.561650+0000","last_clean":"2023-10-06T03:23:54.561650+0000","last_became_active":"2023-10-06T03:23:50.556160+0000","last_became_peered":"2023-10-06T03:23:50.556160+0000","last_unstale":"2023-10-06T03:23:54.561650+0000","last_undegraded":"2023-10-06T03:23:54.561650+0000","last_fullsized":"2023-10-06T03:23:54.561650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:48.412426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561770+0000","last_change":"2023-10-06T03:23:50.560485+0000","last_active":"2023-10-06T03:23:54.561770+0000","last_peered":"2023-10-06T03:23:54.561770+0000","last_clean":"2023-10-06T03:23:54.561770+0000","last_became_active":"2023-10-06T03:23:50.560194+0000","last_became_peered":"2023-10-06T03:23:50.560194+0000","last_unstale":"2023-10-06T03:23:54.561770+0000","last_undegraded":"2023-10-06T03:23:54.561770+0000","last_fullsized":"2023-10-06T03:23:54.561770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:12.346557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560300+0000","last_change":"2023-10-06T03:23:50.551082+0000","last_active":"2023-10-06T03:23:54.560300+0000","last_peered":"2023-10-06T03:23:54.560300+0000","last_clean":"2023-10-06T03:23:54.560300+0000","last_became_active":"2023-10-06T03:23:50.550756+0000","last_became_peered":"2023-10-06T03:23:50.550756+0000","last_unstale":"2023-10-06T03:23:54.560300+0000","last_undegraded":"2023-10-06T03:23:54.560300+0000","last_fullsized":"2023-10-06T03:23:54.560300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560103+0000","last_change":"2023-10-06T03:23:50.553219+0000","last_active":"2023-10-06T03:23:54.560103+0000","last_peered":"2023-10-06T03:23:54.560103+0000","last_clean":"2023-10-06T03:23:54.560103+0000","last_became_active":"2023-10-06T03:23:50.552954+0000","last_became_peered":"2023-10-06T03:23:50.552954+0000","last_unstale":"2023-10-06T03:23:54.560103+0000","last_undegraded":"2023-10-06T03:23:54.560103+0000","last_fullsized":"2023-10-06T03:23:54.560103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568201+0000","last_change":"2023-10-06T03:23:50.538998+0000","last_active":"2023-10-06T03:23:54.568201+0000","last_peered":"2023-10-06T03:23:54.568201+0000","last_clean":"2023-10-06T03:23:54.568201+0000","last_became_active":"2023-10-06T03:23:50.538721+0000","last_became_peered":"2023-10-06T03:23:50.538721+0000","last_unstale":"2023-10-06T03:23:54.568201+0000","last_undegraded":"2023-10-06T03:23:54.568201+0000","last_fullsized":"2023-10-06T03:23:54.568201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566076+0000","last_change":"2023-10-06T03:23:50.548665+0000","last_active":"2023-10-06T03:23:54.566076+0000","last_peered":"2023-10-06T03:23:54.566076+0000","last_clean":"2023-10-06T03:23:54.566076+0000","last_became_active":"2023-10-06T03:23:50.548379+0000","last_became_peered":"2023-10-06T03:23:50.548379+0000","last_unstale":"2023-10-06T03:23:54.566076+0000","last_undegraded":"2023-10-06T03:23:54.566076+0000","last_fullsized":"2023-10-06T03:23:54.566076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:04.343209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570249+0000","last_change":"2023-10-06T03:23:50.547255+0000","last_active":"2023-10-06T03:23:54.570249+0000","last_peered":"2023-10-06T03:23:54.570249+0000","last_clean":"2023-10-06T03:23:54.570249+0000","last_became_active":"2023-10-06T03:23:50.546952+0000","last_became_peered":"2023-10-06T03:23:50.546952+0000","last_unstale":"2023-10-06T03:23:54.570249+0000","last_undegraded":"2023-10-06T03:23:54.570249+0000","last_fullsized":"2023-10-06T03:23:54.570249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:37.459738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.562026+0000","last_change":"2023-10-06T03:23:50.549274+0000","last_active":"2023-10-06T03:23:54.562026+0000","last_peered":"2023-10-06T03:23:54.562026+0000","last_clean":"2023-10-06T03:23:54.562026+0000","last_became_active":"2023-10-06T03:23:50.549011+0000","last_became_peered":"2023-10-06T03:23:50.549011+0000","last_unstale":"2023-10-06T03:23:54.562026+0000","last_undegraded":"2023-10-06T03:23:54.562026+0000","last_fullsized":"2023-10-06T03:23:54.562026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:21.634023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.571307+0000","last_change":"2023-10-06T03:23:50.553751+0000","last_active":"2023-10-06T03:23:54.571307+0000","last_peered":"2023-10-06T03:23:54.571307+0000","last_clean":"2023-10-06T03:23:54.571307+0000","last_became_active":"2023-10-06T03:23:50.553496+0000","last_became_peered":"2023-10-06T03:23:50.553496+0000","last_unstale":"2023-10-06T03:23:54.571307+0000","last_undegraded":"2023-10-06T03:23:54.571307+0000","last_fullsized":"2023-10-06T03:23:54.571307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:35.855132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561063+0000","last_change":"2023-10-06T03:23:50.549272+0000","last_active":"2023-10-06T03:23:54.561063+0000","last_peered":"2023-10-06T03:23:54.561063+0000","last_clean":"2023-10-06T03:23:54.561063+0000","last_became_active":"2023-10-06T03:23:50.548975+0000","last_became_peered":"2023-10-06T03:23:50.548975+0000","last_unstale":"2023-10-06T03:23:54.561063+0000","last_undegraded":"2023-10-06T03:23:54.561063+0000","last_fullsized":"2023-10-06T03:23:54.561063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.564941+0000","last_change":"2023-10-06T03:23:50.553906+0000","last_active":"2023-10-06T03:23:54.564941+0000","last_peered":"2023-10-06T03:23:54.564941+0000","last_clean":"2023-10-06T03:23:54.564941+0000","last_became_active":"2023-10-06T03:23:50.553657+0000","last_became_peered":"2023-10-06T03:23:50.553657+0000","last_unstale":"2023-10-06T03:23:54.564941+0000","last_undegraded":"2023-10-06T03:23:54.564941+0000","last_fullsized":"2023-10-06T03:23:54.564941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557967+0000","last_change":"2023-10-06T03:23:50.559812+0000","last_active":"2023-10-06T03:23:54.557967+0000","last_peered":"2023-10-06T03:23:54.557967+0000","last_clean":"2023-10-06T03:23:54.557967+0000","last_became_active":"2023-10-06T03:23:50.559490+0000","last_became_peered":"2023-10-06T03:23:50.559490+0000","last_unstale":"2023-10-06T03:23:54.557967+0000","last_undegraded":"2023-10-06T03:23:54.557967+0000","last_fullsized":"2023-10-06T03:23:54.557967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:03.745193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560369+0000","last_change":"2023-10-06T03:23:50.560701+0000","last_active":"2023-10-06T03:23:54.560369+0000","last_peered":"2023-10-06T03:23:54.560369+0000","last_clean":"2023-10-06T03:23:54.560369+0000","last_became_active":"2023-10-06T03:23:50.560415+0000","last_became_peered":"2023-10-06T03:23:50.560415+0000","last_unstale":"2023-10-06T03:23:54.560369+0000","last_undegraded":"2023-10-06T03:23:54.560369+0000","last_fullsized":"2023-10-06T03:23:54.560369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574718+0000","last_change":"2023-10-06T03:23:50.552568+0000","last_active":"2023-10-06T03:23:54.574718+0000","last_peered":"2023-10-06T03:23:54.574718+0000","last_clean":"2023-10-06T03:23:54.574718+0000","last_became_active":"2023-10-06T03:23:50.552323+0000","last_became_peered":"2023-10-06T03:23:50.552323+0000","last_unstale":"2023-10-06T03:23:54.574718+0000","last_undegraded":"2023-10-06T03:23:54.574718+0000","last_fullsized":"2023-10-06T03:23:54.574718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574482+0000","last_change":"2023-10-06T03:23:50.553152+0000","last_active":"2023-10-06T03:23:54.574482+0000","last_peered":"2023-10-06T03:23:54.574482+0000","last_clean":"2023-10-06T03:23:54.574482+0000","last_became_active":"2023-10-06T03:23:50.552841+0000","last_became_peered":"2023-10-06T03:23:50.552841+0000","last_unstale":"2023-10-06T03:23:54.574482+0000","last_undegraded":"2023-10-06T03:23:54.574482+0000","last_fullsized":"2023-10-06T03:23:54.574482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561676+0000","last_change":"2023-10-06T03:23:50.552461+0000","last_active":"2023-10-06T03:23:54.561676+0000","last_peered":"2023-10-06T03:23:54.561676+0000","last_clean":"2023-10-06T03:23:54.561676+0000","last_became_active":"2023-10-06T03:23:50.551071+0000","last_became_peered":"2023-10-06T03:23:50.551071+0000","last_unstale":"2023-10-06T03:23:54.561676+0000","last_undegraded":"2023-10-06T03:23:54.561676+0000","last_fullsized":"2023-10-06T03:23:54.561676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581529+0000","last_change":"2023-10-06T03:23:54.579111+0000","last_active":"2023-10-06T03:23:54.581529+0000","last_peered":"2023-10-06T03:23:54.581529+0000","last_clean":"2023-10-06T03:23:54.581529+0000","last_became_active":"2023-10-06T03:23:54.578715+0000","last_became_peered":"2023-10-06T03:23:54.578715+0000","last_unstale":"2023-10-06T03:23:54.581529+0000","last_undegraded":"2023-10-06T03:23:54.581529+0000","last_fullsized":"2023-10-06T03:23:54.581529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:35.035137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570617+0000","last_change":"2023-10-06T03:23:49.548044+0000","last_active":"2023-10-06T03:23:54.570617+0000","last_peered":"2023-10-06T03:23:54.570617+0000","last_clean":"2023-10-06T03:23:54.570617+0000","last_became_active":"2023-10-06T03:23:49.547760+0000","last_became_peered":"2023-10-06T03:23:49.547760+0000","last_unstale":"2023-10-06T03:23:54.570617+0000","last_undegraded":"2023-10-06T03:23:54.570617+0000","last_fullsized":"2023-10-06T03:23:54.570617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:20.629148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559115+0000","last_change":"2023-10-06T03:23:50.559669+0000","last_active":"2023-10-06T03:23:54.559115+0000","last_peered":"2023-10-06T03:23:54.559115+0000","last_clean":"2023-10-06T03:23:54.559115+0000","last_became_active":"2023-10-06T03:23:50.559405+0000","last_became_peered":"2023-10-06T03:23:50.559405+0000","last_unstale":"2023-10-06T03:23:54.559115+0000","last_undegraded":"2023-10-06T03:23:54.559115+0000","last_fullsized":"2023-10-06T03:23:54.559115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:37.459738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.584345+0000","last_change":"2023-10-06T03:23:54.583216+0000","last_active":"2023-10-06T03:23:54.584345+0000","last_peered":"2023-10-06T03:23:54.584345+0000","last_clean":"2023-10-06T03:23:54.584345+0000","last_became_active":"2023-10-06T03:23:54.582867+0000","last_became_peered":"2023-10-06T03:23:54.582867+0000","last_unstale":"2023-10-06T03:23:54.584345+0000","last_undegraded":"2023-10-06T03:23:54.584345+0000","last_fullsized":"2023-10-06T03:23:54.584345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:39.877535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573373+0000","last_change":"2023-10-06T03:23:49.550360+0000","last_active":"2023-10-06T03:23:54.573373+0000","last_peered":"2023-10-06T03:23:54.573373+0000","last_clean":"2023-10-06T03:23:54.573373+0000","last_became_active":"2023-10-06T03:23:49.550065+0000","last_became_peered":"2023-10-06T03:23:49.550065+0000","last_unstale":"2023-10-06T03:23:54.573373+0000","last_undegraded":"2023-10-06T03:23:54.573373+0000","last_fullsized":"2023-10-06T03:23:54.573373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:20.629148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565240+0000","last_change":"2023-10-06T03:23:50.538560+0000","last_active":"2023-10-06T03:23:54.565240+0000","last_peered":"2023-10-06T03:23:54.565240+0000","last_clean":"2023-10-06T03:23:54.565240+0000","last_became_active":"2023-10-06T03:23:50.538280+0000","last_became_peered":"2023-10-06T03:23:50.538280+0000","last_unstale":"2023-10-06T03:23:54.565240+0000","last_undegraded":"2023-10-06T03:23:54.565240+0000","last_fullsized":"2023-10-06T03:23:54.565240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.587526+0000","last_change":"2023-10-06T03:23:54.577798+0000","last_active":"2023-10-06T03:23:54.587526+0000","last_peered":"2023-10-06T03:23:54.587526+0000","last_clean":"2023-10-06T03:23:54.587526+0000","last_became_active":"2023-10-06T03:23:54.577365+0000","last_became_peered":"2023-10-06T03:23:54.577365+0000","last_unstale":"2023-10-06T03:23:54.587526+0000","last_undegraded":"2023-10-06T03:23:54.587526+0000","last_fullsized":"2023-10-06T03:23:54.587526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:29.084904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558191+0000","last_change":"2023-10-06T03:23:49.541525+0000","last_active":"2023-10-06T03:23:54.558191+0000","last_peered":"2023-10-06T03:23:54.558191+0000","last_clean":"2023-10-06T03:23:54.558191+0000","last_became_active":"2023-10-06T03:23:49.541237+0000","last_became_peered":"2023-10-06T03:23:49.541237+0000","last_unstale":"2023-10-06T03:23:54.558191+0000","last_undegraded":"2023-10-06T03:23:54.558191+0000","last_fullsized":"2023-10-06T03:23:54.558191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572886+0000","last_change":"2023-10-06T03:23:50.559460+0000","last_active":"2023-10-06T03:23:54.572886+0000","last_peered":"2023-10-06T03:23:54.572886+0000","last_clean":"2023-10-06T03:23:54.572886+0000","last_became_active":"2023-10-06T03:23:50.559195+0000","last_became_peered":"2023-10-06T03:23:50.559195+0000","last_unstale":"2023-10-06T03:23:54.572886+0000","last_undegraded":"2023-10-06T03:23:54.572886+0000","last_fullsized":"2023-10-06T03:23:54.572886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586096+0000","last_change":"2023-10-06T03:23:54.584333+0000","last_active":"2023-10-06T03:23:54.586096+0000","last_peered":"2023-10-06T03:23:54.586096+0000","last_clean":"2023-10-06T03:23:54.586096+0000","last_became_active":"2023-10-06T03:23:54.583941+0000","last_became_peered":"2023-10-06T03:23:54.583941+0000","last_unstale":"2023-10-06T03:23:54.586096+0000","last_undegraded":"2023-10-06T03:23:54.586096+0000","last_fullsized":"2023-10-06T03:23:54.586096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:41.482140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566163+0000","last_change":"2023-10-06T03:23:49.544125+0000","last_active":"2023-10-06T03:23:54.566163+0000","last_peered":"2023-10-06T03:23:54.566163+0000","last_clean":"2023-10-06T03:23:54.566163+0000","last_became_active":"2023-10-06T03:23:49.543568+0000","last_became_peered":"2023-10-06T03:23:49.543568+0000","last_unstale":"2023-10-06T03:23:54.566163+0000","last_undegraded":"2023-10-06T03:23:54.566163+0000","last_fullsized":"2023-10-06T03:23:54.566163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558099+0000","last_change":"2023-10-06T03:23:50.555547+0000","last_active":"2023-10-06T03:23:54.558099+0000","last_peered":"2023-10-06T03:23:54.558099+0000","last_clean":"2023-10-06T03:23:54.558099+0000","last_became_active":"2023-10-06T03:23:50.555001+0000","last_became_peered":"2023-10-06T03:23:50.555001+0000","last_unstale":"2023-10-06T03:23:54.558099+0000","last_undegraded":"2023-10-06T03:23:54.558099+0000","last_fullsized":"2023-10-06T03:23:54.558099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582762+0000","last_change":"2023-10-06T03:23:54.576856+0000","last_active":"2023-10-06T03:23:54.582762+0000","last_peered":"2023-10-06T03:23:54.582762+0000","last_clean":"2023-10-06T03:23:54.582762+0000","last_became_active":"2023-10-06T03:23:54.576400+0000","last_became_peered":"2023-10-06T03:23:54.576400+0000","last_unstale":"2023-10-06T03:23:54.582762+0000","last_undegraded":"2023-10-06T03:23:54.582762+0000","last_fullsized":"2023-10-06T03:23:54.582762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:38.847179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561597+0000","last_change":"2023-10-06T03:23:49.546821+0000","last_active":"2023-10-06T03:23:54.561597+0000","last_peered":"2023-10-06T03:23:54.561597+0000","last_clean":"2023-10-06T03:23:54.561597+0000","last_became_active":"2023-10-06T03:23:49.546548+0000","last_became_peered":"2023-10-06T03:23:49.546548+0000","last_unstale":"2023-10-06T03:23:54.561597+0000","last_undegraded":"2023-10-06T03:23:54.561597+0000","last_fullsized":"2023-10-06T03:23:54.561597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557846+0000","last_change":"2023-10-06T03:23:50.555413+0000","last_active":"2023-10-06T03:23:54.557846+0000","last_peered":"2023-10-06T03:23:54.557846+0000","last_clean":"2023-10-06T03:23:54.557846+0000","last_became_active":"2023-10-06T03:23:50.554715+0000","last_became_peered":"2023-10-06T03:23:50.554715+0000","last_unstale":"2023-10-06T03:23:54.557846+0000","last_undegraded":"2023-10-06T03:23:54.557846+0000","last_fullsized":"2023-10-06T03:23:54.557846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:04.343209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.577965+0000","last_change":"2023-10-06T03:23:54.573885+0000","last_active":"2023-10-06T03:23:54.577965+0000","last_peered":"2023-10-06T03:23:54.577965+0000","last_clean":"2023-10-06T03:23:54.577965+0000","last_became_active":"2023-10-06T03:23:54.573501+0000","last_became_peered":"2023-10-06T03:23:54.573501+0000","last_unstale":"2023-10-06T03:23:54.577965+0000","last_undegraded":"2023-10-06T03:23:54.577965+0000","last_fullsized":"2023-10-06T03:23:54.577965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:11.874759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561246+0000","last_change":"2023-10-06T03:23:49.549842+0000","last_active":"2023-10-06T03:23:54.561246+0000","last_peered":"2023-10-06T03:23:54.561246+0000","last_clean":"2023-10-06T03:23:54.561246+0000","last_became_active":"2023-10-06T03:23:49.549552+0000","last_became_peered":"2023-10-06T03:23:49.549552+0000","last_unstale":"2023-10-06T03:23:54.561246+0000","last_undegraded":"2023-10-06T03:23:54.561246+0000","last_fullsized":"2023-10-06T03:23:54.561246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:46.154308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574142+0000","last_change":"2023-10-06T03:23:50.556593+0000","last_active":"2023-10-06T03:23:54.574142+0000","last_peered":"2023-10-06T03:23:54.574142+0000","last_clean":"2023-10-06T03:23:54.574142+0000","last_became_active":"2023-10-06T03:23:50.556291+0000","last_became_peered":"2023-10-06T03:23:50.556291+0000","last_unstale":"2023-10-06T03:23:54.574142+0000","last_undegraded":"2023-10-06T03:23:54.574142+0000","last_fullsized":"2023-10-06T03:23:54.574142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.386684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586726+0000","last_change":"2023-10-06T03:23:54.585687+0000","last_active":"2023-10-06T03:23:54.586726+0000","last_peered":"2023-10-06T03:23:54.586726+0000","last_clean":"2023-10-06T03:23:54.586726+0000","last_became_active":"2023-10-06T03:23:54.585174+0000","last_became_peered":"2023-10-06T03:23:54.585174+0000","last_unstale":"2023-10-06T03:23:54.586726+0000","last_undegraded":"2023-10-06T03:23:54.586726+0000","last_fullsized":"2023-10-06T03:23:54.586726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:28.830749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:24:00.300578+0000","last_change":"2023-10-06T03:23:49.542417+0000","last_active":"2023-10-06T03:24:00.300578+0000","last_peered":"2023-10-06T03:24:00.300578+0000","last_clean":"2023-10-06T03:24:00.300578+0000","last_became_active":"2023-10-06T03:23:49.541619+0000","last_became_peered":"2023-10-06T03:23:49.541619+0000","last_unstale":"2023-10-06T03:24:00.300578+0000","last_undegraded":"2023-10-06T03:24:00.300578+0000","last_fullsized":"2023-10-06T03:24:00.300578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570210+0000","last_change":"2023-10-06T03:23:50.553384+0000","last_active":"2023-10-06T03:23:54.570210+0000","last_peered":"2023-10-06T03:23:54.570210+0000","last_clean":"2023-10-06T03:23:54.570210+0000","last_became_active":"2023-10-06T03:23:50.553071+0000","last_became_peered":"2023-10-06T03:23:50.553071+0000","last_unstale":"2023-10-06T03:23:54.570210+0000","last_undegraded":"2023-10-06T03:23:54.570210+0000","last_fullsized":"2023-10-06T03:23:54.570210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582553+0000","last_change":"2023-10-06T03:23:54.576003+0000","last_active":"2023-10-06T03:23:54.582553+0000","last_peered":"2023-10-06T03:23:54.582553+0000","last_clean":"2023-10-06T03:23:54.582553+0000","last_became_active":"2023-10-06T03:23:54.575595+0000","last_became_peered":"2023-10-06T03:23:54.575595+0000","last_unstale":"2023-10-06T03:23:54.582553+0000","last_undegraded":"2023-10-06T03:23:54.582553+0000","last_fullsized":"2023-10-06T03:23:54.582553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:56.213189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561136+0000","last_change":"2023-10-06T03:23:49.553574+0000","last_active":"2023-10-06T03:23:54.561136+0000","last_peered":"2023-10-06T03:23:54.561136+0000","last_clean":"2023-10-06T03:23:54.561136+0000","last_became_active":"2023-10-06T03:23:49.553287+0000","last_became_peered":"2023-10-06T03:23:49.553287+0000","last_unstale":"2023-10-06T03:23:54.561136+0000","last_undegraded":"2023-10-06T03:23:54.561136+0000","last_fullsized":"2023-10-06T03:23:54.561136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:30.660149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558194+0000","last_change":"2023-10-06T03:23:50.559333+0000","last_active":"2023-10-06T03:23:54.558194+0000","last_peered":"2023-10-06T03:23:54.558194+0000","last_clean":"2023-10-06T03:23:54.558194+0000","last_became_active":"2023-10-06T03:23:50.554903+0000","last_became_peered":"2023-10-06T03:23:50.554903+0000","last_unstale":"2023-10-06T03:23:54.558194+0000","last_undegraded":"2023-10-06T03:23:54.558194+0000","last_fullsized":"2023-10-06T03:23:54.558194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.578775+0000","last_change":"2023-10-06T03:23:54.576737+0000","last_active":"2023-10-06T03:23:54.578775+0000","last_peered":"2023-10-06T03:23:54.578775+0000","last_clean":"2023-10-06T03:23:54.578775+0000","last_became_active":"2023-10-06T03:23:54.576315+0000","last_became_peered":"2023-10-06T03:23:54.576315+0000","last_unstale":"2023-10-06T03:23:54.578775+0000","last_undegraded":"2023-10-06T03:23:54.578775+0000","last_fullsized":"2023-10-06T03:23:54.578775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:23.573045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565078+0000","last_change":"2023-10-06T03:23:49.541373+0000","last_active":"2023-10-06T03:23:54.565078+0000","last_peered":"2023-10-06T03:23:54.565078+0000","last_clean":"2023-10-06T03:23:54.565078+0000","last_became_active":"2023-10-06T03:23:49.541117+0000","last_became_peered":"2023-10-06T03:23:49.541117+0000","last_unstale":"2023-10-06T03:23:54.565078+0000","last_undegraded":"2023-10-06T03:23:54.565078+0000","last_fullsized":"2023-10-06T03:23:54.565078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:44.960845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561590+0000","last_change":"2023-10-06T03:23:50.552104+0000","last_active":"2023-10-06T03:23:54.561590+0000","last_peered":"2023-10-06T03:23:54.561590+0000","last_clean":"2023-10-06T03:23:54.561590+0000","last_became_active":"2023-10-06T03:23:50.550706+0000","last_became_peered":"2023-10-06T03:23:50.550706+0000","last_unstale":"2023-10-06T03:23:54.561590+0000","last_undegraded":"2023-10-06T03:23:54.561590+0000","last_fullsized":"2023-10-06T03:23:54.561590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.578733+0000","last_change":"2023-10-06T03:23:54.576258+0000","last_active":"2023-10-06T03:23:54.578733+0000","last_peered":"2023-10-06T03:23:54.578733+0000","last_clean":"2023-10-06T03:23:54.578733+0000","last_became_active":"2023-10-06T03:23:54.575885+0000","last_became_peered":"2023-10-06T03:23:54.575885+0000","last_unstale":"2023-10-06T03:23:54.578733+0000","last_undegraded":"2023-10-06T03:23:54.578733+0000","last_fullsized":"2023-10-06T03:23:54.578733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:34.771595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560193+0000","last_change":"2023-10-06T03:23:49.550646+0000","last_active":"2023-10-06T03:23:54.560193+0000","last_peered":"2023-10-06T03:23:54.560193+0000","last_clean":"2023-10-06T03:23:54.560193+0000","last_became_active":"2023-10-06T03:23:49.550390+0000","last_became_peered":"2023-10-06T03:23:49.550390+0000","last_unstale":"2023-10-06T03:23:54.560193+0000","last_undegraded":"2023-10-06T03:23:54.560193+0000","last_fullsized":"2023-10-06T03:23:54.560193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:26.970739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565649+0000","last_change":"2023-10-06T03:23:50.546312+0000","last_active":"2023-10-06T03:23:54.565649+0000","last_peered":"2023-10-06T03:23:54.565649+0000","last_clean":"2023-10-06T03:23:54.565649+0000","last_became_active":"2023-10-06T03:23:50.546061+0000","last_became_peered":"2023-10-06T03:23:50.546061+0000","last_unstale":"2023-10-06T03:23:54.565649+0000","last_undegraded":"2023-10-06T03:23:54.565649+0000","last_fullsized":"2023-10-06T03:23:54.565649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582076+0000","last_change":"2023-10-06T03:23:54.576371+0000","last_active":"2023-10-06T03:23:54.582076+0000","last_peered":"2023-10-06T03:23:54.582076+0000","last_clean":"2023-10-06T03:23:54.582076+0000","last_became_active":"2023-10-06T03:23:54.576017+0000","last_became_peered":"2023-10-06T03:23:54.576017+0000","last_unstale":"2023-10-06T03:23:54.582076+0000","last_undegraded":"2023-10-06T03:23:54.582076+0000","last_fullsized":"2023-10-06T03:23:54.582076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:38.847179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572371+0000","last_change":"2023-10-06T03:23:49.546273+0000","last_active":"2023-10-06T03:23:54.572371+0000","last_peered":"2023-10-06T03:23:54.572371+0000","last_clean":"2023-10-06T03:23:54.572371+0000","last_became_active":"2023-10-06T03:23:49.546030+0000","last_became_peered":"2023-10-06T03:23:49.546030+0000","last_unstale":"2023-10-06T03:23:54.572371+0000","last_undegraded":"2023-10-06T03:23:54.572371+0000","last_fullsized":"2023-10-06T03:23:54.572371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560122+0000","last_change":"2023-10-06T03:23:50.552633+0000","last_active":"2023-10-06T03:23:54.560122+0000","last_peered":"2023-10-06T03:23:54.560122+0000","last_clean":"2023-10-06T03:23:54.560122+0000","last_became_active":"2023-10-06T03:23:50.552401+0000","last_became_peered":"2023-10-06T03:23:50.552401+0000","last_unstale":"2023-10-06T03:23:54.560122+0000","last_undegraded":"2023-10-06T03:23:54.560122+0000","last_fullsized":"2023-10-06T03:23:54.560122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582883+0000","last_change":"2023-10-06T03:23:54.575577+0000","last_active":"2023-10-06T03:23:54.582883+0000","last_peered":"2023-10-06T03:23:54.582883+0000","last_clean":"2023-10-06T03:23:54.582883+0000","last_became_active":"2023-10-06T03:23:54.575207+0000","last_became_peered":"2023-10-06T03:23:54.575207+0000","last_unstale":"2023-10-06T03:23:54.582883+0000","last_undegraded":"2023-10-06T03:23:54.582883+0000","last_fullsized":"2023-10-06T03:23:54.582883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561649+0000","last_change":"2023-10-06T03:23:49.551635+0000","last_active":"2023-10-06T03:23:54.561649+0000","last_peered":"2023-10-06T03:23:54.561649+0000","last_clean":"2023-10-06T03:23:54.561649+0000","last_became_active":"2023-10-06T03:23:49.551383+0000","last_became_peered":"2023-10-06T03:23:49.551383+0000","last_unstale":"2023-10-06T03:23:54.561649+0000","last_undegraded":"2023-10-06T03:23:54.561649+0000","last_fullsized":"2023-10-06T03:23:54.561649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:28.615722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559800+0000","last_change":"2023-10-06T03:23:50.551380+0000","last_active":"2023-10-06T03:23:54.559800+0000","last_peered":"2023-10-06T03:23:54.559800+0000","last_clean":"2023-10-06T03:23:54.559800+0000","last_became_active":"2023-10-06T03:23:50.551113+0000","last_became_peered":"2023-10-06T03:23:50.551113+0000","last_unstale":"2023-10-06T03:23:54.559800+0000","last_undegraded":"2023-10-06T03:23:54.559800+0000","last_fullsized":"2023-10-06T03:23:54.559800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:28.082470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582682+0000","last_change":"2023-10-06T03:23:54.578999+0000","last_active":"2023-10-06T03:23:54.582682+0000","last_peered":"2023-10-06T03:23:54.582682+0000","last_clean":"2023-10-06T03:23:54.582682+0000","last_became_active":"2023-10-06T03:23:54.578680+0000","last_became_peered":"2023-10-06T03:23:54.578680+0000","last_unstale":"2023-10-06T03:23:54.582682+0000","last_undegraded":"2023-10-06T03:23:54.582682+0000","last_fullsized":"2023-10-06T03:23:54.582682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:46.387578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561434+0000","last_change":"2023-10-06T03:23:49.551746+0000","last_active":"2023-10-06T03:23:54.561434+0000","last_peered":"2023-10-06T03:23:54.561434+0000","last_clean":"2023-10-06T03:23:54.561434+0000","last_became_active":"2023-10-06T03:23:49.551502+0000","last_became_peered":"2023-10-06T03:23:49.551502+0000","last_unstale":"2023-10-06T03:23:54.561434+0000","last_undegraded":"2023-10-06T03:23:54.561434+0000","last_fullsized":"2023-10-06T03:23:54.561434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:16.290952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568892+0000","last_change":"2023-10-06T03:23:50.553384+0000","last_active":"2023-10-06T03:23:54.568892+0000","last_peered":"2023-10-06T03:23:54.568892+0000","last_clean":"2023-10-06T03:23:54.568892+0000","last_became_active":"2023-10-06T03:23:50.553111+0000","last_became_peered":"2023-10-06T03:23:50.553111+0000","last_unstale":"2023-10-06T03:23:54.568892+0000","last_undegraded":"2023-10-06T03:23:54.568892+0000","last_fullsized":"2023-10-06T03:23:54.568892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:29.722975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581802+0000","last_change":"2023-10-06T03:23:54.577157+0000","last_active":"2023-10-06T03:23:54.581802+0000","last_peered":"2023-10-06T03:23:54.581802+0000","last_clean":"2023-10-06T03:23:54.581802+0000","last_became_active":"2023-10-06T03:23:54.576783+0000","last_became_peered":"2023-10-06T03:23:54.576783+0000","last_unstale":"2023-10-06T03:23:54.581802+0000","last_undegraded":"2023-10-06T03:23:54.581802+0000","last_fullsized":"2023-10-06T03:23:54.581802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:07.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561143+0000","last_change":"2023-10-06T03:23:49.548189+0000","last_active":"2023-10-06T03:23:54.561143+0000","last_peered":"2023-10-06T03:23:54.561143+0000","last_clean":"2023-10-06T03:23:54.561143+0000","last_became_active":"2023-10-06T03:23:49.547936+0000","last_became_peered":"2023-10-06T03:23:49.547936+0000","last_unstale":"2023-10-06T03:23:54.561143+0000","last_undegraded":"2023-10-06T03:23:54.561143+0000","last_fullsized":"2023-10-06T03:23:54.561143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:42.983966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572005+0000","last_change":"2023-10-06T03:23:50.554414+0000","last_active":"2023-10-06T03:23:54.572005+0000","last_peered":"2023-10-06T03:23:54.572005+0000","last_clean":"2023-10-06T03:23:54.572005+0000","last_became_active":"2023-10-06T03:23:50.554126+0000","last_became_peered":"2023-10-06T03:23:50.554126+0000","last_unstale":"2023-10-06T03:23:54.572005+0000","last_undegraded":"2023-10-06T03:23:54.572005+0000","last_fullsized":"2023-10-06T03:23:54.572005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582750+0000","last_change":"2023-10-06T03:23:54.577469+0000","last_active":"2023-10-06T03:23:54.582750+0000","last_peered":"2023-10-06T03:23:54.582750+0000","last_clean":"2023-10-06T03:23:54.582750+0000","last_became_active":"2023-10-06T03:23:54.577100+0000","last_became_peered":"2023-10-06T03:23:54.577100+0000","last_unstale":"2023-10-06T03:23:54.582750+0000","last_undegraded":"2023-10-06T03:23:54.582750+0000","last_fullsized":"2023-10-06T03:23:54.582750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:41.482140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560302+0000","last_change":"2023-10-06T03:23:49.551245+0000","last_active":"2023-10-06T03:23:54.560302+0000","last_peered":"2023-10-06T03:23:54.560302+0000","last_clean":"2023-10-06T03:23:54.560302+0000","last_became_active":"2023-10-06T03:23:49.550981+0000","last_became_peered":"2023-10-06T03:23:49.550981+0000","last_unstale":"2023-10-06T03:23:54.560302+0000","last_undegraded":"2023-10-06T03:23:54.560302+0000","last_fullsized":"2023-10-06T03:23:54.560302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567343+0000","last_change":"2023-10-06T03:23:50.546972+0000","last_active":"2023-10-06T03:23:54.567343+0000","last_peered":"2023-10-06T03:23:54.567343+0000","last_clean":"2023-10-06T03:23:54.567343+0000","last_became_active":"2023-10-06T03:23:50.546729+0000","last_became_peered":"2023-10-06T03:23:50.546729+0000","last_unstale":"2023-10-06T03:23:54.567343+0000","last_undegraded":"2023-10-06T03:23:54.567343+0000","last_fullsized":"2023-10-06T03:23:54.567343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581894+0000","last_change":"2023-10-06T03:23:54.576116+0000","last_active":"2023-10-06T03:23:54.581894+0000","last_peered":"2023-10-06T03:23:54.581894+0000","last_clean":"2023-10-06T03:23:54.581894+0000","last_became_active":"2023-10-06T03:23:54.575714+0000","last_became_peered":"2023-10-06T03:23:54.575714+0000","last_unstale":"2023-10-06T03:23:54.581894+0000","last_undegraded":"2023-10-06T03:23:54.581894+0000","last_fullsized":"2023-10-06T03:23:54.581894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:33.745377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558207+0000","last_change":"2023-10-06T03:23:49.549931+0000","last_active":"2023-10-06T03:23:54.558207+0000","last_peered":"2023-10-06T03:23:54.558207+0000","last_clean":"2023-10-06T03:23:54.558207+0000","last_became_active":"2023-10-06T03:23:49.549675+0000","last_became_peered":"2023-10-06T03:23:49.549675+0000","last_unstale":"2023-10-06T03:23:54.558207+0000","last_undegraded":"2023-10-06T03:23:54.558207+0000","last_fullsized":"2023-10-06T03:23:54.558207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569852+0000","last_change":"2023-10-06T03:23:50.560836+0000","last_active":"2023-10-06T03:23:54.569852+0000","last_peered":"2023-10-06T03:23:54.569852+0000","last_clean":"2023-10-06T03:23:54.569852+0000","last_became_active":"2023-10-06T03:23:50.560582+0000","last_became_peered":"2023-10-06T03:23:50.560582+0000","last_unstale":"2023-10-06T03:23:54.569852+0000","last_undegraded":"2023-10-06T03:23:54.569852+0000","last_fullsized":"2023-10-06T03:23:54.569852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:53.298950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582964+0000","last_change":"2023-10-06T03:23:54.580383+0000","last_active":"2023-10-06T03:23:54.582964+0000","last_peered":"2023-10-06T03:23:54.582964+0000","last_clean":"2023-10-06T03:23:54.582964+0000","last_became_active":"2023-10-06T03:23:54.580033+0000","last_became_peered":"2023-10-06T03:23:54.580033+0000","last_unstale":"2023-10-06T03:23:54.582964+0000","last_undegraded":"2023-10-06T03:23:54.582964+0000","last_fullsized":"2023-10-06T03:23:54.582964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:01.313140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572093+0000","last_change":"2023-10-06T03:23:49.551405+0000","last_active":"2023-10-06T03:23:54.572093+0000","last_peered":"2023-10-06T03:23:54.572093+0000","last_clean":"2023-10-06T03:23:54.572093+0000","last_became_active":"2023-10-06T03:23:49.551030+0000","last_became_peered":"2023-10-06T03:23:49.551030+0000","last_unstale":"2023-10-06T03:23:54.572093+0000","last_undegraded":"2023-10-06T03:23:54.572093+0000","last_fullsized":"2023-10-06T03:23:54.572093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569949+0000","last_change":"2023-10-06T03:23:50.547982+0000","last_active":"2023-10-06T03:23:54.569949+0000","last_peered":"2023-10-06T03:23:54.569949+0000","last_clean":"2023-10-06T03:23:54.569949+0000","last_became_active":"2023-10-06T03:23:50.547602+0000","last_became_peered":"2023-10-06T03:23:50.547602+0000","last_unstale":"2023-10-06T03:23:54.569949+0000","last_undegraded":"2023-10-06T03:23:54.569949+0000","last_fullsized":"2023-10-06T03:23:54.569949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:03.745193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582140+0000","last_change":"2023-10-06T03:23:54.575198+0000","last_active":"2023-10-06T03:23:54.582140+0000","last_peered":"2023-10-06T03:23:54.582140+0000","last_clean":"2023-10-06T03:23:54.582140+0000","last_became_active":"2023-10-06T03:23:54.574788+0000","last_became_peered":"2023-10-06T03:23:54.574788+0000","last_unstale":"2023-10-06T03:23:54.582140+0000","last_undegraded":"2023-10-06T03:23:54.582140+0000","last_fullsized":"2023-10-06T03:23:54.582140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:20.930646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568731+0000","last_change":"2023-10-06T03:23:49.538200+0000","last_active":"2023-10-06T03:23:54.568731+0000","last_peered":"2023-10-06T03:23:54.568731+0000","last_clean":"2023-10-06T03:23:54.568731+0000","last_became_active":"2023-10-06T03:23:49.537928+0000","last_became_peered":"2023-10-06T03:23:49.537928+0000","last_unstale":"2023-10-06T03:23:54.568731+0000","last_undegraded":"2023-10-06T03:23:54.568731+0000","last_fullsized":"2023-10-06T03:23:54.568731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570161+0000","last_change":"2023-10-06T03:23:50.552986+0000","last_active":"2023-10-06T03:23:54.570161+0000","last_peered":"2023-10-06T03:23:54.570161+0000","last_clean":"2023-10-06T03:23:54.570161+0000","last_became_active":"2023-10-06T03:23:50.552689+0000","last_became_peered":"2023-10-06T03:23:50.552689+0000","last_unstale":"2023-10-06T03:23:54.570161+0000","last_undegraded":"2023-10-06T03:23:54.570161+0000","last_fullsized":"2023-10-06T03:23:54.570161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.579868+0000","last_change":"2023-10-06T03:23:54.578003+0000","last_active":"2023-10-06T03:23:54.579868+0000","last_peered":"2023-10-06T03:23:54.579868+0000","last_clean":"2023-10-06T03:23:54.579868+0000","last_became_active":"2023-10-06T03:23:54.577637+0000","last_became_peered":"2023-10-06T03:23:54.577637+0000","last_unstale":"2023-10-06T03:23:54.579868+0000","last_undegraded":"2023-10-06T03:23:54.579868+0000","last_fullsized":"2023-10-06T03:23:54.579868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:14.629579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557999+0000","last_change":"2023-10-06T03:23:49.550476+0000","last_active":"2023-10-06T03:23:54.557999+0000","last_peered":"2023-10-06T03:23:54.557999+0000","last_clean":"2023-10-06T03:23:54.557999+0000","last_became_active":"2023-10-06T03:23:49.549380+0000","last_became_peered":"2023-10-06T03:23:49.549380+0000","last_unstale":"2023-10-06T03:23:54.557999+0000","last_undegraded":"2023-10-06T03:23:54.557999+0000","last_fullsized":"2023-10-06T03:23:54.557999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.028565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574909+0000","last_change":"2023-10-06T03:23:50.556274+0000","last_active":"2023-10-06T03:23:54.574909+0000","last_peered":"2023-10-06T03:23:54.574909+0000","last_clean":"2023-10-06T03:23:54.574909+0000","last_became_active":"2023-10-06T03:23:50.555698+0000","last_became_peered":"2023-10-06T03:23:50.555698+0000","last_unstale":"2023-10-06T03:23:54.574909+0000","last_undegraded":"2023-10-06T03:23:54.574909+0000","last_fullsized":"2023-10-06T03:23:54.574909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585484+0000","last_change":"2023-10-06T03:23:54.583261+0000","last_active":"2023-10-06T03:23:54.585484+0000","last_peered":"2023-10-06T03:23:54.585484+0000","last_clean":"2023-10-06T03:23:54.585484+0000","last_became_active":"2023-10-06T03:23:54.582906+0000","last_became_peered":"2023-10-06T03:23:54.582906+0000","last_unstale":"2023-10-06T03:23:54.585484+0000","last_undegraded":"2023-10-06T03:23:54.585484+0000","last_fullsized":"2023-10-06T03:23:54.585484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:49.490384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559423+0000","last_change":"2023-10-06T03:23:49.542977+0000","last_active":"2023-10-06T03:23:54.559423+0000","last_peered":"2023-10-06T03:23:54.559423+0000","last_clean":"2023-10-06T03:23:54.559423+0000","last_became_active":"2023-10-06T03:23:49.541527+0000","last_became_peered":"2023-10-06T03:23:49.541527+0000","last_unstale":"2023-10-06T03:23:54.559423+0000","last_undegraded":"2023-10-06T03:23:54.559423+0000","last_fullsized":"2023-10-06T03:23:54.559423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570117+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:23:54.570117+0000","last_peered":"2023-10-06T03:23:54.570117+0000","last_clean":"2023-10-06T03:23:54.570117+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:23:54.570117+0000","last_undegraded":"2023-10-06T03:23:54.570117+0000","last_fullsized":"2023-10-06T03:23:54.570117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557888+0000","last_change":"2023-10-06T03:23:50.559454+0000","last_active":"2023-10-06T03:23:54.557888+0000","last_peered":"2023-10-06T03:23:54.557888+0000","last_clean":"2023-10-06T03:23:54.557888+0000","last_became_active":"2023-10-06T03:23:50.554761+0000","last_became_peered":"2023-10-06T03:23:50.554761+0000","last_unstale":"2023-10-06T03:23:54.557888+0000","last_undegraded":"2023-10-06T03:23:54.557888+0000","last_fullsized":"2023-10-06T03:23:54.557888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:42.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585917+0000","last_change":"2023-10-06T03:23:54.583446+0000","last_active":"2023-10-06T03:23:54.585917+0000","last_peered":"2023-10-06T03:23:54.585917+0000","last_clean":"2023-10-06T03:23:54.585917+0000","last_became_active":"2023-10-06T03:23:54.583023+0000","last_became_peered":"2023-10-06T03:23:54.583023+0000","last_unstale":"2023-10-06T03:23:54.585917+0000","last_undegraded":"2023-10-06T03:23:54.585917+0000","last_fullsized":"2023-10-06T03:23:54.585917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:03.806535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558092+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:23:54.558092+0000","last_peered":"2023-10-06T03:23:54.558092+0000","last_clean":"2023-10-06T03:23:54.558092+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:23:54.558092+0000","last_undegraded":"2023-10-06T03:23:54.558092+0000","last_fullsized":"2023-10-06T03:23:54.558092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.618705+0000","last_change":"2023-10-06T03:23:49.546452+0000","last_active":"2023-10-06T03:23:54.618705+0000","last_peered":"2023-10-06T03:23:54.618705+0000","last_clean":"2023-10-06T03:23:54.618705+0000","last_became_active":"2023-10-06T03:23:49.545885+0000","last_became_peered":"2023-10-06T03:23:49.545885+0000","last_unstale":"2023-10-06T03:23:54.618705+0000","last_undegraded":"2023-10-06T03:23:54.618705+0000","last_fullsized":"2023-10-06T03:23:54.618705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568810+0000","last_change":"2023-10-06T03:23:50.550474+0000","last_active":"2023-10-06T03:23:54.568810+0000","last_peered":"2023-10-06T03:23:54.568810+0000","last_clean":"2023-10-06T03:23:54.568810+0000","last_became_active":"2023-10-06T03:23:50.550207+0000","last_became_peered":"2023-10-06T03:23:50.550207+0000","last_unstale":"2023-10-06T03:23:54.568810+0000","last_undegraded":"2023-10-06T03:23:54.568810+0000","last_fullsized":"2023-10-06T03:23:54.568810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:42.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582115+0000","last_change":"2023-10-06T03:23:54.574338+0000","last_active":"2023-10-06T03:23:54.582115+0000","last_peered":"2023-10-06T03:23:54.582115+0000","last_clean":"2023-10-06T03:23:54.582115+0000","last_became_active":"2023-10-06T03:23:54.573845+0000","last_became_peered":"2023-10-06T03:23:54.573845+0000","last_unstale":"2023-10-06T03:23:54.582115+0000","last_undegraded":"2023-10-06T03:23:54.582115+0000","last_fullsized":"2023-10-06T03:23:54.582115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574305+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:23:54.574305+0000","last_peered":"2023-10-06T03:23:54.574305+0000","last_clean":"2023-10-06T03:23:54.574305+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:23:54.574305+0000","last_undegraded":"2023-10-06T03:23:54.574305+0000","last_fullsized":"2023-10-06T03:23:54.574305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560457+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:23:54.560457+0000","last_peered":"2023-10-06T03:23:54.560457+0000","last_clean":"2023-10-06T03:23:54.560457+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:23:54.560457+0000","last_undegraded":"2023-10-06T03:23:54.560457+0000","last_fullsized":"2023-10-06T03:23:54.560457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.564914+0000","last_change":"2023-10-06T03:23:49.548108+0000","last_active":"2023-10-06T03:23:54.564914+0000","last_peered":"2023-10-06T03:23:54.564914+0000","last_clean":"2023-10-06T03:23:54.564914+0000","last_became_active":"2023-10-06T03:23:49.547822+0000","last_became_peered":"2023-10-06T03:23:49.547822+0000","last_unstale":"2023-10-06T03:23:54.564914+0000","last_undegraded":"2023-10-06T03:23:54.564914+0000","last_fullsized":"2023-10-06T03:23:54.564914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565572+0000","last_change":"2023-10-06T03:23:50.553282+0000","last_active":"2023-10-06T03:23:54.565572+0000","last_peered":"2023-10-06T03:23:54.565572+0000","last_clean":"2023-10-06T03:23:54.565572+0000","last_became_active":"2023-10-06T03:23:50.553022+0000","last_became_peered":"2023-10-06T03:23:50.553022+0000","last_unstale":"2023-10-06T03:23:54.565572+0000","last_undegraded":"2023-10-06T03:23:54.565572+0000","last_fullsized":"2023-10-06T03:23:54.565572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585122+0000","last_change":"2023-10-06T03:23:54.579225+0000","last_active":"2023-10-06T03:23:54.585122+0000","last_peered":"2023-10-06T03:23:54.585122+0000","last_clean":"2023-10-06T03:23:54.585122+0000","last_became_active":"2023-10-06T03:23:54.578772+0000","last_became_peered":"2023-10-06T03:23:54.578772+0000","last_unstale":"2023-10-06T03:23:54.585122+0000","last_undegraded":"2023-10-06T03:23:54.585122+0000","last_fullsized":"2023-10-06T03:23:54.585122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:20.332751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.562142+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:23:54.562142+0000","last_peered":"2023-10-06T03:23:54.562142+0000","last_clean":"2023-10-06T03:23:54.562142+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:23:54.562142+0000","last_undegraded":"2023-10-06T03:23:54.562142+0000","last_fullsized":"2023-10-06T03:23:54.562142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573464+0000","last_change":"2023-10-06T03:23:49.543301+0000","last_active":"2023-10-06T03:23:54.573464+0000","last_peered":"2023-10-06T03:23:54.573464+0000","last_clean":"2023-10-06T03:23:54.573464+0000","last_became_active":"2023-10-06T03:23:49.543042+0000","last_became_peered":"2023-10-06T03:23:49.543042+0000","last_unstale":"2023-10-06T03:23:54.573464+0000","last_undegraded":"2023-10-06T03:23:54.573464+0000","last_fullsized":"2023-10-06T03:23:54.573464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:01.161389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574803+0000","last_change":"2023-10-06T03:23:50.556439+0000","last_active":"2023-10-06T03:23:54.574803+0000","last_peered":"2023-10-06T03:23:54.574803+0000","last_clean":"2023-10-06T03:23:54.574803+0000","last_became_active":"2023-10-06T03:23:50.556043+0000","last_became_peered":"2023-10-06T03:23:50.556043+0000","last_unstale":"2023-10-06T03:23:54.574803+0000","last_undegraded":"2023-10-06T03:23:54.574803+0000","last_fullsized":"2023-10-06T03:23:54.574803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:28.082470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.583328+0000","last_change":"2023-10-06T03:23:54.577530+0000","last_active":"2023-10-06T03:23:54.583328+0000","last_peered":"2023-10-06T03:23:54.583328+0000","last_clean":"2023-10-06T03:23:54.583328+0000","last_became_active":"2023-10-06T03:23:54.577161+0000","last_became_peered":"2023-10-06T03:23:54.577161+0000","last_unstale":"2023-10-06T03:23:54.583328+0000","last_undegraded":"2023-10-06T03:23:54.583328+0000","last_fullsized":"2023-10-06T03:23:54.583328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:01.313140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560295+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:23:54.560295+0000","last_peered":"2023-10-06T03:23:54.560295+0000","last_clean":"2023-10-06T03:23:54.560295+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:23:54.560295+0000","last_undegraded":"2023-10-06T03:23:54.560295+0000","last_fullsized":"2023-10-06T03:23:54.560295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558696+0000","last_change":"2023-10-06T03:23:49.548616+0000","last_active":"2023-10-06T03:23:54.558696+0000","last_peered":"2023-10-06T03:23:54.558696+0000","last_clean":"2023-10-06T03:23:54.558696+0000","last_became_active":"2023-10-06T03:23:49.548377+0000","last_became_peered":"2023-10-06T03:23:49.548377+0000","last_unstale":"2023-10-06T03:23:54.558696+0000","last_undegraded":"2023-10-06T03:23:54.558696+0000","last_fullsized":"2023-10-06T03:23:54.558696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:44.960845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572427+0000","last_change":"2023-10-06T03:23:50.558690+0000","last_active":"2023-10-06T03:23:54.572427+0000","last_peered":"2023-10-06T03:23:54.572427+0000","last_clean":"2023-10-06T03:23:54.572427+0000","last_became_active":"2023-10-06T03:23:50.558466+0000","last_became_peered":"2023-10-06T03:23:50.558466+0000","last_unstale":"2023-10-06T03:23:54.572427+0000","last_undegraded":"2023-10-06T03:23:54.572427+0000","last_fullsized":"2023-10-06T03:23:54.572427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.386684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.588069+0000","last_change":"2023-10-06T03:23:54.579261+0000","last_active":"2023-10-06T03:23:54.588069+0000","last_peered":"2023-10-06T03:23:54.588069+0000","last_clean":"2023-10-06T03:23:54.588069+0000","last_became_active":"2023-10-06T03:23:54.578854+0000","last_became_peered":"2023-10-06T03:23:54.578854+0000","last_unstale":"2023-10-06T03:23:54.588069+0000","last_undegraded":"2023-10-06T03:23:54.588069+0000","last_fullsized":"2023-10-06T03:23:54.588069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:26.465848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560024+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:23:54.560024+0000","last_peered":"2023-10-06T03:23:54.560024+0000","last_clean":"2023-10-06T03:23:54.560024+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:23:54.560024+0000","last_undegraded":"2023-10-06T03:23:54.560024+0000","last_fullsized":"2023-10-06T03:23:54.560024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570037+0000","last_change":"2023-10-06T03:23:49.547635+0000","last_active":"2023-10-06T03:23:54.570037+0000","last_peered":"2023-10-06T03:23:54.570037+0000","last_clean":"2023-10-06T03:23:54.570037+0000","last_became_active":"2023-10-06T03:23:49.545752+0000","last_became_peered":"2023-10-06T03:23:49.545752+0000","last_unstale":"2023-10-06T03:23:54.570037+0000","last_undegraded":"2023-10-06T03:23:54.570037+0000","last_fullsized":"2023-10-06T03:23:54.570037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574483+0000","last_change":"2023-10-06T03:23:50.549324+0000","last_active":"2023-10-06T03:23:54.574483+0000","last_peered":"2023-10-06T03:23:54.574483+0000","last_clean":"2023-10-06T03:23:54.574483+0000","last_became_active":"2023-10-06T03:23:50.546439+0000","last_became_peered":"2023-10-06T03:23:50.546439+0000","last_unstale":"2023-10-06T03:23:54.574483+0000","last_undegraded":"2023-10-06T03:23:54.574483+0000","last_fullsized":"2023-10-06T03:23:54.574483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:21.033440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.583424+0000","last_change":"2023-10-06T03:23:54.579994+0000","last_active":"2023-10-06T03:23:54.583424+0000","last_peered":"2023-10-06T03:23:54.583424+0000","last_clean":"2023-10-06T03:23:54.583424+0000","last_became_active":"2023-10-06T03:23:54.579608+0000","last_became_peered":"2023-10-06T03:23:54.579608+0000","last_unstale":"2023-10-06T03:23:54.583424+0000","last_undegraded":"2023-10-06T03:23:54.583424+0000","last_fullsized":"2023-10-06T03:23:54.583424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:43.155244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572140+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:23:54.572140+0000","last_peered":"2023-10-06T03:23:54.572140+0000","last_clean":"2023-10-06T03:23:54.572140+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:23:54.572140+0000","last_undegraded":"2023-10-06T03:23:54.572140+0000","last_fullsized":"2023-10-06T03:23:54.572140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574682+0000","last_change":"2023-10-06T03:23:49.545180+0000","last_active":"2023-10-06T03:23:54.574682+0000","last_peered":"2023-10-06T03:23:54.574682+0000","last_clean":"2023-10-06T03:23:54.574682+0000","last_became_active":"2023-10-06T03:23:49.544948+0000","last_became_peered":"2023-10-06T03:23:49.544948+0000","last_unstale":"2023-10-06T03:23:54.574682+0000","last_undegraded":"2023-10-06T03:23:54.574682+0000","last_fullsized":"2023-10-06T03:23:54.574682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567580+0000","last_change":"2023-10-06T03:23:50.550782+0000","last_active":"2023-10-06T03:23:54.567580+0000","last_peered":"2023-10-06T03:23:54.567580+0000","last_clean":"2023-10-06T03:23:54.567580+0000","last_became_active":"2023-10-06T03:23:50.550406+0000","last_became_peered":"2023-10-06T03:23:50.550406+0000","last_unstale":"2023-10-06T03:23:54.567580+0000","last_undegraded":"2023-10-06T03:23:54.567580+0000","last_fullsized":"2023-10-06T03:23:54.567580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.588080+0000","last_change":"2023-10-06T03:23:54.580162+0000","last_active":"2023-10-06T03:23:54.588080+0000","last_peered":"2023-10-06T03:23:54.588080+0000","last_clean":"2023-10-06T03:23:54.588080+0000","last_became_active":"2023-10-06T03:23:54.579792+0000","last_became_peered":"2023-10-06T03:23:54.579792+0000","last_unstale":"2023-10-06T03:23:54.588080+0000","last_undegraded":"2023-10-06T03:23:54.588080+0000","last_fullsized":"2023-10-06T03:23:54.588080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572797+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:23:54.572797+0000","last_peered":"2023-10-06T03:23:54.572797+0000","last_clean":"2023-10-06T03:23:54.572797+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:23:54.572797+0000","last_undegraded":"2023-10-06T03:23:54.572797+0000","last_fullsized":"2023-10-06T03:23:54.572797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561503+0000","last_change":"2023-10-06T03:23:49.544756+0000","last_active":"2023-10-06T03:23:54.561503+0000","last_peered":"2023-10-06T03:23:54.561503+0000","last_clean":"2023-10-06T03:23:54.561503+0000","last_became_active":"2023-10-06T03:23:49.544484+0000","last_became_peered":"2023-10-06T03:23:49.544484+0000","last_unstale":"2023-10-06T03:23:54.561503+0000","last_undegraded":"2023-10-06T03:23:54.561503+0000","last_fullsized":"2023-10-06T03:23:54.561503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573304+0000","last_change":"2023-10-06T03:23:50.553155+0000","last_active":"2023-10-06T03:23:54.573304+0000","last_peered":"2023-10-06T03:23:54.573304+0000","last_clean":"2023-10-06T03:23:54.573304+0000","last_became_active":"2023-10-06T03:23:50.552915+0000","last_became_peered":"2023-10-06T03:23:50.552915+0000","last_unstale":"2023-10-06T03:23:54.573304+0000","last_undegraded":"2023-10-06T03:23:54.573304+0000","last_fullsized":"2023-10-06T03:23:54.573304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581310+0000","last_change":"2023-10-06T03:23:54.580336+0000","last_active":"2023-10-06T03:23:54.581310+0000","last_peered":"2023-10-06T03:23:54.581310+0000","last_clean":"2023-10-06T03:23:54.581310+0000","last_became_active":"2023-10-06T03:23:54.579923+0000","last_became_peered":"2023-10-06T03:23:54.579923+0000","last_unstale":"2023-10-06T03:23:54.581310+0000","last_undegraded":"2023-10-06T03:23:54.581310+0000","last_fullsized":"2023-10-06T03:23:54.581310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:18.254667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567497+0000","last_change":"2023-10-06T03:23:49.551353+0000","last_active":"2023-10-06T03:23:54.567497+0000","last_peered":"2023-10-06T03:23:54.567497+0000","last_clean":"2023-10-06T03:23:54.567497+0000","last_became_active":"2023-10-06T03:23:49.550924+0000","last_became_peered":"2023-10-06T03:23:49.550924+0000","last_unstale":"2023-10-06T03:23:54.567497+0000","last_undegraded":"2023-10-06T03:23:54.567497+0000","last_fullsized":"2023-10-06T03:23:54.567497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561785+0000","last_change":"2023-10-06T03:23:50.548063+0000","last_active":"2023-10-06T03:23:54.561785+0000","last_peered":"2023-10-06T03:23:54.561785+0000","last_clean":"2023-10-06T03:23:54.561785+0000","last_became_active":"2023-10-06T03:23:50.547820+0000","last_became_peered":"2023-10-06T03:23:50.547820+0000","last_unstale":"2023-10-06T03:23:54.561785+0000","last_undegraded":"2023-10-06T03:23:54.561785+0000","last_fullsized":"2023-10-06T03:23:54.561785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:06.967901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.584497+0000","last_change":"2023-10-06T03:23:54.580975+0000","last_active":"2023-10-06T03:23:54.584497+0000","last_peered":"2023-10-06T03:23:54.584497+0000","last_clean":"2023-10-06T03:23:54.584497+0000","last_became_active":"2023-10-06T03:23:54.580530+0000","last_became_peered":"2023-10-06T03:23:54.580530+0000","last_unstale":"2023-10-06T03:23:54.584497+0000","last_undegraded":"2023-10-06T03:23:54.584497+0000","last_fullsized":"2023-10-06T03:23:54.584497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:26.465848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560207+0000","last_change":"2023-10-06T03:23:49.550718+0000","last_active":"2023-10-06T03:23:54.560207+0000","last_peered":"2023-10-06T03:23:54.560207+0000","last_clean":"2023-10-06T03:23:54.560207+0000","last_became_active":"2023-10-06T03:23:49.550451+0000","last_became_peered":"2023-10-06T03:23:49.550451+0000","last_unstale":"2023-10-06T03:23:54.560207+0000","last_undegraded":"2023-10-06T03:23:54.560207+0000","last_fullsized":"2023-10-06T03:23:54.560207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569944+0000","last_change":"2023-10-06T03:23:50.560044+0000","last_active":"2023-10-06T03:23:54.569944+0000","last_peered":"2023-10-06T03:23:54.569944+0000","last_clean":"2023-10-06T03:23:54.569944+0000","last_became_active":"2023-10-06T03:23:50.559762+0000","last_became_peered":"2023-10-06T03:23:50.559762+0000","last_unstale":"2023-10-06T03:23:54.569944+0000","last_undegraded":"2023-10-06T03:23:54.569944+0000","last_fullsized":"2023-10-06T03:23:54.569944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:57.290738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.577962+0000","last_change":"2023-10-06T03:23:54.572457+0000","last_active":"2023-10-06T03:23:54.577962+0000","last_peered":"2023-10-06T03:23:54.577962+0000","last_clean":"2023-10-06T03:23:54.577962+0000","last_became_active":"2023-10-06T03:23:54.571942+0000","last_became_peered":"2023-10-06T03:23:54.571942+0000","last_unstale":"2023-10-06T03:23:54.577962+0000","last_undegraded":"2023-10-06T03:23:54.577962+0000","last_fullsized":"2023-10-06T03:23:54.577962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:04.871504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561406+0000","last_change":"2023-10-06T03:23:49.550646+0000","last_active":"2023-10-06T03:23:54.561406+0000","last_peered":"2023-10-06T03:23:54.561406+0000","last_clean":"2023-10-06T03:23:54.561406+0000","last_became_active":"2023-10-06T03:23:49.550386+0000","last_became_peered":"2023-10-06T03:23:49.550386+0000","last_unstale":"2023-10-06T03:23:54.561406+0000","last_undegraded":"2023-10-06T03:23:54.561406+0000","last_fullsized":"2023-10-06T03:23:54.561406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570428+0000","last_change":"2023-10-06T03:23:50.546985+0000","last_active":"2023-10-06T03:23:54.570428+0000","last_peered":"2023-10-06T03:23:54.570428+0000","last_clean":"2023-10-06T03:23:54.570428+0000","last_became_active":"2023-10-06T03:23:50.546697+0000","last_became_peered":"2023-10-06T03:23:50.546697+0000","last_unstale":"2023-10-06T03:23:54.570428+0000","last_undegraded":"2023-10-06T03:23:54.570428+0000","last_fullsized":"2023-10-06T03:23:54.570428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:14.232265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582421+0000","last_change":"2023-10-06T03:23:54.580064+0000","last_active":"2023-10-06T03:23:54.582421+0000","last_peered":"2023-10-06T03:23:54.582421+0000","last_clean":"2023-10-06T03:23:54.582421+0000","last_became_active":"2023-10-06T03:23:54.579678+0000","last_became_peered":"2023-10-06T03:23:54.579678+0000","last_unstale":"2023-10-06T03:23:54.582421+0000","last_undegraded":"2023-10-06T03:23:54.582421+0000","last_fullsized":"2023-10-06T03:23:54.582421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:35.686057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559611+0000","last_change":"2023-10-06T03:23:49.548219+0000","last_active":"2023-10-06T03:23:54.559611+0000","last_peered":"2023-10-06T03:23:54.559611+0000","last_clean":"2023-10-06T03:23:54.559611+0000","last_became_active":"2023-10-06T03:23:49.547961+0000","last_became_peered":"2023-10-06T03:23:49.547961+0000","last_unstale":"2023-10-06T03:23:54.559611+0000","last_undegraded":"2023-10-06T03:23:54.559611+0000","last_fullsized":"2023-10-06T03:23:54.559611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:26.970739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557859+0000","last_change":"2023-10-06T03:23:50.551706+0000","last_active":"2023-10-06T03:23:54.557859+0000","last_peered":"2023-10-06T03:23:54.557859+0000","last_clean":"2023-10-06T03:23:54.557859+0000","last_became_active":"2023-10-06T03:23:50.551421+0000","last_became_peered":"2023-10-06T03:23:50.551421+0000","last_unstale":"2023-10-06T03:23:54.557859+0000","last_undegraded":"2023-10-06T03:23:54.557859+0000","last_fullsized":"2023-10-06T03:23:54.557859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:16.310349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586634+0000","last_change":"2023-10-06T03:23:54.585084+0000","last_active":"2023-10-06T03:23:54.586634+0000","last_peered":"2023-10-06T03:23:54.586634+0000","last_clean":"2023-10-06T03:23:54.586634+0000","last_became_active":"2023-10-06T03:23:54.584340+0000","last_became_peered":"2023-10-06T03:23:54.584340+0000","last_unstale":"2023-10-06T03:23:54.586634+0000","last_undegraded":"2023-10-06T03:23:54.586634+0000","last_fullsized":"2023-10-06T03:23:54.586634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:56.706198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566271+0000","last_change":"2023-10-06T03:23:49.544298+0000","last_active":"2023-10-06T03:23:54.566271+0000","last_peered":"2023-10-06T03:23:54.566271+0000","last_clean":"2023-10-06T03:23:54.566271+0000","last_became_active":"2023-10-06T03:23:49.543893+0000","last_became_peered":"2023-10-06T03:23:49.543893+0000","last_unstale":"2023-10-06T03:23:54.566271+0000","last_undegraded":"2023-10-06T03:23:54.566271+0000","last_fullsized":"2023-10-06T03:23:54.566271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568117+0000","last_change":"2023-10-06T03:23:50.553611+0000","last_active":"2023-10-06T03:23:54.568117+0000","last_peered":"2023-10-06T03:23:54.568117+0000","last_clean":"2023-10-06T03:23:54.568117+0000","last_became_active":"2023-10-06T03:23:50.553182+0000","last_became_peered":"2023-10-06T03:23:50.553182+0000","last_unstale":"2023-10-06T03:23:54.568117+0000","last_undegraded":"2023-10-06T03:23:54.568117+0000","last_fullsized":"2023-10-06T03:23:54.568117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:16.310349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572471+0000","last_change":"2023-10-06T03:23:50.553726+0000","last_active":"2023-10-06T03:23:54.572471+0000","last_peered":"2023-10-06T03:23:54.572471+0000","last_clean":"2023-10-06T03:23:54.572471+0000","last_became_active":"2023-10-06T03:23:50.553470+0000","last_became_peered":"2023-10-06T03:23:50.553470+0000","last_unstale":"2023-10-06T03:23:54.572471+0000","last_undegraded":"2023-10-06T03:23:54.572471+0000","last_fullsized":"2023-10-06T03:23:54.572471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:29.620598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557956+0000","last_change":"2023-10-06T03:23:50.559351+0000","last_active":"2023-10-06T03:23:54.557956+0000","last_peered":"2023-10-06T03:23:54.557956+0000","last_clean":"2023-10-06T03:23:54.557956+0000","last_became_active":"2023-10-06T03:23:50.554817+0000","last_became_peered":"2023-10-06T03:23:50.554817+0000","last_unstale":"2023-10-06T03:23:54.557956+0000","last_undegraded":"2023-10-06T03:23:54.557956+0000","last_fullsized":"2023-10-06T03:23:54.557956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:29.722975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570702+0000","last_change":"2023-10-06T03:23:50.556578+0000","last_active":"2023-10-06T03:23:54.570702+0000","last_peered":"2023-10-06T03:23:54.570702+0000","last_clean":"2023-10-06T03:23:54.570702+0000","last_became_active":"2023-10-06T03:23:50.556314+0000","last_became_peered":"2023-10-06T03:23:50.556314+0000","last_unstale":"2023-10-06T03:23:54.570702+0000","last_undegraded":"2023-10-06T03:23:54.570702+0000","last_fullsized":"2023-10-06T03:23:54.570702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:00.849101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558641+0000","last_change":"2023-10-06T03:23:50.556963+0000","last_active":"2023-10-06T03:23:54.558641+0000","last_peered":"2023-10-06T03:23:54.558641+0000","last_clean":"2023-10-06T03:23:54.558641+0000","last_became_active":"2023-10-06T03:23:50.555458+0000","last_became_peered":"2023-10-06T03:23:50.555458+0000","last_unstale":"2023-10-06T03:23:54.558641+0000","last_undegraded":"2023-10-06T03:23:54.558641+0000","last_fullsized":"2023-10-06T03:23:54.558641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574585+0000","last_change":"2023-10-06T03:23:50.551327+0000","last_active":"2023-10-06T03:23:54.574585+0000","last_peered":"2023-10-06T03:23:54.574585+0000","last_clean":"2023-10-06T03:23:54.574585+0000","last_became_active":"2023-10-06T03:23:50.551040+0000","last_became_peered":"2023-10-06T03:23:50.551040+0000","last_unstale":"2023-10-06T03:23:54.574585+0000","last_undegraded":"2023-10-06T03:23:54.574585+0000","last_fullsized":"2023-10-06T03:23:54.574585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":698736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3680000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.5039999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":694806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":103639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.19}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.111999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.919}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":108208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":105062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:09.157 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:09.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.301+0000 7ff4b091b700 1 Processor -- start 2023-10-06T03:24:09.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.301+0000 7ff4b091b700 1 -- start start 2023-10-06T03:24:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4b091b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff4ac0c6260 0x7ff4ac0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4b091b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ac0cc840 con 0x7ff4ac0cd370 2023-10-06T03:24:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4b091b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ac0cbc70 con 0x7ff4ac1594b0 2023-10-06T03:24:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4b091b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0cbf10 con 0x7ff4ac0c6260 2023-10-06T03:24:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4ab59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff4ac0c6260 0x7ff4ac0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4a259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff4ac0cd370 0x7ff4ac0ce9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48428/0 (socket says 172.21.15.84:48428) 2023-10-06T03:24:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4a259c700 1 -- 172.21.15.84:0/1699881347 learned_addr learned my addr 172.21.15.84:0/1699881347 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4ab59e700 1 -- 172.21.15.84:0/1699881347 >> v1:172.21.15.131:6789/0 conn(0x7ff4ac1594b0 legacy=0x7ff4ac0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4ab59e700 1 -- 172.21.15.84:0/1699881347 >> v1:172.21.15.84:6789/0 conn(0x7ff4ac0cd370 legacy=0x7ff4ac0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4aa59c700 1 -- 172.21.15.84:0/1699881347 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550304788 0 0) 0x7ff4ac0cc840 con 0x7ff4ac0cd370 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.302+0000 7ff4ab59e700 1 -- 172.21.15.84:0/1699881347 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0cc1f0 con 0x7ff4ac0c6260 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4ab59e700 1 --2- 172.21.15.84:0/1699881347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac0c6260 0x7ff4ac0cf0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009e60 tx=0x7ff4a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfbb9af70cc50dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4aa59c700 1 -- 172.21.15.84:0/1699881347 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400e070 con 0x7ff4ac0c6260 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4aa59c700 1 -- 172.21.15.84:0/1699881347 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400bc30 con 0x7ff4ac0c6260 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4aa59c700 1 -- 172.21.15.84:0/1699881347 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4012430 con 0x7ff4ac0c6260 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4b091b700 1 -- 172.21.15.84:0/1699881347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac0c6260 msgr2=0x7ff4ac0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4b091b700 1 --2- 172.21.15.84:0/1699881347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac0c6260 0x7ff4ac0cf0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009e60 tx=0x7ff4a4009780 comp rx=0 tx=0).stop 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4b091b700 1 -- 172.21.15.84:0/1699881347 shutdown_connections 2023-10-06T03:24:09.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4b091b700 1 --2- 172.21.15.84:0/1699881347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac0c6260 0x7ff4ac0cf0d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4b091b700 1 -- 172.21.15.84:0/1699881347 >> 172.21.15.84:0/1699881347 conn(0x7ff4ac099600 msgr2=0x7ff4ac06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4b091b700 1 -- 172.21.15.84:0/1699881347 shutdown_connections 2023-10-06T03:24:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.303+0000 7ff4b091b700 1 -- 172.21.15.84:0/1699881347 wait complete. 2023-10-06T03:24:09.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.304+0000 7ff4b091b700 1 Processor -- start 2023-10-06T03:24:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.304+0000 7ff4b091b700 1 -- start start 2023-10-06T03:24:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4b091b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4ac0c6260 0x7ff4ac154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4b091b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4ac0cd370 0x7ff4ac16d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4b091b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac1594b0 0x7ff4ac150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4b091b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac16da60 con 0x7ff4ac1594b0 2023-10-06T03:24:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4b091b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac153c00 con 0x7ff4ac0cd370 2023-10-06T03:24:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4b091b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac151440 con 0x7ff4ac0c6260 2023-10-06T03:24:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4ab59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac1594b0 0x7ff4ac150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4ab59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac1594b0 0x7ff4ac150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34220/0 (socket says 172.21.15.84:34220) 2023-10-06T03:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4ab59e700 1 -- 172.21.15.84:0/1248984091 learned_addr learned my addr 172.21.15.84:0/1248984091 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4aad9d700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4ac0c6260 0x7ff4ac154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.305+0000 7ff4a259c700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4ac0cd370 0x7ff4ac16d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4ab59e700 1 -- 172.21.15.84:0/1248984091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4ac0c6260 msgr2=0x7ff4ac154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4ab59e700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4ac0c6260 0x7ff4ac154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4ab59e700 1 -- 172.21.15.84:0/1248984091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4ac0cd370 msgr2=0x7ff4ac16d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4ab59e700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4ac0cd370 0x7ff4ac16d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4ab59e700 1 -- 172.21.15.84:0/1248984091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009a20 con 0x7ff4ac1594b0 2023-10-06T03:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4ab59e700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac1594b0 0x7ff4ac150f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac06fc60 tx=0x7ff4a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4a37fe700 1 -- 172.21.15.84:0/1248984091 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4007000 con 0x7ff4ac1594b0 2023-10-06T03:24:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4a37fe700 1 -- 172.21.15.84:0/1248984091 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a40263f0 con 0x7ff4ac1594b0 2023-10-06T03:24:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4b091b700 1 -- 172.21.15.84:0/1248984091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac14e240 con 0x7ff4ac1594b0 2023-10-06T03:24:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4a37fe700 1 -- 172.21.15.84:0/1248984091 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40267d0 con 0x7ff4ac1594b0 2023-10-06T03:24:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.306+0000 7ff4b091b700 1 -- 172.21.15.84:0/1248984091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac1549c0 con 0x7ff4ac1594b0 2023-10-06T03:24:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.307+0000 7ff4b091b700 1 -- 172.21.15.84:0/1248984091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac0c88e0 con 0x7ff4ac1594b0 2023-10-06T03:24:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.307+0000 7ff4a37fe700 1 -- 172.21.15.84:0/1248984091 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4a4026bc0 con 0x7ff4ac1594b0 2023-10-06T03:24:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.308+0000 7ff4a37fe700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff48c066f30 0x7ff48c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.308+0000 7ff4a37fe700 1 -- 172.21.15.84:0/1248984091 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff4a4086990 con 0x7ff4ac1594b0 2023-10-06T03:24:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.308+0000 7ff4aad9d700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff48c066f30 0x7ff48c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.308+0000 7ff4aad9d700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff48c066f30 0x7ff48c0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff49c000c00 tx=0x7ff49c007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.312+0000 7ff4a37fe700 1 -- 172.21.15.84:0/1248984091 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4a40537b0 con 0x7ff4ac1594b0 2023-10-06T03:24:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.491+0000 7ff4b091b700 1 -- 172.21.15.84:0/1248984091 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4ac05f270 con 0x7ff48c066f30 2023-10-06T03:24:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.500+0000 7ff4a37fe700 1 -- 172.21.15.84:0/1248984091 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367504 (secure 0 0 0) 0x7ff4ac05f270 con 0x7ff48c066f30 2023-10-06T03:24:09.506 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 -- 172.21.15.84:0/1248984091 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff48c066f30 msgr2=0x7ff48c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff48c066f30 0x7ff48c0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff49c000c00 tx=0x7ff49c007ef0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 -- 172.21.15.84:0/1248984091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac1594b0 msgr2=0x7ff4ac150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac1594b0 0x7ff4ac150f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac06fc60 tx=0x7ff4a4019000 comp rx=0 tx=0).stop 2023-10-06T03:24:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 -- 172.21.15.84:0/1248984091 shutdown_connections 2023-10-06T03:24:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff48c066f30 0x7ff48c0693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ac1594b0 0x7ff4ac150f00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4ac0c6260 0x7ff4ac154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 --2- 172.21.15.84:0/1248984091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4ac0cd370 0x7ff4ac16d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 -- 172.21.15.84:0/1248984091 >> 172.21.15.84:0/1248984091 conn(0x7ff4ac099600 msgr2=0x7ff4ac068270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:09.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 -- 172.21.15.84:0/1248984091 shutdown_connections 2023-10-06T03:24:09.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.504+0000 7ff4b091b700 1 -- 172.21.15.84:0/1248984091 wait complete. 2023-10-06T03:24:09.510 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:24:09.518 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-10-06T03:24:09.044614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381508,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593212,"statfs":{"total":773094113280,"available":770655449088,"internally_reserved":0,"allocated":3280896,"data_stored":2023855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003345"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561518+0000","last_change":"2023-10-06T03:23:50.561014+0000","last_active":"2023-10-06T03:23:54.561518+0000","last_peered":"2023-10-06T03:23:54.561518+0000","last_clean":"2023-10-06T03:23:54.561518+0000","last_became_active":"2023-10-06T03:23:50.560752+0000","last_became_peered":"2023-10-06T03:23:50.560752+0000","last_unstale":"2023-10-06T03:23:54.561518+0000","last_undegraded":"2023-10-06T03:23:54.561518+0000","last_fullsized":"2023-10-06T03:23:54.561518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:11.240323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561509+0000","last_change":"2023-10-06T03:23:50.554102+0000","last_active":"2023-10-06T03:23:54.561509+0000","last_peered":"2023-10-06T03:23:54.561509+0000","last_clean":"2023-10-06T03:23:54.561509+0000","last_became_active":"2023-10-06T03:23:50.553890+0000","last_became_peered":"2023-10-06T03:23:50.553890+0000","last_unstale":"2023-10-06T03:23:54.561509+0000","last_undegraded":"2023-10-06T03:23:54.561509+0000","last_fullsized":"2023-10-06T03:23:54.561509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570300+0000","last_change":"2023-10-06T03:23:50.547813+0000","last_active":"2023-10-06T03:23:54.570300+0000","last_peered":"2023-10-06T03:23:54.570300+0000","last_clean":"2023-10-06T03:23:54.570300+0000","last_became_active":"2023-10-06T03:23:50.547300+0000","last_became_peered":"2023-10-06T03:23:50.547300+0000","last_unstale":"2023-10-06T03:23:54.570300+0000","last_undegraded":"2023-10-06T03:23:54.570300+0000","last_fullsized":"2023-10-06T03:23:54.570300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:41.253538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572253+0000","last_change":"2023-10-06T03:23:50.555770+0000","last_active":"2023-10-06T03:23:54.572253+0000","last_peered":"2023-10-06T03:23:54.572253+0000","last_clean":"2023-10-06T03:23:54.572253+0000","last_became_active":"2023-10-06T03:23:50.555523+0000","last_became_peered":"2023-10-06T03:23:50.555523+0000","last_unstale":"2023-10-06T03:23:54.572253+0000","last_undegraded":"2023-10-06T03:23:54.572253+0000","last_fullsized":"2023-10-06T03:23:54.572253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:47.159183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567665+0000","last_change":"2023-10-06T03:23:50.560528+0000","last_active":"2023-10-06T03:23:54.567665+0000","last_peered":"2023-10-06T03:23:54.567665+0000","last_clean":"2023-10-06T03:23:54.567665+0000","last_became_active":"2023-10-06T03:23:50.560247+0000","last_became_peered":"2023-10-06T03:23:50.560247+0000","last_unstale":"2023-10-06T03:23:54.567665+0000","last_undegraded":"2023-10-06T03:23:54.567665+0000","last_fullsized":"2023-10-06T03:23:54.567665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570783+0000","last_change":"2023-10-06T03:23:50.546938+0000","last_active":"2023-10-06T03:23:54.570783+0000","last_peered":"2023-10-06T03:23:54.570783+0000","last_clean":"2023-10-06T03:23:54.570783+0000","last_became_active":"2023-10-06T03:23:50.546653+0000","last_became_peered":"2023-10-06T03:23:50.546653+0000","last_unstale":"2023-10-06T03:23:54.570783+0000","last_undegraded":"2023-10-06T03:23:54.570783+0000","last_fullsized":"2023-10-06T03:23:54.570783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560769+0000","last_change":"2023-10-06T03:23:50.553364+0000","last_active":"2023-10-06T03:23:54.560769+0000","last_peered":"2023-10-06T03:23:54.560769+0000","last_clean":"2023-10-06T03:23:54.560769+0000","last_became_active":"2023-10-06T03:23:50.553098+0000","last_became_peered":"2023-10-06T03:23:50.553098+0000","last_unstale":"2023-10-06T03:23:54.560769+0000","last_undegraded":"2023-10-06T03:23:54.560769+0000","last_fullsized":"2023-10-06T03:23:54.560769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559957+0000","last_change":"2023-10-06T03:23:50.556409+0000","last_active":"2023-10-06T03:23:54.559957+0000","last_peered":"2023-10-06T03:23:54.559957+0000","last_clean":"2023-10-06T03:23:54.559957+0000","last_became_active":"2023-10-06T03:23:50.556162+0000","last_became_peered":"2023-10-06T03:23:50.556162+0000","last_unstale":"2023-10-06T03:23:54.559957+0000","last_undegraded":"2023-10-06T03:23:54.559957+0000","last_fullsized":"2023-10-06T03:23:54.559957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565989+0000","last_change":"2023-10-06T03:23:50.548544+0000","last_active":"2023-10-06T03:23:54.565989+0000","last_peered":"2023-10-06T03:23:54.565989+0000","last_clean":"2023-10-06T03:23:54.565989+0000","last_became_active":"2023-10-06T03:23:50.548294+0000","last_became_peered":"2023-10-06T03:23:50.548294+0000","last_unstale":"2023-10-06T03:23:54.565989+0000","last_undegraded":"2023-10-06T03:23:54.565989+0000","last_fullsized":"2023-10-06T03:23:54.565989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561682+0000","last_change":"2023-10-06T03:23:50.547845+0000","last_active":"2023-10-06T03:23:54.561682+0000","last_peered":"2023-10-06T03:23:54.561682+0000","last_clean":"2023-10-06T03:23:54.561682+0000","last_became_active":"2023-10-06T03:23:50.547570+0000","last_became_peered":"2023-10-06T03:23:50.547570+0000","last_unstale":"2023-10-06T03:23:54.561682+0000","last_undegraded":"2023-10-06T03:23:54.561682+0000","last_fullsized":"2023-10-06T03:23:54.561682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570220+0000","last_change":"2023-10-06T03:23:50.554501+0000","last_active":"2023-10-06T03:23:54.570220+0000","last_peered":"2023-10-06T03:23:54.570220+0000","last_clean":"2023-10-06T03:23:54.570220+0000","last_became_active":"2023-10-06T03:23:50.554323+0000","last_became_peered":"2023-10-06T03:23:50.554323+0000","last_unstale":"2023-10-06T03:23:54.570220+0000","last_undegraded":"2023-10-06T03:23:54.570220+0000","last_fullsized":"2023-10-06T03:23:54.570220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:39.132842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561650+0000","last_change":"2023-10-06T03:23:50.556387+0000","last_active":"2023-10-06T03:23:54.561650+0000","last_peered":"2023-10-06T03:23:54.561650+0000","last_clean":"2023-10-06T03:23:54.561650+0000","last_became_active":"2023-10-06T03:23:50.556160+0000","last_became_peered":"2023-10-06T03:23:50.556160+0000","last_unstale":"2023-10-06T03:23:54.561650+0000","last_undegraded":"2023-10-06T03:23:54.561650+0000","last_fullsized":"2023-10-06T03:23:54.561650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:48.412426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561770+0000","last_change":"2023-10-06T03:23:50.560485+0000","last_active":"2023-10-06T03:23:54.561770+0000","last_peered":"2023-10-06T03:23:54.561770+0000","last_clean":"2023-10-06T03:23:54.561770+0000","last_became_active":"2023-10-06T03:23:50.560194+0000","last_became_peered":"2023-10-06T03:23:50.560194+0000","last_unstale":"2023-10-06T03:23:54.561770+0000","last_undegraded":"2023-10-06T03:23:54.561770+0000","last_fullsized":"2023-10-06T03:23:54.561770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:12.346557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560300+0000","last_change":"2023-10-06T03:23:50.551082+0000","last_active":"2023-10-06T03:23:54.560300+0000","last_peered":"2023-10-06T03:23:54.560300+0000","last_clean":"2023-10-06T03:23:54.560300+0000","last_became_active":"2023-10-06T03:23:50.550756+0000","last_became_peered":"2023-10-06T03:23:50.550756+0000","last_unstale":"2023-10-06T03:23:54.560300+0000","last_undegraded":"2023-10-06T03:23:54.560300+0000","last_fullsized":"2023-10-06T03:23:54.560300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560103+0000","last_change":"2023-10-06T03:23:50.553219+0000","last_active":"2023-10-06T03:23:54.560103+0000","last_peered":"2023-10-06T03:23:54.560103+0000","last_clean":"2023-10-06T03:23:54.560103+0000","last_became_active":"2023-10-06T03:23:50.552954+0000","last_became_peered":"2023-10-06T03:23:50.552954+0000","last_unstale":"2023-10-06T03:23:54.560103+0000","last_undegraded":"2023-10-06T03:23:54.560103+0000","last_fullsized":"2023-10-06T03:23:54.560103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568201+0000","last_change":"2023-10-06T03:23:50.538998+0000","last_active":"2023-10-06T03:23:54.568201+0000","last_peered":"2023-10-06T03:23:54.568201+0000","last_clean":"2023-10-06T03:23:54.568201+0000","last_became_active":"2023-10-06T03:23:50.538721+0000","last_became_peered":"2023-10-06T03:23:50.538721+0000","last_unstale":"2023-10-06T03:23:54.568201+0000","last_undegraded":"2023-10-06T03:23:54.568201+0000","last_fullsized":"2023-10-06T03:23:54.568201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566076+0000","last_change":"2023-10-06T03:23:50.548665+0000","last_active":"2023-10-06T03:23:54.566076+0000","last_peered":"2023-10-06T03:23:54.566076+0000","last_clean":"2023-10-06T03:23:54.566076+0000","last_became_active":"2023-10-06T03:23:50.548379+0000","last_became_peered":"2023-10-06T03:23:50.548379+0000","last_unstale":"2023-10-06T03:23:54.566076+0000","last_undegraded":"2023-10-06T03:23:54.566076+0000","last_fullsized":"2023-10-06T03:23:54.566076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:04.343209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570249+0000","last_change":"2023-10-06T03:23:50.547255+0000","last_active":"2023-10-06T03:23:54.570249+0000","last_peered":"2023-10-06T03:23:54.570249+0000","last_clean":"2023-10-06T03:23:54.570249+0000","last_became_active":"2023-10-06T03:23:50.546952+0000","last_became_peered":"2023-10-06T03:23:50.546952+0000","last_unstale":"2023-10-06T03:23:54.570249+0000","last_undegraded":"2023-10-06T03:23:54.570249+0000","last_fullsized":"2023-10-06T03:23:54.570249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:37.459738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.562026+0000","last_change":"2023-10-06T03:23:50.549274+0000","last_active":"2023-10-06T03:23:54.562026+0000","last_peered":"2023-10-06T03:23:54.562026+0000","last_clean":"2023-10-06T03:23:54.562026+0000","last_became_active":"2023-10-06T03:23:50.549011+0000","last_became_peered":"2023-10-06T03:23:50.549011+0000","last_unstale":"2023-10-06T03:23:54.562026+0000","last_undegraded":"2023-10-06T03:23:54.562026+0000","last_fullsized":"2023-10-06T03:23:54.562026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:21.634023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.571307+0000","last_change":"2023-10-06T03:23:50.553751+0000","last_active":"2023-10-06T03:23:54.571307+0000","last_peered":"2023-10-06T03:23:54.571307+0000","last_clean":"2023-10-06T03:23:54.571307+0000","last_became_active":"2023-10-06T03:23:50.553496+0000","last_became_peered":"2023-10-06T03:23:50.553496+0000","last_unstale":"2023-10-06T03:23:54.571307+0000","last_undegraded":"2023-10-06T03:23:54.571307+0000","last_fullsized":"2023-10-06T03:23:54.571307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:35.855132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561063+0000","last_change":"2023-10-06T03:23:50.549272+0000","last_active":"2023-10-06T03:23:54.561063+0000","last_peered":"2023-10-06T03:23:54.561063+0000","last_clean":"2023-10-06T03:23:54.561063+0000","last_became_active":"2023-10-06T03:23:50.548975+0000","last_became_peered":"2023-10-06T03:23:50.548975+0000","last_unstale":"2023-10-06T03:23:54.561063+0000","last_undegraded":"2023-10-06T03:23:54.561063+0000","last_fullsized":"2023-10-06T03:23:54.561063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.564941+0000","last_change":"2023-10-06T03:23:50.553906+0000","last_active":"2023-10-06T03:23:54.564941+0000","last_peered":"2023-10-06T03:23:54.564941+0000","last_clean":"2023-10-06T03:23:54.564941+0000","last_became_active":"2023-10-06T03:23:50.553657+0000","last_became_peered":"2023-10-06T03:23:50.553657+0000","last_unstale":"2023-10-06T03:23:54.564941+0000","last_undegraded":"2023-10-06T03:23:54.564941+0000","last_fullsized":"2023-10-06T03:23:54.564941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557967+0000","last_change":"2023-10-06T03:23:50.559812+0000","last_active":"2023-10-06T03:23:54.557967+0000","last_peered":"2023-10-06T03:23:54.557967+0000","last_clean":"2023-10-06T03:23:54.557967+0000","last_became_active":"2023-10-06T03:23:50.559490+0000","last_became_peered":"2023-10-06T03:23:50.559490+0000","last_unstale":"2023-10-06T03:23:54.557967+0000","last_undegraded":"2023-10-06T03:23:54.557967+0000","last_fullsized":"2023-10-06T03:23:54.557967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:03.745193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560369+0000","last_change":"2023-10-06T03:23:50.560701+0000","last_active":"2023-10-06T03:23:54.560369+0000","last_peered":"2023-10-06T03:23:54.560369+0000","last_clean":"2023-10-06T03:23:54.560369+0000","last_became_active":"2023-10-06T03:23:50.560415+0000","last_became_peered":"2023-10-06T03:23:50.560415+0000","last_unstale":"2023-10-06T03:23:54.560369+0000","last_undegraded":"2023-10-06T03:23:54.560369+0000","last_fullsized":"2023-10-06T03:23:54.560369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574718+0000","last_change":"2023-10-06T03:23:50.552568+0000","last_active":"2023-10-06T03:23:54.574718+0000","last_peered":"2023-10-06T03:23:54.574718+0000","last_clean":"2023-10-06T03:23:54.574718+0000","last_became_active":"2023-10-06T03:23:50.552323+0000","last_became_peered":"2023-10-06T03:23:50.552323+0000","last_unstale":"2023-10-06T03:23:54.574718+0000","last_undegraded":"2023-10-06T03:23:54.574718+0000","last_fullsized":"2023-10-06T03:23:54.574718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574482+0000","last_change":"2023-10-06T03:23:50.553152+0000","last_active":"2023-10-06T03:23:54.574482+0000","last_peered":"2023-10-06T03:23:54.574482+0000","last_clean":"2023-10-06T03:23:54.574482+0000","last_became_active":"2023-10-06T03:23:50.552841+0000","last_became_peered":"2023-10-06T03:23:50.552841+0000","last_unstale":"2023-10-06T03:23:54.574482+0000","last_undegraded":"2023-10-06T03:23:54.574482+0000","last_fullsized":"2023-10-06T03:23:54.574482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561676+0000","last_change":"2023-10-06T03:23:50.552461+0000","last_active":"2023-10-06T03:23:54.561676+0000","last_peered":"2023-10-06T03:23:54.561676+0000","last_clean":"2023-10-06T03:23:54.561676+0000","last_became_active":"2023-10-06T03:23:50.551071+0000","last_became_peered":"2023-10-06T03:23:50.551071+0000","last_unstale":"2023-10-06T03:23:54.561676+0000","last_undegraded":"2023-10-06T03:23:54.561676+0000","last_fullsized":"2023-10-06T03:23:54.561676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581529+0000","last_change":"2023-10-06T03:23:54.579111+0000","last_active":"2023-10-06T03:23:54.581529+0000","last_peered":"2023-10-06T03:23:54.581529+0000","last_clean":"2023-10-06T03:23:54.581529+0000","last_became_active":"2023-10-06T03:23:54.578715+0000","last_became_peered":"2023-10-06T03:23:54.578715+0000","last_unstale":"2023-10-06T03:23:54.581529+0000","last_undegraded":"2023-10-06T03:23:54.581529+0000","last_fullsized":"2023-10-06T03:23:54.581529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:35.035137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570617+0000","last_change":"2023-10-06T03:23:49.548044+0000","last_active":"2023-10-06T03:23:54.570617+0000","last_peered":"2023-10-06T03:23:54.570617+0000","last_clean":"2023-10-06T03:23:54.570617+0000","last_became_active":"2023-10-06T03:23:49.547760+0000","last_became_peered":"2023-10-06T03:23:49.547760+0000","last_unstale":"2023-10-06T03:23:54.570617+0000","last_undegraded":"2023-10-06T03:23:54.570617+0000","last_fullsized":"2023-10-06T03:23:54.570617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:20.629148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559115+0000","last_change":"2023-10-06T03:23:50.559669+0000","last_active":"2023-10-06T03:23:54.559115+0000","last_peered":"2023-10-06T03:23:54.559115+0000","last_clean":"2023-10-06T03:23:54.559115+0000","last_became_active":"2023-10-06T03:23:50.559405+0000","last_became_peered":"2023-10-06T03:23:50.559405+0000","last_unstale":"2023-10-06T03:23:54.559115+0000","last_undegraded":"2023-10-06T03:23:54.559115+0000","last_fullsized":"2023-10-06T03:23:54.559115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:37.459738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.584345+0000","last_change":"2023-10-06T03:23:54.583216+0000","last_active":"2023-10-06T03:23:54.584345+0000","last_peered":"2023-10-06T03:23:54.584345+0000","last_clean":"2023-10-06T03:23:54.584345+0000","last_became_active":"2023-10-06T03:23:54.582867+0000","last_became_peered":"2023-10-06T03:23:54.582867+0000","last_unstale":"2023-10-06T03:23:54.584345+0000","last_undegraded":"2023-10-06T03:23:54.584345+0000","last_fullsized":"2023-10-06T03:23:54.584345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:39.877535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573373+0000","last_change":"2023-10-06T03:23:49.550360+0000","last_active":"2023-10-06T03:23:54.573373+0000","last_peered":"2023-10-06T03:23:54.573373+0000","last_clean":"2023-10-06T03:23:54.573373+0000","last_became_active":"2023-10-06T03:23:49.550065+0000","last_became_peered":"2023-10-06T03:23:49.550065+0000","last_unstale":"2023-10-06T03:23:54.573373+0000","last_undegraded":"2023-10-06T03:23:54.573373+0000","last_fullsized":"2023-10-06T03:23:54.573373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:20.629148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565240+0000","last_change":"2023-10-06T03:23:50.538560+0000","last_active":"2023-10-06T03:23:54.565240+0000","last_peered":"2023-10-06T03:23:54.565240+0000","last_clean":"2023-10-06T03:23:54.565240+0000","last_became_active":"2023-10-06T03:23:50.538280+0000","last_became_peered":"2023-10-06T03:23:50.538280+0000","last_unstale":"2023-10-06T03:23:54.565240+0000","last_undegraded":"2023-10-06T03:23:54.565240+0000","last_fullsized":"2023-10-06T03:23:54.565240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.587526+0000","last_change":"2023-10-06T03:23:54.577798+0000","last_active":"2023-10-06T03:23:54.587526+0000","last_peered":"2023-10-06T03:23:54.587526+0000","last_clean":"2023-10-06T03:23:54.587526+0000","last_became_active":"2023-10-06T03:23:54.577365+0000","last_became_peered":"2023-10-06T03:23:54.577365+0000","last_unstale":"2023-10-06T03:23:54.587526+0000","last_undegraded":"2023-10-06T03:23:54.587526+0000","last_fullsized":"2023-10-06T03:23:54.587526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:29.084904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558191+0000","last_change":"2023-10-06T03:23:49.541525+0000","last_active":"2023-10-06T03:23:54.558191+0000","last_peered":"2023-10-06T03:23:54.558191+0000","last_clean":"2023-10-06T03:23:54.558191+0000","last_became_active":"2023-10-06T03:23:49.541237+0000","last_became_peered":"2023-10-06T03:23:49.541237+0000","last_unstale":"2023-10-06T03:23:54.558191+0000","last_undegraded":"2023-10-06T03:23:54.558191+0000","last_fullsized":"2023-10-06T03:23:54.558191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572886+0000","last_change":"2023-10-06T03:23:50.559460+0000","last_active":"2023-10-06T03:23:54.572886+0000","last_peered":"2023-10-06T03:23:54.572886+0000","last_clean":"2023-10-06T03:23:54.572886+0000","last_became_active":"2023-10-06T03:23:50.559195+0000","last_became_peered":"2023-10-06T03:23:50.559195+0000","last_unstale":"2023-10-06T03:23:54.572886+0000","last_undegraded":"2023-10-06T03:23:54.572886+0000","last_fullsized":"2023-10-06T03:23:54.572886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:43.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586096+0000","last_change":"2023-10-06T03:23:54.584333+0000","last_active":"2023-10-06T03:23:54.586096+0000","last_peered":"2023-10-06T03:23:54.586096+0000","last_clean":"2023-10-06T03:23:54.586096+0000","last_became_active":"2023-10-06T03:23:54.583941+0000","last_became_peered":"2023-10-06T03:23:54.583941+0000","last_unstale":"2023-10-06T03:23:54.586096+0000","last_undegraded":"2023-10-06T03:23:54.586096+0000","last_fullsized":"2023-10-06T03:23:54.586096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:41.482140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566163+0000","last_change":"2023-10-06T03:23:49.544125+0000","last_active":"2023-10-06T03:23:54.566163+0000","last_peered":"2023-10-06T03:23:54.566163+0000","last_clean":"2023-10-06T03:23:54.566163+0000","last_became_active":"2023-10-06T03:23:49.543568+0000","last_became_peered":"2023-10-06T03:23:49.543568+0000","last_unstale":"2023-10-06T03:23:54.566163+0000","last_undegraded":"2023-10-06T03:23:54.566163+0000","last_fullsized":"2023-10-06T03:23:54.566163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558099+0000","last_change":"2023-10-06T03:23:50.555547+0000","last_active":"2023-10-06T03:23:54.558099+0000","last_peered":"2023-10-06T03:23:54.558099+0000","last_clean":"2023-10-06T03:23:54.558099+0000","last_became_active":"2023-10-06T03:23:50.555001+0000","last_became_peered":"2023-10-06T03:23:50.555001+0000","last_unstale":"2023-10-06T03:23:54.558099+0000","last_undegraded":"2023-10-06T03:23:54.558099+0000","last_fullsized":"2023-10-06T03:23:54.558099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:41.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582762+0000","last_change":"2023-10-06T03:23:54.576856+0000","last_active":"2023-10-06T03:23:54.582762+0000","last_peered":"2023-10-06T03:23:54.582762+0000","last_clean":"2023-10-06T03:23:54.582762+0000","last_became_active":"2023-10-06T03:23:54.576400+0000","last_became_peered":"2023-10-06T03:23:54.576400+0000","last_unstale":"2023-10-06T03:23:54.582762+0000","last_undegraded":"2023-10-06T03:23:54.582762+0000","last_fullsized":"2023-10-06T03:23:54.582762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:38.847179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561597+0000","last_change":"2023-10-06T03:23:49.546821+0000","last_active":"2023-10-06T03:23:54.561597+0000","last_peered":"2023-10-06T03:23:54.561597+0000","last_clean":"2023-10-06T03:23:54.561597+0000","last_became_active":"2023-10-06T03:23:49.546548+0000","last_became_peered":"2023-10-06T03:23:49.546548+0000","last_unstale":"2023-10-06T03:23:54.561597+0000","last_undegraded":"2023-10-06T03:23:54.561597+0000","last_fullsized":"2023-10-06T03:23:54.561597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557846+0000","last_change":"2023-10-06T03:23:50.555413+0000","last_active":"2023-10-06T03:23:54.557846+0000","last_peered":"2023-10-06T03:23:54.557846+0000","last_clean":"2023-10-06T03:23:54.557846+0000","last_became_active":"2023-10-06T03:23:50.554715+0000","last_became_peered":"2023-10-06T03:23:50.554715+0000","last_unstale":"2023-10-06T03:23:54.557846+0000","last_undegraded":"2023-10-06T03:23:54.557846+0000","last_fullsized":"2023-10-06T03:23:54.557846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:04.343209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.577965+0000","last_change":"2023-10-06T03:23:54.573885+0000","last_active":"2023-10-06T03:23:54.577965+0000","last_peered":"2023-10-06T03:23:54.577965+0000","last_clean":"2023-10-06T03:23:54.577965+0000","last_became_active":"2023-10-06T03:23:54.573501+0000","last_became_peered":"2023-10-06T03:23:54.573501+0000","last_unstale":"2023-10-06T03:23:54.577965+0000","last_undegraded":"2023-10-06T03:23:54.577965+0000","last_fullsized":"2023-10-06T03:23:54.577965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:11.874759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561246+0000","last_change":"2023-10-06T03:23:49.549842+0000","last_active":"2023-10-06T03:23:54.561246+0000","last_peered":"2023-10-06T03:23:54.561246+0000","last_clean":"2023-10-06T03:23:54.561246+0000","last_became_active":"2023-10-06T03:23:49.549552+0000","last_became_peered":"2023-10-06T03:23:49.549552+0000","last_unstale":"2023-10-06T03:23:54.561246+0000","last_undegraded":"2023-10-06T03:23:54.561246+0000","last_fullsized":"2023-10-06T03:23:54.561246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:46.154308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574142+0000","last_change":"2023-10-06T03:23:50.556593+0000","last_active":"2023-10-06T03:23:54.574142+0000","last_peered":"2023-10-06T03:23:54.574142+0000","last_clean":"2023-10-06T03:23:54.574142+0000","last_became_active":"2023-10-06T03:23:50.556291+0000","last_became_peered":"2023-10-06T03:23:50.556291+0000","last_unstale":"2023-10-06T03:23:54.574142+0000","last_undegraded":"2023-10-06T03:23:54.574142+0000","last_fullsized":"2023-10-06T03:23:54.574142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.386684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586726+0000","last_change":"2023-10-06T03:23:54.585687+0000","last_active":"2023-10-06T03:23:54.586726+0000","last_peered":"2023-10-06T03:23:54.586726+0000","last_clean":"2023-10-06T03:23:54.586726+0000","last_became_active":"2023-10-06T03:23:54.585174+0000","last_became_peered":"2023-10-06T03:23:54.585174+0000","last_unstale":"2023-10-06T03:23:54.586726+0000","last_undegraded":"2023-10-06T03:23:54.586726+0000","last_fullsized":"2023-10-06T03:23:54.586726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:28.830749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:24:00.300578+0000","last_change":"2023-10-06T03:23:49.542417+0000","last_active":"2023-10-06T03:24:00.300578+0000","last_peered":"2023-10-06T03:24:00.300578+0000","last_clean":"2023-10-06T03:24:00.300578+0000","last_became_active":"2023-10-06T03:23:49.541619+0000","last_became_peered":"2023-10-06T03:23:49.541619+0000","last_unstale":"2023-10-06T03:24:00.300578+0000","last_undegraded":"2023-10-06T03:24:00.300578+0000","last_fullsized":"2023-10-06T03:24:00.300578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570210+0000","last_change":"2023-10-06T03:23:50.553384+0000","last_active":"2023-10-06T03:23:54.570210+0000","last_peered":"2023-10-06T03:23:54.570210+0000","last_clean":"2023-10-06T03:23:54.570210+0000","last_became_active":"2023-10-06T03:23:50.553071+0000","last_became_peered":"2023-10-06T03:23:50.553071+0000","last_unstale":"2023-10-06T03:23:54.570210+0000","last_undegraded":"2023-10-06T03:23:54.570210+0000","last_fullsized":"2023-10-06T03:23:54.570210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582553+0000","last_change":"2023-10-06T03:23:54.576003+0000","last_active":"2023-10-06T03:23:54.582553+0000","last_peered":"2023-10-06T03:23:54.582553+0000","last_clean":"2023-10-06T03:23:54.582553+0000","last_became_active":"2023-10-06T03:23:54.575595+0000","last_became_peered":"2023-10-06T03:23:54.575595+0000","last_unstale":"2023-10-06T03:23:54.582553+0000","last_undegraded":"2023-10-06T03:23:54.582553+0000","last_fullsized":"2023-10-06T03:23:54.582553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:56.213189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561136+0000","last_change":"2023-10-06T03:23:49.553574+0000","last_active":"2023-10-06T03:23:54.561136+0000","last_peered":"2023-10-06T03:23:54.561136+0000","last_clean":"2023-10-06T03:23:54.561136+0000","last_became_active":"2023-10-06T03:23:49.553287+0000","last_became_peered":"2023-10-06T03:23:49.553287+0000","last_unstale":"2023-10-06T03:23:54.561136+0000","last_undegraded":"2023-10-06T03:23:54.561136+0000","last_fullsized":"2023-10-06T03:23:54.561136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:30.660149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558194+0000","last_change":"2023-10-06T03:23:50.559333+0000","last_active":"2023-10-06T03:23:54.558194+0000","last_peered":"2023-10-06T03:23:54.558194+0000","last_clean":"2023-10-06T03:23:54.558194+0000","last_became_active":"2023-10-06T03:23:50.554903+0000","last_became_peered":"2023-10-06T03:23:50.554903+0000","last_unstale":"2023-10-06T03:23:54.558194+0000","last_undegraded":"2023-10-06T03:23:54.558194+0000","last_fullsized":"2023-10-06T03:23:54.558194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:50.174983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.578775+0000","last_change":"2023-10-06T03:23:54.576737+0000","last_active":"2023-10-06T03:23:54.578775+0000","last_peered":"2023-10-06T03:23:54.578775+0000","last_clean":"2023-10-06T03:23:54.578775+0000","last_became_active":"2023-10-06T03:23:54.576315+0000","last_became_peered":"2023-10-06T03:23:54.576315+0000","last_unstale":"2023-10-06T03:23:54.578775+0000","last_undegraded":"2023-10-06T03:23:54.578775+0000","last_fullsized":"2023-10-06T03:23:54.578775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:23.573045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565078+0000","last_change":"2023-10-06T03:23:49.541373+0000","last_active":"2023-10-06T03:23:54.565078+0000","last_peered":"2023-10-06T03:23:54.565078+0000","last_clean":"2023-10-06T03:23:54.565078+0000","last_became_active":"2023-10-06T03:23:49.541117+0000","last_became_peered":"2023-10-06T03:23:49.541117+0000","last_unstale":"2023-10-06T03:23:54.565078+0000","last_undegraded":"2023-10-06T03:23:54.565078+0000","last_fullsized":"2023-10-06T03:23:54.565078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:44.960845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561590+0000","last_change":"2023-10-06T03:23:50.552104+0000","last_active":"2023-10-06T03:23:54.561590+0000","last_peered":"2023-10-06T03:23:54.561590+0000","last_clean":"2023-10-06T03:23:54.561590+0000","last_became_active":"2023-10-06T03:23:50.550706+0000","last_became_peered":"2023-10-06T03:23:50.550706+0000","last_unstale":"2023-10-06T03:23:54.561590+0000","last_undegraded":"2023-10-06T03:23:54.561590+0000","last_fullsized":"2023-10-06T03:23:54.561590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.578733+0000","last_change":"2023-10-06T03:23:54.576258+0000","last_active":"2023-10-06T03:23:54.578733+0000","last_peered":"2023-10-06T03:23:54.578733+0000","last_clean":"2023-10-06T03:23:54.578733+0000","last_became_active":"2023-10-06T03:23:54.575885+0000","last_became_peered":"2023-10-06T03:23:54.575885+0000","last_unstale":"2023-10-06T03:23:54.578733+0000","last_undegraded":"2023-10-06T03:23:54.578733+0000","last_fullsized":"2023-10-06T03:23:54.578733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:34.771595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560193+0000","last_change":"2023-10-06T03:23:49.550646+0000","last_active":"2023-10-06T03:23:54.560193+0000","last_peered":"2023-10-06T03:23:54.560193+0000","last_clean":"2023-10-06T03:23:54.560193+0000","last_became_active":"2023-10-06T03:23:49.550390+0000","last_became_peered":"2023-10-06T03:23:49.550390+0000","last_unstale":"2023-10-06T03:23:54.560193+0000","last_undegraded":"2023-10-06T03:23:54.560193+0000","last_fullsized":"2023-10-06T03:23:54.560193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:26.970739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565649+0000","last_change":"2023-10-06T03:23:50.546312+0000","last_active":"2023-10-06T03:23:54.565649+0000","last_peered":"2023-10-06T03:23:54.565649+0000","last_clean":"2023-10-06T03:23:54.565649+0000","last_became_active":"2023-10-06T03:23:50.546061+0000","last_became_peered":"2023-10-06T03:23:50.546061+0000","last_unstale":"2023-10-06T03:23:54.565649+0000","last_undegraded":"2023-10-06T03:23:54.565649+0000","last_fullsized":"2023-10-06T03:23:54.565649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:26.627227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582076+0000","last_change":"2023-10-06T03:23:54.576371+0000","last_active":"2023-10-06T03:23:54.582076+0000","last_peered":"2023-10-06T03:23:54.582076+0000","last_clean":"2023-10-06T03:23:54.582076+0000","last_became_active":"2023-10-06T03:23:54.576017+0000","last_became_peered":"2023-10-06T03:23:54.576017+0000","last_unstale":"2023-10-06T03:23:54.582076+0000","last_undegraded":"2023-10-06T03:23:54.582076+0000","last_fullsized":"2023-10-06T03:23:54.582076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:38.847179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572371+0000","last_change":"2023-10-06T03:23:49.546273+0000","last_active":"2023-10-06T03:23:54.572371+0000","last_peered":"2023-10-06T03:23:54.572371+0000","last_clean":"2023-10-06T03:23:54.572371+0000","last_became_active":"2023-10-06T03:23:49.546030+0000","last_became_peered":"2023-10-06T03:23:49.546030+0000","last_unstale":"2023-10-06T03:23:54.572371+0000","last_undegraded":"2023-10-06T03:23:54.572371+0000","last_fullsized":"2023-10-06T03:23:54.572371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560122+0000","last_change":"2023-10-06T03:23:50.552633+0000","last_active":"2023-10-06T03:23:54.560122+0000","last_peered":"2023-10-06T03:23:54.560122+0000","last_clean":"2023-10-06T03:23:54.560122+0000","last_became_active":"2023-10-06T03:23:50.552401+0000","last_became_peered":"2023-10-06T03:23:50.552401+0000","last_unstale":"2023-10-06T03:23:54.560122+0000","last_undegraded":"2023-10-06T03:23:54.560122+0000","last_fullsized":"2023-10-06T03:23:54.560122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582883+0000","last_change":"2023-10-06T03:23:54.575577+0000","last_active":"2023-10-06T03:23:54.582883+0000","last_peered":"2023-10-06T03:23:54.582883+0000","last_clean":"2023-10-06T03:23:54.582883+0000","last_became_active":"2023-10-06T03:23:54.575207+0000","last_became_peered":"2023-10-06T03:23:54.575207+0000","last_unstale":"2023-10-06T03:23:54.582883+0000","last_undegraded":"2023-10-06T03:23:54.582883+0000","last_fullsized":"2023-10-06T03:23:54.582883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561649+0000","last_change":"2023-10-06T03:23:49.551635+0000","last_active":"2023-10-06T03:23:54.561649+0000","last_peered":"2023-10-06T03:23:54.561649+0000","last_clean":"2023-10-06T03:23:54.561649+0000","last_became_active":"2023-10-06T03:23:49.551383+0000","last_became_peered":"2023-10-06T03:23:49.551383+0000","last_unstale":"2023-10-06T03:23:54.561649+0000","last_undegraded":"2023-10-06T03:23:54.561649+0000","last_fullsized":"2023-10-06T03:23:54.561649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:28.615722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559800+0000","last_change":"2023-10-06T03:23:50.551380+0000","last_active":"2023-10-06T03:23:54.559800+0000","last_peered":"2023-10-06T03:23:54.559800+0000","last_clean":"2023-10-06T03:23:54.559800+0000","last_became_active":"2023-10-06T03:23:50.551113+0000","last_became_peered":"2023-10-06T03:23:50.551113+0000","last_unstale":"2023-10-06T03:23:54.559800+0000","last_undegraded":"2023-10-06T03:23:54.559800+0000","last_fullsized":"2023-10-06T03:23:54.559800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:28.082470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582682+0000","last_change":"2023-10-06T03:23:54.578999+0000","last_active":"2023-10-06T03:23:54.582682+0000","last_peered":"2023-10-06T03:23:54.582682+0000","last_clean":"2023-10-06T03:23:54.582682+0000","last_became_active":"2023-10-06T03:23:54.578680+0000","last_became_peered":"2023-10-06T03:23:54.578680+0000","last_unstale":"2023-10-06T03:23:54.582682+0000","last_undegraded":"2023-10-06T03:23:54.582682+0000","last_fullsized":"2023-10-06T03:23:54.582682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:46.387578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561434+0000","last_change":"2023-10-06T03:23:49.551746+0000","last_active":"2023-10-06T03:23:54.561434+0000","last_peered":"2023-10-06T03:23:54.561434+0000","last_clean":"2023-10-06T03:23:54.561434+0000","last_became_active":"2023-10-06T03:23:49.551502+0000","last_became_peered":"2023-10-06T03:23:49.551502+0000","last_unstale":"2023-10-06T03:23:54.561434+0000","last_undegraded":"2023-10-06T03:23:54.561434+0000","last_fullsized":"2023-10-06T03:23:54.561434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:16.290952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568892+0000","last_change":"2023-10-06T03:23:50.553384+0000","last_active":"2023-10-06T03:23:54.568892+0000","last_peered":"2023-10-06T03:23:54.568892+0000","last_clean":"2023-10-06T03:23:54.568892+0000","last_became_active":"2023-10-06T03:23:50.553111+0000","last_became_peered":"2023-10-06T03:23:50.553111+0000","last_unstale":"2023-10-06T03:23:54.568892+0000","last_undegraded":"2023-10-06T03:23:54.568892+0000","last_fullsized":"2023-10-06T03:23:54.568892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:29.722975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581802+0000","last_change":"2023-10-06T03:23:54.577157+0000","last_active":"2023-10-06T03:23:54.581802+0000","last_peered":"2023-10-06T03:23:54.581802+0000","last_clean":"2023-10-06T03:23:54.581802+0000","last_became_active":"2023-10-06T03:23:54.576783+0000","last_became_peered":"2023-10-06T03:23:54.576783+0000","last_unstale":"2023-10-06T03:23:54.581802+0000","last_undegraded":"2023-10-06T03:23:54.581802+0000","last_fullsized":"2023-10-06T03:23:54.581802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:07.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561143+0000","last_change":"2023-10-06T03:23:49.548189+0000","last_active":"2023-10-06T03:23:54.561143+0000","last_peered":"2023-10-06T03:23:54.561143+0000","last_clean":"2023-10-06T03:23:54.561143+0000","last_became_active":"2023-10-06T03:23:49.547936+0000","last_became_peered":"2023-10-06T03:23:49.547936+0000","last_unstale":"2023-10-06T03:23:54.561143+0000","last_undegraded":"2023-10-06T03:23:54.561143+0000","last_fullsized":"2023-10-06T03:23:54.561143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:42.983966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572005+0000","last_change":"2023-10-06T03:23:50.554414+0000","last_active":"2023-10-06T03:23:54.572005+0000","last_peered":"2023-10-06T03:23:54.572005+0000","last_clean":"2023-10-06T03:23:54.572005+0000","last_became_active":"2023-10-06T03:23:50.554126+0000","last_became_peered":"2023-10-06T03:23:50.554126+0000","last_unstale":"2023-10-06T03:23:54.572005+0000","last_undegraded":"2023-10-06T03:23:54.572005+0000","last_fullsized":"2023-10-06T03:23:54.572005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.890073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582750+0000","last_change":"2023-10-06T03:23:54.577469+0000","last_active":"2023-10-06T03:23:54.582750+0000","last_peered":"2023-10-06T03:23:54.582750+0000","last_clean":"2023-10-06T03:23:54.582750+0000","last_became_active":"2023-10-06T03:23:54.577100+0000","last_became_peered":"2023-10-06T03:23:54.577100+0000","last_unstale":"2023-10-06T03:23:54.582750+0000","last_undegraded":"2023-10-06T03:23:54.582750+0000","last_fullsized":"2023-10-06T03:23:54.582750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:41.482140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560302+0000","last_change":"2023-10-06T03:23:49.551245+0000","last_active":"2023-10-06T03:23:54.560302+0000","last_peered":"2023-10-06T03:23:54.560302+0000","last_clean":"2023-10-06T03:23:54.560302+0000","last_became_active":"2023-10-06T03:23:49.550981+0000","last_became_peered":"2023-10-06T03:23:49.550981+0000","last_unstale":"2023-10-06T03:23:54.560302+0000","last_undegraded":"2023-10-06T03:23:54.560302+0000","last_fullsized":"2023-10-06T03:23:54.560302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567343+0000","last_change":"2023-10-06T03:23:50.546972+0000","last_active":"2023-10-06T03:23:54.567343+0000","last_peered":"2023-10-06T03:23:54.567343+0000","last_clean":"2023-10-06T03:23:54.567343+0000","last_became_active":"2023-10-06T03:23:50.546729+0000","last_became_peered":"2023-10-06T03:23:50.546729+0000","last_unstale":"2023-10-06T03:23:54.567343+0000","last_undegraded":"2023-10-06T03:23:54.567343+0000","last_fullsized":"2023-10-06T03:23:54.567343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581894+0000","last_change":"2023-10-06T03:23:54.576116+0000","last_active":"2023-10-06T03:23:54.581894+0000","last_peered":"2023-10-06T03:23:54.581894+0000","last_clean":"2023-10-06T03:23:54.581894+0000","last_became_active":"2023-10-06T03:23:54.575714+0000","last_became_peered":"2023-10-06T03:23:54.575714+0000","last_unstale":"2023-10-06T03:23:54.581894+0000","last_undegraded":"2023-10-06T03:23:54.581894+0000","last_fullsized":"2023-10-06T03:23:54.581894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:33.745377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558207+0000","last_change":"2023-10-06T03:23:49.549931+0000","last_active":"2023-10-06T03:23:54.558207+0000","last_peered":"2023-10-06T03:23:54.558207+0000","last_clean":"2023-10-06T03:23:54.558207+0000","last_became_active":"2023-10-06T03:23:49.549675+0000","last_became_peered":"2023-10-06T03:23:49.549675+0000","last_unstale":"2023-10-06T03:23:54.558207+0000","last_undegraded":"2023-10-06T03:23:54.558207+0000","last_fullsized":"2023-10-06T03:23:54.558207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569852+0000","last_change":"2023-10-06T03:23:50.560836+0000","last_active":"2023-10-06T03:23:54.569852+0000","last_peered":"2023-10-06T03:23:54.569852+0000","last_clean":"2023-10-06T03:23:54.569852+0000","last_became_active":"2023-10-06T03:23:50.560582+0000","last_became_peered":"2023-10-06T03:23:50.560582+0000","last_unstale":"2023-10-06T03:23:54.569852+0000","last_undegraded":"2023-10-06T03:23:54.569852+0000","last_fullsized":"2023-10-06T03:23:54.569852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:53.298950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582964+0000","last_change":"2023-10-06T03:23:54.580383+0000","last_active":"2023-10-06T03:23:54.582964+0000","last_peered":"2023-10-06T03:23:54.582964+0000","last_clean":"2023-10-06T03:23:54.582964+0000","last_became_active":"2023-10-06T03:23:54.580033+0000","last_became_peered":"2023-10-06T03:23:54.580033+0000","last_unstale":"2023-10-06T03:23:54.582964+0000","last_undegraded":"2023-10-06T03:23:54.582964+0000","last_fullsized":"2023-10-06T03:23:54.582964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:01.313140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572093+0000","last_change":"2023-10-06T03:23:49.551405+0000","last_active":"2023-10-06T03:23:54.572093+0000","last_peered":"2023-10-06T03:23:54.572093+0000","last_clean":"2023-10-06T03:23:54.572093+0000","last_became_active":"2023-10-06T03:23:49.551030+0000","last_became_peered":"2023-10-06T03:23:49.551030+0000","last_unstale":"2023-10-06T03:23:54.572093+0000","last_undegraded":"2023-10-06T03:23:54.572093+0000","last_fullsized":"2023-10-06T03:23:54.572093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569949+0000","last_change":"2023-10-06T03:23:50.547982+0000","last_active":"2023-10-06T03:23:54.569949+0000","last_peered":"2023-10-06T03:23:54.569949+0000","last_clean":"2023-10-06T03:23:54.569949+0000","last_became_active":"2023-10-06T03:23:50.547602+0000","last_became_peered":"2023-10-06T03:23:50.547602+0000","last_unstale":"2023-10-06T03:23:54.569949+0000","last_undegraded":"2023-10-06T03:23:54.569949+0000","last_fullsized":"2023-10-06T03:23:54.569949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:03.745193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582140+0000","last_change":"2023-10-06T03:23:54.575198+0000","last_active":"2023-10-06T03:23:54.582140+0000","last_peered":"2023-10-06T03:23:54.582140+0000","last_clean":"2023-10-06T03:23:54.582140+0000","last_became_active":"2023-10-06T03:23:54.574788+0000","last_became_peered":"2023-10-06T03:23:54.574788+0000","last_unstale":"2023-10-06T03:23:54.582140+0000","last_undegraded":"2023-10-06T03:23:54.582140+0000","last_fullsized":"2023-10-06T03:23:54.582140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:20.930646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568731+0000","last_change":"2023-10-06T03:23:49.538200+0000","last_active":"2023-10-06T03:23:54.568731+0000","last_peered":"2023-10-06T03:23:54.568731+0000","last_clean":"2023-10-06T03:23:54.568731+0000","last_became_active":"2023-10-06T03:23:49.537928+0000","last_became_peered":"2023-10-06T03:23:49.537928+0000","last_unstale":"2023-10-06T03:23:54.568731+0000","last_undegraded":"2023-10-06T03:23:54.568731+0000","last_fullsized":"2023-10-06T03:23:54.568731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570161+0000","last_change":"2023-10-06T03:23:50.552986+0000","last_active":"2023-10-06T03:23:54.570161+0000","last_peered":"2023-10-06T03:23:54.570161+0000","last_clean":"2023-10-06T03:23:54.570161+0000","last_became_active":"2023-10-06T03:23:50.552689+0000","last_became_peered":"2023-10-06T03:23:50.552689+0000","last_unstale":"2023-10-06T03:23:54.570161+0000","last_undegraded":"2023-10-06T03:23:54.570161+0000","last_fullsized":"2023-10-06T03:23:54.570161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.579868+0000","last_change":"2023-10-06T03:23:54.578003+0000","last_active":"2023-10-06T03:23:54.579868+0000","last_peered":"2023-10-06T03:23:54.579868+0000","last_clean":"2023-10-06T03:23:54.579868+0000","last_became_active":"2023-10-06T03:23:54.577637+0000","last_became_peered":"2023-10-06T03:23:54.577637+0000","last_unstale":"2023-10-06T03:23:54.579868+0000","last_undegraded":"2023-10-06T03:23:54.579868+0000","last_fullsized":"2023-10-06T03:23:54.579868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:14.629579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557999+0000","last_change":"2023-10-06T03:23:49.550476+0000","last_active":"2023-10-06T03:23:54.557999+0000","last_peered":"2023-10-06T03:23:54.557999+0000","last_clean":"2023-10-06T03:23:54.557999+0000","last_became_active":"2023-10-06T03:23:49.549380+0000","last_became_peered":"2023-10-06T03:23:49.549380+0000","last_unstale":"2023-10-06T03:23:54.557999+0000","last_undegraded":"2023-10-06T03:23:54.557999+0000","last_fullsized":"2023-10-06T03:23:54.557999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.028565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574909+0000","last_change":"2023-10-06T03:23:50.556274+0000","last_active":"2023-10-06T03:23:54.574909+0000","last_peered":"2023-10-06T03:23:54.574909+0000","last_clean":"2023-10-06T03:23:54.574909+0000","last_became_active":"2023-10-06T03:23:50.555698+0000","last_became_peered":"2023-10-06T03:23:50.555698+0000","last_unstale":"2023-10-06T03:23:54.574909+0000","last_undegraded":"2023-10-06T03:23:54.574909+0000","last_fullsized":"2023-10-06T03:23:54.574909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:45.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585484+0000","last_change":"2023-10-06T03:23:54.583261+0000","last_active":"2023-10-06T03:23:54.585484+0000","last_peered":"2023-10-06T03:23:54.585484+0000","last_clean":"2023-10-06T03:23:54.585484+0000","last_became_active":"2023-10-06T03:23:54.582906+0000","last_became_peered":"2023-10-06T03:23:54.582906+0000","last_unstale":"2023-10-06T03:23:54.585484+0000","last_undegraded":"2023-10-06T03:23:54.585484+0000","last_fullsized":"2023-10-06T03:23:54.585484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:49.490384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559423+0000","last_change":"2023-10-06T03:23:49.542977+0000","last_active":"2023-10-06T03:23:54.559423+0000","last_peered":"2023-10-06T03:23:54.559423+0000","last_clean":"2023-10-06T03:23:54.559423+0000","last_became_active":"2023-10-06T03:23:49.541527+0000","last_became_peered":"2023-10-06T03:23:49.541527+0000","last_unstale":"2023-10-06T03:23:54.559423+0000","last_undegraded":"2023-10-06T03:23:54.559423+0000","last_fullsized":"2023-10-06T03:23:54.559423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570117+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:23:54.570117+0000","last_peered":"2023-10-06T03:23:54.570117+0000","last_clean":"2023-10-06T03:23:54.570117+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:23:54.570117+0000","last_undegraded":"2023-10-06T03:23:54.570117+0000","last_fullsized":"2023-10-06T03:23:54.570117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557888+0000","last_change":"2023-10-06T03:23:50.559454+0000","last_active":"2023-10-06T03:23:54.557888+0000","last_peered":"2023-10-06T03:23:54.557888+0000","last_clean":"2023-10-06T03:23:54.557888+0000","last_became_active":"2023-10-06T03:23:50.554761+0000","last_became_peered":"2023-10-06T03:23:50.554761+0000","last_unstale":"2023-10-06T03:23:54.557888+0000","last_undegraded":"2023-10-06T03:23:54.557888+0000","last_fullsized":"2023-10-06T03:23:54.557888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:42.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585917+0000","last_change":"2023-10-06T03:23:54.583446+0000","last_active":"2023-10-06T03:23:54.585917+0000","last_peered":"2023-10-06T03:23:54.585917+0000","last_clean":"2023-10-06T03:23:54.585917+0000","last_became_active":"2023-10-06T03:23:54.583023+0000","last_became_peered":"2023-10-06T03:23:54.583023+0000","last_unstale":"2023-10-06T03:23:54.585917+0000","last_undegraded":"2023-10-06T03:23:54.585917+0000","last_fullsized":"2023-10-06T03:23:54.585917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:03.806535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558092+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:23:54.558092+0000","last_peered":"2023-10-06T03:23:54.558092+0000","last_clean":"2023-10-06T03:23:54.558092+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:23:54.558092+0000","last_undegraded":"2023-10-06T03:23:54.558092+0000","last_fullsized":"2023-10-06T03:23:54.558092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.618705+0000","last_change":"2023-10-06T03:23:49.546452+0000","last_active":"2023-10-06T03:23:54.618705+0000","last_peered":"2023-10-06T03:23:54.618705+0000","last_clean":"2023-10-06T03:23:54.618705+0000","last_became_active":"2023-10-06T03:23:49.545885+0000","last_became_peered":"2023-10-06T03:23:49.545885+0000","last_unstale":"2023-10-06T03:23:54.618705+0000","last_undegraded":"2023-10-06T03:23:54.618705+0000","last_fullsized":"2023-10-06T03:23:54.618705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568810+0000","last_change":"2023-10-06T03:23:50.550474+0000","last_active":"2023-10-06T03:23:54.568810+0000","last_peered":"2023-10-06T03:23:54.568810+0000","last_clean":"2023-10-06T03:23:54.568810+0000","last_became_active":"2023-10-06T03:23:50.550207+0000","last_became_peered":"2023-10-06T03:23:50.550207+0000","last_unstale":"2023-10-06T03:23:54.568810+0000","last_undegraded":"2023-10-06T03:23:54.568810+0000","last_fullsized":"2023-10-06T03:23:54.568810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:42.365176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582115+0000","last_change":"2023-10-06T03:23:54.574338+0000","last_active":"2023-10-06T03:23:54.582115+0000","last_peered":"2023-10-06T03:23:54.582115+0000","last_clean":"2023-10-06T03:23:54.582115+0000","last_became_active":"2023-10-06T03:23:54.573845+0000","last_became_peered":"2023-10-06T03:23:54.573845+0000","last_unstale":"2023-10-06T03:23:54.582115+0000","last_undegraded":"2023-10-06T03:23:54.582115+0000","last_fullsized":"2023-10-06T03:23:54.582115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574305+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:23:54.574305+0000","last_peered":"2023-10-06T03:23:54.574305+0000","last_clean":"2023-10-06T03:23:54.574305+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:23:54.574305+0000","last_undegraded":"2023-10-06T03:23:54.574305+0000","last_fullsized":"2023-10-06T03:23:54.574305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560457+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:23:54.560457+0000","last_peered":"2023-10-06T03:23:54.560457+0000","last_clean":"2023-10-06T03:23:54.560457+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:23:54.560457+0000","last_undegraded":"2023-10-06T03:23:54.560457+0000","last_fullsized":"2023-10-06T03:23:54.560457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.564914+0000","last_change":"2023-10-06T03:23:49.548108+0000","last_active":"2023-10-06T03:23:54.564914+0000","last_peered":"2023-10-06T03:23:54.564914+0000","last_clean":"2023-10-06T03:23:54.564914+0000","last_became_active":"2023-10-06T03:23:49.547822+0000","last_became_peered":"2023-10-06T03:23:49.547822+0000","last_unstale":"2023-10-06T03:23:54.564914+0000","last_undegraded":"2023-10-06T03:23:54.564914+0000","last_fullsized":"2023-10-06T03:23:54.564914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.497936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.565572+0000","last_change":"2023-10-06T03:23:50.553282+0000","last_active":"2023-10-06T03:23:54.565572+0000","last_peered":"2023-10-06T03:23:54.565572+0000","last_clean":"2023-10-06T03:23:54.565572+0000","last_became_active":"2023-10-06T03:23:50.553022+0000","last_became_peered":"2023-10-06T03:23:50.553022+0000","last_unstale":"2023-10-06T03:23:54.565572+0000","last_undegraded":"2023-10-06T03:23:54.565572+0000","last_fullsized":"2023-10-06T03:23:54.565572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:43.267305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.585122+0000","last_change":"2023-10-06T03:23:54.579225+0000","last_active":"2023-10-06T03:23:54.585122+0000","last_peered":"2023-10-06T03:23:54.585122+0000","last_clean":"2023-10-06T03:23:54.585122+0000","last_became_active":"2023-10-06T03:23:54.578772+0000","last_became_peered":"2023-10-06T03:23:54.578772+0000","last_unstale":"2023-10-06T03:23:54.585122+0000","last_undegraded":"2023-10-06T03:23:54.585122+0000","last_fullsized":"2023-10-06T03:23:54.585122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:20.332751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.562142+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:23:54.562142+0000","last_peered":"2023-10-06T03:23:54.562142+0000","last_clean":"2023-10-06T03:23:54.562142+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:23:54.562142+0000","last_undegraded":"2023-10-06T03:23:54.562142+0000","last_fullsized":"2023-10-06T03:23:54.562142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573464+0000","last_change":"2023-10-06T03:23:49.543301+0000","last_active":"2023-10-06T03:23:54.573464+0000","last_peered":"2023-10-06T03:23:54.573464+0000","last_clean":"2023-10-06T03:23:54.573464+0000","last_became_active":"2023-10-06T03:23:49.543042+0000","last_became_peered":"2023-10-06T03:23:49.543042+0000","last_unstale":"2023-10-06T03:23:54.573464+0000","last_undegraded":"2023-10-06T03:23:54.573464+0000","last_fullsized":"2023-10-06T03:23:54.573464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:01.161389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574803+0000","last_change":"2023-10-06T03:23:50.556439+0000","last_active":"2023-10-06T03:23:54.574803+0000","last_peered":"2023-10-06T03:23:54.574803+0000","last_clean":"2023-10-06T03:23:54.574803+0000","last_became_active":"2023-10-06T03:23:50.556043+0000","last_became_peered":"2023-10-06T03:23:50.556043+0000","last_unstale":"2023-10-06T03:23:54.574803+0000","last_undegraded":"2023-10-06T03:23:54.574803+0000","last_fullsized":"2023-10-06T03:23:54.574803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:28.082470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.583328+0000","last_change":"2023-10-06T03:23:54.577530+0000","last_active":"2023-10-06T03:23:54.583328+0000","last_peered":"2023-10-06T03:23:54.583328+0000","last_clean":"2023-10-06T03:23:54.583328+0000","last_became_active":"2023-10-06T03:23:54.577161+0000","last_became_peered":"2023-10-06T03:23:54.577161+0000","last_unstale":"2023-10-06T03:23:54.583328+0000","last_undegraded":"2023-10-06T03:23:54.583328+0000","last_fullsized":"2023-10-06T03:23:54.583328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:01.313140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560295+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:23:54.560295+0000","last_peered":"2023-10-06T03:23:54.560295+0000","last_clean":"2023-10-06T03:23:54.560295+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:23:54.560295+0000","last_undegraded":"2023-10-06T03:23:54.560295+0000","last_fullsized":"2023-10-06T03:23:54.560295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558696+0000","last_change":"2023-10-06T03:23:49.548616+0000","last_active":"2023-10-06T03:23:54.558696+0000","last_peered":"2023-10-06T03:23:54.558696+0000","last_clean":"2023-10-06T03:23:54.558696+0000","last_became_active":"2023-10-06T03:23:49.548377+0000","last_became_peered":"2023-10-06T03:23:49.548377+0000","last_unstale":"2023-10-06T03:23:54.558696+0000","last_undegraded":"2023-10-06T03:23:54.558696+0000","last_fullsized":"2023-10-06T03:23:54.558696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:44.960845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572427+0000","last_change":"2023-10-06T03:23:50.558690+0000","last_active":"2023-10-06T03:23:54.572427+0000","last_peered":"2023-10-06T03:23:54.572427+0000","last_clean":"2023-10-06T03:23:54.572427+0000","last_became_active":"2023-10-06T03:23:50.558466+0000","last_became_peered":"2023-10-06T03:23:50.558466+0000","last_unstale":"2023-10-06T03:23:54.572427+0000","last_undegraded":"2023-10-06T03:23:54.572427+0000","last_fullsized":"2023-10-06T03:23:54.572427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.386684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.588069+0000","last_change":"2023-10-06T03:23:54.579261+0000","last_active":"2023-10-06T03:23:54.588069+0000","last_peered":"2023-10-06T03:23:54.588069+0000","last_clean":"2023-10-06T03:23:54.588069+0000","last_became_active":"2023-10-06T03:23:54.578854+0000","last_became_peered":"2023-10-06T03:23:54.578854+0000","last_unstale":"2023-10-06T03:23:54.588069+0000","last_undegraded":"2023-10-06T03:23:54.588069+0000","last_fullsized":"2023-10-06T03:23:54.588069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:26.465848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560024+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:23:54.560024+0000","last_peered":"2023-10-06T03:23:54.560024+0000","last_clean":"2023-10-06T03:23:54.560024+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:23:54.560024+0000","last_undegraded":"2023-10-06T03:23:54.560024+0000","last_fullsized":"2023-10-06T03:23:54.560024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570037+0000","last_change":"2023-10-06T03:23:49.547635+0000","last_active":"2023-10-06T03:23:54.570037+0000","last_peered":"2023-10-06T03:23:54.570037+0000","last_clean":"2023-10-06T03:23:54.570037+0000","last_became_active":"2023-10-06T03:23:49.545752+0000","last_became_peered":"2023-10-06T03:23:49.545752+0000","last_unstale":"2023-10-06T03:23:54.570037+0000","last_undegraded":"2023-10-06T03:23:54.570037+0000","last_fullsized":"2023-10-06T03:23:54.570037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574483+0000","last_change":"2023-10-06T03:23:50.549324+0000","last_active":"2023-10-06T03:23:54.574483+0000","last_peered":"2023-10-06T03:23:54.574483+0000","last_clean":"2023-10-06T03:23:54.574483+0000","last_became_active":"2023-10-06T03:23:50.546439+0000","last_became_peered":"2023-10-06T03:23:50.546439+0000","last_unstale":"2023-10-06T03:23:54.574483+0000","last_undegraded":"2023-10-06T03:23:54.574483+0000","last_fullsized":"2023-10-06T03:23:54.574483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:21.033440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.583424+0000","last_change":"2023-10-06T03:23:54.579994+0000","last_active":"2023-10-06T03:23:54.583424+0000","last_peered":"2023-10-06T03:23:54.583424+0000","last_clean":"2023-10-06T03:23:54.583424+0000","last_became_active":"2023-10-06T03:23:54.579608+0000","last_became_peered":"2023-10-06T03:23:54.579608+0000","last_unstale":"2023-10-06T03:23:54.583424+0000","last_undegraded":"2023-10-06T03:23:54.583424+0000","last_fullsized":"2023-10-06T03:23:54.583424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:43.155244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572140+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:23:54.572140+0000","last_peered":"2023-10-06T03:23:54.572140+0000","last_clean":"2023-10-06T03:23:54.572140+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:23:54.572140+0000","last_undegraded":"2023-10-06T03:23:54.572140+0000","last_fullsized":"2023-10-06T03:23:54.572140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574682+0000","last_change":"2023-10-06T03:23:49.545180+0000","last_active":"2023-10-06T03:23:54.574682+0000","last_peered":"2023-10-06T03:23:54.574682+0000","last_clean":"2023-10-06T03:23:54.574682+0000","last_became_active":"2023-10-06T03:23:49.544948+0000","last_became_peered":"2023-10-06T03:23:49.544948+0000","last_unstale":"2023-10-06T03:23:54.574682+0000","last_undegraded":"2023-10-06T03:23:54.574682+0000","last_fullsized":"2023-10-06T03:23:54.574682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:11.341681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567580+0000","last_change":"2023-10-06T03:23:50.550782+0000","last_active":"2023-10-06T03:23:54.567580+0000","last_peered":"2023-10-06T03:23:54.567580+0000","last_clean":"2023-10-06T03:23:54.567580+0000","last_became_active":"2023-10-06T03:23:50.550406+0000","last_became_peered":"2023-10-06T03:23:50.550406+0000","last_unstale":"2023-10-06T03:23:54.567580+0000","last_undegraded":"2023-10-06T03:23:54.567580+0000","last_fullsized":"2023-10-06T03:23:54.567580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.588080+0000","last_change":"2023-10-06T03:23:54.580162+0000","last_active":"2023-10-06T03:23:54.588080+0000","last_peered":"2023-10-06T03:23:54.588080+0000","last_clean":"2023-10-06T03:23:54.588080+0000","last_became_active":"2023-10-06T03:23:54.579792+0000","last_became_peered":"2023-10-06T03:23:54.579792+0000","last_unstale":"2023-10-06T03:23:54.588080+0000","last_undegraded":"2023-10-06T03:23:54.588080+0000","last_fullsized":"2023-10-06T03:23:54.588080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:09.181438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572797+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:23:54.572797+0000","last_peered":"2023-10-06T03:23:54.572797+0000","last_clean":"2023-10-06T03:23:54.572797+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:23:54.572797+0000","last_undegraded":"2023-10-06T03:23:54.572797+0000","last_fullsized":"2023-10-06T03:23:54.572797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561503+0000","last_change":"2023-10-06T03:23:49.544756+0000","last_active":"2023-10-06T03:23:54.561503+0000","last_peered":"2023-10-06T03:23:54.561503+0000","last_clean":"2023-10-06T03:23:54.561503+0000","last_became_active":"2023-10-06T03:23:49.544484+0000","last_became_peered":"2023-10-06T03:23:49.544484+0000","last_unstale":"2023-10-06T03:23:54.561503+0000","last_undegraded":"2023-10-06T03:23:54.561503+0000","last_fullsized":"2023-10-06T03:23:54.561503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.573304+0000","last_change":"2023-10-06T03:23:50.553155+0000","last_active":"2023-10-06T03:23:54.573304+0000","last_peered":"2023-10-06T03:23:54.573304+0000","last_clean":"2023-10-06T03:23:54.573304+0000","last_became_active":"2023-10-06T03:23:50.552915+0000","last_became_peered":"2023-10-06T03:23:50.552915+0000","last_unstale":"2023-10-06T03:23:54.573304+0000","last_undegraded":"2023-10-06T03:23:54.573304+0000","last_fullsized":"2023-10-06T03:23:54.573304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:36.020010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.581310+0000","last_change":"2023-10-06T03:23:54.580336+0000","last_active":"2023-10-06T03:23:54.581310+0000","last_peered":"2023-10-06T03:23:54.581310+0000","last_clean":"2023-10-06T03:23:54.581310+0000","last_became_active":"2023-10-06T03:23:54.579923+0000","last_became_peered":"2023-10-06T03:23:54.579923+0000","last_unstale":"2023-10-06T03:23:54.581310+0000","last_undegraded":"2023-10-06T03:23:54.581310+0000","last_fullsized":"2023-10-06T03:23:54.581310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:18.254667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.567497+0000","last_change":"2023-10-06T03:23:49.551353+0000","last_active":"2023-10-06T03:23:54.567497+0000","last_peered":"2023-10-06T03:23:54.567497+0000","last_clean":"2023-10-06T03:23:54.567497+0000","last_became_active":"2023-10-06T03:23:49.550924+0000","last_became_peered":"2023-10-06T03:23:49.550924+0000","last_unstale":"2023-10-06T03:23:54.567497+0000","last_undegraded":"2023-10-06T03:23:54.567497+0000","last_fullsized":"2023-10-06T03:23:54.567497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561785+0000","last_change":"2023-10-06T03:23:50.548063+0000","last_active":"2023-10-06T03:23:54.561785+0000","last_peered":"2023-10-06T03:23:54.561785+0000","last_clean":"2023-10-06T03:23:54.561785+0000","last_became_active":"2023-10-06T03:23:50.547820+0000","last_became_peered":"2023-10-06T03:23:50.547820+0000","last_unstale":"2023-10-06T03:23:54.561785+0000","last_undegraded":"2023-10-06T03:23:54.561785+0000","last_fullsized":"2023-10-06T03:23:54.561785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:06.967901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.584497+0000","last_change":"2023-10-06T03:23:54.580975+0000","last_active":"2023-10-06T03:23:54.584497+0000","last_peered":"2023-10-06T03:23:54.584497+0000","last_clean":"2023-10-06T03:23:54.584497+0000","last_became_active":"2023-10-06T03:23:54.580530+0000","last_became_peered":"2023-10-06T03:23:54.580530+0000","last_unstale":"2023-10-06T03:23:54.584497+0000","last_undegraded":"2023-10-06T03:23:54.584497+0000","last_fullsized":"2023-10-06T03:23:54.584497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:26.465848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.560207+0000","last_change":"2023-10-06T03:23:49.550718+0000","last_active":"2023-10-06T03:23:54.560207+0000","last_peered":"2023-10-06T03:23:54.560207+0000","last_clean":"2023-10-06T03:23:54.560207+0000","last_became_active":"2023-10-06T03:23:49.550451+0000","last_became_peered":"2023-10-06T03:23:49.550451+0000","last_unstale":"2023-10-06T03:23:54.560207+0000","last_undegraded":"2023-10-06T03:23:54.560207+0000","last_fullsized":"2023-10-06T03:23:54.560207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:10.235448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.569944+0000","last_change":"2023-10-06T03:23:50.560044+0000","last_active":"2023-10-06T03:23:54.569944+0000","last_peered":"2023-10-06T03:23:54.569944+0000","last_clean":"2023-10-06T03:23:54.569944+0000","last_became_active":"2023-10-06T03:23:50.559762+0000","last_became_peered":"2023-10-06T03:23:50.559762+0000","last_unstale":"2023-10-06T03:23:54.569944+0000","last_undegraded":"2023-10-06T03:23:54.569944+0000","last_fullsized":"2023-10-06T03:23:54.569944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:57.290738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.577962+0000","last_change":"2023-10-06T03:23:54.572457+0000","last_active":"2023-10-06T03:23:54.577962+0000","last_peered":"2023-10-06T03:23:54.577962+0000","last_clean":"2023-10-06T03:23:54.577962+0000","last_became_active":"2023-10-06T03:23:54.571942+0000","last_became_peered":"2023-10-06T03:23:54.571942+0000","last_unstale":"2023-10-06T03:23:54.577962+0000","last_undegraded":"2023-10-06T03:23:54.577962+0000","last_fullsized":"2023-10-06T03:23:54.577962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:04.871504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.561406+0000","last_change":"2023-10-06T03:23:49.550646+0000","last_active":"2023-10-06T03:23:54.561406+0000","last_peered":"2023-10-06T03:23:54.561406+0000","last_clean":"2023-10-06T03:23:54.561406+0000","last_became_active":"2023-10-06T03:23:49.550386+0000","last_became_peered":"2023-10-06T03:23:49.550386+0000","last_unstale":"2023-10-06T03:23:54.561406+0000","last_undegraded":"2023-10-06T03:23:54.561406+0000","last_fullsized":"2023-10-06T03:23:54.561406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:47.407550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570428+0000","last_change":"2023-10-06T03:23:50.546985+0000","last_active":"2023-10-06T03:23:54.570428+0000","last_peered":"2023-10-06T03:23:54.570428+0000","last_clean":"2023-10-06T03:23:54.570428+0000","last_became_active":"2023-10-06T03:23:50.546697+0000","last_became_peered":"2023-10-06T03:23:50.546697+0000","last_unstale":"2023-10-06T03:23:54.570428+0000","last_undegraded":"2023-10-06T03:23:54.570428+0000","last_fullsized":"2023-10-06T03:23:54.570428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:14.232265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.582421+0000","last_change":"2023-10-06T03:23:54.580064+0000","last_active":"2023-10-06T03:23:54.582421+0000","last_peered":"2023-10-06T03:23:54.582421+0000","last_clean":"2023-10-06T03:23:54.582421+0000","last_became_active":"2023-10-06T03:23:54.579678+0000","last_became_peered":"2023-10-06T03:23:54.579678+0000","last_unstale":"2023-10-06T03:23:54.582421+0000","last_undegraded":"2023-10-06T03:23:54.582421+0000","last_fullsized":"2023-10-06T03:23:54.582421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:35.686057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.559611+0000","last_change":"2023-10-06T03:23:49.548219+0000","last_active":"2023-10-06T03:23:54.559611+0000","last_peered":"2023-10-06T03:23:54.559611+0000","last_clean":"2023-10-06T03:23:54.559611+0000","last_became_active":"2023-10-06T03:23:49.547961+0000","last_became_peered":"2023-10-06T03:23:49.547961+0000","last_unstale":"2023-10-06T03:23:54.559611+0000","last_undegraded":"2023-10-06T03:23:54.559611+0000","last_fullsized":"2023-10-06T03:23:54.559611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:26.970739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557859+0000","last_change":"2023-10-06T03:23:50.551706+0000","last_active":"2023-10-06T03:23:54.557859+0000","last_peered":"2023-10-06T03:23:54.557859+0000","last_clean":"2023-10-06T03:23:54.557859+0000","last_became_active":"2023-10-06T03:23:50.551421+0000","last_became_peered":"2023-10-06T03:23:50.551421+0000","last_unstale":"2023-10-06T03:23:54.557859+0000","last_undegraded":"2023-10-06T03:23:54.557859+0000","last_fullsized":"2023-10-06T03:23:54.557859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:16.310349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.586634+0000","last_change":"2023-10-06T03:23:54.585084+0000","last_active":"2023-10-06T03:23:54.586634+0000","last_peered":"2023-10-06T03:23:54.586634+0000","last_clean":"2023-10-06T03:23:54.586634+0000","last_became_active":"2023-10-06T03:23:54.584340+0000","last_became_peered":"2023-10-06T03:23:54.584340+0000","last_unstale":"2023-10-06T03:23:54.586634+0000","last_undegraded":"2023-10-06T03:23:54.586634+0000","last_fullsized":"2023-10-06T03:23:54.586634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:53.546466+0000","last_clean_scrub_stamp":"2023-10-06T03:23:53.546466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:56.706198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.566271+0000","last_change":"2023-10-06T03:23:49.544298+0000","last_active":"2023-10-06T03:23:54.566271+0000","last_peered":"2023-10-06T03:23:54.566271+0000","last_clean":"2023-10-06T03:23:54.566271+0000","last_became_active":"2023-10-06T03:23:49.543893+0000","last_became_peered":"2023-10-06T03:23:49.543893+0000","last_unstale":"2023-10-06T03:23:54.566271+0000","last_undegraded":"2023-10-06T03:23:54.566271+0000","last_fullsized":"2023-10-06T03:23:54.566271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:48.519188+0000","last_clean_scrub_stamp":"2023-10-06T03:23:48.519188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:05.963026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.568117+0000","last_change":"2023-10-06T03:23:50.553611+0000","last_active":"2023-10-06T03:23:54.568117+0000","last_peered":"2023-10-06T03:23:54.568117+0000","last_clean":"2023-10-06T03:23:54.568117+0000","last_became_active":"2023-10-06T03:23:50.553182+0000","last_became_peered":"2023-10-06T03:23:50.553182+0000","last_unstale":"2023-10-06T03:23:54.568117+0000","last_undegraded":"2023-10-06T03:23:54.568117+0000","last_fullsized":"2023-10-06T03:23:54.568117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:16.310349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.572471+0000","last_change":"2023-10-06T03:23:50.553726+0000","last_active":"2023-10-06T03:23:54.572471+0000","last_peered":"2023-10-06T03:23:54.572471+0000","last_clean":"2023-10-06T03:23:54.572471+0000","last_became_active":"2023-10-06T03:23:50.553470+0000","last_became_peered":"2023-10-06T03:23:50.553470+0000","last_unstale":"2023-10-06T03:23:54.572471+0000","last_undegraded":"2023-10-06T03:23:54.572471+0000","last_fullsized":"2023-10-06T03:23:54.572471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:29.620598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.557956+0000","last_change":"2023-10-06T03:23:50.559351+0000","last_active":"2023-10-06T03:23:54.557956+0000","last_peered":"2023-10-06T03:23:54.557956+0000","last_clean":"2023-10-06T03:23:54.557956+0000","last_became_active":"2023-10-06T03:23:50.554817+0000","last_became_peered":"2023-10-06T03:23:50.554817+0000","last_unstale":"2023-10-06T03:23:54.557956+0000","last_undegraded":"2023-10-06T03:23:54.557956+0000","last_fullsized":"2023-10-06T03:23:54.557956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:29.722975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.570702+0000","last_change":"2023-10-06T03:23:50.556578+0000","last_active":"2023-10-06T03:23:54.570702+0000","last_peered":"2023-10-06T03:23:54.570702+0000","last_clean":"2023-10-06T03:23:54.570702+0000","last_became_active":"2023-10-06T03:23:50.556314+0000","last_became_peered":"2023-10-06T03:23:50.556314+0000","last_unstale":"2023-10-06T03:23:54.570702+0000","last_undegraded":"2023-10-06T03:23:54.570702+0000","last_fullsized":"2023-10-06T03:23:54.570702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:00.849101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.558641+0000","last_change":"2023-10-06T03:23:50.556963+0000","last_active":"2023-10-06T03:23:54.558641+0000","last_peered":"2023-10-06T03:23:54.558641+0000","last_clean":"2023-10-06T03:23:54.558641+0000","last_became_active":"2023-10-06T03:23:50.555458+0000","last_became_peered":"2023-10-06T03:23:50.555458+0000","last_unstale":"2023-10-06T03:23:54.558641+0000","last_undegraded":"2023-10-06T03:23:54.558641+0000","last_fullsized":"2023-10-06T03:23:54.558641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:20.752666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:54.574585+0000","last_change":"2023-10-06T03:23:50.551327+0000","last_active":"2023-10-06T03:23:54.574585+0000","last_peered":"2023-10-06T03:23:54.574585+0000","last_clean":"2023-10-06T03:23:54.574585+0000","last_became_active":"2023-10-06T03:23:50.551040+0000","last_became_peered":"2023-10-06T03:23:50.551040+0000","last_unstale":"2023-10-06T03:23:54.574585+0000","last_undegraded":"2023-10-06T03:23:54.574585+0000","last_fullsized":"2023-10-06T03:23:54.574585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:49.524064+0000","last_clean_scrub_stamp":"2023-10-06T03:23:49.524064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:10.053071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":698736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3680000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.5039999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":694806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":103639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.19}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.111999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.919}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":108208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":105062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:09.527 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:24:09.527 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T03:24:09.527 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T03:24:09.527 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T03:24:09.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.670+0000 7fbb9d25d700 1 Processor -- start 2023-10-06T03:24:09.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.670+0000 7fbb9d25d700 1 -- start start 2023-10-06T03:24:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9d25d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb98159480 0x7fbb980b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9d25d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbb980b3610 0x7fbb980cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9d25d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb980cc1b0 0x7fbb980b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9d25d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb980cb7e0 con 0x7fbb980cc1b0 2023-10-06T03:24:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9d25d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb980b08a0 con 0x7fbb980b3610 2023-10-06T03:24:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9d25d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980cb190 con 0x7fbb98159480 2023-10-06T03:24:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9ca5c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb980cc1b0 0x7fbb980b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9ca5c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb980cc1b0 0x7fbb980b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34234/0 (socket says 172.21.15.84:34234) 2023-10-06T03:24:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9ca5c700 1 -- 172.21.15.84:0/402667894 learned_addr learned my addr 172.21.15.84:0/402667894 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb977fe700 1 --2- 172.21.15.84:0/402667894 >> v2:172.21.15.131:3300/0 conn(0x7fbb980b3610 0x7fbb980cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb97fff700 1 --2- 172.21.15.84:0/402667894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb98159480 0x7fbb980b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9ca5c700 1 -- 172.21.15.84:0/402667894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb98159480 msgr2=0x7fbb980b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:09.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9ca5c700 1 --2- 172.21.15.84:0/402667894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb98159480 0x7fbb980b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9ca5c700 1 -- 172.21.15.84:0/402667894 >> v2:172.21.15.131:3300/0 conn(0x7fbb980b3610 msgr2=0x7fbb980cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:09.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9ca5c700 1 --2- 172.21.15.84:0/402667894 >> v2:172.21.15.131:3300/0 conn(0x7fbb980b3610 0x7fbb980cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.671+0000 7fbb9ca5c700 1 -- 172.21.15.84:0/402667894 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980cb470 con 0x7fbb980cc1b0 2023-10-06T03:24:09.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb9ca5c700 1 --2- 172.21.15.84:0/402667894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980cc1b0 0x7fbb980b2140 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbb98069160 tx=0x7fbb90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d285db0b5a06da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb96ffd700 1 -- 172.21.15.84:0/402667894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9000e070 con 0x7fbb980cc1b0 2023-10-06T03:24:09.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb96ffd700 1 -- 172.21.15.84:0/402667894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9000b970 con 0x7fbb980cc1b0 2023-10-06T03:24:09.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb96ffd700 1 -- 172.21.15.84:0/402667894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900092e0 con 0x7fbb980cc1b0 2023-10-06T03:24:09.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb9d25d700 1 -- 172.21.15.84:0/402667894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980cc1b0 msgr2=0x7fbb980b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb9d25d700 1 --2- 172.21.15.84:0/402667894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980cc1b0 0x7fbb980b2140 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbb98069160 tx=0x7fbb90009840 comp rx=0 tx=0).stop 2023-10-06T03:24:09.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb9d25d700 1 -- 172.21.15.84:0/402667894 shutdown_connections 2023-10-06T03:24:09.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb9d25d700 1 --2- 172.21.15.84:0/402667894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980cc1b0 0x7fbb980b2140 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb9d25d700 1 --2- 172.21.15.84:0/402667894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb98159480 0x7fbb980b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb9d25d700 1 --2- 172.21.15.84:0/402667894 >> v2:172.21.15.131:3300/0 conn(0x7fbb980b3610 0x7fbb980cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb9d25d700 1 -- 172.21.15.84:0/402667894 >> 172.21.15.84:0/402667894 conn(0x7fbb9806ed20 msgr2=0x7fbb9806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:09.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb9d25d700 1 -- 172.21.15.84:0/402667894 shutdown_connections 2023-10-06T03:24:09.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.672+0000 7fbb9d25d700 1 -- 172.21.15.84:0/402667894 wait complete. 2023-10-06T03:24:09.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.673+0000 7fbb9d25d700 1 Processor -- start 2023-10-06T03:24:09.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb9d25d700 1 -- start start 2023-10-06T03:24:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb9d25d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980b3610 0x7fbb98154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb9d25d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb980cc1b0 0x7fbb980c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb9d25d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb98159480 0x7fbb98157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb9d25d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980cf9d0 con 0x7fbb980b3610 2023-10-06T03:24:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb9d25d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980c6b10 con 0x7fbb980cc1b0 2023-10-06T03:24:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb9d25d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980cedc0 con 0x7fbb98159480 2023-10-06T03:24:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb97fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980b3610 0x7fbb98154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb97fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980b3610 0x7fbb98154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34246/0 (socket says 172.21.15.84:34246) 2023-10-06T03:24:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb97fff700 1 -- 172.21.15.84:0/2159163559 learned_addr learned my addr 172.21.15.84:0/2159163559 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb9ca5c700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb98159480 0x7fbb98157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.674+0000 7fbb977fe700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb980cc1b0 0x7fbb980c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb97fff700 1 -- 172.21.15.84:0/2159163559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb98159480 msgr2=0x7fbb98157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb97fff700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb98159480 0x7fbb98157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb97fff700 1 -- 172.21.15.84:0/2159163559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb980cc1b0 msgr2=0x7fbb980c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb97fff700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb980cc1b0 0x7fbb980c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb97fff700 1 -- 172.21.15.84:0/2159163559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90009ae0 con 0x7fbb980b3610 2023-10-06T03:24:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb97fff700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980b3610 0x7fbb98154750 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800e930 tx=0x7fbb880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb7ffff700 1 -- 172.21.15.84:0/2159163559 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88013680 con 0x7fbb980b3610 2023-10-06T03:24:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb7ffff700 1 -- 172.21.15.84:0/2159163559 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb880137e0 con 0x7fbb980b3610 2023-10-06T03:24:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb9d25d700 1 -- 172.21.15.84:0/2159163559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb980cf0a0 con 0x7fbb980b3610 2023-10-06T03:24:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb7ffff700 1 -- 172.21.15.84:0/2159163559 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88013b80 con 0x7fbb980b3610 2023-10-06T03:24:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.675+0000 7fbb9d25d700 1 -- 172.21.15.84:0/2159163559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb980cf660 con 0x7fbb980b3610 2023-10-06T03:24:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.676+0000 7fbb9d25d700 1 -- 172.21.15.84:0/2159163559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9805f270 con 0x7fbb980b3610 2023-10-06T03:24:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.676+0000 7fbb7ffff700 1 -- 172.21.15.84:0/2159163559 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb8800c3e0 con 0x7fbb980b3610 2023-10-06T03:24:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.677+0000 7fbb7ffff700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb84066f30 0x7fbb840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.677+0000 7fbb7ffff700 1 -- 172.21.15.84:0/2159163559 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbb88084a00 con 0x7fbb980b3610 2023-10-06T03:24:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.677+0000 7fbb977fe700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb84066f30 0x7fbb840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.677+0000 7fbb977fe700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb84066f30 0x7fbb840693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb9816c810 tx=0x7fbb8c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.681+0000 7fbb7ffff700 1 -- 172.21.15.84:0/2159163559 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb88051820 con 0x7fbb980b3610 2023-10-06T03:24:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.905+0000 7fbb9d25d700 1 -- 172.21.15.84:0/2159163559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbb98159850 con 0x7fbb980b3610 2023-10-06T03:24:09.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.905+0000 7fbb7ffff700 1 -- 172.21.15.84:0/2159163559 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbb88054e40 con 0x7fbb980b3610 2023-10-06T03:24:09.907 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:09.907 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 -- 172.21.15.84:0/2159163559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb84066f30 msgr2=0x7fbb840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb84066f30 0x7fbb840693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb9816c810 tx=0x7fbb8c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 -- 172.21.15.84:0/2159163559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980b3610 msgr2=0x7fbb98154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980b3610 0x7fbb98154750 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800e930 tx=0x7fbb880091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 -- 172.21.15.84:0/2159163559 shutdown_connections 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbb84066f30 0x7fbb840693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb98159480 0x7fbb98157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb980b3610 0x7fbb98154750 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 --2- 172.21.15.84:0/2159163559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb980cc1b0 0x7fbb980c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 -- 172.21.15.84:0/2159163559 >> 172.21.15.84:0/2159163559 conn(0x7fbb9806ed20 msgr2=0x7fbb981568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 -- 172.21.15.84:0/2159163559 shutdown_connections 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:09.907+0000 7fbb9d25d700 1 -- 172.21.15.84:0/2159163559 wait complete. 2023-10-06T03:24:09.921 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T03:24:09.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.033+0000 7f0b001c8700 1 Processor -- start 2023-10-06T03:24:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.034+0000 7f0b001c8700 1 -- start start 2023-10-06T03:24:10.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.034+0000 7f0b001c8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af806f2b0 0x7f0af80adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.034+0000 7f0b001c8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af806e710 con 0x7f0af8069af0 2023-10-06T03:24:10.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.034+0000 7f0b001c8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af806db00 con 0x7f0af8069720 2023-10-06T03:24:10.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.034+0000 7f0b001c8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80cd040 con 0x7f0af806f2b0 2023-10-06T03:24:10.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afd763700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0af8069af0 0x7f0af806eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48430/0 (socket says 172.21.15.84:48430) 2023-10-06T03:24:10.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afd763700 1 -- 172.21.15.84:0/44351944 learned_addr learned my addr 172.21.15.84:0/44351944 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:10.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afe765700 1 --2- 172.21.15.84:0/44351944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af806f2b0 0x7f0af80adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afcf62700 1 -- 172.21.15.84:0/44351944 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245201884 0 0) 0x7f0af806e710 con 0x7f0af8069af0 2023-10-06T03:24:10.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afcf62700 1 -- 172.21.15.84:0/44351944 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae0003570 con 0x7f0af8069af0 2023-10-06T03:24:10.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afcf62700 1 -- 172.21.15.84:0/44351944 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938948581 0 0) 0x7f0af806db00 con 0x7f0af8069720 2023-10-06T03:24:10.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afcf62700 1 -- 172.21.15.84:0/44351944 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0af806e710 con 0x7f0af8069720 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afcf62700 1 -- 172.21.15.84:0/44351944 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645627622 0 0) 0x7f0ae0003570 con 0x7f0af8069af0 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afe765700 1 -- 172.21.15.84:0/44351944 >> v1:172.21.15.131:6789/0 conn(0x7f0af8069720 legacy=0x7f0af80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afe765700 1 -- 172.21.15.84:0/44351944 >> v1:172.21.15.84:6789/0 conn(0x7f0af8069af0 legacy=0x7f0af806eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afe765700 1 -- 172.21.15.84:0/44351944 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af806dde0 con 0x7f0af806f2b0 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afe765700 1 --2- 172.21.15.84:0/44351944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af806f2b0 0x7f0af80adaa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009910 tx=0x7f0af00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40e02c06775514e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afcf62700 1 -- 172.21.15.84:0/44351944 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec001470 con 0x7f0af806f2b0 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afcf62700 1 -- 172.21.15.84:0/44351944 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af0011420 con 0x7f0af806f2b0 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.035+0000 7f0afcf62700 1 -- 172.21.15.84:0/44351944 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00117a0 con 0x7f0af806f2b0 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.036+0000 7f0b001c8700 1 -- 172.21.15.84:0/44351944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af806f2b0 msgr2=0x7f0af80adaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.036+0000 7f0b001c8700 1 --2- 172.21.15.84:0/44351944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af806f2b0 0x7f0af80adaa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009910 tx=0x7f0af00091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.036+0000 7f0b001c8700 1 -- 172.21.15.84:0/44351944 shutdown_connections 2023-10-06T03:24:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.036+0000 7f0b001c8700 1 --2- 172.21.15.84:0/44351944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af806f2b0 0x7f0af80adaa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.036+0000 7f0b001c8700 1 -- 172.21.15.84:0/44351944 >> 172.21.15.84:0/44351944 conn(0x7f0af80680c0 msgr2=0x7f0af80cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.036+0000 7f0b001c8700 1 -- 172.21.15.84:0/44351944 shutdown_connections 2023-10-06T03:24:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.036+0000 7f0b001c8700 1 -- 172.21.15.84:0/44351944 wait complete. 2023-10-06T03:24:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.037+0000 7f0b001c8700 1 Processor -- start 2023-10-06T03:24:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.037+0000 7f0b001c8700 1 -- start start 2023-10-06T03:24:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0b001c8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8069720 0x7f0af816add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0b001c8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af8069af0 0x7f0af816b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0b001c8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0af806f2b0 0x7f0af80c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0b001c8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af815e610 con 0x7f0af8069720 2023-10-06T03:24:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0b001c8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8165410 con 0x7f0af806f2b0 2023-10-06T03:24:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0b001c8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af81695b0 con 0x7f0af8069af0 2023-10-06T03:24:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afdf64700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8069720 0x7f0af816add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afdf64700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8069720 0x7f0af816add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34252/0 (socket says 172.21.15.84:34252) 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afdf64700 1 -- 172.21.15.84:0/2486935234 learned_addr learned my addr 172.21.15.84:0/2486935234 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afd763700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af8069af0 0x7f0af816b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afe765700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0af806f2b0 0x7f0af80c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afdf64700 1 -- 172.21.15.84:0/2486935234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af8069af0 msgr2=0x7f0af816b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afdf64700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af8069af0 0x7f0af816b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afdf64700 1 -- 172.21.15.84:0/2486935234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0af806f2b0 msgr2=0x7f0af80c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afdf64700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0af806f2b0 0x7f0af80c0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afdf64700 1 -- 172.21.15.84:0/2486935234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af0009420 con 0x7f0af8069720 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afe765700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0af806f2b0 0x7f0af80c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.038+0000 7f0afdf64700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8069720 0x7f0af816add0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800cb10 tx=0x7f0ae8002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.039+0000 7f0af5ffb700 1 -- 172.21.15.84:0/2486935234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800a7e0 con 0x7f0af8069720 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.039+0000 7f0af5ffb700 1 -- 172.21.15.84:0/2486935234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae800a940 con 0x7f0af8069720 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.039+0000 7f0b001c8700 1 -- 172.21.15.84:0/2486935234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af81689a0 con 0x7f0af8069720 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.039+0000 7f0af5ffb700 1 -- 172.21.15.84:0/2486935234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800ad00 con 0x7f0af8069720 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.039+0000 7f0b001c8700 1 -- 172.21.15.84:0/2486935234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af8168f60 con 0x7f0af8069720 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.040+0000 7f0b001c8700 1 -- 172.21.15.84:0/2486935234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af8064ad0 con 0x7f0af8069720 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.040+0000 7f0af5ffb700 1 -- 172.21.15.84:0/2486935234 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ae8012630 con 0x7f0af8069720 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.040+0000 7f0af5ffb700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ae4066f30 0x7f0ae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.040+0000 7f0af5ffb700 1 -- 172.21.15.84:0/2486935234 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0ae8084b60 con 0x7f0af8069720 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.041+0000 7f0afd763700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ae4066f30 0x7f0ae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.041+0000 7f0afd763700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ae4066f30 0x7f0ae40693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0af80c4180 tx=0x7f0aec000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.045+0000 7f0af5ffb700 1 -- 172.21.15.84:0/2486935234 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ae8051980 con 0x7f0af8069720 2023-10-06T03:24:10.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.226+0000 7f0b001c8700 1 -- 172.21.15.84:0/2486935234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0af804bb80 con 0x7f0af8069720 2023-10-06T03:24:10.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.227+0000 7f0af5ffb700 1 -- 172.21.15.84:0/2486935234 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f0ae800ae60 con 0x7f0af8069720 2023-10-06T03:24:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:10.229 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:10.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 -- 172.21.15.84:0/2486935234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ae4066f30 msgr2=0x7f0ae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ae4066f30 0x7f0ae40693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0af80c4180 tx=0x7f0aec000bc0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 -- 172.21.15.84:0/2486935234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8069720 msgr2=0x7f0af816add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8069720 0x7f0af816add0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800cb10 tx=0x7f0ae8002820 comp rx=0 tx=0).stop 2023-10-06T03:24:10.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 -- 172.21.15.84:0/2486935234 shutdown_connections 2023-10-06T03:24:10.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ae4066f30 0x7f0ae40693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0af806f2b0 0x7f0af80c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8069720 0x7f0af816add0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 --2- 172.21.15.84:0/2486935234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0af8069af0 0x7f0af816b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 -- 172.21.15.84:0/2486935234 >> 172.21.15.84:0/2486935234 conn(0x7f0af80680c0 msgr2=0x7f0af80b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:10.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 -- 172.21.15.84:0/2486935234 shutdown_connections 2023-10-06T03:24:10.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.229+0000 7f0b001c8700 1 -- 172.21.15.84:0/2486935234 wait complete. 2023-10-06T03:24:10.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:47.554201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:48.881558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:52.564434+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:10.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:10.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.358+0000 7fe280f14700 1 Processor -- start 2023-10-06T03:24:10.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.358+0000 7fe280f14700 1 -- start start 2023-10-06T03:24:10.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe280f14700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe27c159510 0x7fe27c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe280f14700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe27c0cbae0 0x7fe27c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe280f14700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27c0cbf00 con 0x7fe27c1598e0 2023-10-06T03:24:10.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe280f14700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27c0cf610 con 0x7fe27c0cbae0 2023-10-06T03:24:10.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe280f14700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0cf8f0 con 0x7fe27c159510 2023-10-06T03:24:10.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe27ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe27c0cbae0 0x7fe27c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe27ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe27c0cbae0 0x7fe27c0cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34256/0 (socket says 172.21.15.84:34256) 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe27ad9d700 1 -- 172.21.15.84:0/3887447527 learned_addr learned my addr 172.21.15.84:0/3887447527 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe27a59c700 1 --2- 172.21.15.84:0/3887447527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe27c159510 0x7fe27c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe27ad9d700 1 -- 172.21.15.84:0/3887447527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe27c159510 msgr2=0x7fe27c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe27ad9d700 1 --2- 172.21.15.84:0/3887447527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe27c159510 0x7fe27c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe27ad9d700 1 -- 172.21.15.84:0/3887447527 >> v1:172.21.15.131:6789/0 conn(0x7fe27c1598e0 legacy=0x7fe27c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe27ad9d700 1 -- 172.21.15.84:0/3887447527 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c0cfbd0 con 0x7fe27c0cbae0 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.359+0000 7fe27ad9d700 1 --2- 172.21.15.84:0/3887447527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 0x7fe27c0cef30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe274009f20 tx=0x7fe274009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbd83d25f3f2d3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe279d9b700 1 -- 172.21.15.84:0/3887447527 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27400e070 con 0x7fe27c0cbae0 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe279d9b700 1 -- 172.21.15.84:0/3887447527 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27400ba40 con 0x7fe27c0cbae0 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe279d9b700 1 -- 172.21.15.84:0/3887447527 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2740092e0 con 0x7fe27c0cbae0 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe280f14700 1 -- 172.21.15.84:0/3887447527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 msgr2=0x7fe27c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe280f14700 1 --2- 172.21.15.84:0/3887447527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 0x7fe27c0cef30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe274009f20 tx=0x7fe274009840 comp rx=0 tx=0).stop 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe280f14700 1 -- 172.21.15.84:0/3887447527 shutdown_connections 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe280f14700 1 --2- 172.21.15.84:0/3887447527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 0x7fe27c0cef30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe280f14700 1 --2- 172.21.15.84:0/3887447527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe27c159510 0x7fe27c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe280f14700 1 -- 172.21.15.84:0/3887447527 >> 172.21.15.84:0/3887447527 conn(0x7fe27c089e90 msgr2=0x7fe27c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe280f14700 1 -- 172.21.15.84:0/3887447527 shutdown_connections 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.360+0000 7fe280f14700 1 -- 172.21.15.84:0/3887447527 wait complete. 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.361+0000 7fe280f14700 1 Processor -- start 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.361+0000 7fe280f14700 1 -- start start 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe280f14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 0x7fe27c16caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe280f14700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe27c159510 0x7fe27c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe280f14700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27c1598e0 0x7fe27c0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe280f14700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c15aa30 con 0x7fe27c0cbae0 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe280f14700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0ca080 con 0x7fe27c1598e0 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe280f14700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0b53c0 con 0x7fe27c159510 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe27a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 0x7fe27c16caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe27a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 0x7fe27c16caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34272/0 (socket says 172.21.15.84:34272) 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe27a59c700 1 -- 172.21.15.84:0/2191041742 learned_addr learned my addr 172.21.15.84:0/2191041742 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe271d9b700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe27c159510 0x7fe27c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe27ad9d700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27c1598e0 0x7fe27c0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe27a59c700 1 -- 172.21.15.84:0/2191041742 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe27c159510 msgr2=0x7fe27c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.362+0000 7fe27a59c700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe27c159510 0x7fe27c0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.363+0000 7fe27a59c700 1 -- 172.21.15.84:0/2191041742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27c1598e0 msgr2=0x7fe27c0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.363+0000 7fe27a59c700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27c1598e0 0x7fe27c0b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.363+0000 7fe27a59c700 1 -- 172.21.15.84:0/2191041742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe274009ae0 con 0x7fe27c0cbae0 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.363+0000 7fe27a59c700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 0x7fe27c16caa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00d8c0 tx=0x7fe26c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.363+0000 7fe272ffd700 1 -- 172.21.15.84:0/2191041742 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0125f0 con 0x7fe27c0cbae0 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.363+0000 7fe272ffd700 1 -- 172.21.15.84:0/2191041742 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c012750 con 0x7fe27c0cbae0 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.363+0000 7fe280f14700 1 -- 172.21.15.84:0/2191041742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27c159f30 con 0x7fe27c0cbae0 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.363+0000 7fe272ffd700 1 -- 172.21.15.84:0/2191041742 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c012af0 con 0x7fe27c0cbae0 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.363+0000 7fe280f14700 1 -- 172.21.15.84:0/2191041742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27c15a410 con 0x7fe27c0cbae0 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.364+0000 7fe280f14700 1 -- 172.21.15.84:0/2191041742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27c064ad0 con 0x7fe27c0cbae0 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.364+0000 7fe272ffd700 1 -- 172.21.15.84:0/2191041742 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe26c01e460 con 0x7fe27c0cbae0 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.365+0000 7fe272ffd700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe25c066f30 0x7fe25c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.365+0000 7fe271d9b700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe25c066f30 0x7fe25c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.365+0000 7fe272ffd700 1 -- 172.21.15.84:0/2191041742 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe26c084cf0 con 0x7fe27c0cbae0 2023-10-06T03:24:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.365+0000 7fe271d9b700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe25c066f30 0x7fe25c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe27c15cd00 tx=0x7fe264007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.369+0000 7fe272ffd700 1 -- 172.21.15.84:0/2191041742 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe26c089070 con 0x7fe27c0cbae0 2023-10-06T03:24:10.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.551+0000 7fe280f14700 1 -- 172.21.15.84:0/2191041742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe27c0cfeb0 con 0x7fe27c0cbae0 2023-10-06T03:24:10.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.552+0000 7fe272ffd700 1 -- 172.21.15.84:0/2191041742 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe26c051b10 con 0x7fe27c0cbae0 2023-10-06T03:24:10.554 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:24:10.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 -- 172.21.15.84:0/2191041742 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe25c066f30 msgr2=0x7fe25c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe25c066f30 0x7fe25c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe27c15cd00 tx=0x7fe264007ea0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 -- 172.21.15.84:0/2191041742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 msgr2=0x7fe27c16caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 0x7fe27c16caa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00d8c0 tx=0x7fe26c008040 comp rx=0 tx=0).stop 2023-10-06T03:24:10.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 -- 172.21.15.84:0/2191041742 shutdown_connections 2023-10-06T03:24:10.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe25c066f30 0x7fe25c0693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27c1598e0 0x7fe27c0b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c0cbae0 0x7fe27c16caa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 --2- 172.21.15.84:0/2191041742 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe27c159510 0x7fe27c0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 -- 172.21.15.84:0/2191041742 >> 172.21.15.84:0/2191041742 conn(0x7fe27c089e90 msgr2=0x7fe27c0683b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:10.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 -- 172.21.15.84:0/2191041742 shutdown_connections 2023-10-06T03:24:10.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.554+0000 7fe280f14700 1 -- 172.21.15.84:0/2191041742 wait complete. 2023-10-06T03:24:10.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.684+0000 7f1323fff700 1 Processor -- start 2023-10-06T03:24:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.684+0000 7f1323fff700 1 -- start start 2023-10-06T03:24:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f1323fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240b2660 0x7f13240cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f1323fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f13240b2a30 0x7f13240cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f1323fff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13240cc9b0 con 0x7f13240ceae0 2023-10-06T03:24:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f1323fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240cbda0 con 0x7f13240b2a30 2023-10-06T03:24:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f1323fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13240cc080 con 0x7f13240b2660 2023-10-06T03:24:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f1322ffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240b2660 0x7f13240cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f13227fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f13240b2a30 0x7f13240cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f13237fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f13240ceae0 0x7f13240cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:42428/0 (socket says 172.21.15.84:42428) 2023-10-06T03:24:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f13227fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f13240b2a30 0x7f13240cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:54212/0 (socket says 172.21.15.84:54212) 2023-10-06T03:24:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f13237fe700 1 -- 172.21.15.84:0/2980981772 learned_addr learned my addr 172.21.15.84:0/2980981772 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f1322ffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240b2660 0x7f13240cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:47190/0 (socket says 172.21.15.84:47190) 2023-10-06T03:24:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f1321ffb700 1 -- 172.21.15.84:0/2980981772 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573868661 0 0) 0x7f13240cc9b0 con 0x7f13240ceae0 2023-10-06T03:24:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f1321ffb700 1 -- 172.21.15.84:0/2980981772 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f130c003570 con 0x7f13240ceae0 2023-10-06T03:24:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f13227fc700 1 -- 172.21.15.84:0/2980981772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240b2660 msgr2=0x7f13240cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f13227fc700 1 --2- 172.21.15.84:0/2980981772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240b2660 0x7f13240cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f13227fc700 1 -- 172.21.15.84:0/2980981772 >> v1:172.21.15.131:6789/0 conn(0x7f13240ceae0 legacy=0x7f13240cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f13227fc700 1 -- 172.21.15.84:0/2980981772 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240cc360 con 0x7f13240b2a30 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.685+0000 7f1322ffd700 1 --2- 172.21.15.84:0/2980981772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240b2660 0x7f13240cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f13227fc700 1 --2- 172.21.15.84:0/2980981772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13240b2a30 0x7f13240cd230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f13180098e0 tx=0x7f13180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5adce1cf4b67d848 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1321ffb700 1 -- 172.21.15.84:0/2980981772 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318011630 con 0x7f13240b2a30 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1321ffb700 1 -- 172.21.15.84:0/2980981772 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318011790 con 0x7f13240b2a30 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1321ffb700 1 -- 172.21.15.84:0/2980981772 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318011b30 con 0x7f13240b2a30 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1323fff700 1 -- 172.21.15.84:0/2980981772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13240b2a30 msgr2=0x7f13240cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1323fff700 1 --2- 172.21.15.84:0/2980981772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13240b2a30 0x7f13240cd230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f13180098e0 tx=0x7f13180091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1323fff700 1 -- 172.21.15.84:0/2980981772 shutdown_connections 2023-10-06T03:24:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1323fff700 1 --2- 172.21.15.84:0/2980981772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240b2660 0x7f13240cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1323fff700 1 --2- 172.21.15.84:0/2980981772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13240b2a30 0x7f13240cd230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1323fff700 1 -- 172.21.15.84:0/2980981772 >> 172.21.15.84:0/2980981772 conn(0x7f1324099560 msgr2=0x7f132406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1323fff700 1 -- 172.21.15.84:0/2980981772 shutdown_connections 2023-10-06T03:24:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.686+0000 7f1323fff700 1 -- 172.21.15.84:0/2980981772 wait complete. 2023-10-06T03:24:10.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f1323fff700 1 Processor -- start 2023-10-06T03:24:10.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f1323fff700 1 -- start start 2023-10-06T03:24:10.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f1323fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13240b2660 0x7f132414f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f1323fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13240b2a30 0x7f132414fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f1323fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240ceae0 0x7f1324169df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f1323fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13240c7640 con 0x7f13240b2a30 2023-10-06T03:24:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f1323fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1324150260 con 0x7f13240b2660 2023-10-06T03:24:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f1323fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1324150540 con 0x7f13240ceae0 2023-10-06T03:24:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f13227fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13240b2a30 0x7f132414fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f13227fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13240b2a30 0x7f132414fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33544/0 (socket says 172.21.15.84:33544) 2023-10-06T03:24:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f13227fc700 1 -- 172.21.15.84:0/2820513507 learned_addr learned my addr 172.21.15.84:0/2820513507 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f1322ffd700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13240b2660 0x7f132414f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.688+0000 7f13237fe700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240ceae0 0x7f1324169df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f13227fc700 1 -- 172.21.15.84:0/2820513507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240ceae0 msgr2=0x7f1324169df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f13227fc700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240ceae0 0x7f1324169df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f13227fc700 1 -- 172.21.15.84:0/2820513507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13240b2660 msgr2=0x7f132414f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f13227fc700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13240b2660 0x7f132414f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f13227fc700 1 -- 172.21.15.84:0/2820513507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c0093c0 con 0x7f13240b2a30 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f13227fc700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13240b2a30 0x7f132414fbe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f132406fd00 tx=0x7f1318017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f130affd700 1 -- 172.21.15.84:0/2820513507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318011900 con 0x7f13240b2a30 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f130affd700 1 -- 172.21.15.84:0/2820513507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318011a60 con 0x7f13240b2a30 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f1323fff700 1 -- 172.21.15.84:0/2820513507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1318009420 con 0x7f13240b2a30 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f130affd700 1 -- 172.21.15.84:0/2820513507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131801a680 con 0x7f13240b2a30 2023-10-06T03:24:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.689+0000 7f1323fff700 1 -- 172.21.15.84:0/2820513507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1324150b00 con 0x7f13240b2a30 2023-10-06T03:24:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.690+0000 7f1323fff700 1 -- 172.21.15.84:0/2820513507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13240c77f0 con 0x7f13240b2a30 2023-10-06T03:24:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.690+0000 7f130affd700 1 -- 172.21.15.84:0/2820513507 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f131801aab0 con 0x7f13240b2a30 2023-10-06T03:24:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.691+0000 7f130affd700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1310066f30 0x7f13100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.691+0000 7f130affd700 1 -- 172.21.15.84:0/2820513507 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f13180864a0 con 0x7f13240b2a30 2023-10-06T03:24:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.691+0000 7f1322ffd700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1310066f30 0x7f13100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.691+0000 7f1322ffd700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1310066f30 0x7f13100693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f131c009e90 tx=0x7f131c009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.695+0000 7f130affd700 1 -- 172.21.15.84:0/2820513507 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13240c77f0 con 0x7f13240b2a30 2023-10-06T03:24:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.876+0000 7f1323fff700 1 -- 172.21.15.84:0/2820513507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f132405f270 con 0x7f13240b2a30 2023-10-06T03:24:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.877+0000 7f130affd700 1 -- 172.21.15.84:0/2820513507 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13180532c0 con 0x7f13240b2a30 2023-10-06T03:24:10.878 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:24:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 -- 172.21.15.84:0/2820513507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1310066f30 msgr2=0x7f13100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1310066f30 0x7f13100693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f131c009e90 tx=0x7f131c009120 comp rx=0 tx=0).stop 2023-10-06T03:24:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 -- 172.21.15.84:0/2820513507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13240b2a30 msgr2=0x7f132414fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13240b2a30 0x7f132414fbe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f132406fd00 tx=0x7f1318017000 comp rx=0 tx=0).stop 2023-10-06T03:24:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 -- 172.21.15.84:0/2820513507 shutdown_connections 2023-10-06T03:24:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1310066f30 0x7f13100693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13240b2660 0x7f132414f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13240ceae0 0x7f1324169df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 --2- 172.21.15.84:0/2820513507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13240b2a30 0x7f132414fbe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 -- 172.21.15.84:0/2820513507 >> 172.21.15.84:0/2820513507 conn(0x7f1324099560 msgr2=0x7f132406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 -- 172.21.15.84:0/2820513507 shutdown_connections 2023-10-06T03:24:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:10.879+0000 7f1323fff700 1 -- 172.21.15.84:0/2820513507 wait complete. 2023-10-06T03:24:10.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:11.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.006+0000 7fd628ed9700 1 Processor -- start 2023-10-06T03:24:11.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.006+0000 7fd628ed9700 1 -- start start 2023-10-06T03:24:11.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.007+0000 7fd628ed9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd624156780 0x7fd62406e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.007+0000 7fd628ed9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6240c84e0 con 0x7fd62406e910 2023-10-06T03:24:11.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.007+0000 7fd628ed9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62406f910 con 0x7fd6241563b0 2023-10-06T03:24:11.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.007+0000 7fd628ed9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62406ed50 con 0x7fd624156780 2023-10-06T03:24:11.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.007+0000 7fd621d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd624156780 0x7fd62406e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.007+0000 7fd622d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd62406e910 0x7fd6240adb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53762/0 (socket says 172.21.15.84:53762) 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.007+0000 7fd622d9d700 1 -- 172.21.15.84:0/3822994663 learned_addr learned my addr 172.21.15.84:0/3822994663 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.008+0000 7fd621d9b700 1 -- 172.21.15.84:0/3822994663 >> v1:172.21.15.131:6789/0 conn(0x7fd6241563b0 legacy=0x7fd62406f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.008+0000 7fd621d9b700 1 -- 172.21.15.84:0/3822994663 >> v1:172.21.15.84:6789/0 conn(0x7fd62406e910 legacy=0x7fd6240adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.008+0000 7fd621d9b700 1 -- 172.21.15.84:0/3822994663 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240c78d0 con 0x7fd624156780 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.008+0000 7fd621d9b700 1 --2- 172.21.15.84:0/3822994663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd624156780 0x7fd62406e3d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0098e0 tx=0x7fd60c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df9302ccdb0ad0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.008+0000 7fd62159a700 1 -- 172.21.15.84:0/3822994663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c009e80 con 0x7fd624156780 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.008+0000 7fd62159a700 1 -- 172.21.15.84:0/3822994663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00b820 con 0x7fd624156780 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.008+0000 7fd62159a700 1 -- 172.21.15.84:0/3822994663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00bba0 con 0x7fd624156780 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.008+0000 7fd628ed9700 1 -- 172.21.15.84:0/3822994663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd624156780 msgr2=0x7fd62406e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.008+0000 7fd628ed9700 1 --2- 172.21.15.84:0/3822994663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd624156780 0x7fd62406e3d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0098e0 tx=0x7fd60c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.009+0000 7fd628ed9700 1 -- 172.21.15.84:0/3822994663 shutdown_connections 2023-10-06T03:24:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.009+0000 7fd628ed9700 1 --2- 172.21.15.84:0/3822994663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd624156780 0x7fd62406e3d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.009+0000 7fd628ed9700 1 -- 172.21.15.84:0/3822994663 >> 172.21.15.84:0/3822994663 conn(0x7fd624069190 msgr2=0x7fd6240cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.009+0000 7fd628ed9700 1 -- 172.21.15.84:0/3822994663 shutdown_connections 2023-10-06T03:24:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.009+0000 7fd628ed9700 1 -- 172.21.15.84:0/3822994663 wait complete. 2023-10-06T03:24:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.010+0000 7fd628ed9700 1 Processor -- start 2023-10-06T03:24:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.010+0000 7fd628ed9700 1 -- start start 2023-10-06T03:24:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.010+0000 7fd628ed9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62406e910 0x7fd6241697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.010+0000 7fd628ed9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6241563b0 0x7fd6241668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.010+0000 7fd628ed9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd624156780 0x7fd6240a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.010+0000 7fd628ed9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240a77f0 con 0x7fd6241563b0 2023-10-06T03:24:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.010+0000 7fd628ed9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd624169cf0 con 0x7fd62406e910 2023-10-06T03:24:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.010+0000 7fd628ed9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240a6900 con 0x7fd624156780 2023-10-06T03:24:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd621d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6241563b0 0x7fd6241668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd621d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6241563b0 0x7fd6241668d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33552/0 (socket says 172.21.15.84:33552) 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd621d9b700 1 -- 172.21.15.84:0/3762235969 learned_addr learned my addr 172.21.15.84:0/3762235969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd622d9d700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd624156780 0x7fd6240a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd62259c700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62406e910 0x7fd6241697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd621d9b700 1 -- 172.21.15.84:0/3762235969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd624156780 msgr2=0x7fd6240a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd621d9b700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd624156780 0x7fd6240a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd621d9b700 1 -- 172.21.15.84:0/3762235969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62406e910 msgr2=0x7fd6241697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd621d9b700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62406e910 0x7fd6241697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd621d9b700 1 -- 172.21.15.84:0/3762235969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c009420 con 0x7fd6241563b0 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd62259c700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62406e910 0x7fd6241697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd621d9b700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6241563b0 0x7fd6241668d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0030c0 tx=0x7fd60c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd61a7fc700 1 -- 172.21.15.84:0/3762235969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00bae0 con 0x7fd6241563b0 2023-10-06T03:24:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd61a7fc700 1 -- 172.21.15.84:0/3762235969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c020070 con 0x7fd6241563b0 2023-10-06T03:24:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd628ed9700 1 -- 172.21.15.84:0/3762235969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6240a6be0 con 0x7fd6241563b0 2023-10-06T03:24:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd61a7fc700 1 -- 172.21.15.84:0/3762235969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c01b6a0 con 0x7fd6241563b0 2023-10-06T03:24:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.011+0000 7fd628ed9700 1 -- 172.21.15.84:0/3762235969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6240a71a0 con 0x7fd6241563b0 2023-10-06T03:24:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.012+0000 7fd628ed9700 1 -- 172.21.15.84:0/3762235969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6240a7960 con 0x7fd6241563b0 2023-10-06T03:24:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.012+0000 7fd61a7fc700 1 -- 172.21.15.84:0/3762235969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd60c022030 con 0x7fd6241563b0 2023-10-06T03:24:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.013+0000 7fd61a7fc700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd604066f30 0x7fd6040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.013+0000 7fd61a7fc700 1 -- 172.21.15.84:0/3762235969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd60c086920 con 0x7fd6241563b0 2023-10-06T03:24:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.013+0000 7fd62259c700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd604066f30 0x7fd6040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.013+0000 7fd62259c700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd604066f30 0x7fd6040693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd61400e360 tx=0x7fd614009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.017+0000 7fd61a7fc700 1 -- 172.21.15.84:0/3762235969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd60c0536a0 con 0x7fd6241563b0 2023-10-06T03:24:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.197+0000 7fd628ed9700 1 -- 172.21.15.84:0/3762235969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6240a7930 con 0x7fd6241563b0 2023-10-06T03:24:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.197+0000 7fd61a7fc700 1 -- 172.21.15.84:0/3762235969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd60c056cc0 con 0x7fd6241563b0 2023-10-06T03:24:11.199 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 -- 172.21.15.84:0/3762235969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd604066f30 msgr2=0x7fd6040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd604066f30 0x7fd6040693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd61400e360 tx=0x7fd614009040 comp rx=0 tx=0).stop 2023-10-06T03:24:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 -- 172.21.15.84:0/3762235969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6241563b0 msgr2=0x7fd6241668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6241563b0 0x7fd6241668d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0030c0 tx=0x7fd60c016000 comp rx=0 tx=0).stop 2023-10-06T03:24:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 -- 172.21.15.84:0/3762235969 shutdown_connections 2023-10-06T03:24:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd604066f30 0x7fd6040693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62406e910 0x7fd6241697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd624156780 0x7fd6240a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 --2- 172.21.15.84:0/3762235969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6241563b0 0x7fd6241668d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 -- 172.21.15.84:0/3762235969 >> 172.21.15.84:0/3762235969 conn(0x7fd624069190 msgr2=0x7fd6240cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 -- 172.21.15.84:0/3762235969 shutdown_connections 2023-10-06T03:24:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.199+0000 7fd628ed9700 1 -- 172.21.15.84:0/3762235969 wait complete. 2023-10-06T03:24:11.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.328+0000 7f0fe5975700 1 Processor -- start 2023-10-06T03:24:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.328+0000 7f0fe5975700 1 -- start start 2023-10-06T03:24:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.329+0000 7f0fe5975700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe00c9c40 0x7f0fe00675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.329+0000 7f0fe5975700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe00c6ff0 con 0x7f0fe0069a10 2023-10-06T03:24:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.329+0000 7f0fe5975700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe00c7590 con 0x7f0fe0155780 2023-10-06T03:24:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.329+0000 7f0fe5975700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00c90a0 con 0x7f0fe00c9c40 2023-10-06T03:24:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.329+0000 7f0fe5174700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0fe0069a10 0x7f0fe00c7a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53764/0 (socket says 172.21.15.84:53764) 2023-10-06T03:24:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.329+0000 7f0fe5174700 1 -- 172.21.15.84:0/221287003 learned_addr learned my addr 172.21.15.84:0/221287003 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.329+0000 7f0fdffff700 1 --2- 172.21.15.84:0/221287003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe00c9c40 0x7f0fe00675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdf7fe700 1 -- 172.21.15.84:0/221287003 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781919614 0 0) 0x7f0fe00c6ff0 con 0x7f0fe0069a10 2023-10-06T03:24:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdf7fe700 1 -- 172.21.15.84:0/221287003 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc8003570 con 0x7f0fe0069a10 2023-10-06T03:24:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdf7fe700 1 -- 172.21.15.84:0/221287003 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271880465 0 0) 0x7f0fe00c7590 con 0x7f0fe0155780 2023-10-06T03:24:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdf7fe700 1 -- 172.21.15.84:0/221287003 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe00c6ff0 con 0x7f0fe0155780 2023-10-06T03:24:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdffff700 1 -- 172.21.15.84:0/221287003 >> v1:172.21.15.131:6789/0 conn(0x7f0fe0155780 legacy=0x7f0fe00c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdffff700 1 -- 172.21.15.84:0/221287003 >> v1:172.21.15.84:6789/0 conn(0x7f0fe0069a10 legacy=0x7f0fe00c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdffff700 1 -- 172.21.15.84:0/221287003 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00caeb0 con 0x7f0fe00c9c40 2023-10-06T03:24:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdffff700 1 --2- 172.21.15.84:0/221287003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe00c9c40 0x7f0fe00675f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009910 tx=0x7f0fd40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=753fee929b91ae5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdf7fe700 1 -- 172.21.15.84:0/221287003 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400c710 con 0x7f0fe00c9c40 2023-10-06T03:24:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdf7fe700 1 -- 172.21.15.84:0/221287003 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd400c870 con 0x7f0fe00c9c40 2023-10-06T03:24:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.330+0000 7f0fdf7fe700 1 -- 172.21.15.84:0/221287003 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400cbf0 con 0x7f0fe00c9c40 2023-10-06T03:24:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.331+0000 7f0fe5975700 1 -- 172.21.15.84:0/221287003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe00c9c40 msgr2=0x7f0fe00675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.331+0000 7f0fe5975700 1 --2- 172.21.15.84:0/221287003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe00c9c40 0x7f0fe00675f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009910 tx=0x7f0fd40091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.331+0000 7f0fe5975700 1 -- 172.21.15.84:0/221287003 shutdown_connections 2023-10-06T03:24:11.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.331+0000 7f0fe5975700 1 --2- 172.21.15.84:0/221287003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe00c9c40 0x7f0fe00675f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.331+0000 7f0fe5975700 1 -- 172.21.15.84:0/221287003 >> 172.21.15.84:0/221287003 conn(0x7f0fe00cd220 msgr2=0x7f0fe00c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.331+0000 7f0fe5975700 1 -- 172.21.15.84:0/221287003 shutdown_connections 2023-10-06T03:24:11.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.331+0000 7f0fe5975700 1 -- 172.21.15.84:0/221287003 wait complete. 2023-10-06T03:24:11.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.332+0000 7f0fe5975700 1 Processor -- start 2023-10-06T03:24:11.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.332+0000 7f0fe5975700 1 -- start start 2023-10-06T03:24:11.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe5975700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe0069a10 0x7f0fe01411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe5975700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fe00c9c40 0x7f0fe0152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe5975700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe0155780 0x7f0fe00675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe5975700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00af5e0 con 0x7f0fe0069a10 2023-10-06T03:24:11.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe5975700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00afe80 con 0x7f0fe00c9c40 2023-10-06T03:24:11.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe5975700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe0141730 con 0x7f0fe0155780 2023-10-06T03:24:11.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe4973700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe0069a10 0x7f0fe01411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe4973700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe0069a10 0x7f0fe01411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33556/0 (socket says 172.21.15.84:33556) 2023-10-06T03:24:11.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe4973700 1 -- 172.21.15.84:0/3004201605 learned_addr learned my addr 172.21.15.84:0/3004201605 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:11.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe5174700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe0155780 0x7f0fe00675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fdffff700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fe00c9c40 0x7f0fe0152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe4973700 1 -- 172.21.15.84:0/3004201605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe0155780 msgr2=0x7f0fe00675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe4973700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe0155780 0x7f0fe00675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe4973700 1 -- 172.21.15.84:0/3004201605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fe00c9c40 msgr2=0x7f0fe0152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe4973700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fe00c9c40 0x7f0fe0152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe4973700 1 -- 172.21.15.84:0/3004201605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd4009420 con 0x7f0fe0069a10 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.333+0000 7f0fe4973700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe0069a10 0x7f0fe01411f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000ed20 tx=0x7f0fd0002810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.334+0000 7f0fdcff9700 1 -- 172.21.15.84:0/3004201605 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd000ee00 con 0x7f0fe0069a10 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.334+0000 7f0fdcff9700 1 -- 172.21.15.84:0/3004201605 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd000cd80 con 0x7f0fe0069a10 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.334+0000 7f0fdcff9700 1 -- 172.21.15.84:0/3004201605 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00116c0 con 0x7f0fe0069a10 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.334+0000 7f0fe5975700 1 -- 172.21.15.84:0/3004201605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe01696a0 con 0x7f0fe0069a10 2023-10-06T03:24:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.334+0000 7f0fe5975700 1 -- 172.21.15.84:0/3004201605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe00afb10 con 0x7f0fe0069a10 2023-10-06T03:24:11.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.334+0000 7f0fe5975700 1 -- 172.21.15.84:0/3004201605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe006f0c0 con 0x7f0fe0069a10 2023-10-06T03:24:11.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.335+0000 7f0fdcff9700 1 -- 172.21.15.84:0/3004201605 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fd0011ab0 con 0x7f0fe0069a10 2023-10-06T03:24:11.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.335+0000 7f0fdcff9700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fcc066f30 0x7f0fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.335+0000 7f0fdcff9700 1 -- 172.21.15.84:0/3004201605 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0fd0015070 con 0x7f0fe0069a10 2023-10-06T03:24:11.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.335+0000 7f0fdffff700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fcc066f30 0x7f0fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.336+0000 7f0fdffff700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fcc066f30 0x7f0fcc0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009860 tx=0x7f0fd4018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.340+0000 7f0fdcff9700 1 -- 172.21.15.84:0/3004201605 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fd0054310 con 0x7f0fe0069a10 2023-10-06T03:24:11.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.521+0000 7f0fe5975700 1 -- 172.21.15.84:0/3004201605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0fe005f270 con 0x7f0fe0069a10 2023-10-06T03:24:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.521+0000 7f0fdcff9700 1 -- 172.21.15.84:0/3004201605 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0fd0057930 con 0x7f0fe0069a10 2023-10-06T03:24:11.523 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:24:11.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 -- 172.21.15.84:0/3004201605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fcc066f30 msgr2=0x7f0fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fcc066f30 0x7f0fcc0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009860 tx=0x7f0fd4018000 comp rx=0 tx=0).stop 2023-10-06T03:24:11.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 -- 172.21.15.84:0/3004201605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe0069a10 msgr2=0x7f0fe01411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe0069a10 0x7f0fe01411f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000ed20 tx=0x7f0fd0002810 comp rx=0 tx=0).stop 2023-10-06T03:24:11.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 -- 172.21.15.84:0/3004201605 shutdown_connections 2023-10-06T03:24:11.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0fcc066f30 0x7f0fcc0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fe0155780 0x7f0fe00675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe0069a10 0x7f0fe01411f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 --2- 172.21.15.84:0/3004201605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fe00c9c40 0x7f0fe0152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 -- 172.21.15.84:0/3004201605 >> 172.21.15.84:0/3004201605 conn(0x7f0fe00cd220 msgr2=0x7f0fe00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 -- 172.21.15.84:0/3004201605 shutdown_connections 2023-10-06T03:24:11.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.523+0000 7f0fe5975700 1 -- 172.21.15.84:0/3004201605 wait complete. 2023-10-06T03:24:11.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.652+0000 7ff73c406700 1 Processor -- start 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.652+0000 7ff73c406700 1 -- start start 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.653+0000 7ff73c406700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff73415bc00 0x7ff7340675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.653+0000 7ff73c406700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73406f0d0 con 0x7ff7340c93e0 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.653+0000 7ff73c406700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73406e4c0 con 0x7ff7340c97b0 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.653+0000 7ff73c406700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73406a6f0 con 0x7ff73415bc00 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.653+0000 7ff73a1a2700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff7340c93e0 0x7ff734069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53770/0 (socket says 172.21.15.84:53770) 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.653+0000 7ff73a1a2700 1 -- 172.21.15.84:0/1566015326 learned_addr learned my addr 172.21.15.84:0/1566015326 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7399a1700 1 --2- 172.21.15.84:0/1566015326 >> v2:172.21.15.131:3300/0 conn(0x7ff73415bc00 0x7ff7340675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276331486 0 0) 0x7ff73406f0d0 con 0x7ff7340c93e0 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff71c003570 con 0x7ff7340c93e0 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454575396 0 0) 0x7ff71c003570 con 0x7ff7340c93e0 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 >> v2:172.21.15.131:3300/0 conn(0x7ff73415bc00 msgr2=0x7ff7340675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 --2- 172.21.15.84:0/1566015326 >> v2:172.21.15.131:3300/0 conn(0x7ff73415bc00 0x7ff7340675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 >> v1:172.21.15.131:6789/0 conn(0x7ff7340c97b0 legacy=0x7ff734157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73406e7a0 con 0x7ff7340c93e0 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7ff7240017f0 con 0x7ff7340c93e0 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 >> v1:172.21.15.84:6789/0 conn(0x7ff7340c93e0 legacy=0x7ff734069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff71c003a60 0x7ff71c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71c004810 0x7ff71c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff71c0051c0 0x7ff71c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c00c0a0 con 0x7ff71c0051c0 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c00c210 con 0x7ff71c003a60 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c00c3d0 con 0x7ff71c004810 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff73a9a3700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff71c0051c0 0x7ff71c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff73a1a2700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff71c003a60 0x7ff71c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff7399a1700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71c004810 0x7ff71c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff73a9a3700 1 -- 172.21.15.84:0/1566015326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71c004810 msgr2=0x7ff71c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff73a9a3700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71c004810 0x7ff71c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff73a9a3700 1 -- 172.21.15.84:0/1566015326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff71c003a60 msgr2=0x7ff71c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff73a9a3700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff71c003a60 0x7ff71c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff73a9a3700 1 -- 172.21.15.84:0/1566015326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c003570 con 0x7ff71c0051c0 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.654+0000 7ff73a9a3700 1 -- 172.21.15.84:0/1566015326 reap_dead start 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff73a9a3700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff71c0051c0 0x7ff71c00ba60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0018b0 tx=0x7ff72c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6a6ccb02700383 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c012420 con 0x7ff71c0051c0 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c0125a0 con 0x7ff71c0051c0 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff7391a0700 1 -- 172.21.15.84:0/1566015326 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c012960 con 0x7ff71c0051c0 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff73c406700 1 -- 172.21.15.84:0/1566015326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff71c0051c0 msgr2=0x7ff71c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff73c406700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff71c0051c0 0x7ff71c00ba60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0018b0 tx=0x7ff72c007d30 comp rx=0 tx=0).stop 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff73c406700 1 -- 172.21.15.84:0/1566015326 shutdown_connections 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff73c406700 1 --2- 172.21.15.84:0/1566015326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff71c0051c0 0x7ff71c00ba60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff73c406700 1 -- 172.21.15.84:0/1566015326 >> 172.21.15.84:0/1566015326 conn(0x7ff7340691d0 msgr2=0x7ff7340cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff73c406700 1 -- 172.21.15.84:0/1566015326 shutdown_connections 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.655+0000 7ff73c406700 1 -- 172.21.15.84:0/1566015326 wait complete. 2023-10-06T03:24:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.656+0000 7ff73c406700 1 Processor -- start 2023-10-06T03:24:11.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.656+0000 7ff73c406700 1 -- start start 2023-10-06T03:24:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73c406700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71c0051c0 0x7ff7340c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73c406700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7340c61a0 0x7ff734152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73c406700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7340c6720 0x7ff7340c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73c406700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340adc00 con 0x7ff7340c6720 2023-10-06T03:24:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73c406700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340adea0 con 0x7ff7340c61a0 2023-10-06T03:24:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73c406700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340c70b0 con 0x7ff71c0051c0 2023-10-06T03:24:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73a9a3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7340c6720 0x7ff7340c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73a9a3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7340c6720 0x7ff7340c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33572/0 (socket says 172.21.15.84:33572) 2023-10-06T03:24:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73a9a3700 1 -- 172.21.15.84:0/2963174969 learned_addr learned my addr 172.21.15.84:0/2963174969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff7399a1700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7340c61a0 0x7ff734152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73a1a2700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71c0051c0 0x7ff7340c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73a9a3700 1 -- 172.21.15.84:0/2963174969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71c0051c0 msgr2=0x7ff7340c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73a9a3700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71c0051c0 0x7ff7340c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73a9a3700 1 -- 172.21.15.84:0/2963174969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7340c61a0 msgr2=0x7ff734152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.657+0000 7ff73a9a3700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7340c61a0 0x7ff734152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.658+0000 7ff73a9a3700 1 -- 172.21.15.84:0/2963174969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7340c55c0 con 0x7ff7340c6720 2023-10-06T03:24:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.658+0000 7ff73a9a3700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7340c6720 0x7ff7340c6b70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c3f0 tx=0x7ff72c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.658+0000 7ff7327fc700 1 -- 172.21.15.84:0/2963174969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c012420 con 0x7ff7340c6720 2023-10-06T03:24:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.658+0000 7ff7327fc700 1 -- 172.21.15.84:0/2963174969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c001200 con 0x7ff7340c6720 2023-10-06T03:24:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.658+0000 7ff73c406700 1 -- 172.21.15.84:0/2963174969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7340c4d20 con 0x7ff7340c6720 2023-10-06T03:24:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.658+0000 7ff7327fc700 1 -- 172.21.15.84:0/2963174969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00cdd0 con 0x7ff7340c6720 2023-10-06T03:24:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.658+0000 7ff73c406700 1 -- 172.21.15.84:0/2963174969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7340c52e0 con 0x7ff7340c6720 2023-10-06T03:24:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.659+0000 7ff73c406700 1 -- 172.21.15.84:0/2963174969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73406e0f0 con 0x7ff7340c6720 2023-10-06T03:24:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.659+0000 7ff7327fc700 1 -- 172.21.15.84:0/2963174969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff72c019070 con 0x7ff7340c6720 2023-10-06T03:24:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.660+0000 7ff7327fc700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff720066f30 0x7ff7200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.660+0000 7ff7327fc700 1 -- 172.21.15.84:0/2963174969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff72c085ca0 con 0x7ff7340c6720 2023-10-06T03:24:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.660+0000 7ff73a1a2700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff720066f30 0x7ff7200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.660+0000 7ff73a1a2700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff720066f30 0x7ff7200693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff724002060 tx=0x7ff7240021d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.664+0000 7ff7327fc700 1 -- 172.21.15.84:0/2963174969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff72c052b80 con 0x7ff7340c6720 2023-10-06T03:24:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.847+0000 7ff73c406700 1 -- 172.21.15.84:0/2963174969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff734064ad0 con 0x7ff7340c6720 2023-10-06T03:24:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.847+0000 7ff7327fc700 1 -- 172.21.15.84:0/2963174969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff72c017030 con 0x7ff7340c6720 2023-10-06T03:24:11.849 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 -- 172.21.15.84:0/2963174969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff720066f30 msgr2=0x7ff7200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff720066f30 0x7ff7200693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff724002060 tx=0x7ff7240021d0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 -- 172.21.15.84:0/2963174969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7340c6720 msgr2=0x7ff7340c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7340c6720 0x7ff7340c6b70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c3f0 tx=0x7ff72c015000 comp rx=0 tx=0).stop 2023-10-06T03:24:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 -- 172.21.15.84:0/2963174969 shutdown_connections 2023-10-06T03:24:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff720066f30 0x7ff7200693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7340c6720 0x7ff7340c6b70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71c0051c0 0x7ff7340c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 --2- 172.21.15.84:0/2963174969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7340c61a0 0x7ff734152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 -- 172.21.15.84:0/2963174969 >> 172.21.15.84:0/2963174969 conn(0x7ff7340691d0 msgr2=0x7ff734063570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 -- 172.21.15.84:0/2963174969 shutdown_connections 2023-10-06T03:24:11.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.849+0000 7ff73c406700 1 -- 172.21.15.84:0/2963174969 wait complete. 2023-10-06T03:24:11.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:11.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.975+0000 7f0b6911a700 1 Processor -- start 2023-10-06T03:24:11.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.975+0000 7f0b6911a700 1 -- start start 2023-10-06T03:24:11.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b6911a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640696d0 0x7f0b64069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b6911a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0b640b1200 0x7f0b640b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b6911a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b64159fa0 con 0x7f0b6415a430 2023-10-06T03:24:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b6911a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b641599c0 con 0x7f0b640b1200 2023-10-06T03:24:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b6911a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640b1b50 con 0x7f0b640696d0 2023-10-06T03:24:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b637fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0b6415a430 0x7f0b6406cc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53782/0 (socket says 172.21.15.84:53782) 2023-10-06T03:24:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b637fe700 1 -- 172.21.15.84:0/2569797268 learned_addr learned my addr 172.21.15.84:0/2569797268 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b63fff700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640696d0 0x7f0b64069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b68919700 1 --2- 172.21.15.84:0/2569797268 >> v2:172.21.15.131:3300/0 conn(0x7f0b640b1200 0x7f0b640b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492270731 0 0) 0x7f0b64159fa0 con 0x7f0b6415a430 2023-10-06T03:24:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b4c003570 con 0x7f0b6415a430 2023-10-06T03:24:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2961921556 0 0) 0x7f0b4c003570 con 0x7f0b6415a430 2023-10-06T03:24:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640696d0 msgr2=0x7f0b64069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640696d0 0x7f0b64069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 >> v2:172.21.15.131:3300/0 conn(0x7f0b640b1200 msgr2=0x7f0b640b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 --2- 172.21.15.84:0/2569797268 >> v2:172.21.15.131:3300/0 conn(0x7f0b640b1200 0x7f0b640b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6406d650 con 0x7f0b6415a430 2023-10-06T03:24:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f0b58001470 con 0x7f0b6415a430 2023-10-06T03:24:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 >> v1:172.21.15.84:6789/0 conn(0x7f0b6415a430 legacy=0x7f0b6406cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.976+0000 7f0b62ffd700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b4c003a60 0x7f0b4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b62ffd700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b4c004810 0x7f0b4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b62ffd700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640696d0 0x7f0b4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b641599c0 con 0x7f0b4c003a60 2023-10-06T03:24:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640b1b50 con 0x7f0b4c004810 2023-10-06T03:24:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c00ba60 con 0x7f0b640696d0 2023-10-06T03:24:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b68919700 1 --2- 172.21.15.84:0/2569797268 >> v2:172.21.15.131:3300/0 conn(0x7f0b640b1200 0x7f0b640b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b63fff700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b4c003a60 0x7f0b4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b637fe700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b4c004810 0x7f0b4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b68919700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640696d0 0x7f0b4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b63fff700 1 -- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640696d0 msgr2=0x7f0b4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b63fff700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640696d0 0x7f0b4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b63fff700 1 -- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b4c004810 msgr2=0x7f0b4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b63fff700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b4c004810 0x7f0b4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b63fff700 1 -- 172.21.15.84:0/2569797268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c003570 con 0x7f0b4c003a60 2023-10-06T03:24:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b68919700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640696d0 0x7f0b4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b63fff700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b4c003a60 0x7f0b4c003e70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009c30 tx=0x7f0b540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7eaf77e46cf7df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5400e710 con 0x7f0b4c003a60 2023-10-06T03:24:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5400e870 con 0x7f0b4c003a60 2023-10-06T03:24:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.977+0000 7f0b62ffd700 1 -- 172.21.15.84:0/2569797268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5400ec30 con 0x7f0b4c003a60 2023-10-06T03:24:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.978+0000 7f0b6911a700 1 -- 172.21.15.84:0/2569797268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b4c003a60 msgr2=0x7f0b4c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.978+0000 7f0b6911a700 1 --2- 172.21.15.84:0/2569797268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b4c003a60 0x7f0b4c003e70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009c30 tx=0x7f0b540091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.978+0000 7f0b68919700 1 -- 172.21.15.84:0/2569797268 reap_dead start 2023-10-06T03:24:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.978+0000 7f0b6911a700 1 -- 172.21.15.84:0/2569797268 shutdown_connections 2023-10-06T03:24:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.978+0000 7f0b6911a700 1 -- 172.21.15.84:0/2569797268 >> 172.21.15.84:0/2569797268 conn(0x7f0b6406b540 msgr2=0x7f0b6406b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.978+0000 7f0b6911a700 1 -- 172.21.15.84:0/2569797268 shutdown_connections 2023-10-06T03:24:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.978+0000 7f0b6911a700 1 -- 172.21.15.84:0/2569797268 wait complete. 2023-10-06T03:24:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.979+0000 7f0b6911a700 1 Processor -- start 2023-10-06T03:24:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.979+0000 7f0b6911a700 1 -- start start 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b6911a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b4c003a60 0x7f0b6415ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b6911a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b640ce2e0 0x7f0b640ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b6911a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640c8740 0x7f0b640c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b6911a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640cd010 con 0x7f0b640ce2e0 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b6911a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640cde50 con 0x7f0b640c8740 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b6911a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640cd240 con 0x7f0b4c003a60 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b640ce2e0 0x7f0b640ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b640ce2e0 0x7f0b640ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33592/0 (socket says 172.21.15.84:33592) 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b637fe700 1 -- 172.21.15.84:0/802769969 learned_addr learned my addr 172.21.15.84:0/802769969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b63fff700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b4c003a60 0x7f0b6415ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b68919700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640c8740 0x7f0b640c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b637fe700 1 -- 172.21.15.84:0/802769969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b4c003a60 msgr2=0x7f0b6415ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b637fe700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b4c003a60 0x7f0b6415ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b637fe700 1 -- 172.21.15.84:0/802769969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640c8740 msgr2=0x7f0b640c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b637fe700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640c8740 0x7f0b640c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b637fe700 1 -- 172.21.15.84:0/802769969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640cd520 con 0x7f0b640ce2e0 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b637fe700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b640ce2e0 0x7f0b640ce750 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b58001050 tx=0x7f0b6406c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b4bfff700 1 -- 172.21.15.84:0/802769969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800c760 con 0x7f0b640ce2e0 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b4bfff700 1 -- 172.21.15.84:0/802769969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5800c8c0 con 0x7f0b640ce2e0 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b6911a700 1 -- 172.21.15.84:0/802769969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b640cd800 con 0x7f0b640ce2e0 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b4bfff700 1 -- 172.21.15.84:0/802769969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800cc80 con 0x7f0b640ce2e0 2023-10-06T03:24:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.980+0000 7f0b6911a700 1 -- 172.21.15.84:0/802769969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6415b340 con 0x7f0b640ce2e0 2023-10-06T03:24:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.981+0000 7f0b6911a700 1 -- 172.21.15.84:0/802769969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6415b560 con 0x7f0b640ce2e0 2023-10-06T03:24:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.982+0000 7f0b4bfff700 1 -- 172.21.15.84:0/802769969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b58013630 con 0x7f0b640ce2e0 2023-10-06T03:24:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.982+0000 7f0b4bfff700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0b50066f30 0x7f0b500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.982+0000 7f0b4bfff700 1 -- 172.21.15.84:0/802769969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0b580848e0 con 0x7f0b640ce2e0 2023-10-06T03:24:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.982+0000 7f0b63fff700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0b50066f30 0x7f0b500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.982+0000 7f0b63fff700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0b50066f30 0x7f0b500693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b540091e0 tx=0x7f0b5401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:11.986+0000 7f0b4bfff700 1 -- 172.21.15.84:0/802769969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b58051700 con 0x7f0b640ce2e0 2023-10-06T03:24:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.211+0000 7f0b6911a700 1 -- 172.21.15.84:0/802769969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b6405f270 con 0x7f0b640ce2e0 2023-10-06T03:24:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.211+0000 7f0b4bfff700 1 -- 172.21.15.84:0/802769969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f0b58054d20 con 0x7f0b640ce2e0 2023-10-06T03:24:12.213 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:12.214 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:49.917332+0000","modified":"2023-10-06T03:24:03.584509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.213+0000 7f0b6911a700 1 -- 172.21.15.84:0/802769969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0b50066f30 msgr2=0x7f0b500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.213+0000 7f0b6911a700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0b50066f30 0x7f0b500693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b540091e0 tx=0x7f0b5401a000 comp rx=0 tx=0).stop 2023-10-06T03:24:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.213+0000 7f0b6911a700 1 -- 172.21.15.84:0/802769969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b640ce2e0 msgr2=0x7f0b640ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.213+0000 7f0b6911a700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b640ce2e0 0x7f0b640ce750 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b58001050 tx=0x7f0b6406c370 comp rx=0 tx=0).stop 2023-10-06T03:24:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.213+0000 7f0b6911a700 1 -- 172.21.15.84:0/802769969 shutdown_connections 2023-10-06T03:24:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.213+0000 7f0b6911a700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0b50066f30 0x7f0b500693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.213+0000 7f0b6911a700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640c8740 0x7f0b640c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.213+0000 7f0b6911a700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b4c003a60 0x7f0b6415ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.213+0000 7f0b6911a700 1 --2- 172.21.15.84:0/802769969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b640ce2e0 0x7f0b640ce750 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.213+0000 7f0b6911a700 1 -- 172.21.15.84:0/802769969 >> 172.21.15.84:0/802769969 conn(0x7f0b6406b540 msgr2=0x7f0b640b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.214+0000 7f0b6911a700 1 -- 172.21.15.84:0/802769969 shutdown_connections 2023-10-06T03:24:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.214+0000 7f0b6911a700 1 -- 172.21.15.84:0/802769969 wait complete. 2023-10-06T03:24:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-10-06T03:24:12.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:12.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.340+0000 7fb3d63f5700 1 Processor -- start 2023-10-06T03:24:12.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.340+0000 7fb3d63f5700 1 -- start start 2023-10-06T03:24:12.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.340+0000 7fb3d63f5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d00cd180 0x7fb3d00cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.340+0000 7fb3d63f5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb3d00cb400 0x7fb3d00cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.340+0000 7fb3d63f5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d00cdb30 con 0x7fb3d0159e30 2023-10-06T03:24:12.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.340+0000 7fb3d63f5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d015e060 con 0x7fb3d00cb400 2023-10-06T03:24:12.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.340+0000 7fb3d63f5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d015d4e0 con 0x7fb3d00cd180 2023-10-06T03:24:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3cffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb3d0159e30 0x7fb3d015a200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53794/0 (socket says 172.21.15.84:53794) 2023-10-06T03:24:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3cffff700 1 -- 172.21.15.84:0/319586217 learned_addr learned my addr 172.21.15.84:0/319586217 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3d4992700 1 --2- 172.21.15.84:0/319586217 >> v2:172.21.15.131:3300/0 conn(0x7fb3d00cb400 0x7fb3d00cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3cf7fe700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d00cd180 0x7fb3d00cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138631011 0 0) 0x7fb3d00cdb30 con 0x7fb3d0159e30 2023-10-06T03:24:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b8003570 con 0x7fb3d0159e30 2023-10-06T03:24:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1814289958 0 0) 0x7fb3b8003570 con 0x7fb3d0159e30 2023-10-06T03:24:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d00cd180 msgr2=0x7fb3d00cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d00cd180 0x7fb3d00cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 >> v2:172.21.15.131:3300/0 conn(0x7fb3d00cb400 msgr2=0x7fb3d00cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 --2- 172.21.15.84:0/319586217 >> v2:172.21.15.131:3300/0 conn(0x7fb3d00cb400 0x7fb3d00cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d015d7c0 con 0x7fb3d0159e30 2023-10-06T03:24:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fb3c0001470 con 0x7fb3d0159e30 2023-10-06T03:24:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 >> v1:172.21.15.84:6789/0 conn(0x7fb3d0159e30 legacy=0x7fb3d015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3b8003a60 0x7fb3b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3b8004810 0x7fb3b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d00cd180 0x7fb3b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d015e060 con 0x7fb3b8003a60 2023-10-06T03:24:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d015d4e0 con 0x7fb3b8004810 2023-10-06T03:24:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b800bb10 con 0x7fb3d00cd180 2023-10-06T03:24:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3cffff700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3b8003a60 0x7fb3b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3cf7fe700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3b8004810 0x7fb3b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3d4992700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d00cd180 0x7fb3b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3cffff700 1 -- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d00cd180 msgr2=0x7fb3b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3cffff700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d00cd180 0x7fb3b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.341+0000 7fb3cffff700 1 -- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3b8004810 msgr2=0x7fb3b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3cffff700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3b8004810 0x7fb3b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3cffff700 1 -- 172.21.15.84:0/319586217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8003570 con 0x7fb3b8003a60 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3cf7fe700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3b8004810 0x7fb3b8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3cffff700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3b8003a60 0x7fb3b8003e70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000c3c0 tx=0x7fb3c0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247507836cacdd8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000cc90 con 0x7fb3b8003a60 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c000ce10 con 0x7fb3b8003a60 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3ceffd700 1 -- 172.21.15.84:0/319586217 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0005b70 con 0x7fb3b8003a60 2023-10-06T03:24:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3d63f5700 1 -- 172.21.15.84:0/319586217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3b8003a60 msgr2=0x7fb3b8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3d63f5700 1 --2- 172.21.15.84:0/319586217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3b8003a60 0x7fb3b8003e70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000c3c0 tx=0x7fb3c0001e90 comp rx=0 tx=0).stop 2023-10-06T03:24:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3d4992700 1 -- 172.21.15.84:0/319586217 reap_dead start 2023-10-06T03:24:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3d63f5700 1 -- 172.21.15.84:0/319586217 shutdown_connections 2023-10-06T03:24:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3d63f5700 1 -- 172.21.15.84:0/319586217 >> 172.21.15.84:0/319586217 conn(0x7fb3d0070810 msgr2=0x7fb3d0070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3d63f5700 1 -- 172.21.15.84:0/319586217 shutdown_connections 2023-10-06T03:24:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.342+0000 7fb3d63f5700 1 -- 172.21.15.84:0/319586217 wait complete. 2023-10-06T03:24:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.343+0000 7fb3d63f5700 1 Processor -- start 2023-10-06T03:24:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.344+0000 7fb3d63f5700 1 -- start start 2023-10-06T03:24:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.344+0000 7fb3d63f5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3b8003a60 0x7fb3d00c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.344+0000 7fb3d63f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d015c490 0x7fb3d0156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.344+0000 7fb3d63f5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d015b1d0 0x7fb3d015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.344+0000 7fb3d63f5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d00c6a10 con 0x7fb3d015c490 2023-10-06T03:24:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.344+0000 7fb3d63f5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d015bb80 con 0x7fb3b8003a60 2023-10-06T03:24:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.344+0000 7fb3d63f5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d00c81e0 con 0x7fb3d015b1d0 2023-10-06T03:24:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3cf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d015c490 0x7fb3d0156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3cf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d015c490 0x7fb3d0156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33600/0 (socket says 172.21.15.84:33600) 2023-10-06T03:24:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3cf7fe700 1 -- 172.21.15.84:0/3575407605 learned_addr learned my addr 172.21.15.84:0/3575407605 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3d4992700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d015b1d0 0x7fb3d015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3cffff700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3b8003a60 0x7fb3d00c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3cf7fe700 1 -- 172.21.15.84:0/3575407605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d015b1d0 msgr2=0x7fb3d015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3cf7fe700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d015b1d0 0x7fb3d015b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3cf7fe700 1 -- 172.21.15.84:0/3575407605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3b8003a60 msgr2=0x7fb3d00c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3cf7fe700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3b8003a60 0x7fb3d00c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3cf7fe700 1 -- 172.21.15.84:0/3575407605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d00ca3f0 con 0x7fb3d015c490 2023-10-06T03:24:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3cf7fe700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d015c490 0x7fb3d0156060 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4011890 tx=0x7fb3c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3b7fff700 1 -- 172.21.15.84:0/3575407605 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4015670 con 0x7fb3d015c490 2023-10-06T03:24:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3b7fff700 1 -- 172.21.15.84:0/3575407605 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c40157d0 con 0x7fb3d015c490 2023-10-06T03:24:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3d63f5700 1 -- 172.21.15.84:0/3575407605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d00c9e30 con 0x7fb3d015c490 2023-10-06T03:24:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3b7fff700 1 -- 172.21.15.84:0/3575407605 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4015b70 con 0x7fb3d015c490 2023-10-06T03:24:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.345+0000 7fb3d63f5700 1 -- 172.21.15.84:0/3575407605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d00ca1c0 con 0x7fb3d015c490 2023-10-06T03:24:12.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.346+0000 7fb3d63f5700 1 -- 172.21.15.84:0/3575407605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d0064ad0 con 0x7fb3d015c490 2023-10-06T03:24:12.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.347+0000 7fb3b7fff700 1 -- 172.21.15.84:0/3575407605 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3c4013410 con 0x7fb3d015c490 2023-10-06T03:24:12.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.347+0000 7fb3b7fff700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3bc066f30 0x7fb3bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.347+0000 7fb3cffff700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3bc066f30 0x7fb3bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.347+0000 7fb3b7fff700 1 -- 172.21.15.84:0/3575407605 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb3c4085040 con 0x7fb3d015c490 2023-10-06T03:24:12.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.348+0000 7fb3cffff700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3bc066f30 0x7fb3bc0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0001ed0 tx=0x7fb3c0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:12.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.351+0000 7fb3b7fff700 1 -- 172.21.15.84:0/3575407605 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3c40558f0 con 0x7fb3d015c490 2023-10-06T03:24:12.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.533+0000 7fb3d63f5700 1 -- 172.21.15.84:0/3575407605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3d00c7210 con 0x7fb3d015c490 2023-10-06T03:24:12.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.534+0000 7fb3b7fff700 1 -- 172.21.15.84:0/3575407605 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fb3c4055480 con 0x7fb3d015c490 2023-10-06T03:24:12.536 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:12.536 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:12.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 -- 172.21.15.84:0/3575407605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3bc066f30 msgr2=0x7fb3bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3bc066f30 0x7fb3bc0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0001ed0 tx=0x7fb3c0015000 comp rx=0 tx=0).stop 2023-10-06T03:24:12.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 -- 172.21.15.84:0/3575407605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d015c490 msgr2=0x7fb3d0156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d015c490 0x7fb3d0156060 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4011890 tx=0x7fb3c4008040 comp rx=0 tx=0).stop 2023-10-06T03:24:12.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 -- 172.21.15.84:0/3575407605 shutdown_connections 2023-10-06T03:24:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3bc066f30 0x7fb3bc0693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3b8003a60 0x7fb3d00c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3d015b1d0 0x7fb3d015b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 --2- 172.21.15.84:0/3575407605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d015c490 0x7fb3d0156060 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 -- 172.21.15.84:0/3575407605 >> 172.21.15.84:0/3575407605 conn(0x7fb3d0070810 msgr2=0x7fb3d00cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 -- 172.21.15.84:0/3575407605 shutdown_connections 2023-10-06T03:24:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.536+0000 7fb3d63f5700 1 -- 172.21.15.84:0/3575407605 wait complete. 2023-10-06T03:24:12.550 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:47.554201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:48.881558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:52.564434+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:12.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:12.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.667+0000 7f99b7fff700 1 Processor -- start 2023-10-06T03:24:12.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.667+0000 7f99b7fff700 1 -- start start 2023-10-06T03:24:12.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99b80b2a30 0x7f99b8164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b7fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b80cc9b0 con 0x7f99b80cd400 2023-10-06T03:24:12.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b7fff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b80cbda0 con 0x7f99b80b2660 2023-10-06T03:24:12.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b7fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b80cc080 con 0x7f99b80b2a30 2023-10-06T03:24:12.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99b80b2a30 0x7f99b8164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99b80b2a30 0x7f99b8164360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33606/0 (socket says 172.21.15.84:33606) 2023-10-06T03:24:12.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99affff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f99b80cd400 0x7f99b80ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53800/0 (socket says 172.21.15.84:53800) 2023-10-06T03:24:12.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b77fe700 1 -- 172.21.15.84:0/3168113907 learned_addr learned my addr 172.21.15.84:0/3168113907 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:12.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b77fe700 1 -- 172.21.15.84:0/3168113907 >> v1:172.21.15.131:6789/0 conn(0x7f99b80b2660 legacy=0x7f99b80cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b77fe700 1 -- 172.21.15.84:0/3168113907 >> v1:172.21.15.84:6789/0 conn(0x7f99b80cd400 legacy=0x7f99b80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b77fe700 1 -- 172.21.15.84:0/3168113907 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b80cc360 con 0x7f99b80b2a30 2023-10-06T03:24:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b67fc700 1 -- 172.21.15.84:0/3168113907 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104559387 0 0) 0x7f99b80cc9b0 con 0x7f99b80cd400 2023-10-06T03:24:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.668+0000 7f99b77fe700 1 --2- 172.21.15.84:0/3168113907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2a30 0x7f99b8164360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009f20 tx=0x7f99b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c380e1b5f6c4b9a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.669+0000 7f99b67fc700 1 -- 172.21.15.84:0/3168113907 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000e070 con 0x7f99b80b2a30 2023-10-06T03:24:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.669+0000 7f99b67fc700 1 -- 172.21.15.84:0/3168113907 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000ba40 con 0x7f99b80b2a30 2023-10-06T03:24:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.669+0000 7f99b67fc700 1 -- 172.21.15.84:0/3168113907 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00092e0 con 0x7f99b80b2a30 2023-10-06T03:24:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.669+0000 7f99b7fff700 1 -- 172.21.15.84:0/3168113907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2a30 msgr2=0x7f99b8164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.669+0000 7f99b7fff700 1 --2- 172.21.15.84:0/3168113907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2a30 0x7f99b8164360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009f20 tx=0x7f99b0009840 comp rx=0 tx=0).stop 2023-10-06T03:24:12.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.669+0000 7f99b7fff700 1 -- 172.21.15.84:0/3168113907 shutdown_connections 2023-10-06T03:24:12.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.669+0000 7f99b7fff700 1 --2- 172.21.15.84:0/3168113907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2a30 0x7f99b8164360 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.669+0000 7f99b7fff700 1 -- 172.21.15.84:0/3168113907 >> 172.21.15.84:0/3168113907 conn(0x7f99b8099560 msgr2=0x7f99b806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:12.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.669+0000 7f99b7fff700 1 -- 172.21.15.84:0/3168113907 shutdown_connections 2023-10-06T03:24:12.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.669+0000 7f99b7fff700 1 -- 172.21.15.84:0/3168113907 wait complete. 2023-10-06T03:24:12.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.670+0000 7f99b7fff700 1 Processor -- start 2023-10-06T03:24:12.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.670+0000 7f99b7fff700 1 -- start start 2023-10-06T03:24:12.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2660 0x7f99b80b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b80b2a30 0x7f99b8142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99b80cd400 0x7f99b8154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b7fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b8153580 con 0x7f99b80b2660 2023-10-06T03:24:12.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b7fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80b52a0 con 0x7f99b80b2a30 2023-10-06T03:24:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b7fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80b5c70 con 0x7f99b80cd400 2023-10-06T03:24:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2660 0x7f99b80b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2660 0x7f99b80b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33616/0 (socket says 172.21.15.84:33616) 2023-10-06T03:24:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b6ffd700 1 -- 172.21.15.84:0/4017568293 learned_addr learned my addr 172.21.15.84:0/4017568293 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99affff700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b80b2a30 0x7f99b8142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b77fe700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99b80cd400 0x7f99b8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b6ffd700 1 -- 172.21.15.84:0/4017568293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99b80cd400 msgr2=0x7f99b8154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b6ffd700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99b80cd400 0x7f99b8154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b6ffd700 1 -- 172.21.15.84:0/4017568293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b80b2a30 msgr2=0x7f99b8142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b6ffd700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b80b2a30 0x7f99b8142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b6ffd700 1 -- 172.21.15.84:0/4017568293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0009ae0 con 0x7f99b80b2660 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.671+0000 7f99b77fe700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99b80cd400 0x7f99b8154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.672+0000 7f99b6ffd700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2660 0x7f99b80b5730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b5e0 tx=0x7f99a80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.672+0000 7f99aeffd700 1 -- 172.21.15.84:0/4017568293 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800f510 con 0x7f99b80b2660 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.672+0000 7f99aeffd700 1 -- 172.21.15.84:0/4017568293 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a800f670 con 0x7f99b80b2660 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.672+0000 7f99b7fff700 1 -- 172.21.15.84:0/4017568293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b80b43f0 con 0x7f99b80b2660 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.672+0000 7f99aeffd700 1 -- 172.21.15.84:0/4017568293 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800fa30 con 0x7f99b80b2660 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.672+0000 7f99b7fff700 1 -- 172.21.15.84:0/4017568293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b80b4970 con 0x7f99b80b2660 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.673+0000 7f99b7fff700 1 -- 172.21.15.84:0/4017568293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b80b5580 con 0x7f99b80b2660 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.673+0000 7f99aeffd700 1 -- 172.21.15.84:0/4017568293 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99a801a400 con 0x7f99b80b2660 2023-10-06T03:24:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.674+0000 7f99aeffd700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9998066f30 0x7f99980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.674+0000 7f99aeffd700 1 -- 172.21.15.84:0/4017568293 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f99a8084450 con 0x7f99b80b2660 2023-10-06T03:24:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.674+0000 7f99affff700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9998066f30 0x7f99980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.674+0000 7f99affff700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9998066f30 0x7f99980693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f99b80b2350 tx=0x7f99a0007bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.678+0000 7f99aeffd700 1 -- 172.21.15.84:0/4017568293 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99a80512f0 con 0x7f99b80b2660 2023-10-06T03:24:12.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.866+0000 7f99b7fff700 1 -- 172.21.15.84:0/4017568293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f99b80cc640 con 0x7f99b80b2660 2023-10-06T03:24:12.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.867+0000 7f99aeffd700 1 -- 172.21.15.84:0/4017568293 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f99a8054910 con 0x7f99b80b2660 2023-10-06T03:24:12.869 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:24:12.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 -- 172.21.15.84:0/4017568293 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9998066f30 msgr2=0x7f99980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9998066f30 0x7f99980693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f99b80b2350 tx=0x7f99a0007bf0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 -- 172.21.15.84:0/4017568293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2660 msgr2=0x7f99b80b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2660 0x7f99b80b5730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b5e0 tx=0x7f99a80090f0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 -- 172.21.15.84:0/4017568293 shutdown_connections 2023-10-06T03:24:12.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9998066f30 0x7f99980693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99b80cd400 0x7f99b8154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99b80b2660 0x7f99b80b5730 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 --2- 172.21.15.84:0/4017568293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b80b2a30 0x7f99b8142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 -- 172.21.15.84:0/4017568293 >> 172.21.15.84:0/4017568293 conn(0x7f99b8099560 msgr2=0x7f99b8156290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:12.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 -- 172.21.15.84:0/4017568293 shutdown_connections 2023-10-06T03:24:12.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.869+0000 7f99b7fff700 1 -- 172.21.15.84:0/4017568293 wait complete. 2023-10-06T03:24:12.882 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:13.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.998+0000 7f925900b700 1 Processor -- start 2023-10-06T03:24:13.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.998+0000 7f925900b700 1 -- start start 2023-10-06T03:24:13.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925900b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92540cd980 0x7f9254159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925900b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f92540b4a60 0x7f92540d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925900b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92540d0850 0x7f925415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925900b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92540b5f30 con 0x7f92540d0850 2023-10-06T03:24:13.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925900b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92540b3640 con 0x7f92540b4a60 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925900b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92540d0c90 con 0x7f92540cd980 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92540d0850 0x7f925415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92540d0850 0x7f925415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33622/0 (socket says 172.21.15.84:33622) 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925359e700 1 -- 172.21.15.84:0/3296837400 learned_addr learned my addr 172.21.15.84:0/3296837400 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f924a59c700 1 --2- 172.21.15.84:0/3296837400 >> v2:172.21.15.131:3300/0 conn(0x7f92540b4a60 0x7f92540d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f9252d9d700 1 --2- 172.21.15.84:0/3296837400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92540cd980 0x7f9254159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925359e700 1 -- 172.21.15.84:0/3296837400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92540cd980 msgr2=0x7f9254159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925359e700 1 --2- 172.21.15.84:0/3296837400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92540cd980 0x7f9254159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925359e700 1 -- 172.21.15.84:0/3296837400 >> v2:172.21.15.131:3300/0 conn(0x7f92540b4a60 msgr2=0x7f92540d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925359e700 1 --2- 172.21.15.84:0/3296837400 >> v2:172.21.15.131:3300/0 conn(0x7f92540b4a60 0x7f92540d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925359e700 1 -- 172.21.15.84:0/3296837400 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92540b63c0 con 0x7f92540d0850 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:12.999+0000 7f925359e700 1 --2- 172.21.15.84:0/3296837400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540d0850 0x7f925415ade0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92540895f0 tx=0x7f924c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7410ff3d3f87ff94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925259c700 1 -- 172.21.15.84:0/3296837400 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c00e070 con 0x7f92540d0850 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925259c700 1 -- 172.21.15.84:0/3296837400 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c00b970 con 0x7f92540d0850 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925259c700 1 -- 172.21.15.84:0/3296837400 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c0092e0 con 0x7f92540d0850 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925900b700 1 -- 172.21.15.84:0/3296837400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540d0850 msgr2=0x7f925415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925900b700 1 --2- 172.21.15.84:0/3296837400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540d0850 0x7f925415ade0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92540895f0 tx=0x7f924c009840 comp rx=0 tx=0).stop 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925900b700 1 -- 172.21.15.84:0/3296837400 shutdown_connections 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925900b700 1 --2- 172.21.15.84:0/3296837400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540d0850 0x7f925415ade0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925900b700 1 --2- 172.21.15.84:0/3296837400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92540cd980 0x7f9254159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925900b700 1 --2- 172.21.15.84:0/3296837400 >> v2:172.21.15.131:3300/0 conn(0x7f92540b4a60 0x7f92540d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925900b700 1 -- 172.21.15.84:0/3296837400 >> 172.21.15.84:0/3296837400 conn(0x7f925406ed20 msgr2=0x7f925406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:13.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925900b700 1 -- 172.21.15.84:0/3296837400 shutdown_connections 2023-10-06T03:24:13.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.000+0000 7f925900b700 1 -- 172.21.15.84:0/3296837400 wait complete. 2023-10-06T03:24:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.001+0000 7f925900b700 1 Processor -- start 2023-10-06T03:24:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.001+0000 7f925900b700 1 -- start start 2023-10-06T03:24:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f925900b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540b4a60 0x7f925415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f925900b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92540cd980 0x7f92540b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f925900b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92540d0850 0x7f92541542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f925900b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925415ba20 con 0x7f92540b4a60 2023-10-06T03:24:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f925900b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540b28c0 con 0x7f92540d0850 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f925900b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925415ae10 con 0x7f92540cd980 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f9252d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540b4a60 0x7f925415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f9252d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540b4a60 0x7f925415beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33636/0 (socket says 172.21.15.84:33636) 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f9252d9d700 1 -- 172.21.15.84:0/422661277 learned_addr learned my addr 172.21.15.84:0/422661277 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f925359e700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92540d0850 0x7f92541542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f924a59c700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92540cd980 0x7f92540b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f9252d9d700 1 -- 172.21.15.84:0/422661277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92540cd980 msgr2=0x7f92540b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f9252d9d700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92540cd980 0x7f92540b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f9252d9d700 1 -- 172.21.15.84:0/422661277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92540d0850 msgr2=0x7f92541542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f9252d9d700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92540d0850 0x7f92541542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.002+0000 7f9252d9d700 1 -- 172.21.15.84:0/422661277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c009ae0 con 0x7f92540b4a60 2023-10-06T03:24:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.003+0000 7f9252d9d700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540b4a60 0x7f925415beb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f924400ec80 tx=0x7f92440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.003+0000 7f924b7fe700 1 -- 172.21.15.84:0/422661277 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400c850 con 0x7f92540b4a60 2023-10-06T03:24:13.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.003+0000 7f924b7fe700 1 -- 172.21.15.84:0/422661277 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924400c9d0 con 0x7f92540b4a60 2023-10-06T03:24:13.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.003+0000 7f925900b700 1 -- 172.21.15.84:0/422661277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925415b0f0 con 0x7f92540b4a60 2023-10-06T03:24:13.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.003+0000 7f924b7fe700 1 -- 172.21.15.84:0/422661277 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400cd90 con 0x7f92540b4a60 2023-10-06T03:24:13.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.003+0000 7f925900b700 1 -- 172.21.15.84:0/422661277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925415b6b0 con 0x7f92540b4a60 2023-10-06T03:24:13.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.004+0000 7f925900b700 1 -- 172.21.15.84:0/422661277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9254064ad0 con 0x7f92540b4a60 2023-10-06T03:24:13.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.004+0000 7f924b7fe700 1 -- 172.21.15.84:0/422661277 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9244013680 con 0x7f92540b4a60 2023-10-06T03:24:13.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.004+0000 7f924b7fe700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9234066f30 0x7f92340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.005+0000 7f924a59c700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9234066f30 0x7f92340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.005+0000 7f924b7fe700 1 -- 172.21.15.84:0/422661277 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9244084c10 con 0x7f92540b4a60 2023-10-06T03:24:13.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.005+0000 7f924a59c700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9234066f30 0x7f92340693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f92541534f0 tx=0x7f923c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.009+0000 7f924b7fe700 1 -- 172.21.15.84:0/422661277 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9244051a30 con 0x7f92540b4a60 2023-10-06T03:24:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.193+0000 7f925900b700 1 -- 172.21.15.84:0/422661277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92540b5320 con 0x7f92540b4a60 2023-10-06T03:24:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.193+0000 7f924b7fe700 1 -- 172.21.15.84:0/422661277 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9244055050 con 0x7f92540b4a60 2023-10-06T03:24:13.195 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:24:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 -- 172.21.15.84:0/422661277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9234066f30 msgr2=0x7f92340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9234066f30 0x7f92340693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f92541534f0 tx=0x7f923c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 -- 172.21.15.84:0/422661277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540b4a60 msgr2=0x7f925415beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540b4a60 0x7f925415beb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f924400ec80 tx=0x7f92440091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 -- 172.21.15.84:0/422661277 shutdown_connections 2023-10-06T03:24:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9234066f30 0x7f92340693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92540d0850 0x7f92541542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92540b4a60 0x7f925415beb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 --2- 172.21.15.84:0/422661277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92540cd980 0x7f92540b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 -- 172.21.15.84:0/422661277 >> 172.21.15.84:0/422661277 conn(0x7f925406ed20 msgr2=0x7f925415c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 -- 172.21.15.84:0/422661277 shutdown_connections 2023-10-06T03:24:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.195+0000 7f925900b700 1 -- 172.21.15.84:0/422661277 wait complete. 2023-10-06T03:24:13.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:13.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.324+0000 7facba4b6700 1 Processor -- start 2023-10-06T03:24:13.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.324+0000 7facba4b6700 1 -- start start 2023-10-06T03:24:13.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facba4b6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7facb40b2660 0x7facb40cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facba4b6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7facb40cf1f0 0x7facb40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facba4b6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb40cc9b0 con 0x7facb40b2a30 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facba4b6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb40cbda0 con 0x7facb40b2660 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facba4b6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb40cc080 con 0x7facb40cf1f0 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facb94b4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7facb40b2660 0x7facb40cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facb9cb5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7facb40cf1f0 0x7facb40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facb94b4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7facb40b2660 0x7facb40cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33646/0 (socket says 172.21.15.84:33646) 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facb94b4700 1 -- 172.21.15.84:0/556283731 learned_addr learned my addr 172.21.15.84:0/556283731 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facb8cb3700 1 --1- 172.21.15.84:0/556283731 >> v1:172.21.15.84:6789/0 conn(0x7facb40b2a30 0x7facb40ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53804/0 (socket says 172.21.15.84:53804) 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facb9cb5700 1 -- 172.21.15.84:0/556283731 >> v2:172.21.15.84:3300/0 conn(0x7facb40b2660 msgr2=0x7facb40cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facb9cb5700 1 --2- 172.21.15.84:0/556283731 >> v2:172.21.15.84:3300/0 conn(0x7facb40b2660 0x7facb40cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facb9cb5700 1 -- 172.21.15.84:0/556283731 >> v1:172.21.15.84:6789/0 conn(0x7facb40b2a30 legacy=0x7facb40ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.325+0000 7facb9cb5700 1 -- 172.21.15.84:0/556283731 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb40cc360 con 0x7facb40cf1f0 2023-10-06T03:24:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.326+0000 7facb9cb5700 1 --2- 172.21.15.84:0/556283731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40cf1f0 0x7facb40cd230 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7facb40894b0 tx=0x7facac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53206d019f2af1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.326+0000 7facabfff700 1 -- 172.21.15.84:0/556283731 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac00e070 con 0x7facb40cf1f0 2023-10-06T03:24:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.326+0000 7facabfff700 1 -- 172.21.15.84:0/556283731 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac00bb60 con 0x7facb40cf1f0 2023-10-06T03:24:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.326+0000 7facabfff700 1 -- 172.21.15.84:0/556283731 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac012430 con 0x7facb40cf1f0 2023-10-06T03:24:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.326+0000 7facba4b6700 1 -- 172.21.15.84:0/556283731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40cf1f0 msgr2=0x7facb40cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.326+0000 7facba4b6700 1 --2- 172.21.15.84:0/556283731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40cf1f0 0x7facb40cd230 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7facb40894b0 tx=0x7facac009780 comp rx=0 tx=0).stop 2023-10-06T03:24:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.326+0000 7facba4b6700 1 -- 172.21.15.84:0/556283731 shutdown_connections 2023-10-06T03:24:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.326+0000 7facba4b6700 1 --2- 172.21.15.84:0/556283731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40cf1f0 0x7facb40cd230 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.326+0000 7facba4b6700 1 --2- 172.21.15.84:0/556283731 >> v2:172.21.15.84:3300/0 conn(0x7facb40b2660 0x7facb40cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.326+0000 7facba4b6700 1 -- 172.21.15.84:0/556283731 >> 172.21.15.84:0/556283731 conn(0x7facb4099560 msgr2=0x7facb406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.327+0000 7facba4b6700 1 -- 172.21.15.84:0/556283731 shutdown_connections 2023-10-06T03:24:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.327+0000 7facba4b6700 1 -- 172.21.15.84:0/556283731 wait complete. 2023-10-06T03:24:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.328+0000 7facba4b6700 1 Processor -- start 2023-10-06T03:24:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.328+0000 7facba4b6700 1 -- start start 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.328+0000 7facba4b6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40b2660 0x7facb41523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.328+0000 7facba4b6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40b2a30 0x7facb41528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.328+0000 7facba4b6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb40cf1f0 0x7facb40c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.328+0000 7facba4b6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb40b21f0 con 0x7facb40cf1f0 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.328+0000 7facba4b6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb40c81c0 con 0x7facb40b2a30 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.328+0000 7facba4b6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb4152e20 con 0x7facb40b2660 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb9cb5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb40cf1f0 0x7facb40c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb9cb5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb40cf1f0 0x7facb40c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33660/0 (socket says 172.21.15.84:33660) 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb9cb5700 1 -- 172.21.15.84:0/511223467 learned_addr learned my addr 172.21.15.84:0/511223467 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb94b4700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40b2660 0x7facb41523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb8cb3700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40b2a30 0x7facb41528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb9cb5700 1 -- 172.21.15.84:0/511223467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40b2660 msgr2=0x7facb41523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb9cb5700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40b2660 0x7facb41523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb9cb5700 1 -- 172.21.15.84:0/511223467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40b2a30 msgr2=0x7facb41528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb9cb5700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40b2a30 0x7facb41528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb9cb5700 1 -- 172.21.15.84:0/511223467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac009a20 con 0x7facb40cf1f0 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facb9cb5700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb40cf1f0 0x7facb40c8650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7facac0097c0 tx=0x7facac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7faca97fa700 1 -- 172.21.15.84:0/511223467 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac012e00 con 0x7facb40cf1f0 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7faca97fa700 1 -- 172.21.15.84:0/511223467 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac01d630 con 0x7facb40cf1f0 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7faca97fa700 1 -- 172.21.15.84:0/511223467 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac01d9f0 con 0x7facb40cf1f0 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facba4b6700 1 -- 172.21.15.84:0/511223467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb40b5990 con 0x7facb40cf1f0 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.329+0000 7facba4b6700 1 -- 172.21.15.84:0/511223467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb40c7b70 con 0x7facb40cf1f0 2023-10-06T03:24:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.330+0000 7facba4b6700 1 -- 172.21.15.84:0/511223467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb40c8370 con 0x7facb40cf1f0 2023-10-06T03:24:13.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.330+0000 7faca97fa700 1 -- 172.21.15.84:0/511223467 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facac024070 con 0x7facb40cf1f0 2023-10-06T03:24:13.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.331+0000 7faca97fa700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac98066f30 0x7fac980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.331+0000 7faca97fa700 1 -- 172.21.15.84:0/511223467 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7facac087200 con 0x7facb40cf1f0 2023-10-06T03:24:13.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.331+0000 7facb94b4700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac98066f30 0x7fac980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.331+0000 7facb94b4700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac98066f30 0x7fac980693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7facb0009450 tx=0x7facb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.335+0000 7faca97fa700 1 -- 172.21.15.84:0/511223467 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facb40c8370 con 0x7facb40cf1f0 2023-10-06T03:24:13.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.517+0000 7facba4b6700 1 -- 172.21.15.84:0/511223467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7facb40c8330 con 0x7facb40cf1f0 2023-10-06T03:24:13.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.517+0000 7faca97fa700 1 -- 172.21.15.84:0/511223467 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7facac0540d0 con 0x7facb40cf1f0 2023-10-06T03:24:13.519 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:13.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 -- 172.21.15.84:0/511223467 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac98066f30 msgr2=0x7fac980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac98066f30 0x7fac980693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7facb0009450 tx=0x7facb0008040 comp rx=0 tx=0).stop 2023-10-06T03:24:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 -- 172.21.15.84:0/511223467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb40cf1f0 msgr2=0x7facb40c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb40cf1f0 0x7facb40c8650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7facac0097c0 tx=0x7facac019000 comp rx=0 tx=0).stop 2023-10-06T03:24:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 -- 172.21.15.84:0/511223467 shutdown_connections 2023-10-06T03:24:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac98066f30 0x7fac980693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb40cf1f0 0x7facb40c8650 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40b2660 0x7facb41523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 --2- 172.21.15.84:0/511223467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40b2a30 0x7facb41528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 -- 172.21.15.84:0/511223467 >> 172.21.15.84:0/511223467 conn(0x7facb4099560 msgr2=0x7facb4068e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.519+0000 7facba4b6700 1 -- 172.21.15.84:0/511223467 shutdown_connections 2023-10-06T03:24:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.520+0000 7facba4b6700 1 -- 172.21.15.84:0/511223467 wait complete. 2023-10-06T03:24:13.533 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:13.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.650+0000 7fac66272700 1 Processor -- start 2023-10-06T03:24:13.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.650+0000 7fac66272700 1 -- start start 2023-10-06T03:24:13.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.650+0000 7fac66272700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac6015dd30 0x7fac6015a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.650+0000 7fac66272700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6015d8a0 con 0x7fac600cb4c0 2023-10-06T03:24:13.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.650+0000 7fac66272700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6015a830 con 0x7fac60067c10 2023-10-06T03:24:13.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.650+0000 7fac66272700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6015ab10 con 0x7fac6015dd30 2023-10-06T03:24:13.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fac600cb4c0 0x7fac60159b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53820/0 (socket says 172.21.15.84:53820) 2023-10-06T03:24:13.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5f7fe700 1 -- 172.21.15.84:0/734541241 learned_addr learned my addr 172.21.15.84:0/734541241 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:13.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac6480f700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac6015dd30 0x7fac6015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033195204 0 0) 0x7fac6015d8a0 con 0x7fac600cb4c0 2023-10-06T03:24:13.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac48003570 con 0x7fac600cb4c0 2023-10-06T03:24:13.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525180005 0 0) 0x7fac6015a830 con 0x7fac60067c10 2023-10-06T03:24:13.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac6015d8a0 con 0x7fac60067c10 2023-10-06T03:24:13.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 943196071 0 0) 0x7fac48003570 con 0x7fac600cb4c0 2023-10-06T03:24:13.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac6015dd30 msgr2=0x7fac6015a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac6015dd30 0x7fac6015a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 >> v1:172.21.15.131:6789/0 conn(0x7fac60067c10 legacy=0x7fac600cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6015d250 con 0x7fac600cb4c0 2023-10-06T03:24:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fac54001470 con 0x7fac600cb4c0 2023-10-06T03:24:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 >> v1:172.21.15.84:6789/0 conn(0x7fac600cb4c0 legacy=0x7fac60159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac48003c20 0x7fac48004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac48004810 0x7fac48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac6015dd30 0x7fac48005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6015ab10 con 0x7fac48004810 2023-10-06T03:24:13.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4800bbf0 con 0x7fac48003c20 2023-10-06T03:24:13.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4800bdb0 con 0x7fac6015dd30 2023-10-06T03:24:13.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5f7fe700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac48004810 0x7fac48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac5ffff700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac48003c20 0x7fac48004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.651+0000 7fac6480f700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac6015dd30 0x7fac48005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac5f7fe700 1 -- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac6015dd30 msgr2=0x7fac48005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:13.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac5f7fe700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac6015dd30 0x7fac48005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac5f7fe700 1 -- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac48003c20 msgr2=0x7fac48004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:13.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac5f7fe700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac48003c20 0x7fac48004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac5f7fe700 1 -- 172.21.15.84:0/734541241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac48003570 con 0x7fac48004810 2023-10-06T03:24:13.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac6480f700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac6015dd30 0x7fac48005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:13.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac5f7fe700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac48004810 0x7fac48004c80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac54007fd0 tx=0x7fac6015d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64959eb123762195 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400cae0 con 0x7fac48004810 2023-10-06T03:24:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5400cc60 con 0x7fac48004810 2023-10-06T03:24:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac5effd700 1 -- 172.21.15.84:0/734541241 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54005920 con 0x7fac48004810 2023-10-06T03:24:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac66272700 1 -- 172.21.15.84:0/734541241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac48004810 msgr2=0x7fac48004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac66272700 1 --2- 172.21.15.84:0/734541241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac48004810 0x7fac48004c80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac54007fd0 tx=0x7fac6015d810 comp rx=0 tx=0).stop 2023-10-06T03:24:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac6480f700 1 -- 172.21.15.84:0/734541241 reap_dead start 2023-10-06T03:24:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac66272700 1 -- 172.21.15.84:0/734541241 shutdown_connections 2023-10-06T03:24:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac66272700 1 -- 172.21.15.84:0/734541241 >> 172.21.15.84:0/734541241 conn(0x7fac600cd1e0 msgr2=0x7fac600cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac66272700 1 -- 172.21.15.84:0/734541241 shutdown_connections 2023-10-06T03:24:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.652+0000 7fac66272700 1 -- 172.21.15.84:0/734541241 wait complete. 2023-10-06T03:24:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.653+0000 7fac66272700 1 Processor -- start 2023-10-06T03:24:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.654+0000 7fac66272700 1 -- start start 2023-10-06T03:24:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.654+0000 7fac66272700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac48004810 0x7fac60151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.654+0000 7fac66272700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac60157720 0x7fac60159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.654+0000 7fac66272700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac60157b90 0x7fac601598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.654+0000 7fac66272700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac60159e10 con 0x7fac60157720 2023-10-06T03:24:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.654+0000 7fac66272700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6015a2a0 con 0x7fac48004810 2023-10-06T03:24:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.654+0000 7fac66272700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac600b0680 con 0x7fac60157b90 2023-10-06T03:24:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.654+0000 7fac5f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac60157720 0x7fac60159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.654+0000 7fac5f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac60157720 0x7fac60159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33692/0 (socket says 172.21.15.84:33692) 2023-10-06T03:24:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.654+0000 7fac5f7fe700 1 -- 172.21.15.84:0/3827046277 learned_addr learned my addr 172.21.15.84:0/3827046277 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:13.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac5ffff700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac48004810 0x7fac60151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac6480f700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac60157b90 0x7fac601598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac5f7fe700 1 -- 172.21.15.84:0/3827046277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac60157b90 msgr2=0x7fac601598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac5f7fe700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac60157b90 0x7fac601598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac5f7fe700 1 -- 172.21.15.84:0/3827046277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac48004810 msgr2=0x7fac60151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac5f7fe700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac48004810 0x7fac60151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac5f7fe700 1 -- 172.21.15.84:0/3827046277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac600b0960 con 0x7fac60157720 2023-10-06T03:24:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac5f7fe700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac60157720 0x7fac60159390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac480057f0 tx=0x7fac54015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac47fff700 1 -- 172.21.15.84:0/3827046277 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54005ea0 con 0x7fac60157720 2023-10-06T03:24:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac47fff700 1 -- 172.21.15.84:0/3827046277 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac540070d0 con 0x7fac60157720 2023-10-06T03:24:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac47fff700 1 -- 172.21.15.84:0/3827046277 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac540074b0 con 0x7fac60157720 2023-10-06T03:24:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac66272700 1 -- 172.21.15.84:0/3827046277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac600b0c40 con 0x7fac60157720 2023-10-06T03:24:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.655+0000 7fac66272700 1 -- 172.21.15.84:0/3827046277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac600b1200 con 0x7fac60157720 2023-10-06T03:24:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.656+0000 7fac66272700 1 -- 172.21.15.84:0/3827046277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac600b1850 con 0x7fac60157720 2023-10-06T03:24:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.656+0000 7fac47fff700 1 -- 172.21.15.84:0/3827046277 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac5401f410 con 0x7fac60157720 2023-10-06T03:24:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.657+0000 7fac47fff700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac4c066f30 0x7fac4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.657+0000 7fac47fff700 1 -- 172.21.15.84:0/3827046277 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fac54086100 con 0x7fac60157720 2023-10-06T03:24:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.657+0000 7fac5ffff700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac4c066f30 0x7fac4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.657+0000 7fac5ffff700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac4c066f30 0x7fac4c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac50001120 tx=0x7fac50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.661+0000 7fac47fff700 1 -- 172.21.15.84:0/3827046277 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac54052f20 con 0x7fac60157720 2023-10-06T03:24:13.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.844+0000 7fac66272700 1 -- 172.21.15.84:0/3827046277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac60064ad0 con 0x7fac60157720 2023-10-06T03:24:13.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.844+0000 7fac47fff700 1 -- 172.21.15.84:0/3827046277 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac54056540 con 0x7fac60157720 2023-10-06T03:24:13.846 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:24:13.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 -- 172.21.15.84:0/3827046277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac4c066f30 msgr2=0x7fac4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac4c066f30 0x7fac4c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac50001120 tx=0x7fac50009040 comp rx=0 tx=0).stop 2023-10-06T03:24:13.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 -- 172.21.15.84:0/3827046277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac60157720 msgr2=0x7fac60159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac60157720 0x7fac60159390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac480057f0 tx=0x7fac54015000 comp rx=0 tx=0).stop 2023-10-06T03:24:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 -- 172.21.15.84:0/3827046277 shutdown_connections 2023-10-06T03:24:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac4c066f30 0x7fac4c0693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac48004810 0x7fac60151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac60157b90 0x7fac601598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 --2- 172.21.15.84:0/3827046277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac60157720 0x7fac60159390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 -- 172.21.15.84:0/3827046277 >> 172.21.15.84:0/3827046277 conn(0x7fac600cd1e0 msgr2=0x7fac6015c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.846+0000 7fac66272700 1 -- 172.21.15.84:0/3827046277 shutdown_connections 2023-10-06T03:24:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.847+0000 7fac66272700 1 -- 172.21.15.84:0/3827046277 wait complete. 2023-10-06T03:24:13.860 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:13.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.975+0000 7f23dffff700 1 Processor -- start 2023-10-06T03:24:13.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.975+0000 7f23dffff700 1 -- start start 2023-10-06T03:24:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23dffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23e00b2660 0x7f23e00cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23dffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f23e00cf1f0 0x7f23e00cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23dffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e00cc9b0 con 0x7f23e00b2a30 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23dffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e00cbda0 con 0x7f23e00cf1f0 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23dffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e00cc080 con 0x7f23e00b2660 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23df7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f23e00cf1f0 0x7f23e00cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23df7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f23e00cf1f0 0x7f23e00cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33706/0 (socket says 172.21.15.84:33706) 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23d67fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f23e00b2a30 0x7f23e00ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53826/0 (socket says 172.21.15.84:53826) 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23df7fe700 1 -- 172.21.15.84:0/811687436 learned_addr learned my addr 172.21.15.84:0/811687436 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23deffd700 1 --2- 172.21.15.84:0/811687436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23e00b2660 0x7f23e00cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23df7fe700 1 -- 172.21.15.84:0/811687436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23e00b2660 msgr2=0x7f23e00cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23df7fe700 1 --2- 172.21.15.84:0/811687436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23e00b2660 0x7f23e00cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23df7fe700 1 -- 172.21.15.84:0/811687436 >> v1:172.21.15.84:6789/0 conn(0x7f23e00b2a30 legacy=0x7f23e00ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23df7fe700 1 -- 172.21.15.84:0/811687436 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e00cc360 con 0x7f23e00cf1f0 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.976+0000 7f23de7fc700 1 -- 172.21.15.84:0/811687436 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914831602 0 0) 0x7f23e00cc9b0 con 0x7f23e00b2a30 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23df7fe700 1 --2- 172.21.15.84:0/811687436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00cf1f0 0x7f23e00cd230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009f20 tx=0x7f23d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a396d5557b4254 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23de7fc700 1 -- 172.21.15.84:0/811687436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d800e070 con 0x7f23e00cf1f0 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23de7fc700 1 -- 172.21.15.84:0/811687436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d800ba80 con 0x7f23e00cf1f0 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23de7fc700 1 -- 172.21.15.84:0/811687436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d80092e0 con 0x7f23e00cf1f0 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23dffff700 1 -- 172.21.15.84:0/811687436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00cf1f0 msgr2=0x7f23e00cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23dffff700 1 --2- 172.21.15.84:0/811687436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00cf1f0 0x7f23e00cd230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009f20 tx=0x7f23d8009840 comp rx=0 tx=0).stop 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23dffff700 1 -- 172.21.15.84:0/811687436 shutdown_connections 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23dffff700 1 --2- 172.21.15.84:0/811687436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00cf1f0 0x7f23e00cd230 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23dffff700 1 --2- 172.21.15.84:0/811687436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23e00b2660 0x7f23e00cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23dffff700 1 -- 172.21.15.84:0/811687436 >> 172.21.15.84:0/811687436 conn(0x7f23e0099560 msgr2=0x7f23e006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23dffff700 1 -- 172.21.15.84:0/811687436 shutdown_connections 2023-10-06T03:24:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.977+0000 7f23dffff700 1 -- 172.21.15.84:0/811687436 wait complete. 2023-10-06T03:24:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.978+0000 7f23dffff700 1 Processor -- start 2023-10-06T03:24:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23dffff700 1 -- start start 2023-10-06T03:24:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23dffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00b2660 0x7f23e014cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23dffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e00b2a30 0x7f23e00c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23dffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23e00cf1f0 0x7f23e00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23dffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e014d440 con 0x7f23e00b2660 2023-10-06T03:24:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23dffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e014e8a0 con 0x7f23e00b2a30 2023-10-06T03:24:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23dffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e00c81b0 con 0x7f23e00cf1f0 2023-10-06T03:24:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23deffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00b2660 0x7f23e014cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23deffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00b2660 0x7f23e014cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33712/0 (socket says 172.21.15.84:33712) 2023-10-06T03:24:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23deffd700 1 -- 172.21.15.84:0/1766120204 learned_addr learned my addr 172.21.15.84:0/1766120204 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23df7fe700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23e00cf1f0 0x7f23e00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.979+0000 7f23d67fc700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e00b2a30 0x7f23e00c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23deffd700 1 -- 172.21.15.84:0/1766120204 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23e00cf1f0 msgr2=0x7f23e00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23deffd700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23e00cf1f0 0x7f23e00b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23deffd700 1 -- 172.21.15.84:0/1766120204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e00b2a30 msgr2=0x7f23e00c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23deffd700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e00b2a30 0x7f23e00c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23deffd700 1 -- 172.21.15.84:0/1766120204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d8009ae0 con 0x7f23e00b2660 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23deffd700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00b2660 0x7f23e014cf00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f23d000d840 tx=0x7f23d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23d77fe700 1 -- 172.21.15.84:0/1766120204 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0014620 con 0x7f23e00b2660 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23d77fe700 1 -- 172.21.15.84:0/1766120204 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d0014780 con 0x7f23e00b2660 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23dffff700 1 -- 172.21.15.84:0/1766120204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e00c8490 con 0x7f23e00b2660 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23d77fe700 1 -- 172.21.15.84:0/1766120204 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0014b40 con 0x7f23e00b2660 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.980+0000 7f23dffff700 1 -- 172.21.15.84:0/1766120204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e00c8a50 con 0x7f23e00b2660 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.981+0000 7f23dffff700 1 -- 172.21.15.84:0/1766120204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e014eb60 con 0x7f23e00b2660 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.981+0000 7f23d77fe700 1 -- 172.21.15.84:0/1766120204 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23d001d400 con 0x7f23e00b2660 2023-10-06T03:24:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.982+0000 7f23d77fe700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f23c0066f30 0x7f23c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.982+0000 7f23d77fe700 1 -- 172.21.15.84:0/1766120204 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f23d00850a0 con 0x7f23e00b2660 2023-10-06T03:24:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.982+0000 7f23d67fc700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f23c0066f30 0x7f23c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.982+0000 7f23d67fc700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f23c0066f30 0x7f23c00693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23e014d9c0 tx=0x7f23c8007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:13.986+0000 7f23d77fe700 1 -- 172.21.15.84:0/1766120204 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23d0051ec0 con 0x7f23e00b2660 2023-10-06T03:24:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.167+0000 7f23dffff700 1 -- 172.21.15.84:0/1766120204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f23e005f270 con 0x7f23e00b2660 2023-10-06T03:24:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.167+0000 7f23d77fe700 1 -- 172.21.15.84:0/1766120204 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f23d00554e0 con 0x7f23e00b2660 2023-10-06T03:24:14.169 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 -- 172.21.15.84:0/1766120204 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f23c0066f30 msgr2=0x7f23c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f23c0066f30 0x7f23c00693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23e014d9c0 tx=0x7f23c8007d50 comp rx=0 tx=0).stop 2023-10-06T03:24:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 -- 172.21.15.84:0/1766120204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00b2660 msgr2=0x7f23e014cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00b2660 0x7f23e014cf00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f23d000d840 tx=0x7f23d0008040 comp rx=0 tx=0).stop 2023-10-06T03:24:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 -- 172.21.15.84:0/1766120204 shutdown_connections 2023-10-06T03:24:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f23c0066f30 0x7f23c00693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23e00cf1f0 0x7f23e00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e00b2660 0x7f23e014cf00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 --2- 172.21.15.84:0/1766120204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e00b2a30 0x7f23e00c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 -- 172.21.15.84:0/1766120204 >> 172.21.15.84:0/1766120204 conn(0x7f23e0099560 msgr2=0x7f23e0157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 -- 172.21.15.84:0/1766120204 shutdown_connections 2023-10-06T03:24:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.169+0000 7f23dffff700 1 -- 172.21.15.84:0/1766120204 wait complete. 2023-10-06T03:24:14.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:14.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.295+0000 7faa21661700 1 Processor -- start 2023-10-06T03:24:14.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.295+0000 7faa21661700 1 -- start start 2023-10-06T03:24:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.296+0000 7faa21661700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa1c156540 0x7faa1c0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.296+0000 7faa21661700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa1c0c75b0 0x7faa1c06e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.296+0000 7faa21661700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa1c06ebd0 0x7faa1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.296+0000 7faa21661700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c06f470 con 0x7faa1c0c75b0 2023-10-06T03:24:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.296+0000 7faa21661700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c06f050 con 0x7faa1c156540 2023-10-06T03:24:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.296+0000 7faa21661700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0acd60 con 0x7faa1c06ebd0 2023-10-06T03:24:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.296+0000 7faa1a7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa1c0c75b0 0x7faa1c06e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.296+0000 7faa1a7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa1c0c75b0 0x7faa1c06e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33728/0 (socket says 172.21.15.84:33728) 2023-10-06T03:24:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.296+0000 7faa1a7fc700 1 -- 172.21.15.84:0/905362097 learned_addr learned my addr 172.21.15.84:0/905362097 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa1b7fe700 1 --2- 172.21.15.84:0/905362097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa1c06ebd0 0x7faa1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa1affd700 1 --2- 172.21.15.84:0/905362097 >> v2:172.21.15.131:3300/0 conn(0x7faa1c156540 0x7faa1c0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa1a7fc700 1 -- 172.21.15.84:0/905362097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa1c06ebd0 msgr2=0x7faa1c06d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa1a7fc700 1 --2- 172.21.15.84:0/905362097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa1c06ebd0 0x7faa1c06d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa1a7fc700 1 -- 172.21.15.84:0/905362097 >> v2:172.21.15.131:3300/0 conn(0x7faa1c156540 msgr2=0x7faa1c0c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa1a7fc700 1 --2- 172.21.15.84:0/905362097 >> v2:172.21.15.131:3300/0 conn(0x7faa1c156540 0x7faa1c0c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa1a7fc700 1 -- 172.21.15.84:0/905362097 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c156910 con 0x7faa1c0c75b0 2023-10-06T03:24:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa1affd700 1 --2- 172.21.15.84:0/905362097 >> v2:172.21.15.131:3300/0 conn(0x7faa1c156540 0x7faa1c0c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa1a7fc700 1 --2- 172.21.15.84:0/905362097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 0x7faa1c06e690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faa1c06fd80 tx=0x7faa10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a99df344db99bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa19ffb700 1 -- 172.21.15.84:0/905362097 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1000b820 con 0x7faa1c0c75b0 2023-10-06T03:24:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa19ffb700 1 -- 172.21.15.84:0/905362097 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1000b980 con 0x7faa1c0c75b0 2023-10-06T03:24:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa19ffb700 1 -- 172.21.15.84:0/905362097 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1000bd20 con 0x7faa1c0c75b0 2023-10-06T03:24:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa21661700 1 -- 172.21.15.84:0/905362097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 msgr2=0x7faa1c06e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa21661700 1 --2- 172.21.15.84:0/905362097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 0x7faa1c06e690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faa1c06fd80 tx=0x7faa10009250 comp rx=0 tx=0).stop 2023-10-06T03:24:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa21661700 1 -- 172.21.15.84:0/905362097 shutdown_connections 2023-10-06T03:24:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa21661700 1 --2- 172.21.15.84:0/905362097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa1c06ebd0 0x7faa1c06d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa21661700 1 --2- 172.21.15.84:0/905362097 >> v2:172.21.15.131:3300/0 conn(0x7faa1c156540 0x7faa1c0c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa21661700 1 --2- 172.21.15.84:0/905362097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 0x7faa1c06e690 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.297+0000 7faa21661700 1 -- 172.21.15.84:0/905362097 >> 172.21.15.84:0/905362097 conn(0x7faa1c0680c0 msgr2=0x7faa1c0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:14.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.298+0000 7faa21661700 1 -- 172.21.15.84:0/905362097 shutdown_connections 2023-10-06T03:24:14.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.298+0000 7faa21661700 1 -- 172.21.15.84:0/905362097 wait complete. 2023-10-06T03:24:14.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.299+0000 7faa21661700 1 Processor -- start 2023-10-06T03:24:14.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.299+0000 7faa21661700 1 -- start start 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.299+0000 7faa21661700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa1c06ebd0 0x7faa1c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.299+0000 7faa21661700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 0x7faa1c1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa21661700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1c156540 0x7faa1c158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa21661700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0b1e70 con 0x7faa1c0c75b0 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa21661700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0b1260 con 0x7faa1c156540 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa21661700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0b1540 con 0x7faa1c06ebd0 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 0x7faa1c1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 0x7faa1c1587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33738/0 (socket says 172.21.15.84:33738) 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1a7fc700 1 -- 172.21.15.84:0/3115575087 learned_addr learned my addr 172.21.15.84:0/3115575087 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:14.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1affd700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa1c06ebd0 0x7faa1c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1b7fe700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1c156540 0x7faa1c158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1a7fc700 1 -- 172.21.15.84:0/3115575087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa1c06ebd0 msgr2=0x7faa1c1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1a7fc700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa1c06ebd0 0x7faa1c1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1a7fc700 1 -- 172.21.15.84:0/3115575087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1c156540 msgr2=0x7faa1c158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1a7fc700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1c156540 0x7faa1c158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1a7fc700 1 -- 172.21.15.84:0/3115575087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100094f0 con 0x7faa1c0c75b0 2023-10-06T03:24:14.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1b7fe700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1c156540 0x7faa1c158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa1a7fc700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 0x7faa1c1587a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa100094c0 tx=0x7faa10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa02ffd700 1 -- 172.21.15.84:0/3115575087 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1001a420 con 0x7faa1c0c75b0 2023-10-06T03:24:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa02ffd700 1 -- 172.21.15.84:0/3115575087 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1001a580 con 0x7faa1c0c75b0 2023-10-06T03:24:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa02ffd700 1 -- 172.21.15.84:0/3115575087 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1001a940 con 0x7faa1c0c75b0 2023-10-06T03:24:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa21661700 1 -- 172.21.15.84:0/3115575087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c0b1820 con 0x7faa1c0c75b0 2023-10-06T03:24:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.300+0000 7faa21661700 1 -- 172.21.15.84:0/3115575087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c155910 con 0x7faa1c0c75b0 2023-10-06T03:24:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.301+0000 7faa21661700 1 -- 172.21.15.84:0/3115575087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c167c20 con 0x7faa1c0c75b0 2023-10-06T03:24:14.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.302+0000 7faa02ffd700 1 -- 172.21.15.84:0/3115575087 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa1002e450 con 0x7faa1c0c75b0 2023-10-06T03:24:14.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.302+0000 7faa02ffd700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa08066f30 0x7faa080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.302+0000 7faa02ffd700 1 -- 172.21.15.84:0/3115575087 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7faa10086360 con 0x7faa1c0c75b0 2023-10-06T03:24:14.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.302+0000 7faa1affd700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa08066f30 0x7faa080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.302+0000 7faa1affd700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa08066f30 0x7faa080693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0c2390 tx=0x7faa0c0077b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:14.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.306+0000 7faa02ffd700 1 -- 172.21.15.84:0/3115575087 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa1c167c20 con 0x7faa1c0c75b0 2023-10-06T03:24:14.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.532+0000 7faa21661700 1 -- 172.21.15.84:0/3115575087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa1c167c20 con 0x7faa1c0c75b0 2023-10-06T03:24:14.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.533+0000 7faa02ffd700 1 -- 172.21.15.84:0/3115575087 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7faa1c167c20 con 0x7faa1c0c75b0 2023-10-06T03:24:14.535 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:14.535 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:49.917332+0000","modified":"2023-10-06T03:24:03.584509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:14.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 -- 172.21.15.84:0/3115575087 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa08066f30 msgr2=0x7faa080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa08066f30 0x7faa080693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0c2390 tx=0x7faa0c0077b0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 -- 172.21.15.84:0/3115575087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 msgr2=0x7faa1c1587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 0x7faa1c1587a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa100094c0 tx=0x7faa10017000 comp rx=0 tx=0).stop 2023-10-06T03:24:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 -- 172.21.15.84:0/3115575087 shutdown_connections 2023-10-06T03:24:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa08066f30 0x7faa080693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1c156540 0x7faa1c158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa1c06ebd0 0x7faa1c1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 --2- 172.21.15.84:0/3115575087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa1c0c75b0 0x7faa1c1587a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 -- 172.21.15.84:0/3115575087 >> 172.21.15.84:0/3115575087 conn(0x7faa1c0680c0 msgr2=0x7faa1c1542f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 -- 172.21.15.84:0/3115575087 shutdown_connections 2023-10-06T03:24:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.535+0000 7faa21661700 1 -- 172.21.15.84:0/3115575087 wait complete. 2023-10-06T03:24:14.539 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-10-06T03:24:14.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.662+0000 7f841cbb8700 1 Processor -- start 2023-10-06T03:24:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.662+0000 7f841cbb8700 1 -- start start 2023-10-06T03:24:14.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.663+0000 7f841cbb8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84181595a0 0x7f84180aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.663+0000 7f841cbb8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84180b49e0 0x7f84180aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.663+0000 7f841cbb8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84180b0ca0 con 0x7f84180b07a0 2023-10-06T03:24:14.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.663+0000 7f841cbb8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84180b0f80 con 0x7f84180b49e0 2023-10-06T03:24:14.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.663+0000 7f841cbb8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84180b1260 con 0x7f84181595a0 2023-10-06T03:24:14.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f8415d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84180b49e0 0x7f84180aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f841659c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84181595a0 0x7f84180aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f8415d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84180b49e0 0x7f84180aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:54422/0 (socket says 172.21.15.84:54422) 2023-10-06T03:24:14.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f841659c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84181595a0 0x7f84180aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:47386/0 (socket says 172.21.15.84:47386) 2023-10-06T03:24:14.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f8416d9d700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f84180b07a0 0x7f84180b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:42476/0 (socket says 172.21.15.84:42476) 2023-10-06T03:24:14.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f8415d9b700 1 -- 172.21.15.84:0/3347136918 learned_addr learned my addr 172.21.15.84:0/3347136918 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:14.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f8415d9b700 1 -- 172.21.15.84:0/3347136918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84181595a0 msgr2=0x7f84180aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:14.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f8415d9b700 1 --2- 172.21.15.84:0/3347136918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84181595a0 0x7f84180aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f8415d9b700 1 -- 172.21.15.84:0/3347136918 >> v1:172.21.15.131:6789/0 conn(0x7f84180b07a0 legacy=0x7f84180b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f841559a700 1 -- 172.21.15.84:0/3347136918 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070019472 0 0) 0x7f84180b0ca0 con 0x7f84180b07a0 2023-10-06T03:24:14.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f8415d9b700 1 -- 172.21.15.84:0/3347136918 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180b1540 con 0x7f84180b49e0 2023-10-06T03:24:14.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f841659c700 1 --2- 172.21.15.84:0/3347136918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84181595a0 0x7f84180aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:14.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f8415d9b700 1 --2- 172.21.15.84:0/3347136918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84180b49e0 0x7f84180aaab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84000099b0 tx=0x7f8400009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93206f66a0640996 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:14.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f841559a700 1 -- 172.21.15.84:0/3347136918 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400009ea0 con 0x7f84180b49e0 2023-10-06T03:24:14.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f841559a700 1 -- 172.21.15.84:0/3347136918 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840000b860 con 0x7f84180b49e0 2023-10-06T03:24:14.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.664+0000 7f841559a700 1 -- 172.21.15.84:0/3347136918 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000bc00 con 0x7f84180b49e0 2023-10-06T03:24:14.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.665+0000 7f841cbb8700 1 -- 172.21.15.84:0/3347136918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84180b49e0 msgr2=0x7f84180aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.665+0000 7f841cbb8700 1 --2- 172.21.15.84:0/3347136918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84180b49e0 0x7f84180aaab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84000099b0 tx=0x7f8400009250 comp rx=0 tx=0).stop 2023-10-06T03:24:14.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.665+0000 7f841cbb8700 1 -- 172.21.15.84:0/3347136918 shutdown_connections 2023-10-06T03:24:14.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.665+0000 7f841cbb8700 1 --2- 172.21.15.84:0/3347136918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84181595a0 0x7f84180aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.665+0000 7f841cbb8700 1 --2- 172.21.15.84:0/3347136918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84180b49e0 0x7f84180aaab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.665+0000 7f841cbb8700 1 -- 172.21.15.84:0/3347136918 >> 172.21.15.84:0/3347136918 conn(0x7f8418099830 msgr2=0x7f841806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:14.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.665+0000 7f841cbb8700 1 -- 172.21.15.84:0/3347136918 shutdown_connections 2023-10-06T03:24:14.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.665+0000 7f841cbb8700 1 -- 172.21.15.84:0/3347136918 wait complete. 2023-10-06T03:24:14.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.666+0000 7f841cbb8700 1 Processor -- start 2023-10-06T03:24:14.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.666+0000 7f841cbb8700 1 -- start start 2023-10-06T03:24:14.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f841cbb8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84180b07a0 0x7f841809ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f841cbb8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84180b49e0 0x7f841814a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f841cbb8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84181595a0 0x7f8418069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f841cbb8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841809a9c0 con 0x7f84181595a0 2023-10-06T03:24:14.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f841cbb8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841815ed20 con 0x7f84180b07a0 2023-10-06T03:24:14.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f841cbb8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841809a090 con 0x7f84180b49e0 2023-10-06T03:24:14.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f8416d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84181595a0 0x7f8418069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f8416d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84181595a0 0x7f8418069670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33748/0 (socket says 172.21.15.84:33748) 2023-10-06T03:24:14.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f8416d9d700 1 -- 172.21.15.84:0/47675606 learned_addr learned my addr 172.21.15.84:0/47675606 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:14.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f8415d9b700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84180b49e0 0x7f841814a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f841659c700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84180b07a0 0x7f841809ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f8416d9d700 1 -- 172.21.15.84:0/47675606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84180b49e0 msgr2=0x7f841814a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f8416d9d700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84180b49e0 0x7f841814a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f8416d9d700 1 -- 172.21.15.84:0/47675606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84180b07a0 msgr2=0x7f841809ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f8416d9d700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84180b07a0 0x7f841809ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f8416d9d700 1 -- 172.21.15.84:0/47675606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8408009a20 con 0x7f84181595a0 2023-10-06T03:24:14.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f841659c700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84180b07a0 0x7f841809ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:14.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.667+0000 7f8416d9d700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84181595a0 0x7f8418069670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8410001eb0 tx=0x7f8410007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:14.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.668+0000 7f840e7fc700 1 -- 172.21.15.84:0/47675606 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410005a70 con 0x7f84181595a0 2023-10-06T03:24:14.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.668+0000 7f840e7fc700 1 -- 172.21.15.84:0/47675606 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8410005bd0 con 0x7f84181595a0 2023-10-06T03:24:14.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.668+0000 7f841cbb8700 1 -- 172.21.15.84:0/47675606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84000094f0 con 0x7f84181595a0 2023-10-06T03:24:14.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.668+0000 7f840e7fc700 1 -- 172.21.15.84:0/47675606 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84100070d0 con 0x7f84181595a0 2023-10-06T03:24:14.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.668+0000 7f841cbb8700 1 -- 172.21.15.84:0/47675606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841809a650 con 0x7f84181595a0 2023-10-06T03:24:14.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.669+0000 7f841cbb8700 1 -- 172.21.15.84:0/47675606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8418064ad0 con 0x7f84181595a0 2023-10-06T03:24:14.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.669+0000 7f840e7fc700 1 -- 172.21.15.84:0/47675606 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8410007480 con 0x7f84181595a0 2023-10-06T03:24:14.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.669+0000 7f840e7fc700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83f8066f30 0x7f83f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.670+0000 7f841659c700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83f8066f30 0x7f83f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.670+0000 7f840e7fc700 1 -- 172.21.15.84:0/47675606 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8410083e10 con 0x7f84181595a0 2023-10-06T03:24:14.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.670+0000 7f841659c700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83f8066f30 0x7f83f80693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f84080099f0 tx=0x7f840800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:14.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.674+0000 7f840e7fc700 1 -- 172.21.15.84:0/47675606 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8410050c30 con 0x7f84181595a0 2023-10-06T03:24:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.858+0000 7f841cbb8700 1 -- 172.21.15.84:0/47675606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84180b1820 con 0x7f84181595a0 2023-10-06T03:24:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.859+0000 7f840e7fc700 1 -- 172.21.15.84:0/47675606 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f8410017020 con 0x7f84181595a0 2023-10-06T03:24:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:14.862 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 -- 172.21.15.84:0/47675606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83f8066f30 msgr2=0x7f83f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83f8066f30 0x7f83f80693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f84080099f0 tx=0x7f840800b040 comp rx=0 tx=0).stop 2023-10-06T03:24:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 -- 172.21.15.84:0/47675606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84181595a0 msgr2=0x7f8418069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84181595a0 0x7f8418069670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8410001eb0 tx=0x7f8410007d10 comp rx=0 tx=0).stop 2023-10-06T03:24:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 -- 172.21.15.84:0/47675606 shutdown_connections 2023-10-06T03:24:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83f8066f30 0x7f83f80693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84180b07a0 0x7f841809ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84181595a0 0x7f8418069670 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 --2- 172.21.15.84:0/47675606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84180b49e0 0x7f841814a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 -- 172.21.15.84:0/47675606 >> 172.21.15.84:0/47675606 conn(0x7f8418099830 msgr2=0x7f84181589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 -- 172.21.15.84:0/47675606 shutdown_connections 2023-10-06T03:24:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.861+0000 7f841cbb8700 1 -- 172.21.15.84:0/47675606 wait complete. 2023-10-06T03:24:14.876 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:14.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.988+0000 7fa383a8b700 1 Processor -- start 2023-10-06T03:24:14.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.988+0000 7fa383a8b700 1 -- start start 2023-10-06T03:24:14.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.989+0000 7fa383a8b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b49e0 0x7fa37c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.989+0000 7fa383a8b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa37c0b07a0 0x7fa37c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.989+0000 7fa383a8b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37c0b0ca0 con 0x7fa37c1595a0 2023-10-06T03:24:14.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.989+0000 7fa383a8b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37c0b0f80 con 0x7fa37c0b07a0 2023-10-06T03:24:14.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.989+0000 7fa383a8b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0b1260 con 0x7fa37c0b49e0 2023-10-06T03:24:14.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.989+0000 7fa381026700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b49e0 0x7fa37c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa382028700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa37c0b07a0 0x7fa37c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa381026700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b49e0 0x7fa37c0aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:47398/0 (socket says 172.21.15.84:47398) 2023-10-06T03:24:14.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa381026700 1 -- 172.21.15.84:0/731114081 learned_addr learned my addr 172.21.15.84:0/731114081 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:14.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa382028700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa37c0b07a0 0x7fa37c0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:54442/0 (socket says 172.21.15.84:54442) 2023-10-06T03:24:14.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa382028700 1 -- 172.21.15.84:0/731114081 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b49e0 msgr2=0x7fa37c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:14.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa382028700 1 --2- 172.21.15.84:0/731114081 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b49e0 0x7fa37c0aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa382028700 1 -- 172.21.15.84:0/731114081 >> v1:172.21.15.131:6789/0 conn(0x7fa37c1595a0 legacy=0x7fa37c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa382028700 1 -- 172.21.15.84:0/731114081 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c0b1540 con 0x7fa37c0b07a0 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa381026700 1 --2- 172.21.15.84:0/731114081 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b49e0 0x7fa37c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa382028700 1 --2- 172.21.15.84:0/731114081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0b07a0 0x7fa37c0b1c00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa374009e60 tx=0x7fa374009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43de66fe6cff0bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa380825700 1 -- 172.21.15.84:0/731114081 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400e070 con 0x7fa37c0b07a0 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa380825700 1 -- 172.21.15.84:0/731114081 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37400bb60 con 0x7fa37c0b07a0 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.990+0000 7fa380825700 1 -- 172.21.15.84:0/731114081 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374012430 con 0x7fa37c0b07a0 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.991+0000 7fa383a8b700 1 -- 172.21.15.84:0/731114081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0b07a0 msgr2=0x7fa37c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.991+0000 7fa383a8b700 1 --2- 172.21.15.84:0/731114081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0b07a0 0x7fa37c0b1c00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa374009e60 tx=0x7fa374009780 comp rx=0 tx=0).stop 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.991+0000 7fa383a8b700 1 -- 172.21.15.84:0/731114081 shutdown_connections 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.991+0000 7fa383a8b700 1 --2- 172.21.15.84:0/731114081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0b07a0 0x7fa37c0b1c00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.991+0000 7fa383a8b700 1 --2- 172.21.15.84:0/731114081 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b49e0 0x7fa37c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:14.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.991+0000 7fa383a8b700 1 -- 172.21.15.84:0/731114081 >> 172.21.15.84:0/731114081 conn(0x7fa37c099830 msgr2=0x7fa37c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:14.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.991+0000 7fa383a8b700 1 -- 172.21.15.84:0/731114081 shutdown_connections 2023-10-06T03:24:14.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.991+0000 7fa383a8b700 1 -- 172.21.15.84:0/731114081 wait complete. 2023-10-06T03:24:14.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.992+0000 7fa383a8b700 1 Processor -- start 2023-10-06T03:24:14.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.992+0000 7fa383a8b700 1 -- start start 2023-10-06T03:24:14.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa383a8b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b07a0 0x7fa37c157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa383a8b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0b49e0 0x7fa37c0aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa383a8b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37c1595a0 0x7fa37c0abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:14.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa383a8b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0aea30 con 0x7fa37c1595a0 2023-10-06T03:24:14.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa383a8b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0ade20 con 0x7fa37c0b49e0 2023-10-06T03:24:14.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa383a8b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0ae100 con 0x7fa37c0b07a0 2023-10-06T03:24:14.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa382028700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37c1595a0 0x7fa37c0abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa382028700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37c1595a0 0x7fa37c0abc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33758/0 (socket says 172.21.15.84:33758) 2023-10-06T03:24:14.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa382028700 1 -- 172.21.15.84:0/336845933 learned_addr learned my addr 172.21.15.84:0/336845933 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:14.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa381827700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b07a0 0x7fa37c157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa381026700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0b49e0 0x7fa37c0aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:14.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa382028700 1 -- 172.21.15.84:0/336845933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b07a0 msgr2=0x7fa37c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa382028700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b07a0 0x7fa37c157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa382028700 1 -- 172.21.15.84:0/336845933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0b49e0 msgr2=0x7fa37c0aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa382028700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0b49e0 0x7fa37c0aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa382028700 1 -- 172.21.15.84:0/336845933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c0094f0 con 0x7fa37c1595a0 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa382028700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37c1595a0 0x7fa37c0abc20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa37c067c60 tx=0x7fa374019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.993+0000 7fa371ffb700 1 -- 172.21.15.84:0/336845933 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374012ea0 con 0x7fa37c1595a0 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.994+0000 7fa371ffb700 1 -- 172.21.15.84:0/336845933 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa374027470 con 0x7fa37c1595a0 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.994+0000 7fa383a8b700 1 -- 172.21.15.84:0/336845933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa374009a20 con 0x7fa37c1595a0 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.994+0000 7fa371ffb700 1 -- 172.21.15.84:0/336845933 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374027850 con 0x7fa37c1595a0 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.994+0000 7fa383a8b700 1 -- 172.21.15.84:0/336845933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c0ae6c0 con 0x7fa37c1595a0 2023-10-06T03:24:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.995+0000 7fa383a8b700 1 -- 172.21.15.84:0/336845933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c0aeba0 con 0x7fa37c1595a0 2023-10-06T03:24:15.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.995+0000 7fa371ffb700 1 -- 172.21.15.84:0/336845933 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa374024070 con 0x7fa37c1595a0 2023-10-06T03:24:15.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.995+0000 7fa371ffb700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa360066f30 0x7fa3600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.995+0000 7fa371ffb700 1 -- 172.21.15.84:0/336845933 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa374087550 con 0x7fa37c1595a0 2023-10-06T03:24:15.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.996+0000 7fa381827700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa360066f30 0x7fa3600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:14.996+0000 7fa381827700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa360066f30 0x7fa3600693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa378003a20 tx=0x7fa378007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.000+0000 7fa371ffb700 1 -- 172.21.15.84:0/336845933 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3740542d0 con 0x7fa37c1595a0 2023-10-06T03:24:15.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.223+0000 7fa383a8b700 1 -- 172.21.15.84:0/336845933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa37c064ad0 con 0x7fa37c1595a0 2023-10-06T03:24:15.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.224+0000 7fa371ffb700 1 -- 172.21.15.84:0/336845933 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7fa3740578f0 con 0x7fa37c1595a0 2023-10-06T03:24:15.226 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:15.226 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:49.917332+0000","modified":"2023-10-06T03:24:03.584509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 -- 172.21.15.84:0/336845933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa360066f30 msgr2=0x7fa3600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa360066f30 0x7fa3600693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa378003a20 tx=0x7fa378007f10 comp rx=0 tx=0).stop 2023-10-06T03:24:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 -- 172.21.15.84:0/336845933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37c1595a0 msgr2=0x7fa37c0abc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37c1595a0 0x7fa37c0abc20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa37c067c60 tx=0x7fa374019000 comp rx=0 tx=0).stop 2023-10-06T03:24:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 -- 172.21.15.84:0/336845933 shutdown_connections 2023-10-06T03:24:15.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa360066f30 0x7fa3600693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37c1595a0 0x7fa37c0abc20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c0b07a0 0x7fa37c157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 --2- 172.21.15.84:0/336845933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0b49e0 0x7fa37c0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 -- 172.21.15.84:0/336845933 >> 172.21.15.84:0/336845933 conn(0x7fa37c099830 msgr2=0x7fa37c158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:15.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 -- 172.21.15.84:0/336845933 shutdown_connections 2023-10-06T03:24:15.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.226+0000 7fa383a8b700 1 -- 172.21.15.84:0/336845933 wait complete. 2023-10-06T03:24:15.229 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-10-06T03:24:15.642 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:23:49.917332+0000', 'modified': '2023-10-06T03:24:03.584509+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6835/3283560838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 3283560838}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 3283560838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:24:15.642 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:24:15.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T03:24:15.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.757+0000 7faa4ff38700 1 Processor -- start 2023-10-06T03:24:15.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.757+0000 7faa4ff38700 1 -- start start 2023-10-06T03:24:15.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.758+0000 7faa4ff38700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa481595a0 0x7faa480aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.758+0000 7faa4ff38700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa480b49e0 0x7faa480aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.758+0000 7faa4ff38700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa480b0ca0 con 0x7faa480b07a0 2023-10-06T03:24:15.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.758+0000 7faa4ff38700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa480b0f80 con 0x7faa480b49e0 2023-10-06T03:24:15.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.758+0000 7faa4ff38700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa480b1260 con 0x7faa481595a0 2023-10-06T03:24:15.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.758+0000 7faa4d4d3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa480b49e0 0x7faa480aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.758+0000 7faa4d4d3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa480b49e0 0x7faa480aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33762/0 (socket says 172.21.15.84:33762) 2023-10-06T03:24:15.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.758+0000 7faa4e4d5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faa480b07a0 0x7faa480b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53832/0 (socket says 172.21.15.84:53832) 2023-10-06T03:24:15.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.758+0000 7faa4d4d3700 1 -- 172.21.15.84:0/2216299706 learned_addr learned my addr 172.21.15.84:0/2216299706 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:15.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/2216299706 >> v2:172.21.15.131:3300/0 conn(0x7faa481595a0 0x7faa480aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4d4d3700 1 -- 172.21.15.84:0/2216299706 >> v2:172.21.15.131:3300/0 conn(0x7faa481595a0 msgr2=0x7faa480aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:15.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/2216299706 >> v2:172.21.15.131:3300/0 conn(0x7faa481595a0 0x7faa480aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4d4d3700 1 -- 172.21.15.84:0/2216299706 >> v1:172.21.15.84:6789/0 conn(0x7faa480b07a0 legacy=0x7faa480b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4d4d3700 1 -- 172.21.15.84:0/2216299706 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa480b1540 con 0x7faa480b49e0 2023-10-06T03:24:15.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/2216299706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b49e0 0x7faa480aaab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faa380099b0 tx=0x7faa38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd6a1616aa152fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4ccd2700 1 -- 172.21.15.84:0/2216299706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800b820 con 0x7faa480b49e0 2023-10-06T03:24:15.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4ccd2700 1 -- 172.21.15.84:0/2216299706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3800b980 con 0x7faa480b49e0 2023-10-06T03:24:15.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4ccd2700 1 -- 172.21.15.84:0/2216299706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800bd20 con 0x7faa480b49e0 2023-10-06T03:24:15.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4ff38700 1 -- 172.21.15.84:0/2216299706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b49e0 msgr2=0x7faa480aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4ff38700 1 --2- 172.21.15.84:0/2216299706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b49e0 0x7faa480aaab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faa380099b0 tx=0x7faa38009250 comp rx=0 tx=0).stop 2023-10-06T03:24:15.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4ff38700 1 -- 172.21.15.84:0/2216299706 shutdown_connections 2023-10-06T03:24:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4ff38700 1 --2- 172.21.15.84:0/2216299706 >> v2:172.21.15.131:3300/0 conn(0x7faa481595a0 0x7faa480aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4ff38700 1 --2- 172.21.15.84:0/2216299706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b49e0 0x7faa480aaab0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.759+0000 7faa4ff38700 1 -- 172.21.15.84:0/2216299706 >> 172.21.15.84:0/2216299706 conn(0x7faa48099830 msgr2=0x7faa4806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.760+0000 7faa4ff38700 1 -- 172.21.15.84:0/2216299706 shutdown_connections 2023-10-06T03:24:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.760+0000 7faa4ff38700 1 -- 172.21.15.84:0/2216299706 wait complete. 2023-10-06T03:24:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4ff38700 1 Processor -- start 2023-10-06T03:24:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4ff38700 1 -- start start 2023-10-06T03:24:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4ff38700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b07a0 0x7faa4814a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4ff38700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa480b49e0 0x7faa481599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4ff38700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa481595a0 0x7faa48159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4ff38700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4815b170 con 0x7faa480b07a0 2023-10-06T03:24:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4ff38700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa48157020 con 0x7faa481595a0 2023-10-06T03:24:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4ff38700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4815a560 con 0x7faa480b49e0 2023-10-06T03:24:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4dcd4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b07a0 0x7faa4814a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4dcd4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b07a0 0x7faa4814a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33766/0 (socket says 172.21.15.84:33766) 2023-10-06T03:24:15.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.761+0000 7faa4dcd4700 1 -- 172.21.15.84:0/1931136459 learned_addr learned my addr 172.21.15.84:0/1931136459 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:15.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa4dcd4700 1 -- 172.21.15.84:0/1931136459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa480b49e0 msgr2=0x7faa481599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa480b49e0 0x7faa481599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa4e4d5700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa481595a0 0x7faa48159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa480b49e0 0x7faa481599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa4dcd4700 1 -- 172.21.15.84:0/1931136459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa481595a0 msgr2=0x7faa48159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa481595a0 0x7faa48159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa4dcd4700 1 -- 172.21.15.84:0/1931136459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa380094f0 con 0x7faa480b07a0 2023-10-06T03:24:15.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b07a0 0x7faa4814a880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faa4400d840 tx=0x7faa44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa3dffb700 1 -- 172.21.15.84:0/1931136459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44014620 con 0x7faa480b07a0 2023-10-06T03:24:15.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa3dffb700 1 -- 172.21.15.84:0/1931136459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44014780 con 0x7faa480b07a0 2023-10-06T03:24:15.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa3dffb700 1 -- 172.21.15.84:0/1931136459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44014b40 con 0x7faa480b07a0 2023-10-06T03:24:15.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa4ff38700 1 -- 172.21.15.84:0/1931136459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4815a840 con 0x7faa480b07a0 2023-10-06T03:24:15.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.762+0000 7faa4ff38700 1 -- 172.21.15.84:0/1931136459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4815ae00 con 0x7faa480b07a0 2023-10-06T03:24:15.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.764+0000 7faa3dffb700 1 -- 172.21.15.84:0/1931136459 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa4401d400 con 0x7faa480b07a0 2023-10-06T03:24:15.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.764+0000 7faa3dffb700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa2c066f30 0x7faa2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.764+0000 7faa3dffb700 1 -- 172.21.15.84:0/1931136459 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7faa44085220 con 0x7faa480b07a0 2023-10-06T03:24:15.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.764+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa2c066f30 0x7faa2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.764+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa2c066f30 0x7faa2c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faa48088e20 tx=0x7faa38017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.766+0000 7faa59230b80 1 Processor -- start 2023-10-06T03:24:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.766+0000 7faa59230b80 1 -- start start 2023-10-06T03:24:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.766+0000 7faa59230b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4c840 0x5573d1c4cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.766+0000 7faa59230b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c4dcc0 0x5573d1c9c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.766+0000 7faa59230b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c9cc00 0x5573d1c9d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.766+0000 7faa59230b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d1ba3a70 con 0x5573d1c4c840 2023-10-06T03:24:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.766+0000 7faa59230b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d1ba1270 con 0x5573d1c4dcc0 2023-10-06T03:24:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.766+0000 7faa59230b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573d1b9d060 con 0x5573d1c9cc00 2023-10-06T03:24:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa4dcd4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4c840 0x5573d1c4cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa4dcd4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4c840 0x5573d1c4cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33770/0 (socket says 172.21.15.84:33770) 2023-10-06T03:24:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa4dcd4700 1 -- 172.21.15.84:0/1915693292 learned_addr learned my addr 172.21.15.84:0/1915693292 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa4dcd4700 1 -- 172.21.15.84:0/1915693292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c9cc00 msgr2=0x5573d1c9d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/1915693292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c9cc00 0x5573d1c9d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa4dcd4700 1 -- 172.21.15.84:0/1915693292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c4dcc0 msgr2=0x5573d1c9c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/1915693292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c4dcc0 0x5573d1c9c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa4dcd4700 1 -- 172.21.15.84:0/1915693292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573d1a37270 con 0x5573d1c4c840 2023-10-06T03:24:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/1915693292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4c840 0x5573d1c4cc10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faa440832c0 tx=0x7faa4405b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595cfa4268f1c0fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa2affd700 1 -- 172.21.15.84:0/1915693292 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44058f50 con 0x5573d1c4c840 2023-10-06T03:24:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa2affd700 1 -- 172.21.15.84:0/1915693292 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4405cca0 con 0x5573d1c4c840 2023-10-06T03:24:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.767+0000 7faa2affd700 1 -- 172.21.15.84:0/1915693292 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440540a0 con 0x5573d1c4c840 2023-10-06T03:24:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 -- 172.21.15.84:0/1915693292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4c840 msgr2=0x5573d1c4cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 --2- 172.21.15.84:0/1915693292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4c840 0x5573d1c4cc10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faa440832c0 tx=0x7faa4405b040 comp rx=0 tx=0).stop 2023-10-06T03:24:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 -- 172.21.15.84:0/1915693292 shutdown_connections 2023-10-06T03:24:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 --2- 172.21.15.84:0/1915693292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c9cc00 0x5573d1c9d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 --2- 172.21.15.84:0/1915693292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4c840 0x5573d1c4cc10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 --2- 172.21.15.84:0/1915693292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c4dcc0 0x5573d1c9c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 -- 172.21.15.84:0/1915693292 >> 172.21.15.84:0/1915693292 conn(0x5573d1c4e160 msgr2=0x5573d1c4e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 -- 172.21.15.84:0/1915693292 shutdown_connections 2023-10-06T03:24:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 -- 172.21.15.84:0/1915693292 wait complete. 2023-10-06T03:24:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 -- start start 2023-10-06T03:24:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.768+0000 7faa59230b80 1 Processor -- start 2023-10-06T03:24:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.769+0000 7faa59230b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c4c840 0x5573d1c8bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.769+0000 7faa59230b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c8aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.769+0000 7faa59230b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c9cc00 0x5573d1c8e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.769+0000 7faa59230b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d1b48890 con 0x5573d1c4dcc0 2023-10-06T03:24:15.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.769+0000 7faa59230b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d1b63ea0 con 0x5573d1c4c840 2023-10-06T03:24:15.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.769+0000 7faa59230b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573d1a1fe30 con 0x5573d1c9cc00 2023-10-06T03:24:15.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.769+0000 7faa59230b80 10 client.0 _ll_register_callbacks cb 0x5573d1c0fe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:24:15.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4d4d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c8aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4d4d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c8aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33788/0 (socket says 172.21.15.84:33788) 2023-10-06T03:24:15.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4d4d3700 1 -- 172.21.15.84:0/3997987283 learned_addr learned my addr 172.21.15.84:0/3997987283 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:15.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c4c840 0x5573d1c8bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4e4d5700 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c9cc00 0x5573d1c8e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4d4d3700 1 -- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c9cc00 msgr2=0x5573d1c8e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:15.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c9cc00 0x5573d1c8e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4d4d3700 1 -- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c4c840 msgr2=0x5573d1c8bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:15.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c4c840 0x5573d1c8bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4d4d3700 1 -- 172.21.15.84:0/3997987283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4815ae00 con 0x5573d1c4dcc0 2023-10-06T03:24:15.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c8aa10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faa48067c60 tx=0x7faa3801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cae0dd4bb6bbd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.770+0000 7faa23fff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:24:15.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.771+0000 7faa23fff700 1 -- 172.21.15.84:0/3997987283 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38006ab0 con 0x5573d1c4dcc0 2023-10-06T03:24:15.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa59230b80 1 -- 172.21.15.84:0/3997987283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573d1c41940 con 0x5573d1c4dcc0 2023-10-06T03:24:15.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa23fff700 1 -- 172.21.15.84:0/3997987283 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7faa3801c650 con 0x5573d1c4dcc0 2023-10-06T03:24:15.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa23fff700 1 -- 172.21.15.84:0/3997987283 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa38034bc0 con 0x5573d1c4dcc0 2023-10-06T03:24:15.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa59230b80 10 client.4800 fetch_fsmap learned FSMap version 8 2023-10-06T03:24:15.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa59230b80 1 -- 172.21.15.84:0/3997987283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5573d19d9fe0 con 0x5573d1c4dcc0 2023-10-06T03:24:15.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa23fff700 1 -- 172.21.15.84:0/3997987283 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5573d1c41940 con 0x5573d1c4dcc0 2023-10-06T03:24:15.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa23fff700 1 -- 172.21.15.84:0/3997987283 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 8) v1 ==== 3108+0+0 (secure 0 0 0) 0x7faa3802f020 con 0x5573d1c4dcc0 2023-10-06T03:24:15.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa59230b80 10 client.4800 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T03:24:15.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa59230b80 10 client.4800 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:24:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa59230b80 20 client.4800 populate_metadata read hostname 'smithi084' 2023-10-06T03:24:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa59230b80 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x5573d1ca3060 0x5573d1ca3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa59230b80 4 client.4800 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:24:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa59230b80 1 -- 172.21.15.84:0/3997987283 --> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573d1c1e870 con 0x5573d1ca3060 2023-10-06T03:24:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.772+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x5573d1ca3060 0x5573d1ca3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa23fff700 10 client.4800 ms_handle_connect on v2:172.21.15.131:6833/3283560838 2023-10-06T03:24:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x5573d1ca3060 0x5573d1ca3430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13c94b6739c6185e server_cookie=2282da10ef6a20f7 in_seq=0 out_seq=0 2023-10-06T03:24:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa23fff700 1 -- 172.21.15.84:0/3997987283 <== mds.0 v2:172.21.15.131:6833/3283560838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5573d1c1e870 con 0x5573d1ca3060 2023-10-06T03:24:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa23fff700 10 client.4800 handle_command_reply: tid=0 2023-10-06T03:24:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa59230b80 1 client.4800 shutdown 2023-10-06T03:24:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa59230b80 1 -- 172.21.15.84:0/3997987283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 msgr2=0x5573d1c8aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa59230b80 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c8aa10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faa48067c60 tx=0x7faa3801e040 comp rx=0 tx=0).stop 2023-10-06T03:24:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa59230b80 1 -- 172.21.15.84:0/3997987283 shutdown_connections 2023-10-06T03:24:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa59230b80 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x5573d1ca3060 0x5573d1ca3430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa59230b80 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c4c840 0x5573d1c8bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa23fff700 0 client.4800 ms_handle_reset on v2:172.21.15.131:6833/3283560838 2023-10-06T03:24:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.773+0000 7faa59230b80 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c9cc00 0x5573d1c8e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.774+0000 7faa59230b80 1 --2- 172.21.15.84:0/3997987283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c8aa10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.774+0000 7faa59230b80 1 -- 172.21.15.84:0/3997987283 >> 172.21.15.84:0/3997987283 conn(0x5573d1c4e160 msgr2=0x5573d1c49a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.774+0000 7faa59230b80 1 -- 172.21.15.84:0/3997987283 shutdown_connections 2023-10-06T03:24:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.774+0000 7faa59230b80 1 -- 172.21.15.84:0/3997987283 wait complete. 2023-10-06T03:24:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.774+0000 7faa59230b80 20 client.4800 trim_cache size 0 max 16384 2023-10-06T03:24:15.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.790+0000 7faa59230b80 1 Processor -- start 2023-10-06T03:24:15.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.790+0000 7faa59230b80 1 -- start start 2023-10-06T03:24:15.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa59230b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 0x5573d1c8d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa59230b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa59230b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 0x5573d1c7ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa59230b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d1c931c0 con 0x5573d1c4dcc0 2023-10-06T03:24:15.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa59230b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d1c8f240 con 0x5573d1c9cc00 2023-10-06T03:24:15.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa59230b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573d1c4d2b0 con 0x5573d1c4c840 2023-10-06T03:24:15.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4d4d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4d4d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33790/0 (socket says 172.21.15.84:33790) 2023-10-06T03:24:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4d4d3700 1 -- 172.21.15.84:0/1747242597 learned_addr learned my addr 172.21.15.84:0/1747242597 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 0x5573d1c8d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4d4d3700 1 -- 172.21.15.84:0/1747242597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 msgr2=0x5573d1c8d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4e4d5700 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 0x5573d1c7ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 0x5573d1c8d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4d4d3700 1 -- 172.21.15.84:0/1747242597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 msgr2=0x5573d1c7ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 0x5573d1c7ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4d4d3700 1 -- 172.21.15.84:0/1747242597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573d1b6b780 con 0x5573d1c4dcc0 2023-10-06T03:24:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 0x5573d1c8d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.791+0000 7faa4e4d5700 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 0x5573d1c7ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c010 tx=0x7faa3802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d842a87e9f812008 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa2b7fe700 1 -- 172.21.15.84:0/1747242597 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38034dc0 con 0x5573d1c4dcc0 2023-10-06T03:24:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa2b7fe700 1 -- 172.21.15.84:0/1747242597 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa38011420 con 0x5573d1c4dcc0 2023-10-06T03:24:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa2b7fe700 1 -- 172.21.15.84:0/1747242597 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3801ca20 con 0x5573d1c4dcc0 2023-10-06T03:24:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa59230b80 1 -- 172.21.15.84:0/1747242597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 msgr2=0x5573d1c7c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa59230b80 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c010 tx=0x7faa3802a000 comp rx=0 tx=0).stop 2023-10-06T03:24:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa59230b80 1 -- 172.21.15.84:0/1747242597 shutdown_connections 2023-10-06T03:24:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa59230b80 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 0x5573d1c7ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa59230b80 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 0x5573d1c8d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa59230b80 1 --2- 172.21.15.84:0/1747242597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa59230b80 1 -- 172.21.15.84:0/1747242597 >> 172.21.15.84:0/1747242597 conn(0x5573d1c4e160 msgr2=0x5573d1c4fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa59230b80 1 -- 172.21.15.84:0/1747242597 shutdown_connections 2023-10-06T03:24:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.792+0000 7faa59230b80 1 -- 172.21.15.84:0/1747242597 wait complete. 2023-10-06T03:24:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.793+0000 7faa59230b80 1 -- start start 2023-10-06T03:24:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.793+0000 7faa59230b80 1 Processor -- start 2023-10-06T03:24:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa59230b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 0x5573d1ca35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa59230b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa59230b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 0x5573d1c7ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa59230b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d1cfa4a0 con 0x5573d1c4dcc0 2023-10-06T03:24:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa59230b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d1cf9080 con 0x5573d1c9cc00 2023-10-06T03:24:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa59230b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573d1cf9ec0 con 0x5573d1c4c840 2023-10-06T03:24:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa59230b80 10 client.0 _ll_register_callbacks cb 0x5573d1c0fe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:24:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4d4d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4d4d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33802/0 (socket says 172.21.15.84:33802) 2023-10-06T03:24:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4d4d3700 1 -- 172.21.15.84:0/4086700843 learned_addr learned my addr 172.21.15.84:0/4086700843 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 0x5573d1ca35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4e4d5700 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 0x5573d1c7ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4d4d3700 1 -- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 msgr2=0x5573d1ca35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 0x5573d1ca35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4d4d3700 1 -- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 msgr2=0x5573d1c7ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 0x5573d1c7ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4d4d3700 1 -- 172.21.15.84:0/4086700843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5573d19d9fe0 con 0x5573d1c4dcc0 2023-10-06T03:24:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa4d4d3700 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa38040040 tx=0x7faa3801cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f39850a15d9b0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.794+0000 7faa23fff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:24:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa23fff700 1 -- 172.21.15.84:0/4086700843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38034dc0 con 0x5573d1c4dcc0 2023-10-06T03:24:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa23fff700 1 -- 172.21.15.84:0/4086700843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7faa3801a430 con 0x5573d1c4dcc0 2023-10-06T03:24:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa59230b80 1 -- 172.21.15.84:0/4086700843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa4405cca0 con 0x5573d1c4dcc0 2023-10-06T03:24:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa23fff700 1 -- 172.21.15.84:0/4086700843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa3801a800 con 0x5573d1c4dcc0 2023-10-06T03:24:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa59230b80 10 client.4806 fetch_fsmap learned FSMap version 8 2023-10-06T03:24:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa59230b80 1 -- 172.21.15.84:0/4086700843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5573d1b52470 con 0x5573d1c4dcc0 2023-10-06T03:24:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa23fff700 1 -- 172.21.15.84:0/4086700843 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4405cca0 con 0x5573d1c4dcc0 2023-10-06T03:24:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa23fff700 1 -- 172.21.15.84:0/4086700843 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 8) v1 ==== 3108+0+0 (secure 0 0 0) 0x7faa3802f070 con 0x5573d1c4dcc0 2023-10-06T03:24:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa59230b80 10 client.4806 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T03:24:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa59230b80 10 client.4806 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:24:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa59230b80 20 client.4806 populate_metadata read hostname 'smithi084' 2023-10-06T03:24:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa59230b80 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x5573d1c748a0 0x5573d1c74c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa59230b80 4 client.4806 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa59230b80 1 -- 172.21.15.84:0/4086700843 --> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5573d1b3fe00 con 0x5573d1c748a0 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.795+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x5573d1c748a0 0x5573d1c74c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa23fff700 10 client.4806 ms_handle_connect on v2:172.21.15.131:6833/3283560838 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa4dcd4700 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x5573d1c748a0 0x5573d1c74c70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e90ff6648f277 server_cookie=3804c40f21b557be in_seq=0 out_seq=0 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa23fff700 1 -- 172.21.15.84:0/4086700843 <== mds.0 v2:172.21.15.131:6833/3283560838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5573d1b3fe00 con 0x5573d1c748a0 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa23fff700 10 client.4806 handle_command_reply: tid=0 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 client.4806 shutdown 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 -- 172.21.15.84:0/4086700843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 msgr2=0x5573d1c7c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa38040040 tx=0x7faa3801cf90 comp rx=0 tx=0).stop 2023-10-06T03:24:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 -- 172.21.15.84:0/4086700843 shutdown_connections 2023-10-06T03:24:15.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:6833/3283560838,v1:172.21.15.131:6835/3283560838] conn(0x5573d1c748a0 0x5573d1c74c70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5573d1c9cc00 0x5573d1c7ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5573d1c4c840 0x5573d1ca35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 --2- 172.21.15.84:0/4086700843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573d1c4dcc0 0x5573d1c7c510 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa23fff700 0 client.4806 ms_handle_reset on v2:172.21.15.131:6833/3283560838 2023-10-06T03:24:15.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 -- 172.21.15.84:0/4086700843 >> 172.21.15.84:0/4086700843 conn(0x5573d1c4e160 msgr2=0x5573d1c49a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:15.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 -- 172.21.15.84:0/4086700843 shutdown_connections 2023-10-06T03:24:15.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 1 -- 172.21.15.84:0/4086700843 wait complete. 2023-10-06T03:24:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.796+0000 7faa59230b80 20 client.4806 trim_cache size 0 max 16384 2023-10-06T03:24:15.813 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:24:15.813 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:24:15.813 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:24:15.813 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4290, 2023-10-06T03:24:15.814 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:24:15.814 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:24:15.814 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:24:15.814 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 25.266898763, 2023-10-06T03:24:15.814 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 8, 2023-10-06T03:24:15.814 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 24, 2023-10-06T03:24:15.814 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 24, 2023-10-06T03:24:15.814 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 31.183574277000002 2023-10-06T03:24:15.815 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:24:15.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 -- 172.21.15.84:0/1931136459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa2c066f30 msgr2=0x7faa2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa2c066f30 0x7faa2c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faa48088e20 tx=0x7faa38017000 comp rx=0 tx=0).stop 2023-10-06T03:24:15.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 -- 172.21.15.84:0/1931136459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b07a0 msgr2=0x7faa4814a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b07a0 0x7faa4814a880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faa4400d840 tx=0x7faa44008040 comp rx=0 tx=0).stop 2023-10-06T03:24:15.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 -- 172.21.15.84:0/1931136459 shutdown_connections 2023-10-06T03:24:15.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa2c066f30 0x7faa2c0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa481595a0 0x7faa48159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa480b07a0 0x7faa4814a880 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 --2- 172.21.15.84:0/1931136459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa480b49e0 0x7faa481599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 -- 172.21.15.84:0/1931136459 >> 172.21.15.84:0/1931136459 conn(0x7faa48099830 msgr2=0x7faa48158930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:15.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 -- 172.21.15.84:0/1931136459 shutdown_connections 2023-10-06T03:24:15.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:15.797+0000 7faa4ff38700 1 -- 172.21.15.84:0/1931136459 wait complete. 2023-10-06T03:24:15.818 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T03:24:15.994 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T03:24:15.994 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T03:24:15.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:15.994 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:24:16.010 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T03:24:16.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T03:24:16.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.088 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-10-06T03:24:16.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.182 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:24:16.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.197 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-10-06T03:24:16.265 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2023-10-06T03:24:16.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:24:16.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.266 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:24:16.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.285 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2023-10-06T03:24:16.356 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2023-10-06T03:24:16.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:24:16.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.358 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:24:16.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.414 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2023-10-06T03:24:16.481 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2023-10-06T03:24:16.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:24:16.483 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-06T03:24:16.483 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:24:16.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.597+0000 7f753a345700 1 Processor -- start 2023-10-06T03:24:16.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.597+0000 7f753a345700 1 -- start start 2023-10-06T03:24:16.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f753a345700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75341407b0 0x7f753406d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:16.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f753a345700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7534140b80 0x7f75340aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:16.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f753a345700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340c6540 con 0x7f75340af200 2023-10-06T03:24:16.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f753a345700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340c6820 con 0x7f75341407b0 2023-10-06T03:24:16.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f753a345700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340c6b00 con 0x7f7534140b80 2023-10-06T03:24:16.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7539343700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75341407b0 0x7f753406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:16.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7539b44700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f75340af200 0x7f753415adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53836/0 (socket says 172.21.15.84:53836) 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7539b44700 1 -- 172.21.15.84:0/2651573312 learned_addr learned my addr 172.21.15.84:0/2651573312 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7538b42700 1 --2- 172.21.15.84:0/2651573312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7534140b80 0x7f75340aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7539343700 1 -- 172.21.15.84:0/2651573312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7534140b80 msgr2=0x7f75340aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7539343700 1 --2- 172.21.15.84:0/2651573312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7534140b80 0x7f75340aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7539343700 1 -- 172.21.15.84:0/2651573312 >> v1:172.21.15.84:6789/0 conn(0x7f75340af200 legacy=0x7f753415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7539343700 1 -- 172.21.15.84:0/2651573312 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340c6de0 con 0x7f75341407b0 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7539343700 1 --2- 172.21.15.84:0/2651573312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75341407b0 0x7f753406d250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7524009e60 tx=0x7f7524009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e2d7537bc45ffa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7533fff700 1 -- 172.21.15.84:0/2651573312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400e070 con 0x7f75341407b0 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.598+0000 7f7533fff700 1 -- 172.21.15.84:0/2651573312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400bc30 con 0x7f75341407b0 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.599+0000 7f7533fff700 1 -- 172.21.15.84:0/2651573312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524012430 con 0x7f75341407b0 2023-10-06T03:24:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.599+0000 7f753a345700 1 -- 172.21.15.84:0/2651573312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75341407b0 msgr2=0x7f753406d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.599+0000 7f753a345700 1 --2- 172.21.15.84:0/2651573312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75341407b0 0x7f753406d250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7524009e60 tx=0x7f7524009780 comp rx=0 tx=0).stop 2023-10-06T03:24:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.599+0000 7f753a345700 1 -- 172.21.15.84:0/2651573312 shutdown_connections 2023-10-06T03:24:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.599+0000 7f753a345700 1 --2- 172.21.15.84:0/2651573312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75341407b0 0x7f753406d250 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.599+0000 7f753a345700 1 --2- 172.21.15.84:0/2651573312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7534140b80 0x7f75340aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.599+0000 7f753a345700 1 -- 172.21.15.84:0/2651573312 >> 172.21.15.84:0/2651573312 conn(0x7f75340680c0 msgr2=0x7f75340cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.599+0000 7f753a345700 1 -- 172.21.15.84:0/2651573312 shutdown_connections 2023-10-06T03:24:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.599+0000 7f753a345700 1 -- 172.21.15.84:0/2651573312 wait complete. 2023-10-06T03:24:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.600+0000 7f753a345700 1 Processor -- start 2023-10-06T03:24:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.600+0000 7f753a345700 1 -- start start 2023-10-06T03:24:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f753a345700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340af200 0x7f753415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f753a345700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75341407b0 0x7f75341582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f753a345700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75340c5460 0x7f753416b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f753a345700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534168c90 con 0x7f75340af200 2023-10-06T03:24:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f753a345700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75341587f0 con 0x7f75341407b0 2023-10-06T03:24:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f753a345700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7534158a70 con 0x7f75340c5460 2023-10-06T03:24:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f7539343700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340af200 0x7f753415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f7539343700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340af200 0x7f753415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33816/0 (socket says 172.21.15.84:33816) 2023-10-06T03:24:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f7539343700 1 -- 172.21.15.84:0/512319355 learned_addr learned my addr 172.21.15.84:0/512319355 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f7539343700 1 -- 172.21.15.84:0/512319355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75340c5460 msgr2=0x7f753416b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f7538b42700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75341407b0 0x7f75341582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f7539b44700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75340c5460 0x7f753416b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f7539343700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75340c5460 0x7f753416b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f7539343700 1 -- 172.21.15.84:0/512319355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75341407b0 msgr2=0x7f75341582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f7539343700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75341407b0 0x7f75341582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.601+0000 7f7539343700 1 -- 172.21.15.84:0/512319355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524009a20 con 0x7f75340af200 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.602+0000 7f7539343700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340af200 0x7f753415a360 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7524013000 tx=0x7f7524019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.602+0000 7f75317fa700 1 -- 172.21.15.84:0/512319355 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524012e80 con 0x7f75340af200 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.602+0000 7f75317fa700 1 -- 172.21.15.84:0/512319355 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524027470 con 0x7f75340af200 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.602+0000 7f753a345700 1 -- 172.21.15.84:0/512319355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7534158d50 con 0x7f75340af200 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.602+0000 7f75317fa700 1 -- 172.21.15.84:0/512319355 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524027830 con 0x7f75340af200 2023-10-06T03:24:16.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.602+0000 7f753a345700 1 -- 172.21.15.84:0/512319355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7534159310 con 0x7f75340af200 2023-10-06T03:24:16.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.603+0000 7f753a345700 1 -- 172.21.15.84:0/512319355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753405f270 con 0x7f75340af200 2023-10-06T03:24:16.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.603+0000 7f75317fa700 1 -- 172.21.15.84:0/512319355 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7524024070 con 0x7f75340af200 2023-10-06T03:24:16.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.603+0000 7f75317fa700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7520066f30 0x7f75200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:16.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.604+0000 7f75317fa700 1 -- 172.21.15.84:0/512319355 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7524087450 con 0x7f75340af200 2023-10-06T03:24:16.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.604+0000 7f7538b42700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7520066f30 0x7f75200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:16.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.604+0000 7f7538b42700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7520066f30 0x7f75200693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f753415a8a0 tx=0x7f7528008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:16.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.608+0000 7f75317fa700 1 -- 172.21.15.84:0/512319355 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7524054270 con 0x7f75340af200 2023-10-06T03:24:16.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.835+0000 7f753a345700 1 -- 172.21.15.84:0/512319355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f75340c70c0 con 0x7f75340af200 2023-10-06T03:24:16.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.835+0000 7f75317fa700 1 -- 172.21.15.84:0/512319355 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7524057890 con 0x7f75340af200 2023-10-06T03:24:16.837 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:24:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 -- 172.21.15.84:0/512319355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7520066f30 msgr2=0x7f75200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7520066f30 0x7f75200693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f753415a8a0 tx=0x7f7528008040 comp rx=0 tx=0).stop 2023-10-06T03:24:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 -- 172.21.15.84:0/512319355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340af200 msgr2=0x7f753415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340af200 0x7f753415a360 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7524013000 tx=0x7f7524019000 comp rx=0 tx=0).stop 2023-10-06T03:24:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 -- 172.21.15.84:0/512319355 shutdown_connections 2023-10-06T03:24:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7520066f30 0x7f75200693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75340c5460 0x7f753416b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340af200 0x7f753415a360 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 --2- 172.21.15.84:0/512319355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75341407b0 0x7f75341582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 -- 172.21.15.84:0/512319355 >> 172.21.15.84:0/512319355 conn(0x7f75340680c0 msgr2=0x7f75340b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 -- 172.21.15.84:0/512319355 shutdown_connections 2023-10-06T03:24:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:16.837+0000 7f753a345700 1 -- 172.21.15.84:0/512319355 wait complete. 2023-10-06T03:24:16.850 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:24:16.851 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:24:16.851 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:24:16.851 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:24:16.851 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:24:16.851 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:24:16.851 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:24:16.851 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:24:16.851 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:24:16.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.852 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:24:16.866 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:16.866 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:16.867 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:16.868 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:24:16.868 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:16.868 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:24:16.868 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42498sec preferred_lft 42498sec 2023-10-06T03:24:16.868 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:24:16.868 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.868 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:24:16.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.869 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:24:16.869 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:24:16.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:24:16.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-10-06T03:24:16.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-10-06T03:24:16.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:24:16.869 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:24:16.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.976 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:24:17.000 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:24:17.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.001 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:24:17.059 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:24:17.059 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:24:17.059 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:24:17.059 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:24:17.059 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:24:17.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.060 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:24:17.060 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:24:17.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:24:17.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:24:17.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:24:17.060 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:24:17.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.160 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:24:17.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.175 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-10-06T03:24:17.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.230 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:24:17.230 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:24:17.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:24:17.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T03:24:17.230 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:24:17.318 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T03:24:17.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.318 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:24:17.318 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:24:17.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T03:24:17.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:24:17.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T03:24:17.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T03:24:17.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T03:24:17.319 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:24:17.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.495 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:24:17.495 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:24:17.495 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:24:17.495 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:24:17.495 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:24:17.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:17.587 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:24:17.601 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:24:17.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:17.601 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:24:17.656 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:24:17.656 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:24:17.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:17.736 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:17.736 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:17.843 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:17.844 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:17.844 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:24:17.844 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:24:17.844 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:24:17.844 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:24:17.844 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:24:17.844 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:24:17.867 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:17.867 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:17.867 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:24:17.867 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:24:17.867 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:24:17.867 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:24:17.867 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:24:17.867 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:24:17.867 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:24:17.868 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:24:17.868 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:24:17.870 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:24:17.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.870 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:24:17.935 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-06T03:24:17.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:24:18.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.089+0000 7f2d91219700 1 Processor -- start 2023-10-06T03:24:18.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.089+0000 7f2d91219700 1 -- start start 2023-10-06T03:24:18.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.090+0000 7f2d91219700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c15db50 0x7f2d8c0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:18.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.090+0000 7f2d91219700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2d8c0ad620 0x7f2d8c0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:18.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.090+0000 7f2d91219700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8c0ca640 con 0x7f2d8c0ad250 2023-10-06T03:24:18.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.090+0000 7f2d91219700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c0ced30 con 0x7f2d8c0ad620 2023-10-06T03:24:18.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.090+0000 7f2d91219700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0cf010 con 0x7f2d8c15db50 2023-10-06T03:24:18.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.090+0000 7f2d8b59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2d8c0ad620 0x7f2d8c0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:18.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.090+0000 7f2d8a59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c15db50 0x7f2d8c0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:18.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d8b59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2d8c0ad620 0x7f2d8c0ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:54526/0 (socket says 172.21.15.84:54526) 2023-10-06T03:24:18.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d8a59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c15db50 0x7f2d8c0cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:47468/0 (socket says 172.21.15.84:47468) 2023-10-06T03:24:18.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d8b59e700 1 -- 172.21.15.84:0/1175476707 learned_addr learned my addr 172.21.15.84:0/1175476707 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:18.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d8ad9d700 1 --1- 172.21.15.84:0/1175476707 >> v1:172.21.15.131:6789/0 conn(0x7f2d8c0ad250 0x7f2d8c15d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:42504/0 (socket says 172.21.15.84:42504) 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d89d9b700 1 -- 172.21.15.84:0/1175476707 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506129980 0 0) 0x7f2d8c0ca640 con 0x7f2d8c0ad250 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d8a59c700 1 -- 172.21.15.84:0/1175476707 >> v2:172.21.15.131:3300/0 conn(0x7f2d8c0ad620 msgr2=0x7f2d8c0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d8a59c700 1 --2- 172.21.15.84:0/1175476707 >> v2:172.21.15.131:3300/0 conn(0x7f2d8c0ad620 0x7f2d8c0ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d8a59c700 1 -- 172.21.15.84:0/1175476707 >> v1:172.21.15.131:6789/0 conn(0x7f2d8c0ad250 legacy=0x7f2d8c15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d8a59c700 1 -- 172.21.15.84:0/1175476707 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0ccad0 con 0x7f2d8c15db50 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d8a59c700 1 --2- 172.21.15.84:0/1175476707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c15db50 0x7f2d8c0cd2d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d800098e0 tx=0x7f2d800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c44422259a7459 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d89d9b700 1 -- 172.21.15.84:0/1175476707 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8000b640 con 0x7f2d8c15db50 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d89d9b700 1 -- 172.21.15.84:0/1175476707 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8000b7a0 con 0x7f2d8c15db50 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.091+0000 7f2d89d9b700 1 -- 172.21.15.84:0/1175476707 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8000bb40 con 0x7f2d8c15db50 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.092+0000 7f2d91219700 1 -- 172.21.15.84:0/1175476707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c15db50 msgr2=0x7f2d8c0cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.092+0000 7f2d91219700 1 --2- 172.21.15.84:0/1175476707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c15db50 0x7f2d8c0cd2d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d800098e0 tx=0x7f2d800091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.092+0000 7f2d91219700 1 -- 172.21.15.84:0/1175476707 shutdown_connections 2023-10-06T03:24:18.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.092+0000 7f2d91219700 1 --2- 172.21.15.84:0/1175476707 >> v2:172.21.15.131:3300/0 conn(0x7f2d8c0ad620 0x7f2d8c0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:18.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.092+0000 7f2d91219700 1 --2- 172.21.15.84:0/1175476707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c15db50 0x7f2d8c0cd2d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:18.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.092+0000 7f2d91219700 1 -- 172.21.15.84:0/1175476707 >> 172.21.15.84:0/1175476707 conn(0x7f2d8c067dd0 msgr2=0x7f2d8c0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:18.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.092+0000 7f2d91219700 1 -- 172.21.15.84:0/1175476707 shutdown_connections 2023-10-06T03:24:18.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.092+0000 7f2d91219700 1 -- 172.21.15.84:0/1175476707 wait complete. 2023-10-06T03:24:18.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.093+0000 7f2d91219700 1 Processor -- start 2023-10-06T03:24:18.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.093+0000 7f2d91219700 1 -- start start 2023-10-06T03:24:18.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d91219700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c0ad250 0x7f2d8c0c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:18.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d91219700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d8c0ad620 0x7f2d8c16a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:18.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d91219700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d8c15db50 0x7f2d8c15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:18.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d91219700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c1680b0 con 0x7f2d8c0ad620 2023-10-06T03:24:18.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d91219700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c16a940 con 0x7f2d8c15db50 2023-10-06T03:24:18.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d91219700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c16ac20 con 0x7f2d8c0ad250 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d8c0ad620 0x7f2d8c16a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d8c0ad620 0x7f2d8c16a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33822/0 (socket says 172.21.15.84:33822) 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8a59c700 1 -- 172.21.15.84:0/76963114 learned_addr learned my addr 172.21.15.84:0/76963114 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8ad9d700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c0ad250 0x7f2d8c0c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8b59e700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d8c15db50 0x7f2d8c15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8a59c700 1 -- 172.21.15.84:0/76963114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c0ad250 msgr2=0x7f2d8c0c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8a59c700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c0ad250 0x7f2d8c0c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8a59c700 1 -- 172.21.15.84:0/76963114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d8c15db50 msgr2=0x7f2d8c15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8a59c700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d8c15db50 0x7f2d8c15abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8a59c700 1 -- 172.21.15.84:0/76963114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d80009420 con 0x7f2d8c0ad620 2023-10-06T03:24:18.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d8a59c700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d8c0ad620 0x7f2d8c16a080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d80013000 tx=0x7f2d80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d72ffd700 1 -- 172.21.15.84:0/76963114 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8000b910 con 0x7f2d8c0ad620 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d72ffd700 1 -- 172.21.15.84:0/76963114 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8000ba70 con 0x7f2d8c0ad620 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d91219700 1 -- 172.21.15.84:0/76963114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c16af00 con 0x7f2d8c0ad620 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d72ffd700 1 -- 172.21.15.84:0/76963114 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80011670 con 0x7f2d8c0ad620 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.094+0000 7f2d91219700 1 -- 172.21.15.84:0/76963114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c16a5c0 con 0x7f2d8c0ad620 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.095+0000 7f2d91219700 1 -- 172.21.15.84:0/76963114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c168220 con 0x7f2d8c0ad620 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.096+0000 7f2d72ffd700 1 -- 172.21.15.84:0/76963114 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d80011a60 con 0x7f2d8c0ad620 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.096+0000 7f2d72ffd700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d78066f30 0x7f2d780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.096+0000 7f2d72ffd700 1 -- 172.21.15.84:0/76963114 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2d800860b0 con 0x7f2d8c0ad620 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.096+0000 7f2d8ad9d700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d78066f30 0x7f2d780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.097+0000 7f2d8ad9d700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d78066f30 0x7f2d780693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0022a0 tx=0x7f2d7c001a90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:18.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.100+0000 7f2d72ffd700 1 -- 172.21.15.84:0/76963114 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d80052ed0 con 0x7f2d8c0ad620 2023-10-06T03:24:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.329+0000 7f2d91219700 1 -- 172.21.15.84:0/76963114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d8c064ad0 con 0x7f2d8c0ad620 2023-10-06T03:24:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.329+0000 7f2d72ffd700 1 -- 172.21.15.84:0/76963114 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2d800564f0 con 0x7f2d8c0ad620 2023-10-06T03:24:18.331 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:24:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 -- 172.21.15.84:0/76963114 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d78066f30 msgr2=0x7f2d780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d78066f30 0x7f2d780693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0022a0 tx=0x7f2d7c001a90 comp rx=0 tx=0).stop 2023-10-06T03:24:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 -- 172.21.15.84:0/76963114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d8c0ad620 msgr2=0x7f2d8c16a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d8c0ad620 0x7f2d8c16a080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d80013000 tx=0x7f2d80017000 comp rx=0 tx=0).stop 2023-10-06T03:24:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 -- 172.21.15.84:0/76963114 shutdown_connections 2023-10-06T03:24:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2d78066f30 0x7f2d780693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d8c15db50 0x7f2d8c15abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d8c0ad250 0x7f2d8c0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 --2- 172.21.15.84:0/76963114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d8c0ad620 0x7f2d8c16a080 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 -- 172.21.15.84:0/76963114 >> 172.21.15.84:0/76963114 conn(0x7f2d8c067dd0 msgr2=0x7f2d8c0ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 -- 172.21.15.84:0/76963114 shutdown_connections 2023-10-06T03:24:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:18.331+0000 7f2d91219700 1 -- 172.21.15.84:0/76963114 wait complete. 2023-10-06T03:24:18.345 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:24:18.345 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:24:18.345 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:24:18.345 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T03:24:18.345 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T03:24:18.345 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:24:18.346 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:24:18.346 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:24:18.346 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:24:18.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.346 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:24:18.361 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:18.361 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:18.361 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:18.362 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.362 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:18.362 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.362 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:18.362 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:18.363 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:24:18.363 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:18.363 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:18.363 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:24:18.363 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:18.364 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:18.364 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:24:18.364 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:18.364 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:24:18.364 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42496sec preferred_lft 42496sec 2023-10-06T03:24:18.364 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:24:18.364 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.365 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:18.365 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:18.365 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:24:18.365 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.365 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9c01:bbff:fec1:72ce/64 scope link tentative 2023-10-06T03:24:18.365 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.365 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:24:18.366 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:24:18.366 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::74a6:25ff:fe2a:c673/64 scope link tentative 2023-10-06T03:24:18.366 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.366 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:24:18.424 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:24:18.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.426 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:24:18.481 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:24:18.481 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:24:18.481 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:24:18.481 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:24:18.482 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:24:18.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.482 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:24:18.482 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:24:18.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:24:18.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:24:18.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:24:18.482 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:24:18.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.585 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:24:18.599 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:24:18.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.600 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-10-06T03:24:18.654 INFO:teuthology.orchestra.run.smithi084.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T03:24:18.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.654 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:24:18.654 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:24:18.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:24:18.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T03:24:18.655 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:24:18.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.743 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T03:24:18.774 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:18.774 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:18.775 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:18.775 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.775 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:18.775 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.775 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:18.775 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether a2:60:b7:ff:48:ba brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:24:18.775 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:24:18.775 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.775 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::a060:b7ff:feff:48ba/64 scope link tentative 2023-10-06T03:24:18.775 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T03:24:18.864 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether a2:60:b7:ff:48:ba brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::a060:b7ff:feff:48ba/64 scope link tentative 2023-10-06T03:24:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:18.879 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T03:24:18.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.880 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:24:18.880 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:24:18.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T03:24:18.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T03:24:18.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T03:24:18.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T03:24:18.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T03:24:18.880 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:24:19.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:19.095 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:24:19.096 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:24:19.096 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.1 up 2023-10-06T03:24:19.096 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T03:24:19.096 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:24:19.175 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:19.175 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T03:24:19.189 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:24:19.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:19.190 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:24:19.244 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-06T03:24:19.244 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:24:19.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:19.324 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:19.324 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:19.343 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:19.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:19.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:24:19.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 2@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:24:19.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:24:19.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:24:19.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:24:19.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:24:19.366 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:19.367 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:19.367 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:24:19.367 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 2@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:24:19.367 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:24:19.367 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:24:19.367 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:24:19.367 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:24:19.367 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:24:19.367 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:24:19.367 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:24:19.369 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:24:19.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:19.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:24:19.433 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-06T03:24:19.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:24:19.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.586+0000 7f8d46bc0700 1 Processor -- start 2023-10-06T03:24:19.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.586+0000 7f8d46bc0700 1 -- start start 2023-10-06T03:24:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.587+0000 7f8d46bc0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8d40157640 0x7f8d4006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.587+0000 7f8d46bc0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4006bd00 con 0x7f8d400ca980 2023-10-06T03:24:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.587+0000 7f8d46bc0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d400ca730 con 0x7f8d40067d00 2023-10-06T03:24:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.587+0000 7f8d46bc0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4006ed10 con 0x7f8d40157640 2023-10-06T03:24:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.587+0000 7f8d37fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8d400ca980 0x7f8d400675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53842/0 (socket says 172.21.15.84:53842) 2023-10-06T03:24:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.587+0000 7f8d37fff700 1 -- 172.21.15.84:0/3929833676 learned_addr learned my addr 172.21.15.84:0/3929833676 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953872225 0 0) 0x7f8d4006bd00 con 0x7f8d400ca980 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d28003570 con 0x7f8d400ca980 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 420326655 0 0) 0x7f8d28003570 con 0x7f8d400ca980 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d4495c700 1 --2- 172.21.15.84:0/3929833676 >> v2:172.21.15.131:3300/0 conn(0x7f8d40157640 0x7f8d4006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 >> v2:172.21.15.131:3300/0 conn(0x7f8d40157640 msgr2=0x7f8d4006e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 --2- 172.21.15.84:0/3929833676 >> v2:172.21.15.131:3300/0 conn(0x7f8d40157640 0x7f8d4006e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 >> v1:172.21.15.131:6789/0 conn(0x7f8d40067d00 legacy=0x7f8d4006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4006eff0 con 0x7f8d400ca980 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f8d30001470 con 0x7f8d400ca980 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 >> v1:172.21.15.84:6789/0 conn(0x7f8d400ca980 legacy=0x7f8d400675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 --2- 172.21.15.84:0/3929833676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d28003a60 0x7f8d28003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 --2- 172.21.15.84:0/3929833676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d28004810 0x7f8d28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 --2- 172.21.15.84:0/3929833676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d280052e0 0x7f8d2800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4006ed10 con 0x7f8d280052e0 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2800c260 con 0x7f8d28004810 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2800c420 con 0x7f8d28003a60 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d4495c700 1 --2- 172.21.15.84:0/3929833676 >> v2:172.21.15.131:3300/0 conn(0x7f8d40157640 0x7f8d4006e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d4515d700 1 --2- 172.21.15.84:0/3929833676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d280052e0 0x7f8d2800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d4495c700 1 --2- 172.21.15.84:0/3929833676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d28003a60 0x7f8d28003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d4515d700 1 -- 172.21.15.84:0/3929833676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d28003a60 msgr2=0x7f8d28003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d4515d700 1 --2- 172.21.15.84:0/3929833676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d28003a60 0x7f8d28003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d4515d700 1 -- 172.21.15.84:0/3929833676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d28004810 msgr2=0x7f8d28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d4515d700 1 --2- 172.21.15.84:0/3929833676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d28004810 0x7f8d28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d4515d700 1 -- 172.21.15.84:0/3929833676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d28003570 con 0x7f8d280052e0 2023-10-06T03:24:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.588+0000 7f8d4515d700 1 -- 172.21.15.84:0/3929833676 reap_dead start 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d4515d700 1 --2- 172.21.15.84:0/3929833676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d280052e0 0x7f8d2800ba60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d380019a0 tx=0x7f8d38007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a8755e14c7274 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800c5d0 con 0x7f8d280052e0 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3800c730 con 0x7f8d280052e0 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d377fe700 1 -- 172.21.15.84:0/3929833676 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800cad0 con 0x7f8d280052e0 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d46bc0700 1 -- 172.21.15.84:0/3929833676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d280052e0 msgr2=0x7f8d2800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d46bc0700 1 --2- 172.21.15.84:0/3929833676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d280052e0 0x7f8d2800ba60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d380019a0 tx=0x7f8d38007d10 comp rx=0 tx=0).stop 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d46bc0700 1 -- 172.21.15.84:0/3929833676 shutdown_connections 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d46bc0700 1 --2- 172.21.15.84:0/3929833676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d280052e0 0x7f8d2800ba60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d46bc0700 1 -- 172.21.15.84:0/3929833676 >> 172.21.15.84:0/3929833676 conn(0x7f8d400cdef0 msgr2=0x7f8d400c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d46bc0700 1 -- 172.21.15.84:0/3929833676 shutdown_connections 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.589+0000 7f8d46bc0700 1 -- 172.21.15.84:0/3929833676 wait complete. 2023-10-06T03:24:19.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.590+0000 7f8d46bc0700 1 Processor -- start 2023-10-06T03:24:19.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.591+0000 7f8d46bc0700 1 -- start start 2023-10-06T03:24:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.591+0000 7f8d46bc0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d280052e0 0x7f8d400c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.591+0000 7f8d46bc0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d4015bc80 0x7f8d40154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.591+0000 7f8d46bc0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d400b13a0 0x7f8d400b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.591+0000 7f8d46bc0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400b1d80 con 0x7f8d400b13a0 2023-10-06T03:24:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.591+0000 7f8d46bc0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d40167730 con 0x7f8d4015bc80 2023-10-06T03:24:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.591+0000 7f8d46bc0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400c70e0 con 0x7f8d280052e0 2023-10-06T03:24:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.591+0000 7f8d4515d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d400b13a0 0x7f8d400b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.591+0000 7f8d4515d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d400b13a0 0x7f8d400b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33850/0 (socket says 172.21.15.84:33850) 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.591+0000 7f8d4515d700 1 -- 172.21.15.84:0/1845994021 learned_addr learned my addr 172.21.15.84:0/1845994021 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d4495c700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d280052e0 0x7f8d400c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d4515d700 1 -- 172.21.15.84:0/1845994021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d280052e0 msgr2=0x7f8d400c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d4515d700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d280052e0 0x7f8d400c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d4515d700 1 -- 172.21.15.84:0/1845994021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d4015bc80 msgr2=0x7f8d40154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d4515d700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d4015bc80 0x7f8d40154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d4515d700 1 -- 172.21.15.84:0/1845994021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d400c73c0 con 0x7f8d400b13a0 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d4495c700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d280052e0 0x7f8d400c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d4515d700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d400b13a0 0x7f8d400b1840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8d400b3420 tx=0x7f8d38015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d34ff9700 1 -- 172.21.15.84:0/1845994021 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800c5d0 con 0x7f8d400b13a0 2023-10-06T03:24:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d34ff9700 1 -- 172.21.15.84:0/1845994021 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3800cab0 con 0x7f8d400b13a0 2023-10-06T03:24:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d46bc0700 1 -- 172.21.15.84:0/1845994021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d400c76a0 con 0x7f8d400b13a0 2023-10-06T03:24:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d34ff9700 1 -- 172.21.15.84:0/1845994021 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38006a50 con 0x7f8d400b13a0 2023-10-06T03:24:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.592+0000 7f8d46bc0700 1 -- 172.21.15.84:0/1845994021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d400c6dd0 con 0x7f8d400b13a0 2023-10-06T03:24:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.593+0000 7f8d46bc0700 1 -- 172.21.15.84:0/1845994021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d40064ad0 con 0x7f8d400b13a0 2023-10-06T03:24:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.593+0000 7f8d34ff9700 1 -- 172.21.15.84:0/1845994021 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d38019050 con 0x7f8d400b13a0 2023-10-06T03:24:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.594+0000 7f8d34ff9700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d2c066f30 0x7f8d2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.594+0000 7f8d34ff9700 1 -- 172.21.15.84:0/1845994021 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8d38084da0 con 0x7f8d400b13a0 2023-10-06T03:24:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.594+0000 7f8d4495c700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d2c066f30 0x7f8d2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.594+0000 7f8d4495c700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d2c066f30 0x7f8d2c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00a480 tx=0x7f8d3c007610 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.598+0000 7f8d34ff9700 1 -- 172.21.15.84:0/1845994021 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d38051bc0 con 0x7f8d400b13a0 2023-10-06T03:24:19.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.824+0000 7f8d46bc0700 1 -- 172.21.15.84:0/1845994021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d4006f2d0 con 0x7f8d400b13a0 2023-10-06T03:24:19.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.825+0000 7f8d34ff9700 1 -- 172.21.15.84:0/1845994021 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8d38021020 con 0x7f8d400b13a0 2023-10-06T03:24:19.827 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:24:19.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 -- 172.21.15.84:0/1845994021 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d2c066f30 msgr2=0x7f8d2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d2c066f30 0x7f8d2c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00a480 tx=0x7f8d3c007610 comp rx=0 tx=0).stop 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 -- 172.21.15.84:0/1845994021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d400b13a0 msgr2=0x7f8d400b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d400b13a0 0x7f8d400b1840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8d400b3420 tx=0x7f8d38015000 comp rx=0 tx=0).stop 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 -- 172.21.15.84:0/1845994021 shutdown_connections 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d2c066f30 0x7f8d2c0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d400b13a0 0x7f8d400b1840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d280052e0 0x7f8d400c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 --2- 172.21.15.84:0/1845994021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d4015bc80 0x7f8d40154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 -- 172.21.15.84:0/1845994021 >> 172.21.15.84:0/1845994021 conn(0x7f8d400cdef0 msgr2=0x7f8d40156690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 -- 172.21.15.84:0/1845994021 shutdown_connections 2023-10-06T03:24:19.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:19.827+0000 7f8d46bc0700 1 -- 172.21.15.84:0/1845994021 wait complete. 2023-10-06T03:24:19.840 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:24:19.840 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:24:19.841 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T03:24:19.841 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:24:19.841 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:24:19.841 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:24:19.841 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:24:19.841 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:24:19.841 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:24:19.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:19.842 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T03:24:19.859 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T03:24:19.860 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:19.861 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:24:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:24:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42493sec preferred_lft 42493sec 2023-10-06T03:24:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T03:24:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:19.861 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:24:19.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:19.861 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:24:19.862 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:24:19.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:24:19.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2023-10-06T03:24:19.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2023-10-06T03:24:19.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:24:19.862 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:24:20.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.039 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:24:20.080 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T03:24:20.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.081 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T03:24:20.181 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T03:24:20.181 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:24:20.181 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:24:20.182 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:24:20.182 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:24:20.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.182 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:24:20.182 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:24:20.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:24:20.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:24:20.183 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:24:20.183 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:24:20.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.387 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:24:20.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.401 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2023-10-06T03:24:20.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.455 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:24:20.455 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:24:20.455 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:24:20.455 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T03:24:20.455 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:24:20.544 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T03:24:20.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.545 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:24:20.545 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:24:20.545 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T03:24:20.545 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:24:20.545 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T03:24:20.545 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T03:24:20.546 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T03:24:20.546 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:24:20.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.733 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:24:20.733 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:24:20.733 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-10-06T03:24:20.733 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:24:20.733 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:24:20.824 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:20.825 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:24:20.839 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:24:20.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:20.839 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:24:20.894 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T03:24:20.895 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:24:20.895 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:21.013 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:21.014 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:21.100 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:21.100 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:21.100 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:24:21.100 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:24:21.100 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:24:21.100 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:24:21.100 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:24:21.101 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:24:21.121 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:21.121 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:21.121 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:24:21.121 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:24:21.121 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:24:21.122 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:24:21.122 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:24:21.122 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:24:21.122 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:24:21.122 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:24:21.122 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:24:21.123 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:24:21.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.124 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:24:21.148 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-06T03:24:21.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:24:21.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.272+0000 7fbda78bc700 1 Processor -- start 2023-10-06T03:24:21.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.273+0000 7fbda78bc700 1 -- start start 2023-10-06T03:24:21.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.273+0000 7fbda78bc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbda0159b10 0x7fbda0159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:21.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.273+0000 7fbda78bc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda00caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:21.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.273+0000 7fbda78bc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda0068d50 con 0x7fbda00cb630 2023-10-06T03:24:21.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.273+0000 7fbda78bc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda015a4d0 con 0x7fbda0159b10 2023-10-06T03:24:21.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.273+0000 7fbda78bc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda0154060 con 0x7fbda00ca6b0 2023-10-06T03:24:21.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbda4e57700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbda0159b10 0x7fbda0159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:21.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbda5658700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fbda00cb630 0x7fbda00691e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:37736/0 (socket says 172.21.15.84:37736) 2023-10-06T03:24:21.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbda5e59700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda00caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:21.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbda5658700 1 -- 172.21.15.84:0/2496722843 learned_addr learned my addr 172.21.15.84:0/2496722843 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:21.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbda4e57700 1 -- 172.21.15.84:0/2496722843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 msgr2=0x7fbda00caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:21.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbda4e57700 1 --2- 172.21.15.84:0/2496722843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda00caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbda4e57700 1 -- 172.21.15.84:0/2496722843 >> v1:172.21.15.131:6789/0 conn(0x7fbda00cb630 legacy=0x7fbda00691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:21.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbda4e57700 1 -- 172.21.15.84:0/2496722843 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda015a6b0 con 0x7fbda0159b10 2023-10-06T03:24:21.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbd9ffff700 1 -- 172.21.15.84:0/2496722843 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160337320 0 0) 0x7fbda0068d50 con 0x7fbda00cb630 2023-10-06T03:24:21.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbda5e59700 1 --2- 172.21.15.84:0/2496722843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda00caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:21.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbda4e57700 1 --2- 172.21.15.84:0/2496722843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda0159b10 0x7fbda0159f90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009910 tx=0x7fbd940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7746c739b2a43d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:21.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbd9ffff700 1 -- 172.21.15.84:0/2496722843 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400b640 con 0x7fbda0159b10 2023-10-06T03:24:21.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbd9ffff700 1 -- 172.21.15.84:0/2496722843 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9400b7a0 con 0x7fbda0159b10 2023-10-06T03:24:21.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.274+0000 7fbd9ffff700 1 -- 172.21.15.84:0/2496722843 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400bb60 con 0x7fbda0159b10 2023-10-06T03:24:21.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.275+0000 7fbda78bc700 1 -- 172.21.15.84:0/2496722843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda0159b10 msgr2=0x7fbda0159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:21.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.275+0000 7fbda78bc700 1 --2- 172.21.15.84:0/2496722843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda0159b10 0x7fbda0159f90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009910 tx=0x7fbd940091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.275+0000 7fbda78bc700 1 -- 172.21.15.84:0/2496722843 shutdown_connections 2023-10-06T03:24:21.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.275+0000 7fbda78bc700 1 --2- 172.21.15.84:0/2496722843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda00caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.275+0000 7fbda78bc700 1 --2- 172.21.15.84:0/2496722843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda0159b10 0x7fbda0159f90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.275+0000 7fbda78bc700 1 -- 172.21.15.84:0/2496722843 >> 172.21.15.84:0/2496722843 conn(0x7fbda0070810 msgr2=0x7fbda0070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.275+0000 7fbda78bc700 1 -- 172.21.15.84:0/2496722843 shutdown_connections 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.275+0000 7fbda78bc700 1 -- 172.21.15.84:0/2496722843 wait complete. 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.276+0000 7fbda78bc700 1 Processor -- start 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.276+0000 7fbda78bc700 1 -- start start 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda78bc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda01520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda78bc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda00cb630 0x7fbda00c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda78bc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda0159b10 0x7fbda0155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda78bc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda0156ff0 con 0x7fbda0159b10 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda78bc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda00b1e00 con 0x7fbda00cb630 2023-10-06T03:24:21.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda78bc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda00b11f0 con 0x7fbda00ca6b0 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda5e59700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda0159b10 0x7fbda0155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda5658700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda01520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda5e59700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda0159b10 0x7fbda0155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45998/0 (socket says 172.21.15.84:45998) 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda5658700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda01520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:49732/0 (socket says 172.21.15.84:49732) 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda5e59700 1 -- 172.21.15.84:0/2420276796 learned_addr learned my addr 172.21.15.84:0/2420276796 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.277+0000 7fbda4e57700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda00cb630 0x7fbda00c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbda5e59700 1 -- 172.21.15.84:0/2420276796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 msgr2=0x7fbda01520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbda5e59700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda01520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbda5e59700 1 -- 172.21.15.84:0/2420276796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda00cb630 msgr2=0x7fbda00c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbda5e59700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda00cb630 0x7fbda00c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbda5e59700 1 -- 172.21.15.84:0/2420276796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd98009420 con 0x7fbda0159b10 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbda5658700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda01520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbda4e57700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda00cb630 0x7fbda00c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbda5e59700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda0159b10 0x7fbda0155c90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800ec80 tx=0x7fbd980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbd9d7fa700 1 -- 172.21.15.84:0/2420276796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98009720 con 0x7fbda0159b10 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbd9d7fa700 1 -- 172.21.15.84:0/2420276796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9800c850 con 0x7fbda0159b10 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbda78bc700 1 -- 172.21.15.84:0/2420276796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd94009420 con 0x7fbda0159b10 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbd9d7fa700 1 -- 172.21.15.84:0/2420276796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800cc10 con 0x7fbda0159b10 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.278+0000 7fbda78bc700 1 -- 172.21.15.84:0/2420276796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda00b17b0 con 0x7fbda0159b10 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.279+0000 7fbda78bc700 1 -- 172.21.15.84:0/2420276796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda00b1f70 con 0x7fbda0159b10 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.279+0000 7fbd9d7fa700 1 -- 172.21.15.84:0/2420276796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd98013470 con 0x7fbda0159b10 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.280+0000 7fbd9d7fa700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd8c066f30 0x7fbd8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:21.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.280+0000 7fbd9d7fa700 1 -- 172.21.15.84:0/2420276796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbd980849b0 con 0x7fbda0159b10 2023-10-06T03:24:21.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.280+0000 7fbda5658700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd8c066f30 0x7fbd8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:21.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.280+0000 7fbda5658700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd8c066f30 0x7fbd8c0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbd90001560 tx=0x7fbd90001a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:21.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.284+0000 7fbd9d7fa700 1 -- 172.21.15.84:0/2420276796 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd98051730 con 0x7fbda0159b10 2023-10-06T03:24:21.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.513+0000 7fbda78bc700 1 -- 172.21.15.84:0/2420276796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbda0064ad0 con 0x7fbda0159b10 2023-10-06T03:24:21.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.514+0000 7fbd9d7fa700 1 -- 172.21.15.84:0/2420276796 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbd98017070 con 0x7fbda0159b10 2023-10-06T03:24:21.516 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:24:21.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 -- 172.21.15.84:0/2420276796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd8c066f30 msgr2=0x7fbd8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:21.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd8c066f30 0x7fbd8c0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbd90001560 tx=0x7fbd90001a20 comp rx=0 tx=0).stop 2023-10-06T03:24:21.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 -- 172.21.15.84:0/2420276796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda0159b10 msgr2=0x7fbda0155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:21.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda0159b10 0x7fbda0155c90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800ec80 tx=0x7fbd980091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 -- 172.21.15.84:0/2420276796 shutdown_connections 2023-10-06T03:24:21.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd8c066f30 0x7fbd8c0693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda0159b10 0x7fbda0155c90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00ca6b0 0x7fbda01520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 --2- 172.21.15.84:0/2420276796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda00cb630 0x7fbda00c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:21.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 -- 172.21.15.84:0/2420276796 >> 172.21.15.84:0/2420276796 conn(0x7fbda0070810 msgr2=0x7fbda00ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:21.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 -- 172.21.15.84:0/2420276796 shutdown_connections 2023-10-06T03:24:21.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:21.516+0000 7fbda78bc700 1 -- 172.21.15.84:0/2420276796 wait complete. 2023-10-06T03:24:21.529 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:24:21.530 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:24:21.530 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T03:24:21.530 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T03:24:21.530 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T03:24:21.530 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:24:21.530 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:24:21.530 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:24:21.530 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T03:24:21.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.531 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T03:24:21.547 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:21.547 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:21.547 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:21.547 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.547 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:21.548 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.548 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:21.548 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:21.548 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T03:24:21.548 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:21.548 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:21.548 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T03:24:21.549 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:21.549 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:21.549 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:24:21.549 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:21.549 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:24:21.549 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42491sec preferred_lft 42491sec 2023-10-06T03:24:21.549 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T03:24:21.550 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.550 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:21.550 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether e6:c9:c5:59:18:bb brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:21.550 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:24:21.550 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.551 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::a0d2:65ff:fe0e:962d/64 scope link 2023-10-06T03:24:21.551 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.551 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:24:21.551 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether e6:c9:c5:59:18:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:24:21.551 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::e4c9:c5ff:fe59:18bb/64 scope link tentative 2023-10-06T03:24:21.551 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.552 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:24:21.610 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T03:24:21.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.612 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T03:24:21.668 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T03:24:21.668 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:24:21.668 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:24:21.669 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:24:21.669 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:24:21.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.669 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:24:21.669 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:24:21.669 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:24:21.669 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:24:21.669 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:24:21.669 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:24:21.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.769 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:24:21.783 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:24:21.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.784 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2023-10-06T03:24:21.838 INFO:teuthology.orchestra.run.smithi131.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T03:24:21.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.839 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:24:21.839 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:24:21.839 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:24:21.839 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T03:24:21.839 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:24:21.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.928 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T03:24:21.958 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:21.958 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:21.958 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:21.958 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.958 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:21.958 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.958 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:21.958 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 4e:48:52:0e:4f:9c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:24:21.958 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:24:21.959 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.959 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4c48:52ff:fe0e:4f9c/64 scope link tentative 2023-10-06T03:24:21.959 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.970 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T03:24:22.049 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:22.049 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:22.049 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:22.049 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:22.049 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:22.049 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:22.049 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:22.050 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 4e:48:52:0e:4f:9c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:24:22.050 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:24:22.050 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:22.050 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4c48:52ff:fe0e:4f9c/64 scope link tentative 2023-10-06T03:24:22.050 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:22.060 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T03:24:22.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:22.060 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:24:22.060 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:24:22.061 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T03:24:22.061 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T03:24:22.061 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T03:24:22.061 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T03:24:22.061 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T03:24:22.061 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:24:22.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:22.280 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:24:22.280 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:24:22.280 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.1 up 2023-10-06T03:24:22.280 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T03:24:22.280 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:24:22.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:22.359 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T03:24:22.374 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T03:24:22.374 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:22.374 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T03:24:22.428 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-06T03:24:22.428 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:24:22.428 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:22.507 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:22.508 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:22.526 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:22.526 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:22.526 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:24:22.526 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 3@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:24:22.526 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:24:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:24:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:24:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:24:22.548 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:24:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 3@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:24:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:24:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:24:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:24:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:24:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:24:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:24:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:24:22.550 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:24:22.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:22.551 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T03:24:22.616 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T03:24:22.633 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:22.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.753+0000 7f29555e1700 1 Processor -- start 2023-10-06T03:24:22.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.754+0000 7f29555e1700 1 -- start start 2023-10-06T03:24:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.754+0000 7f29555e1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29500ca3b0 0x7f29501582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.754+0000 7f29555e1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29500adba0 0x7f29500ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.754+0000 7f29555e1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f29500ce710 0x7f295015af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.754+0000 7f29555e1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29500cbbd0 con 0x7f29500ca3b0 2023-10-06T03:24:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.754+0000 7f29555e1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29500ceb70 con 0x7f29500ce710 2023-10-06T03:24:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.754+0000 7f29555e1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2950157e20 con 0x7f29500adba0 2023-10-06T03:24:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.754+0000 7f294effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29500ca3b0 0x7f29501582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29500ca3b0 0x7f29501582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46014/0 (socket says 172.21.15.84:46014) 2023-10-06T03:24:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294effd700 1 -- 172.21.15.84:0/3126669449 learned_addr learned my addr 172.21.15.84:0/3126669449 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f29467fc700 1 --2- 172.21.15.84:0/3126669449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29500adba0 0x7f29500ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294f7fe700 1 --2- 172.21.15.84:0/3126669449 >> v2:172.21.15.131:3300/0 conn(0x7f29500ce710 0x7f295015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294effd700 1 -- 172.21.15.84:0/3126669449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29500adba0 msgr2=0x7f29500ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294effd700 1 --2- 172.21.15.84:0/3126669449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29500adba0 0x7f29500ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294effd700 1 -- 172.21.15.84:0/3126669449 >> v2:172.21.15.131:3300/0 conn(0x7f29500ce710 msgr2=0x7f295015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294effd700 1 --2- 172.21.15.84:0/3126669449 >> v2:172.21.15.131:3300/0 conn(0x7f29500ce710 0x7f295015af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294effd700 1 -- 172.21.15.84:0/3126669449 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500cb610 con 0x7f29500ca3b0 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294effd700 1 --2- 172.21.15.84:0/3126669449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500ca3b0 0x7f29501582b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29500c52b0 tx=0x7f2940009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e2f2a4d7c54a31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294e7fc700 1 -- 172.21.15.84:0/3126669449 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294000b860 con 0x7f29500ca3b0 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294e7fc700 1 -- 172.21.15.84:0/3126669449 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294000b9c0 con 0x7f29500ca3b0 2023-10-06T03:24:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.755+0000 7f294e7fc700 1 -- 172.21.15.84:0/3126669449 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294000bd60 con 0x7f29500ca3b0 2023-10-06T03:24:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.756+0000 7f29555e1700 1 -- 172.21.15.84:0/3126669449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500ca3b0 msgr2=0x7f29501582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.756+0000 7f29555e1700 1 --2- 172.21.15.84:0/3126669449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500ca3b0 0x7f29501582b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29500c52b0 tx=0x7f2940009250 comp rx=0 tx=0).stop 2023-10-06T03:24:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.756+0000 7f29555e1700 1 -- 172.21.15.84:0/3126669449 shutdown_connections 2023-10-06T03:24:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.756+0000 7f29555e1700 1 --2- 172.21.15.84:0/3126669449 >> v2:172.21.15.131:3300/0 conn(0x7f29500ce710 0x7f295015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.756+0000 7f29555e1700 1 --2- 172.21.15.84:0/3126669449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500ca3b0 0x7f29501582b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.756+0000 7f29555e1700 1 --2- 172.21.15.84:0/3126669449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29500adba0 0x7f29500ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.756+0000 7f29555e1700 1 -- 172.21.15.84:0/3126669449 >> 172.21.15.84:0/3126669449 conn(0x7f2950070810 msgr2=0x7f2950070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.756+0000 7f29555e1700 1 -- 172.21.15.84:0/3126669449 shutdown_connections 2023-10-06T03:24:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.756+0000 7f29555e1700 1 -- 172.21.15.84:0/3126669449 wait complete. 2023-10-06T03:24:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.757+0000 7f29555e1700 1 Processor -- start 2023-10-06T03:24:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.757+0000 7f29555e1700 1 -- start start 2023-10-06T03:24:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f29555e1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500adba0 0x7f29500b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f29555e1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29500ca3b0 0x7f295015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f29555e1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29500ce710 0x7f295014eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f29555e1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295015b790 con 0x7f29500adba0 2023-10-06T03:24:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f29555e1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295015ba70 con 0x7f29500ca3b0 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f29555e1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295015bd50 con 0x7f29500ce710 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f294effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500adba0 0x7f29500b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f294effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500adba0 0x7f29500b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46016/0 (socket says 172.21.15.84:46016) 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f294effd700 1 -- 172.21.15.84:0/2247250608 learned_addr learned my addr 172.21.15.84:0/2247250608 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f29467fc700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29500ca3b0 0x7f295015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f294f7fe700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29500ce710 0x7f295014eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f294effd700 1 -- 172.21.15.84:0/2247250608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29500ce710 msgr2=0x7f295014eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f294effd700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29500ce710 0x7f295014eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f294effd700 1 -- 172.21.15.84:0/2247250608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29500ca3b0 msgr2=0x7f295015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f294effd700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29500ca3b0 0x7f295015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f294effd700 1 -- 172.21.15.84:0/2247250608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29400094f0 con 0x7f29500adba0 2023-10-06T03:24:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f294effd700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500adba0 0x7f29500b3bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f29500cdfe0 tx=0x7f2940017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f29477fe700 1 -- 172.21.15.84:0/2247250608 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940011dc0 con 0x7f29500adba0 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.758+0000 7f29477fe700 1 -- 172.21.15.84:0/2247250608 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2940024440 con 0x7f29500adba0 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.759+0000 7f29555e1700 1 -- 172.21.15.84:0/2247250608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295015c030 con 0x7f29500adba0 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.759+0000 7f29477fe700 1 -- 172.21.15.84:0/2247250608 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940024800 con 0x7f29500adba0 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.759+0000 7f29555e1700 1 -- 172.21.15.84:0/2247250608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295014f2e0 con 0x7f29500adba0 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.759+0000 7f29555e1700 1 -- 172.21.15.84:0/2247250608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2950064ad0 con 0x7f29500adba0 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.760+0000 7f29477fe700 1 -- 172.21.15.84:0/2247250608 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f294001a420 con 0x7f29500adba0 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.760+0000 7f29477fe700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2930066f30 0x7f29300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.760+0000 7f29477fe700 1 -- 172.21.15.84:0/2247250608 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2940086750 con 0x7f29500adba0 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.760+0000 7f29467fc700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2930066f30 0x7f29300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.761+0000 7f29467fc700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2930066f30 0x7f29300693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2938006fd0 tx=0x7f2938008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.764+0000 7f29477fe700 1 -- 172.21.15.84:0/2247250608 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2940053570 con 0x7f29500adba0 2023-10-06T03:24:22.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.946+0000 7f29555e1700 1 -- 172.21.15.84:0/2247250608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29500cb8f0 con 0x7f29500adba0 2023-10-06T03:24:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.947+0000 7f29477fe700 1 -- 172.21.15.84:0/2247250608 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f2940056b90 con 0x7f29500adba0 2023-10-06T03:24:22.949 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 -- 172.21.15.84:0/2247250608 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2930066f30 msgr2=0x7f29300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2930066f30 0x7f29300693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2938006fd0 tx=0x7f2938008040 comp rx=0 tx=0).stop 2023-10-06T03:24:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 -- 172.21.15.84:0/2247250608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500adba0 msgr2=0x7f29500b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500adba0 0x7f29500b3bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f29500cdfe0 tx=0x7f2940017000 comp rx=0 tx=0).stop 2023-10-06T03:24:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 -- 172.21.15.84:0/2247250608 shutdown_connections 2023-10-06T03:24:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2930066f30 0x7f29300693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29500ce710 0x7f295014eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29500adba0 0x7f29500b3bf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 --2- 172.21.15.84:0/2247250608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29500ca3b0 0x7f295015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 -- 172.21.15.84:0/2247250608 >> 172.21.15.84:0/2247250608 conn(0x7f2950070810 msgr2=0x7f2950150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 -- 172.21.15.84:0/2247250608 shutdown_connections 2023-10-06T03:24:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:22.949+0000 7f29555e1700 1 -- 172.21.15.84:0/2247250608 wait complete. 2023-10-06T03:24:22.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:47.554201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:48.881558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:52.564434+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:22.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:23.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.080+0000 7f829624f700 1 Processor -- start 2023-10-06T03:24:23.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.080+0000 7f829624f700 1 -- start start 2023-10-06T03:24:23.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f829624f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8290159340 0x7f82900af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f829624f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8290159710 0x7f82900cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f829624f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82900cba70 0x7f82900cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f829624f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900cbed0 con 0x7f82900cba70 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f829624f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900cf820 con 0x7f8290159340 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f829624f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900cfb00 con 0x7f8290159710 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82900cba70 0x7f82900cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82900cba70 0x7f82900cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46022/0 (socket says 172.21.15.84:46022) 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828ffff700 1 -- 172.21.15.84:0/1778211996 learned_addr learned my addr 172.21.15.84:0/1778211996 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828effd700 1 --2- 172.21.15.84:0/1778211996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8290159710 0x7f82900cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828f7fe700 1 --2- 172.21.15.84:0/1778211996 >> v2:172.21.15.131:3300/0 conn(0x7f8290159340 0x7f82900af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828ffff700 1 -- 172.21.15.84:0/1778211996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8290159710 msgr2=0x7f82900cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828ffff700 1 --2- 172.21.15.84:0/1778211996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8290159710 0x7f82900cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828ffff700 1 -- 172.21.15.84:0/1778211996 >> v2:172.21.15.131:3300/0 conn(0x7f8290159340 msgr2=0x7f82900af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828ffff700 1 --2- 172.21.15.84:0/1778211996 >> v2:172.21.15.131:3300/0 conn(0x7f8290159340 0x7f82900af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828ffff700 1 -- 172.21.15.84:0/1778211996 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900cfde0 con 0x7f82900cba70 2023-10-06T03:24:23.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828ffff700 1 --2- 172.21.15.84:0/1778211996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 0x7f82900cceb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8290071290 tx=0x7f8288009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a518ce956b0a1d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.081+0000 7f828e7fc700 1 -- 172.21.15.84:0/1778211996 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800e070 con 0x7f82900cba70 2023-10-06T03:24:23.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f828e7fc700 1 -- 172.21.15.84:0/1778211996 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828800b970 con 0x7f82900cba70 2023-10-06T03:24:23.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f828e7fc700 1 -- 172.21.15.84:0/1778211996 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82880092e0 con 0x7f82900cba70 2023-10-06T03:24:23.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f829624f700 1 -- 172.21.15.84:0/1778211996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 msgr2=0x7f82900cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f829624f700 1 --2- 172.21.15.84:0/1778211996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 0x7f82900cceb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8290071290 tx=0x7f8288009840 comp rx=0 tx=0).stop 2023-10-06T03:24:23.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f829624f700 1 -- 172.21.15.84:0/1778211996 shutdown_connections 2023-10-06T03:24:23.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f829624f700 1 --2- 172.21.15.84:0/1778211996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 0x7f82900cceb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f829624f700 1 --2- 172.21.15.84:0/1778211996 >> v2:172.21.15.131:3300/0 conn(0x7f8290159340 0x7f82900af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f829624f700 1 --2- 172.21.15.84:0/1778211996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8290159710 0x7f82900cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f829624f700 1 -- 172.21.15.84:0/1778211996 >> 172.21.15.84:0/1778211996 conn(0x7f8290099720 msgr2=0x7f829006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f829624f700 1 -- 172.21.15.84:0/1778211996 shutdown_connections 2023-10-06T03:24:23.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.082+0000 7f829624f700 1 -- 172.21.15.84:0/1778211996 wait complete. 2023-10-06T03:24:23.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.083+0000 7f829624f700 1 Processor -- start 2023-10-06T03:24:23.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.083+0000 7f829624f700 1 -- start start 2023-10-06T03:24:23.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f829624f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 0x7f829014d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f829624f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8290159340 0x7f8290152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f829624f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8290159710 0x7f8290152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f829624f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900b11d0 con 0x7f82900cba70 2023-10-06T03:24:23.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f829624f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900b0d40 con 0x7f8290159340 2023-10-06T03:24:23.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f829624f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900b0130 con 0x7f8290159710 2023-10-06T03:24:23.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f828f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 0x7f829014d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f828f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 0x7f829014d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46036/0 (socket says 172.21.15.84:46036) 2023-10-06T03:24:23.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f828f7fe700 1 -- 172.21.15.84:0/1315548301 learned_addr learned my addr 172.21.15.84:0/1315548301 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:23.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f828effd700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8290159340 0x7f8290152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f828ffff700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8290159710 0x7f8290152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f828f7fe700 1 -- 172.21.15.84:0/1315548301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8290159710 msgr2=0x7f8290152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f828f7fe700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8290159710 0x7f8290152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f828f7fe700 1 -- 172.21.15.84:0/1315548301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8290159340 msgr2=0x7f8290152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f828f7fe700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8290159340 0x7f8290152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.084+0000 7f828f7fe700 1 -- 172.21.15.84:0/1315548301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288009ae0 con 0x7f82900cba70 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.085+0000 7f828f7fe700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 0x7f829014d360 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f828000ec80 tx=0x7f8280009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.085+0000 7f82777fe700 1 -- 172.21.15.84:0/1315548301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828000c8e0 con 0x7f82900cba70 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.085+0000 7f82777fe700 1 -- 172.21.15.84:0/1315548301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828000ca40 con 0x7f82900cba70 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.085+0000 7f829624f700 1 -- 172.21.15.84:0/1315548301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82900b0410 con 0x7f82900cba70 2023-10-06T03:24:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.085+0000 7f82777fe700 1 -- 172.21.15.84:0/1315548301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828000cdc0 con 0x7f82900cba70 2023-10-06T03:24:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.085+0000 7f829624f700 1 -- 172.21.15.84:0/1315548301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82900b09d0 con 0x7f82900cba70 2023-10-06T03:24:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.086+0000 7f829624f700 1 -- 172.21.15.84:0/1315548301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82900b1020 con 0x7f82900cba70 2023-10-06T03:24:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.086+0000 7f82777fe700 1 -- 172.21.15.84:0/1315548301 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8280013680 con 0x7f82900cba70 2023-10-06T03:24:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.086+0000 7f82777fe700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f827c066f30 0x7f827c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.087+0000 7f82777fe700 1 -- 172.21.15.84:0/1315548301 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8280085070 con 0x7f82900cba70 2023-10-06T03:24:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.087+0000 7f828effd700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f827c066f30 0x7f827c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.087+0000 7f828effd700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f827c066f30 0x7f827c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8290153340 tx=0x7f82840091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.091+0000 7f82777fe700 1 -- 172.21.15.84:0/1315548301 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8280051e90 con 0x7f82900cba70 2023-10-06T03:24:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.274+0000 7f829624f700 1 -- 172.21.15.84:0/1315548301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8290064ad0 con 0x7f82900cba70 2023-10-06T03:24:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.274+0000 7f82777fe700 1 -- 172.21.15.84:0/1315548301 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f82800170a0 con 0x7f82900cba70 2023-10-06T03:24:23.276 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:24:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 -- 172.21.15.84:0/1315548301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f827c066f30 msgr2=0x7f827c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f827c066f30 0x7f827c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8290153340 tx=0x7f82840091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 -- 172.21.15.84:0/1315548301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 msgr2=0x7f829014d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 0x7f829014d360 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f828000ec80 tx=0x7f8280009120 comp rx=0 tx=0).stop 2023-10-06T03:24:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 -- 172.21.15.84:0/1315548301 shutdown_connections 2023-10-06T03:24:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f827c066f30 0x7f827c0693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8290159710 0x7f8290152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cba70 0x7f829014d360 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 --2- 172.21.15.84:0/1315548301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8290159340 0x7f8290152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 -- 172.21.15.84:0/1315548301 >> 172.21.15.84:0/1315548301 conn(0x7f8290099720 msgr2=0x7f82900caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 -- 172.21.15.84:0/1315548301 shutdown_connections 2023-10-06T03:24:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.276+0000 7f829624f700 1 -- 172.21.15.84:0/1315548301 wait complete. 2023-10-06T03:24:23.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:23.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.408+0000 7fae38206700 1 Processor -- start 2023-10-06T03:24:23.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.408+0000 7fae38206700 1 -- start start 2023-10-06T03:24:23.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae38206700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae301598e0 0x7fae300ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae38206700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fae300cbcb0 0x7fae300ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae38206700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae300cf610 con 0x7fae30159510 2023-10-06T03:24:23.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae38206700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae300cf8f0 con 0x7fae301598e0 2023-10-06T03:24:23.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae38206700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae300cfbd0 con 0x7fae300cbcb0 2023-10-06T03:24:23.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae357a1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae301598e0 0x7fae300ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae357a1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae301598e0 0x7fae300ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46050/0 (socket says 172.21.15.84:46050) 2023-10-06T03:24:23.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae357a1700 1 -- 172.21.15.84:0/1423276131 learned_addr learned my addr 172.21.15.84:0/1423276131 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:23.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae367a3700 1 --2- 172.21.15.84:0/1423276131 >> v2:172.21.15.131:3300/0 conn(0x7fae300cbcb0 0x7fae300ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae357a1700 1 -- 172.21.15.84:0/1423276131 >> v2:172.21.15.131:3300/0 conn(0x7fae300cbcb0 msgr2=0x7fae300ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae357a1700 1 --2- 172.21.15.84:0/1423276131 >> v2:172.21.15.131:3300/0 conn(0x7fae300cbcb0 0x7fae300ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae357a1700 1 -- 172.21.15.84:0/1423276131 >> v1:172.21.15.131:6789/0 conn(0x7fae30159510 legacy=0x7fae300cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae357a1700 1 -- 172.21.15.84:0/1423276131 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300cfeb0 con 0x7fae301598e0 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.409+0000 7fae357a1700 1 --2- 172.21.15.84:0/1423276131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae301598e0 0x7fae300ce820 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fae3006f990 tx=0x7fae20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e4c6418d952fa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae34fa0700 1 -- 172.21.15.84:0/1423276131 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000b860 con 0x7fae301598e0 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae34fa0700 1 -- 172.21.15.84:0/1423276131 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2000b9c0 con 0x7fae301598e0 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae34fa0700 1 -- 172.21.15.84:0/1423276131 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000bd60 con 0x7fae301598e0 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae38206700 1 -- 172.21.15.84:0/1423276131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae301598e0 msgr2=0x7fae300ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae38206700 1 --2- 172.21.15.84:0/1423276131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae301598e0 0x7fae300ce820 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fae3006f990 tx=0x7fae20009250 comp rx=0 tx=0).stop 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae38206700 1 -- 172.21.15.84:0/1423276131 shutdown_connections 2023-10-06T03:24:23.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae38206700 1 --2- 172.21.15.84:0/1423276131 >> v2:172.21.15.131:3300/0 conn(0x7fae300cbcb0 0x7fae300ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae38206700 1 --2- 172.21.15.84:0/1423276131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae301598e0 0x7fae300ce820 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae38206700 1 -- 172.21.15.84:0/1423276131 >> 172.21.15.84:0/1423276131 conn(0x7fae30089e90 msgr2=0x7fae300997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae38206700 1 -- 172.21.15.84:0/1423276131 shutdown_connections 2023-10-06T03:24:23.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.410+0000 7fae38206700 1 -- 172.21.15.84:0/1423276131 wait complete. 2023-10-06T03:24:23.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.411+0000 7fae38206700 1 Processor -- start 2023-10-06T03:24:23.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.411+0000 7fae38206700 1 -- start start 2023-10-06T03:24:23.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae38206700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae300cbcb0 0x7fae3015c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae38206700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae30159510 0x7fae3016d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae38206700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae301598e0 0x7fae3016de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae38206700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3015a160 con 0x7fae30159510 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae38206700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae300b5aa0 con 0x7fae301598e0 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae38206700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae300b5d80 con 0x7fae300cbcb0 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae357a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae30159510 0x7fae3016d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae357a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae30159510 0x7fae3016d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46052/0 (socket says 172.21.15.84:46052) 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae357a1700 1 -- 172.21.15.84:0/483391644 learned_addr learned my addr 172.21.15.84:0/483391644 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae367a3700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae301598e0 0x7fae3016de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae35fa2700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae300cbcb0 0x7fae3015c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae357a1700 1 -- 172.21.15.84:0/483391644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae300cbcb0 msgr2=0x7fae3015c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae357a1700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae300cbcb0 0x7fae3015c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae357a1700 1 -- 172.21.15.84:0/483391644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae301598e0 msgr2=0x7fae3016de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae357a1700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae301598e0 0x7fae3016de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae357a1700 1 -- 172.21.15.84:0/483391644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200094f0 con 0x7fae30159510 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.412+0000 7fae357a1700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae30159510 0x7fae3016d8e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fae30067c60 tx=0x7fae20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.413+0000 7fae25ffb700 1 -- 172.21.15.84:0/483391644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20024440 con 0x7fae30159510 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.413+0000 7fae25ffb700 1 -- 172.21.15.84:0/483391644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae200245a0 con 0x7fae30159510 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.413+0000 7fae38206700 1 -- 172.21.15.84:0/483391644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae300b6060 con 0x7fae30159510 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.413+0000 7fae25ffb700 1 -- 172.21.15.84:0/483391644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20024960 con 0x7fae30159510 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.413+0000 7fae38206700 1 -- 172.21.15.84:0/483391644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae301551f0 con 0x7fae30159510 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.414+0000 7fae38206700 1 -- 172.21.15.84:0/483391644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae301554a0 con 0x7fae30159510 2023-10-06T03:24:23.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.414+0000 7fae25ffb700 1 -- 172.21.15.84:0/483391644 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae20024d50 con 0x7fae30159510 2023-10-06T03:24:23.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.414+0000 7fae25ffb700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 0x7fae140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.415+0000 7fae25ffb700 1 -- 172.21.15.84:0/483391644 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fae20086460 con 0x7fae30159510 2023-10-06T03:24:23.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.415+0000 7fae35fa2700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 0x7fae140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.415+0000 7fae35fa2700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 0x7fae140693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae2c003860 tx=0x7fae2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.419+0000 7fae25ffb700 1 -- 172.21.15.84:0/483391644 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae20053280 con 0x7fae30159510 2023-10-06T03:24:23.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.599+0000 7fae38206700 1 -- 172.21.15.84:0/483391644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae300cb6a0 con 0x7fae30159510 2023-10-06T03:24:23.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.599+0000 7fae25ffb700 1 -- 172.21.15.84:0/483391644 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae2002b340 con 0x7fae30159510 2023-10-06T03:24:23.601 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:24:23.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 -- 172.21.15.84:0/483391644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 msgr2=0x7fae140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 0x7fae140693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae2c003860 tx=0x7fae2c009040 comp rx=0 tx=0).stop 2023-10-06T03:24:23.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 -- 172.21.15.84:0/483391644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae30159510 msgr2=0x7fae3016d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae30159510 0x7fae3016d8e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fae30067c60 tx=0x7fae20017000 comp rx=0 tx=0).stop 2023-10-06T03:24:23.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 -- 172.21.15.84:0/483391644 shutdown_connections 2023-10-06T03:24:23.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 0x7fae140693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae301598e0 0x7fae3016de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae300cbcb0 0x7fae3015c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 --2- 172.21.15.84:0/483391644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae30159510 0x7fae3016d8e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 -- 172.21.15.84:0/483391644 >> 172.21.15.84:0/483391644 conn(0x7fae30089e90 msgr2=0x7fae3014b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 -- 172.21.15.84:0/483391644 shutdown_connections 2023-10-06T03:24:23.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.602+0000 7fae38206700 1 -- 172.21.15.84:0/483391644 wait complete. 2023-10-06T03:24:23.615 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:23.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.731+0000 7f01576c0700 1 Processor -- start 2023-10-06T03:24:23.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.731+0000 7f01576c0700 1 -- start start 2023-10-06T03:24:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f01576c0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f01500cce90 0x7f0150068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f01576c0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01500c96b0 con 0x7f01500c4490 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f01576c0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0150159c40 con 0x7f01500b0860 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f01576c0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01500c8aa0 con 0x7f01500cce90 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f0154c5b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f01500c4490 0x7f01500cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52184/0 (socket says 172.21.15.84:52184) 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f0154c5b700 1 -- 172.21.15.84:0/438524577 learned_addr learned my addr 172.21.15.84:0/438524577 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097471945 0 0) 0x7f01500c96b0 con 0x7f01500c4490 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0138003570 con 0x7f01500c4490 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f0155c5d700 1 --2- 172.21.15.84:0/438524577 >> v2:172.21.15.131:3300/0 conn(0x7f01500cce90 0x7f0150068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178588276 0 0) 0x7f0150159c40 con 0x7f01500b0860 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01500c96b0 con 0x7f01500b0860 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2693154306 0 0) 0x7f0138003570 con 0x7f01500c4490 2023-10-06T03:24:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 >> v2:172.21.15.131:3300/0 conn(0x7f01500cce90 msgr2=0x7f0150068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 --2- 172.21.15.84:0/438524577 >> v2:172.21.15.131:3300/0 conn(0x7f01500cce90 0x7f0150068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 >> v1:172.21.15.131:6789/0 conn(0x7f01500b0860 legacy=0x7f01500cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01500c8d80 con 0x7f01500c4490 2023-10-06T03:24:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f0144001470 con 0x7f01500c4490 2023-10-06T03:24:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 >> v1:172.21.15.84:6789/0 conn(0x7f01500c4490 legacy=0x7f01500cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0138003bf0 0x7f0138003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f0138004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0138005230 0x7f013800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500c8aa0 con 0x7f0138004810 2023-10-06T03:24:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013800c160 con 0x7f0138003bf0 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013800c320 con 0x7f0138005230 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f0154c5b700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f0138004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.732+0000 7f015545c700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0138003bf0 0x7f0138003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f0155c5d700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0138005230 0x7f013800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f0154c5b700 1 -- 172.21.15.84:0/438524577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0138005230 msgr2=0x7f013800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f0154c5b700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0138005230 0x7f013800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f0154c5b700 1 -- 172.21.15.84:0/438524577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0138003bf0 msgr2=0x7f0138003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f0154c5b700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0138003bf0 0x7f0138003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f0154c5b700 1 -- 172.21.15.84:0/438524577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138003570 con 0x7f0138004810 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f0155c5d700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0138005230 0x7f013800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f0155c5d700 1 -- 172.21.15.84:0/438524577 reap_dead start 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f0154c5b700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f0138004c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f014400c2d0 tx=0x7f0144001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8780a92481c0e896 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014400cbc0 con 0x7f0138004810 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014400cd20 con 0x7f0138004810 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f014ffff700 1 -- 172.21.15.84:0/438524577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144005b70 con 0x7f0138004810 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f01576c0700 1 -- 172.21.15.84:0/438524577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 msgr2=0x7f0138004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f01576c0700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f0138004c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f014400c2d0 tx=0x7f0144001e10 comp rx=0 tx=0).stop 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f01576c0700 1 -- 172.21.15.84:0/438524577 shutdown_connections 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f01576c0700 1 --2- 172.21.15.84:0/438524577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f0138004c80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.733+0000 7f01576c0700 1 -- 172.21.15.84:0/438524577 >> 172.21.15.84:0/438524577 conn(0x7f0150088000 msgr2=0x7f01500ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.734+0000 7f01576c0700 1 -- 172.21.15.84:0/438524577 shutdown_connections 2023-10-06T03:24:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.734+0000 7f01576c0700 1 -- 172.21.15.84:0/438524577 wait complete. 2023-10-06T03:24:23.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.735+0000 7f01576c0700 1 Processor -- start 2023-10-06T03:24:23.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.735+0000 7f01576c0700 1 -- start start 2023-10-06T03:24:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f01576c0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f01500b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f01576c0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0150151ef0 0x7f0150152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f01576c0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f015016d1c0 0x7f015016d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f01576c0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0150152880 con 0x7f0138004810 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f01576c0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500b2620 con 0x7f015016d1c0 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f01576c0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01500b2900 con 0x7f0150151ef0 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f015545c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f01500b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f015545c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f01500b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46066/0 (socket says 172.21.15.84:46066) 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f015545c700 1 -- 172.21.15.84:0/1537708134 learned_addr learned my addr 172.21.15.84:0/1537708134 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f0154c5b700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0150151ef0 0x7f0150152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f015545c700 1 -- 172.21.15.84:0/1537708134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0150151ef0 msgr2=0x7f0150152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f0155c5d700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f015016d1c0 0x7f015016d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f015545c700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0150151ef0 0x7f0150152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f015545c700 1 -- 172.21.15.84:0/1537708134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f015016d1c0 msgr2=0x7f015016d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f015545c700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f015016d1c0 0x7f015016d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f015545c700 1 -- 172.21.15.84:0/1537708134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01500b2be0 con 0x7f0138004810 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f015545c700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f01500b1f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f014000c210 tx=0x7f0140001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f014d7fa700 1 -- 172.21.15.84:0/1537708134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014000ce50 con 0x7f0138004810 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f014d7fa700 1 -- 172.21.15.84:0/1537708134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0140015430 con 0x7f0138004810 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f01576c0700 1 -- 172.21.15.84:0/1537708134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01500b2ec0 con 0x7f0138004810 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f014d7fa700 1 -- 172.21.15.84:0/1537708134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400157f0 con 0x7f0138004810 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.736+0000 7f01576c0700 1 -- 172.21.15.84:0/1537708134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015016db60 con 0x7f0138004810 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.737+0000 7f01576c0700 1 -- 172.21.15.84:0/1537708134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015016dd80 con 0x7f0138004810 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.738+0000 7f014d7fa700 1 -- 172.21.15.84:0/1537708134 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0140015b60 con 0x7f0138004810 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.738+0000 7f014d7fa700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f013c066f30 0x7f013c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.738+0000 7f0154c5b700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f013c066f30 0x7f013c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.738+0000 7f014d7fa700 1 -- 172.21.15.84:0/1537708134 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f01400858a0 con 0x7f0138004810 2023-10-06T03:24:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.739+0000 7f0154c5b700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f013c066f30 0x7f013c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0144008fd0 tx=0x7f0144015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.742+0000 7f014d7fa700 1 -- 172.21.15.84:0/1537708134 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01400526c0 con 0x7f0138004810 2023-10-06T03:24:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.924+0000 7f01576c0700 1 -- 172.21.15.84:0/1537708134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0150064ad0 con 0x7f0138004810 2023-10-06T03:24:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.925+0000 7f014d7fa700 1 -- 172.21.15.84:0/1537708134 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0140055ce0 con 0x7f0138004810 2023-10-06T03:24:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 -- 172.21.15.84:0/1537708134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f013c066f30 msgr2=0x7f013c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f013c066f30 0x7f013c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0144008fd0 tx=0x7f0144015000 comp rx=0 tx=0).stop 2023-10-06T03:24:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 -- 172.21.15.84:0/1537708134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 msgr2=0x7f01500b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f01500b1f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f014000c210 tx=0x7f0140001bd0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 -- 172.21.15.84:0/1537708134 shutdown_connections 2023-10-06T03:24:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f013c066f30 0x7f013c0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f015016d1c0 0x7f015016d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0138004810 0x7f01500b1f20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 --2- 172.21.15.84:0/1537708134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0150151ef0 0x7f0150152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 -- 172.21.15.84:0/1537708134 >> 172.21.15.84:0/1537708134 conn(0x7f0150088000 msgr2=0x7f01500c3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 -- 172.21.15.84:0/1537708134 shutdown_connections 2023-10-06T03:24:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:23.927+0000 7f01576c0700 1 -- 172.21.15.84:0/1537708134 wait complete. 2023-10-06T03:24:23.940 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.055+0000 7f850f907700 1 Processor -- start 2023-10-06T03:24:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.055+0000 7f850f907700 1 -- start start 2023-10-06T03:24:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.056+0000 7f850f907700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f85080cbcb0 0x7f85080cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.056+0000 7f850f907700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85080cf610 con 0x7f85081598e0 2023-10-06T03:24:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.056+0000 7f850f907700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85080cf8f0 con 0x7f8508159510 2023-10-06T03:24:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.056+0000 7f850f907700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85080cfbd0 con 0x7f85080cbcb0 2023-10-06T03:24:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.056+0000 7f850cea2700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f85081598e0 0x7f85080ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52194/0 (socket says 172.21.15.84:52194) 2023-10-06T03:24:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.056+0000 7f850cea2700 1 -- 172.21.15.84:0/1623334021 learned_addr learned my addr 172.21.15.84:0/1623334021 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.056+0000 7f850dea4700 1 --2- 172.21.15.84:0/1623334021 >> v2:172.21.15.131:3300/0 conn(0x7f85080cbcb0 0x7f85080cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.056+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550358050 0 0) 0x7f85080cf610 con 0x7f85081598e0 2023-10-06T03:24:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.056+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f4003570 con 0x7f85081598e0 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4088067377 0 0) 0x7f84f4003570 con 0x7f85081598e0 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 >> v2:172.21.15.131:3300/0 conn(0x7f85080cbcb0 msgr2=0x7f85080cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 --2- 172.21.15.84:0/1623334021 >> v2:172.21.15.131:3300/0 conn(0x7f85080cbcb0 0x7f85080cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 >> v1:172.21.15.131:6789/0 conn(0x7f8508159510 legacy=0x7f85080cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85080cfeb0 con 0x7f85081598e0 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f84f8001470 con 0x7f85081598e0 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 >> v1:172.21.15.84:6789/0 conn(0x7f85081598e0 legacy=0x7f85080ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f4003a60 0x7f84f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f4004810 0x7f84f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f40051c0 0x7f84f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080cfbd0 con 0x7f84f4003a60 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f400c050 con 0x7f84f4004810 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f400c210 con 0x7f84f40051c0 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f850d6a3700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f4003a60 0x7f84f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f850dea4700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f40051c0 0x7f84f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f850cea2700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f4004810 0x7f84f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f850d6a3700 1 -- 172.21.15.84:0/1623334021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f40051c0 msgr2=0x7f84f400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f850d6a3700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f40051c0 0x7f84f400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f850d6a3700 1 -- 172.21.15.84:0/1623334021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f4004810 msgr2=0x7f84f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f850d6a3700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f4004810 0x7f84f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f850d6a3700 1 -- 172.21.15.84:0/1623334021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4003570 con 0x7f84f4003a60 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f850dea4700 1 -- 172.21.15.84:0/1623334021 reap_dead start 2023-10-06T03:24:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f850d6a3700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f4003a60 0x7f84f4003e30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f85040019a0 tx=0x7f8504007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794f005a7e062e56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400c5d0 con 0x7f84f4003a60 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850400c750 con 0x7f84f4003a60 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.057+0000 7f84fffff700 1 -- 172.21.15.84:0/1623334021 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400cb10 con 0x7f84f4003a60 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.058+0000 7f850f907700 1 -- 172.21.15.84:0/1623334021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f4003a60 msgr2=0x7f84f4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.058+0000 7f850f907700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f4003a60 0x7f84f4003e30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f85040019a0 tx=0x7f8504007d10 comp rx=0 tx=0).stop 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.058+0000 7f850f907700 1 -- 172.21.15.84:0/1623334021 shutdown_connections 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.058+0000 7f850f907700 1 --2- 172.21.15.84:0/1623334021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f4003a60 0x7f84f4003e30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.058+0000 7f850f907700 1 -- 172.21.15.84:0/1623334021 >> 172.21.15.84:0/1623334021 conn(0x7f8508089e90 msgr2=0x7f85080997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.058+0000 7f850f907700 1 -- 172.21.15.84:0/1623334021 shutdown_connections 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.058+0000 7f850f907700 1 -- 172.21.15.84:0/1623334021 wait complete. 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.059+0000 7f850f907700 1 Processor -- start 2023-10-06T03:24:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.059+0000 7f850f907700 1 -- start start 2023-10-06T03:24:24.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850f907700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f4003a60 0x7f850814b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850f907700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080c65a0 0x7f85080c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850f907700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85080c9730 0x7f85080c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850f907700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080c6f50 con 0x7f85080c65a0 2023-10-06T03:24:24.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850f907700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8508159e80 con 0x7f84f4003a60 2023-10-06T03:24:24.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850f907700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850815a160 con 0x7f85080c9730 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850cea2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080c65a0 0x7f85080c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850cea2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080c65a0 0x7f85080c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46070/0 (socket says 172.21.15.84:46070) 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850cea2700 1 -- 172.21.15.84:0/407672344 learned_addr learned my addr 172.21.15.84:0/407672344 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850d6a3700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f4003a60 0x7f850814b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850dea4700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85080c9730 0x7f85080c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850cea2700 1 -- 172.21.15.84:0/407672344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85080c9730 msgr2=0x7f85080c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850cea2700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85080c9730 0x7f85080c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850cea2700 1 -- 172.21.15.84:0/407672344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f4003a60 msgr2=0x7f850814b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850cea2700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f4003a60 0x7f850814b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.060+0000 7f850cea2700 1 -- 172.21.15.84:0/407672344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850815a440 con 0x7f85080c65a0 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.061+0000 7f850cea2700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080c65a0 0x7f85080c6a10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f84f800eb10 tx=0x7f84f8001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.061+0000 7f84fd7fa700 1 -- 172.21.15.84:0/407672344 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f800ee20 con 0x7f85080c65a0 2023-10-06T03:24:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.061+0000 7f84fd7fa700 1 -- 172.21.15.84:0/407672344 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f800c5d0 con 0x7f85080c65a0 2023-10-06T03:24:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.061+0000 7f850f907700 1 -- 172.21.15.84:0/407672344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850815a720 con 0x7f85080c65a0 2023-10-06T03:24:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.061+0000 7f84fd7fa700 1 -- 172.21.15.84:0/407672344 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f800c990 con 0x7f85080c65a0 2023-10-06T03:24:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.061+0000 7f850f907700 1 -- 172.21.15.84:0/407672344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85080ca110 con 0x7f85080c65a0 2023-10-06T03:24:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.062+0000 7f850f907700 1 -- 172.21.15.84:0/407672344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85080ca2a0 con 0x7f85080c65a0 2023-10-06T03:24:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.062+0000 7f84fd7fa700 1 -- 172.21.15.84:0/407672344 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84f800cd00 con 0x7f85080c65a0 2023-10-06T03:24:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.063+0000 7f84fd7fa700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.063+0000 7f850d6a3700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.063+0000 7f84fd7fa700 1 -- 172.21.15.84:0/407672344 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f84f8084740 con 0x7f85080c65a0 2023-10-06T03:24:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.063+0000 7f850d6a3700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f84ec066f30 0x7f84ec0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8504001410 tx=0x7f8504015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.067+0000 7f84fd7fa700 1 -- 172.21.15.84:0/407672344 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84f8051560 con 0x7f85080c65a0 2023-10-06T03:24:24.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.246+0000 7f850f907700 1 -- 172.21.15.84:0/407672344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f850815a910 con 0x7f85080c65a0 2023-10-06T03:24:24.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.247+0000 7f84fd7fa700 1 -- 172.21.15.84:0/407672344 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84f8054b80 con 0x7f85080c65a0 2023-10-06T03:24:24.249 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:24:24.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 -- 172.21.15.84:0/407672344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f84ec066f30 msgr2=0x7f84ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f84ec066f30 0x7f84ec0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8504001410 tx=0x7f8504015000 comp rx=0 tx=0).stop 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 -- 172.21.15.84:0/407672344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080c65a0 msgr2=0x7f85080c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080c65a0 0x7f85080c6a10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f84f800eb10 tx=0x7f84f8001d20 comp rx=0 tx=0).stop 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 -- 172.21.15.84:0/407672344 shutdown_connections 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f4003a60 0x7f850814b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85080c9730 0x7f85080c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 --2- 172.21.15.84:0/407672344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080c65a0 0x7f85080c6a10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 -- 172.21.15.84:0/407672344 >> 172.21.15.84:0/407672344 conn(0x7f8508089e90 msgr2=0x7f850814d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 -- 172.21.15.84:0/407672344 shutdown_connections 2023-10-06T03:24:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.249+0000 7f850f907700 1 -- 172.21.15.84:0/407672344 wait complete. 2023-10-06T03:24:24.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:24.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.378+0000 7eff783b5700 1 Processor -- start 2023-10-06T03:24:24.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.378+0000 7eff783b5700 1 -- start start 2023-10-06T03:24:24.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.379+0000 7eff783b5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7eff70159510 0x7eff700cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.379+0000 7eff783b5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff701598e0 0x7eff700cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.379+0000 7eff783b5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff700cf350 con 0x7eff700ce820 2023-10-06T03:24:24.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.379+0000 7eff783b5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff700cf610 con 0x7eff70159510 2023-10-06T03:24:24.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.379+0000 7eff783b5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff700cf8f0 con 0x7eff701598e0 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.379+0000 7eff76952700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7eff700ce820 0x7eff700cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52196/0 (socket says 172.21.15.84:52196) 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff76952700 1 -- 172.21.15.84:0/1857552940 learned_addr learned my addr 172.21.15.84:0/1857552940 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff75950700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff701598e0 0x7eff700cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff76151700 1 --2- 172.21.15.84:0/1857552940 >> v2:172.21.15.131:3300/0 conn(0x7eff70159510 0x7eff700cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799367703 0 0) 0x7eff700cf350 con 0x7eff700ce820 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff5c003570 con 0x7eff700ce820 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 472055969 0 0) 0x7eff5c003570 con 0x7eff700ce820 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff701598e0 msgr2=0x7eff700cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff701598e0 0x7eff700cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 >> v2:172.21.15.131:3300/0 conn(0x7eff70159510 msgr2=0x7eff700cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 --2- 172.21.15.84:0/1857552940 >> v2:172.21.15.131:3300/0 conn(0x7eff70159510 0x7eff700cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700cfbd0 con 0x7eff700ce820 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7eff68001470 con 0x7eff700ce820 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 >> v1:172.21.15.84:6789/0 conn(0x7eff700ce820 legacy=0x7eff700cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5c003a60 0x7eff5c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff5c004810 0x7eff5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff5c0051c0 0x7eff5c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700cf610 con 0x7eff5c003a60 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700cf8f0 con 0x7eff5c004810 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c00bfa0 con 0x7eff5c0051c0 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff76151700 1 --2- 172.21.15.84:0/1857552940 >> v2:172.21.15.131:3300/0 conn(0x7eff70159510 0x7eff700cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff75950700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff701598e0 0x7eff700cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:24.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff76151700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5c003a60 0x7eff5c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff76952700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff5c0051c0 0x7eff5c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.380+0000 7eff75950700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff5c004810 0x7eff5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff76151700 1 -- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff5c0051c0 msgr2=0x7eff5c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff76151700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff5c0051c0 0x7eff5c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff76151700 1 -- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff5c004810 msgr2=0x7eff5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff76151700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff5c004810 0x7eff5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff76151700 1 -- 172.21.15.84:0/1857552940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c003570 con 0x7eff5c003a60 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff76151700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5c003a60 0x7eff5c003e70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00e3c0 tx=0x7eff6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefe8ba4170cae38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00ec70 con 0x7eff5c003a60 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c00f040 con 0x7eff5c003a60 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff7514f700 1 -- 172.21.15.84:0/1857552940 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c014480 con 0x7eff5c003a60 2023-10-06T03:24:24.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff783b5700 1 -- 172.21.15.84:0/1857552940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5c003a60 msgr2=0x7eff5c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff783b5700 1 --2- 172.21.15.84:0/1857552940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5c003a60 0x7eff5c003e70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00e3c0 tx=0x7eff6c00b040 comp rx=0 tx=0).stop 2023-10-06T03:24:24.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff76952700 1 -- 172.21.15.84:0/1857552940 reap_dead start 2023-10-06T03:24:24.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff783b5700 1 -- 172.21.15.84:0/1857552940 shutdown_connections 2023-10-06T03:24:24.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff783b5700 1 -- 172.21.15.84:0/1857552940 >> 172.21.15.84:0/1857552940 conn(0x7eff70089e90 msgr2=0x7eff700997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff783b5700 1 -- 172.21.15.84:0/1857552940 shutdown_connections 2023-10-06T03:24:24.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.381+0000 7eff783b5700 1 -- 172.21.15.84:0/1857552940 wait complete. 2023-10-06T03:24:24.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff783b5700 1 Processor -- start 2023-10-06T03:24:24.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff783b5700 1 -- start start 2023-10-06T03:24:24.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff783b5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff5c003a60 0x7eff70167a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff783b5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7016aff0 0x7eff700b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff783b5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff700b5a40 0x7eff7016c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff783b5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff70167fa0 con 0x7eff700b5a40 2023-10-06T03:24:24.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff783b5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7016c0c0 con 0x7eff7016aff0 2023-10-06T03:24:24.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff783b5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7009ddf0 con 0x7eff5c003a60 2023-10-06T03:24:24.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff76952700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff700b5a40 0x7eff7016c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff76952700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff700b5a40 0x7eff7016c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46084/0 (socket says 172.21.15.84:46084) 2023-10-06T03:24:24.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff76952700 1 -- 172.21.15.84:0/454881234 learned_addr learned my addr 172.21.15.84:0/454881234 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:24.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff76151700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff5c003a60 0x7eff70167a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.383+0000 7eff75950700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7016aff0 0x7eff700b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff76952700 1 -- 172.21.15.84:0/454881234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff5c003a60 msgr2=0x7eff70167a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff76952700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff5c003a60 0x7eff70167a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff76952700 1 -- 172.21.15.84:0/454881234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7016aff0 msgr2=0x7eff700b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff76952700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7016aff0 0x7eff700b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff76952700 1 -- 172.21.15.84:0/454881234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7016b4b0 con 0x7eff700b5a40 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff75950700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7016aff0 0x7eff700b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff76952700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff700b5a40 0x7eff7016c550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7eff70088cf0 tx=0x7eff68001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff667fc700 1 -- 172.21.15.84:0/454881234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6800f690 con 0x7eff700b5a40 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff667fc700 1 -- 172.21.15.84:0/454881234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6800f7f0 con 0x7eff700b5a40 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff783b5700 1 -- 172.21.15.84:0/454881234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7016b790 con 0x7eff700b5a40 2023-10-06T03:24:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff667fc700 1 -- 172.21.15.84:0/454881234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6800fb90 con 0x7eff700b5a40 2023-10-06T03:24:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.384+0000 7eff783b5700 1 -- 172.21.15.84:0/454881234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7016bd50 con 0x7eff700b5a40 2023-10-06T03:24:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.385+0000 7eff783b5700 1 -- 172.21.15.84:0/454881234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7016c230 con 0x7eff700b5a40 2023-10-06T03:24:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.385+0000 7eff667fc700 1 -- 172.21.15.84:0/454881234 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff6801d460 con 0x7eff700b5a40 2023-10-06T03:24:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.386+0000 7eff667fc700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 0x7eff540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.386+0000 7eff667fc700 1 -- 172.21.15.84:0/454881234 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7eff68084740 con 0x7eff700b5a40 2023-10-06T03:24:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.386+0000 7eff76151700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 0x7eff540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.386+0000 7eff76151700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 0x7eff540693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0094a0 tx=0x7eff6c019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.390+0000 7eff667fc700 1 -- 172.21.15.84:0/454881234 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff68051560 con 0x7eff700b5a40 2023-10-06T03:24:24.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.571+0000 7eff783b5700 1 -- 172.21.15.84:0/454881234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7eff70064ad0 con 0x7eff700b5a40 2023-10-06T03:24:24.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.572+0000 7eff667fc700 1 -- 172.21.15.84:0/454881234 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7eff68054b80 con 0x7eff700b5a40 2023-10-06T03:24:24.574 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:24.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 -- 172.21.15.84:0/454881234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 msgr2=0x7eff540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 0x7eff540693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0094a0 tx=0x7eff6c019000 comp rx=0 tx=0).stop 2023-10-06T03:24:24.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 -- 172.21.15.84:0/454881234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff700b5a40 msgr2=0x7eff7016c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff700b5a40 0x7eff7016c550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7eff70088cf0 tx=0x7eff68001e90 comp rx=0 tx=0).stop 2023-10-06T03:24:24.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 -- 172.21.15.84:0/454881234 shutdown_connections 2023-10-06T03:24:24.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff54066f30 0x7eff540693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff700b5a40 0x7eff7016c550 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff5c003a60 0x7eff70167a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 --2- 172.21.15.84:0/454881234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff7016aff0 0x7eff700b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 -- 172.21.15.84:0/454881234 >> 172.21.15.84:0/454881234 conn(0x7eff70089e90 msgr2=0x7eff70152b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 -- 172.21.15.84:0/454881234 shutdown_connections 2023-10-06T03:24:24.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.574+0000 7eff783b5700 1 -- 172.21.15.84:0/454881234 wait complete. 2023-10-06T03:24:24.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:24.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.701+0000 7f4c110e3700 1 Processor -- start 2023-10-06T03:24:24.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.701+0000 7f4c110e3700 1 -- start start 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.701+0000 7f4c110e3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c0c1595a0 0x7f4c0c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.701+0000 7f4c110e3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4c0c0b07a0 0x7f4c0c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.701+0000 7f4c110e3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0c0b0ca0 con 0x7f4c0c0b49e0 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.701+0000 7f4c110e3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c0b0f80 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.701+0000 7f4c110e3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c0b1260 con 0x7f4c0c1595a0 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c0b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4c0c0b07a0 0x7f4c0c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c0b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4c0c0b07a0 0x7f4c0c0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46092/0 (socket says 172.21.15.84:46092) 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c0b59e700 1 -- 172.21.15.84:0/1107791493 learned_addr learned my addr 172.21.15.84:0/1107791493 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c0ad9d700 1 --2- 172.21.15.84:0/1107791493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c0c1595a0 0x7f4c0c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c0b59e700 1 -- 172.21.15.84:0/1107791493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c0c1595a0 msgr2=0x7f4c0c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c0b59e700 1 --2- 172.21.15.84:0/1107791493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c0c1595a0 0x7f4c0c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c0b59e700 1 -- 172.21.15.84:0/1107791493 >> v1:172.21.15.131:6789/0 conn(0x7f4c0c0b49e0 legacy=0x7f4c0c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c0b59e700 1 -- 172.21.15.84:0/1107791493 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c0b1540 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c0b59e700 1 --2- 172.21.15.84:0/1107791493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 0x7f4c0c0b1c00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0099b0 tx=0x7f4bfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15de7aef2b386fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c09d9b700 1 -- 172.21.15.84:0/1107791493 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00b860 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c09d9b700 1 -- 172.21.15.84:0/1107791493 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc00b9c0 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.702+0000 7f4c09d9b700 1 -- 172.21.15.84:0/1107791493 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00bd60 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.703+0000 7f4c110e3700 1 -- 172.21.15.84:0/1107791493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 msgr2=0x7f4c0c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.703+0000 7f4c110e3700 1 --2- 172.21.15.84:0/1107791493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 0x7f4c0c0b1c00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0099b0 tx=0x7f4bfc009250 comp rx=0 tx=0).stop 2023-10-06T03:24:24.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.703+0000 7f4c110e3700 1 -- 172.21.15.84:0/1107791493 shutdown_connections 2023-10-06T03:24:24.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.703+0000 7f4c110e3700 1 --2- 172.21.15.84:0/1107791493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 0x7f4c0c0b1c00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.703+0000 7f4c110e3700 1 --2- 172.21.15.84:0/1107791493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c0c1595a0 0x7f4c0c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.703+0000 7f4c110e3700 1 -- 172.21.15.84:0/1107791493 >> 172.21.15.84:0/1107791493 conn(0x7f4c0c099830 msgr2=0x7f4c0c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.703+0000 7f4c110e3700 1 -- 172.21.15.84:0/1107791493 shutdown_connections 2023-10-06T03:24:24.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.703+0000 7f4c110e3700 1 -- 172.21.15.84:0/1107791493 wait complete. 2023-10-06T03:24:24.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.704+0000 7f4c110e3700 1 Processor -- start 2023-10-06T03:24:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.704+0000 7f4c110e3700 1 -- start start 2023-10-06T03:24:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c110e3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 0x7f4c0c16a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c110e3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c0c0b49e0 0x7f4c0c16a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c110e3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c0c1595a0 0x7f4c0c16c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c110e3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c16a640 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c110e3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c16adf0 con 0x7f4c0c0b49e0 2023-10-06T03:24:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c110e3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c0ac7b0 con 0x7f4c0c1595a0 2023-10-06T03:24:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 0x7f4c0c16a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 0x7f4c0c16a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46094/0 (socket says 172.21.15.84:46094) 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0ad9d700 1 -- 172.21.15.84:0/1511709610 learned_addr learned my addr 172.21.15.84:0/1511709610 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0b59e700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c0c1595a0 0x7f4c0c16c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0a59c700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c0c0b49e0 0x7f4c0c16a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0ad9d700 1 -- 172.21.15.84:0/1511709610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c0c1595a0 msgr2=0x7f4c0c16c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0ad9d700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c0c1595a0 0x7f4c0c16c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0ad9d700 1 -- 172.21.15.84:0/1511709610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c0c0b49e0 msgr2=0x7f4c0c16a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0ad9d700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c0c0b49e0 0x7f4c0c16a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0ad9d700 1 -- 172.21.15.84:0/1511709610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc0094f0 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c0ad9d700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 0x7f4c0c16a100 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400d840 tx=0x7f4c04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4bf2ffd700 1 -- 172.21.15.84:0/1511709610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04014620 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4bf2ffd700 1 -- 172.21.15.84:0/1511709610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c04014780 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c110e3700 1 -- 172.21.15.84:0/1511709610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c0aca90 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4bf2ffd700 1 -- 172.21.15.84:0/1511709610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04014b40 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.705+0000 7f4c110e3700 1 -- 172.21.15.84:0/1511709610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c0ad050 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.706+0000 7f4c110e3700 1 -- 172.21.15.84:0/1511709610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0c064ad0 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.707+0000 7f4bf2ffd700 1 -- 172.21.15.84:0/1511709610 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c0401d400 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.707+0000 7f4bf2ffd700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bf8066f30 0x7f4bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.707+0000 7f4c0a59c700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bf8066f30 0x7f4bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.707+0000 7f4bf2ffd700 1 -- 172.21.15.84:0/1511709610 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4c04085210 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.708+0000 7f4c0a59c700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bf8066f30 0x7f4bf80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c00007fd0 tx=0x7f4c00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.711+0000 7f4bf2ffd700 1 -- 172.21.15.84:0/1511709610 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c04052030 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.895+0000 7f4c110e3700 1 -- 172.21.15.84:0/1511709610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c0c0b1880 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.896+0000 7f4bf2ffd700 1 -- 172.21.15.84:0/1511709610 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f4c04055650 con 0x7f4c0c0b07a0 2023-10-06T03:24:24.898 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:24.898 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 -- 172.21.15.84:0/1511709610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bf8066f30 msgr2=0x7f4bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bf8066f30 0x7f4bf80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c00007fd0 tx=0x7f4c00009040 comp rx=0 tx=0).stop 2023-10-06T03:24:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 -- 172.21.15.84:0/1511709610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 msgr2=0x7f4c0c16a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 0x7f4c0c16a100 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400d840 tx=0x7f4c04008040 comp rx=0 tx=0).stop 2023-10-06T03:24:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 -- 172.21.15.84:0/1511709610 shutdown_connections 2023-10-06T03:24:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bf8066f30 0x7f4bf80693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c0c1595a0 0x7f4c0c16c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c0c0b07a0 0x7f4c0c16a100 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 --2- 172.21.15.84:0/1511709610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c0c0b49e0 0x7f4c0c16a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 -- 172.21.15.84:0/1511709610 >> 172.21.15.84:0/1511709610 conn(0x7f4c0c099830 msgr2=0x7f4c0c0b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 -- 172.21.15.84:0/1511709610 shutdown_connections 2023-10-06T03:24:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:24.898+0000 7f4c110e3700 1 -- 172.21.15.84:0/1511709610 wait complete. 2023-10-06T03:24:24.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:47.554201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:48.881558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:52.564434+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:24.913 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:25.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.027+0000 7f711759e700 1 Processor -- start 2023-10-06T03:24:25.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.027+0000 7f711759e700 1 -- start start 2023-10-06T03:24:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f711759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71180b2660 0x7f71180cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f711759e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f71180b2a30 0x7f71180cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f711759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71180ceae0 0x7f71180cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f711759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71180cc9b0 con 0x7f71180ceae0 2023-10-06T03:24:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f711759e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71180cf4c0 con 0x7f71180b2a30 2023-10-06T03:24:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f711759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180cbda0 con 0x7f71180b2660 2023-10-06T03:24:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f7116d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71180ceae0 0x7f71180cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f7116d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71180ceae0 0x7f71180cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46108/0 (socket says 172.21.15.84:46108) 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f7116d9d700 1 -- 172.21.15.84:0/3911970365 learned_addr learned my addr 172.21.15.84:0/3911970365 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f7116d9d700 1 -- 172.21.15.84:0/3911970365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71180b2660 msgr2=0x7f71180cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f7115d9b700 1 --2- 172.21.15.84:0/3911970365 >> v2:172.21.15.131:3300/0 conn(0x7f71180b2a30 0x7f71180cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f711659c700 1 --2- 172.21.15.84:0/3911970365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71180b2660 0x7f71180cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f7116d9d700 1 --2- 172.21.15.84:0/3911970365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71180b2660 0x7f71180cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f7116d9d700 1 -- 172.21.15.84:0/3911970365 >> v2:172.21.15.131:3300/0 conn(0x7f71180b2a30 msgr2=0x7f71180cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f7116d9d700 1 --2- 172.21.15.84:0/3911970365 >> v2:172.21.15.131:3300/0 conn(0x7f71180b2a30 0x7f71180cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f7116d9d700 1 -- 172.21.15.84:0/3911970365 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180cc080 con 0x7f71180ceae0 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f7116d9d700 1 --2- 172.21.15.84:0/3911970365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 0x7f71180cef80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f71180893f0 tx=0x7f7108009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e7970a0b3e804f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f711559a700 1 -- 172.21.15.84:0/3911970365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710800b860 con 0x7f71180ceae0 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f711559a700 1 -- 172.21.15.84:0/3911970365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710800b9c0 con 0x7f71180ceae0 2023-10-06T03:24:25.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.028+0000 7f711559a700 1 -- 172.21.15.84:0/3911970365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710800bd60 con 0x7f71180ceae0 2023-10-06T03:24:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.029+0000 7f711759e700 1 -- 172.21.15.84:0/3911970365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 msgr2=0x7f71180cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.029+0000 7f711759e700 1 --2- 172.21.15.84:0/3911970365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 0x7f71180cef80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f71180893f0 tx=0x7f7108009250 comp rx=0 tx=0).stop 2023-10-06T03:24:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.029+0000 7f711759e700 1 -- 172.21.15.84:0/3911970365 shutdown_connections 2023-10-06T03:24:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.029+0000 7f711759e700 1 --2- 172.21.15.84:0/3911970365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 0x7f71180cef80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.029+0000 7f711759e700 1 --2- 172.21.15.84:0/3911970365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71180b2660 0x7f71180cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.029+0000 7f711759e700 1 --2- 172.21.15.84:0/3911970365 >> v2:172.21.15.131:3300/0 conn(0x7f71180b2a30 0x7f71180cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.029+0000 7f711759e700 1 -- 172.21.15.84:0/3911970365 >> 172.21.15.84:0/3911970365 conn(0x7f7118099560 msgr2=0x7f711806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.029+0000 7f711759e700 1 -- 172.21.15.84:0/3911970365 shutdown_connections 2023-10-06T03:24:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.029+0000 7f711759e700 1 -- 172.21.15.84:0/3911970365 wait complete. 2023-10-06T03:24:25.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.030+0000 7f711759e700 1 Processor -- start 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.030+0000 7f711759e700 1 -- start start 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f711759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71180b2660 0x7f7118169700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f711759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71180b2a30 0x7f71180c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f711759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 0x7f71180c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f711759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711809a170 con 0x7f71180ceae0 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f711759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711809a410 con 0x7f71180b2a30 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f711759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711809a6f0 con 0x7f71180b2660 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f7116d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 0x7f71180c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f7116d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 0x7f71180c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46122/0 (socket says 172.21.15.84:46122) 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f7116d9d700 1 -- 172.21.15.84:0/1185488483 learned_addr learned my addr 172.21.15.84:0/1185488483 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f7115d9b700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71180b2a30 0x7f71180c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f711659c700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71180b2660 0x7f7118169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f7116d9d700 1 -- 172.21.15.84:0/1185488483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71180b2660 msgr2=0x7f7118169700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f7116d9d700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71180b2660 0x7f7118169700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f7116d9d700 1 -- 172.21.15.84:0/1185488483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71180b2a30 msgr2=0x7f71180c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f7116d9d700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71180b2a30 0x7f71180c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f7116d9d700 1 -- 172.21.15.84:0/1185488483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71080094f0 con 0x7f71180ceae0 2023-10-06T03:24:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.031+0000 7f7116d9d700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 0x7f71180c67a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f711806fd00 tx=0x7f7108017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.032+0000 7f71067fc700 1 -- 172.21.15.84:0/1185488483 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710801a660 con 0x7f71180ceae0 2023-10-06T03:24:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.032+0000 7f71067fc700 1 -- 172.21.15.84:0/1185488483 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710801a7c0 con 0x7f71180ceae0 2023-10-06T03:24:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.032+0000 7f711759e700 1 -- 172.21.15.84:0/1185488483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711809a9d0 con 0x7f71180ceae0 2023-10-06T03:24:25.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.032+0000 7f71067fc700 1 -- 172.21.15.84:0/1185488483 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710801ab80 con 0x7f71180ceae0 2023-10-06T03:24:25.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.032+0000 7f711759e700 1 -- 172.21.15.84:0/1185488483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71181557f0 con 0x7f71180ceae0 2023-10-06T03:24:25.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.033+0000 7f711759e700 1 -- 172.21.15.84:0/1185488483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711805f270 con 0x7f71180ceae0 2023-10-06T03:24:25.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.033+0000 7f71067fc700 1 -- 172.21.15.84:0/1185488483 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f710802e440 con 0x7f71180ceae0 2023-10-06T03:24:25.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.033+0000 7f71067fc700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f70f8066f30 0x7f70f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.033+0000 7f71067fc700 1 -- 172.21.15.84:0/1185488483 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7108086af0 con 0x7f71180ceae0 2023-10-06T03:24:25.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.034+0000 7f711659c700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f70f8066f30 0x7f70f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.034+0000 7f711659c700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f70f8066f30 0x7f70f80693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f711000e470 tx=0x7f7110007630 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.038+0000 7f71067fc700 1 -- 172.21.15.84:0/1185488483 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7108053990 con 0x7f71180ceae0 2023-10-06T03:24:25.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.219+0000 7f711759e700 1 -- 172.21.15.84:0/1185488483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f71180cc360 con 0x7f71180ceae0 2023-10-06T03:24:25.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.220+0000 7f71067fc700 1 -- 172.21.15.84:0/1185488483 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7108056fb0 con 0x7f71180ceae0 2023-10-06T03:24:25.221 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:24:25.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.221+0000 7f711759e700 1 -- 172.21.15.84:0/1185488483 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f70f8066f30 msgr2=0x7f70f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.221+0000 7f711759e700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f70f8066f30 0x7f70f80693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f711000e470 tx=0x7f7110007630 comp rx=0 tx=0).stop 2023-10-06T03:24:25.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.221+0000 7f711759e700 1 -- 172.21.15.84:0/1185488483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 msgr2=0x7f71180c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.221+0000 7f711759e700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 0x7f71180c67a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f711806fd00 tx=0x7f7108017000 comp rx=0 tx=0).stop 2023-10-06T03:24:25.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.221+0000 7f711759e700 1 -- 172.21.15.84:0/1185488483 shutdown_connections 2023-10-06T03:24:25.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.221+0000 7f711759e700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f70f8066f30 0x7f70f80693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.221+0000 7f711759e700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71180ceae0 0x7f71180c67a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.221+0000 7f711759e700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71180b2660 0x7f7118169700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.221+0000 7f711759e700 1 --2- 172.21.15.84:0/1185488483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71180b2a30 0x7f71180c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.221+0000 7f711759e700 1 -- 172.21.15.84:0/1185488483 >> 172.21.15.84:0/1185488483 conn(0x7f7118099560 msgr2=0x7f7118069110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.222+0000 7f711759e700 1 -- 172.21.15.84:0/1185488483 shutdown_connections 2023-10-06T03:24:25.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.222+0000 7f711759e700 1 -- 172.21.15.84:0/1185488483 wait complete. 2023-10-06T03:24:25.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:25.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.350+0000 7fd2a8bd8700 1 Processor -- start 2023-10-06T03:24:25.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.350+0000 7fd2a8bd8700 1 -- start start 2023-10-06T03:24:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.351+0000 7fd2a8bd8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a40c6060 0x7fd2a40ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.351+0000 7fd2a8bd8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a40ae250 con 0x7fd2a4159950 2023-10-06T03:24:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.351+0000 7fd2a8bd8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a40ad640 con 0x7fd2a4159580 2023-10-06T03:24:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.351+0000 7fd2a8bd8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40ad920 con 0x7fd2a40c6060 2023-10-06T03:24:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.351+0000 7fd2a2ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd2a4159950 0x7fd2a40ae6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52212/0 (socket says 172.21.15.84:52212) 2023-10-06T03:24:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.351+0000 7fd2a2ffd700 1 -- 172.21.15.84:0/2333134708 learned_addr learned my addr 172.21.15.84:0/2333134708 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a3fff700 1 --2- 172.21.15.84:0/2333134708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a40c6060 0x7fd2a40ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a27fc700 1 -- 172.21.15.84:0/2333134708 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184210499 0 0) 0x7fd2a40ae250 con 0x7fd2a4159950 2023-10-06T03:24:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a27fc700 1 -- 172.21.15.84:0/2333134708 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd28c003570 con 0x7fd2a4159950 2023-10-06T03:24:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a27fc700 1 -- 172.21.15.84:0/2333134708 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690535391 0 0) 0x7fd2a40ad640 con 0x7fd2a4159580 2023-10-06T03:24:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a27fc700 1 -- 172.21.15.84:0/2333134708 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2a40ae250 con 0x7fd2a4159580 2023-10-06T03:24:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a3fff700 1 -- 172.21.15.84:0/2333134708 >> v1:172.21.15.131:6789/0 conn(0x7fd2a4159580 legacy=0x7fd2a40ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a3fff700 1 -- 172.21.15.84:0/2333134708 >> v1:172.21.15.84:6789/0 conn(0x7fd2a4159950 legacy=0x7fd2a40ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a3fff700 1 -- 172.21.15.84:0/2333134708 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a40adc00 con 0x7fd2a40c6060 2023-10-06T03:24:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a3fff700 1 --2- 172.21.15.84:0/2333134708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a40c6060 0x7fd2a40ce890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009910 tx=0x7fd29c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3a989c37084469d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a27fc700 1 -- 172.21.15.84:0/2333134708 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c011630 con 0x7fd2a40c6060 2023-10-06T03:24:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a27fc700 1 -- 172.21.15.84:0/2333134708 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c011790 con 0x7fd2a40c6060 2023-10-06T03:24:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.352+0000 7fd2a27fc700 1 -- 172.21.15.84:0/2333134708 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c011b10 con 0x7fd2a40c6060 2023-10-06T03:24:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.353+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/2333134708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a40c6060 msgr2=0x7fd2a40ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.353+0000 7fd2a8bd8700 1 --2- 172.21.15.84:0/2333134708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a40c6060 0x7fd2a40ce890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009910 tx=0x7fd29c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.353+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/2333134708 shutdown_connections 2023-10-06T03:24:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.353+0000 7fd2a8bd8700 1 --2- 172.21.15.84:0/2333134708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a40c6060 0x7fd2a40ce890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.353+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/2333134708 >> 172.21.15.84:0/2333134708 conn(0x7fd2a4099560 msgr2=0x7fd2a406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.353+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/2333134708 shutdown_connections 2023-10-06T03:24:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.353+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/2333134708 wait complete. 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.354+0000 7fd2a8bd8700 1 Processor -- start 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.354+0000 7fd2a8bd8700 1 -- start start 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a8bd8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2a40c6060 0x7fd2a40b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a8bd8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2a4159580 0x7fd2a40c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a8bd8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a4159950 0x7fd2a40c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a8bd8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40b5f10 con 0x7fd2a40c6060 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a8bd8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40b47b0 con 0x7fd2a4159580 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a8bd8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a4156150 con 0x7fd2a4159950 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2a40c6060 0x7fd2a40b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2a40c6060 0x7fd2a40b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46128/0 (socket says 172.21.15.84:46128) 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a37fe700 1 -- 172.21.15.84:0/3921463277 learned_addr learned my addr 172.21.15.84:0/3921463277 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a2ffd700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2a4159580 0x7fd2a40c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.355+0000 7fd2a3fff700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a4159950 0x7fd2a40c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd2a37fe700 1 -- 172.21.15.84:0/3921463277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a4159950 msgr2=0x7fd2a40c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd2a37fe700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a4159950 0x7fd2a40c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd2a37fe700 1 -- 172.21.15.84:0/3921463277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2a4159580 msgr2=0x7fd2a40c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd2a37fe700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2a4159580 0x7fd2a40c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd2a37fe700 1 -- 172.21.15.84:0/3921463277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c009420 con 0x7fd2a40c6060 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd2a37fe700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2a40c6060 0x7fd2a40b56c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd29400c8e0 tx=0x7fd294002740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd28b7fe700 1 -- 172.21.15.84:0/3921463277 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd294012630 con 0x7fd2a40c6060 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd28b7fe700 1 -- 172.21.15.84:0/3921463277 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2940127b0 con 0x7fd2a40c6060 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd28b7fe700 1 -- 172.21.15.84:0/3921463277 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd294012b70 con 0x7fd2a40c6060 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/3921463277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a40b3e80 con 0x7fd2a40c6060 2023-10-06T03:24:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.356+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/3921463277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a40b4440 con 0x7fd2a40c6060 2023-10-06T03:24:25.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.357+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/3921463277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a40b4a90 con 0x7fd2a40c6060 2023-10-06T03:24:25.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.358+0000 7fd28b7fe700 1 -- 172.21.15.84:0/3921463277 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd29401b400 con 0x7fd2a40c6060 2023-10-06T03:24:25.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.358+0000 7fd28b7fe700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd290066f30 0x7fd2900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.358+0000 7fd28b7fe700 1 -- 172.21.15.84:0/3921463277 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd294085230 con 0x7fd2a40c6060 2023-10-06T03:24:25.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.358+0000 7fd2a2ffd700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd290066f30 0x7fd2900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.359+0000 7fd2a2ffd700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd290066f30 0x7fd2900693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4069f30 tx=0x7fd298009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.366+0000 7fd28b7fe700 1 -- 172.21.15.84:0/3921463277 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2940520d0 con 0x7fd2a40c6060 2023-10-06T03:24:25.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.547+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/3921463277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2a405f270 con 0x7fd2a40c6060 2023-10-06T03:24:25.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.548+0000 7fd28b7fe700 1 -- 172.21.15.84:0/3921463277 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2940556f0 con 0x7fd2a40c6060 2023-10-06T03:24:25.550 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:24:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/3921463277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd290066f30 msgr2=0x7fd2900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd290066f30 0x7fd2900693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4069f30 tx=0x7fd298009040 comp rx=0 tx=0).stop 2023-10-06T03:24:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/3921463277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2a40c6060 msgr2=0x7fd2a40b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2a40c6060 0x7fd2a40b56c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd29400c8e0 tx=0x7fd294002740 comp rx=0 tx=0).stop 2023-10-06T03:24:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/3921463277 shutdown_connections 2023-10-06T03:24:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd290066f30 0x7fd2900693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a4159950 0x7fd2a40c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2a40c6060 0x7fd2a40b56c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 --2- 172.21.15.84:0/3921463277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2a4159580 0x7fd2a40c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/3921463277 >> 172.21.15.84:0/3921463277 conn(0x7fd2a4099560 msgr2=0x7fd2a4158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/3921463277 shutdown_connections 2023-10-06T03:24:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.551+0000 7fd2a8bd8700 1 -- 172.21.15.84:0/3921463277 wait complete. 2023-10-06T03:24:25.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:25.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.682+0000 7ff735c1f700 1 Processor -- start 2023-10-06T03:24:25.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.682+0000 7ff735c1f700 1 -- start start 2023-10-06T03:24:25.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff735c1f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7300c9fa0 0x7ff7301592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff735c1f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff73006e210 0x7ff7300cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff735c1f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7300cad00 con 0x7ff73006de40 2023-10-06T03:24:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff735c1f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff730067720 con 0x7ff73006e210 2023-10-06T03:24:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff735c1f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7300cc790 con 0x7ff7300c9fa0 2023-10-06T03:24:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff72f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff73006de40 0x7ff730158be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52218/0 (socket says 172.21.15.84:52218) 2023-10-06T03:24:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff72f7fe700 1 -- 172.21.15.84:0/1366353595 learned_addr learned my addr 172.21.15.84:0/1366353595 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440360996 0 0) 0x7ff7300cad00 con 0x7ff73006de40 2023-10-06T03:24:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff718003570 con 0x7ff73006de40 2023-10-06T03:24:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff72effd700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7300c9fa0 0x7ff7301592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.683+0000 7ff72ffff700 1 --2- 172.21.15.84:0/1366353595 >> v2:172.21.15.131:3300/0 conn(0x7ff73006e210 0x7ff7300cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827056014 0 0) 0x7ff718003570 con 0x7ff73006de40 2023-10-06T03:24:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7300c9fa0 msgr2=0x7ff7301592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7300c9fa0 0x7ff7301592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 >> v2:172.21.15.131:3300/0 conn(0x7ff73006e210 msgr2=0x7ff7300cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 --2- 172.21.15.84:0/1366353595 >> v2:172.21.15.131:3300/0 conn(0x7ff73006e210 0x7ff7300cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7300ca460 con 0x7ff73006de40 2023-10-06T03:24:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7ff720001470 con 0x7ff73006de40 2023-10-06T03:24:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 >> v1:172.21.15.84:6789/0 conn(0x7ff73006de40 legacy=0x7ff730158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 0x7ff718003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff718004810 0x7ff718004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7180051c0 0x7ff71800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff730067720 con 0x7ff718003a60 2023-10-06T03:24:25.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7300cc790 con 0x7ff718004810 2023-10-06T03:24:25.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71800bfa0 con 0x7ff7180051c0 2023-10-06T03:24:25.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72f7fe700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 0x7ff718003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72effd700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7300c9fa0 0x7ff7301592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:25.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72ffff700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7180051c0 0x7ff71800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72f7fe700 1 -- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7180051c0 msgr2=0x7ff71800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72f7fe700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7180051c0 0x7ff71800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72f7fe700 1 -- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff718004810 msgr2=0x7ff718004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72f7fe700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff718004810 0x7ff718004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72f7fe700 1 -- 172.21.15.84:0/1366353595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718003570 con 0x7ff718003a60 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72f7fe700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 0x7ff718003e70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c340 tx=0x7ff720007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a480572639b458e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000cc30 con 0x7ff718003a60 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72000cd90 con 0x7ff718003a60 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.684+0000 7ff72e7fc700 1 -- 172.21.15.84:0/1366353595 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720005b70 con 0x7ff718003a60 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.685+0000 7ff735c1f700 1 -- 172.21.15.84:0/1366353595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 msgr2=0x7ff718003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.685+0000 7ff735c1f700 1 --2- 172.21.15.84:0/1366353595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 0x7ff718003e70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c340 tx=0x7ff720007940 comp rx=0 tx=0).stop 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.685+0000 7ff72ffff700 1 -- 172.21.15.84:0/1366353595 reap_dead start 2023-10-06T03:24:25.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.685+0000 7ff735c1f700 1 -- 172.21.15.84:0/1366353595 shutdown_connections 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.685+0000 7ff735c1f700 1 -- 172.21.15.84:0/1366353595 >> 172.21.15.84:0/1366353595 conn(0x7ff7300cd410 msgr2=0x7ff7300b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.685+0000 7ff735c1f700 1 -- 172.21.15.84:0/1366353595 shutdown_connections 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.685+0000 7ff735c1f700 1 -- 172.21.15.84:0/1366353595 wait complete. 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.686+0000 7ff735c1f700 1 Processor -- start 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.686+0000 7ff735c1f700 1 -- start start 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff735c1f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 0x7ff73015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff735c1f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff73014f410 0x7ff7301688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff735c1f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff73014f880 0x7ff7301565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff735c1f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73015c060 con 0x7ff718003a60 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff735c1f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff730167cd0 con 0x7ff73014f880 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff735c1f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff730167fb0 con 0x7ff73014f410 2023-10-06T03:24:25.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 0x7ff73015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 0x7ff73015bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46144/0 (socket says 172.21.15.84:46144) 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72f7fe700 1 -- 172.21.15.84:0/3348888559 learned_addr learned my addr 172.21.15.84:0/3348888559 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72effd700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff73014f410 0x7ff7301688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72ffff700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff73014f880 0x7ff7301565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72f7fe700 1 -- 172.21.15.84:0/3348888559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff73014f410 msgr2=0x7ff7301688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72f7fe700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff73014f410 0x7ff7301688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72f7fe700 1 -- 172.21.15.84:0/3348888559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff73014f880 msgr2=0x7ff7301565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72f7fe700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff73014f880 0x7ff7301565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72f7fe700 1 -- 172.21.15.84:0/3348888559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730168290 con 0x7ff718003a60 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.687+0000 7ff72f7fe700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 0x7ff73015bb20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff718005760 tx=0x7ff720015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.688+0000 7ff7177fe700 1 -- 172.21.15.84:0/3348888559 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000cc30 con 0x7ff718003a60 2023-10-06T03:24:25.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.688+0000 7ff7177fe700 1 -- 172.21.15.84:0/3348888559 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff720001bd0 con 0x7ff718003a60 2023-10-06T03:24:25.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.688+0000 7ff735c1f700 1 -- 172.21.15.84:0/3348888559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73015c060 con 0x7ff718003a60 2023-10-06T03:24:25.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.688+0000 7ff7177fe700 1 -- 172.21.15.84:0/3348888559 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720007550 con 0x7ff718003a60 2023-10-06T03:24:25.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.688+0000 7ff735c1f700 1 -- 172.21.15.84:0/3348888559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7300c1970 con 0x7ff718003a60 2023-10-06T03:24:25.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.688+0000 7ff735c1f700 1 -- 172.21.15.84:0/3348888559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73016b0b0 con 0x7ff718003a60 2023-10-06T03:24:25.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.689+0000 7ff7177fe700 1 -- 172.21.15.84:0/3348888559 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff72001f410 con 0x7ff718003a60 2023-10-06T03:24:25.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.689+0000 7ff7177fe700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff71c066f30 0x7ff71c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.689+0000 7ff7177fe700 1 -- 172.21.15.84:0/3348888559 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff7200863d0 con 0x7ff718003a60 2023-10-06T03:24:25.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.689+0000 7ff72effd700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff71c066f30 0x7ff71c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.690+0000 7ff72effd700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff71c066f30 0x7ff71c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff724006f00 tx=0x7ff724008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.694+0000 7ff7177fe700 1 -- 172.21.15.84:0/3348888559 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7200531f0 con 0x7ff718003a60 2023-10-06T03:24:25.806 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:24:25.808 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:24:25.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.876+0000 7ff735c1f700 1 -- 172.21.15.84:0/3348888559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff730064ad0 con 0x7ff718003a60 2023-10-06T03:24:25.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.876+0000 7ff7177fe700 1 -- 172.21.15.84:0/3348888559 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff720056810 con 0x7ff718003a60 2023-10-06T03:24:25.878 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 -- 172.21.15.84:0/3348888559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff71c066f30 msgr2=0x7ff71c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff71c066f30 0x7ff71c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff724006f00 tx=0x7ff724008040 comp rx=0 tx=0).stop 2023-10-06T03:24:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 -- 172.21.15.84:0/3348888559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 msgr2=0x7ff73015bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 0x7ff73015bb20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff718005760 tx=0x7ff720015000 comp rx=0 tx=0).stop 2023-10-06T03:24:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 -- 172.21.15.84:0/3348888559 shutdown_connections 2023-10-06T03:24:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff71c066f30 0x7ff71c0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff73014f880 0x7ff7301565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff718003a60 0x7ff73015bb20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 --2- 172.21.15.84:0/3348888559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff73014f410 0x7ff7301688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 -- 172.21.15.84:0/3348888559 >> 172.21.15.84:0/3348888559 conn(0x7ff7300cd410 msgr2=0x7ff730158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 -- 172.21.15.84:0/3348888559 shutdown_connections 2023-10-06T03:24:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:25.878+0000 7ff735c1f700 1 -- 172.21.15.84:0/3348888559 wait complete. 2023-10-06T03:24:25.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.047+0000 7f8a9228c700 1 Processor -- start 2023-10-06T03:24:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.047+0000 7f8a9228c700 1 -- start start 2023-10-06T03:24:26.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8c159510 0x7f8a8c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a8c1598e0 0x7f8a8c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8a8c0ce820 0x7f8a8c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8c0cf610 con 0x7f8a8c1598e0 2023-10-06T03:24:26.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8c0cf8f0 con 0x7f8a8c0ce820 2023-10-06T03:24:26.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0cfbd0 con 0x7f8a8c159510 2023-10-06T03:24:26.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a8c1598e0 0x7f8a8c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a8c1598e0 0x7f8a8c0cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46146/0 (socket says 172.21.15.84:46146) 2023-10-06T03:24:26.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8b7fe700 1 -- 172.21.15.84:0/1919183217 learned_addr learned my addr 172.21.15.84:0/1919183217 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:26.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8b7fe700 1 -- 172.21.15.84:0/1919183217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8c159510 msgr2=0x7f8a8c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:26.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8bfff700 1 --2- 172.21.15.84:0/1919183217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8c159510 0x7f8a8c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a90829700 1 --2- 172.21.15.84:0/1919183217 >> v2:172.21.15.131:3300/0 conn(0x7f8a8c0ce820 0x7f8a8c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8b7fe700 1 --2- 172.21.15.84:0/1919183217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8c159510 0x7f8a8c0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8b7fe700 1 -- 172.21.15.84:0/1919183217 >> v2:172.21.15.131:3300/0 conn(0x7f8a8c0ce820 msgr2=0x7f8a8c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8b7fe700 1 --2- 172.21.15.84:0/1919183217 >> v2:172.21.15.131:3300/0 conn(0x7f8a8c0ce820 0x7f8a8c0cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8b7fe700 1 -- 172.21.15.84:0/1919183217 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c0cfeb0 con 0x7f8a8c1598e0 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8b7fe700 1 --2- 172.21.15.84:0/1919183217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 0x7f8a8c0cbae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c08acb0 tx=0x7f8a7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ea76d61a973b9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8affd700 1 -- 172.21.15.84:0/1919183217 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00b860 con 0x7f8a8c1598e0 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8affd700 1 -- 172.21.15.84:0/1919183217 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c00b9c0 con 0x7f8a8c1598e0 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a8affd700 1 -- 172.21.15.84:0/1919183217 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00bd60 con 0x7f8a8c1598e0 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 -- 172.21.15.84:0/1919183217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 msgr2=0x7f8a8c0cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 --2- 172.21.15.84:0/1919183217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 0x7f8a8c0cbae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c08acb0 tx=0x7f8a7c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 -- 172.21.15.84:0/1919183217 shutdown_connections 2023-10-06T03:24:26.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 --2- 172.21.15.84:0/1919183217 >> v2:172.21.15.131:3300/0 conn(0x7f8a8c0ce820 0x7f8a8c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 --2- 172.21.15.84:0/1919183217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8c159510 0x7f8a8c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 --2- 172.21.15.84:0/1919183217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 0x7f8a8c0cbae0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 -- 172.21.15.84:0/1919183217 >> 172.21.15.84:0/1919183217 conn(0x7f8a8c089e90 msgr2=0x7f8a8c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 -- 172.21.15.84:0/1919183217 shutdown_connections 2023-10-06T03:24:26.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.049+0000 7f8a9228c700 1 -- 172.21.15.84:0/1919183217 wait complete. 2023-10-06T03:24:26.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.050+0000 7f8a9228c700 1 Processor -- start 2023-10-06T03:24:26.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.051+0000 7f8a9228c700 1 -- start start 2023-10-06T03:24:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.051+0000 7f8a9228c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8c0ce820 0x7f8a8c15c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.051+0000 7f8a9228c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c159510 0x7f8a8c149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.051+0000 7f8a9228c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 0x7f8a8c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.051+0000 7f8a9228c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c15c2d0 con 0x7f8a8c1598e0 2023-10-06T03:24:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.051+0000 7f8a9228c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c149ba0 con 0x7f8a8c159510 2023-10-06T03:24:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.051+0000 7f8a9228c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c15b9e0 con 0x7f8a8c0ce820 2023-10-06T03:24:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.051+0000 7f8a90829700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 0x7f8a8c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.051+0000 7f8a90829700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 0x7f8a8c0b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46156/0 (socket says 172.21.15.84:46156) 2023-10-06T03:24:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.051+0000 7f8a90829700 1 -- 172.21.15.84:0/546660778 learned_addr learned my addr 172.21.15.84:0/546660778 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a8b7fe700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c159510 0x7f8a8c149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a8bfff700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8c0ce820 0x7f8a8c15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a90829700 1 -- 172.21.15.84:0/546660778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8c0ce820 msgr2=0x7f8a8c15c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a90829700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8c0ce820 0x7f8a8c15c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a90829700 1 -- 172.21.15.84:0/546660778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c159510 msgr2=0x7f8a8c149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a90829700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c159510 0x7f8a8c149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a90829700 1 -- 172.21.15.84:0/546660778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c0094f0 con 0x7f8a8c1598e0 2023-10-06T03:24:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a90829700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 0x7f8a8c0b4940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400cde0 tx=0x7f8a840077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a73fff700 1 -- 172.21.15.84:0/546660778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400ab50 con 0x7f8a8c1598e0 2023-10-06T03:24:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a73fff700 1 -- 172.21.15.84:0/546660778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8400acb0 con 0x7f8a8c1598e0 2023-10-06T03:24:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a9228c700 1 -- 172.21.15.84:0/546660778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c0b5350 con 0x7f8a8c1598e0 2023-10-06T03:24:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a73fff700 1 -- 172.21.15.84:0/546660778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84017660 con 0x7f8a8c1598e0 2023-10-06T03:24:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.052+0000 7f8a9228c700 1 -- 172.21.15.84:0/546660778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c15bf60 con 0x7f8a8c1598e0 2023-10-06T03:24:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.053+0000 7f8a9228c700 1 -- 172.21.15.84:0/546660778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8c15c440 con 0x7f8a8c1598e0 2023-10-06T03:24:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.053+0000 7f8a73fff700 1 -- 172.21.15.84:0/546660778 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a84003020 con 0x7f8a8c1598e0 2023-10-06T03:24:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.054+0000 7f8a73fff700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a78066f30 0x7f8a780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.054+0000 7f8a73fff700 1 -- 172.21.15.84:0/546660778 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8a84013070 con 0x7f8a8c1598e0 2023-10-06T03:24:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.054+0000 7f8a8bfff700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a78066f30 0x7f8a780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.054+0000 7f8a8bfff700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a78066f30 0x7f8a780693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a800089b0 tx=0x7f8a80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.059+0000 7f8a73fff700 1 -- 172.21.15.84:0/546660778 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a84088030 con 0x7f8a8c1598e0 2023-10-06T03:24:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.239+0000 7f8a9228c700 1 -- 172.21.15.84:0/546660778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a8c064ad0 con 0x7f8a8c1598e0 2023-10-06T03:24:26.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.240+0000 7f8a73fff700 1 -- 172.21.15.84:0/546660778 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a84051db0 con 0x7f8a8c1598e0 2023-10-06T03:24:26.242 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:24:26.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.241+0000 7f8a9228c700 1 -- 172.21.15.84:0/546660778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a78066f30 msgr2=0x7f8a780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.241+0000 7f8a9228c700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a78066f30 0x7f8a780693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a800089b0 tx=0x7f8a80008040 comp rx=0 tx=0).stop 2023-10-06T03:24:26.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.241+0000 7f8a9228c700 1 -- 172.21.15.84:0/546660778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 msgr2=0x7f8a8c0b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.241+0000 7f8a9228c700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 0x7f8a8c0b4940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400cde0 tx=0x7f8a840077d0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.242+0000 7f8a9228c700 1 -- 172.21.15.84:0/546660778 shutdown_connections 2023-10-06T03:24:26.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.242+0000 7f8a9228c700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a78066f30 0x7f8a780693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.242+0000 7f8a9228c700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a8c1598e0 0x7f8a8c0b4940 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.242+0000 7f8a9228c700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8c0ce820 0x7f8a8c15c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.242+0000 7f8a9228c700 1 --2- 172.21.15.84:0/546660778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c159510 0x7f8a8c149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.242+0000 7f8a9228c700 1 -- 172.21.15.84:0/546660778 >> 172.21.15.84:0/546660778 conn(0x7f8a8c089e90 msgr2=0x7f8a8c14c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.242+0000 7f8a9228c700 1 -- 172.21.15.84:0/546660778 shutdown_connections 2023-10-06T03:24:26.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.242+0000 7f8a9228c700 1 -- 172.21.15.84:0/546660778 wait complete. 2023-10-06T03:24:26.255 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.371+0000 7f9f738b3700 1 Processor -- start 2023-10-06T03:24:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.371+0000 7f9f738b3700 1 -- start start 2023-10-06T03:24:26.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f738b3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9f6c0b0a50 0x7f9f6c0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f738b3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6c0c5400 con 0x7f9f6c0cc460 2023-10-06T03:24:26.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f738b3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6c0ccd40 con 0x7f9f6c0b0680 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f738b3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6c0ca7d0 con 0x7f9f6c0b0a50 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f71e50700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9f6c0cc460 0x7f9f6c0c9090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52230/0 (socket says 172.21.15.84:52230) 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f71e50700 1 -- 172.21.15.84:0/737366684 learned_addr learned my addr 172.21.15.84:0/737366684 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f70e4e700 1 --2- 172.21.15.84:0/737366684 >> v2:172.21.15.131:3300/0 conn(0x7f9f6c0b0a50 0x7f9f6c0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192808532 0 0) 0x7f9f6c0c5400 con 0x7f9f6c0cc460 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f58003570 con 0x7f9f6c0cc460 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3706707045 0 0) 0x7f9f58003570 con 0x7f9f6c0cc460 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 >> v2:172.21.15.131:3300/0 conn(0x7f9f6c0b0a50 msgr2=0x7f9f6c0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 --2- 172.21.15.84:0/737366684 >> v2:172.21.15.131:3300/0 conn(0x7f9f6c0b0a50 0x7f9f6c0cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 >> v1:172.21.15.131:6789/0 conn(0x7f9f6c0b0680 legacy=0x7f9f6c0ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c0cd020 con 0x7f9f6c0cc460 2023-10-06T03:24:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f9f640017f0 con 0x7f9f6c0cc460 2023-10-06T03:24:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 >> v1:172.21.15.84:6789/0 conn(0x7f9f6c0cc460 legacy=0x7f9f6c0c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f58003a60 0x7f9f58003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f580051c0 0x7f9f5800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0ca7d0 con 0x7f9f58004810 2023-10-06T03:24:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5800c0e0 con 0x7f9f580051c0 2023-10-06T03:24:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.372+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5800c2a0 con 0x7f9f58003a60 2023-10-06T03:24:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f70e4e700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f7164f700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f58003a60 0x7f9f58003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f71e50700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f580051c0 0x7f9f5800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f70e4e700 1 -- 172.21.15.84:0/737366684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f58003a60 msgr2=0x7f9f58003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f70e4e700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f58003a60 0x7f9f58003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f70e4e700 1 -- 172.21.15.84:0/737366684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f580051c0 msgr2=0x7f9f5800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f70e4e700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f580051c0 0x7f9f5800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f70e4e700 1 -- 172.21.15.84:0/737366684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f58003570 con 0x7f9f58004810 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f7164f700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f58003a60 0x7f9f58003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f71e50700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f580051c0 0x7f9f5800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f71e50700 1 -- 172.21.15.84:0/737366684 reap_dead start 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f70e4e700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f58004c80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009c00 tx=0x7f9f5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8a23efd05595ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c00e710 con 0x7f9f58004810 2023-10-06T03:24:26.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c00e870 con 0x7f9f58004810 2023-10-06T03:24:26.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.373+0000 7f9f63fff700 1 -- 172.21.15.84:0/737366684 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c00ec30 con 0x7f9f58004810 2023-10-06T03:24:26.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.374+0000 7f9f738b3700 1 -- 172.21.15.84:0/737366684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 msgr2=0x7f9f58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.374+0000 7f9f738b3700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f58004c80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009c00 tx=0x7f9f5c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.374+0000 7f9f738b3700 1 -- 172.21.15.84:0/737366684 shutdown_connections 2023-10-06T03:24:26.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.374+0000 7f9f738b3700 1 --2- 172.21.15.84:0/737366684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f58004c80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.374+0000 7f9f738b3700 1 -- 172.21.15.84:0/737366684 >> 172.21.15.84:0/737366684 conn(0x7f9f6c088000 msgr2=0x7f9f6c0ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.374+0000 7f9f738b3700 1 -- 172.21.15.84:0/737366684 shutdown_connections 2023-10-06T03:24:26.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.374+0000 7f9f738b3700 1 -- 172.21.15.84:0/737366684 wait complete. 2023-10-06T03:24:26.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.376+0000 7f9f738b3700 1 Processor -- start 2023-10-06T03:24:26.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.376+0000 7f9f738b3700 1 -- start start 2023-10-06T03:24:26.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f738b3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f6c0c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f738b3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6c16b620 0x7f9f6c16abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f738b3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c16b120 0x7f9f6c0af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f738b3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c151ff0 con 0x7f9f58004810 2023-10-06T03:24:26.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f738b3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c1522d0 con 0x7f9f6c16b120 2023-10-06T03:24:26.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f738b3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0c5b60 con 0x7f9f6c16b620 2023-10-06T03:24:26.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f7164f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f6c0c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f7164f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f6c0c5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46180/0 (socket says 172.21.15.84:46180) 2023-10-06T03:24:26.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f7164f700 1 -- 172.21.15.84:0/3377749734 learned_addr learned my addr 172.21.15.84:0/3377749734 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:26.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f71e50700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c16b120 0x7f9f6c0af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f70e4e700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6c16b620 0x7f9f6c16abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f7164f700 1 -- 172.21.15.84:0/3377749734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6c16b620 msgr2=0x7f9f6c16abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f7164f700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6c16b620 0x7f9f6c16abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f7164f700 1 -- 172.21.15.84:0/3377749734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c16b120 msgr2=0x7f9f6c0af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f7164f700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c16b120 0x7f9f6c0af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f7164f700 1 -- 172.21.15.84:0/3377749734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c153b00 con 0x7f9f58004810 2023-10-06T03:24:26.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f71e50700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c16b120 0x7f9f6c0af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:26.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f70e4e700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6c16b620 0x7f9f6c16abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:26.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f7164f700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f6c0c5620 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800e5e0 tx=0x7f9f68009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f617fa700 1 -- 172.21.15.84:0/3377749734 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f68010520 con 0x7f9f58004810 2023-10-06T03:24:26.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f617fa700 1 -- 172.21.15.84:0/3377749734 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f68010680 con 0x7f9f58004810 2023-10-06T03:24:26.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f617fa700 1 -- 172.21.15.84:0/3377749734 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f68010a00 con 0x7f9f58004810 2023-10-06T03:24:26.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f738b3700 1 -- 172.21.15.84:0/3377749734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c153de0 con 0x7f9f58004810 2023-10-06T03:24:26.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f738b3700 1 -- 172.21.15.84:0/3377749734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c16ba90 con 0x7f9f58004810 2023-10-06T03:24:26.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.377+0000 7f9f738b3700 1 -- 172.21.15.84:0/3377749734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c154280 con 0x7f9f58004810 2023-10-06T03:24:26.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.378+0000 7f9f617fa700 1 -- 172.21.15.84:0/3377749734 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f68014480 con 0x7f9f58004810 2023-10-06T03:24:26.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.378+0000 7f9f617fa700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9f50066f30 0x7f9f500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.378+0000 7f9f617fa700 1 -- 172.21.15.84:0/3377749734 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9f68084340 con 0x7f9f58004810 2023-10-06T03:24:26.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.378+0000 7f9f70e4e700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9f50066f30 0x7f9f500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.379+0000 7f9f70e4e700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9f50066f30 0x7f9f500693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c155470 tx=0x7f9f5c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.382+0000 7f9f617fa700 1 -- 172.21.15.84:0/3377749734 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f6804d5a0 con 0x7f9f58004810 2023-10-06T03:24:26.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.563+0000 7f9f738b3700 1 -- 172.21.15.84:0/3377749734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9f6c064ad0 con 0x7f9f58004810 2023-10-06T03:24:26.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.563+0000 7f9f617fa700 1 -- 172.21.15.84:0/3377749734 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9f68051210 con 0x7f9f58004810 2023-10-06T03:24:26.565 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:26.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 -- 172.21.15.84:0/3377749734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9f50066f30 msgr2=0x7f9f500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9f50066f30 0x7f9f500693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c155470 tx=0x7f9f5c01a000 comp rx=0 tx=0).stop 2023-10-06T03:24:26.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 -- 172.21.15.84:0/3377749734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 msgr2=0x7f9f6c0c5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f6c0c5620 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800e5e0 tx=0x7f9f68009040 comp rx=0 tx=0).stop 2023-10-06T03:24:26.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 -- 172.21.15.84:0/3377749734 shutdown_connections 2023-10-06T03:24:26.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9f50066f30 0x7f9f500693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c16b120 0x7f9f6c0af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f58004810 0x7f9f6c0c5620 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 --2- 172.21.15.84:0/3377749734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6c16b620 0x7f9f6c16abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 -- 172.21.15.84:0/3377749734 >> 172.21.15.84:0/3377749734 conn(0x7f9f6c088000 msgr2=0x7f9f6c0c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 -- 172.21.15.84:0/3377749734 shutdown_connections 2023-10-06T03:24:26.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.565+0000 7f9f738b3700 1 -- 172.21.15.84:0/3377749734 wait complete. 2023-10-06T03:24:26.580 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.693+0000 7f2938ec8700 1 Processor -- start 2023-10-06T03:24:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.693+0000 7f2938ec8700 1 -- start start 2023-10-06T03:24:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2938ec8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29340cc830 0x7f293406e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2938ec8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29340ccc80 0x7f2934069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2938ec8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29340c7370 con 0x7f29340ac040 2023-10-06T03:24:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2938ec8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2934156150 con 0x7f29340ccc80 2023-10-06T03:24:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2938ec8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29340c6760 con 0x7f29340cc830 2023-10-06T03:24:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2932d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29340ccc80 0x7f2934069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2932d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29340ccc80 0x7f2934069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46182/0 (socket says 172.21.15.84:46182) 2023-10-06T03:24:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2932d9d700 1 -- 172.21.15.84:0/422500383 learned_addr learned my addr 172.21.15.84:0/422500383 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2931d9b700 1 --2- 172.21.15.84:0/422500383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29340cc830 0x7f293406e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2932d9d700 1 -- 172.21.15.84:0/422500383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29340cc830 msgr2=0x7f293406e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2932d9d700 1 --2- 172.21.15.84:0/422500383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29340cc830 0x7f293406e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2932d9d700 1 -- 172.21.15.84:0/422500383 >> v1:172.21.15.131:6789/0 conn(0x7f29340ac040 legacy=0x7f29340adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2932d9d700 1 -- 172.21.15.84:0/422500383 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340c6a40 con 0x7f29340ccc80 2023-10-06T03:24:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f2932d9d700 1 --2- 172.21.15.84:0/422500383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340ccc80 0x7f2934069560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f292c009f50 tx=0x7f292c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98801dfda46762e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f293159a700 1 -- 172.21.15.84:0/422500383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00e070 con 0x7f29340ccc80 2023-10-06T03:24:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f293159a700 1 -- 172.21.15.84:0/422500383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c00ba30 con 0x7f29340ccc80 2023-10-06T03:24:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.694+0000 7f293159a700 1 -- 172.21.15.84:0/422500383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0092e0 con 0x7f29340ccc80 2023-10-06T03:24:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.695+0000 7f2938ec8700 1 -- 172.21.15.84:0/422500383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340ccc80 msgr2=0x7f2934069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.695+0000 7f2938ec8700 1 --2- 172.21.15.84:0/422500383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340ccc80 0x7f2934069560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f292c009f50 tx=0x7f292c009840 comp rx=0 tx=0).stop 2023-10-06T03:24:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.695+0000 7f2938ec8700 1 -- 172.21.15.84:0/422500383 shutdown_connections 2023-10-06T03:24:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.695+0000 7f2938ec8700 1 --2- 172.21.15.84:0/422500383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340ccc80 0x7f2934069560 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.695+0000 7f2938ec8700 1 --2- 172.21.15.84:0/422500383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29340cc830 0x7f293406e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.695+0000 7f2938ec8700 1 -- 172.21.15.84:0/422500383 >> 172.21.15.84:0/422500383 conn(0x7f29340680c0 msgr2=0x7f29340cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.695+0000 7f2938ec8700 1 -- 172.21.15.84:0/422500383 shutdown_connections 2023-10-06T03:24:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.695+0000 7f2938ec8700 1 -- 172.21.15.84:0/422500383 wait complete. 2023-10-06T03:24:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.696+0000 7f2938ec8700 1 Processor -- start 2023-10-06T03:24:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.696+0000 7f2938ec8700 1 -- start start 2023-10-06T03:24:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2938ec8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29340ac040 0x7f29340c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2938ec8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340cc830 0x7f2934154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2938ec8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29340ccc80 0x7f29341554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2938ec8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29340c0f70 con 0x7f29340cc830 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2938ec8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934155a30 con 0x7f29340ccc80 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2938ec8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29341599e0 con 0x7f29340ac040 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2931d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340cc830 0x7f2934154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2931d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340cc830 0x7f2934154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46196/0 (socket says 172.21.15.84:46196) 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2931d9b700 1 -- 172.21.15.84:0/957273969 learned_addr learned my addr 172.21.15.84:0/957273969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f293259c700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29340ac040 0x7f29340c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2932d9d700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29340ccc80 0x7f29341554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2931d9b700 1 -- 172.21.15.84:0/957273969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29340ac040 msgr2=0x7f29340c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2931d9b700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29340ac040 0x7f29340c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2931d9b700 1 -- 172.21.15.84:0/957273969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29340ccc80 msgr2=0x7f29341554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2931d9b700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29340ccc80 0x7f29341554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2931d9b700 1 -- 172.21.15.84:0/957273969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c009ae0 con 0x7f29340cc830 2023-10-06T03:24:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2931d9b700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340cc830 0x7f2934154fb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f292800c800 tx=0x7f2928008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f29227fc700 1 -- 172.21.15.84:0/957273969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928011600 con 0x7f29340cc830 2023-10-06T03:24:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f29227fc700 1 -- 172.21.15.84:0/957273969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2928011760 con 0x7f29340cc830 2023-10-06T03:24:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f29227fc700 1 -- 172.21.15.84:0/957273969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928011b20 con 0x7f29340cc830 2023-10-06T03:24:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2938ec8700 1 -- 172.21.15.84:0/957273969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2934159cc0 con 0x7f29340cc830 2023-10-06T03:24:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.697+0000 7f2938ec8700 1 -- 172.21.15.84:0/957273969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293415a280 con 0x7f29340cc830 2023-10-06T03:24:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.698+0000 7f2938ec8700 1 -- 172.21.15.84:0/957273969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2934064ad0 con 0x7f29340cc830 2023-10-06T03:24:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.699+0000 7f29227fc700 1 -- 172.21.15.84:0/957273969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29280193f0 con 0x7f29340cc830 2023-10-06T03:24:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.699+0000 7f29227fc700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2914066f30 0x7f29140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.699+0000 7f29227fc700 1 -- 172.21.15.84:0/957273969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2928084db0 con 0x7f29340cc830 2023-10-06T03:24:26.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.699+0000 7f293259c700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2914066f30 0x7f29140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.700+0000 7f293259c700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2914066f30 0x7f29140693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f29240027e0 tx=0x7f2924009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.704+0000 7f29227fc700 1 -- 172.21.15.84:0/957273969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2928051bd0 con 0x7f29340cc830 2023-10-06T03:24:26.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.888+0000 7f2938ec8700 1 -- 172.21.15.84:0/957273969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29340c6d20 con 0x7f29340cc830 2023-10-06T03:24:26.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.890+0000 7f29227fc700 1 -- 172.21.15.84:0/957273969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f29280551f0 con 0x7f29340cc830 2023-10-06T03:24:26.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:26.891 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:26.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 -- 172.21.15.84:0/957273969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2914066f30 msgr2=0x7f29140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2914066f30 0x7f29140693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f29240027e0 tx=0x7f2924009040 comp rx=0 tx=0).stop 2023-10-06T03:24:26.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 -- 172.21.15.84:0/957273969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340cc830 msgr2=0x7f2934154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340cc830 0x7f2934154fb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f292800c800 tx=0x7f2928008040 comp rx=0 tx=0).stop 2023-10-06T03:24:26.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 -- 172.21.15.84:0/957273969 shutdown_connections 2023-10-06T03:24:26.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2914066f30 0x7f29140693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29340ccc80 0x7f29341554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29340ac040 0x7f29340c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 --2- 172.21.15.84:0/957273969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29340cc830 0x7f2934154fb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 -- 172.21.15.84:0/957273969 >> 172.21.15.84:0/957273969 conn(0x7f29340680c0 msgr2=0x7f29340acaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 -- 172.21.15.84:0/957273969 shutdown_connections 2023-10-06T03:24:26.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:26.892+0000 7f2938ec8700 1 -- 172.21.15.84:0/957273969 wait complete. 2023-10-06T03:24:26.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:47.554201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:48.881558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:52.564434+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:26.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.022+0000 7f37aa185700 1 Processor -- start 2023-10-06T03:24:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.022+0000 7f37aa185700 1 -- start start 2023-10-06T03:24:27.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37aa185700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f37a40b2660 0x7f37a40cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37aa185700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f37a40cf1f0 0x7f37a40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37aa185700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a40cc9b0 con 0x7f37a40b2a30 2023-10-06T03:24:27.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37aa185700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a40cbda0 con 0x7f37a40cf1f0 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37aa185700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a40cc080 con 0x7f37a40b2660 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37a9984700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f37a40cf1f0 0x7f37a40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37a9984700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f37a40cf1f0 0x7f37a40cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46202/0 (socket says 172.21.15.84:46202) 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37a9984700 1 -- 172.21.15.84:0/2245897463 learned_addr learned my addr 172.21.15.84:0/2245897463 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37a9183700 1 --2- 172.21.15.84:0/2245897463 >> v2:172.21.15.131:3300/0 conn(0x7f37a40b2660 0x7f37a40cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37a9984700 1 -- 172.21.15.84:0/2245897463 >> v2:172.21.15.131:3300/0 conn(0x7f37a40b2660 msgr2=0x7f37a40cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37a9984700 1 --2- 172.21.15.84:0/2245897463 >> v2:172.21.15.131:3300/0 conn(0x7f37a40b2660 0x7f37a40cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37a9984700 1 -- 172.21.15.84:0/2245897463 >> v1:172.21.15.131:6789/0 conn(0x7f37a40b2a30 legacy=0x7f37a40ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37a9984700 1 -- 172.21.15.84:0/2245897463 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a40cc360 con 0x7f37a40cf1f0 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.023+0000 7f37a9183700 1 --2- 172.21.15.84:0/2245897463 >> v2:172.21.15.131:3300/0 conn(0x7f37a40b2660 0x7f37a40cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f37a9984700 1 --2- 172.21.15.84:0/2245897463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40cf1f0 0x7f37a40cd230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37a4089500 tx=0x7f379c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e216f010977d9051 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f379bfff700 1 -- 172.21.15.84:0/2245897463 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c00b820 con 0x7f37a40cf1f0 2023-10-06T03:24:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f379bfff700 1 -- 172.21.15.84:0/2245897463 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379c00b980 con 0x7f37a40cf1f0 2023-10-06T03:24:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f379bfff700 1 -- 172.21.15.84:0/2245897463 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c00bd20 con 0x7f37a40cf1f0 2023-10-06T03:24:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f37aa185700 1 -- 172.21.15.84:0/2245897463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40cf1f0 msgr2=0x7f37a40cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f37aa185700 1 --2- 172.21.15.84:0/2245897463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40cf1f0 0x7f37a40cd230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37a4089500 tx=0x7f379c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f37aa185700 1 -- 172.21.15.84:0/2245897463 shutdown_connections 2023-10-06T03:24:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f37aa185700 1 --2- 172.21.15.84:0/2245897463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40cf1f0 0x7f37a40cd230 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f37aa185700 1 --2- 172.21.15.84:0/2245897463 >> v2:172.21.15.131:3300/0 conn(0x7f37a40b2660 0x7f37a40cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f37aa185700 1 -- 172.21.15.84:0/2245897463 >> 172.21.15.84:0/2245897463 conn(0x7f37a4099560 msgr2=0x7f37a406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f37aa185700 1 -- 172.21.15.84:0/2245897463 shutdown_connections 2023-10-06T03:24:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.024+0000 7f37aa185700 1 -- 172.21.15.84:0/2245897463 wait complete. 2023-10-06T03:24:27.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.025+0000 7f37aa185700 1 Processor -- start 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.025+0000 7f37aa185700 1 -- start start 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37aa185700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40b2660 0x7f37a41698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37aa185700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a40b2a30 0x7f37a4159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37aa185700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37a40cf1f0 0x7f37a415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37aa185700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4169e20 con 0x7f37a40b2660 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37aa185700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40b4f90 con 0x7f37a40b2a30 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37aa185700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40b5270 con 0x7f37a40cf1f0 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37a9183700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40b2660 0x7f37a41698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37a9183700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40b2660 0x7f37a41698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46216/0 (socket says 172.21.15.84:46216) 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37a9183700 1 -- 172.21.15.84:0/1172176384 learned_addr learned my addr 172.21.15.84:0/1172176384 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37a9984700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37a40cf1f0 0x7f37a415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.026+0000 7f37a8982700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a40b2a30 0x7f37a4159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37a9183700 1 -- 172.21.15.84:0/1172176384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37a40cf1f0 msgr2=0x7f37a415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37a9183700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37a40cf1f0 0x7f37a415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37a9183700 1 -- 172.21.15.84:0/1172176384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a40b2a30 msgr2=0x7f37a4159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37a9183700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a40b2a30 0x7f37a4159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37a9183700 1 -- 172.21.15.84:0/1172176384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c0094f0 con 0x7f37a40b2660 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37a9183700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40b2660 0x7f37a41698e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f37a000a300 tx=0x7f37a00078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37997fa700 1 -- 172.21.15.84:0/1172176384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0015440 con 0x7f37a40b2660 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37997fa700 1 -- 172.21.15.84:0/1172176384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a00155a0 con 0x7f37a40b2660 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37aa185700 1 -- 172.21.15.84:0/1172176384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a40b5550 con 0x7f37a40b2660 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37997fa700 1 -- 172.21.15.84:0/1172176384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0015920 con 0x7f37a40b2660 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.027+0000 7f37aa185700 1 -- 172.21.15.84:0/1172176384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a415bad0 con 0x7f37a40b2660 2023-10-06T03:24:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.028+0000 7f37aa185700 1 -- 172.21.15.84:0/1172176384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a405f270 con 0x7f37a40b2660 2023-10-06T03:24:27.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.028+0000 7f37997fa700 1 -- 172.21.15.84:0/1172176384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37a0015cd0 con 0x7f37a40b2660 2023-10-06T03:24:27.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.029+0000 7f37997fa700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3788066f30 0x7f37880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.029+0000 7f37997fa700 1 -- 172.21.15.84:0/1172176384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f37a0085090 con 0x7f37a40b2660 2023-10-06T03:24:27.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.029+0000 7f37a8982700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3788066f30 0x7f37880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.029+0000 7f37a8982700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3788066f30 0x7f37880693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37a40b6140 tx=0x7f3794009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.033+0000 7f37997fa700 1 -- 172.21.15.84:0/1172176384 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37a004e5a0 con 0x7f37a40b2660 2023-10-06T03:24:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.214+0000 7f37aa185700 1 -- 172.21.15.84:0/1172176384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37a40cc640 con 0x7f37a40b2660 2023-10-06T03:24:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.214+0000 7f37997fa700 1 -- 172.21.15.84:0/1172176384 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37a0051f60 con 0x7f37a40b2660 2023-10-06T03:24:27.216 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:24:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 -- 172.21.15.84:0/1172176384 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3788066f30 msgr2=0x7f37880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3788066f30 0x7f37880693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37a40b6140 tx=0x7f3794009040 comp rx=0 tx=0).stop 2023-10-06T03:24:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 -- 172.21.15.84:0/1172176384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40b2660 msgr2=0x7f37a41698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40b2660 0x7f37a41698e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f37a000a300 tx=0x7f37a00078c0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 -- 172.21.15.84:0/1172176384 shutdown_connections 2023-10-06T03:24:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3788066f30 0x7f37880693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37a40cf1f0 0x7f37a415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37a40b2660 0x7f37a41698e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 --2- 172.21.15.84:0/1172176384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a40b2a30 0x7f37a4159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 -- 172.21.15.84:0/1172176384 >> 172.21.15.84:0/1172176384 conn(0x7f37a4099560 msgr2=0x7f37a4068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 -- 172.21.15.84:0/1172176384 shutdown_connections 2023-10-06T03:24:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.216+0000 7f37aa185700 1 -- 172.21.15.84:0/1172176384 wait complete. 2023-10-06T03:24:27.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.345+0000 7f5f6086a700 1 Processor -- start 2023-10-06T03:24:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.345+0000 7f5f6086a700 1 -- start start 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.346+0000 7f5f6086a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5f5c0b0610 0x7f5f5c0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.346+0000 7f5f6086a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f5c0c95c0 0x7f5f5c0c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.346+0000 7f5f6086a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c0cae10 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.346+0000 7f5f6086a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5c0cd130 con 0x7f5f5c0c95c0 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.346+0000 7f5f6086a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5c157810 con 0x7f5f5c0b0610 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.346+0000 7f5f5b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f5c0c95c0 0x7f5f5c0c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.346+0000 7f5f5b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f5c0c95c0 0x7f5f5c0c2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46232/0 (socket says 172.21.15.84:46232) 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.346+0000 7f5f5b59e700 1 -- 172.21.15.84:0/3954662514 learned_addr learned my addr 172.21.15.84:0/3954662514 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.346+0000 7f5f5ad9d700 1 --2- 172.21.15.84:0/3954662514 >> v2:172.21.15.131:3300/0 conn(0x7f5f5c0b0610 0x7f5f5c0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f5b59e700 1 -- 172.21.15.84:0/3954662514 >> v2:172.21.15.131:3300/0 conn(0x7f5f5c0b0610 msgr2=0x7f5f5c0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f5b59e700 1 --2- 172.21.15.84:0/3954662514 >> v2:172.21.15.131:3300/0 conn(0x7f5f5c0b0610 0x7f5f5c0cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f5b59e700 1 -- 172.21.15.84:0/3954662514 >> v1:172.21.15.131:6789/0 conn(0x7f5f5c0ccc90 legacy=0x7f5f5c0c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f5b59e700 1 -- 172.21.15.84:0/3954662514 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0c9b20 con 0x7f5f5c0c95c0 2023-10-06T03:24:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f5b59e700 1 --2- 172.21.15.84:0/3954662514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0c95c0 0x7f5f5c0c2f80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c06adc0 tx=0x7f5f54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c53e7b53fd34a16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f59d9b700 1 -- 172.21.15.84:0/3954662514 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54009e70 con 0x7f5f5c0c95c0 2023-10-06T03:24:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f59d9b700 1 -- 172.21.15.84:0/3954662514 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5400b860 con 0x7f5f5c0c95c0 2023-10-06T03:24:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f59d9b700 1 -- 172.21.15.84:0/3954662514 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5400bc00 con 0x7f5f5c0c95c0 2023-10-06T03:24:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f6086a700 1 -- 172.21.15.84:0/3954662514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0c95c0 msgr2=0x7f5f5c0c2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f6086a700 1 --2- 172.21.15.84:0/3954662514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0c95c0 0x7f5f5c0c2f80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c06adc0 tx=0x7f5f54009250 comp rx=0 tx=0).stop 2023-10-06T03:24:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.347+0000 7f5f6086a700 1 -- 172.21.15.84:0/3954662514 shutdown_connections 2023-10-06T03:24:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.348+0000 7f5f6086a700 1 --2- 172.21.15.84:0/3954662514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0c95c0 0x7f5f5c0c2f80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.348+0000 7f5f6086a700 1 --2- 172.21.15.84:0/3954662514 >> v2:172.21.15.131:3300/0 conn(0x7f5f5c0b0610 0x7f5f5c0cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.348+0000 7f5f6086a700 1 -- 172.21.15.84:0/3954662514 >> 172.21.15.84:0/3954662514 conn(0x7f5f5c096a70 msgr2=0x7f5f5c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.348+0000 7f5f6086a700 1 -- 172.21.15.84:0/3954662514 shutdown_connections 2023-10-06T03:24:27.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.348+0000 7f5f6086a700 1 -- 172.21.15.84:0/3954662514 wait complete. 2023-10-06T03:24:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.349+0000 7f5f6086a700 1 Processor -- start 2023-10-06T03:24:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.349+0000 7f5f6086a700 1 -- start start 2023-10-06T03:24:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.349+0000 7f5f6086a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f5c0b0610 0x7f5f5c1547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.349+0000 7f5f6086a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f5c0c95c0 0x7f5f5c167160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.349+0000 7f5f6086a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0ccc90 0x7f5f5c099b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.349+0000 7f5f6086a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c0aacf0 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.349+0000 7f5f6086a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c09abd0 con 0x7f5f5c0c95c0 2023-10-06T03:24:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.349+0000 7f5f6086a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c09a610 con 0x7f5f5c0b0610 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0ccc90 0x7f5f5c099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0ccc90 0x7f5f5c099b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46242/0 (socket says 172.21.15.84:46242) 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5b59e700 1 -- 172.21.15.84:0/4238928606 learned_addr learned my addr 172.21.15.84:0/4238928606 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5ad9d700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f5c0b0610 0x7f5f5c1547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5a59c700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f5c0c95c0 0x7f5f5c167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5b59e700 1 -- 172.21.15.84:0/4238928606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f5c0b0610 msgr2=0x7f5f5c1547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5b59e700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f5c0b0610 0x7f5f5c1547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5b59e700 1 -- 172.21.15.84:0/4238928606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f5c0c95c0 msgr2=0x7f5f5c167160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5b59e700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f5c0c95c0 0x7f5f5c167160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5b59e700 1 -- 172.21.15.84:0/4238928606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540094f0 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5ad9d700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f5c0b0610 0x7f5f5c1547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5a59c700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f5c0c95c0 0x7f5f5c167160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f5b59e700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0ccc90 0x7f5f5c099b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009290 tx=0x7f5f54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f42ffd700 1 -- 172.21.15.84:0/4238928606 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54011630 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f42ffd700 1 -- 172.21.15.84:0/4238928606 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f540117b0 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f6086a700 1 -- 172.21.15.84:0/4238928606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5c09a8f0 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f42ffd700 1 -- 172.21.15.84:0/4238928606 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54011b70 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.350+0000 7f5f6086a700 1 -- 172.21.15.84:0/4238928606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5c097fd0 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.351+0000 7f5f6086a700 1 -- 172.21.15.84:0/4238928606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5c098440 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.352+0000 7f5f42ffd700 1 -- 172.21.15.84:0/4238928606 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f540253f0 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.352+0000 7f5f42ffd700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5f48066f30 0x7f5f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.352+0000 7f5f42ffd700 1 -- 172.21.15.84:0/4238928606 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5f54086420 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.352+0000 7f5f5ad9d700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5f48066f30 0x7f5f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.352+0000 7f5f5ad9d700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5f48066f30 0x7f5f480693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0076c0 tx=0x7f5f4c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.356+0000 7f5f42ffd700 1 -- 172.21.15.84:0/4238928606 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f5c098440 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.539+0000 7f5f6086a700 1 -- 172.21.15.84:0/4238928606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f5c098440 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.540+0000 7f5f42ffd700 1 -- 172.21.15.84:0/4238928606 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f5c098440 con 0x7f5f5c0ccc90 2023-10-06T03:24:27.541 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:24:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 -- 172.21.15.84:0/4238928606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5f48066f30 msgr2=0x7f5f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5f48066f30 0x7f5f480693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0076c0 tx=0x7f5f4c00b040 comp rx=0 tx=0).stop 2023-10-06T03:24:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 -- 172.21.15.84:0/4238928606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0ccc90 msgr2=0x7f5f5c099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0ccc90 0x7f5f5c099b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009290 tx=0x7f5f54017000 comp rx=0 tx=0).stop 2023-10-06T03:24:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 -- 172.21.15.84:0/4238928606 shutdown_connections 2023-10-06T03:24:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5f48066f30 0x7f5f480693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f5c0ccc90 0x7f5f5c099b90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f5c0b0610 0x7f5f5c1547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 --2- 172.21.15.84:0/4238928606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f5c0c95c0 0x7f5f5c167160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 -- 172.21.15.84:0/4238928606 >> 172.21.15.84:0/4238928606 conn(0x7f5f5c096a70 msgr2=0x7f5f5c0cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 -- 172.21.15.84:0/4238928606 shutdown_connections 2023-10-06T03:24:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.542+0000 7f5f6086a700 1 -- 172.21.15.84:0/4238928606 wait complete. 2023-10-06T03:24:27.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:27.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.671+0000 7f3811cfb700 1 Processor -- start 2023-10-06T03:24:27.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.671+0000 7f3811cfb700 1 -- start start 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.672+0000 7f3811cfb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f380c0d0a00 0x7f380c164330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.672+0000 7f3811cfb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c0cdc30 con 0x7f380c0ccab0 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.672+0000 7f3811cfb700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c0cb500 con 0x7f380c1539d0 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.672+0000 7f3811cfb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380c0cd020 con 0x7f380c0d0a00 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.672+0000 7f380bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f380c0ccab0 0x7f380c0d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52242/0 (socket says 172.21.15.84:52242) 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.672+0000 7f380bfff700 1 -- 172.21.15.84:0/1969736269 learned_addr learned my addr 172.21.15.84:0/1969736269 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.672+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169436779 0 0) 0x7f380c0cdc30 con 0x7f380c0ccab0 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.672+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37f8003570 con 0x7f380c0ccab0 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.672+0000 7f38114fa700 1 --2- 172.21.15.84:0/1969736269 >> v2:172.21.15.131:3300/0 conn(0x7f380c0d0a00 0x7f380c164330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1356371064 0 0) 0x7f37f8003570 con 0x7f380c0ccab0 2023-10-06T03:24:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 >> v2:172.21.15.131:3300/0 conn(0x7f380c0d0a00 msgr2=0x7f380c164330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 --2- 172.21.15.84:0/1969736269 >> v2:172.21.15.131:3300/0 conn(0x7f380c0d0a00 0x7f380c164330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 >> v1:172.21.15.131:6789/0 conn(0x7f380c1539d0 legacy=0x7f380c15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c0cd300 con 0x7f380c0ccab0 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f37f4001470 con 0x7f380c0ccab0 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 >> v1:172.21.15.84:6789/0 conn(0x7f380c0ccab0 legacy=0x7f380c0d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f37f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37f8004810 0x7f37f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37f80051c0 0x7f37f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0cd020 con 0x7f37f8003a60 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f800c160 con 0x7f37f80051c0 2023-10-06T03:24:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f800c320 con 0x7f37f8004810 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f3810cf9700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f37f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f38114fa700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37f80051c0 0x7f37f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380bfff700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37f8004810 0x7f37f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f3810cf9700 1 -- 172.21.15.84:0/1969736269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37f8004810 msgr2=0x7f37f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f3810cf9700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37f8004810 0x7f37f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f3810cf9700 1 -- 172.21.15.84:0/1969736269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37f80051c0 msgr2=0x7f37f800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f3810cf9700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37f80051c0 0x7f37f800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f3810cf9700 1 -- 172.21.15.84:0/1969736269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f8003570 con 0x7f37f8003a60 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f38114fa700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37f80051c0 0x7f37f800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380bfff700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37f8004810 0x7f37f8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:27.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f38114fa700 1 -- 172.21.15.84:0/1969736269 reap_dead start 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f3810cf9700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f37f8003e70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f37fc001fc0 tx=0x7f37fc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5addd9dbcafe5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc001950 con 0x7f37f8003a60 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc00c8b0 con 0x7f37f8003a60 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.673+0000 7f380b7fe700 1 -- 172.21.15.84:0/1969736269 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc00cc50 con 0x7f37f8003a60 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.674+0000 7f3811cfb700 1 -- 172.21.15.84:0/1969736269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 msgr2=0x7f37f8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.674+0000 7f3811cfb700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f37f8003e70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f37fc001fc0 tx=0x7f37fc001640 comp rx=0 tx=0).stop 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.674+0000 7f3811cfb700 1 -- 172.21.15.84:0/1969736269 shutdown_connections 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.674+0000 7f3811cfb700 1 --2- 172.21.15.84:0/1969736269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f37f8003e70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.674+0000 7f3811cfb700 1 -- 172.21.15.84:0/1969736269 >> 172.21.15.84:0/1969736269 conn(0x7f380c068100 msgr2=0x7f380c0684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.674+0000 7f3811cfb700 1 -- 172.21.15.84:0/1969736269 shutdown_connections 2023-10-06T03:24:27.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.674+0000 7f3811cfb700 1 -- 172.21.15.84:0/1969736269 wait complete. 2023-10-06T03:24:27.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.675+0000 7f3811cfb700 1 Processor -- start 2023-10-06T03:24:27.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.675+0000 7f3811cfb700 1 -- start start 2023-10-06T03:24:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3811cfb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f380c0b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3811cfb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f380c0b3600 0x7f380c0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3811cfb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f380c0b0540 0x7f380c0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3811cfb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0b3a90 con 0x7f37f8003a60 2023-10-06T03:24:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3811cfb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c92e0 con 0x7f380c0b0540 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3811cfb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c7540 con 0x7f380c0b3600 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3810cf9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f380c0b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3810cf9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f380c0b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46256/0 (socket says 172.21.15.84:46256) 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3810cf9700 1 -- 172.21.15.84:0/3480930166 learned_addr learned my addr 172.21.15.84:0/3480930166 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f380bfff700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f380c0b3600 0x7f380c0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f38114fa700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f380c0b0540 0x7f380c0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3810cf9700 1 -- 172.21.15.84:0/3480930166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f380c0b3600 msgr2=0x7f380c0b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3810cf9700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f380c0b3600 0x7f380c0b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3810cf9700 1 -- 172.21.15.84:0/3480930166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f380c0b0540 msgr2=0x7f380c0b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3810cf9700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f380c0b0540 0x7f380c0b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3810cf9700 1 -- 172.21.15.84:0/3480930166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c0c7820 con 0x7f37f8003a60 2023-10-06T03:24:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3810cf9700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f380c0b5670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f37fc012960 tx=0x7f37fc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.676+0000 7f3808ff9700 1 -- 172.21.15.84:0/3480930166 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc001950 con 0x7f37f8003a60 2023-10-06T03:24:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.677+0000 7f3808ff9700 1 -- 172.21.15.84:0/3480930166 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc00c6d0 con 0x7f37f8003a60 2023-10-06T03:24:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.677+0000 7f3811cfb700 1 -- 172.21.15.84:0/3480930166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c0b5bb0 con 0x7f37f8003a60 2023-10-06T03:24:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.677+0000 7f3808ff9700 1 -- 172.21.15.84:0/3480930166 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc026630 con 0x7f37f8003a60 2023-10-06T03:24:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.677+0000 7f3811cfb700 1 -- 172.21.15.84:0/3480930166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c1515e0 con 0x7f37f8003a60 2023-10-06T03:24:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.677+0000 7f3811cfb700 1 -- 172.21.15.84:0/3480930166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c05f270 con 0x7f37f8003a60 2023-10-06T03:24:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.678+0000 7f3808ff9700 1 -- 172.21.15.84:0/3480930166 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37fc019030 con 0x7f37f8003a60 2023-10-06T03:24:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.678+0000 7f3808ff9700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37ec066f30 0x7f37ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.678+0000 7f380bfff700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37ec066f30 0x7f37ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.678+0000 7f3808ff9700 1 -- 172.21.15.84:0/3480930166 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f37fc086560 con 0x7f37f8003a60 2023-10-06T03:24:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.679+0000 7f380bfff700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37ec066f30 0x7f37ec0693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f37f40015a0 tx=0x7f37f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.683+0000 7f3808ff9700 1 -- 172.21.15.84:0/3480930166 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37fc053380 con 0x7f37f8003a60 2023-10-06T03:24:27.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.864+0000 7f3811cfb700 1 -- 172.21.15.84:0/3480930166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f380c0cd5e0 con 0x7f37f8003a60 2023-10-06T03:24:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.864+0000 7f3808ff9700 1 -- 172.21.15.84:0/3480930166 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37fc0569a0 con 0x7f37f8003a60 2023-10-06T03:24:27.865 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 -- 172.21.15.84:0/3480930166 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37ec066f30 msgr2=0x7f37ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37ec066f30 0x7f37ec0693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f37f40015a0 tx=0x7f37f4009040 comp rx=0 tx=0).stop 2023-10-06T03:24:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 -- 172.21.15.84:0/3480930166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 msgr2=0x7f380c0b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f380c0b5670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f37fc012960 tx=0x7f37fc015000 comp rx=0 tx=0).stop 2023-10-06T03:24:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 -- 172.21.15.84:0/3480930166 shutdown_connections 2023-10-06T03:24:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37ec066f30 0x7f37ec0693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f380c0b0540 0x7f380c0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37f8003a60 0x7f380c0b5670 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 --2- 172.21.15.84:0/3480930166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f380c0b3600 0x7f380c0b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 -- 172.21.15.84:0/3480930166 >> 172.21.15.84:0/3480930166 conn(0x7f380c068100 msgr2=0x7f380c15c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 -- 172.21.15.84:0/3480930166 shutdown_connections 2023-10-06T03:24:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.866+0000 7f3811cfb700 1 -- 172.21.15.84:0/3480930166 wait complete. 2023-10-06T03:24:27.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:27.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.995+0000 7ff097a57700 1 Processor -- start 2023-10-06T03:24:27.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.995+0000 7ff097a57700 1 -- start start 2023-10-06T03:24:27.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.996+0000 7ff097a57700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0900cd980 0x7ff090159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.996+0000 7ff097a57700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff0900b4eb0 0x7ff090163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.996+0000 7ff097a57700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0900b5f30 con 0x7ff0900b4a60 2023-10-06T03:24:27.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.996+0000 7ff097a57700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0900b3640 con 0x7ff0900cd980 2023-10-06T03:24:27.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.996+0000 7ff097a57700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0900b63c0 con 0x7ff0900b4eb0 2023-10-06T03:24:27.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.996+0000 7ff0957f3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0900cd980 0x7ff090159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.996+0000 7ff0957f3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0900cd980 0x7ff090159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46272/0 (socket says 172.21.15.84:46272) 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.996+0000 7ff0957f3700 1 -- 172.21.15.84:0/4040260142 learned_addr learned my addr 172.21.15.84:0/4040260142 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.996+0000 7ff095ff4700 1 --2- 172.21.15.84:0/4040260142 >> v2:172.21.15.131:3300/0 conn(0x7ff0900b4eb0 0x7ff090163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff0957f3700 1 -- 172.21.15.84:0/4040260142 >> v2:172.21.15.131:3300/0 conn(0x7ff0900b4eb0 msgr2=0x7ff090163240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff0957f3700 1 --2- 172.21.15.84:0/4040260142 >> v2:172.21.15.131:3300/0 conn(0x7ff0900b4eb0 0x7ff090163240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff0957f3700 1 -- 172.21.15.84:0/4040260142 >> v1:172.21.15.131:6789/0 conn(0x7ff0900b4a60 legacy=0x7ff0900d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff0957f3700 1 -- 172.21.15.84:0/4040260142 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900b5320 con 0x7ff0900cd980 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff0957f3700 1 --2- 172.21.15.84:0/4040260142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900cd980 0x7ff090159c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff0900b3030 tx=0x7ff08c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9976f9fe3e893ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff087fff700 1 -- 172.21.15.84:0/4040260142 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c009e70 con 0x7ff0900cd980 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff087fff700 1 -- 172.21.15.84:0/4040260142 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c00b860 con 0x7ff0900cd980 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff087fff700 1 -- 172.21.15.84:0/4040260142 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00bc00 con 0x7ff0900cd980 2023-10-06T03:24:27.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff097a57700 1 -- 172.21.15.84:0/4040260142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900cd980 msgr2=0x7ff090159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff097a57700 1 --2- 172.21.15.84:0/4040260142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900cd980 0x7ff090159c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff0900b3030 tx=0x7ff08c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:28.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff097a57700 1 -- 172.21.15.84:0/4040260142 shutdown_connections 2023-10-06T03:24:28.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff097a57700 1 --2- 172.21.15.84:0/4040260142 >> v2:172.21.15.131:3300/0 conn(0x7ff0900b4eb0 0x7ff090163240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff097a57700 1 --2- 172.21.15.84:0/4040260142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900cd980 0x7ff090159c10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.997+0000 7ff097a57700 1 -- 172.21.15.84:0/4040260142 >> 172.21.15.84:0/4040260142 conn(0x7ff09006ed20 msgr2=0x7ff09006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.998+0000 7ff097a57700 1 -- 172.21.15.84:0/4040260142 shutdown_connections 2023-10-06T03:24:28.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.998+0000 7ff097a57700 1 -- 172.21.15.84:0/4040260142 wait complete. 2023-10-06T03:24:28.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.999+0000 7ff097a57700 1 Processor -- start 2023-10-06T03:24:28.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.999+0000 7ff097a57700 1 -- start start 2023-10-06T03:24:28.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.999+0000 7ff097a57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900b4a60 0x7ff09015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.999+0000 7ff097a57700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0900b4eb0 0x7ff09015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.999+0000 7ff097a57700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0900cd980 0x7ff09015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.999+0000 7ff097a57700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09016a360 con 0x7ff0900b4a60 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:27.999+0000 7ff097a57700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09015c990 con 0x7ff0900b4eb0 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff097a57700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09015bd80 con 0x7ff0900cd980 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0957f3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900b4a60 0x7ff09015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0957f3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900b4a60 0x7ff09015e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46288/0 (socket says 172.21.15.84:46288) 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0957f3700 1 -- 172.21.15.84:0/29164700 learned_addr learned my addr 172.21.15.84:0/29164700 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0957f3700 1 -- 172.21.15.84:0/29164700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0900cd980 msgr2=0x7ff09015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff095ff4700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0900cd980 0x7ff09015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0957f3700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0900cd980 0x7ff09015b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0957f3700 1 -- 172.21.15.84:0/29164700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0900b4eb0 msgr2=0x7ff09015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff094ff2700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0900b4eb0 0x7ff09015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0957f3700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0900b4eb0 0x7ff09015b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0957f3700 1 -- 172.21.15.84:0/29164700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c0094f0 con 0x7ff0900b4a60 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff094ff2700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0900b4eb0 0x7ff09015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0957f3700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900b4a60 0x7ff09015e2c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff090089150 tx=0x7ff08c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0857fa700 1 -- 172.21.15.84:0/29164700 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c011420 con 0x7ff0900b4a60 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0857fa700 1 -- 172.21.15.84:0/29164700 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c0115a0 con 0x7ff0900b4a60 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff097a57700 1 -- 172.21.15.84:0/29164700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09015c060 con 0x7ff0900b4a60 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff0857fa700 1 -- 172.21.15.84:0/29164700 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c011960 con 0x7ff0900b4a60 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.000+0000 7ff097a57700 1 -- 172.21.15.84:0/29164700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09015c620 con 0x7ff0900b4a60 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.001+0000 7ff097a57700 1 -- 172.21.15.84:0/29164700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09015cc70 con 0x7ff0900b4a60 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.002+0000 7ff0857fa700 1 -- 172.21.15.84:0/29164700 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff08c0253f0 con 0x7ff0900b4a60 2023-10-06T03:24:28.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.002+0000 7ff0857fa700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff074066f30 0x7ff0740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.002+0000 7ff0857fa700 1 -- 172.21.15.84:0/29164700 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff08c0862c0 con 0x7ff0900b4a60 2023-10-06T03:24:28.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.002+0000 7ff094ff2700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff074066f30 0x7ff0740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.002+0000 7ff094ff2700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff074066f30 0x7ff0740693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff0900cd380 tx=0x7ff080009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.006+0000 7ff0857fa700 1 -- 172.21.15.84:0/29164700 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff08c0530e0 con 0x7ff0900b4a60 2023-10-06T03:24:28.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.187+0000 7ff097a57700 1 -- 172.21.15.84:0/29164700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff090064ad0 con 0x7ff0900b4a60 2023-10-06T03:24:28.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.188+0000 7ff0857fa700 1 -- 172.21.15.84:0/29164700 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff08c056700 con 0x7ff0900b4a60 2023-10-06T03:24:28.189 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:24:28.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 -- 172.21.15.84:0/29164700 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff074066f30 msgr2=0x7ff0740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff074066f30 0x7ff0740693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff0900cd380 tx=0x7ff080009040 comp rx=0 tx=0).stop 2023-10-06T03:24:28.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 -- 172.21.15.84:0/29164700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900b4a60 msgr2=0x7ff09015e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900b4a60 0x7ff09015e2c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff090089150 tx=0x7ff08c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:28.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 -- 172.21.15.84:0/29164700 shutdown_connections 2023-10-06T03:24:28.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff074066f30 0x7ff0740693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0900cd980 0x7ff09015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0900b4a60 0x7ff09015e2c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 --2- 172.21.15.84:0/29164700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0900b4eb0 0x7ff09015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 -- 172.21.15.84:0/29164700 >> 172.21.15.84:0/29164700 conn(0x7ff09006ed20 msgr2=0x7ff090155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 -- 172.21.15.84:0/29164700 shutdown_connections 2023-10-06T03:24:28.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.190+0000 7ff097a57700 1 -- 172.21.15.84:0/29164700 wait complete. 2023-10-06T03:24:28.202 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:28.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.318+0000 7fe7c48b7700 1 Processor -- start 2023-10-06T03:24:28.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.318+0000 7fe7c48b7700 1 -- start start 2023-10-06T03:24:28.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.319+0000 7fe7c48b7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe7c0159710 0x7fe7c00cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.319+0000 7fe7c48b7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c00cba70 0x7fe7c00c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.319+0000 7fe7c48b7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c00afbe0 con 0x7fe7c0159340 2023-10-06T03:24:28.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.319+0000 7fe7c48b7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c00cbed0 con 0x7fe7c0159710 2023-10-06T03:24:28.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.319+0000 7fe7c48b7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00cf820 con 0x7fe7c00cba70 2023-10-06T03:24:28.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.319+0000 7fe7b5d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe7c0159710 0x7fe7c00cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.319+0000 7fe7be59c700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe7c0159340 0x7fe7c00af4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:37858/0 (socket says 172.21.15.84:37858) 2023-10-06T03:24:28.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.319+0000 7fe7bed9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c00cba70 0x7fe7c00c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.319+0000 7fe7be59c700 1 -- 172.21.15.84:0/842549613 learned_addr learned my addr 172.21.15.84:0/842549613 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:28.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7bdd9b700 1 -- 172.21.15.84:0/842549613 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320536544 0 0) 0x7fe7b0001160 con 0x7fe7c0159340 2023-10-06T03:24:28.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7bdd9b700 1 -- 172.21.15.84:0/842549613 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7ac003570 con 0x7fe7c0159340 2023-10-06T03:24:28.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7bed9d700 1 -- 172.21.15.84:0/842549613 >> v2:172.21.15.131:3300/0 conn(0x7fe7c0159710 msgr2=0x7fe7c00cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:28.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7bed9d700 1 --2- 172.21.15.84:0/842549613 >> v2:172.21.15.131:3300/0 conn(0x7fe7c0159710 0x7fe7c00cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7bed9d700 1 -- 172.21.15.84:0/842549613 >> v1:172.21.15.131:6789/0 conn(0x7fe7c0159340 legacy=0x7fe7c00af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7bed9d700 1 -- 172.21.15.84:0/842549613 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00cfb00 con 0x7fe7c00cba70 2023-10-06T03:24:28.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7b5d9b700 1 --2- 172.21.15.84:0/842549613 >> v2:172.21.15.131:3300/0 conn(0x7fe7c0159710 0x7fe7c00cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:28.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7bed9d700 1 --2- 172.21.15.84:0/842549613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c00cba70 0x7fe7c00c5660 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009e60 tx=0x7fe7b8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59753d28da339bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7bdd9b700 1 -- 172.21.15.84:0/842549613 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800e070 con 0x7fe7c00cba70 2023-10-06T03:24:28.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7bdd9b700 1 -- 172.21.15.84:0/842549613 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b800bab0 con 0x7fe7c00cba70 2023-10-06T03:24:28.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.320+0000 7fe7bdd9b700 1 -- 172.21.15.84:0/842549613 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800be70 con 0x7fe7c00cba70 2023-10-06T03:24:28.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.321+0000 7fe7c48b7700 1 -- 172.21.15.84:0/842549613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c00cba70 msgr2=0x7fe7c00c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.321+0000 7fe7c48b7700 1 --2- 172.21.15.84:0/842549613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c00cba70 0x7fe7c00c5660 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009e60 tx=0x7fe7b8009780 comp rx=0 tx=0).stop 2023-10-06T03:24:28.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.321+0000 7fe7c48b7700 1 -- 172.21.15.84:0/842549613 shutdown_connections 2023-10-06T03:24:28.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.321+0000 7fe7c48b7700 1 --2- 172.21.15.84:0/842549613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c00cba70 0x7fe7c00c5660 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.321+0000 7fe7c48b7700 1 --2- 172.21.15.84:0/842549613 >> v2:172.21.15.131:3300/0 conn(0x7fe7c0159710 0x7fe7c00cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.321+0000 7fe7c48b7700 1 -- 172.21.15.84:0/842549613 >> 172.21.15.84:0/842549613 conn(0x7fe7c0099720 msgr2=0x7fe7c006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.321+0000 7fe7c48b7700 1 -- 172.21.15.84:0/842549613 shutdown_connections 2023-10-06T03:24:28.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.321+0000 7fe7c48b7700 1 -- 172.21.15.84:0/842549613 wait complete. 2023-10-06T03:24:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.322+0000 7fe7c48b7700 1 Processor -- start 2023-10-06T03:24:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.322+0000 7fe7c48b7700 1 -- start start 2023-10-06T03:24:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7c48b7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7c00cba70 0x7fe7c0158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7c48b7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c0159340 0x7fe7c00c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7c48b7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c0159710 0x7fe7c00c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7c48b7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00c8780 con 0x7fe7c00cba70 2023-10-06T03:24:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7c48b7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0157c70 con 0x7fe7c0159340 2023-10-06T03:24:28.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7c48b7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00c84a0 con 0x7fe7c0159710 2023-10-06T03:24:28.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7be59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7c00cba70 0x7fe7c0158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7be59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7c00cba70 0x7fe7c0158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46296/0 (socket says 172.21.15.84:46296) 2023-10-06T03:24:28.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7be59c700 1 -- 172.21.15.84:0/2186436737 learned_addr learned my addr 172.21.15.84:0/2186436737 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:28.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7bed9d700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c0159710 0x7fe7c00c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7b5d9b700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c0159340 0x7fe7c00c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7be59c700 1 -- 172.21.15.84:0/2186436737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c0159710 msgr2=0x7fe7c00c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7be59c700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c0159710 0x7fe7c00c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7be59c700 1 -- 172.21.15.84:0/2186436737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c0159340 msgr2=0x7fe7c00c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7be59c700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c0159340 0x7fe7c00c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7be59c700 1 -- 172.21.15.84:0/2186436737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a8009420 con 0x7fe7c00cba70 2023-10-06T03:24:28.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7be59c700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7c00cba70 0x7fe7c0158100 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000c7c0 tx=0x7fe7b0007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7b6ffd700 1 -- 172.21.15.84:0/2186436737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0005b80 con 0x7fe7c00cba70 2023-10-06T03:24:28.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7b6ffd700 1 -- 172.21.15.84:0/2186436737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b0005ce0 con 0x7fe7c00cba70 2023-10-06T03:24:28.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7b6ffd700 1 -- 172.21.15.84:0/2186436737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0007340 con 0x7fe7c00cba70 2023-10-06T03:24:28.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7c48b7700 1 -- 172.21.15.84:0/2186436737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b8009a20 con 0x7fe7c00cba70 2023-10-06T03:24:28.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.323+0000 7fe7c48b7700 1 -- 172.21.15.84:0/2186436737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c0157900 con 0x7fe7c00cba70 2023-10-06T03:24:28.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.324+0000 7fe7c48b7700 1 -- 172.21.15.84:0/2186436737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c0157480 con 0x7fe7c00cba70 2023-10-06T03:24:28.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.325+0000 7fe7b6ffd700 1 -- 172.21.15.84:0/2186436737 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7b001b400 con 0x7fe7c00cba70 2023-10-06T03:24:28.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.325+0000 7fe7b6ffd700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe7a0066f30 0x7fe7a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.325+0000 7fe7b6ffd700 1 -- 172.21.15.84:0/2186436737 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe7b0084330 con 0x7fe7c00cba70 2023-10-06T03:24:28.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.325+0000 7fe7b5d9b700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe7a0066f30 0x7fe7a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.325+0000 7fe7b5d9b700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe7a0066f30 0x7fe7a00693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80093f0 tx=0x7fe7a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.329+0000 7fe7b6ffd700 1 -- 172.21.15.84:0/2186436737 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7c0157480 con 0x7fe7c00cba70 2023-10-06T03:24:28.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.510+0000 7fe7c48b7700 1 -- 172.21.15.84:0/2186436737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe7c00afbe0 con 0x7fe7c00cba70 2023-10-06T03:24:28.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.510+0000 7fe7b6ffd700 1 -- 172.21.15.84:0/2186436737 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe7c00afbe0 con 0x7fe7c00cba70 2023-10-06T03:24:28.511 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 -- 172.21.15.84:0/2186436737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe7a0066f30 msgr2=0x7fe7a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe7a0066f30 0x7fe7a00693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80093f0 tx=0x7fe7a8008040 comp rx=0 tx=0).stop 2023-10-06T03:24:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 -- 172.21.15.84:0/2186436737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7c00cba70 msgr2=0x7fe7c0158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7c00cba70 0x7fe7c0158100 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000c7c0 tx=0x7fe7b0007c60 comp rx=0 tx=0).stop 2023-10-06T03:24:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 -- 172.21.15.84:0/2186436737 shutdown_connections 2023-10-06T03:24:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe7a0066f30 0x7fe7a00693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7c0159710 0x7fe7c00c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7c00cba70 0x7fe7c0158100 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 --2- 172.21.15.84:0/2186436737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c0159340 0x7fe7c00c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 -- 172.21.15.84:0/2186436737 >> 172.21.15.84:0/2186436737 conn(0x7fe7c0099720 msgr2=0x7fe7c0155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 -- 172.21.15.84:0/2186436737 shutdown_connections 2023-10-06T03:24:28.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.512+0000 7fe7c48b7700 1 -- 172.21.15.84:0/2186436737 wait complete. 2023-10-06T03:24:28.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:28.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.642+0000 7fe765ff4700 1 Processor -- start 2023-10-06T03:24:28.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.642+0000 7fe765ff4700 1 -- start start 2023-10-06T03:24:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.642+0000 7fe765ff4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe76015db50 0x7fe7600cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.642+0000 7fe765ff4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7600ced30 con 0x7fe7600ad620 2023-10-06T03:24:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.642+0000 7fe765ff4700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7600cf010 con 0x7fe7600ad250 2023-10-06T03:24:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.642+0000 7fe765ff4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7600ccad0 con 0x7fe76015db50 2023-10-06T03:24:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.642+0000 7fe75ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe7600ad620 0x7fe7600ca100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52248/0 (socket says 172.21.15.84:52248) 2023-10-06T03:24:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.642+0000 7fe75ffff700 1 -- 172.21.15.84:0/1786120207 learned_addr learned my addr 172.21.15.84:0/1786120207 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571916869 0 0) 0x7fe7600ced30 con 0x7fe7600ad620 2023-10-06T03:24:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75effd700 1 --2- 172.21.15.84:0/1786120207 >> v2:172.21.15.131:3300/0 conn(0x7fe76015db50 0x7fe7600cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe748003570 con 0x7fe7600ad620 2023-10-06T03:24:28.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4159908045 0 0) 0x7fe748003570 con 0x7fe7600ad620 2023-10-06T03:24:28.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 >> v2:172.21.15.131:3300/0 conn(0x7fe76015db50 msgr2=0x7fe7600cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:28.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 --2- 172.21.15.84:0/1786120207 >> v2:172.21.15.131:3300/0 conn(0x7fe76015db50 0x7fe7600cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 >> v1:172.21.15.131:6789/0 conn(0x7fe7600ad250 legacy=0x7fe76015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7600ccdb0 con 0x7fe7600ad620 2023-10-06T03:24:28.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fe758001470 con 0x7fe7600ad620 2023-10-06T03:24:28.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 >> v1:172.21.15.84:6789/0 conn(0x7fe7600ad620 legacy=0x7fe7600ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe748003a60 0x7fe748003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe748004810 0x7fe748004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7480051c0 0x7fe74800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7600ccad0 con 0x7fe748004810 2023-10-06T03:24:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74800c0d0 con 0x7fe7480051c0 2023-10-06T03:24:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74800c290 con 0x7fe748003a60 2023-10-06T03:24:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75effd700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe748004810 0x7fe748004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75f7fe700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe748003a60 0x7fe748003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75ffff700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7480051c0 0x7fe74800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75effd700 1 -- 172.21.15.84:0/1786120207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe748003a60 msgr2=0x7fe748003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:28.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75effd700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe748003a60 0x7fe748003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75effd700 1 -- 172.21.15.84:0/1786120207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7480051c0 msgr2=0x7fe74800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:28.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75effd700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7480051c0 0x7fe74800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75effd700 1 -- 172.21.15.84:0/1786120207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe748003570 con 0x7fe748004810 2023-10-06T03:24:28.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75ffff700 1 -- 172.21.15.84:0/1786120207 reap_dead start 2023-10-06T03:24:28.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.643+0000 7fe75f7fe700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe748003a60 0x7fe748003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:28.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe75effd700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe748004810 0x7fe748004c80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe7600cd810 tx=0x7fe7540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34849b3209c02b9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400e710 con 0x7fe748004810 2023-10-06T03:24:28.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75400e870 con 0x7fe748004810 2023-10-06T03:24:28.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe75e7fc700 1 -- 172.21.15.84:0/1786120207 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400ec30 con 0x7fe748004810 2023-10-06T03:24:28.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe765ff4700 1 -- 172.21.15.84:0/1786120207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe748004810 msgr2=0x7fe748004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe765ff4700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe748004810 0x7fe748004c80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe7600cd810 tx=0x7fe7540091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe765ff4700 1 -- 172.21.15.84:0/1786120207 shutdown_connections 2023-10-06T03:24:28.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe765ff4700 1 --2- 172.21.15.84:0/1786120207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe748004810 0x7fe748004c80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe765ff4700 1 -- 172.21.15.84:0/1786120207 >> 172.21.15.84:0/1786120207 conn(0x7fe760067dd0 msgr2=0x7fe7600ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe765ff4700 1 -- 172.21.15.84:0/1786120207 shutdown_connections 2023-10-06T03:24:28.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.644+0000 7fe765ff4700 1 -- 172.21.15.84:0/1786120207 wait complete. 2023-10-06T03:24:28.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.645+0000 7fe765ff4700 1 Processor -- start 2023-10-06T03:24:28.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe765ff4700 1 -- start start 2023-10-06T03:24:28.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe765ff4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe748004810 0x7fe7600c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe765ff4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7600c6f30 0x7fe760159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe765ff4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7600b03f0 0x7fe76015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe765ff4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7600c2850 con 0x7fe7600c6f30 2023-10-06T03:24:28.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe765ff4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7600af890 con 0x7fe7600b03f0 2023-10-06T03:24:28.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe765ff4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76015a070 con 0x7fe748004810 2023-10-06T03:24:28.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe75effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7600c6f30 0x7fe760159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe75effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7600c6f30 0x7fe760159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46310/0 (socket says 172.21.15.84:46310) 2023-10-06T03:24:28.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe75effd700 1 -- 172.21.15.84:0/4199753272 learned_addr learned my addr 172.21.15.84:0/4199753272 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:28.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe75f7fe700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe748004810 0x7fe7600c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.646+0000 7fe75ffff700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7600b03f0 0x7fe76015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe75effd700 1 -- 172.21.15.84:0/4199753272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe748004810 msgr2=0x7fe7600c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe75effd700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe748004810 0x7fe7600c2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe75effd700 1 -- 172.21.15.84:0/4199753272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7600b03f0 msgr2=0x7fe76015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe75effd700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7600b03f0 0x7fe76015b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe75effd700 1 -- 172.21.15.84:0/4199753272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7600aec80 con 0x7fe7600c6f30 2023-10-06T03:24:28.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe75effd700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7600c6f30 0x7fe760159b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe75400e4b0 tx=0x7fe75401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe7477fe700 1 -- 172.21.15.84:0/4199753272 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754022070 con 0x7fe7600c6f30 2023-10-06T03:24:28.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe7477fe700 1 -- 172.21.15.84:0/4199753272 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe754013ab0 con 0x7fe7600c6f30 2023-10-06T03:24:28.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe765ff4700 1 -- 172.21.15.84:0/4199753272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7600aef60 con 0x7fe7600c6f30 2023-10-06T03:24:28.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe7477fe700 1 -- 172.21.15.84:0/4199753272 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754013e90 con 0x7fe7600c6f30 2023-10-06T03:24:28.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.647+0000 7fe765ff4700 1 -- 172.21.15.84:0/4199753272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7600af520 con 0x7fe7600c6f30 2023-10-06T03:24:28.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.648+0000 7fe765ff4700 1 -- 172.21.15.84:0/4199753272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7600af9d0 con 0x7fe7600c6f30 2023-10-06T03:24:28.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.648+0000 7fe7477fe700 1 -- 172.21.15.84:0/4199753272 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe75401c660 con 0x7fe7600c6f30 2023-10-06T03:24:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.649+0000 7fe7477fe700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe74c066f30 0x7fe74c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.649+0000 7fe7477fe700 1 -- 172.21.15.84:0/4199753272 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe754086110 con 0x7fe7600c6f30 2023-10-06T03:24:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.649+0000 7fe75f7fe700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe74c066f30 0x7fe74c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.649+0000 7fe75f7fe700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe74c066f30 0x7fe74c0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe750001330 tx=0x7fe750009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.653+0000 7fe7477fe700 1 -- 172.21.15.84:0/4199753272 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7600af9d0 con 0x7fe7600c6f30 2023-10-06T03:24:28.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.836+0000 7fe765ff4700 1 -- 172.21.15.84:0/4199753272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7600af9d0 con 0x7fe7600c6f30 2023-10-06T03:24:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.837+0000 7fe7477fe700 1 -- 172.21.15.84:0/4199753272 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fe7600af9d0 con 0x7fe7600c6f30 2023-10-06T03:24:28.839 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:28.839 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 -- 172.21.15.84:0/4199753272 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe74c066f30 msgr2=0x7fe74c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe74c066f30 0x7fe74c0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe750001330 tx=0x7fe750009040 comp rx=0 tx=0).stop 2023-10-06T03:24:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 -- 172.21.15.84:0/4199753272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7600c6f30 msgr2=0x7fe760159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7600c6f30 0x7fe760159b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe75400e4b0 tx=0x7fe75401a000 comp rx=0 tx=0).stop 2023-10-06T03:24:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 -- 172.21.15.84:0/4199753272 shutdown_connections 2023-10-06T03:24:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe74c066f30 0x7fe74c0693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7600b03f0 0x7fe76015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe748004810 0x7fe7600c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 --2- 172.21.15.84:0/4199753272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7600c6f30 0x7fe760159b30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 -- 172.21.15.84:0/4199753272 >> 172.21.15.84:0/4199753272 conn(0x7fe760067dd0 msgr2=0x7fe76006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 -- 172.21.15.84:0/4199753272 shutdown_connections 2023-10-06T03:24:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.839+0000 7fe765ff4700 1 -- 172.21.15.84:0/4199753272 wait complete. 2023-10-06T03:24:28.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:47.554201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:48.881558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:52.564434+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:28.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:28.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.970+0000 7f95b5994700 1 Processor -- start 2023-10-06T03:24:28.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.970+0000 7f95b5994700 1 -- start start 2023-10-06T03:24:28.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95b5994700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95b0159510 0x7f95b00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95b5994700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95b01598e0 0x7f95b00cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95b5994700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f95b00ce820 0x7f95b00cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95b5994700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b00cf610 con 0x7f95b0159510 2023-10-06T03:24:28.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95b5994700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b00cf8f0 con 0x7f95b00ce820 2023-10-06T03:24:28.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95b5994700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00cfbd0 con 0x7f95b01598e0 2023-10-06T03:24:28.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95aeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95b0159510 0x7f95b00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95aeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95b0159510 0x7f95b00cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46324/0 (socket says 172.21.15.84:46324) 2023-10-06T03:24:28.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95aeffd700 1 -- 172.21.15.84:0/2664372661 learned_addr learned my addr 172.21.15.84:0/2664372661 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95af7fe700 1 --2- 172.21.15.84:0/2664372661 >> v2:172.21.15.131:3300/0 conn(0x7f95b00ce820 0x7f95b00cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95ae7fc700 1 --2- 172.21.15.84:0/2664372661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95b01598e0 0x7f95b00cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95aeffd700 1 -- 172.21.15.84:0/2664372661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95b01598e0 msgr2=0x7f95b00cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95aeffd700 1 --2- 172.21.15.84:0/2664372661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95b01598e0 0x7f95b00cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95aeffd700 1 -- 172.21.15.84:0/2664372661 >> v2:172.21.15.131:3300/0 conn(0x7f95b00ce820 msgr2=0x7f95b00cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95aeffd700 1 --2- 172.21.15.84:0/2664372661 >> v2:172.21.15.131:3300/0 conn(0x7f95b00ce820 0x7f95b00cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95aeffd700 1 -- 172.21.15.84:0/2664372661 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00cfeb0 con 0x7f95b0159510 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95aeffd700 1 --2- 172.21.15.84:0/2664372661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b0159510 0x7f95b00cb5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f95b008acb0 tx=0x7f95a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd0c912753ef715 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95adffb700 1 -- 172.21.15.84:0/2664372661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a000e070 con 0x7f95b0159510 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95adffb700 1 -- 172.21.15.84:0/2664372661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a000ba50 con 0x7f95b0159510 2023-10-06T03:24:28.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.971+0000 7f95adffb700 1 -- 172.21.15.84:0/2664372661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a00092e0 con 0x7f95b0159510 2023-10-06T03:24:28.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.972+0000 7f95b5994700 1 -- 172.21.15.84:0/2664372661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b0159510 msgr2=0x7f95b00cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.972+0000 7f95b5994700 1 --2- 172.21.15.84:0/2664372661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b0159510 0x7f95b00cb5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f95b008acb0 tx=0x7f95a0009840 comp rx=0 tx=0).stop 2023-10-06T03:24:28.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.972+0000 7f95b5994700 1 -- 172.21.15.84:0/2664372661 shutdown_connections 2023-10-06T03:24:28.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.972+0000 7f95b5994700 1 --2- 172.21.15.84:0/2664372661 >> v2:172.21.15.131:3300/0 conn(0x7f95b00ce820 0x7f95b00cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.972+0000 7f95b5994700 1 --2- 172.21.15.84:0/2664372661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b0159510 0x7f95b00cb5a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.972+0000 7f95b5994700 1 --2- 172.21.15.84:0/2664372661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95b01598e0 0x7f95b00cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.972+0000 7f95b5994700 1 -- 172.21.15.84:0/2664372661 >> 172.21.15.84:0/2664372661 conn(0x7f95b0089e90 msgr2=0x7f95b00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.972+0000 7f95b5994700 1 -- 172.21.15.84:0/2664372661 shutdown_connections 2023-10-06T03:24:28.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.972+0000 7f95b5994700 1 -- 172.21.15.84:0/2664372661 wait complete. 2023-10-06T03:24:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.973+0000 7f95b5994700 1 Processor -- start 2023-10-06T03:24:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.973+0000 7f95b5994700 1 -- start start 2023-10-06T03:24:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95b5994700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95b00ce820 0x7f95b016e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95b5994700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95b0159510 0x7f95b0069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95b5994700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b01598e0 0x7f95b0069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95b5994700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b015bcc0 con 0x7f95b01598e0 2023-10-06T03:24:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95b5994700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b016e5f0 con 0x7f95b0159510 2023-10-06T03:24:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95b5994700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b015c590 con 0x7f95b00ce820 2023-10-06T03:24:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b01598e0 0x7f95b0069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b01598e0 0x7f95b0069aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46334/0 (socket says 172.21.15.84:46334) 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95af7fe700 1 -- 172.21.15.84:0/3497098112 learned_addr learned my addr 172.21.15.84:0/3497098112 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95aeffd700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95b00ce820 0x7f95b016e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95ae7fc700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95b0159510 0x7f95b0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95af7fe700 1 -- 172.21.15.84:0/3497098112 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95b00ce820 msgr2=0x7f95b016e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95af7fe700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95b00ce820 0x7f95b016e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95af7fe700 1 -- 172.21.15.84:0/3497098112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95b0159510 msgr2=0x7f95b0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95af7fe700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95b0159510 0x7f95b0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.974+0000 7f95af7fe700 1 -- 172.21.15.84:0/3497098112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0009ae0 con 0x7f95b01598e0 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.975+0000 7f95af7fe700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b01598e0 0x7f95b0069aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f95a800d860 tx=0x7f95a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.975+0000 7f95a6ffd700 1 -- 172.21.15.84:0/3497098112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80125f0 con 0x7f95b01598e0 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.975+0000 7f95a6ffd700 1 -- 172.21.15.84:0/3497098112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8012790 con 0x7f95b01598e0 2023-10-06T03:24:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.975+0000 7f95b5994700 1 -- 172.21.15.84:0/3497098112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b015b0b0 con 0x7f95b01598e0 2023-10-06T03:24:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.975+0000 7f95a6ffd700 1 -- 172.21.15.84:0/3497098112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8012b50 con 0x7f95b01598e0 2023-10-06T03:24:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.975+0000 7f95b5994700 1 -- 172.21.15.84:0/3497098112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b015b670 con 0x7f95b01598e0 2023-10-06T03:24:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.976+0000 7f95b5994700 1 -- 172.21.15.84:0/3497098112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b0064ad0 con 0x7f95b01598e0 2023-10-06T03:24:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.976+0000 7f95a6ffd700 1 -- 172.21.15.84:0/3497098112 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95a8013480 con 0x7f95b01598e0 2023-10-06T03:24:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.976+0000 7f95a6ffd700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9590066f30 0x7f95900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.976+0000 7f95a6ffd700 1 -- 172.21.15.84:0/3497098112 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f95a8084c10 con 0x7f95b01598e0 2023-10-06T03:24:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.976+0000 7f95aeffd700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9590066f30 0x7f95900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.977+0000 7f95aeffd700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9590066f30 0x7f95900693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009880 tx=0x7f95a0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:28.981+0000 7f95a6ffd700 1 -- 172.21.15.84:0/3497098112 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95a8051a30 con 0x7f95b01598e0 2023-10-06T03:24:29.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.163+0000 7f95b5994700 1 -- 172.21.15.84:0/3497098112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f95b00cf180 con 0x7f95b01598e0 2023-10-06T03:24:29.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.164+0000 7f95a6ffd700 1 -- 172.21.15.84:0/3497098112 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f95a8055050 con 0x7f95b01598e0 2023-10-06T03:24:29.165 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:24:29.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 -- 172.21.15.84:0/3497098112 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9590066f30 msgr2=0x7f95900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9590066f30 0x7f95900693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009880 tx=0x7f95a0018000 comp rx=0 tx=0).stop 2023-10-06T03:24:29.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 -- 172.21.15.84:0/3497098112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b01598e0 msgr2=0x7f95b0069aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b01598e0 0x7f95b0069aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f95a800d860 tx=0x7f95a8008040 comp rx=0 tx=0).stop 2023-10-06T03:24:29.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 -- 172.21.15.84:0/3497098112 shutdown_connections 2023-10-06T03:24:29.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9590066f30 0x7f95900693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95b01598e0 0x7f95b0069aa0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95b00ce820 0x7f95b016e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 --2- 172.21.15.84:0/3497098112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95b0159510 0x7f95b0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 -- 172.21.15.84:0/3497098112 >> 172.21.15.84:0/3497098112 conn(0x7f95b0089e90 msgr2=0x7f95b015da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:29.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 -- 172.21.15.84:0/3497098112 shutdown_connections 2023-10-06T03:24:29.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.166+0000 7f95b5994700 1 -- 172.21.15.84:0/3497098112 wait complete. 2023-10-06T03:24:29.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:29.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.294+0000 7fba4e0b9700 1 Processor -- start 2023-10-06T03:24:29.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.294+0000 7fba4e0b9700 1 -- start start 2023-10-06T03:24:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba4e0b9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fba480b2a30 0x7fba48164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba4e0b9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba480cc9b0 con 0x7fba480b2660 2023-10-06T03:24:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba4e0b9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba480cbda0 con 0x7fba480cd400 2023-10-06T03:24:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba4e0b9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba480cc080 con 0x7fba480b2a30 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba4d0b7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fba480b2660 0x7fba480cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52252/0 (socket says 172.21.15.84:52252) 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba4d0b7700 1 -- 172.21.15.84:0/3563982579 learned_addr learned my addr 172.21.15.84:0/3563982579 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba4d8b8700 1 --2- 172.21.15.84:0/3563982579 >> v2:172.21.15.131:3300/0 conn(0x7fba480b2a30 0x7fba48164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba3ffff700 1 -- 172.21.15.84:0/3563982579 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099291499 0 0) 0x7fba480cc9b0 con 0x7fba480b2660 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba3ffff700 1 -- 172.21.15.84:0/3563982579 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba34003570 con 0x7fba480b2660 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba4d8b8700 1 -- 172.21.15.84:0/3563982579 >> v1:172.21.15.131:6789/0 conn(0x7fba480cd400 legacy=0x7fba480ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba4d8b8700 1 -- 172.21.15.84:0/3563982579 >> v1:172.21.15.84:6789/0 conn(0x7fba480b2660 legacy=0x7fba480cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba3ffff700 1 -- 172.21.15.84:0/3563982579 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 309476367 0 0) 0x7fba34003570 con 0x7fba480b2660 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.295+0000 7fba4d8b8700 1 -- 172.21.15.84:0/3563982579 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba480cc360 con 0x7fba480b2a30 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba4d8b8700 1 --2- 172.21.15.84:0/3563982579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba480b2a30 0x7fba48164360 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba44009e60 tx=0x7fba44009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6c94bf5d8119fcb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba3ffff700 1 -- 172.21.15.84:0/3563982579 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4400e070 con 0x7fba480b2a30 2023-10-06T03:24:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba3ffff700 1 -- 172.21.15.84:0/3563982579 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4400b850 con 0x7fba480b2a30 2023-10-06T03:24:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba3ffff700 1 -- 172.21.15.84:0/3563982579 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba400015f0 con 0x7fba480b2a30 2023-10-06T03:24:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba4e0b9700 1 -- 172.21.15.84:0/3563982579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba480b2a30 msgr2=0x7fba48164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba4e0b9700 1 --2- 172.21.15.84:0/3563982579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba480b2a30 0x7fba48164360 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba44009e60 tx=0x7fba44009780 comp rx=0 tx=0).stop 2023-10-06T03:24:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba4e0b9700 1 -- 172.21.15.84:0/3563982579 shutdown_connections 2023-10-06T03:24:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba4e0b9700 1 --2- 172.21.15.84:0/3563982579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba480b2a30 0x7fba48164360 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba4e0b9700 1 -- 172.21.15.84:0/3563982579 >> 172.21.15.84:0/3563982579 conn(0x7fba48099560 msgr2=0x7fba4806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba4e0b9700 1 -- 172.21.15.84:0/3563982579 shutdown_connections 2023-10-06T03:24:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.296+0000 7fba4e0b9700 1 -- 172.21.15.84:0/3563982579 wait complete. 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.297+0000 7fba4e0b9700 1 Processor -- start 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.297+0000 7fba4e0b9700 1 -- start start 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.298+0000 7fba4e0b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba480b2660 0x7fba48154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.298+0000 7fba4e0b9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba480b2a30 0x7fba48152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.298+0000 7fba4e0b9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba480cd400 0x7fba48068d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.298+0000 7fba4e0b9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba481563f0 con 0x7fba480b2660 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.298+0000 7fba4e0b9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba48155a70 con 0x7fba480b2a30 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.298+0000 7fba4e0b9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba48154fa0 con 0x7fba480cd400 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.298+0000 7fba4d0b7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba480b2660 0x7fba48154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4d0b7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba480b2660 0x7fba48154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46350/0 (socket says 172.21.15.84:46350) 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4d0b7700 1 -- 172.21.15.84:0/1365723365 learned_addr learned my addr 172.21.15.84:0/1365723365 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4d8b8700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba480cd400 0x7fba48068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4c8b6700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba480b2a30 0x7fba48152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4d0b7700 1 -- 172.21.15.84:0/1365723365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba480cd400 msgr2=0x7fba48068d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4d0b7700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba480cd400 0x7fba48068d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4d0b7700 1 -- 172.21.15.84:0/1365723365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba480b2a30 msgr2=0x7fba48152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4d0b7700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba480b2a30 0x7fba48152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4d0b7700 1 -- 172.21.15.84:0/1365723365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44009a20 con 0x7fba480b2660 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4d0b7700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba480b2660 0x7fba48154a60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fba40007fd0 tx=0x7fba40002e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba3d7fa700 1 -- 172.21.15.84:0/1365723365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba40007300 con 0x7fba480b2660 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4e0b9700 1 -- 172.21.15.84:0/1365723365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4815a9b0 con 0x7fba480b2660 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba4e0b9700 1 -- 172.21.15.84:0/1365723365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba481554b0 con 0x7fba480b2660 2023-10-06T03:24:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba3d7fa700 1 -- 172.21.15.84:0/1365723365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba40007670 con 0x7fba480b2660 2023-10-06T03:24:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.299+0000 7fba3d7fa700 1 -- 172.21.15.84:0/1365723365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba400057f0 con 0x7fba480b2660 2023-10-06T03:24:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.300+0000 7fba4e0b9700 1 -- 172.21.15.84:0/1365723365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4805f270 con 0x7fba480b2660 2023-10-06T03:24:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.301+0000 7fba3d7fa700 1 -- 172.21.15.84:0/1365723365 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba40005be0 con 0x7fba480b2660 2023-10-06T03:24:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.301+0000 7fba3d7fa700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fba2c066f30 0x7fba2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.301+0000 7fba3d7fa700 1 -- 172.21.15.84:0/1365723365 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fba40084450 con 0x7fba480b2660 2023-10-06T03:24:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.301+0000 7fba4c8b6700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fba2c066f30 0x7fba2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.301+0000 7fba4c8b6700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fba2c066f30 0x7fba2c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba480cd800 tx=0x7fba38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.305+0000 7fba3d7fa700 1 -- 172.21.15.84:0/1365723365 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba40051270 con 0x7fba480b2660 2023-10-06T03:24:29.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.490+0000 7fba4e0b9700 1 -- 172.21.15.84:0/1365723365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba480cc670 con 0x7fba480b2660 2023-10-06T03:24:29.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.490+0000 7fba3d7fa700 1 -- 172.21.15.84:0/1365723365 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba40054890 con 0x7fba480b2660 2023-10-06T03:24:29.492 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:24:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 -- 172.21.15.84:0/1365723365 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fba2c066f30 msgr2=0x7fba2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fba2c066f30 0x7fba2c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba480cd800 tx=0x7fba38009040 comp rx=0 tx=0).stop 2023-10-06T03:24:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 -- 172.21.15.84:0/1365723365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba480b2660 msgr2=0x7fba48154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba480b2660 0x7fba48154a60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fba40007fd0 tx=0x7fba40002e50 comp rx=0 tx=0).stop 2023-10-06T03:24:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 -- 172.21.15.84:0/1365723365 shutdown_connections 2023-10-06T03:24:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fba2c066f30 0x7fba2c0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba480cd400 0x7fba48068d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba480b2660 0x7fba48154a60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 --2- 172.21.15.84:0/1365723365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba480b2a30 0x7fba48152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 -- 172.21.15.84:0/1365723365 >> 172.21.15.84:0/1365723365 conn(0x7fba48099560 msgr2=0x7fba4815d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 -- 172.21.15.84:0/1365723365 shutdown_connections 2023-10-06T03:24:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.492+0000 7fba4e0b9700 1 -- 172.21.15.84:0/1365723365 wait complete. 2023-10-06T03:24:29.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.622+0000 7fea660c3700 1 Processor -- start 2023-10-06T03:24:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.622+0000 7fea660c3700 1 -- start start 2023-10-06T03:24:29.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.623+0000 7fea660c3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fea600cd980 0x7fea60159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.623+0000 7fea660c3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea600b5f30 con 0x7fea600b4a60 2023-10-06T03:24:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.623+0000 7fea660c3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea600b3640 con 0x7fea600b4eb0 2023-10-06T03:24:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.623+0000 7fea660c3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600b63c0 con 0x7fea600cd980 2023-10-06T03:24:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.623+0000 7fea5effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fea600b4a60 0x7fea600d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52266/0 (socket says 172.21.15.84:52266) 2023-10-06T03:24:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.623+0000 7fea5effd700 1 -- 172.21.15.84:0/3504828634 learned_addr learned my addr 172.21.15.84:0/3504828634 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.623+0000 7fea5f7fe700 1 --2- 172.21.15.84:0/3504828634 >> v2:172.21.15.131:3300/0 conn(0x7fea600cd980 0x7fea60159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186091032 0 0) 0x7fea600b5f30 con 0x7fea600b4a60 2023-10-06T03:24:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea48003570 con 0x7fea600b4a60 2023-10-06T03:24:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048468681 0 0) 0x7fea48003570 con 0x7fea600b4a60 2023-10-06T03:24:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 >> v2:172.21.15.131:3300/0 conn(0x7fea600cd980 msgr2=0x7fea60159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 --2- 172.21.15.84:0/3504828634 >> v2:172.21.15.131:3300/0 conn(0x7fea600cd980 0x7fea60159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 >> v1:172.21.15.131:6789/0 conn(0x7fea600b4eb0 legacy=0x7fea60163240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea600b5320 con 0x7fea600b4a60 2023-10-06T03:24:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fea54001470 con 0x7fea600b4a60 2023-10-06T03:24:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 >> v1:172.21.15.84:6789/0 conn(0x7fea600b4a60 legacy=0x7fea600d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea48003a60 0x7fea48003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea48004810 0x7fea48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea480051c0 0x7fea4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600b63c0 con 0x7fea48003a60 2023-10-06T03:24:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4800c0d0 con 0x7fea480051c0 2023-10-06T03:24:29.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4800c290 con 0x7fea48004810 2023-10-06T03:24:29.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5f7fe700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea48003a60 0x7fea48003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5effd700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea48004810 0x7fea48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5ffff700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea480051c0 0x7fea4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5f7fe700 1 -- 172.21.15.84:0/3504828634 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea48004810 msgr2=0x7fea48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:29.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5f7fe700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea48004810 0x7fea48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5f7fe700 1 -- 172.21.15.84:0/3504828634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea480051c0 msgr2=0x7fea4800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:29.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5f7fe700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea480051c0 0x7fea4800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5ffff700 1 -- 172.21.15.84:0/3504828634 reap_dead start 2023-10-06T03:24:29.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5f7fe700 1 -- 172.21.15.84:0/3504828634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48003570 con 0x7fea48003a60 2023-10-06T03:24:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5f7fe700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea48003a60 0x7fea48003e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea5000e210 tx=0x7fea5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb30f336289dfe75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.624+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000eac0 con 0x7fea48003a60 2023-10-06T03:24:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.625+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5000f040 con 0x7fea48003a60 2023-10-06T03:24:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.625+0000 7fea5e7fc700 1 -- 172.21.15.84:0/3504828634 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000ee70 con 0x7fea48003a60 2023-10-06T03:24:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.625+0000 7fea660c3700 1 -- 172.21.15.84:0/3504828634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea48003a60 msgr2=0x7fea48003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.625+0000 7fea660c3700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea48003a60 0x7fea48003e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea5000e210 tx=0x7fea5000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.625+0000 7fea660c3700 1 -- 172.21.15.84:0/3504828634 shutdown_connections 2023-10-06T03:24:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.625+0000 7fea660c3700 1 --2- 172.21.15.84:0/3504828634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea48003a60 0x7fea48003e70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.625+0000 7fea660c3700 1 -- 172.21.15.84:0/3504828634 >> 172.21.15.84:0/3504828634 conn(0x7fea6006ed20 msgr2=0x7fea6006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.625+0000 7fea660c3700 1 -- 172.21.15.84:0/3504828634 shutdown_connections 2023-10-06T03:24:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.625+0000 7fea660c3700 1 -- 172.21.15.84:0/3504828634 wait complete. 2023-10-06T03:24:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.626+0000 7fea660c3700 1 Processor -- start 2023-10-06T03:24:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.626+0000 7fea660c3700 1 -- start start 2023-10-06T03:24:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea660c3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea48003a60 0x7fea6014f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea660c3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea6013be70 0x7fea600cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea660c3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6013c2e0 0x7fea6015e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea660c3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600d0ff0 con 0x7fea6013c2e0 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea660c3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600d0b60 con 0x7fea6013be70 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea660c3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600cff50 con 0x7fea48003a60 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea5ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6013c2e0 0x7fea6015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea5ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6013c2e0 0x7fea6015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46362/0 (socket says 172.21.15.84:46362) 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea5ffff700 1 -- 172.21.15.84:0/1451473395 learned_addr learned my addr 172.21.15.84:0/1451473395 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea5f7fe700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea48003a60 0x7fea6014f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea5effd700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea6013be70 0x7fea600cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea5ffff700 1 -- 172.21.15.84:0/1451473395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea48003a60 msgr2=0x7fea6014f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea5ffff700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea48003a60 0x7fea6014f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea5ffff700 1 -- 172.21.15.84:0/1451473395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea6013be70 msgr2=0x7fea600cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea5ffff700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea6013be70 0x7fea600cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.627+0000 7fea5ffff700 1 -- 172.21.15.84:0/1451473395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea600d0230 con 0x7fea6013c2e0 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.628+0000 7fea5ffff700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6013c2e0 0x7fea6015e790 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fea600d11e0 tx=0x7fea58009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.628+0000 7fea477fe700 1 -- 172.21.15.84:0/1451473395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5800ee40 con 0x7fea6013c2e0 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.628+0000 7fea477fe700 1 -- 172.21.15.84:0/1451473395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58006820 con 0x7fea6013c2e0 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.628+0000 7fea660c3700 1 -- 172.21.15.84:0/1451473395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea600d0510 con 0x7fea6013c2e0 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.628+0000 7fea477fe700 1 -- 172.21.15.84:0/1451473395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58006be0 con 0x7fea6013c2e0 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.628+0000 7fea660c3700 1 -- 172.21.15.84:0/1451473395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea600cfb40 con 0x7fea6013c2e0 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.629+0000 7fea660c3700 1 -- 172.21.15.84:0/1451473395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea600d0cf0 con 0x7fea6013c2e0 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.629+0000 7fea477fe700 1 -- 172.21.15.84:0/1451473395 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea58007030 con 0x7fea6013c2e0 2023-10-06T03:24:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.629+0000 7fea477fe700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.630+0000 7fea477fe700 1 -- 172.21.15.84:0/1451473395 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fea58083af0 con 0x7fea6013c2e0 2023-10-06T03:24:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.630+0000 7fea5f7fe700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.630+0000 7fea5f7fe700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fea4c066f30 0x7fea4c0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fea5000afd0 tx=0x7fea5001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.634+0000 7fea477fe700 1 -- 172.21.15.84:0/1451473395 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea5804d5a0 con 0x7fea6013c2e0 2023-10-06T03:24:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.814+0000 7fea660c3700 1 -- 172.21.15.84:0/1451473395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea60064ad0 con 0x7fea6013c2e0 2023-10-06T03:24:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.815+0000 7fea477fe700 1 -- 172.21.15.84:0/1451473395 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea580190a0 con 0x7fea6013c2e0 2023-10-06T03:24:29.816 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 -- 172.21.15.84:0/1451473395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fea4c066f30 msgr2=0x7fea4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fea4c066f30 0x7fea4c0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fea5000afd0 tx=0x7fea5001a000 comp rx=0 tx=0).stop 2023-10-06T03:24:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 -- 172.21.15.84:0/1451473395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6013c2e0 msgr2=0x7fea6015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6013c2e0 0x7fea6015e790 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fea600d11e0 tx=0x7fea58009040 comp rx=0 tx=0).stop 2023-10-06T03:24:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 -- 172.21.15.84:0/1451473395 shutdown_connections 2023-10-06T03:24:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6013c2e0 0x7fea6015e790 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea48003a60 0x7fea6014f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 --2- 172.21.15.84:0/1451473395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea6013be70 0x7fea600cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 -- 172.21.15.84:0/1451473395 >> 172.21.15.84:0/1451473395 conn(0x7fea6006ed20 msgr2=0x7fea60152820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:29.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 -- 172.21.15.84:0/1451473395 shutdown_connections 2023-10-06T03:24:29.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.817+0000 7fea660c3700 1 -- 172.21.15.84:0/1451473395 wait complete. 2023-10-06T03:24:29.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.946+0000 7eff745e5700 1 Processor -- start 2023-10-06T03:24:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.946+0000 7eff745e5700 1 -- start start 2023-10-06T03:24:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff745e5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff6c1598e0 0x7eff6c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff745e5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7eff6c0cbcb0 0x7eff6c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff745e5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c0cf610 con 0x7eff6c159510 2023-10-06T03:24:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff745e5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0cf8f0 con 0x7eff6c1598e0 2023-10-06T03:24:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff745e5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0cfbd0 con 0x7eff6c0cbcb0 2023-10-06T03:24:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff71b80700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff6c1598e0 0x7eff6c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff71b80700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff6c1598e0 0x7eff6c0ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46364/0 (socket says 172.21.15.84:46364) 2023-10-06T03:24:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff71b80700 1 -- 172.21.15.84:0/2216848633 learned_addr learned my addr 172.21.15.84:0/2216848633 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff72381700 1 --1- 172.21.15.84:0/2216848633 >> v1:172.21.15.84:6789/0 conn(0x7eff6c159510 0x7eff6c0cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52282/0 (socket says 172.21.15.84:52282) 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff71b80700 1 -- 172.21.15.84:0/2216848633 >> v2:172.21.15.131:3300/0 conn(0x7eff6c0cbcb0 msgr2=0x7eff6c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff71b80700 1 --2- 172.21.15.84:0/2216848633 >> v2:172.21.15.131:3300/0 conn(0x7eff6c0cbcb0 0x7eff6c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff71b80700 1 -- 172.21.15.84:0/2216848633 >> v1:172.21.15.84:6789/0 conn(0x7eff6c159510 legacy=0x7eff6c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff71b80700 1 -- 172.21.15.84:0/2216848633 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0cfeb0 con 0x7eff6c1598e0 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff71b80700 1 --2- 172.21.15.84:0/2216848633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c1598e0 0x7eff6c0ce820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff6c06f990 tx=0x7eff5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d3d27edbf545a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff7137f700 1 -- 172.21.15.84:0/2216848633 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00b860 con 0x7eff6c1598e0 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff7137f700 1 -- 172.21.15.84:0/2216848633 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c00b9c0 con 0x7eff6c1598e0 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.947+0000 7eff7137f700 1 -- 172.21.15.84:0/2216848633 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00bd60 con 0x7eff6c1598e0 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.948+0000 7eff745e5700 1 -- 172.21.15.84:0/2216848633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c1598e0 msgr2=0x7eff6c0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.948+0000 7eff745e5700 1 --2- 172.21.15.84:0/2216848633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c1598e0 0x7eff6c0ce820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff6c06f990 tx=0x7eff5c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.948+0000 7eff745e5700 1 -- 172.21.15.84:0/2216848633 shutdown_connections 2023-10-06T03:24:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.948+0000 7eff745e5700 1 --2- 172.21.15.84:0/2216848633 >> v2:172.21.15.131:3300/0 conn(0x7eff6c0cbcb0 0x7eff6c0ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.948+0000 7eff745e5700 1 --2- 172.21.15.84:0/2216848633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c1598e0 0x7eff6c0ce820 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.948+0000 7eff745e5700 1 -- 172.21.15.84:0/2216848633 >> 172.21.15.84:0/2216848633 conn(0x7eff6c089e90 msgr2=0x7eff6c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.948+0000 7eff745e5700 1 -- 172.21.15.84:0/2216848633 shutdown_connections 2023-10-06T03:24:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.948+0000 7eff745e5700 1 -- 172.21.15.84:0/2216848633 wait complete. 2023-10-06T03:24:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.949+0000 7eff745e5700 1 Processor -- start 2023-10-06T03:24:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.949+0000 7eff745e5700 1 -- start start 2023-10-06T03:24:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff745e5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff6c0cbcb0 0x7eff6c16b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff745e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c159510 0x7eff6c15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff745e5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff6c1598e0 0x7eff6c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff745e5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c1559c0 con 0x7eff6c159510 2023-10-06T03:24:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff745e5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c154550 con 0x7eff6c1598e0 2023-10-06T03:24:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff745e5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c1547a0 con 0x7eff6c0cbcb0 2023-10-06T03:24:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff71b80700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c159510 0x7eff6c15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff71b80700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c159510 0x7eff6c15bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46370/0 (socket says 172.21.15.84:46370) 2023-10-06T03:24:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff71b80700 1 -- 172.21.15.84:0/3495249602 learned_addr learned my addr 172.21.15.84:0/3495249602 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff72381700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff6c0cbcb0 0x7eff6c16b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff72b82700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff6c1598e0 0x7eff6c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff71b80700 1 -- 172.21.15.84:0/3495249602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff6c0cbcb0 msgr2=0x7eff6c16b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff71b80700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff6c0cbcb0 0x7eff6c16b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff71b80700 1 -- 172.21.15.84:0/3495249602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff6c1598e0 msgr2=0x7eff6c155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff71b80700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff6c1598e0 0x7eff6c155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff71b80700 1 -- 172.21.15.84:0/3495249602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c0094f0 con 0x7eff6c159510 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff72381700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff6c0cbcb0 0x7eff6c16b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff72b82700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff6c1598e0 0x7eff6c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff71b80700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c159510 0x7eff6c15bbf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009290 tx=0x7eff5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.950+0000 7eff627fc700 1 -- 172.21.15.84:0/3495249602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c011e60 con 0x7eff6c159510 2023-10-06T03:24:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.951+0000 7eff627fc700 1 -- 172.21.15.84:0/3495249602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c01f070 con 0x7eff6c159510 2023-10-06T03:24:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.951+0000 7eff745e5700 1 -- 172.21.15.84:0/3495249602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c154a80 con 0x7eff6c159510 2023-10-06T03:24:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.951+0000 7eff627fc700 1 -- 172.21.15.84:0/3495249602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c01a870 con 0x7eff6c159510 2023-10-06T03:24:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.951+0000 7eff745e5700 1 -- 172.21.15.84:0/3495249602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c155040 con 0x7eff6c159510 2023-10-06T03:24:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.951+0000 7eff745e5700 1 -- 172.21.15.84:0/3495249602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c155370 con 0x7eff6c159510 2023-10-06T03:24:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.952+0000 7eff627fc700 1 -- 172.21.15.84:0/3495249602 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff5c01abe0 con 0x7eff6c159510 2023-10-06T03:24:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.952+0000 7eff627fc700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff50066f30 0x7eff500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.952+0000 7eff627fc700 1 -- 172.21.15.84:0/3495249602 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7eff5c021070 con 0x7eff6c159510 2023-10-06T03:24:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.952+0000 7eff72381700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff50066f30 0x7eff500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.953+0000 7eff72381700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff50066f30 0x7eff500693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff64001820 tx=0x7eff64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:29.956+0000 7eff627fc700 1 -- 172.21.15.84:0/3495249602 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff5c053740 con 0x7eff6c159510 2023-10-06T03:24:30.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.138+0000 7eff745e5700 1 -- 172.21.15.84:0/3495249602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff6c064ad0 con 0x7eff6c159510 2023-10-06T03:24:30.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.138+0000 7eff627fc700 1 -- 172.21.15.84:0/3495249602 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff5c056d60 con 0x7eff6c159510 2023-10-06T03:24:30.139 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:24:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.140+0000 7eff745e5700 1 -- 172.21.15.84:0/3495249602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff50066f30 msgr2=0x7eff500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.140+0000 7eff745e5700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff50066f30 0x7eff500693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff64001820 tx=0x7eff64009040 comp rx=0 tx=0).stop 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.141+0000 7eff745e5700 1 -- 172.21.15.84:0/3495249602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c159510 msgr2=0x7eff6c15bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.141+0000 7eff745e5700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c159510 0x7eff6c15bbf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009290 tx=0x7eff5c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.141+0000 7eff745e5700 1 -- 172.21.15.84:0/3495249602 shutdown_connections 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.141+0000 7eff745e5700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff50066f30 0x7eff500693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.141+0000 7eff745e5700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff6c1598e0 0x7eff6c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.141+0000 7eff745e5700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff6c0cbcb0 0x7eff6c16b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.141+0000 7eff745e5700 1 --2- 172.21.15.84:0/3495249602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff6c159510 0x7eff6c15bbf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.141+0000 7eff745e5700 1 -- 172.21.15.84:0/3495249602 >> 172.21.15.84:0/3495249602 conn(0x7eff6c089e90 msgr2=0x7eff6c15cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.141+0000 7eff745e5700 1 -- 172.21.15.84:0/3495249602 shutdown_connections 2023-10-06T03:24:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.141+0000 7eff745e5700 1 -- 172.21.15.84:0/3495249602 wait complete. 2023-10-06T03:24:30.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.270+0000 7faa6d38d700 1 Processor -- start 2023-10-06T03:24:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.270+0000 7faa6d38d700 1 -- start start 2023-10-06T03:24:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.271+0000 7faa6d38d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa68159510 0x7faa680cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.271+0000 7faa6d38d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680cbae0 0x7faa680cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.271+0000 7faa6d38d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa680cbef0 con 0x7faa681598e0 2023-10-06T03:24:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.271+0000 7faa6d38d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa680cf610 con 0x7faa68159510 2023-10-06T03:24:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.271+0000 7faa6d38d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680cf8f0 con 0x7faa680cbae0 2023-10-06T03:24:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.271+0000 7faa66ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa68159510 0x7faa680cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.271+0000 7faa66ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa68159510 0x7faa680cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46372/0 (socket says 172.21.15.84:46372) 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.271+0000 7faa5e7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faa681598e0 0x7faa680ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52294/0 (socket says 172.21.15.84:52294) 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.271+0000 7faa66ffd700 1 -- 172.21.15.84:0/581957571 learned_addr learned my addr 172.21.15.84:0/581957571 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.271+0000 7faa677fe700 1 --2- 172.21.15.84:0/581957571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680cbae0 0x7faa680cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa66ffd700 1 -- 172.21.15.84:0/581957571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680cbae0 msgr2=0x7faa680cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa66ffd700 1 --2- 172.21.15.84:0/581957571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680cbae0 0x7faa680cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa66ffd700 1 -- 172.21.15.84:0/581957571 >> v1:172.21.15.84:6789/0 conn(0x7faa681598e0 legacy=0x7faa680ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa66ffd700 1 -- 172.21.15.84:0/581957571 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680cfbd0 con 0x7faa68159510 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa667fc700 1 -- 172.21.15.84:0/581957571 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435159314 0 0) 0x7faa680cbef0 con 0x7faa681598e0 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa66ffd700 1 --2- 172.21.15.84:0/581957571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 0x7faa680cb5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faa580099b0 tx=0x7faa58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b402012f0f5cbd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa667fc700 1 -- 172.21.15.84:0/581957571 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800b860 con 0x7faa68159510 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa667fc700 1 -- 172.21.15.84:0/581957571 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5800b9c0 con 0x7faa68159510 2023-10-06T03:24:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa667fc700 1 -- 172.21.15.84:0/581957571 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800bd60 con 0x7faa68159510 2023-10-06T03:24:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa6d38d700 1 -- 172.21.15.84:0/581957571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 msgr2=0x7faa680cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa6d38d700 1 --2- 172.21.15.84:0/581957571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 0x7faa680cb5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faa580099b0 tx=0x7faa58009250 comp rx=0 tx=0).stop 2023-10-06T03:24:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa6d38d700 1 -- 172.21.15.84:0/581957571 shutdown_connections 2023-10-06T03:24:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa6d38d700 1 --2- 172.21.15.84:0/581957571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680cbae0 0x7faa680cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa6d38d700 1 --2- 172.21.15.84:0/581957571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 0x7faa680cb5a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa6d38d700 1 -- 172.21.15.84:0/581957571 >> 172.21.15.84:0/581957571 conn(0x7faa68089e90 msgr2=0x7faa680997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa6d38d700 1 -- 172.21.15.84:0/581957571 shutdown_connections 2023-10-06T03:24:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.272+0000 7faa6d38d700 1 -- 172.21.15.84:0/581957571 wait complete. 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa6d38d700 1 Processor -- start 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa6d38d700 1 -- start start 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa6d38d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680cbae0 0x7faa680b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa6d38d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 0x7faa6816a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa6d38d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa681598e0 0x7faa680b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa6d38d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680b4410 con 0x7faa68159510 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa6d38d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680b5090 con 0x7faa680cbae0 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa6d38d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680b4170 con 0x7faa681598e0 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa5e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 0x7faa6816a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa5e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 0x7faa6816a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46376/0 (socket says 172.21.15.84:46376) 2023-10-06T03:24:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.274+0000 7faa5e7fc700 1 -- 172.21.15.84:0/2445653231 learned_addr learned my addr 172.21.15.84:0/2445653231 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa66ffd700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680cbae0 0x7faa680b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa677fe700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa681598e0 0x7faa680b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa5e7fc700 1 -- 172.21.15.84:0/2445653231 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa681598e0 msgr2=0x7faa680b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa5e7fc700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa681598e0 0x7faa680b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa5e7fc700 1 -- 172.21.15.84:0/2445653231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680cbae0 msgr2=0x7faa680b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa5e7fc700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680cbae0 0x7faa680b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa5e7fc700 1 -- 172.21.15.84:0/2445653231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa580094f0 con 0x7faa68159510 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa66ffd700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680cbae0 0x7faa680b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa5e7fc700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 0x7faa6816a910 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faa5000c5b0 tx=0x7faa50007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa5f7fe700 1 -- 172.21.15.84:0/2445653231 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50005a70 con 0x7faa68159510 2023-10-06T03:24:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa5f7fe700 1 -- 172.21.15.84:0/2445653231 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa50005bd0 con 0x7faa68159510 2023-10-06T03:24:30.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa6d38d700 1 -- 172.21.15.84:0/2445653231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa680b4760 con 0x7faa68159510 2023-10-06T03:24:30.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa5f7fe700 1 -- 172.21.15.84:0/2445653231 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa500070d0 con 0x7faa68159510 2023-10-06T03:24:30.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.275+0000 7faa6d38d700 1 -- 172.21.15.84:0/2445653231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa680b4d20 con 0x7faa68159510 2023-10-06T03:24:30.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.276+0000 7faa6d38d700 1 -- 172.21.15.84:0/2445653231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa68064ad0 con 0x7faa68159510 2023-10-06T03:24:30.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.276+0000 7faa5f7fe700 1 -- 172.21.15.84:0/2445653231 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa50007480 con 0x7faa68159510 2023-10-06T03:24:30.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.277+0000 7faa5f7fe700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa48066f30 0x7faa480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.277+0000 7faa5f7fe700 1 -- 172.21.15.84:0/2445653231 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7faa50083e30 con 0x7faa68159510 2023-10-06T03:24:30.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.277+0000 7faa66ffd700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa48066f30 0x7faa480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.277+0000 7faa66ffd700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa48066f30 0x7faa480693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa580099b0 tx=0x7faa58017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.281+0000 7faa5f7fe700 1 -- 172.21.15.84:0/2445653231 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa50050c50 con 0x7faa68159510 2023-10-06T03:24:30.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.463+0000 7faa6d38d700 1 -- 172.21.15.84:0/2445653231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faa680cfeb0 con 0x7faa68159510 2023-10-06T03:24:30.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.463+0000 7faa5f7fe700 1 -- 172.21.15.84:0/2445653231 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7faa50017020 con 0x7faa68159510 2023-10-06T03:24:30.464 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 -- 172.21.15.84:0/2445653231 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa48066f30 msgr2=0x7faa480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa48066f30 0x7faa480693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa580099b0 tx=0x7faa58017000 comp rx=0 tx=0).stop 2023-10-06T03:24:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 -- 172.21.15.84:0/2445653231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 msgr2=0x7faa6816a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 0x7faa6816a910 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faa5000c5b0 tx=0x7faa50007f20 comp rx=0 tx=0).stop 2023-10-06T03:24:30.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 -- 172.21.15.84:0/2445653231 shutdown_connections 2023-10-06T03:24:30.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa48066f30 0x7faa480693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680cbae0 0x7faa680b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa681598e0 0x7faa680b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 --2- 172.21.15.84:0/2445653231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa68159510 0x7faa6816a910 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 -- 172.21.15.84:0/2445653231 >> 172.21.15.84:0/2445653231 conn(0x7faa68089e90 msgr2=0x7faa6815d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:30.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 -- 172.21.15.84:0/2445653231 shutdown_connections 2023-10-06T03:24:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.465+0000 7faa6d38d700 1 -- 172.21.15.84:0/2445653231 wait complete. 2023-10-06T03:24:30.500 INFO:tasks.cephfs_test_runner:Starting test: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a client unmounts, the thread count on the MDS goes back 2023-10-06T03:24:30.501 INFO:tasks.cephfs_test_runner:test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T03:24:30.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2023-10-06T03:24:30.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.619+0000 7feb693a2700 1 Processor -- start 2023-10-06T03:24:30.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.619+0000 7feb693a2700 1 -- start start 2023-10-06T03:24:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.619+0000 7feb693a2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb641594d0 0x7feb640a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.619+0000 7feb693a2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb640af600 0x7feb6406af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.619+0000 7feb693a2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6406aae0 con 0x7feb6406b4b0 2023-10-06T03:24:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.619+0000 7feb693a2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb640aa030 con 0x7feb641594d0 2023-10-06T03:24:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.619+0000 7feb693a2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb640aa2d0 con 0x7feb640af600 2023-10-06T03:24:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb63fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb641594d0 0x7feb640a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb63fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb641594d0 0x7feb640a9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36784/0 (socket says 172.21.15.84:36784) 2023-10-06T03:24:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb63fff700 1 -- 172.21.15.84:0/2724661976 learned_addr learned my addr 172.21.15.84:0/2724661976 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb63fff700 1 -- 172.21.15.84:0/2724661976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb640af600 msgr2=0x7feb6406af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb637fe700 1 --2- 172.21.15.84:0/2724661976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb640af600 0x7feb6406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb63fff700 1 --2- 172.21.15.84:0/2724661976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb640af600 0x7feb6406af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb63fff700 1 -- 172.21.15.84:0/2724661976 >> v1:172.21.15.131:6789/0 conn(0x7feb6406b4b0 legacy=0x7feb640675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb63fff700 1 -- 172.21.15.84:0/2724661976 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb640aa5b0 con 0x7feb641594d0 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb63fff700 1 --2- 172.21.15.84:0/2724661976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb641594d0 0x7feb640a9af0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feb540099b0 tx=0x7feb54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928a5093a33926fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb62ffd700 1 -- 172.21.15.84:0/2724661976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5400b820 con 0x7feb641594d0 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb62ffd700 1 -- 172.21.15.84:0/2724661976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5400b980 con 0x7feb641594d0 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.620+0000 7feb62ffd700 1 -- 172.21.15.84:0/2724661976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5400bd20 con 0x7feb641594d0 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.621+0000 7feb693a2700 1 -- 172.21.15.84:0/2724661976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb641594d0 msgr2=0x7feb640a9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.621+0000 7feb693a2700 1 --2- 172.21.15.84:0/2724661976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb641594d0 0x7feb640a9af0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feb540099b0 tx=0x7feb54009250 comp rx=0 tx=0).stop 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.621+0000 7feb693a2700 1 -- 172.21.15.84:0/2724661976 shutdown_connections 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.621+0000 7feb693a2700 1 --2- 172.21.15.84:0/2724661976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb641594d0 0x7feb640a9af0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.621+0000 7feb693a2700 1 --2- 172.21.15.84:0/2724661976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb640af600 0x7feb6406af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.621+0000 7feb693a2700 1 -- 172.21.15.84:0/2724661976 >> 172.21.15.84:0/2724661976 conn(0x7feb640691d0 msgr2=0x7feb640aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.621+0000 7feb693a2700 1 -- 172.21.15.84:0/2724661976 shutdown_connections 2023-10-06T03:24:30.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.621+0000 7feb693a2700 1 -- 172.21.15.84:0/2724661976 wait complete. 2023-10-06T03:24:30.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.622+0000 7feb693a2700 1 Processor -- start 2023-10-06T03:24:30.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.622+0000 7feb693a2700 1 -- start start 2023-10-06T03:24:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb693a2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb6406b4b0 0x7feb6414aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb693a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb640af600 0x7feb640b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb693a2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb641594d0 0x7feb6415f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb693a2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb640ae090 con 0x7feb640af600 2023-10-06T03:24:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb693a2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6414a240 con 0x7feb6406b4b0 2023-10-06T03:24:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb693a2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb640ad480 con 0x7feb641594d0 2023-10-06T03:24:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb640af600 0x7feb640b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb640af600 0x7feb640b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36786/0 (socket says 172.21.15.84:36786) 2023-10-06T03:24:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb637fe700 1 -- 172.21.15.84:0/3681654465 learned_addr learned my addr 172.21.15.84:0/3681654465 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb637fe700 1 -- 172.21.15.84:0/3681654465 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb641594d0 msgr2=0x7feb6415f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb637fe700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb641594d0 0x7feb6415f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb637fe700 1 -- 172.21.15.84:0/3681654465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb6406b4b0 msgr2=0x7feb6414aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb637fe700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb6406b4b0 0x7feb6414aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb637fe700 1 -- 172.21.15.84:0/3681654465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb540094f0 con 0x7feb640af600 2023-10-06T03:24:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb637fe700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb640af600 0x7feb640b1ec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feb5800c7d0 tx=0x7feb58008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb4bfff700 1 -- 172.21.15.84:0/3681654465 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58011600 con 0x7feb640af600 2023-10-06T03:24:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb4bfff700 1 -- 172.21.15.84:0/3681654465 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb58011760 con 0x7feb640af600 2023-10-06T03:24:30.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb693a2700 1 -- 172.21.15.84:0/3681654465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb640ad760 con 0x7feb640af600 2023-10-06T03:24:30.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb4bfff700 1 -- 172.21.15.84:0/3681654465 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58011b20 con 0x7feb640af600 2023-10-06T03:24:30.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.623+0000 7feb693a2700 1 -- 172.21.15.84:0/3681654465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb640add20 con 0x7feb640af600 2023-10-06T03:24:30.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.624+0000 7feb693a2700 1 -- 172.21.15.84:0/3681654465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6405f270 con 0x7feb640af600 2023-10-06T03:24:30.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.625+0000 7feb4bfff700 1 -- 172.21.15.84:0/3681654465 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb580193f0 con 0x7feb640af600 2023-10-06T03:24:30.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.625+0000 7feb4bfff700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feb50066f30 0x7feb500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.625+0000 7feb4bfff700 1 -- 172.21.15.84:0/3681654465 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7feb58084d90 con 0x7feb640af600 2023-10-06T03:24:30.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.625+0000 7feb63fff700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feb50066f30 0x7feb500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.626+0000 7feb63fff700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feb50066f30 0x7feb500693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb540099b0 tx=0x7feb54016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.629+0000 7feb4bfff700 1 -- 172.21.15.84:0/3681654465 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb58051bb0 con 0x7feb640af600 2023-10-06T03:24:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:30.890+0000 7feb693a2700 1 -- 172.21.15.84:0/3681654465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) v1 -- 0x7feb640ae1d0 con 0x7feb640af600 2023-10-06T03:24:31.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.384+0000 7feb4bfff700 1 -- 172.21.15.84:0/3681654465 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v57) v1 ==== 147+0+0 (secure 0 0 0) 0x7feb580551d0 con 0x7feb640af600 2023-10-06T03:24:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 -- 172.21.15.84:0/3681654465 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feb50066f30 msgr2=0x7feb500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feb50066f30 0x7feb500693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb540099b0 tx=0x7feb54016000 comp rx=0 tx=0).stop 2023-10-06T03:24:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 -- 172.21.15.84:0/3681654465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb640af600 msgr2=0x7feb640b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb640af600 0x7feb640b1ec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feb5800c7d0 tx=0x7feb58008040 comp rx=0 tx=0).stop 2023-10-06T03:24:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 -- 172.21.15.84:0/3681654465 shutdown_connections 2023-10-06T03:24:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feb50066f30 0x7feb500693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb6406b4b0 0x7feb6414aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb641594d0 0x7feb6415f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 --2- 172.21.15.84:0/3681654465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb640af600 0x7feb640b1ec0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 -- 172.21.15.84:0/3681654465 >> 172.21.15.84:0/3681654465 conn(0x7feb640691d0 msgr2=0x7feb6414f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:31.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 -- 172.21.15.84:0/3681654465 shutdown_connections 2023-10-06T03:24:31.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.386+0000 7feb693a2700 1 -- 172.21.15.84:0/3681654465 wait complete. 2023-10-06T03:24:31.399 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:24:31.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.516+0000 7f11451ed700 1 Processor -- start 2023-10-06T03:24:31.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.516+0000 7f11451ed700 1 -- start start 2023-10-06T03:24:31.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f11451ed700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400cd980 0x7f1140159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f11451ed700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f11400b4a60 0x7f11400d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f11451ed700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400b5f30 con 0x7f11400d0850 2023-10-06T03:24:31.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f11451ed700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400b3640 con 0x7f11400b4a60 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f11451ed700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11400d0c90 con 0x7f11400cd980 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f113e59c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f11400b4a60 0x7f11400d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f113ed9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400cd980 0x7f1140159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f113f59e700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f11400d0850 0x7f114015ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:57208/0 (socket says 172.21.15.84:57208) 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f113f59e700 1 -- 172.21.15.84:0/2394741058 learned_addr learned my addr 172.21.15.84:0/2394741058 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f113e59c700 1 -- 172.21.15.84:0/2394741058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400cd980 msgr2=0x7f1140159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f113e59c700 1 --2- 172.21.15.84:0/2394741058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400cd980 0x7f1140159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f113e59c700 1 -- 172.21.15.84:0/2394741058 >> v1:172.21.15.131:6789/0 conn(0x7f11400d0850 legacy=0x7f114015ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f113e59c700 1 -- 172.21.15.84:0/2394741058 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400b63c0 con 0x7f11400b4a60 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f113dd9b700 1 -- 172.21.15.84:0/2394741058 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757797561 0 0) 0x7f11400b5f30 con 0x7f11400d0850 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.517+0000 7f113ed9d700 1 --2- 172.21.15.84:0/2394741058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400cd980 0x7f1140159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f113e59c700 1 --2- 172.21.15.84:0/2394741058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11400b4a60 0x7f11400d0310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f11340098e0 tx=0x7f11340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2adebeca60402ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:31.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f113dd9b700 1 -- 172.21.15.84:0/2394741058 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113400b640 con 0x7f11400b4a60 2023-10-06T03:24:31.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f113dd9b700 1 -- 172.21.15.84:0/2394741058 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113400b7a0 con 0x7f11400b4a60 2023-10-06T03:24:31.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f113dd9b700 1 -- 172.21.15.84:0/2394741058 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113400bb40 con 0x7f11400b4a60 2023-10-06T03:24:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f11451ed700 1 -- 172.21.15.84:0/2394741058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11400b4a60 msgr2=0x7f11400d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f11451ed700 1 --2- 172.21.15.84:0/2394741058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11400b4a60 0x7f11400d0310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f11340098e0 tx=0x7f11340091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f11451ed700 1 -- 172.21.15.84:0/2394741058 shutdown_connections 2023-10-06T03:24:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f11451ed700 1 --2- 172.21.15.84:0/2394741058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400cd980 0x7f1140159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f11451ed700 1 --2- 172.21.15.84:0/2394741058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11400b4a60 0x7f11400d0310 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f11451ed700 1 -- 172.21.15.84:0/2394741058 >> 172.21.15.84:0/2394741058 conn(0x7f114006ed20 msgr2=0x7f114006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f11451ed700 1 -- 172.21.15.84:0/2394741058 shutdown_connections 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.518+0000 7f11451ed700 1 -- 172.21.15.84:0/2394741058 wait complete. 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.519+0000 7f11451ed700 1 Processor -- start 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.519+0000 7f11451ed700 1 -- start start 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f11451ed700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11400b4a60 0x7f114015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f11451ed700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400cd980 0x7f1140148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f11451ed700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400d0850 0x7f1140149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f11451ed700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114016d320 con 0x7f11400cd980 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f11451ed700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114016d5c0 con 0x7f11400b4a60 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f11451ed700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114016d8a0 con 0x7f11400d0850 2023-10-06T03:24:31.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f113e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400cd980 0x7f1140148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f113e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400cd980 0x7f1140148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36798/0 (socket says 172.21.15.84:36798) 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f113e59c700 1 -- 172.21.15.84:0/3136363209 learned_addr learned my addr 172.21.15.84:0/3136363209 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f113ed9d700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11400b4a60 0x7f114015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.520+0000 7f113f59e700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400d0850 0x7f1140149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f113e59c700 1 -- 172.21.15.84:0/3136363209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400d0850 msgr2=0x7f1140149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f113e59c700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400d0850 0x7f1140149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f113e59c700 1 -- 172.21.15.84:0/3136363209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11400b4a60 msgr2=0x7f114015e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f113e59c700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11400b4a60 0x7f114015e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f113e59c700 1 -- 172.21.15.84:0/3136363209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1130009420 con 0x7f11400cd980 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f113e59c700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400cd980 0x7f1140148af0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1140089150 tx=0x7f1134017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f1126ffd700 1 -- 172.21.15.84:0/3136363209 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113400bb20 con 0x7f11400cd980 2023-10-06T03:24:31.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f1126ffd700 1 -- 172.21.15.84:0/3136363209 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1134000c90 con 0x7f11400cd980 2023-10-06T03:24:31.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f1126ffd700 1 -- 172.21.15.84:0/3136363209 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134011650 con 0x7f11400cd980 2023-10-06T03:24:31.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f11451ed700 1 -- 172.21.15.84:0/3136363209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1134009420 con 0x7f11400cd980 2023-10-06T03:24:31.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.521+0000 7f11451ed700 1 -- 172.21.15.84:0/3136363209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114016de60 con 0x7f11400cd980 2023-10-06T03:24:31.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.522+0000 7f11451ed700 1 -- 172.21.15.84:0/3136363209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1140064ad0 con 0x7f11400cd980 2023-10-06T03:24:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.522+0000 7f1126ffd700 1 -- 172.21.15.84:0/3136363209 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1134011a00 con 0x7f11400cd980 2023-10-06T03:24:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.523+0000 7f1126ffd700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f112c066f30 0x7f112c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.523+0000 7f113ed9d700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f112c066f30 0x7f112c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.523+0000 7f1126ffd700 1 -- 172.21.15.84:0/3136363209 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1134085f70 con 0x7f11400cd980 2023-10-06T03:24:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.523+0000 7f113ed9d700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f112c066f30 0x7f112c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1130009f40 tx=0x7f11300091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.527+0000 7f1126ffd700 1 -- 172.21.15.84:0/3136363209 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1134052e10 con 0x7f11400cd980 2023-10-06T03:24:31.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.710+0000 7f11451ed700 1 -- 172.21.15.84:0/3136363209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1140149570 con 0x7f11400cd980 2023-10-06T03:24:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.713+0000 7f1126ffd700 1 -- 172.21.15.84:0/3136363209 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1134011cb0 con 0x7f11400cd980 2023-10-06T03:24:31.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 -- 172.21.15.84:0/3136363209 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f112c066f30 msgr2=0x7f112c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f112c066f30 0x7f112c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1130009f40 tx=0x7f11300091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 -- 172.21.15.84:0/3136363209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400cd980 msgr2=0x7f1140148af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400cd980 0x7f1140148af0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1140089150 tx=0x7f1134017000 comp rx=0 tx=0).stop 2023-10-06T03:24:31.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 -- 172.21.15.84:0/3136363209 shutdown_connections 2023-10-06T03:24:31.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f112c066f30 0x7f112c0693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11400b4a60 0x7f114015e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11400d0850 0x7f1140149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 --2- 172.21.15.84:0/3136363209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400cd980 0x7f1140148af0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 -- 172.21.15.84:0/3136363209 >> 172.21.15.84:0/3136363209 conn(0x7f114006ed20 msgr2=0x7f114015a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 -- 172.21.15.84:0/3136363209 shutdown_connections 2023-10-06T03:24:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:31.715+0000 7f11451ed700 1 -- 172.21.15.84:0/3136363209 wait complete. 2023-10-06T03:24:31.727 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:24:31.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:24:31.771 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:24:31.817 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:24:31.817 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:24:31.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:31.817 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T03:24:31.859 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:24:31.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:31.860 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:24:31.914 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:24:31.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:31.914 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T03:24:31.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:24:31.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:31.954 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:24:32.010 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T03:24:32.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:32.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T03:24:32.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:24:32.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:32.049 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T03:24:32.104 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T03:24:32.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:32.105 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T03:24:32.139 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:24:32.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:32.139 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T03:24:32.195 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:24:32.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:32.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.309+0000 7f4374420700 1 Processor -- start 2023-10-06T03:24:32.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.309+0000 7f4374420700 1 -- start start 2023-10-06T03:24:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f4374420700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f436c06eb00 0x7f436c0ad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f4374420700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c0acd60 con 0x7f436c06e690 2023-10-06T03:24:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f4374420700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c156910 con 0x7f436c156540 2023-10-06T03:24:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f4374420700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c06f470 con 0x7f436c06eb00 2023-10-06T03:24:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43719bb700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f436c06e690 0x7f436c0ad1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37168/0 (socket says 172.21.15.84:37168) 2023-10-06T03:24:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43719bb700 1 -- 172.21.15.84:0/2726060140 learned_addr learned my addr 172.21.15.84:0/2726060140 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43729bd700 1 --2- 172.21.15.84:0/2726060140 >> v2:172.21.15.131:3300/0 conn(0x7f436c06eb00 0x7f436c0ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728342763 0 0) 0x7f436c0acd60 con 0x7f436c06e690 2023-10-06T03:24:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4354003570 con 0x7f436c06e690 2023-10-06T03:24:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564045719 0 0) 0x7f4354003570 con 0x7f436c06e690 2023-10-06T03:24:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 >> v2:172.21.15.131:3300/0 conn(0x7f436c06eb00 msgr2=0x7f436c0ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 --2- 172.21.15.84:0/2726060140 >> v2:172.21.15.131:3300/0 conn(0x7f436c06eb00 0x7f436c0ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 >> v1:172.21.15.131:6789/0 conn(0x7f436c156540 legacy=0x7f436c0c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c0c7b70 con 0x7f436c06e690 2023-10-06T03:24:32.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f4360001470 con 0x7f436c06e690 2023-10-06T03:24:32.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 >> v1:172.21.15.84:6789/0 conn(0x7f436c06e690 legacy=0x7f436c0ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354003a60 0x7f4354003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4354004810 0x7f4354004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43540051c0 0x7f435400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c06f470 con 0x7f4354004810 2023-10-06T03:24:32.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435400c0d0 con 0x7f43540051c0 2023-10-06T03:24:32.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435400c290 con 0x7f4354003a60 2023-10-06T03:24:32.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.310+0000 7f43719bb700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4354004810 0x7f4354004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43721bc700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354003a60 0x7f4354003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43729bd700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43540051c0 0x7f435400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43719bb700 1 -- 172.21.15.84:0/2726060140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354003a60 msgr2=0x7f4354003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:32.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43719bb700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354003a60 0x7f4354003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43719bb700 1 -- 172.21.15.84:0/2726060140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43540051c0 msgr2=0x7f435400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:32.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43719bb700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43540051c0 0x7f435400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43729bd700 1 -- 172.21.15.84:0/2726060140 reap_dead start 2023-10-06T03:24:32.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43719bb700 1 -- 172.21.15.84:0/2726060140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354003570 con 0x7f4354004810 2023-10-06T03:24:32.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43721bc700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354003a60 0x7f4354003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:32.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43719bb700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4354004810 0x7f4354004c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f436000c3c0 tx=0x7f4360001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84319ff19b332373 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:32.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000cc50 con 0x7f4354004810 2023-10-06T03:24:32.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436000cdb0 con 0x7f4354004810 2023-10-06T03:24:32.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f43711ba700 1 -- 172.21.15.84:0/2726060140 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360005b50 con 0x7f4354004810 2023-10-06T03:24:32.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f4374420700 1 -- 172.21.15.84:0/2726060140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4354004810 msgr2=0x7f4354004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.311+0000 7f4374420700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4354004810 0x7f4354004c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f436000c3c0 tx=0x7f4360001e50 comp rx=0 tx=0).stop 2023-10-06T03:24:32.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.312+0000 7f4374420700 1 -- 172.21.15.84:0/2726060140 shutdown_connections 2023-10-06T03:24:32.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.312+0000 7f4374420700 1 --2- 172.21.15.84:0/2726060140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4354004810 0x7f4354004c80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.312+0000 7f4374420700 1 -- 172.21.15.84:0/2726060140 >> 172.21.15.84:0/2726060140 conn(0x7f436c0680c0 msgr2=0x7f436c0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:32.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.312+0000 7f4374420700 1 -- 172.21.15.84:0/2726060140 shutdown_connections 2023-10-06T03:24:32.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.312+0000 7f4374420700 1 -- 172.21.15.84:0/2726060140 wait complete. 2023-10-06T03:24:32.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.313+0000 7f4374420700 1 Processor -- start 2023-10-06T03:24:32.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.313+0000 7f4374420700 1 -- start start 2023-10-06T03:24:32.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.313+0000 7f4374420700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354004810 0x7f436c0c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.313+0000 7f4374420700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c0aff70 0x7f436c0b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.313+0000 7f4374420700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f436c0695e0 0x7f436c069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.313+0000 7f4374420700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0af280 con 0x7f436c0695e0 2023-10-06T03:24:32.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.313+0000 7f4374420700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c069f90 con 0x7f436c0aff70 2023-10-06T03:24:32.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.313+0000 7f4374420700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0afae0 con 0x7f4354004810 2023-10-06T03:24:32.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43729bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f436c0695e0 0x7f436c069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43729bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f436c0695e0 0x7f436c069a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36814/0 (socket says 172.21.15.84:36814) 2023-10-06T03:24:32.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43729bd700 1 -- 172.21.15.84:0/1925276532 learned_addr learned my addr 172.21.15.84:0/1925276532 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:32.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43721bc700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354004810 0x7f436c0c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43719bb700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c0aff70 0x7f436c0b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43729bd700 1 -- 172.21.15.84:0/1925276532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354004810 msgr2=0x7f436c0c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43729bd700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354004810 0x7f436c0c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43729bd700 1 -- 172.21.15.84:0/1925276532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c0aff70 msgr2=0x7f436c0b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43729bd700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c0aff70 0x7f436c0b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43729bd700 1 -- 172.21.15.84:0/1925276532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c16e370 con 0x7f436c0695e0 2023-10-06T03:24:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43721bc700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354004810 0x7f436c0c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43719bb700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c0aff70 0x7f436c0b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f43729bd700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f436c0695e0 0x7f436c069a50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4364007de0 tx=0x7f436400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f436a7fc700 1 -- 172.21.15.84:0/1925276532 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400e070 con 0x7f436c0695e0 2023-10-06T03:24:32.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f436a7fc700 1 -- 172.21.15.84:0/1925276532 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4364011d30 con 0x7f436c0695e0 2023-10-06T03:24:32.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f4374420700 1 -- 172.21.15.84:0/1925276532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c0af490 con 0x7f436c0695e0 2023-10-06T03:24:32.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f436a7fc700 1 -- 172.21.15.84:0/1925276532 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364011ee0 con 0x7f436c0695e0 2023-10-06T03:24:32.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.314+0000 7f4374420700 1 -- 172.21.15.84:0/1925276532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c0c2600 con 0x7f436c0695e0 2023-10-06T03:24:32.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.315+0000 7f4374420700 1 -- 172.21.15.84:0/1925276532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436c064ad0 con 0x7f436c0695e0 2023-10-06T03:24:32.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.315+0000 7f436a7fc700 1 -- 172.21.15.84:0/1925276532 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4364016970 con 0x7f436c0695e0 2023-10-06T03:24:32.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.316+0000 7f436a7fc700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4358066f30 0x7f43580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.316+0000 7f43721bc700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4358066f30 0x7f43580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.316+0000 7f436a7fc700 1 -- 172.21.15.84:0/1925276532 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4364085710 con 0x7f436c0695e0 2023-10-06T03:24:32.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.316+0000 7f43721bc700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4358066f30 0x7f43580693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f435c007bc0 tx=0x7f435c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:32.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.320+0000 7f436a7fc700 1 -- 172.21.15.84:0/1925276532 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4364052530 con 0x7f436c0695e0 2023-10-06T03:24:32.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.546+0000 7f4374420700 1 -- 172.21.15.84:0/1925276532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f436c0c7e50 con 0x7f436c0695e0 2023-10-06T03:24:32.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.546+0000 7f436a7fc700 1 -- 172.21.15.84:0/1925276532 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f4364055b50 con 0x7f436c0695e0 2023-10-06T03:24:32.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:32.547 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:49.917332+0000","modified":"2023-10-06T03:24:03.584509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:32.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 -- 172.21.15.84:0/1925276532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4358066f30 msgr2=0x7f43580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4358066f30 0x7f43580693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f435c007bc0 tx=0x7f435c009040 comp rx=0 tx=0).stop 2023-10-06T03:24:32.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 -- 172.21.15.84:0/1925276532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f436c0695e0 msgr2=0x7f436c069a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f436c0695e0 0x7f436c069a50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4364007de0 tx=0x7f436400b040 comp rx=0 tx=0).stop 2023-10-06T03:24:32.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 -- 172.21.15.84:0/1925276532 shutdown_connections 2023-10-06T03:24:32.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4358066f30 0x7f43580693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f436c0695e0 0x7f436c069a50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354004810 0x7f436c0c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 --2- 172.21.15.84:0/1925276532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c0aff70 0x7f436c0b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 -- 172.21.15.84:0/1925276532 >> 172.21.15.84:0/1925276532 conn(0x7f436c0680c0 msgr2=0x7f436c0ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:32.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 -- 172.21.15.84:0/1925276532 shutdown_connections 2023-10-06T03:24:32.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.548+0000 7f4374420700 1 -- 172.21.15.84:0/1925276532 wait complete. 2023-10-06T03:24:32.550 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-10-06T03:24:32.561 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:32.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.674+0000 7fa440d3e700 1 Processor -- start 2023-10-06T03:24:32.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.674+0000 7fa440d3e700 1 -- start start 2023-10-06T03:24:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.675+0000 7fa440d3e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0adba0 0x7fa43c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.675+0000 7fa440d3e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa43c0ce710 0x7fa43c15af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.675+0000 7fa440d3e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c0ceb70 con 0x7fa43c0ca3b0 2023-10-06T03:24:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.675+0000 7fa440d3e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c0cbbd0 con 0x7fa43c0ce710 2023-10-06T03:24:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.675+0000 7fa440d3e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c157e20 con 0x7fa43c0adba0 2023-10-06T03:24:32.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa439d9b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0adba0 0x7fa43c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43ad9d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa43c0ce710 0x7fa43c15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43a59c700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa43c0ca3b0 0x7fa43c1582b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:57222/0 (socket says 172.21.15.84:57222) 2023-10-06T03:24:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa439d9b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0adba0 0x7fa43c0ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:39972/0 (socket says 172.21.15.84:39972) 2023-10-06T03:24:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43ad9d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa43c0ce710 0x7fa43c15af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:45098/0 (socket says 172.21.15.84:45098) 2023-10-06T03:24:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43a59c700 1 -- 172.21.15.84:0/616297636 learned_addr learned my addr 172.21.15.84:0/616297636 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43ad9d700 1 -- 172.21.15.84:0/616297636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0adba0 msgr2=0x7fa43c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43ad9d700 1 --2- 172.21.15.84:0/616297636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0adba0 0x7fa43c0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43ad9d700 1 -- 172.21.15.84:0/616297636 >> v1:172.21.15.131:6789/0 conn(0x7fa43c0ca3b0 legacy=0x7fa43c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43959a700 1 -- 172.21.15.84:0/616297636 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215605497 0 0) 0x7fa42c001490 con 0x7fa43c0ca3b0 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43ad9d700 1 -- 172.21.15.84:0/616297636 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c0cb610 con 0x7fa43c0ce710 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43ad9d700 1 --2- 172.21.15.84:0/616297636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43c0ce710 0x7fa43c15af10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4340098e0 tx=0x7fa4340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21468835361723c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.676+0000 7fa43959a700 1 -- 172.21.15.84:0/616297636 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400b640 con 0x7fa43c0ce710 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.677+0000 7fa43959a700 1 -- 172.21.15.84:0/616297636 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43400b7a0 con 0x7fa43c0ce710 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.677+0000 7fa43959a700 1 -- 172.21.15.84:0/616297636 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400bb40 con 0x7fa43c0ce710 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.677+0000 7fa440d3e700 1 -- 172.21.15.84:0/616297636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43c0ce710 msgr2=0x7fa43c15af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.677+0000 7fa440d3e700 1 --2- 172.21.15.84:0/616297636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43c0ce710 0x7fa43c15af10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4340098e0 tx=0x7fa4340091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.677+0000 7fa440d3e700 1 -- 172.21.15.84:0/616297636 shutdown_connections 2023-10-06T03:24:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.677+0000 7fa440d3e700 1 --2- 172.21.15.84:0/616297636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43c0ce710 0x7fa43c15af10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.677+0000 7fa440d3e700 1 --2- 172.21.15.84:0/616297636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0adba0 0x7fa43c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.677+0000 7fa440d3e700 1 -- 172.21.15.84:0/616297636 >> 172.21.15.84:0/616297636 conn(0x7fa43c070810 msgr2=0x7fa43c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.677+0000 7fa440d3e700 1 -- 172.21.15.84:0/616297636 shutdown_connections 2023-10-06T03:24:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.677+0000 7fa440d3e700 1 -- 172.21.15.84:0/616297636 wait complete. 2023-10-06T03:24:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.678+0000 7fa440d3e700 1 Processor -- start 2023-10-06T03:24:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.678+0000 7fa440d3e700 1 -- start start 2023-10-06T03:24:32.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa440d3e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43c0adba0 0x7fa43c1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa440d3e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0ca3b0 0x7fa43c14bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa440d3e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43c0ce710 0x7fa43c15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa440d3e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c15ae80 con 0x7fa43c0ce710 2023-10-06T03:24:32.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa440d3e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c15b160 con 0x7fa43c0adba0 2023-10-06T03:24:32.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa440d3e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c153810 con 0x7fa43c0ca3b0 2023-10-06T03:24:32.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa43ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43c0ce710 0x7fa43c15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa43ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43c0ce710 0x7fa43c15b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36824/0 (socket says 172.21.15.84:36824) 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa43ad9d700 1 -- 172.21.15.84:0/4284118468 learned_addr learned my addr 172.21.15.84:0/4284118468 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa439d9b700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0ca3b0 0x7fa43c14bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa43a59c700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43c0adba0 0x7fa43c1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa43ad9d700 1 -- 172.21.15.84:0/4284118468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0ca3b0 msgr2=0x7fa43c14bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa43ad9d700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0ca3b0 0x7fa43c14bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa43ad9d700 1 -- 172.21.15.84:0/4284118468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43c0adba0 msgr2=0x7fa43c1532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa43ad9d700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43c0adba0 0x7fa43c1532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa43ad9d700 1 -- 172.21.15.84:0/4284118468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434009420 con 0x7fa43c0ce710 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.679+0000 7fa43ad9d700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43c0ce710 0x7fa43c15b5f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa434009f80 tx=0x7fa434017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.680+0000 7fa4327fc700 1 -- 172.21.15.84:0/4284118468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400bb20 con 0x7fa43c0ce710 2023-10-06T03:24:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.680+0000 7fa4327fc700 1 -- 172.21.15.84:0/4284118468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434011420 con 0x7fa43c0ce710 2023-10-06T03:24:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.680+0000 7fa440d3e700 1 -- 172.21.15.84:0/4284118468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c069f80 con 0x7fa43c0ce710 2023-10-06T03:24:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.680+0000 7fa4327fc700 1 -- 172.21.15.84:0/4284118468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4340117a0 con 0x7fa43c0ce710 2023-10-06T03:24:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.680+0000 7fa440d3e700 1 -- 172.21.15.84:0/4284118468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c06a540 con 0x7fa43c0ce710 2023-10-06T03:24:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.680+0000 7fa440d3e700 1 -- 172.21.15.84:0/4284118468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c15b2f0 con 0x7fa43c0ce710 2023-10-06T03:24:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.681+0000 7fa4327fc700 1 -- 172.21.15.84:0/4284118468 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa434011b10 con 0x7fa43c0ce710 2023-10-06T03:24:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.681+0000 7fa4327fc700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa41c066fb0 0x7fa41c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.681+0000 7fa4327fc700 1 -- 172.21.15.84:0/4284118468 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa434086440 con 0x7fa43c0ce710 2023-10-06T03:24:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.682+0000 7fa43a59c700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa41c066fb0 0x7fa41c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.682+0000 7fa43a59c700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa41c066fb0 0x7fa41c069460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0072e0 tx=0x7fa42c001a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:32.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.686+0000 7fa4327fc700 1 -- 172.21.15.84:0/4284118468 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4340531c0 con 0x7fa43c0ce710 2023-10-06T03:24:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.867+0000 7fa440d3e700 1 -- 172.21.15.84:0/4284118468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa43c064ad0 con 0x7fa43c0ce710 2023-10-06T03:24:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.868+0000 7fa4327fc700 1 -- 172.21.15.84:0/4284118468 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fa4340567e0 con 0x7fa43c0ce710 2023-10-06T03:24:32.869 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:32.869 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.870+0000 7fa440d3e700 1 -- 172.21.15.84:0/4284118468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa41c066fb0 msgr2=0x7fa41c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa41c066fb0 0x7fa41c069460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0072e0 tx=0x7fa42c001a10 comp rx=0 tx=0).stop 2023-10-06T03:24:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 -- 172.21.15.84:0/4284118468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43c0ce710 msgr2=0x7fa43c15b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43c0ce710 0x7fa43c15b5f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa434009f80 tx=0x7fa434017000 comp rx=0 tx=0).stop 2023-10-06T03:24:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 -- 172.21.15.84:0/4284118468 shutdown_connections 2023-10-06T03:24:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa41c066fb0 0x7fa41c069460 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43c0adba0 0x7fa43c1532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43c0ce710 0x7fa43c15b5f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 --2- 172.21.15.84:0/4284118468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa43c0ca3b0 0x7fa43c14bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 -- 172.21.15.84:0/4284118468 >> 172.21.15.84:0/4284118468 conn(0x7fa43c070810 msgr2=0x7fa43c14d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 -- 172.21.15.84:0/4284118468 shutdown_connections 2023-10-06T03:24:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.871+0000 7fa440d3e700 1 -- 172.21.15.84:0/4284118468 wait complete. 2023-10-06T03:24:32.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:47.554201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:48.881558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:52.564434+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:32.884 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.999+0000 7fae36ab6700 1 Processor -- start 2023-10-06T03:24:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:32.999+0000 7fae36ab6700 1 -- start start 2023-10-06T03:24:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae36ab6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae300cd400 0x7fae300ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae36ab6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae300cc9b0 con 0x7fae300b2a30 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae36ab6700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae300cbda0 con 0x7fae300b2660 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae36ab6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae300cc080 con 0x7fae300cd400 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae352b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae300cd400 0x7fae300ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae362b5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fae300b2a30 0x7fae300c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37184/0 (socket says 172.21.15.84:37184) 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae352b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae300cd400 0x7fae300ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36834/0 (socket says 172.21.15.84:36834) 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae362b5700 1 -- 172.21.15.84:0/3112804481 learned_addr learned my addr 172.21.15.84:0/3112804481 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae352b3700 1 -- 172.21.15.84:0/3112804481 >> v1:172.21.15.131:6789/0 conn(0x7fae300b2660 legacy=0x7fae300cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae352b3700 1 -- 172.21.15.84:0/3112804481 >> v1:172.21.15.84:6789/0 conn(0x7fae300b2a30 legacy=0x7fae300c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae352b3700 1 -- 172.21.15.84:0/3112804481 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300cc360 con 0x7fae300cd400 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae34ab2700 1 -- 172.21.15.84:0/3112804481 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827158685 0 0) 0x7fae300cc9b0 con 0x7fae300b2a30 2023-10-06T03:24:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae352b3700 1 --2- 172.21.15.84:0/3112804481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 0x7fae300ceae0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae200098e0 tx=0x7fae200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccd6d59925a2d68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae34ab2700 1 -- 172.21.15.84:0/3112804481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20009e80 con 0x7fae300cd400 2023-10-06T03:24:33.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae34ab2700 1 -- 172.21.15.84:0/3112804481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2000b860 con 0x7fae300cd400 2023-10-06T03:24:33.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.000+0000 7fae34ab2700 1 -- 172.21.15.84:0/3112804481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000bbe0 con 0x7fae300cd400 2023-10-06T03:24:33.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.001+0000 7fae36ab6700 1 -- 172.21.15.84:0/3112804481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 msgr2=0x7fae300ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.001+0000 7fae36ab6700 1 --2- 172.21.15.84:0/3112804481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 0x7fae300ceae0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae200098e0 tx=0x7fae200091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.001+0000 7fae36ab6700 1 -- 172.21.15.84:0/3112804481 shutdown_connections 2023-10-06T03:24:33.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.001+0000 7fae36ab6700 1 --2- 172.21.15.84:0/3112804481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 0x7fae300ceae0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.001+0000 7fae36ab6700 1 -- 172.21.15.84:0/3112804481 >> 172.21.15.84:0/3112804481 conn(0x7fae30099560 msgr2=0x7fae3006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:33.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.001+0000 7fae36ab6700 1 -- 172.21.15.84:0/3112804481 shutdown_connections 2023-10-06T03:24:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.001+0000 7fae36ab6700 1 -- 172.21.15.84:0/3112804481 wait complete. 2023-10-06T03:24:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.002+0000 7fae36ab6700 1 Processor -- start 2023-10-06T03:24:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.002+0000 7fae36ab6700 1 -- start start 2023-10-06T03:24:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae36ab6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae300b2660 0x7fae30147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae36ab6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300b2a30 0x7fae300b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae36ab6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 0x7fae300b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae36ab6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3016a630 con 0x7fae300cd400 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae36ab6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae30148480 con 0x7fae300b2a30 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae36ab6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3016d460 con 0x7fae300b2660 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae362b5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 0x7fae300b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae362b5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 0x7fae300b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36844/0 (socket says 172.21.15.84:36844) 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae362b5700 1 -- 172.21.15.84:0/747945981 learned_addr learned my addr 172.21.15.84:0/747945981 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae352b3700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300b2a30 0x7fae300b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae35ab4700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae300b2660 0x7fae30147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae362b5700 1 -- 172.21.15.84:0/747945981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae300b2660 msgr2=0x7fae30147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae362b5700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae300b2660 0x7fae30147f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae362b5700 1 -- 172.21.15.84:0/747945981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300b2a30 msgr2=0x7fae300b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae362b5700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300b2a30 0x7fae300b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae362b5700 1 -- 172.21.15.84:0/747945981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae20009420 con 0x7fae300cd400 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae362b5700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 0x7fae300b58a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fae2800ccf0 tx=0x7fae280019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae25ffb700 1 -- 172.21.15.84:0/747945981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800a810 con 0x7fae300cd400 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae25ffb700 1 -- 172.21.15.84:0/747945981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2800a990 con 0x7fae300cd400 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae25ffb700 1 -- 172.21.15.84:0/747945981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800ad50 con 0x7fae300cd400 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.003+0000 7fae36ab6700 1 -- 172.21.15.84:0/747945981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae30155900 con 0x7fae300cd400 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.004+0000 7fae36ab6700 1 -- 172.21.15.84:0/747945981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3016ce10 con 0x7fae300cd400 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.004+0000 7fae36ab6700 1 -- 172.21.15.84:0/747945981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3016d5d0 con 0x7fae300cd400 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.005+0000 7fae25ffb700 1 -- 172.21.15.84:0/747945981 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae28007300 con 0x7fae300cd400 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.005+0000 7fae25ffb700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 0x7fae140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.005+0000 7fae25ffb700 1 -- 172.21.15.84:0/747945981 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fae28084bc0 con 0x7fae300cd400 2023-10-06T03:24:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.005+0000 7fae35ab4700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 0x7fae140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.005+0000 7fae35ab4700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 0x7fae140693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae2c003a20 tx=0x7fae2c007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.009+0000 7fae25ffb700 1 -- 172.21.15.84:0/747945981 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae28051a60 con 0x7fae300cd400 2023-10-06T03:24:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.192+0000 7fae36ab6700 1 -- 172.21.15.84:0/747945981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae3005f270 con 0x7fae300cd400 2023-10-06T03:24:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.193+0000 7fae25ffb700 1 -- 172.21.15.84:0/747945981 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae28055080 con 0x7fae300cd400 2023-10-06T03:24:33.193 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:24:33.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 -- 172.21.15.84:0/747945981 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 msgr2=0x7fae140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 0x7fae140693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae2c003a20 tx=0x7fae2c007f10 comp rx=0 tx=0).stop 2023-10-06T03:24:33.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 -- 172.21.15.84:0/747945981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 msgr2=0x7fae300b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 0x7fae300b58a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fae2800ccf0 tx=0x7fae280019e0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 -- 172.21.15.84:0/747945981 shutdown_connections 2023-10-06T03:24:33.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fae14066f30 0x7fae140693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae300cd400 0x7fae300b58a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae300b2660 0x7fae30147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 --2- 172.21.15.84:0/747945981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300b2a30 0x7fae300b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 -- 172.21.15.84:0/747945981 >> 172.21.15.84:0/747945981 conn(0x7fae30099560 msgr2=0x7fae30068150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:33.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 -- 172.21.15.84:0/747945981 shutdown_connections 2023-10-06T03:24:33.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.195+0000 7fae36ab6700 1 -- 172.21.15.84:0/747945981 wait complete. 2023-10-06T03:24:33.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:33.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.322+0000 7f76caabb700 1 Processor -- start 2023-10-06T03:24:33.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.322+0000 7f76caabb700 1 -- start start 2023-10-06T03:24:33.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.323+0000 7f76caabb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76c4159510 0x7f76c40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.323+0000 7f76caabb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f76c41598e0 0x7f76c40cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.323+0000 7f76caabb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c40ce820 0x7f76c40cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.323+0000 7f76caabb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c40cf610 con 0x7f76c4159510 2023-10-06T03:24:33.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.323+0000 7f76caabb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c40cf8f0 con 0x7f76c41598e0 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.323+0000 7f76caabb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40cfbd0 con 0x7f76c40ce820 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.323+0000 7f76c8857700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76c4159510 0x7f76c40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.323+0000 7f76c8857700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76c4159510 0x7f76c40cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36854/0 (socket says 172.21.15.84:36854) 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.323+0000 7f76c8857700 1 -- 172.21.15.84:0/2863796028 learned_addr learned my addr 172.21.15.84:0/2863796028 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c8857700 1 -- 172.21.15.84:0/2863796028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c40ce820 msgr2=0x7f76c40cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c9058700 1 --2- 172.21.15.84:0/2863796028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c40ce820 0x7f76c40cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c3fff700 1 --2- 172.21.15.84:0/2863796028 >> v2:172.21.15.131:3300/0 conn(0x7f76c41598e0 0x7f76c40cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c8857700 1 --2- 172.21.15.84:0/2863796028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c40ce820 0x7f76c40cec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c8857700 1 -- 172.21.15.84:0/2863796028 >> v2:172.21.15.131:3300/0 conn(0x7f76c41598e0 msgr2=0x7f76c40cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c8857700 1 --2- 172.21.15.84:0/2863796028 >> v2:172.21.15.131:3300/0 conn(0x7f76c41598e0 0x7f76c40cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c8857700 1 -- 172.21.15.84:0/2863796028 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c40cfeb0 con 0x7f76c4159510 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c8857700 1 --2- 172.21.15.84:0/2863796028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4159510 0x7f76c40cb5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f76c40c73b0 tx=0x7f76b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5cc586f7e680e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c37fe700 1 -- 172.21.15.84:0/2863796028 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400e070 con 0x7f76c4159510 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c37fe700 1 -- 172.21.15.84:0/2863796028 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b400ba50 con 0x7f76c4159510 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76c37fe700 1 -- 172.21.15.84:0/2863796028 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b40092e0 con 0x7f76c4159510 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76caabb700 1 -- 172.21.15.84:0/2863796028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4159510 msgr2=0x7f76c40cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76caabb700 1 --2- 172.21.15.84:0/2863796028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4159510 0x7f76c40cb5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f76c40c73b0 tx=0x7f76b4009840 comp rx=0 tx=0).stop 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76caabb700 1 -- 172.21.15.84:0/2863796028 shutdown_connections 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76caabb700 1 --2- 172.21.15.84:0/2863796028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c40ce820 0x7f76c40cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76caabb700 1 --2- 172.21.15.84:0/2863796028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4159510 0x7f76c40cb5a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76caabb700 1 --2- 172.21.15.84:0/2863796028 >> v2:172.21.15.131:3300/0 conn(0x7f76c41598e0 0x7f76c40cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76caabb700 1 -- 172.21.15.84:0/2863796028 >> 172.21.15.84:0/2863796028 conn(0x7f76c4089e90 msgr2=0x7f76c40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:33.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76caabb700 1 -- 172.21.15.84:0/2863796028 shutdown_connections 2023-10-06T03:24:33.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.324+0000 7f76caabb700 1 -- 172.21.15.84:0/2863796028 wait complete. 2023-10-06T03:24:33.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.325+0000 7f76caabb700 1 Processor -- start 2023-10-06T03:24:33.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.326+0000 7f76caabb700 1 -- start start 2023-10-06T03:24:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.326+0000 7f76caabb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40ce820 0x7f76c414f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.326+0000 7f76caabb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c4159510 0x7f76c40c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.326+0000 7f76caabb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c41598e0 0x7f76c40c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.326+0000 7f76caabb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c41566d0 con 0x7f76c40ce820 2023-10-06T03:24:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.326+0000 7f76caabb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4155b00 con 0x7f76c4159510 2023-10-06T03:24:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.326+0000 7f76caabb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c414f600 con 0x7f76c41598e0 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.326+0000 7f76c8857700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40ce820 0x7f76c414f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c8857700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40ce820 0x7f76c414f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36858/0 (socket says 172.21.15.84:36858) 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c8857700 1 -- 172.21.15.84:0/2418362638 learned_addr learned my addr 172.21.15.84:0/2418362638 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c8857700 1 -- 172.21.15.84:0/2418362638 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c41598e0 msgr2=0x7f76c40c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c8857700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c41598e0 0x7f76c40c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c8857700 1 -- 172.21.15.84:0/2418362638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c4159510 msgr2=0x7f76c40c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c8857700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c4159510 0x7f76c40c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c8857700 1 -- 172.21.15.84:0/2418362638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009ae0 con 0x7f76c40ce820 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c8857700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40ce820 0x7f76c414f0c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009880 tx=0x7f76b4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c0ff9700 1 -- 172.21.15.84:0/2418362638 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4008bb0 con 0x7f76c40ce820 2023-10-06T03:24:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c0ff9700 1 -- 172.21.15.84:0/2418362638 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b4008d30 con 0x7f76c40ce820 2023-10-06T03:24:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76caabb700 1 -- 172.21.15.84:0/2418362638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c4155da0 con 0x7f76c40ce820 2023-10-06T03:24:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76c0ff9700 1 -- 172.21.15.84:0/2418362638 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4008ea0 con 0x7f76c40ce820 2023-10-06T03:24:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.327+0000 7f76caabb700 1 -- 172.21.15.84:0/2418362638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c4156360 con 0x7f76c40ce820 2023-10-06T03:24:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.328+0000 7f76caabb700 1 -- 172.21.15.84:0/2418362638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c4064ad0 con 0x7f76c40ce820 2023-10-06T03:24:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.328+0000 7f76c0ff9700 1 -- 172.21.15.84:0/2418362638 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76b4003040 con 0x7f76c40ce820 2023-10-06T03:24:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.329+0000 7f76c0ff9700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f76b0066f30 0x7f76b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.329+0000 7f76c3fff700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f76b0066f30 0x7f76b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.329+0000 7f76c0ff9700 1 -- 172.21.15.84:0/2418362638 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f76b40869e0 con 0x7f76c40ce820 2023-10-06T03:24:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.329+0000 7f76c3fff700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f76b0066f30 0x7f76b00693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f76c414f950 tx=0x7f76b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.333+0000 7f76c0ff9700 1 -- 172.21.15.84:0/2418362638 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76b40538b0 con 0x7f76c40ce820 2023-10-06T03:24:33.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.515+0000 7f76caabb700 1 -- 172.21.15.84:0/2418362638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76c40cf170 con 0x7f76c40ce820 2023-10-06T03:24:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.515+0000 7f76c0ff9700 1 -- 172.21.15.84:0/2418362638 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76b4056ed0 con 0x7f76c40ce820 2023-10-06T03:24:33.516 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:24:33.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 -- 172.21.15.84:0/2418362638 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f76b0066f30 msgr2=0x7f76b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f76b0066f30 0x7f76b00693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f76c414f950 tx=0x7f76b8008040 comp rx=0 tx=0).stop 2023-10-06T03:24:33.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 -- 172.21.15.84:0/2418362638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40ce820 msgr2=0x7f76c414f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40ce820 0x7f76c414f0c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009880 tx=0x7f76b4018000 comp rx=0 tx=0).stop 2023-10-06T03:24:33.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 -- 172.21.15.84:0/2418362638 shutdown_connections 2023-10-06T03:24:33.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f76b0066f30 0x7f76b00693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c41598e0 0x7f76c40c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40ce820 0x7f76c414f0c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 --2- 172.21.15.84:0/2418362638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c4159510 0x7f76c40c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 -- 172.21.15.84:0/2418362638 >> 172.21.15.84:0/2418362638 conn(0x7f76c4089e90 msgr2=0x7f76c40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:33.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 -- 172.21.15.84:0/2418362638 shutdown_connections 2023-10-06T03:24:33.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.517+0000 7f76caabb700 1 -- 172.21.15.84:0/2418362638 wait complete. 2023-10-06T03:24:33.530 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.646+0000 7fd7b4514700 1 Processor -- start 2023-10-06T03:24:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.646+0000 7fd7b4514700 1 -- start start 2023-10-06T03:24:33.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.647+0000 7fd7b4514700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7ac159550 0x7fd7ac0675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.647+0000 7fd7b4514700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7ac159920 0x7fd7ac067b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.647+0000 7fd7b4514700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd7ac06e3d0 0x7fd7ac06e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.647+0000 7fd7b4514700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac0b0690 con 0x7fd7ac159550 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.647+0000 7fd7b4514700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac06ed90 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.647+0000 7fd7b4514700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac06f020 con 0x7fd7ac159920 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.647+0000 7fd7b22b0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7ac159550 0x7fd7ac0675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.647+0000 7fd7b22b0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7ac159550 0x7fd7ac0675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36862/0 (socket says 172.21.15.84:36862) 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.647+0000 7fd7b22b0700 1 -- 172.21.15.84:0/2269167626 learned_addr learned my addr 172.21.15.84:0/2269167626 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b22b0700 1 -- 172.21.15.84:0/2269167626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7ac159920 msgr2=0x7fd7ac067b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b1aaf700 1 --2- 172.21.15.84:0/2269167626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7ac159920 0x7fd7ac067b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b22b0700 1 --2- 172.21.15.84:0/2269167626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7ac159920 0x7fd7ac067b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b22b0700 1 -- 172.21.15.84:0/2269167626 >> v2:172.21.15.131:3300/0 conn(0x7fd7ac06e3d0 msgr2=0x7fd7ac06e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b2ab1700 1 --2- 172.21.15.84:0/2269167626 >> v2:172.21.15.131:3300/0 conn(0x7fd7ac06e3d0 0x7fd7ac06e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b22b0700 1 --2- 172.21.15.84:0/2269167626 >> v2:172.21.15.131:3300/0 conn(0x7fd7ac06e3d0 0x7fd7ac06e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b22b0700 1 -- 172.21.15.84:0/2269167626 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac06f300 con 0x7fd7ac159550 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b2ab1700 1 --2- 172.21.15.84:0/2269167626 >> v2:172.21.15.131:3300/0 conn(0x7fd7ac06e3d0 0x7fd7ac06e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b22b0700 1 --2- 172.21.15.84:0/2269167626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac159550 0x7fd7ac0675f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac06a450 tx=0x7fd79c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b03f984b7d64158 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b12ae700 1 -- 172.21.15.84:0/2269167626 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c00e070 con 0x7fd7ac159550 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b12ae700 1 -- 172.21.15.84:0/2269167626 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c00bad0 con 0x7fd7ac159550 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b12ae700 1 -- 172.21.15.84:0/2269167626 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0092e0 con 0x7fd7ac159550 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b4514700 1 -- 172.21.15.84:0/2269167626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac159550 msgr2=0x7fd7ac0675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.648+0000 7fd7b4514700 1 --2- 172.21.15.84:0/2269167626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac159550 0x7fd7ac0675f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac06a450 tx=0x7fd79c009840 comp rx=0 tx=0).stop 2023-10-06T03:24:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.649+0000 7fd7b4514700 1 -- 172.21.15.84:0/2269167626 shutdown_connections 2023-10-06T03:24:33.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.649+0000 7fd7b4514700 1 --2- 172.21.15.84:0/2269167626 >> v2:172.21.15.131:3300/0 conn(0x7fd7ac06e3d0 0x7fd7ac06e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.649+0000 7fd7b4514700 1 --2- 172.21.15.84:0/2269167626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac159550 0x7fd7ac0675f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.649+0000 7fd7b4514700 1 --2- 172.21.15.84:0/2269167626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7ac159920 0x7fd7ac067b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.649+0000 7fd7b4514700 1 -- 172.21.15.84:0/2269167626 >> 172.21.15.84:0/2269167626 conn(0x7fd7ac069190 msgr2=0x7fd7ac0cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:33.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.649+0000 7fd7b4514700 1 -- 172.21.15.84:0/2269167626 shutdown_connections 2023-10-06T03:24:33.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.649+0000 7fd7b4514700 1 -- 172.21.15.84:0/2269167626 wait complete. 2023-10-06T03:24:33.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.650+0000 7fd7b4514700 1 Processor -- start 2023-10-06T03:24:33.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.650+0000 7fd7b4514700 1 -- start start 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.650+0000 7fd7b4514700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac06e3d0 0x7fd7ac0c2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.650+0000 7fd7b4514700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7ac159550 0x7fd7ac1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.650+0000 7fd7b4514700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ac159920 0x7fd7ac16d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.650+0000 7fd7b4514700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac16e100 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.650+0000 7fd7b4514700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0c2840 con 0x7fd7ac159920 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.650+0000 7fd7b4514700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac151a20 con 0x7fd7ac159550 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b22b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac06e3d0 0x7fd7ac0c2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b22b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac06e3d0 0x7fd7ac0c2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36870/0 (socket says 172.21.15.84:36870) 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b22b0700 1 -- 172.21.15.84:0/1389546516 learned_addr learned my addr 172.21.15.84:0/1389546516 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b22b0700 1 -- 172.21.15.84:0/1389546516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7ac159550 msgr2=0x7fd7ac1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b22b0700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7ac159550 0x7fd7ac1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b22b0700 1 -- 172.21.15.84:0/1389546516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ac159920 msgr2=0x7fd7ac16d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b22b0700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ac159920 0x7fd7ac16d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b22b0700 1 -- 172.21.15.84:0/1389546516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c009ae0 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b22b0700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac06e3d0 0x7fd7ac0c2cd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009430 tx=0x7fd79c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7aa7fc700 1 -- 172.21.15.84:0/1389546516 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c008bb0 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7aa7fc700 1 -- 172.21.15.84:0/1389546516 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c008d10 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b4514700 1 -- 172.21.15.84:0/1389546516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ac0c1c30 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7aa7fc700 1 -- 172.21.15.84:0/1389546516 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0266b0 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.651+0000 7fd7b4514700 1 -- 172.21.15.84:0/1389546516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac0c21f0 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.652+0000 7fd7b4514700 1 -- 172.21.15.84:0/1389546516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ac0c2b20 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.652+0000 7fd7aa7fc700 1 -- 172.21.15.84:0/1389546516 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd79c003040 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.653+0000 7fd7aa7fc700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd798066f30 0x7fd7980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.653+0000 7fd7aa7fc700 1 -- 172.21.15.84:0/1389546516 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd79c086940 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.653+0000 7fd7b1aaf700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd798066f30 0x7fd7980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.653+0000 7fd7b1aaf700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd798066f30 0x7fd7980693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0c3640 tx=0x7fd7a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.657+0000 7fd7aa7fc700 1 -- 172.21.15.84:0/1389546516 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd79c053810 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.837+0000 7fd7b4514700 1 -- 172.21.15.84:0/1389546516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd7ac064ad0 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.837+0000 7fd7aa7fc700 1 -- 172.21.15.84:0/1389546516 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd79c056e30 con 0x7fd7ac06e3d0 2023-10-06T03:24:33.838 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:33.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 -- 172.21.15.84:0/1389546516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd798066f30 msgr2=0x7fd7980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd798066f30 0x7fd7980693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0c3640 tx=0x7fd7a0008040 comp rx=0 tx=0).stop 2023-10-06T03:24:33.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 -- 172.21.15.84:0/1389546516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac06e3d0 msgr2=0x7fd7ac0c2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac06e3d0 0x7fd7ac0c2cd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009430 tx=0x7fd79c018000 comp rx=0 tx=0).stop 2023-10-06T03:24:33.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 -- 172.21.15.84:0/1389546516 shutdown_connections 2023-10-06T03:24:33.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd798066f30 0x7fd7980693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ac159920 0x7fd7ac16d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac06e3d0 0x7fd7ac0c2cd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 --2- 172.21.15.84:0/1389546516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7ac159550 0x7fd7ac1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 -- 172.21.15.84:0/1389546516 >> 172.21.15.84:0/1389546516 conn(0x7fd7ac069190 msgr2=0x7fd7ac0b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:33.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 -- 172.21.15.84:0/1389546516 shutdown_connections 2023-10-06T03:24:33.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.839+0000 7fd7b4514700 1 -- 172.21.15.84:0/1389546516 wait complete. 2023-10-06T03:24:33.851 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.967+0000 7f04c255e700 1 Processor -- start 2023-10-06T03:24:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.967+0000 7f04c255e700 1 -- start start 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04c255e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f04bc159510 0x7f04bc0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04c255e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc0cbae0 0x7f04bc0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04c255e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc0cbef0 con 0x7f04bc1598e0 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04c255e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04bc0cf610 con 0x7f04bc159510 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04c255e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0cf8f0 con 0x7f04bc0cbae0 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04bb7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f04bc1598e0 0x7f04bc0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37200/0 (socket says 172.21.15.84:37200) 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04bb7fe700 1 -- 172.21.15.84:0/965577454 learned_addr learned my addr 172.21.15.84:0/965577454 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504468936 0 0) 0x7f04bc0cbef0 con 0x7f04bc1598e0 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04c0afb700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc0cbae0 0x7f04bc0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04a4003570 con 0x7f04bc1598e0 2023-10-06T03:24:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04bbfff700 1 --2- 172.21.15.84:0/965577454 >> v2:172.21.15.131:3300/0 conn(0x7f04bc159510 0x7f04bc0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2386226416 0 0) 0x7f04a4003570 con 0x7f04bc1598e0 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc0cbae0 msgr2=0x7f04bc0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc0cbae0 0x7f04bc0cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 >> v2:172.21.15.131:3300/0 conn(0x7f04bc159510 msgr2=0x7f04bc0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 --2- 172.21.15.84:0/965577454 >> v2:172.21.15.131:3300/0 conn(0x7f04bc159510 0x7f04bc0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc0cfbd0 con 0x7f04bc1598e0 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f04ac001470 con 0x7f04bc1598e0 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 >> v1:172.21.15.84:6789/0 conn(0x7f04bc1598e0 legacy=0x7f04bc0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 0x7f04a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc0cbae0 0x7f04a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04a4004d50 0x7f04a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0cf610 con 0x7f04a4003a60 2023-10-06T03:24:33.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0cf8f0 con 0x7f04a4004d50 2023-10-06T03:24:33.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a400ba60 con 0x7f04bc0cbae0 2023-10-06T03:24:33.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.968+0000 7f04bbfff700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 0x7f04a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04bb7fe700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc0cbae0 0x7f04a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04c0afb700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04a4004d50 0x7f04a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04bbfff700 1 -- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc0cbae0 msgr2=0x7f04a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:33.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04bbfff700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc0cbae0 0x7f04a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04bbfff700 1 -- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04a4004d50 msgr2=0x7f04a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04bbfff700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04a4004d50 0x7f04a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04bbfff700 1 -- 172.21.15.84:0/965577454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a4003570 con 0x7f04a4003a60 2023-10-06T03:24:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04bbfff700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 0x7f04a4003e70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009c00 tx=0x7f04b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3c70dfa33badba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b000e6b0 con 0x7f04a4003a60 2023-10-06T03:24:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b000e810 con 0x7f04a4003a60 2023-10-06T03:24:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.969+0000 7f04baffd700 1 -- 172.21.15.84:0/965577454 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b000ebd0 con 0x7f04a4003a60 2023-10-06T03:24:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.970+0000 7f04c255e700 1 -- 172.21.15.84:0/965577454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 msgr2=0x7f04a4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.970+0000 7f04c255e700 1 --2- 172.21.15.84:0/965577454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 0x7f04a4003e70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009c00 tx=0x7f04b00091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.970+0000 7f04c0afb700 1 -- 172.21.15.84:0/965577454 reap_dead start 2023-10-06T03:24:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.970+0000 7f04c255e700 1 -- 172.21.15.84:0/965577454 shutdown_connections 2023-10-06T03:24:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.970+0000 7f04c255e700 1 -- 172.21.15.84:0/965577454 >> 172.21.15.84:0/965577454 conn(0x7f04bc089e90 msgr2=0x7f04bc0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.970+0000 7f04c255e700 1 -- 172.21.15.84:0/965577454 shutdown_connections 2023-10-06T03:24:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.970+0000 7f04c255e700 1 -- 172.21.15.84:0/965577454 wait complete. 2023-10-06T03:24:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.971+0000 7f04c255e700 1 Processor -- start 2023-10-06T03:24:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.971+0000 7f04c255e700 1 -- start start 2023-10-06T03:24:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.971+0000 7f04c255e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 0x7f04bc15b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04c255e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc149970 0x7f04bc0c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04c255e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04bc15af20 0x7f04bc0c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04c255e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc169fb0 con 0x7f04a4003a60 2023-10-06T03:24:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04c255e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc15c100 con 0x7f04bc15af20 2023-10-06T03:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04c255e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc15c3e0 con 0x7f04bc149970 2023-10-06T03:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04bbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 0x7f04bc15b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04bbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 0x7f04bc15b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36896/0 (socket says 172.21.15.84:36896) 2023-10-06T03:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04bbfff700 1 -- 172.21.15.84:0/1503878388 learned_addr learned my addr 172.21.15.84:0/1503878388 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04bbfff700 1 -- 172.21.15.84:0/1503878388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc149970 msgr2=0x7f04bc0c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04bb7fe700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc149970 0x7f04bc0c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04bbfff700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc149970 0x7f04bc0c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04bbfff700 1 -- 172.21.15.84:0/1503878388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04bc15af20 msgr2=0x7f04bc0c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04bbfff700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04bc15af20 0x7f04bc0c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04bbfff700 1 -- 172.21.15.84:0/1503878388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc15c6c0 con 0x7f04a4003a60 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04bbfff700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 0x7f04bc15b8b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f04b000e4b0 tx=0x7f04b001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04a3fff700 1 -- 172.21.15.84:0/1503878388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0022070 con 0x7f04a4003a60 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04a3fff700 1 -- 172.21.15.84:0/1503878388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b000e980 con 0x7f04a4003a60 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04c255e700 1 -- 172.21.15.84:0/1503878388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc15c9a0 con 0x7f04a4003a60 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04a3fff700 1 -- 172.21.15.84:0/1503878388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0027470 con 0x7f04a4003a60 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.972+0000 7f04c255e700 1 -- 172.21.15.84:0/1503878388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc159ce0 con 0x7f04a4003a60 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.973+0000 7f04c255e700 1 -- 172.21.15.84:0/1503878388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc064ad0 con 0x7f04a4003a60 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.973+0000 7f04a3fff700 1 -- 172.21.15.84:0/1503878388 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04b001c450 con 0x7f04a4003a60 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.974+0000 7f04a3fff700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f04a8066f30 0x7f04a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.974+0000 7f04a3fff700 1 -- 172.21.15.84:0/1503878388 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f04b0086500 con 0x7f04a4003a60 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.974+0000 7f04bb7fe700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f04a8066f30 0x7f04a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.974+0000 7f04bb7fe700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f04a8066f30 0x7f04a80693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f04ac000fd0 tx=0x7f04ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:33.978+0000 7f04a3fff700 1 -- 172.21.15.84:0/1503878388 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04b0053420 con 0x7f04a4003a60 2023-10-06T03:24:34.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.157+0000 7f04c255e700 1 -- 172.21.15.84:0/1503878388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04bc0cfeb0 con 0x7f04a4003a60 2023-10-06T03:24:34.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.158+0000 7f04a3fff700 1 -- 172.21.15.84:0/1503878388 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04b0056940 con 0x7f04a4003a60 2023-10-06T03:24:34.159 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:24:34.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 -- 172.21.15.84:0/1503878388 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f04a8066f30 msgr2=0x7f04a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f04a8066f30 0x7f04a80693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f04ac000fd0 tx=0x7f04ac009040 comp rx=0 tx=0).stop 2023-10-06T03:24:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 -- 172.21.15.84:0/1503878388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 msgr2=0x7f04bc15b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 0x7f04bc15b8b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f04b000e4b0 tx=0x7f04b001a000 comp rx=0 tx=0).stop 2023-10-06T03:24:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 -- 172.21.15.84:0/1503878388 shutdown_connections 2023-10-06T03:24:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f04a8066f30 0x7f04a80693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04bc15af20 0x7f04bc0c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04a4003a60 0x7f04bc15b8b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 --2- 172.21.15.84:0/1503878388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04bc149970 0x7f04bc0c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 -- 172.21.15.84:0/1503878388 >> 172.21.15.84:0/1503878388 conn(0x7f04bc089e90 msgr2=0x7f04bc0684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 -- 172.21.15.84:0/1503878388 shutdown_connections 2023-10-06T03:24:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.160+0000 7f04c255e700 1 -- 172.21.15.84:0/1503878388 wait complete. 2023-10-06T03:24:34.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:34.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.289+0000 7fd939faa700 1 Processor -- start 2023-10-06T03:24:34.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.289+0000 7fd939faa700 1 -- start start 2023-10-06T03:24:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.289+0000 7fd939faa700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9341598e0 0x7fd9340ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.289+0000 7fd939faa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9340cbcb0 0x7fd9340ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.289+0000 7fd939faa700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9340cf610 con 0x7fd934159510 2023-10-06T03:24:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.289+0000 7fd939faa700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9340cf8f0 con 0x7fd9341598e0 2023-10-06T03:24:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.289+0000 7fd939faa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340cfbd0 con 0x7fd9340cbcb0 2023-10-06T03:24:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd9337fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd934159510 0x7fd9340cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37210/0 (socket says 172.21.15.84:37210) 2023-10-06T03:24:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd9337fe700 1 -- 172.21.15.84:0/2430607937 learned_addr learned my addr 172.21.15.84:0/2430607937 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd932ffd700 1 --2- 172.21.15.84:0/2430607937 >> v2:172.21.15.84:3300/0 conn(0x7fd9341598e0 0x7fd9340ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd9327fc700 1 -- 172.21.15.84:0/2430607937 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599973289 0 0) 0x7fd9340cf610 con 0x7fd934159510 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd9327fc700 1 -- 172.21.15.84:0/2430607937 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd920003570 con 0x7fd934159510 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd933fff700 1 --2- 172.21.15.84:0/2430607937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9340cbcb0 0x7fd9340ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd932ffd700 1 -- 172.21.15.84:0/2430607937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9340cbcb0 msgr2=0x7fd9340ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd932ffd700 1 --2- 172.21.15.84:0/2430607937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9340cbcb0 0x7fd9340ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd932ffd700 1 -- 172.21.15.84:0/2430607937 >> v1:172.21.15.84:6789/0 conn(0x7fd934159510 legacy=0x7fd9340cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd932ffd700 1 -- 172.21.15.84:0/2430607937 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9340cfeb0 con 0x7fd9341598e0 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd933fff700 1 --2- 172.21.15.84:0/2430607937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9340cbcb0 0x7fd9340ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd932ffd700 1 --2- 172.21.15.84:0/2430607937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9341598e0 0x7fd9340ce820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0098e0 tx=0x7fd91c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fce304e345491a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd9327fc700 1 -- 172.21.15.84:0/2430607937 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00b640 con 0x7fd9341598e0 2023-10-06T03:24:34.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd9327fc700 1 -- 172.21.15.84:0/2430607937 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c00b7a0 con 0x7fd9341598e0 2023-10-06T03:24:34.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.290+0000 7fd9327fc700 1 -- 172.21.15.84:0/2430607937 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00bb40 con 0x7fd9341598e0 2023-10-06T03:24:34.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.291+0000 7fd939faa700 1 -- 172.21.15.84:0/2430607937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9341598e0 msgr2=0x7fd9340ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.291+0000 7fd939faa700 1 --2- 172.21.15.84:0/2430607937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9341598e0 0x7fd9340ce820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0098e0 tx=0x7fd91c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.291+0000 7fd939faa700 1 -- 172.21.15.84:0/2430607937 shutdown_connections 2023-10-06T03:24:34.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.291+0000 7fd939faa700 1 --2- 172.21.15.84:0/2430607937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9340cbcb0 0x7fd9340ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.291+0000 7fd939faa700 1 --2- 172.21.15.84:0/2430607937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9341598e0 0x7fd9340ce820 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.291+0000 7fd939faa700 1 -- 172.21.15.84:0/2430607937 >> 172.21.15.84:0/2430607937 conn(0x7fd934089e90 msgr2=0x7fd9340997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:34.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.291+0000 7fd939faa700 1 -- 172.21.15.84:0/2430607937 shutdown_connections 2023-10-06T03:24:34.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.291+0000 7fd939faa700 1 -- 172.21.15.84:0/2430607937 wait complete. 2023-10-06T03:24:34.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.292+0000 7fd939faa700 1 Processor -- start 2023-10-06T03:24:34.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.292+0000 7fd939faa700 1 -- start start 2023-10-06T03:24:34.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd939faa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340cbcb0 0x7fd93416dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd939faa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd934159510 0x7fd9340b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd939faa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9341598e0 0x7fd9340b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd939faa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340b4840 con 0x7fd934159510 2023-10-06T03:24:34.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd939faa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340b32f0 con 0x7fd9340cbcb0 2023-10-06T03:24:34.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd939faa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340b3540 con 0x7fd9341598e0 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd932ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd934159510 0x7fd9340b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd932ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd934159510 0x7fd9340b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36916/0 (socket says 172.21.15.84:36916) 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd932ffd700 1 -- 172.21.15.84:0/3840163575 learned_addr learned my addr 172.21.15.84:0/3840163575 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd933fff700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9341598e0 0x7fd9340b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd932ffd700 1 -- 172.21.15.84:0/3840163575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9341598e0 msgr2=0x7fd9340b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd932ffd700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9341598e0 0x7fd9340b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd932ffd700 1 -- 172.21.15.84:0/3840163575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340cbcb0 msgr2=0x7fd93416dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd9337fe700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340cbcb0 0x7fd93416dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd932ffd700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340cbcb0 0x7fd93416dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd932ffd700 1 -- 172.21.15.84:0/3840163575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c009420 con 0x7fd934159510 2023-10-06T03:24:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd933fff700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9341598e0 0x7fd9340b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:34.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd9337fe700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340cbcb0 0x7fd93416dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:34.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd932ffd700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd934159510 0x7fd9340b4300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd91c013000 tx=0x7fd91c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd92b7fe700 1 -- 172.21.15.84:0/3840163575 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c01bda0 con 0x7fd934159510 2023-10-06T03:24:34.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.293+0000 7fd92b7fe700 1 -- 172.21.15.84:0/3840163575 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c011420 con 0x7fd934159510 2023-10-06T03:24:34.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.294+0000 7fd939faa700 1 -- 172.21.15.84:0/3840163575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9340b3820 con 0x7fd934159510 2023-10-06T03:24:34.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.294+0000 7fd92b7fe700 1 -- 172.21.15.84:0/3840163575 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0117e0 con 0x7fd934159510 2023-10-06T03:24:34.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.294+0000 7fd939faa700 1 -- 172.21.15.84:0/3840163575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9340b3de0 con 0x7fd934159510 2023-10-06T03:24:34.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.294+0000 7fd939faa700 1 -- 172.21.15.84:0/3840163575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9340b3fd0 con 0x7fd934159510 2023-10-06T03:24:34.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.295+0000 7fd92b7fe700 1 -- 172.21.15.84:0/3840163575 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd91c011b50 con 0x7fd934159510 2023-10-06T03:24:34.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.295+0000 7fd92b7fe700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd914066f30 0x7fd9140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.295+0000 7fd9337fe700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd914066f30 0x7fd9140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.295+0000 7fd92b7fe700 1 -- 172.21.15.84:0/3840163575 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd91c085ff0 con 0x7fd934159510 2023-10-06T03:24:34.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.296+0000 7fd9337fe700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd914066f30 0x7fd9140693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd924005c50 tx=0x7fd924009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.300+0000 7fd92b7fe700 1 -- 172.21.15.84:0/3840163575 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd91c052e10 con 0x7fd934159510 2023-10-06T03:24:34.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.480+0000 7fd939faa700 1 -- 172.21.15.84:0/3840163575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd934064ad0 con 0x7fd934159510 2023-10-06T03:24:34.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.480+0000 7fd92b7fe700 1 -- 172.21.15.84:0/3840163575 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd91c056430 con 0x7fd934159510 2023-10-06T03:24:34.481 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:24:34.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.482+0000 7fd939faa700 1 -- 172.21.15.84:0/3840163575 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd914066f30 msgr2=0x7fd9140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.482+0000 7fd939faa700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd914066f30 0x7fd9140693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd924005c50 tx=0x7fd924009040 comp rx=0 tx=0).stop 2023-10-06T03:24:34.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.482+0000 7fd939faa700 1 -- 172.21.15.84:0/3840163575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd934159510 msgr2=0x7fd9340b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.482+0000 7fd939faa700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd934159510 0x7fd9340b4300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd91c013000 tx=0x7fd91c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:34.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.482+0000 7fd939faa700 1 -- 172.21.15.84:0/3840163575 shutdown_connections 2023-10-06T03:24:34.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.482+0000 7fd939faa700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd914066f30 0x7fd9140693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.482+0000 7fd939faa700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340cbcb0 0x7fd93416dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.482+0000 7fd939faa700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9341598e0 0x7fd9340b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.482+0000 7fd939faa700 1 --2- 172.21.15.84:0/3840163575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd934159510 0x7fd9340b4300 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.482+0000 7fd939faa700 1 -- 172.21.15.84:0/3840163575 >> 172.21.15.84:0/3840163575 conn(0x7fd934089e90 msgr2=0x7fd934149f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:34.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.483+0000 7fd939faa700 1 -- 172.21.15.84:0/3840163575 shutdown_connections 2023-10-06T03:24:34.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.483+0000 7fd939faa700 1 -- 172.21.15.84:0/3840163575 wait complete. 2023-10-06T03:24:34.495 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:34.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.611+0000 7f8df7cfb700 1 Processor -- start 2023-10-06T03:24:34.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.611+0000 7f8df7cfb700 1 -- start start 2023-10-06T03:24:34.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df7cfb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8df01595a0 0x7f8df00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df7cfb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8df00b49e0 0x7f8df00aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df7cfb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8df00b07a0 0x7f8df00b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df7cfb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df00b0ca0 con 0x7f8df00b49e0 2023-10-06T03:24:34.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df7cfb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df00b0f80 con 0x7f8df01595a0 2023-10-06T03:24:34.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df7cfb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00b1260 con 0x7f8df00b07a0 2023-10-06T03:24:34.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df5296700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8df00b49e0 0x7f8df00aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df5296700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8df00b49e0 0x7f8df00aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36922/0 (socket says 172.21.15.84:36922) 2023-10-06T03:24:34.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df5296700 1 -- 172.21.15.84:0/2969217388 learned_addr learned my addr 172.21.15.84:0/2969217388 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:34.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df6298700 1 --2- 172.21.15.84:0/2969217388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8df00b07a0 0x7f8df00b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df5a97700 1 --2- 172.21.15.84:0/2969217388 >> v2:172.21.15.131:3300/0 conn(0x7f8df01595a0 0x7f8df00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df5296700 1 -- 172.21.15.84:0/2969217388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8df00b07a0 msgr2=0x7f8df00b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:34.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df5296700 1 --2- 172.21.15.84:0/2969217388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8df00b07a0 0x7f8df00b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df5296700 1 -- 172.21.15.84:0/2969217388 >> v2:172.21.15.131:3300/0 conn(0x7f8df01595a0 msgr2=0x7f8df00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:34.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df5296700 1 --2- 172.21.15.84:0/2969217388 >> v2:172.21.15.131:3300/0 conn(0x7f8df01595a0 0x7f8df00aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.612+0000 7f8df5296700 1 -- 172.21.15.84:0/2969217388 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df00b1540 con 0x7f8df00b49e0 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df5296700 1 --2- 172.21.15.84:0/2969217388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 0x7f8df00aaab0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8de00099b0 tx=0x7f8de0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db0f6efa384917c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df4a95700 1 -- 172.21.15.84:0/2969217388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000b820 con 0x7f8df00b49e0 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df4a95700 1 -- 172.21.15.84:0/2969217388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de000b980 con 0x7f8df00b49e0 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df4a95700 1 -- 172.21.15.84:0/2969217388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000bd20 con 0x7f8df00b49e0 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df7cfb700 1 -- 172.21.15.84:0/2969217388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 msgr2=0x7f8df00aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df7cfb700 1 --2- 172.21.15.84:0/2969217388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 0x7f8df00aaab0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8de00099b0 tx=0x7f8de0009250 comp rx=0 tx=0).stop 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df7cfb700 1 -- 172.21.15.84:0/2969217388 shutdown_connections 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df7cfb700 1 --2- 172.21.15.84:0/2969217388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8df00b07a0 0x7f8df00b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df7cfb700 1 --2- 172.21.15.84:0/2969217388 >> v2:172.21.15.131:3300/0 conn(0x7f8df01595a0 0x7f8df00aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df7cfb700 1 --2- 172.21.15.84:0/2969217388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 0x7f8df00aaab0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df7cfb700 1 -- 172.21.15.84:0/2969217388 >> 172.21.15.84:0/2969217388 conn(0x7f8df0099830 msgr2=0x7f8df006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:34.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df7cfb700 1 -- 172.21.15.84:0/2969217388 shutdown_connections 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.613+0000 7f8df7cfb700 1 -- 172.21.15.84:0/2969217388 wait complete. 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.614+0000 7f8df7cfb700 1 Processor -- start 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.614+0000 7f8df7cfb700 1 -- start start 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df7cfb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df00b07a0 0x7f8df00aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df7cfb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 0x7f8df01698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df7cfb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8df01595a0 0x7f8df015e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df7cfb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df016cea0 con 0x7f8df00b49e0 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df7cfb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df016d460 con 0x7f8df00b07a0 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df7cfb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df016a380 con 0x7f8df01595a0 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df5296700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 0x7f8df01698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df5296700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 0x7f8df01698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36936/0 (socket says 172.21.15.84:36936) 2023-10-06T03:24:34.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df5296700 1 -- 172.21.15.84:0/3994360437 learned_addr learned my addr 172.21.15.84:0/3994360437 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df6298700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8df01595a0 0x7f8df015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.615+0000 7f8df5a97700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df00b07a0 0x7f8df00aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8df5296700 1 -- 172.21.15.84:0/3994360437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8df01595a0 msgr2=0x7f8df015e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8df5296700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8df01595a0 0x7f8df015e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8df5296700 1 -- 172.21.15.84:0/3994360437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df00b07a0 msgr2=0x7f8df00aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8df5296700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df00b07a0 0x7f8df00aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8df5296700 1 -- 172.21.15.84:0/3994360437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00094f0 con 0x7f8df00b49e0 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8df5a97700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df00b07a0 0x7f8df00aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8df5296700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 0x7f8df01698c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8de00099b0 tx=0x7f8de0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8de5ffb700 1 -- 172.21.15.84:0/3994360437 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0011e20 con 0x7f8df00b49e0 2023-10-06T03:24:34.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8de5ffb700 1 -- 172.21.15.84:0/3994360437 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0024440 con 0x7f8df00b49e0 2023-10-06T03:24:34.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8df7cfb700 1 -- 172.21.15.84:0/3994360437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df016a660 con 0x7f8df00b49e0 2023-10-06T03:24:34.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8de5ffb700 1 -- 172.21.15.84:0/3994360437 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0024800 con 0x7f8df00b49e0 2023-10-06T03:24:34.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.616+0000 7f8df7cfb700 1 -- 172.21.15.84:0/3994360437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df00af4d0 con 0x7f8df00b49e0 2023-10-06T03:24:34.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.617+0000 7f8df7cfb700 1 -- 172.21.15.84:0/3994360437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df016d5d0 con 0x7f8df00b49e0 2023-10-06T03:24:34.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.617+0000 7f8de5ffb700 1 -- 172.21.15.84:0/3994360437 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8de001a420 con 0x7f8df00b49e0 2023-10-06T03:24:34.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.618+0000 7f8de5ffb700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dd4066f30 0x7f8dd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.618+0000 7f8df5a97700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dd4066f30 0x7f8dd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.618+0000 7f8de5ffb700 1 -- 172.21.15.84:0/3994360437 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8de0086930 con 0x7f8df00b49e0 2023-10-06T03:24:34.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.618+0000 7f8df5a97700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dd4066f30 0x7f8dd40693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8df016ce00 tx=0x7f8dec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.622+0000 7f8de5ffb700 1 -- 172.21.15.84:0/3994360437 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8de0053750 con 0x7f8df00b49e0 2023-10-06T03:24:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.845+0000 7f8df7cfb700 1 -- 172.21.15.84:0/3994360437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8df0064ad0 con 0x7f8df00b49e0 2023-10-06T03:24:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.845+0000 7f8de5ffb700 1 -- 172.21.15.84:0/3994360437 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f8de0056d70 con 0x7f8df00b49e0 2023-10-06T03:24:34.846 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:34.846 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:49.917332+0000","modified":"2023-10-06T03:24:03.584509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 -- 172.21.15.84:0/3994360437 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dd4066f30 msgr2=0x7f8dd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dd4066f30 0x7f8dd40693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8df016ce00 tx=0x7f8dec008040 comp rx=0 tx=0).stop 2023-10-06T03:24:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 -- 172.21.15.84:0/3994360437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 msgr2=0x7f8df01698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 0x7f8df01698c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8de00099b0 tx=0x7f8de0017000 comp rx=0 tx=0).stop 2023-10-06T03:24:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 -- 172.21.15.84:0/3994360437 shutdown_connections 2023-10-06T03:24:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dd4066f30 0x7f8dd40693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df00b07a0 0x7f8df00aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8df01595a0 0x7f8df015e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 --2- 172.21.15.84:0/3994360437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8df00b49e0 0x7f8df01698c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 -- 172.21.15.84:0/3994360437 >> 172.21.15.84:0/3994360437 conn(0x7f8df0099830 msgr2=0x7f8df0158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 -- 172.21.15.84:0/3994360437 shutdown_connections 2023-10-06T03:24:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.847+0000 7f8df7cfb700 1 -- 172.21.15.84:0/3994360437 wait complete. 2023-10-06T03:24:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-10-06T03:24:34.860 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.973+0000 7f87106d9700 1 Processor -- start 2023-10-06T03:24:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.973+0000 7f87106d9700 1 -- start start 2023-10-06T03:24:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.973+0000 7f87106d9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87081595a0 0x7f87080aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f87106d9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f87080b07a0 0x7f87080b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f87106d9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87080b0ca0 con 0x7f87080b49e0 2023-10-06T03:24:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f87106d9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87080b0f80 con 0x7f87080b07a0 2023-10-06T03:24:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f87106d9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87080b1260 con 0x7f87081595a0 2023-10-06T03:24:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870dc74700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f87080b49e0 0x7f87080aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37214/0 (socket says 172.21.15.84:37214) 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870dc74700 1 -- 172.21.15.84:0/776841365 learned_addr learned my addr 172.21.15.84:0/776841365 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870e475700 1 --2- 172.21.15.84:0/776841365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87081595a0 0x7f87080aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870ec76700 1 --2- 172.21.15.84:0/776841365 >> v2:172.21.15.131:3300/0 conn(0x7f87080b07a0 0x7f87080b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870d473700 1 -- 172.21.15.84:0/776841365 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915269476 0 0) 0x7f87080b0ca0 con 0x7f87080b49e0 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870d473700 1 -- 172.21.15.84:0/776841365 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86f4003570 con 0x7f87080b49e0 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870e475700 1 -- 172.21.15.84:0/776841365 >> v2:172.21.15.131:3300/0 conn(0x7f87080b07a0 msgr2=0x7f87080b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870e475700 1 --2- 172.21.15.84:0/776841365 >> v2:172.21.15.131:3300/0 conn(0x7f87080b07a0 0x7f87080b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870e475700 1 -- 172.21.15.84:0/776841365 >> v1:172.21.15.84:6789/0 conn(0x7f87080b49e0 legacy=0x7f87080aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870d473700 1 -- 172.21.15.84:0/776841365 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1832098021 0 0) 0x7f86f4003570 con 0x7f87080b49e0 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870e475700 1 -- 172.21.15.84:0/776841365 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87080b1540 con 0x7f87081595a0 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.974+0000 7f870e475700 1 --2- 172.21.15.84:0/776841365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87081595a0 0x7f87080aa570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f87040098d0 tx=0x7f8704009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87f7495f58092978 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f870d473700 1 -- 172.21.15.84:0/776841365 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8001470 con 0x7f87081595a0 2023-10-06T03:24:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f870d473700 1 -- 172.21.15.84:0/776841365 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8704011420 con 0x7f87081595a0 2023-10-06T03:24:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f870d473700 1 -- 172.21.15.84:0/776841365 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87040117a0 con 0x7f87081595a0 2023-10-06T03:24:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f87106d9700 1 -- 172.21.15.84:0/776841365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87081595a0 msgr2=0x7f87080aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f87106d9700 1 --2- 172.21.15.84:0/776841365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87081595a0 0x7f87080aa570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f87040098d0 tx=0x7f8704009120 comp rx=0 tx=0).stop 2023-10-06T03:24:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f87106d9700 1 -- 172.21.15.84:0/776841365 shutdown_connections 2023-10-06T03:24:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f87106d9700 1 --2- 172.21.15.84:0/776841365 >> v2:172.21.15.131:3300/0 conn(0x7f87080b07a0 0x7f87080b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f87106d9700 1 --2- 172.21.15.84:0/776841365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87081595a0 0x7f87080aa570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f87106d9700 1 -- 172.21.15.84:0/776841365 >> 172.21.15.84:0/776841365 conn(0x7f8708099830 msgr2=0x7f870806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f87106d9700 1 -- 172.21.15.84:0/776841365 shutdown_connections 2023-10-06T03:24:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.975+0000 7f87106d9700 1 -- 172.21.15.84:0/776841365 wait complete. 2023-10-06T03:24:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.976+0000 7f87106d9700 1 Processor -- start 2023-10-06T03:24:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.976+0000 7f87106d9700 1 -- start start 2023-10-06T03:24:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f87106d9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87080b07a0 0x7f870816a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f87106d9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87080b49e0 0x7f870815c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f87106d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87081595a0 0x7f8708156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f87106d9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870815e230 con 0x7f87081595a0 2023-10-06T03:24:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f87106d9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870809a2c0 con 0x7f87080b49e0 2023-10-06T03:24:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f87106d9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870815c550 con 0x7f87080b07a0 2023-10-06T03:24:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870ec76700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87081595a0 0x7f8708156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870ec76700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87081595a0 0x7f8708156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36948/0 (socket says 172.21.15.84:36948) 2023-10-06T03:24:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870ec76700 1 -- 172.21.15.84:0/2302929737 learned_addr learned my addr 172.21.15.84:0/2302929737 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870e475700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87080b07a0 0x7f870816a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870dc74700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87080b49e0 0x7f870815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870ec76700 1 -- 172.21.15.84:0/2302929737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87080b07a0 msgr2=0x7f870816a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870ec76700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87080b07a0 0x7f870816a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870ec76700 1 -- 172.21.15.84:0/2302929737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87080b49e0 msgr2=0x7f870815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870ec76700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87080b49e0 0x7f870815c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870ec76700 1 -- 172.21.15.84:0/2302929737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87040093c0 con 0x7f87081595a0 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870e475700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87080b07a0 0x7f870816a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.977+0000 7f870ec76700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87081595a0 0x7f8708156510 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8700009ec0 tx=0x7f870000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.978+0000 7f86fe7fc700 1 -- 172.21.15.84:0/2302929737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870000cc20 con 0x7f87081595a0 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.978+0000 7f86fe7fc700 1 -- 172.21.15.84:0/2302929737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870000f040 con 0x7f87081595a0 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.978+0000 7f86fe7fc700 1 -- 172.21.15.84:0/2302929737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700014480 con 0x7f87081595a0 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.978+0000 7f87106d9700 1 -- 172.21.15.84:0/2302929737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8708156a50 con 0x7f87081595a0 2023-10-06T03:24:34.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.978+0000 7f87106d9700 1 -- 172.21.15.84:0/2302929737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870815e720 con 0x7f87081595a0 2023-10-06T03:24:34.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.979+0000 7f87106d9700 1 -- 172.21.15.84:0/2302929737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870809a090 con 0x7f87081595a0 2023-10-06T03:24:34.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.979+0000 7f86fe7fc700 1 -- 172.21.15.84:0/2302929737 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8700014830 con 0x7f87081595a0 2023-10-06T03:24:34.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.979+0000 7f86fe7fc700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86ec066f30 0x7f86ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.980+0000 7f86fe7fc700 1 -- 172.21.15.84:0/2302929737 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f87000853a0 con 0x7f87081595a0 2023-10-06T03:24:34.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.980+0000 7f870e475700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86ec066f30 0x7f86ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.980+0000 7f870e475700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86ec066f30 0x7f86ec0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8704009160 tx=0x7f8704016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:34.984+0000 7f86fe7fc700 1 -- 172.21.15.84:0/2302929737 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f870809a090 con 0x7f87081595a0 2023-10-06T03:24:35.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.167+0000 7f87106d9700 1 -- 172.21.15.84:0/2302929737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f870815e970 con 0x7f87081595a0 2023-10-06T03:24:35.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.167+0000 7f86fe7fc700 1 -- 172.21.15.84:0/2302929737 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f8700055c50 con 0x7f87081595a0 2023-10-06T03:24:35.168 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:35.169 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:35.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 -- 172.21.15.84:0/2302929737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86ec066f30 msgr2=0x7f86ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86ec066f30 0x7f86ec0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8704009160 tx=0x7f8704016000 comp rx=0 tx=0).stop 2023-10-06T03:24:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 -- 172.21.15.84:0/2302929737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87081595a0 msgr2=0x7f8708156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87081595a0 0x7f8708156510 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8700009ec0 tx=0x7f870000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 -- 172.21.15.84:0/2302929737 shutdown_connections 2023-10-06T03:24:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86ec066f30 0x7f86ec0693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87081595a0 0x7f8708156510 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87080b07a0 0x7f870816a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 --2- 172.21.15.84:0/2302929737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87080b49e0 0x7f870815c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 -- 172.21.15.84:0/2302929737 >> 172.21.15.84:0/2302929737 conn(0x7f8708099830 msgr2=0x7f87080b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.169+0000 7f87106d9700 1 -- 172.21.15.84:0/2302929737 shutdown_connections 2023-10-06T03:24:35.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.170+0000 7f87106d9700 1 -- 172.21.15.84:0/2302929737 wait complete. 2023-10-06T03:24:35.182 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:24:35.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:35.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.296+0000 7f84013a9700 1 Processor -- start 2023-10-06T03:24:35.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.296+0000 7f84013a9700 1 -- start start 2023-10-06T03:24:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f84013a9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc1595a0 0x7f83fc0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f84013a9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f83fc0b49e0 0x7f83fc0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f84013a9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83fc0b0ca0 con 0x7f83fc0b07a0 2023-10-06T03:24:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f84013a9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc0b0f80 con 0x7f83fc0b49e0 2023-10-06T03:24:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f84013a9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0b1260 con 0x7f83fc1595a0 2023-10-06T03:24:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83faffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc1595a0 0x7f83fc0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83f3fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f83fc0b49e0 0x7f83fc0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83faffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc1595a0 0x7f83fc0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:40138/0 (socket says 172.21.15.84:40138) 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83f3fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f83fc0b49e0 0x7f83fc0aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:45228/0 (socket says 172.21.15.84:45228) 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83faffd700 1 -- 172.21.15.84:0/3116001358 learned_addr learned my addr 172.21.15.84:0/3116001358 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83fb7fe700 1 --1- 172.21.15.84:0/3116001358 >> v1:172.21.15.131:6789/0 conn(0x7f83fc0b07a0 0x7f83fc0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:57244/0 (socket says 172.21.15.84:57244) 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83faffd700 1 -- 172.21.15.84:0/3116001358 >> v2:172.21.15.131:3300/0 conn(0x7f83fc0b49e0 msgr2=0x7f83fc0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83faffd700 1 --2- 172.21.15.84:0/3116001358 >> v2:172.21.15.131:3300/0 conn(0x7f83fc0b49e0 0x7f83fc0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83faffd700 1 -- 172.21.15.84:0/3116001358 >> v1:172.21.15.131:6789/0 conn(0x7f83fc0b07a0 legacy=0x7f83fc0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83faffd700 1 -- 172.21.15.84:0/3116001358 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc0b1540 con 0x7f83fc1595a0 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.297+0000 7f83faffd700 1 --2- 172.21.15.84:0/3116001358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc1595a0 0x7f83fc0aa570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009990 tx=0x7f83ec009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8250a63af08f6fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f83fa7fc700 1 -- 172.21.15.84:0/3116001358 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec009e80 con 0x7f83fc1595a0 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f83fa7fc700 1 -- 172.21.15.84:0/3116001358 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec005c10 con 0x7f83fc1595a0 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f83fa7fc700 1 -- 172.21.15.84:0/3116001358 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00b650 con 0x7f83fc1595a0 2023-10-06T03:24:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f84013a9700 1 -- 172.21.15.84:0/3116001358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc1595a0 msgr2=0x7f83fc0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f84013a9700 1 --2- 172.21.15.84:0/3116001358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc1595a0 0x7f83fc0aa570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009990 tx=0x7f83ec009220 comp rx=0 tx=0).stop 2023-10-06T03:24:35.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f84013a9700 1 -- 172.21.15.84:0/3116001358 shutdown_connections 2023-10-06T03:24:35.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f84013a9700 1 --2- 172.21.15.84:0/3116001358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc1595a0 0x7f83fc0aa570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f84013a9700 1 --2- 172.21.15.84:0/3116001358 >> v2:172.21.15.131:3300/0 conn(0x7f83fc0b49e0 0x7f83fc0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f84013a9700 1 -- 172.21.15.84:0/3116001358 >> 172.21.15.84:0/3116001358 conn(0x7f83fc099830 msgr2=0x7f83fc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:35.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f84013a9700 1 -- 172.21.15.84:0/3116001358 shutdown_connections 2023-10-06T03:24:35.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.298+0000 7f84013a9700 1 -- 172.21.15.84:0/3116001358 wait complete. 2023-10-06T03:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.299+0000 7f84013a9700 1 Processor -- start 2023-10-06T03:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.299+0000 7f84013a9700 1 -- start start 2023-10-06T03:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f84013a9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83fc0b07a0 0x7f83fc157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f84013a9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc0b49e0 0x7f83fc169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f84013a9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83fc1595a0 0x7f83fc0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f84013a9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0c7490 con 0x7f83fc0b07a0 2023-10-06T03:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f84013a9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0c5d30 con 0x7f83fc1595a0 2023-10-06T03:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f84013a9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0c6010 con 0x7f83fc0b49e0 2023-10-06T03:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f83faffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83fc0b07a0 0x7f83fc157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f83faffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83fc0b07a0 0x7f83fc157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36962/0 (socket says 172.21.15.84:36962) 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f83faffd700 1 -- 172.21.15.84:0/1584136943 learned_addr learned my addr 172.21.15.84:0/1584136943 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f83f3fff700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc0b49e0 0x7f83fc169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.300+0000 7f83fb7fe700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83fc1595a0 0x7f83fc0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f83faffd700 1 -- 172.21.15.84:0/1584136943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc0b49e0 msgr2=0x7f83fc169e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f83faffd700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc0b49e0 0x7f83fc169e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f83faffd700 1 -- 172.21.15.84:0/1584136943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83fc1595a0 msgr2=0x7f83fc0c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f83faffd700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83fc1595a0 0x7f83fc0c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f83faffd700 1 -- 172.21.15.84:0/1584136943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec009480 con 0x7f83fc0b07a0 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f83faffd700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83fc0b07a0 0x7f83fc157960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00b3c0 tx=0x7f83ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f83f2ffd700 1 -- 172.21.15.84:0/1584136943 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec011980 con 0x7f83fc0b07a0 2023-10-06T03:24:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f83f2ffd700 1 -- 172.21.15.84:0/1584136943 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec020070 con 0x7f83fc0b07a0 2023-10-06T03:24:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f83f2ffd700 1 -- 172.21.15.84:0/1584136943 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec011d30 con 0x7f83fc0b07a0 2023-10-06T03:24:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f84013a9700 1 -- 172.21.15.84:0/1584136943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc0c62f0 con 0x7f83fc0b07a0 2023-10-06T03:24:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.301+0000 7f84013a9700 1 -- 172.21.15.84:0/1584136943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83fc0c6b30 con 0x7f83fc0b07a0 2023-10-06T03:24:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.302+0000 7f84013a9700 1 -- 172.21.15.84:0/1584136943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83fc064ad0 con 0x7f83fc0b07a0 2023-10-06T03:24:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.302+0000 7f83f2ffd700 1 -- 172.21.15.84:0/1584136943 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83ec022030 con 0x7f83fc0b07a0 2023-10-06T03:24:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.302+0000 7f83f2ffd700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83dc066f60 0x7f83dc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.302+0000 7f83f2ffd700 1 -- 172.21.15.84:0/1584136943 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f83ec086350 con 0x7f83fc0b07a0 2023-10-06T03:24:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.302+0000 7f83f3fff700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83dc066f60 0x7f83dc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.303+0000 7f83f3fff700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83dc066f60 0x7f83dc069410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0c70d0 tx=0x7f83e40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.307+0000 7f83f2ffd700 1 -- 172.21.15.84:0/1584136943 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83ec053170 con 0x7f83fc0b07a0 2023-10-06T03:24:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.530+0000 7f84013a9700 1 -- 172.21.15.84:0/1584136943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83fc0b1820 con 0x7f83fc0b07a0 2023-10-06T03:24:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.531+0000 7f83f2ffd700 1 -- 172.21.15.84:0/1584136943 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f83ec056790 con 0x7f83fc0b07a0 2023-10-06T03:24:35.532 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:35.532 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:49.917332+0000","modified":"2023-10-06T03:24:03.584509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 -- 172.21.15.84:0/1584136943 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83dc066f60 msgr2=0x7f83dc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83dc066f60 0x7f83dc069410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0c70d0 tx=0x7f83e40091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 -- 172.21.15.84:0/1584136943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83fc0b07a0 msgr2=0x7f83fc157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83fc0b07a0 0x7f83fc157960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00b3c0 tx=0x7f83ec016000 comp rx=0 tx=0).stop 2023-10-06T03:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 -- 172.21.15.84:0/1584136943 shutdown_connections 2023-10-06T03:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f83dc066f60 0x7f83dc069410 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83fc1595a0 0x7f83fc0c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83fc0b07a0 0x7f83fc157960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 --2- 172.21.15.84:0/1584136943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83fc0b49e0 0x7f83fc169e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 -- 172.21.15.84:0/1584136943 >> 172.21.15.84:0/1584136943 conn(0x7f83fc099830 msgr2=0x7f83fc0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 -- 172.21.15.84:0/1584136943 shutdown_connections 2023-10-06T03:24:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.533+0000 7f84013a9700 1 -- 172.21.15.84:0/1584136943 wait complete. 2023-10-06T03:24:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-10-06T03:24:35.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:35.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.659+0000 7f65bc2ab700 1 Processor -- start 2023-10-06T03:24:35.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.659+0000 7f65bc2ab700 1 -- start start 2023-10-06T03:24:35.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.660+0000 7f65bc2ab700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65b41595a0 0x7f65b40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.660+0000 7f65bc2ab700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f65b40b07a0 0x7f65b40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.660+0000 7f65bc2ab700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b40b0ca0 con 0x7f65b40b49e0 2023-10-06T03:24:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.660+0000 7f65bc2ab700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b40b0f80 con 0x7f65b41595a0 2023-10-06T03:24:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.660+0000 7f65bc2ab700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b40b1260 con 0x7f65b40b07a0 2023-10-06T03:24:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.660+0000 7f65ba047700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65b41595a0 0x7f65b40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.660+0000 7f65ba047700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65b41595a0 0x7f65b40aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36974/0 (socket says 172.21.15.84:36974) 2023-10-06T03:24:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.660+0000 7f65ba047700 1 -- 172.21.15.84:0/3030108141 learned_addr learned my addr 172.21.15.84:0/3030108141 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65ba047700 1 -- 172.21.15.84:0/3030108141 >> v2:172.21.15.131:3300/0 conn(0x7f65b40b07a0 msgr2=0x7f65b40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65ba848700 1 --2- 172.21.15.84:0/3030108141 >> v2:172.21.15.131:3300/0 conn(0x7f65b40b07a0 0x7f65b40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65ba047700 1 --2- 172.21.15.84:0/3030108141 >> v2:172.21.15.131:3300/0 conn(0x7f65b40b07a0 0x7f65b40b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65ba047700 1 -- 172.21.15.84:0/3030108141 >> v1:172.21.15.131:6789/0 conn(0x7f65b40b49e0 legacy=0x7f65b40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:35.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65ba047700 1 -- 172.21.15.84:0/3030108141 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40b1540 con 0x7f65b41595a0 2023-10-06T03:24:35.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65ba047700 1 --2- 172.21.15.84:0/3030108141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 0x7f65b40aa570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009990 tx=0x7f65b0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d378cfabf354c4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65b9045700 1 -- 172.21.15.84:0/3030108141 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0005c10 con 0x7f65b41595a0 2023-10-06T03:24:35.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65b9045700 1 -- 172.21.15.84:0/3030108141 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b0005d70 con 0x7f65b41595a0 2023-10-06T03:24:35.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65b9045700 1 -- 172.21.15.84:0/3030108141 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000b800 con 0x7f65b41595a0 2023-10-06T03:24:35.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65bc2ab700 1 -- 172.21.15.84:0/3030108141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 msgr2=0x7f65b40aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.661+0000 7f65bc2ab700 1 --2- 172.21.15.84:0/3030108141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 0x7f65b40aa570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009990 tx=0x7f65b0009220 comp rx=0 tx=0).stop 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.662+0000 7f65bc2ab700 1 -- 172.21.15.84:0/3030108141 shutdown_connections 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.662+0000 7f65bc2ab700 1 --2- 172.21.15.84:0/3030108141 >> v2:172.21.15.131:3300/0 conn(0x7f65b40b07a0 0x7f65b40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.662+0000 7f65bc2ab700 1 --2- 172.21.15.84:0/3030108141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 0x7f65b40aa570 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.662+0000 7f65bc2ab700 1 -- 172.21.15.84:0/3030108141 >> 172.21.15.84:0/3030108141 conn(0x7f65b4099830 msgr2=0x7f65b406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.662+0000 7f65bc2ab700 1 -- 172.21.15.84:0/3030108141 shutdown_connections 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.662+0000 7f65bc2ab700 1 -- 172.21.15.84:0/3030108141 wait complete. 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65bc2ab700 1 Processor -- start 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65bc2ab700 1 -- start start 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65bc2ab700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b40b07a0 0x7f65b4157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65bc2ab700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65b40b49e0 0x7f65b409bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65bc2ab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 0x7f65b416a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65bc2ab700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40ae0b0 con 0x7f65b41595a0 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65bc2ab700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40adac0 con 0x7f65b40b49e0 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65bc2ab700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b416ab20 con 0x7f65b40b07a0 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65ba848700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 0x7f65b416a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65ba848700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 0x7f65b416a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36982/0 (socket says 172.21.15.84:36982) 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.663+0000 7f65ba848700 1 -- 172.21.15.84:0/1358210915 learned_addr learned my addr 172.21.15.84:0/1358210915 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65ba047700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b40b07a0 0x7f65b4157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65b9846700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65b40b49e0 0x7f65b409bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65ba848700 1 -- 172.21.15.84:0/1358210915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b40b07a0 msgr2=0x7f65b4157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65ba848700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b40b07a0 0x7f65b4157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65ba848700 1 -- 172.21.15.84:0/1358210915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65b40b49e0 msgr2=0x7f65b409bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65ba848700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65b40b49e0 0x7f65b409bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65ba848700 1 -- 172.21.15.84:0/1358210915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b0009480 con 0x7f65b41595a0 2023-10-06T03:24:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65b9846700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65b40b49e0 0x7f65b409bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65ba848700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 0x7f65b416a060 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00cee0 tx=0x7f65ac007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65aa7fc700 1 -- 172.21.15.84:0/1358210915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00ae60 con 0x7f65b41595a0 2023-10-06T03:24:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65aa7fc700 1 -- 172.21.15.84:0/1358210915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac016430 con 0x7f65b41595a0 2023-10-06T03:24:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65bc2ab700 1 -- 172.21.15.84:0/1358210915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b416ae00 con 0x7f65b41595a0 2023-10-06T03:24:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65aa7fc700 1 -- 172.21.15.84:0/1358210915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0167d0 con 0x7f65b41595a0 2023-10-06T03:24:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.664+0000 7f65bc2ab700 1 -- 172.21.15.84:0/1358210915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b40ab400 con 0x7f65b41595a0 2023-10-06T03:24:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.665+0000 7f65bc2ab700 1 -- 172.21.15.84:0/1358210915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b408aa50 con 0x7f65b41595a0 2023-10-06T03:24:35.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.665+0000 7f65aa7fc700 1 -- 172.21.15.84:0/1358210915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65ac003020 con 0x7f65b41595a0 2023-10-06T03:24:35.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.666+0000 7f65aa7fc700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6598066f30 0x7f65980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.666+0000 7f65aa7fc700 1 -- 172.21.15.84:0/1358210915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f65ac012070 con 0x7f65b41595a0 2023-10-06T03:24:35.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.666+0000 7f65ba047700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6598066f30 0x7f65980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.666+0000 7f65ba047700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6598066f30 0x7f65980693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65b0007fd0 tx=0x7f65b0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.670+0000 7f65aa7fc700 1 -- 172.21.15.84:0/1358210915 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65ac052700 con 0x7f65b41595a0 2023-10-06T03:24:35.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.893+0000 7f65bc2ab700 1 -- 172.21.15.84:0/1358210915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65b4158240 con 0x7f65b41595a0 2023-10-06T03:24:35.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.894+0000 7f65aa7fc700 1 -- 172.21.15.84:0/1358210915 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f65ac055d20 con 0x7f65b41595a0 2023-10-06T03:24:35.895 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:35.895 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/749105656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":749105656},{"type":"v1","addr":"172.21.15.84:6836","nonce":749105656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/821685312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":821685312},{"type":"v1","addr":"172.21.15.84:6837","nonce":821685312}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4060135792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4060135792},{"type":"v1","addr":"172.21.15.131:6834","nonce":4060135792}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:49.917332+0000","modified":"2023-10-06T03:24:03.584509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/3283560838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3283560838},{"type":"v1","addr":"172.21.15.131:6835","nonce":3283560838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:35.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 -- 172.21.15.84:0/1358210915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6598066f30 msgr2=0x7f65980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6598066f30 0x7f65980693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65b0007fd0 tx=0x7f65b0015000 comp rx=0 tx=0).stop 2023-10-06T03:24:35.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 -- 172.21.15.84:0/1358210915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 msgr2=0x7f65b416a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 0x7f65b416a060 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00cee0 tx=0x7f65ac007870 comp rx=0 tx=0).stop 2023-10-06T03:24:35.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 -- 172.21.15.84:0/1358210915 shutdown_connections 2023-10-06T03:24:35.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6598066f30 0x7f65980693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b41595a0 0x7f65b416a060 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b40b07a0 0x7f65b4157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 --2- 172.21.15.84:0/1358210915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65b40b49e0 0x7f65b409bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 -- 172.21.15.84:0/1358210915 >> 172.21.15.84:0/1358210915 conn(0x7f65b4099830 msgr2=0x7f65b4068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:35.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 -- 172.21.15.84:0/1358210915 shutdown_connections 2023-10-06T03:24:35.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:35.896+0000 7f65bc2ab700 1 -- 172.21.15.84:0/1358210915 wait complete. 2023-10-06T03:24:35.898 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-10-06T03:24:35.909 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:36.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.022+0000 7f47517b9700 1 Processor -- start 2023-10-06T03:24:36.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.022+0000 7f47517b9700 1 -- start start 2023-10-06T03:24:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f47517b9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f474c0b07a0 0x7f474c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f47517b9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474c0b0ca0 con 0x7f474c1595a0 2023-10-06T03:24:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f47517b9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474c0b0f80 con 0x7f474c0b49e0 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f47517b9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474c0ab390 con 0x7f474c0b07a0 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f474b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f474c0b07a0 0x7f474c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f474b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f474c0b07a0 0x7f474c0ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36992/0 (socket says 172.21.15.84:36992) 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f474b7fe700 1 -- 172.21.15.84:0/1238258622 learned_addr learned my addr 172.21.15.84:0/1238258622 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f474affd700 1 --1- 172.21.15.84:0/1238258622 >> v1:172.21.15.84:6789/0 conn(0x7f474c1595a0 0x7f474c0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37216/0 (socket says 172.21.15.84:37216) 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f474b7fe700 1 -- 172.21.15.84:0/1238258622 >> v1:172.21.15.131:6789/0 conn(0x7f474c0b49e0 legacy=0x7f474c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f474b7fe700 1 -- 172.21.15.84:0/1238258622 >> v1:172.21.15.84:6789/0 conn(0x7f474c1595a0 legacy=0x7f474c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f474b7fe700 1 -- 172.21.15.84:0/1238258622 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c0b1260 con 0x7f474c0b07a0 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.023+0000 7f474a7fc700 1 -- 172.21.15.84:0/1238258622 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569853483 0 0) 0x7f474c0b0ca0 con 0x7f474c1595a0 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f474b7fe700 1 --2- 172.21.15.84:0/1238258622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b07a0 0x7f474c0ccfd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4744009f50 tx=0x7f4744009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8954103236989cdc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f474a7fc700 1 -- 172.21.15.84:0/1238258622 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474400e070 con 0x7f474c0b07a0 2023-10-06T03:24:36.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f474a7fc700 1 -- 172.21.15.84:0/1238258622 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474400ba30 con 0x7f474c0b07a0 2023-10-06T03:24:36.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f474a7fc700 1 -- 172.21.15.84:0/1238258622 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47440092e0 con 0x7f474c0b07a0 2023-10-06T03:24:36.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f47517b9700 1 -- 172.21.15.84:0/1238258622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b07a0 msgr2=0x7f474c0ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f47517b9700 1 --2- 172.21.15.84:0/1238258622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b07a0 0x7f474c0ccfd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4744009f50 tx=0x7f4744009840 comp rx=0 tx=0).stop 2023-10-06T03:24:36.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f47517b9700 1 -- 172.21.15.84:0/1238258622 shutdown_connections 2023-10-06T03:24:36.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f47517b9700 1 --2- 172.21.15.84:0/1238258622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b07a0 0x7f474c0ccfd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f47517b9700 1 -- 172.21.15.84:0/1238258622 >> 172.21.15.84:0/1238258622 conn(0x7f474c099830 msgr2=0x7f474c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:36.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f47517b9700 1 -- 172.21.15.84:0/1238258622 shutdown_connections 2023-10-06T03:24:36.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.024+0000 7f47517b9700 1 -- 172.21.15.84:0/1238258622 wait complete. 2023-10-06T03:24:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.025+0000 7f47517b9700 1 Processor -- start 2023-10-06T03:24:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.025+0000 7f47517b9700 1 -- start start 2023-10-06T03:24:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f47517b9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f474c0b07a0 0x7f474c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f47517b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b49e0 0x7f474c09a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f47517b9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f474c1595a0 0x7f474c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f47517b9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c159a10 con 0x7f474c0b49e0 2023-10-06T03:24:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f47517b9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c159cf0 con 0x7f474c1595a0 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f47517b9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c159fd0 con 0x7f474c0b07a0 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f4743fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b49e0 0x7f474c09a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f4743fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b49e0 0x7f474c09a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37006/0 (socket says 172.21.15.84:37006) 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f4743fff700 1 -- 172.21.15.84:0/1033014028 learned_addr learned my addr 172.21.15.84:0/1033014028 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f474b7fe700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f474c1595a0 0x7f474c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f474affd700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f474c0b07a0 0x7f474c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f4743fff700 1 -- 172.21.15.84:0/1033014028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f474c0b07a0 msgr2=0x7f474c158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f4743fff700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f474c0b07a0 0x7f474c158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f4743fff700 1 -- 172.21.15.84:0/1033014028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f474c1595a0 msgr2=0x7f474c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f4743fff700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f474c1595a0 0x7f474c15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.026+0000 7f4743fff700 1 -- 172.21.15.84:0/1033014028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744009ae0 con 0x7f474c0b49e0 2023-10-06T03:24:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.027+0000 7f4743fff700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b49e0 0x7f474c09a090 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4734002ee0 tx=0x7f4734007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.027+0000 7f4742ffd700 1 -- 172.21.15.84:0/1033014028 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734016070 con 0x7f474c0b49e0 2023-10-06T03:24:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.027+0000 7f4742ffd700 1 -- 172.21.15.84:0/1033014028 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4734006820 con 0x7f474c0b49e0 2023-10-06T03:24:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.027+0000 7f47517b9700 1 -- 172.21.15.84:0/1033014028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474c15a2b0 con 0x7f474c0b49e0 2023-10-06T03:24:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.027+0000 7f4742ffd700 1 -- 172.21.15.84:0/1033014028 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734006bc0 con 0x7f474c0b49e0 2023-10-06T03:24:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.027+0000 7f47517b9700 1 -- 172.21.15.84:0/1033014028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474c158ea0 con 0x7f474c0b49e0 2023-10-06T03:24:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.028+0000 7f47517b9700 1 -- 172.21.15.84:0/1033014028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474c064ad0 con 0x7f474c0b49e0 2023-10-06T03:24:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.028+0000 7f4742ffd700 1 -- 172.21.15.84:0/1033014028 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4734007020 con 0x7f474c0b49e0 2023-10-06T03:24:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.028+0000 7f4742ffd700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f472c066f30 0x7f472c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.029+0000 7f4742ffd700 1 -- 172.21.15.84:0/1033014028 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4734084280 con 0x7f474c0b49e0 2023-10-06T03:24:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.029+0000 7f474affd700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f472c066f30 0x7f472c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.029+0000 7f474affd700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f472c066f30 0x7f472c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f474c09e110 tx=0x7f473c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.033+0000 7f4742ffd700 1 -- 172.21.15.84:0/1033014028 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47340510a0 con 0x7f474c0b49e0 2023-10-06T03:24:36.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.216+0000 7f47517b9700 1 -- 172.21.15.84:0/1033014028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f474c0b1540 con 0x7f474c0b49e0 2023-10-06T03:24:36.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.217+0000 7f4742ffd700 1 -- 172.21.15.84:0/1033014028 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f47340546c0 con 0x7f474c0b49e0 2023-10-06T03:24:36.217 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:36.218 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:23:54.959268+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:47.554201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:48.881558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:52.564434+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.218+0000 7f47517b9700 1 -- 172.21.15.84:0/1033014028 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f472c066f30 msgr2=0x7f472c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.218+0000 7f47517b9700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f472c066f30 0x7f472c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f474c09e110 tx=0x7f473c009040 comp rx=0 tx=0).stop 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.218+0000 7f47517b9700 1 -- 172.21.15.84:0/1033014028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b49e0 msgr2=0x7f474c09a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.218+0000 7f47517b9700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b49e0 0x7f474c09a090 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4734002ee0 tx=0x7f4734007f20 comp rx=0 tx=0).stop 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.219+0000 7f47517b9700 1 -- 172.21.15.84:0/1033014028 shutdown_connections 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.219+0000 7f47517b9700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f472c066f30 0x7f472c0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.219+0000 7f47517b9700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f474c1595a0 0x7f474c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.219+0000 7f47517b9700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f474c0b07a0 0x7f474c158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.219+0000 7f47517b9700 1 --2- 172.21.15.84:0/1033014028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f474c0b49e0 0x7f474c09a090 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.219+0000 7f47517b9700 1 -- 172.21.15.84:0/1033014028 >> 172.21.15.84:0/1033014028 conn(0x7f474c099830 msgr2=0x7f474c069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:36.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.219+0000 7f47517b9700 1 -- 172.21.15.84:0/1033014028 shutdown_connections 2023-10-06T03:24:36.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.219+0000 7f47517b9700 1 -- 172.21.15.84:0/1033014028 wait complete. 2023-10-06T03:24:36.232 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:24:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.347+0000 7f4a2199b700 1 Processor -- start 2023-10-06T03:24:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.347+0000 7f4a2199b700 1 -- start start 2023-10-06T03:24:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a2199b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a1c1595a0 0x7f4a1c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a2199b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c0b49e0 0x7f4a1c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a2199b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c0b0ca0 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a2199b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c0b0f80 con 0x7f4a1c1595a0 2023-10-06T03:24:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a2199b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0b1260 con 0x7f4a1c0b49e0 2023-10-06T03:24:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a1affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a1c1595a0 0x7f4a1c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a1affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a1c1595a0 0x7f4a1c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37020/0 (socket says 172.21.15.84:37020) 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a1affd700 1 -- 172.21.15.84:0/719205686 learned_addr learned my addr 172.21.15.84:0/719205686 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a1affd700 1 -- 172.21.15.84:0/719205686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c0b49e0 msgr2=0x7f4a1c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a1a7fc700 1 --2- 172.21.15.84:0/719205686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c0b49e0 0x7f4a1c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a1affd700 1 --2- 172.21.15.84:0/719205686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c0b49e0 0x7f4a1c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a1affd700 1 -- 172.21.15.84:0/719205686 >> v1:172.21.15.131:6789/0 conn(0x7f4a1c0b07a0 legacy=0x7f4a1c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a1affd700 1 -- 172.21.15.84:0/719205686 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c0b1540 con 0x7f4a1c1595a0 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a1a7fc700 1 --2- 172.21.15.84:0/719205686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c0b49e0 0x7f4a1c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a1affd700 1 --2- 172.21.15.84:0/719205686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c1595a0 0x7f4a1c0aa570 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009990 tx=0x7f4a14009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea16f7fbeb8d6519 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a19ffb700 1 -- 172.21.15.84:0/719205686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14005c10 con 0x7f4a1c1595a0 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a19ffb700 1 -- 172.21.15.84:0/719205686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a14005d70 con 0x7f4a1c1595a0 2023-10-06T03:24:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.348+0000 7f4a19ffb700 1 -- 172.21.15.84:0/719205686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400b840 con 0x7f4a1c1595a0 2023-10-06T03:24:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.349+0000 7f4a2199b700 1 -- 172.21.15.84:0/719205686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c1595a0 msgr2=0x7f4a1c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.349+0000 7f4a2199b700 1 --2- 172.21.15.84:0/719205686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c1595a0 0x7f4a1c0aa570 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009990 tx=0x7f4a14009220 comp rx=0 tx=0).stop 2023-10-06T03:24:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.349+0000 7f4a2199b700 1 -- 172.21.15.84:0/719205686 shutdown_connections 2023-10-06T03:24:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.349+0000 7f4a2199b700 1 --2- 172.21.15.84:0/719205686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c1595a0 0x7f4a1c0aa570 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.349+0000 7f4a2199b700 1 --2- 172.21.15.84:0/719205686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c0b49e0 0x7f4a1c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.349+0000 7f4a2199b700 1 -- 172.21.15.84:0/719205686 >> 172.21.15.84:0/719205686 conn(0x7f4a1c099830 msgr2=0x7f4a1c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.349+0000 7f4a2199b700 1 -- 172.21.15.84:0/719205686 shutdown_connections 2023-10-06T03:24:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.349+0000 7f4a2199b700 1 -- 172.21.15.84:0/719205686 wait complete. 2023-10-06T03:24:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.350+0000 7f4a2199b700 1 Processor -- start 2023-10-06T03:24:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.350+0000 7f4a2199b700 1 -- start start 2023-10-06T03:24:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a2199b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c0b07a0 0x7f4a1c15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a2199b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a1c0b49e0 0x7f4a1c169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a2199b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c1595a0 0x7f4a1c16a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a2199b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c16af10 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a2199b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c156d80 con 0x7f4a1c0b49e0 2023-10-06T03:24:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a2199b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c16b180 con 0x7f4a1c1595a0 2023-10-06T03:24:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c0b07a0 0x7f4a1c15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c0b07a0 0x7f4a1c15a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37022/0 (socket says 172.21.15.84:37022) 2023-10-06T03:24:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1affd700 1 -- 172.21.15.84:0/727834993 learned_addr learned my addr 172.21.15.84:0/727834993 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1b7fe700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c1595a0 0x7f4a1c16a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1a7fc700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a1c0b49e0 0x7f4a1c169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1affd700 1 -- 172.21.15.84:0/727834993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c1595a0 msgr2=0x7f4a1c16a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1affd700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c1595a0 0x7f4a1c16a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1affd700 1 -- 172.21.15.84:0/727834993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a1c0b49e0 msgr2=0x7f4a1c169d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1affd700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a1c0b49e0 0x7f4a1c169d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1affd700 1 -- 172.21.15.84:0/727834993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a14009480 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.351+0000 7f4a1b7fe700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c1595a0 0x7f4a1c16a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.352+0000 7f4a1affd700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c0b07a0 0x7f4a1c15a350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4a140030c0 tx=0x7f4a14015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.352+0000 7f4a02ffd700 1 -- 172.21.15.84:0/727834993 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14000cf0 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.352+0000 7f4a02ffd700 1 -- 172.21.15.84:0/727834993 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a14011cc0 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.352+0000 7f4a2199b700 1 -- 172.21.15.84:0/727834993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c15abd0 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.352+0000 7f4a02ffd700 1 -- 172.21.15.84:0/727834993 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1401c690 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.352+0000 7f4a2199b700 1 -- 172.21.15.84:0/727834993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c15b190 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.353+0000 7f4a2199b700 1 -- 172.21.15.84:0/727834993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c064ad0 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.353+0000 7f4a02ffd700 1 -- 172.21.15.84:0/727834993 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a1401ca80 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.353+0000 7f4a02ffd700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4a08066f30 0x7f4a080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.353+0000 7f4a02ffd700 1 -- 172.21.15.84:0/727834993 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4a140865c0 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.353+0000 7f4a1a7fc700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4a08066f30 0x7f4a080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.354+0000 7f4a1a7fc700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4a08066f30 0x7f4a080693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c09e110 tx=0x7f4a10006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.358+0000 7f4a02ffd700 1 -- 172.21.15.84:0/727834993 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a140533e0 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.584+0000 7f4a2199b700 1 -- 172.21.15.84:0/727834993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4a1c0af850 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.585 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:24:36.585+0000 7f573ff98700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:24:36.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.594+0000 7f4a02ffd700 1 -- 172.21.15.84:0/727834993 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4a14056a00 con 0x7f4a1c0b07a0 2023-10-06T03:24:36.596 INFO:tasks.ceph.mds.d.smithi131.stderr: -3620> 2023-10-06T03:23:55.619+0000 7fb48a2ed700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:24:36.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 -- 172.21.15.84:0/727834993 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4a08066f30 msgr2=0x7f4a080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4a08066f30 0x7f4a080693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c09e110 tx=0x7f4a10006f90 comp rx=0 tx=0).stop 2023-10-06T03:24:36.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 -- 172.21.15.84:0/727834993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c0b07a0 msgr2=0x7f4a1c15a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c0b07a0 0x7f4a1c15a350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4a140030c0 tx=0x7f4a14015000 comp rx=0 tx=0).stop 2023-10-06T03:24:36.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 -- 172.21.15.84:0/727834993 shutdown_connections 2023-10-06T03:24:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4a08066f30 0x7f4a080693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a1c1595a0 0x7f4a1c16a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1c0b07a0 0x7f4a1c15a350 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 --2- 172.21.15.84:0/727834993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a1c0b49e0 0x7f4a1c169d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 -- 172.21.15.84:0/727834993 >> 172.21.15.84:0/727834993 conn(0x7f4a1c099830 msgr2=0x7f4a1c158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 -- 172.21.15.84:0/727834993 shutdown_connections 2023-10-06T03:24:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.596+0000 7f4a2199b700 1 -- 172.21.15.84:0/727834993 wait complete. 2023-10-06T03:24:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:24:36.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:24:36.621 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:24:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.724+0000 7f5ff2935700 1 Processor -- start 2023-10-06T03:24:36.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.724+0000 7f5ff2935700 1 -- start start 2023-10-06T03:24:36.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff2935700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2660 0x7f5fec0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff2935700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5fec0cf1f0 0x7f5fec0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff2935700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec0cc9b0 con 0x7f5fec0b2a30 2023-10-06T03:24:36.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff2935700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec0cbda0 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff2935700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0cc080 con 0x7f5fec0b2660 2023-10-06T03:24:36.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff1132700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5fec0b2a30 0x7f5fec0ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37220/0 (socket says 172.21.15.84:37220) 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff1132700 1 -- 172.21.15.84:0/3008222687 learned_addr learned my addr 172.21.15.84:0/3008222687 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff1933700 1 --2- 172.21.15.84:0/3008222687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2660 0x7f5fec0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff2134700 1 --2- 172.21.15.84:0/3008222687 >> v2:172.21.15.131:3300/0 conn(0x7f5fec0cf1f0 0x7f5fec0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff0931700 1 -- 172.21.15.84:0/3008222687 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375054021 0 0) 0x7f5fec0cc9b0 con 0x7f5fec0b2a30 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff0931700 1 -- 172.21.15.84:0/3008222687 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd8003570 con 0x7f5fec0b2a30 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff2134700 1 -- 172.21.15.84:0/3008222687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2660 msgr2=0x7f5fec0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff2134700 1 --2- 172.21.15.84:0/3008222687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2660 0x7f5fec0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff2134700 1 -- 172.21.15.84:0/3008222687 >> v1:172.21.15.84:6789/0 conn(0x7f5fec0b2a30 legacy=0x7f5fec0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff2134700 1 -- 172.21.15.84:0/3008222687 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0cc360 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.725+0000 7f5ff1933700 1 --2- 172.21.15.84:0/3008222687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2660 0x7f5fec0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff2134700 1 --2- 172.21.15.84:0/3008222687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0cf1f0 0x7f5fec0cd230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009e60 tx=0x7f5fe4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9452d52f43464d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff0931700 1 -- 172.21.15.84:0/3008222687 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400e070 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff0931700 1 -- 172.21.15.84:0/3008222687 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe400bab0 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff0931700 1 -- 172.21.15.84:0/3008222687 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400be70 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff2935700 1 -- 172.21.15.84:0/3008222687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0cf1f0 msgr2=0x7f5fec0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff2935700 1 --2- 172.21.15.84:0/3008222687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0cf1f0 0x7f5fec0cd230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009e60 tx=0x7f5fe4009780 comp rx=0 tx=0).stop 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff2935700 1 -- 172.21.15.84:0/3008222687 shutdown_connections 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff2935700 1 --2- 172.21.15.84:0/3008222687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0cf1f0 0x7f5fec0cd230 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff2935700 1 --2- 172.21.15.84:0/3008222687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2660 0x7f5fec0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff2935700 1 -- 172.21.15.84:0/3008222687 >> 172.21.15.84:0/3008222687 conn(0x7f5fec099560 msgr2=0x7f5fec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff2935700 1 -- 172.21.15.84:0/3008222687 shutdown_connections 2023-10-06T03:24:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.726+0000 7f5ff2935700 1 -- 172.21.15.84:0/3008222687 wait complete. 2023-10-06T03:24:36.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.727+0000 7f5ff2935700 1 Processor -- start 2023-10-06T03:24:36.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.727+0000 7f5ff2935700 1 -- start start 2023-10-06T03:24:36.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff2935700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0b2660 0x7f5fec14bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff2935700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2a30 0x7f5fec0c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff2935700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fec0cf1f0 0x7f5fec0c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff2935700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0c8120 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff2935700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0c8400 con 0x7f5fec0b2660 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff2935700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0c86e0 con 0x7f5fec0b2a30 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff2134700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fec0cf1f0 0x7f5fec0c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff2134700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fec0cf1f0 0x7f5fec0c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37030/0 (socket says 172.21.15.84:37030) 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff2134700 1 -- 172.21.15.84:0/2338589015 learned_addr learned my addr 172.21.15.84:0/2338589015 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff1933700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0b2660 0x7f5fec14bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.728+0000 7f5ff1132700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2a30 0x7f5fec0c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5ff2134700 1 -- 172.21.15.84:0/2338589015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2a30 msgr2=0x7f5fec0c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5ff2134700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2a30 0x7f5fec0c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5ff2134700 1 -- 172.21.15.84:0/2338589015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0b2660 msgr2=0x7f5fec14bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5ff2134700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0b2660 0x7f5fec14bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5ff2134700 1 -- 172.21.15.84:0/2338589015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe80093c0 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5ff1132700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2a30 0x7f5fec0c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5ff2134700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fec0cf1f0 0x7f5fec0c6950 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5fec06fd00 tx=0x7f5fe4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5fe1ffb700 1 -- 172.21.15.84:0/2338589015 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4012ea0 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5fe1ffb700 1 -- 172.21.15.84:0/2338589015 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe4027470 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5ff2935700 1 -- 172.21.15.84:0/2338589015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe4009a20 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5fe1ffb700 1 -- 172.21.15.84:0/2338589015 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4027850 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.729+0000 7f5ff2935700 1 -- 172.21.15.84:0/2338589015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec14f040 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.730+0000 7f5ff2935700 1 -- 172.21.15.84:0/2338589015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec14f200 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.730+0000 7f5fe1ffb700 1 -- 172.21.15.84:0/2338589015 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fe4024070 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.731+0000 7f5fe1ffb700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5fd0066f30 0x7f5fd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.731+0000 7f5ff1933700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5fd0066f30 0x7f5fd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.731+0000 7f5fe1ffb700 1 -- 172.21.15.84:0/2338589015 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f5fe4087500 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.731+0000 7f5ff1933700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5fd0066f30 0x7f5fd00693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009e90 tx=0x7f5fe8009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.735+0000 7f5fe1ffb700 1 -- 172.21.15.84:0/2338589015 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fe40542d0 con 0x7f5fec0cf1f0 2023-10-06T03:24:36.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:36.959+0000 7f5ff2935700 1 -- 172.21.15.84:0/2338589015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5fec05f270 con 0x7f5fec0cf1f0 2023-10-06T03:24:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.600+0000 7f5fe1ffb700 1 -- 172.21.15.84:0/2338589015 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5fe40578f0 con 0x7f5fec0cf1f0 2023-10-06T03:24:37.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 -- 172.21.15.84:0/2338589015 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5fd0066f30 msgr2=0x7f5fd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5fd0066f30 0x7f5fd00693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009e90 tx=0x7f5fe8009120 comp rx=0 tx=0).stop 2023-10-06T03:24:37.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 -- 172.21.15.84:0/2338589015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fec0cf1f0 msgr2=0x7f5fec0c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fec0cf1f0 0x7f5fec0c6950 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5fec06fd00 tx=0x7f5fe4019000 comp rx=0 tx=0).stop 2023-10-06T03:24:37.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 -- 172.21.15.84:0/2338589015 shutdown_connections 2023-10-06T03:24:37.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5fd0066f30 0x7f5fd00693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0b2660 0x7f5fec14bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fec0cf1f0 0x7f5fec0c6950 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 --2- 172.21.15.84:0/2338589015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fec0b2a30 0x7f5fec0c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 -- 172.21.15.84:0/2338589015 >> 172.21.15.84:0/2338589015 conn(0x7f5fec099560 msgr2=0x7f5fec157bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:37.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 -- 172.21.15.84:0/2338589015 shutdown_connections 2023-10-06T03:24:37.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.603+0000 7f5ff2935700 1 -- 172.21.15.84:0/2338589015 wait complete. 2023-10-06T03:24:37.617 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:24:37.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.734+0000 7f24273a0700 1 Processor -- start 2023-10-06T03:24:37.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.734+0000 7f24273a0700 1 -- start start 2023-10-06T03:24:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.735+0000 7f24273a0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f242006ab10 0x7f242006e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.735+0000 7f24273a0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f242013fb70 0x7f242006e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.735+0000 7f24273a0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242006ee60 con 0x7f242013f7a0 2023-10-06T03:24:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.735+0000 7f24273a0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24200c24a0 con 0x7f242006ab10 2023-10-06T03:24:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.735+0000 7f24273a0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242006f140 con 0x7f242013fb70 2023-10-06T03:24:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.735+0000 7f242639e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f242013f7a0 0x7f242006a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37234/0 (socket says 172.21.15.84:37234) 2023-10-06T03:24:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.735+0000 7f242639e700 1 -- 172.21.15.84:0/2341500668 learned_addr learned my addr 172.21.15.84:0/2341500668 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647964130 0 0) 0x7f242006ee60 con 0x7f242013f7a0 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f240c003570 con 0x7f242013f7a0 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f2425b9d700 1 --2- 172.21.15.84:0/2341500668 >> v2:172.21.15.131:3300/0 conn(0x7f242006ab10 0x7f242006e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f2426b9f700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f242013fb70 0x7f242006e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3317586487 0 0) 0x7f240c003570 con 0x7f242013f7a0 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f242013fb70 msgr2=0x7f242006e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f242013fb70 0x7f242006e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 >> v2:172.21.15.131:3300/0 conn(0x7f242006ab10 msgr2=0x7f242006e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 --2- 172.21.15.84:0/2341500668 >> v2:172.21.15.131:3300/0 conn(0x7f242006ab10 0x7f242006e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242006f420 con 0x7f242013f7a0 2023-10-06T03:24:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f241c001470 con 0x7f242013f7a0 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 >> v1:172.21.15.84:6789/0 conn(0x7f242013f7a0 legacy=0x7f242006a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f240c003a60 0x7f240c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f242013fb70 0x7f240c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f240c004d50 0x7f240c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200c24a0 con 0x7f240c003a60 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242006f140 con 0x7f240c004d50 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c00ba60 con 0x7f242013fb70 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242639e700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f240c003a60 0x7f240c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f2425b9d700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f242013fb70 0x7f240c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f2426b9f700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f240c004d50 0x7f240c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242639e700 1 -- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f242013fb70 msgr2=0x7f240c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242639e700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f242013fb70 0x7f240c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242639e700 1 -- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f240c004d50 msgr2=0x7f240c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242639e700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f240c004d50 0x7f240c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.736+0000 7f242639e700 1 -- 172.21.15.84:0/2341500668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c003570 con 0x7f240c003a60 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f242639e700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f240c003a60 0x7f240c003e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c3c0 tx=0x7f241c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d65557d5a41b2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c00cc30 con 0x7f240c003a60 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c00cdb0 con 0x7f240c003a60 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f242539c700 1 -- 172.21.15.84:0/2341500668 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c005b70 con 0x7f240c003a60 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f24273a0700 1 -- 172.21.15.84:0/2341500668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f240c003a60 msgr2=0x7f240c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f24273a0700 1 --2- 172.21.15.84:0/2341500668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f240c003a60 0x7f240c003e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c3c0 tx=0x7f241c001e90 comp rx=0 tx=0).stop 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f2426b9f700 1 -- 172.21.15.84:0/2341500668 reap_dead start 2023-10-06T03:24:37.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f24273a0700 1 -- 172.21.15.84:0/2341500668 shutdown_connections 2023-10-06T03:24:37.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f24273a0700 1 -- 172.21.15.84:0/2341500668 >> 172.21.15.84:0/2341500668 conn(0x7f24200680c0 msgr2=0x7f24200cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:37.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f24273a0700 1 -- 172.21.15.84:0/2341500668 shutdown_connections 2023-10-06T03:24:37.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.737+0000 7f24273a0700 1 -- 172.21.15.84:0/2341500668 wait complete. 2023-10-06T03:24:37.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.738+0000 7f24273a0700 1 Processor -- start 2023-10-06T03:24:37.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.738+0000 7f24273a0700 1 -- start start 2023-10-06T03:24:37.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f24273a0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f240c003a60 0x7f242013ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f24273a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2420159490 0x7f24200ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f24273a0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2420159900 0x7f24200692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f24273a0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420159000 con 0x7f2420159490 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f24273a0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420158430 con 0x7f2420159900 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f24273a0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24201586d0 con 0x7f240c003a60 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f2425b9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2420159490 0x7f24200ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f2425b9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2420159490 0x7f24200ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37056/0 (socket says 172.21.15.84:37056) 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f2425b9d700 1 -- 172.21.15.84:0/3507696072 learned_addr learned my addr 172.21.15.84:0/3507696072 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f242639e700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f240c003a60 0x7f242013ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.739+0000 7f2426b9f700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2420159900 0x7f24200692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f2425b9d700 1 -- 172.21.15.84:0/3507696072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f240c003a60 msgr2=0x7f242013ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f2425b9d700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f240c003a60 0x7f242013ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f2425b9d700 1 -- 172.21.15.84:0/3507696072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2420159900 msgr2=0x7f24200692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f2425b9d700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2420159900 0x7f24200692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f2425b9d700 1 -- 172.21.15.84:0/3507696072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24201589b0 con 0x7f2420159490 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f2425b9d700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2420159490 0x7f24200ad4e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2410011b40 tx=0x7f24100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f24167fc700 1 -- 172.21.15.84:0/3507696072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000f8c0 con 0x7f2420159490 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f24167fc700 1 -- 172.21.15.84:0/3507696072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241000fa20 con 0x7f2420159490 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f24167fc700 1 -- 172.21.15.84:0/3507696072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000fda0 con 0x7f2420159490 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f24273a0700 1 -- 172.21.15.84:0/3507696072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2420158c90 con 0x7f2420159490 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.740+0000 7f24273a0700 1 -- 172.21.15.84:0/3507696072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2420152980 con 0x7f2420159490 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.741+0000 7f24273a0700 1 -- 172.21.15.84:0/3507696072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2420159170 con 0x7f2420159490 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.741+0000 7f24167fc700 1 -- 172.21.15.84:0/3507696072 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2410014650 con 0x7f2420159490 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.741+0000 7f24167fc700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2404066f30 0x7f24040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.742+0000 7f24167fc700 1 -- 172.21.15.84:0/3507696072 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f2410018030 con 0x7f2420159490 2023-10-06T03:24:37.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.742+0000 7f242639e700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2404066f30 0x7f24040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.742+0000 7f242639e700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2404066f30 0x7f24040693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f241c001ed0 tx=0x7f241c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.746+0000 7f24167fc700 1 -- 172.21.15.84:0/3507696072 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2410052060 con 0x7f2420159490 2023-10-06T03:24:37.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:37.928+0000 7f24273a0700 1 -- 172.21.15.84:0/3507696072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f242005f270 con 0x7f2420159490 2023-10-06T03:24:38.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.602+0000 7f24167fc700 1 -- 172.21.15.84:0/3507696072 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2410055680 con 0x7f2420159490 2023-10-06T03:24:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 -- 172.21.15.84:0/3507696072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2404066f30 msgr2=0x7f24040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2404066f30 0x7f24040693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f241c001ed0 tx=0x7f241c015000 comp rx=0 tx=0).stop 2023-10-06T03:24:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 -- 172.21.15.84:0/3507696072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2420159490 msgr2=0x7f24200ad4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2420159490 0x7f24200ad4e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2410011b40 tx=0x7f24100091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 -- 172.21.15.84:0/3507696072 shutdown_connections 2023-10-06T03:24:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2404066f30 0x7f24040693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2420159900 0x7f24200692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f240c003a60 0x7f242013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 --2- 172.21.15.84:0/3507696072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2420159490 0x7f24200ad4e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 -- 172.21.15.84:0/3507696072 >> 172.21.15.84:0/3507696072 conn(0x7f24200680c0 msgr2=0x7f2420155b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 -- 172.21.15.84:0/3507696072 shutdown_connections 2023-10-06T03:24:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.604+0000 7f24273a0700 1 -- 172.21.15.84:0/3507696072 wait complete. 2023-10-06T03:24:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:24:38.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:24:38.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.737+0000 7f31a575a700 1 Processor -- start 2023-10-06T03:24:38.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.737+0000 7f31a575a700 1 -- start start 2023-10-06T03:24:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a575a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f31a00af020 0x7f31a00ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a575a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31a00cedd0 0x7f31a00ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a575a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a00c6ea0 con 0x7f31a00aec50 2023-10-06T03:24:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a575a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a00cf210 con 0x7f31a00cedd0 2023-10-06T03:24:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a575a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a00c6290 con 0x7f31a00af020 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a4f59700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31a00cedd0 0x7f31a00ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a4f59700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31a00cedd0 0x7f31a00ad0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37072/0 (socket says 172.21.15.84:37072) 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a4f59700 1 -- 172.21.15.84:0/4024644448 learned_addr learned my addr 172.21.15.84:0/4024644448 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f319f7fe700 1 --2- 172.21.15.84:0/4024644448 >> v2:172.21.15.131:3300/0 conn(0x7f31a00af020 0x7f31a00ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a4f59700 1 -- 172.21.15.84:0/4024644448 >> v2:172.21.15.131:3300/0 conn(0x7f31a00af020 msgr2=0x7f31a00ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a4f59700 1 --2- 172.21.15.84:0/4024644448 >> v2:172.21.15.131:3300/0 conn(0x7f31a00af020 0x7f31a00ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a4f59700 1 -- 172.21.15.84:0/4024644448 >> v1:172.21.15.131:6789/0 conn(0x7f31a00aec50 legacy=0x7f31a00c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f31a4f59700 1 -- 172.21.15.84:0/4024644448 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a00c6570 con 0x7f31a00cedd0 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.738+0000 7f319f7fe700 1 --2- 172.21.15.84:0/4024644448 >> v2:172.21.15.131:3300/0 conn(0x7f31a00af020 0x7f31a00ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f31a4f59700 1 --2- 172.21.15.84:0/4024644448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00cedd0 0x7f31a00ad0d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f31a00b6320 tx=0x7f3198009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810c35498cce53a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f319effd700 1 -- 172.21.15.84:0/4024644448 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800e070 con 0x7f31a00cedd0 2023-10-06T03:24:38.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f319effd700 1 -- 172.21.15.84:0/4024644448 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319800ba10 con 0x7f31a00cedd0 2023-10-06T03:24:38.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f319effd700 1 -- 172.21.15.84:0/4024644448 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980092e0 con 0x7f31a00cedd0 2023-10-06T03:24:38.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f31a575a700 1 -- 172.21.15.84:0/4024644448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00cedd0 msgr2=0x7f31a00ad0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f31a575a700 1 --2- 172.21.15.84:0/4024644448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00cedd0 0x7f31a00ad0d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f31a00b6320 tx=0x7f3198009840 comp rx=0 tx=0).stop 2023-10-06T03:24:38.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f31a575a700 1 -- 172.21.15.84:0/4024644448 shutdown_connections 2023-10-06T03:24:38.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f31a575a700 1 --2- 172.21.15.84:0/4024644448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00cedd0 0x7f31a00ad0d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f31a575a700 1 --2- 172.21.15.84:0/4024644448 >> v2:172.21.15.131:3300/0 conn(0x7f31a00af020 0x7f31a00ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f31a575a700 1 -- 172.21.15.84:0/4024644448 >> 172.21.15.84:0/4024644448 conn(0x7f31a0099580 msgr2=0x7f31a006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:38.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f31a575a700 1 -- 172.21.15.84:0/4024644448 shutdown_connections 2023-10-06T03:24:38.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.739+0000 7f31a575a700 1 -- 172.21.15.84:0/4024644448 wait complete. 2023-10-06T03:24:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.740+0000 7f31a575a700 1 Processor -- start 2023-10-06T03:24:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f31a575a700 1 -- start start 2023-10-06T03:24:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f31a575a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00aec50 0x7f31a00b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f31a575a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00af020 0x7f31a0069980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f31a575a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31a00cedd0 0x7f31a014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f31a575a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a0150810 con 0x7f31a00aec50 2023-10-06T03:24:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f31a575a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00b3b30 con 0x7f31a00af020 2023-10-06T03:24:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f31a575a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00b3e10 con 0x7f31a00cedd0 2023-10-06T03:24:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f319ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00aec50 0x7f31a00b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f319ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00aec50 0x7f31a00b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37080/0 (socket says 172.21.15.84:37080) 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f319ffff700 1 -- 172.21.15.84:0/1684116353 learned_addr learned my addr 172.21.15.84:0/1684116353 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f31a4f59700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31a00cedd0 0x7f31a014f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.741+0000 7f319f7fe700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00af020 0x7f31a0069980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f319ffff700 1 -- 172.21.15.84:0/1684116353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31a00cedd0 msgr2=0x7f31a014f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f319ffff700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31a00cedd0 0x7f31a014f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f319ffff700 1 -- 172.21.15.84:0/1684116353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00af020 msgr2=0x7f31a0069980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f319ffff700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00af020 0x7f31a0069980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f319ffff700 1 -- 172.21.15.84:0/1684116353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198009ae0 con 0x7f31a00aec50 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f319ffff700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00aec50 0x7f31a00b1f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f319000b5e0 tx=0x7f31900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f3187fff700 1 -- 172.21.15.84:0/1684116353 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000f510 con 0x7f31a00aec50 2023-10-06T03:24:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f3187fff700 1 -- 172.21.15.84:0/1684116353 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319000f670 con 0x7f31a00aec50 2023-10-06T03:24:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f3187fff700 1 -- 172.21.15.84:0/1684116353 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000fa30 con 0x7f31a00aec50 2023-10-06T03:24:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f31a575a700 1 -- 172.21.15.84:0/1684116353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a00af510 con 0x7f31a00aec50 2023-10-06T03:24:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.742+0000 7f31a575a700 1 -- 172.21.15.84:0/1684116353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a00b40f0 con 0x7f31a00aec50 2023-10-06T03:24:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.743+0000 7f31a575a700 1 -- 172.21.15.84:0/1684116353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a005f270 con 0x7f31a00aec50 2023-10-06T03:24:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.743+0000 7f3187fff700 1 -- 172.21.15.84:0/1684116353 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f319001a400 con 0x7f31a00aec50 2023-10-06T03:24:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.744+0000 7f3187fff700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f318c066f30 0x7f318c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.744+0000 7f3187fff700 1 -- 172.21.15.84:0/1684116353 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f3190084300 con 0x7f31a00aec50 2023-10-06T03:24:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.744+0000 7f319f7fe700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f318c066f30 0x7f318c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.744+0000 7f319f7fe700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f318c066f30 0x7f318c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f31a00ae300 tx=0x7f3194006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.748+0000 7f3187fff700 1 -- 172.21.15.84:0/1684116353 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3190054d50 con 0x7f31a00aec50 2023-10-06T03:24:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:38.930+0000 7f31a575a700 1 -- 172.21.15.84:0/1684116353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31a00ae330 con 0x7f31a00aec50 2023-10-06T03:24:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.608+0000 7f3187fff700 1 -- 172.21.15.84:0/1684116353 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f31900548e0 con 0x7f31a00aec50 2023-10-06T03:24:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.611+0000 7f31a575a700 1 -- 172.21.15.84:0/1684116353 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f318c066f30 msgr2=0x7f318c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.611+0000 7f31a575a700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f318c066f30 0x7f318c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f31a00ae300 tx=0x7f3194006f90 comp rx=0 tx=0).stop 2023-10-06T03:24:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.611+0000 7f31a575a700 1 -- 172.21.15.84:0/1684116353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00aec50 msgr2=0x7f31a00b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.611+0000 7f31a575a700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00aec50 0x7f31a00b1f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f319000b5e0 tx=0x7f31900090f0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.611+0000 7f31a575a700 1 -- 172.21.15.84:0/1684116353 shutdown_connections 2023-10-06T03:24:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.611+0000 7f31a575a700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f318c066f30 0x7f318c0693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.611+0000 7f31a575a700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31a00cedd0 0x7f31a014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.611+0000 7f31a575a700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a00aec50 0x7f31a00b1f30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.611+0000 7f31a575a700 1 --2- 172.21.15.84:0/1684116353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00af020 0x7f31a0069980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.611+0000 7f31a575a700 1 -- 172.21.15.84:0/1684116353 >> 172.21.15.84:0/1684116353 conn(0x7f31a0099580 msgr2=0x7f31a00cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.612+0000 7f31a575a700 1 -- 172.21.15.84:0/1684116353 shutdown_connections 2023-10-06T03:24:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.612+0000 7f31a575a700 1 -- 172.21.15.84:0/1684116353 wait complete. 2023-10-06T03:24:39.614 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T03:24:39.626 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T03:24:39.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.744+0000 7f24aa6ac700 1 Processor -- start 2023-10-06T03:24:39.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.744+0000 7f24aa6ac700 1 -- start start 2023-10-06T03:24:39.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.745+0000 7f24aa6ac700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f24a406ed20 0x7f24a40b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.745+0000 7f24aa6ac700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a40b2d20 con 0x7f24a40aee20 2023-10-06T03:24:39.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.745+0000 7f24aa6ac700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a40b0450 con 0x7f24a406f0f0 2023-10-06T03:24:39.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.745+0000 7f24aa6ac700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a406fb80 con 0x7f24a406ed20 2023-10-06T03:24:39.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.745+0000 7f24a8c49700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f24a40aee20 0x7f24a40af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37236/0 (socket says 172.21.15.84:37236) 2023-10-06T03:24:39.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.745+0000 7f24a8c49700 1 -- 172.21.15.84:0/1119072299 learned_addr learned my addr 172.21.15.84:0/1119072299 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:39.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727825133 0 0) 0x7f24a40b2d20 con 0x7f24a40aee20 2023-10-06T03:24:39.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f248c003570 con 0x7f24a40aee20 2023-10-06T03:24:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a3fff700 1 --2- 172.21.15.84:0/1119072299 >> v2:172.21.15.131:3300/0 conn(0x7f24a406ed20 0x7f24a40b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627192615 0 0) 0x7f248c003570 con 0x7f24a40aee20 2023-10-06T03:24:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 >> v2:172.21.15.131:3300/0 conn(0x7f24a406ed20 msgr2=0x7f24a40b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 --2- 172.21.15.84:0/1119072299 >> v2:172.21.15.131:3300/0 conn(0x7f24a406ed20 0x7f24a40b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 >> v1:172.21.15.131:6789/0 conn(0x7f24a406f0f0 legacy=0x7f24a40b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40b2a40 con 0x7f24a40aee20 2023-10-06T03:24:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f249c0017f0 con 0x7f24a40aee20 2023-10-06T03:24:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 >> v1:172.21.15.84:6789/0 conn(0x7f24a40aee20 legacy=0x7f24a40af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f248c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f248c004810 0x7f248c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f248c0052e0 0x7f248c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c00c160 con 0x7f248c003a60 2023-10-06T03:24:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c00c2d0 con 0x7f248c0052e0 2023-10-06T03:24:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248c00c490 con 0x7f248c004810 2023-10-06T03:24:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a3fff700 1 --2- 172.21.15.84:0/1119072299 >> v2:172.21.15.131:3300/0 conn(0x7f24a406ed20 0x7f24a40b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a3fff700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f248c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a8c49700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f248c0052e0 0x7f248c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a37fe700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f248c004810 0x7f248c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a3fff700 1 -- 172.21.15.84:0/1119072299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f248c004810 msgr2=0x7f248c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a3fff700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f248c004810 0x7f248c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a3fff700 1 -- 172.21.15.84:0/1119072299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f248c0052e0 msgr2=0x7f248c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a3fff700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f248c0052e0 0x7f248c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a3fff700 1 -- 172.21.15.84:0/1119072299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c003570 con 0x7f248c003a60 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a8c49700 1 -- 172.21.15.84:0/1119072299 reap_dead start 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.746+0000 7f24a37fe700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f248c004810 0x7f248c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24a3fff700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f248c003e70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2494009ba0 tx=0x7f2494008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc8195754cfde84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400c070 con 0x7f248c003a60 2023-10-06T03:24:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249400e5e0 con 0x7f248c003a60 2023-10-06T03:24:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24a2ffd700 1 -- 172.21.15.84:0/1119072299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400e770 con 0x7f248c003a60 2023-10-06T03:24:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1119072299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 msgr2=0x7f248c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24aa6ac700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f248c003e70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2494009ba0 tx=0x7f2494008040 comp rx=0 tx=0).stop 2023-10-06T03:24:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1119072299 shutdown_connections 2023-10-06T03:24:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24aa6ac700 1 --2- 172.21.15.84:0/1119072299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f248c003e70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1119072299 >> 172.21.15.84:0/1119072299 conn(0x7f24a4068330 msgr2=0x7f24a4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1119072299 shutdown_connections 2023-10-06T03:24:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.747+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1119072299 wait complete. 2023-10-06T03:24:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.748+0000 7f24aa6ac700 1 Processor -- start 2023-10-06T03:24:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.749+0000 7f24aa6ac700 1 -- start start 2023-10-06T03:24:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.749+0000 7f24aa6ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f24a4155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.749+0000 7f24aa6ac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a415aeb0 0x7f24a415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.749+0000 7f24aa6ac700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a40c99b0 0x7f24a40c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.749+0000 7f24aa6ac700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40ca360 con 0x7f248c003a60 2023-10-06T03:24:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.749+0000 7f24aa6ac700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a41584e0 con 0x7f24a415aeb0 2023-10-06T03:24:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.749+0000 7f24aa6ac700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a41578d0 con 0x7f24a40c99b0 2023-10-06T03:24:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.749+0000 7f24a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f24a4155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.749+0000 7f24a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f24a4155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37096/0 (socket says 172.21.15.84:37096) 2023-10-06T03:24:39.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.749+0000 7f24a3fff700 1 -- 172.21.15.84:0/1016499271 learned_addr learned my addr 172.21.15.84:0/1016499271 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:39.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f24a37fe700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a415aeb0 0x7f24a415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f24a8c49700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a40c99b0 0x7f24a40c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f24a3fff700 1 -- 172.21.15.84:0/1016499271 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a40c99b0 msgr2=0x7f24a40c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f24a3fff700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a40c99b0 0x7f24a40c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f24a3fff700 1 -- 172.21.15.84:0/1016499271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a415aeb0 msgr2=0x7f24a415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f24a3fff700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a415aeb0 0x7f24a415b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f24a3fff700 1 -- 172.21.15.84:0/1016499271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a4157bb0 con 0x7f248c003a60 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f24a3fff700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f24a4155480 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f248c00c2a0 tx=0x7f249401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f248bfff700 1 -- 172.21.15.84:0/1016499271 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400e750 con 0x7f248c003a60 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f248bfff700 1 -- 172.21.15.84:0/1016499271 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249401c440 con 0x7f248c003a60 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1016499271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a4157e90 con 0x7f248c003a60 2023-10-06T03:24:39.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f248bfff700 1 -- 172.21.15.84:0/1016499271 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249401c800 con 0x7f248c003a60 2023-10-06T03:24:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.750+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1016499271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40ca7b0 con 0x7f248c003a60 2023-10-06T03:24:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.751+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1016499271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a40ca360 con 0x7f248c003a60 2023-10-06T03:24:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.751+0000 7f248bfff700 1 -- 172.21.15.84:0/1016499271 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f249401cbb0 con 0x7f248c003a60 2023-10-06T03:24:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.752+0000 7f248bfff700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2490066f30 0x7f24900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.752+0000 7f248bfff700 1 -- 172.21.15.84:0/1016499271 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6043+0+0 (secure 0 0 0) 0x7f2494086200 con 0x7f248c003a60 2023-10-06T03:24:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.752+0000 7f24a37fe700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2490066f30 0x7f24900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.752+0000 7f24a37fe700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2490066f30 0x7f24900693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f24a40b12d0 tx=0x7f2498009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.756+0000 7f248bfff700 1 -- 172.21.15.84:0/1016499271 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2494053320 con 0x7f248c003a60 2023-10-06T03:24:39.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:39.936+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1016499271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f24a4064ad0 con 0x7f248c003a60 2023-10-06T03:24:40.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.611+0000 7f248bfff700 1 -- 172.21.15.84:0/1016499271 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v29) v1 ==== 178+0+0 (secure 0 0 0) 0x7f249401ce60 con 0x7f248c003a60 2023-10-06T03:24:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.617+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1016499271 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2490066f30 msgr2=0x7f24900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.617+0000 7f24aa6ac700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2490066f30 0x7f24900693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f24a40b12d0 tx=0x7f2498009040 comp rx=0 tx=0).stop 2023-10-06T03:24:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.617+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1016499271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 msgr2=0x7f24a4155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.617+0000 7f24aa6ac700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f24a4155480 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f248c00c2a0 tx=0x7f249401a000 comp rx=0 tx=0).stop 2023-10-06T03:24:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.617+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1016499271 shutdown_connections 2023-10-06T03:24:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.617+0000 7f24aa6ac700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2490066f30 0x7f24900693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.617+0000 7f24aa6ac700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a40c99b0 0x7f24a40c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.617+0000 7f24aa6ac700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f248c003a60 0x7f24a4155480 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.617+0000 7f24aa6ac700 1 --2- 172.21.15.84:0/1016499271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a415aeb0 0x7f24a415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.617+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1016499271 >> 172.21.15.84:0/1016499271 conn(0x7f24a4068330 msgr2=0x7f24a40b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.618+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1016499271 shutdown_connections 2023-10-06T03:24:40.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.618+0000 7f24aa6ac700 1 -- 172.21.15.84:0/1016499271 wait complete. 2023-10-06T03:24:40.625 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' removed 2023-10-06T03:24:40.643 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:24:40.644 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:24:40.644 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:24:40.644 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:24:40.644 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:24:40.644 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:24:40.645 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:24:40.645 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:24:40.645 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:24:40.645 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:24:40.645 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:24:40.645 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:24:40.645 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:24:40.645 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:24:40.646 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:24:40.646 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:24:40.656 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:24:40.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:24:40.658 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:24:40.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:24:40.659 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:24:40.660 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:24:40.661 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:24:40.661 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:24:40.698 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:24:40.702 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:40.702 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:24:40.703 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:40.703 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:24:40.704 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:40.705 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:24:40.705 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:40.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:24:40.773 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:24:40.773 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:24:40.780 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:24:40.781 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:24:40.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.826+0000 7f0f5b672700 1 Processor -- start 2023-10-06T03:24:40.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.826+0000 7f0f5b672700 1 -- start start 2023-10-06T03:24:40.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f5b672700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0f54156390 0x7f0f540cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f5b672700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0f5406c370 0x7f0f540c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f5b672700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5406c780 con 0x7f0f540cc750 2023-10-06T03:24:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f5b672700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540ccbd0 con 0x7f0f5406c370 2023-10-06T03:24:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f5b672700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5406c9e0 con 0x7f0f54156390 2023-10-06T03:24:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f59c0f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0f5406c370 0x7f0f540c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f58c0d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0f540cc750 0x7f0f5406bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40244/0 (socket says 172.21.15.84:40244) 2023-10-06T03:24:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f58c0d700 1 -- 172.21.15.84:0/1434002445 learned_addr learned my addr 172.21.15.84:0/1434002445 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f5940e700 1 --2- 172.21.15.84:0/1434002445 >> v2:172.21.15.131:3300/0 conn(0x7f0f54156390 0x7f0f540cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f59c0f700 1 -- 172.21.15.84:0/1434002445 >> v2:172.21.15.131:3300/0 conn(0x7f0f54156390 msgr2=0x7f0f540cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f59c0f700 1 --2- 172.21.15.84:0/1434002445 >> v2:172.21.15.131:3300/0 conn(0x7f0f54156390 0x7f0f540cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f59c0f700 1 -- 172.21.15.84:0/1434002445 >> v1:172.21.15.84:6789/0 conn(0x7f0f540cc750 legacy=0x7f0f5406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f59c0f700 1 -- 172.21.15.84:0/1434002445 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54156b60 con 0x7f0f5406c370 2023-10-06T03:24:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.827+0000 7f0f4bfff700 1 -- 172.21.15.84:0/1434002445 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825900522 0 0) 0x7f0f5406c780 con 0x7f0f540cc750 2023-10-06T03:24:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f59c0f700 1 --2- 172.21.15.84:0/1434002445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f5406c370 0x7f0f540c88c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0f54069f90 tx=0x7f0f4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc399a178283f344 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f4bfff700 1 -- 172.21.15.84:0/1434002445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00b6b0 con 0x7f0f5406c370 2023-10-06T03:24:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f4bfff700 1 -- 172.21.15.84:0/1434002445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00b810 con 0x7f0f5406c370 2023-10-06T03:24:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f4bfff700 1 -- 172.21.15.84:0/1434002445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00bbb0 con 0x7f0f5406c370 2023-10-06T03:24:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f5b672700 1 -- 172.21.15.84:0/1434002445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f5406c370 msgr2=0x7f0f540c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f5b672700 1 --2- 172.21.15.84:0/1434002445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f5406c370 0x7f0f540c88c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0f54069f90 tx=0x7f0f4c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f5b672700 1 -- 172.21.15.84:0/1434002445 shutdown_connections 2023-10-06T03:24:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f5b672700 1 --2- 172.21.15.84:0/1434002445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f5406c370 0x7f0f540c88c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f5b672700 1 --2- 172.21.15.84:0/1434002445 >> v2:172.21.15.131:3300/0 conn(0x7f0f54156390 0x7f0f540cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f5b672700 1 -- 172.21.15.84:0/1434002445 >> 172.21.15.84:0/1434002445 conn(0x7f0f540cdef0 msgr2=0x7f0f540c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f5b672700 1 -- 172.21.15.84:0/1434002445 shutdown_connections 2023-10-06T03:24:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.828+0000 7f0f5b672700 1 -- 172.21.15.84:0/1434002445 wait complete. 2023-10-06T03:24:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.829+0000 7f0f5b672700 1 Processor -- start 2023-10-06T03:24:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.829+0000 7f0f5b672700 1 -- start start 2023-10-06T03:24:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.830+0000 7f0f5b672700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f5406c370 0x7f0f54169270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.830+0000 7f0f5b672700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540cc750 0x7f0f54151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.830+0000 7f0f5b672700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54156390 0x7f0f540c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.830+0000 7f0f5b672700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54168cd0 con 0x7f0f54156390 2023-10-06T03:24:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.830+0000 7f0f5b672700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54152080 con 0x7f0f5406c370 2023-10-06T03:24:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.830+0000 7f0f5b672700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f541680c0 con 0x7f0f540cc750 2023-10-06T03:24:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.830+0000 7f0f59c0f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54156390 0x7f0f540c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.830+0000 7f0f59c0f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54156390 0x7f0f540c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52064/0 (socket says 172.21.15.84:52064) 2023-10-06T03:24:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.830+0000 7f0f59c0f700 1 -- 172.21.15.84:0/367288147 learned_addr learned my addr 172.21.15.84:0/367288147 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f5940e700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f5406c370 0x7f0f54169270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f58c0d700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540cc750 0x7f0f54151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f59c0f700 1 -- 172.21.15.84:0/367288147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540cc750 msgr2=0x7f0f54151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f59c0f700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540cc750 0x7f0f54151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f59c0f700 1 -- 172.21.15.84:0/367288147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f5406c370 msgr2=0x7f0f54169270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f59c0f700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f5406c370 0x7f0f54169270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f59c0f700 1 -- 172.21.15.84:0/367288147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c009420 con 0x7f0f54156390 2023-10-06T03:24:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f59c0f700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54156390 0x7f0f540c6aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0f5406df60 tx=0x7f0f4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f497fa700 1 -- 172.21.15.84:0/367288147 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c011630 con 0x7f0f54156390 2023-10-06T03:24:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f497fa700 1 -- 172.21.15.84:0/367288147 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c011790 con 0x7f0f54156390 2023-10-06T03:24:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f5b672700 1 -- 172.21.15.84:0/367288147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f541683a0 con 0x7f0f54156390 2023-10-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f497fa700 1 -- 172.21.15.84:0/367288147 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c011b30 con 0x7f0f54156390 2023-10-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.831+0000 7f0f5b672700 1 -- 172.21.15.84:0/367288147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f54168960 con 0x7f0f54156390 2023-10-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.832+0000 7f0f5b672700 1 -- 172.21.15.84:0/367288147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f54064ad0 con 0x7f0f54156390 2023-10-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.832+0000 7f0f497fa700 1 -- 172.21.15.84:0/367288147 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f4c02e440 con 0x7f0f54156390 2023-10-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.833+0000 7f0f497fa700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0f38066f30 0x7f0f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.833+0000 7f0f497fa700 1 -- 172.21.15.84:0/367288147 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f0f4c086150 con 0x7f0f54156390 2023-10-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.833+0000 7f0f5940e700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0f38066f30 0x7f0f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.833+0000 7f0f5940e700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0f38066f30 0x7f0f380693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f540c5a40 tx=0x7f0f5000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:40.837+0000 7f0f497fa700 1 -- 172.21.15.84:0/367288147 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f4c053380 con 0x7f0f54156390 2023-10-06T03:24:41.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:41.033+0000 7f0f5b672700 1 -- 172.21.15.84:0/367288147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0f54156e40 con 0x7f0f54156390 2023-10-06T03:24:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.356+0000 7f0f497fa700 1 -- 172.21.15.84:0/367288147 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0f4c0569a0 con 0x7f0f54156390 2023-10-06T03:24:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 -- 172.21.15.84:0/367288147 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0f38066f30 msgr2=0x7f0f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0f38066f30 0x7f0f380693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f540c5a40 tx=0x7f0f5000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 -- 172.21.15.84:0/367288147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54156390 msgr2=0x7f0f540c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54156390 0x7f0f540c6aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0f5406df60 tx=0x7f0f4c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 -- 172.21.15.84:0/367288147 shutdown_connections 2023-10-06T03:24:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0f38066f30 0x7f0f380693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f5406c370 0x7f0f54169270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54156390 0x7f0f540c6aa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 --2- 172.21.15.84:0/367288147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540cc750 0x7f0f54151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 -- 172.21.15.84:0/367288147 >> 172.21.15.84:0/367288147 conn(0x7f0f540cdef0 msgr2=0x7f0f540cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 -- 172.21.15.84:0/367288147 shutdown_connections 2023-10-06T03:24:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.359+0000 7f0f5b672700 1 -- 172.21.15.84:0/367288147 wait complete. 2023-10-06T03:24:42.361 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T03:24:42.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:24:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.493+0000 7fcf7d2e4700 1 Processor -- start 2023-10-06T03:24:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.493+0000 7fcf7d2e4700 1 -- start start 2023-10-06T03:24:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf7d2e4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf780b2850 0x7fcf780cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf7d2e4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf780cb7e0 con 0x7fcf780cbc70 2023-10-06T03:24:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf7d2e4700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf780b08a0 con 0x7fcf78159480 2023-10-06T03:24:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf7d2e4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf780cb190 con 0x7fcf780b2850 2023-10-06T03:24:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf7cae3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf780b2850 0x7fcf780cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf777fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcf780cbc70 0x7fcf780b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40256/0 (socket says 172.21.15.84:40256) 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf777fe700 1 -- 172.21.15.84:0/2371973304 learned_addr learned my addr 172.21.15.84:0/2371973304 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf7cae3700 1 -- 172.21.15.84:0/2371973304 >> v1:172.21.15.131:6789/0 conn(0x7fcf78159480 legacy=0x7fcf780b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf7cae3700 1 -- 172.21.15.84:0/2371973304 >> v1:172.21.15.84:6789/0 conn(0x7fcf780cbc70 legacy=0x7fcf780b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf7cae3700 1 -- 172.21.15.84:0/2371973304 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780cb470 con 0x7fcf780b2850 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.494+0000 7fcf76ffd700 1 -- 172.21.15.84:0/2371973304 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668417350 0 0) 0x7fcf780cb7e0 con 0x7fcf780cbc70 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf7cae3700 1 --2- 172.21.15.84:0/2371973304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 0x7fcf780cc0c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009e60 tx=0x7fcf70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc43ae824e07e7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf76ffd700 1 -- 172.21.15.84:0/2371973304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7000e070 con 0x7fcf780b2850 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf76ffd700 1 -- 172.21.15.84:0/2371973304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7000bc30 con 0x7fcf780b2850 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf76ffd700 1 -- 172.21.15.84:0/2371973304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70012430 con 0x7fcf780b2850 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/2371973304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 msgr2=0x7fcf780cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf7d2e4700 1 --2- 172.21.15.84:0/2371973304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 0x7fcf780cc0c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009e60 tx=0x7fcf70009780 comp rx=0 tx=0).stop 2023-10-06T03:24:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/2371973304 shutdown_connections 2023-10-06T03:24:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf7d2e4700 1 --2- 172.21.15.84:0/2371973304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 0x7fcf780cc0c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/2371973304 >> 172.21.15.84:0/2371973304 conn(0x7fcf7806ed20 msgr2=0x7fcf7806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/2371973304 shutdown_connections 2023-10-06T03:24:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.495+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/2371973304 wait complete. 2023-10-06T03:24:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.496+0000 7fcf7d2e4700 1 Processor -- start 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.497+0000 7fcf7d2e4700 1 -- start start 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.497+0000 7fcf7d2e4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 0x7fcf7815f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.497+0000 7fcf7d2e4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf780cbc70 0x7fcf780c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.497+0000 7fcf7d2e4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf78159480 0x7fcf78154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.497+0000 7fcf7d2e4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78169f60 con 0x7fcf780b2850 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.497+0000 7fcf7d2e4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78169c80 con 0x7fcf78159480 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.497+0000 7fcf7d2e4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7815e6e0 con 0x7fcf780cbc70 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.497+0000 7fcf77fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 0x7fcf7815f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.497+0000 7fcf77fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 0x7fcf7815f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52088/0 (socket says 172.21.15.84:52088) 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.497+0000 7fcf77fff700 1 -- 172.21.15.84:0/157422509 learned_addr learned my addr 172.21.15.84:0/157422509 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf7cae3700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf78159480 0x7fcf78154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf777fe700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf780cbc70 0x7fcf780c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf77fff700 1 -- 172.21.15.84:0/157422509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf780cbc70 msgr2=0x7fcf780c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf77fff700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf780cbc70 0x7fcf780c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf77fff700 1 -- 172.21.15.84:0/157422509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf78159480 msgr2=0x7fcf78154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf77fff700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf78159480 0x7fcf78154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf77fff700 1 -- 172.21.15.84:0/157422509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf70009a20 con 0x7fcf780b2850 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf77fff700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 0x7fcf7815f1c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800c510 tx=0x7fcf6800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf5ffff700 1 -- 172.21.15.84:0/157422509 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68011590 con 0x7fcf780b2850 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf5ffff700 1 -- 172.21.15.84:0/157422509 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf68011710 con 0x7fcf780b2850 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf5ffff700 1 -- 172.21.15.84:0/157422509 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68011ad0 con 0x7fcf780b2850 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/157422509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7815e9c0 con 0x7fcf780b2850 2023-10-06T03:24:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.498+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/157422509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7815f700 con 0x7fcf780b2850 2023-10-06T03:24:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.499+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/157422509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7815e540 con 0x7fcf780b2850 2023-10-06T03:24:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.499+0000 7fcf5ffff700 1 -- 172.21.15.84:0/157422509 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf6801b3b0 con 0x7fcf780b2850 2023-10-06T03:24:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.500+0000 7fcf5ffff700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf64066f30 0x7fcf640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.500+0000 7fcf5ffff700 1 -- 172.21.15.84:0/157422509 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fcf68083a20 con 0x7fcf780b2850 2023-10-06T03:24:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.500+0000 7fcf777fe700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf64066f30 0x7fcf640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.500+0000 7fcf777fe700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf64066f30 0x7fcf640693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c007fd0 tx=0x7fcf6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:42.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.504+0000 7fcf5ffff700 1 -- 172.21.15.84:0/157422509 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf7815e540 con 0x7fcf780b2850 2023-10-06T03:24:42.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.760+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/157422509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcf7815e540 con 0x7fcf780b2850 2023-10-06T03:24:42.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.761+0000 7fcf5ffff700 1 -- 172.21.15.84:0/157422509 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fcf7815e540 con 0x7fcf780b2850 2023-10-06T03:24:42.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:42.763 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:24:42.763 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T03:24:42.763 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.763 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T03:24:42.763 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lA8KvDxAA2irSaBc/QiMm9oI5GEK1PA==", 2023-10-06T03:24:42.763 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.763 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:24:42.763 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:24:42.763 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:24:42.764 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.764 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.764 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T03:24:42.764 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lq2TnGhAAOzV6kE1Ji9yvQGuouda9GQ==", 2023-10-06T03:24:42.764 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.764 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:24:42.764 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:24:42.764 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:24:42.765 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.765 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.765 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T03:24:42.765 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9l4w54FhAASOElKyXlWzXB7pDJV5TzVQ==", 2023-10-06T03:24:42.765 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.765 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:24:42.765 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:24:42.765 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:24:42.766 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.766 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.766 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T03:24:42.766 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lh/61IRAANVLLVFSkTIhlvAyQkmkbqQ==", 2023-10-06T03:24:42.766 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.766 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:24:42.766 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:24:42.766 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:24:42.767 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.767 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.767 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T03:24:42.767 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCVfR9lPd++MRAAikRAaM5HcwQgYYfszDoMzQ==", 2023-10-06T03:24:42.767 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.767 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:42.767 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:24:42.767 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCYfR9l3ovfLxAAkuD96aBKGZX1SQvItQjbmA==", 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCbfR9lsbQpMBAApjEhKZ3RZXIXNFPmGrp3Rg==", 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T03:24:42.769 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCefR9lOhnPMRAAinzeYJrHzI3Laz+kRo7U9w==", 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCkfR9liYL2MhAAVzzPBy1+K4n9a324eCqKSg==", 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:42.770 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCnfR9lEe8GMBAAgXFWAPLix5BkHtrqQazDqA==", 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.771 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCqfR9lcprFMBAA4/ksqag9gsivr9htt3UDBg==", 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.772 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCtfR9leIi9MBAAaco3XMawt8uFNMNRbPQAQQ==", 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lGQaGJRAALZ28ylNKJSf4AhF9KcsrBg==", 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.773 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ls6nPLRAA/94kuDcXCPlYoYcCuqwN2A==", 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:24:42.774 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lY17ZKhAAyLFVSlBM5vWr4LSl+wwWZw==", 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:24:42.775 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lPWYyMxAAmgd5iQq7RQp80iK1oBfUww==", 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:24:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRfR9loncpLhAA2cZSGjrup5zj13Xtt9k6Xw==", 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mds", 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCzfR9lrVTiIBAA94nYJjh4w8bF2XWcUG5Yeg==", 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCzfR9lEF7iIBAAByvHZEDKppMzgiKbuezhKw==", 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T03:24:42.778 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-osd", 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCzfR9lkmbiIBAAgNZ9pF/zs8rvyiLgSKDINQ==", 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCzfR9lCm/iIBAA2zYKiKOp32199ZgXTvHaKw==", 2023-10-06T03:24:42.779 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCzfR9linbiIBAAtXC23JEAXQAdA85a6bHYgg==", 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCzfR9lC37iIBAAXzc0kCoOT/mO1P/C4ygGDg==", 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ltUixDBAAQN/x3iVJcTKF7hTMehPYgQ==", 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:24:42.781 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lFqqSBhAA1km5fSJT2+QAdMBBxBWrXQ==", 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:24:42.782 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.783 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:42.783 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T03:24:42.783 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:24:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/157422509 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf64066f30 msgr2=0x7fcf640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf64066f30 0x7fcf640693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c007fd0 tx=0x7fcf6c009040 comp rx=0 tx=0).stop 2023-10-06T03:24:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/157422509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 msgr2=0x7fcf7815f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 0x7fcf7815f1c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800c510 tx=0x7fcf6800c8d0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/157422509 shutdown_connections 2023-10-06T03:24:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf64066f30 0x7fcf640693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf78159480 0x7fcf78154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b2850 0x7fcf7815f1c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 --2- 172.21.15.84:0/157422509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf780cbc70 0x7fcf780c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/157422509 >> 172.21.15.84:0/157422509 conn(0x7fcf7806ed20 msgr2=0x7fcf781569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/157422509 shutdown_connections 2023-10-06T03:24:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.763+0000 7fcf7d2e4700 1 -- 172.21.15.84:0/157422509 wait complete. 2023-10-06T03:24:42.785 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T03:24:42.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.899+0000 7f2cb2263700 1 Processor -- start 2023-10-06T03:24:42.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.899+0000 7f2cb2263700 1 -- start start 2023-10-06T03:24:42.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.899+0000 7f2cb2263700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2cac1595c0 0x7f2cac06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cb2263700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cac06e9e0 0x7f2cac0675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cb2263700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cac159990 0x7f2cac067b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cb2263700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac0cde70 con 0x7f2cac06e9e0 2023-10-06T03:24:42.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cb2263700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac06ef60 con 0x7f2cac1595c0 2023-10-06T03:24:42.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cb2263700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac06f240 con 0x7f2cac159990 2023-10-06T03:24:42.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cab7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cac06e9e0 0x7f2cac0675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cab7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cac06e9e0 0x7f2cac0675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52096/0 (socket says 172.21.15.84:52096) 2023-10-06T03:24:42.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cab7fe700 1 -- 172.21.15.84:0/4237991422 learned_addr learned my addr 172.21.15.84:0/4237991422 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:42.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cb0800700 1 --2- 172.21.15.84:0/4237991422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cac159990 0x7f2cac067b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cabfff700 1 --2- 172.21.15.84:0/4237991422 >> v2:172.21.15.131:3300/0 conn(0x7f2cac1595c0 0x7f2cac06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cab7fe700 1 -- 172.21.15.84:0/4237991422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cac159990 msgr2=0x7f2cac067b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:42.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cab7fe700 1 --2- 172.21.15.84:0/4237991422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cac159990 0x7f2cac067b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cab7fe700 1 -- 172.21.15.84:0/4237991422 >> v2:172.21.15.131:3300/0 conn(0x7f2cac1595c0 msgr2=0x7f2cac06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:42.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cab7fe700 1 --2- 172.21.15.84:0/4237991422 >> v2:172.21.15.131:3300/0 conn(0x7f2cac1595c0 0x7f2cac06e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cab7fe700 1 -- 172.21.15.84:0/4237991422 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac0b0190 con 0x7f2cac06e9e0 2023-10-06T03:24:42.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cabfff700 1 --2- 172.21.15.84:0/4237991422 >> v2:172.21.15.131:3300/0 conn(0x7f2cac1595c0 0x7f2cac06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:42.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2cab7fe700 1 --2- 172.21.15.84:0/4237991422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 0x7f2cac0675f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2cac070610 tx=0x7f2ca0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115376b6b7e007ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:42.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2caaffd700 1 -- 172.21.15.84:0/4237991422 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000b860 con 0x7f2cac06e9e0 2023-10-06T03:24:42.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2caaffd700 1 -- 172.21.15.84:0/4237991422 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca000b9c0 con 0x7f2cac06e9e0 2023-10-06T03:24:42.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.900+0000 7f2caaffd700 1 -- 172.21.15.84:0/4237991422 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000bd60 con 0x7f2cac06e9e0 2023-10-06T03:24:42.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.901+0000 7f2cb2263700 1 -- 172.21.15.84:0/4237991422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 msgr2=0x7f2cac0675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.901+0000 7f2cb2263700 1 --2- 172.21.15.84:0/4237991422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 0x7f2cac0675f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2cac070610 tx=0x7f2ca0009250 comp rx=0 tx=0).stop 2023-10-06T03:24:42.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.901+0000 7f2cb2263700 1 -- 172.21.15.84:0/4237991422 shutdown_connections 2023-10-06T03:24:42.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.901+0000 7f2cb2263700 1 --2- 172.21.15.84:0/4237991422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cac159990 0x7f2cac067b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.901+0000 7f2cb2263700 1 --2- 172.21.15.84:0/4237991422 >> v2:172.21.15.131:3300/0 conn(0x7f2cac1595c0 0x7f2cac06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.901+0000 7f2cb2263700 1 --2- 172.21.15.84:0/4237991422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 0x7f2cac0675f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.901+0000 7f2cb2263700 1 -- 172.21.15.84:0/4237991422 >> 172.21.15.84:0/4237991422 conn(0x7f2cac069180 msgr2=0x7f2cac0cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:42.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.901+0000 7f2cb2263700 1 -- 172.21.15.84:0/4237991422 shutdown_connections 2023-10-06T03:24:42.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.901+0000 7f2cb2263700 1 -- 172.21.15.84:0/4237991422 wait complete. 2023-10-06T03:24:42.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.902+0000 7f2cb2263700 1 Processor -- start 2023-10-06T03:24:42.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.902+0000 7f2cb2263700 1 -- start start 2023-10-06T03:24:42.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cb2263700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 0x7f2cac16d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cb2263700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cac1595c0 0x7f2cac16dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cb2263700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cac159990 0x7f2cac15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cb2263700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0c3af0 con 0x7f2cac06e9e0 2023-10-06T03:24:42.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cb2263700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0c5e70 con 0x7f2cac159990 2023-10-06T03:24:42.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cb2263700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0c6150 con 0x7f2cac1595c0 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cabfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 0x7f2cac16d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cabfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 0x7f2cac16d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52100/0 (socket says 172.21.15.84:52100) 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cabfff700 1 -- 172.21.15.84:0/1317011055 learned_addr learned my addr 172.21.15.84:0/1317011055 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cabfff700 1 -- 172.21.15.84:0/1317011055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cac1595c0 msgr2=0x7f2cac16dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cabfff700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cac1595c0 0x7f2cac16dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cabfff700 1 -- 172.21.15.84:0/1317011055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cac159990 msgr2=0x7f2cac15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cabfff700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cac159990 0x7f2cac15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.903+0000 7f2cabfff700 1 -- 172.21.15.84:0/1317011055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00094f0 con 0x7f2cac06e9e0 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.904+0000 7f2cabfff700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 0x7f2cac16d690 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00c830 tx=0x7f2c9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.904+0000 7f2c93fff700 1 -- 172.21.15.84:0/1317011055 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c011600 con 0x7f2cac06e9e0 2023-10-06T03:24:42.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.904+0000 7f2c93fff700 1 -- 172.21.15.84:0/1317011055 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c011760 con 0x7f2cac06e9e0 2023-10-06T03:24:42.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.904+0000 7f2cb2263700 1 -- 172.21.15.84:0/1317011055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac0c6430 con 0x7f2cac06e9e0 2023-10-06T03:24:42.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.904+0000 7f2c93fff700 1 -- 172.21.15.84:0/1317011055 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c011b20 con 0x7f2cac06e9e0 2023-10-06T03:24:42.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.904+0000 7f2cb2263700 1 -- 172.21.15.84:0/1317011055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac0c3720 con 0x7f2cac06e9e0 2023-10-06T03:24:42.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.905+0000 7f2cb2263700 1 -- 172.21.15.84:0/1317011055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac0c5ce0 con 0x7f2cac06e9e0 2023-10-06T03:24:42.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.905+0000 7f2c93fff700 1 -- 172.21.15.84:0/1317011055 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c9c00a3e0 con 0x7f2cac06e9e0 2023-10-06T03:24:42.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.905+0000 7f2c93fff700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2c98066f30 0x7f2c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.906+0000 7f2c93fff700 1 -- 172.21.15.84:0/1317011055 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2c9c084940 con 0x7f2cac06e9e0 2023-10-06T03:24:42.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.906+0000 7f2cab7fe700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2c98066f30 0x7f2c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.906+0000 7f2cab7fe700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2c98066f30 0x7f2c980693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2cac070610 tx=0x7f2ca0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:42.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:42.910+0000 7f2c93fff700 1 -- 172.21.15.84:0/1317011055 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c9c051c60 con 0x7f2cac06e9e0 2023-10-06T03:24:43.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.166+0000 7f2cb2263700 1 -- 172.21.15.84:0/1317011055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2cac064ad0 con 0x7f2cac06e9e0 2023-10-06T03:24:43.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.169+0000 7f2c93fff700 1 -- 172.21.15.84:0/1317011055 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2c9c0150a0 con 0x7f2cac06e9e0 2023-10-06T03:24:43.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 -- 172.21.15.84:0/1317011055 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2c98066f30 msgr2=0x7f2c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2c98066f30 0x7f2c980693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2cac070610 tx=0x7f2ca0017000 comp rx=0 tx=0).stop 2023-10-06T03:24:43.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 -- 172.21.15.84:0/1317011055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 msgr2=0x7f2cac16d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 0x7f2cac16d690 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00c830 tx=0x7f2c9c008040 comp rx=0 tx=0).stop 2023-10-06T03:24:43.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 -- 172.21.15.84:0/1317011055 shutdown_connections 2023-10-06T03:24:43.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2c98066f30 0x7f2c980693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cac159990 0x7f2cac15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06e9e0 0x7f2cac16d690 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 --2- 172.21.15.84:0/1317011055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cac1595c0 0x7f2cac16dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 -- 172.21.15.84:0/1317011055 >> 172.21.15.84:0/1317011055 conn(0x7f2cac069180 msgr2=0x7f2cac157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 -- 172.21.15.84:0/1317011055 shutdown_connections 2023-10-06T03:24:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.171+0000 7f2cb2263700 1 -- 172.21.15.84:0/1317011055 wait complete. 2023-10-06T03:24:43.184 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T03:24:43.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.297+0000 7fbc8a6cd700 1 Processor -- start 2023-10-06T03:24:43.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.297+0000 7fbc8a6cd700 1 -- start start 2023-10-06T03:24:43.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc8a6cd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc841595a0 0x7fbc840aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc8a6cd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbc840b07a0 0x7fbc840b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc8a6cd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc840b0ca0 con 0x7fbc840b49e0 2023-10-06T03:24:43.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc8a6cd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc840b0f80 con 0x7fbc840b07a0 2023-10-06T03:24:43.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc8a6cd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840b1260 con 0x7fbc841595a0 2023-10-06T03:24:43.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc837fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbc840b49e0 0x7fbc840aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40266/0 (socket says 172.21.15.84:40266) 2023-10-06T03:24:43.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc837fe700 1 -- 172.21.15.84:0/1795347904 learned_addr learned my addr 172.21.15.84:0/1795347904 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:43.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc83fff700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc841595a0 0x7fbc840aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc88c6a700 1 --2- 172.21.15.84:0/1795347904 >> v2:172.21.15.131:3300/0 conn(0x7fbc840b07a0 0x7fbc840b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039789452 0 0) 0x7fbc840b0ca0 con 0x7fbc840b49e0 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.298+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc6c003570 con 0x7fbc840b49e0 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 93454997 0 0) 0x7fbc6c003570 con 0x7fbc840b49e0 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc841595a0 msgr2=0x7fbc840aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc841595a0 0x7fbc840aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 >> v2:172.21.15.131:3300/0 conn(0x7fbc840b07a0 msgr2=0x7fbc840b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 --2- 172.21.15.84:0/1795347904 >> v2:172.21.15.131:3300/0 conn(0x7fbc840b07a0 0x7fbc840b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc840b1540 con 0x7fbc840b49e0 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fbc78001470 con 0x7fbc840b49e0 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 >> v1:172.21.15.84:6789/0 conn(0x7fbc840b49e0 legacy=0x7fbc840aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc841595a0 0x7fbc6c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc6c003fe0 0x7fbc6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c004d50 0x7fbc6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840b0f80 con 0x7fbc6c004d50 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840b1260 con 0x7fbc6c003fe0 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c00ba90 con 0x7fbc841595a0 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc88c6a700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c004d50 0x7fbc6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc83fff700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc841595a0 0x7fbc6c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc837fe700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc6c003fe0 0x7fbc6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc88c6a700 1 -- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc841595a0 msgr2=0x7fbc6c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc88c6a700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc841595a0 0x7fbc6c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc88c6a700 1 -- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc6c003fe0 msgr2=0x7fbc6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:43.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc88c6a700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc6c003fe0 0x7fbc6c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc88c6a700 1 -- 172.21.15.84:0/1795347904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c003570 con 0x7fbc6c004d50 2023-10-06T03:24:43.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc88c6a700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c004d50 0x7fbc6c0051c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00e210 tx=0x7fbc7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3a41ec7695d4cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:43.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.299+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00ea60 con 0x7fbc6c004d50 2023-10-06T03:24:43.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.300+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c00f040 con 0x7fbc6c004d50 2023-10-06T03:24:43.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.300+0000 7fbc82ffd700 1 -- 172.21.15.84:0/1795347904 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00ee10 con 0x7fbc6c004d50 2023-10-06T03:24:43.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.300+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/1795347904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c004d50 msgr2=0x7fbc6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.300+0000 7fbc8a6cd700 1 --2- 172.21.15.84:0/1795347904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c004d50 0x7fbc6c0051c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00e210 tx=0x7fbc7c00b040 comp rx=0 tx=0).stop 2023-10-06T03:24:43.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.300+0000 7fbc88c6a700 1 -- 172.21.15.84:0/1795347904 reap_dead start 2023-10-06T03:24:43.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.300+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/1795347904 shutdown_connections 2023-10-06T03:24:43.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.300+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/1795347904 >> 172.21.15.84:0/1795347904 conn(0x7fbc84099830 msgr2=0x7fbc8406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:43.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.300+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/1795347904 shutdown_connections 2023-10-06T03:24:43.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.300+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/1795347904 wait complete. 2023-10-06T03:24:43.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.301+0000 7fbc8a6cd700 1 Processor -- start 2023-10-06T03:24:43.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.301+0000 7fbc8a6cd700 1 -- start start 2023-10-06T03:24:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc8a6cd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc8416c800 0x7fbc84169a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc8a6cd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc840c5270 0x7fbc8415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc8a6cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc840c56e0 0x7fbc8415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc8a6cd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8409b5e0 con 0x7fbc840c56e0 2023-10-06T03:24:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc8a6cd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8416cfb0 con 0x7fbc8416c800 2023-10-06T03:24:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc8a6cd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8416d290 con 0x7fbc840c5270 2023-10-06T03:24:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc88c6a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc840c56e0 0x7fbc8415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc88c6a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc840c56e0 0x7fbc8415dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52118/0 (socket says 172.21.15.84:52118) 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc88c6a700 1 -- 172.21.15.84:0/2024834285 learned_addr learned my addr 172.21.15.84:0/2024834285 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc83fff700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc8416c800 0x7fbc84169a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc837fe700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc840c5270 0x7fbc8415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc88c6a700 1 -- 172.21.15.84:0/2024834285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc840c5270 msgr2=0x7fbc8415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc88c6a700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc840c5270 0x7fbc8415d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc88c6a700 1 -- 172.21.15.84:0/2024834285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc8416c800 msgr2=0x7fbc84169a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc88c6a700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc8416c800 0x7fbc84169a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc88c6a700 1 -- 172.21.15.84:0/2024834285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8416d570 con 0x7fbc840c56e0 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.302+0000 7fbc88c6a700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc840c56e0 0x7fbc8415dc00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00afd0 tx=0x7fbc7c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.303+0000 7fbc6bfff700 1 -- 172.21.15.84:0/2024834285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00eee0 con 0x7fbc840c56e0 2023-10-06T03:24:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.303+0000 7fbc6bfff700 1 -- 172.21.15.84:0/2024834285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c022070 con 0x7fbc840c56e0 2023-10-06T03:24:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.303+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/2024834285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8416d850 con 0x7fbc840c56e0 2023-10-06T03:24:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.303+0000 7fbc6bfff700 1 -- 172.21.15.84:0/2024834285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c01e890 con 0x7fbc840c56e0 2023-10-06T03:24:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.303+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/2024834285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8416cbd0 con 0x7fbc840c56e0 2023-10-06T03:24:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.304+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/2024834285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc84064ad0 con 0x7fbc840c56e0 2023-10-06T03:24:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.304+0000 7fbc6bfff700 1 -- 172.21.15.84:0/2024834285 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc7c003040 con 0x7fbc840c56e0 2023-10-06T03:24:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.304+0000 7fbc6bfff700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc70066f30 0x7fbc700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.304+0000 7fbc6bfff700 1 -- 172.21.15.84:0/2024834285 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fbc7c024070 con 0x7fbc840c56e0 2023-10-06T03:24:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.304+0000 7fbc83fff700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc70066f30 0x7fbc700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.305+0000 7fbc83fff700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc70066f30 0x7fbc700693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc74006ea0 tx=0x7fbc74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:43.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.308+0000 7fbc6bfff700 1 -- 172.21.15.84:0/2024834285 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc7c0533f0 con 0x7fbc840c56e0 2023-10-06T03:24:43.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.565+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/2024834285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fbc840b1820 con 0x7fbc840c56e0 2023-10-06T03:24:43.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.569+0000 7fbc6bfff700 1 -- 172.21.15.84:0/2024834285 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbc7c056a10 con 0x7fbc840c56e0 2023-10-06T03:24:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/2024834285 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc70066f30 msgr2=0x7fbc700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc70066f30 0x7fbc700693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc74006ea0 tx=0x7fbc74008040 comp rx=0 tx=0).stop 2023-10-06T03:24:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/2024834285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc840c56e0 msgr2=0x7fbc8415dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc840c56e0 0x7fbc8415dc00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00afd0 tx=0x7fbc7c01a000 comp rx=0 tx=0).stop 2023-10-06T03:24:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/2024834285 shutdown_connections 2023-10-06T03:24:43.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc70066f30 0x7fbc700693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc8416c800 0x7fbc84169a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc840c56e0 0x7fbc8415dc00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 --2- 172.21.15.84:0/2024834285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc840c5270 0x7fbc8415d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/2024834285 >> 172.21.15.84:0/2024834285 conn(0x7fbc84099830 msgr2=0x7fbc840b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:43.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/2024834285 shutdown_connections 2023-10-06T03:24:43.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.571+0000 7fbc8a6cd700 1 -- 172.21.15.84:0/2024834285 wait complete. 2023-10-06T03:24:43.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T03:24:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.698+0000 7f0950273700 1 Processor -- start 2023-10-06T03:24:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.698+0000 7f0950273700 1 -- start start 2023-10-06T03:24:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f0950273700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f09480b49e0 0x7f09480aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f0950273700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09480b07a0 0x7f09480b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f0950273700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09480b0ca0 con 0x7f09481595a0 2023-10-06T03:24:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f0950273700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09480b0f80 con 0x7f09480b49e0 2023-10-06T03:24:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f0950273700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09480b1260 con 0x7f09480b07a0 2023-10-06T03:24:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f094d80e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f09480b49e0 0x7f09480aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f094e810700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09480b07a0 0x7f09480b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f094e810700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09480b07a0 0x7f09480b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:37398/0 (socket says 172.21.15.84:37398) 2023-10-06T03:24:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f094e810700 1 -- 172.21.15.84:0/2792918566 learned_addr learned my addr 172.21.15.84:0/2792918566 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f094e00f700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f09481595a0 0x7f09480aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:57542/0 (socket says 172.21.15.84:57542) 2023-10-06T03:24:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f094e810700 1 -- 172.21.15.84:0/2792918566 >> v2:172.21.15.131:3300/0 conn(0x7f09480b49e0 msgr2=0x7f09480aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f094e810700 1 --2- 172.21.15.84:0/2792918566 >> v2:172.21.15.131:3300/0 conn(0x7f09480b49e0 0x7f09480aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f094e810700 1 -- 172.21.15.84:0/2792918566 >> v1:172.21.15.131:6789/0 conn(0x7f09481595a0 legacy=0x7f09480aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.699+0000 7f094e810700 1 -- 172.21.15.84:0/2792918566 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480b1540 con 0x7f09480b07a0 2023-10-06T03:24:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.700+0000 7f094d80e700 1 --2- 172.21.15.84:0/2792918566 >> v2:172.21.15.131:3300/0 conn(0x7f09480b49e0 0x7f09480aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.700+0000 7f094e810700 1 --2- 172.21.15.84:0/2792918566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09480b07a0 0x7f09480b1c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09380099e0 tx=0x7f0938009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a5445e73c241544 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.700+0000 7f094d00d700 1 -- 172.21.15.84:0/2792918566 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800b820 con 0x7f09480b07a0 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.700+0000 7f094d00d700 1 -- 172.21.15.84:0/2792918566 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093800b980 con 0x7f09480b07a0 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.700+0000 7f094d00d700 1 -- 172.21.15.84:0/2792918566 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800bd20 con 0x7f09480b07a0 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.700+0000 7f0950273700 1 -- 172.21.15.84:0/2792918566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09480b07a0 msgr2=0x7f09480b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.700+0000 7f0950273700 1 --2- 172.21.15.84:0/2792918566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09480b07a0 0x7f09480b1c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09380099e0 tx=0x7f0938009250 comp rx=0 tx=0).stop 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.700+0000 7f0950273700 1 -- 172.21.15.84:0/2792918566 shutdown_connections 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.700+0000 7f0950273700 1 --2- 172.21.15.84:0/2792918566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09480b07a0 0x7f09480b1c00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.700+0000 7f0950273700 1 --2- 172.21.15.84:0/2792918566 >> v2:172.21.15.131:3300/0 conn(0x7f09480b49e0 0x7f09480aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.701+0000 7f0950273700 1 -- 172.21.15.84:0/2792918566 >> 172.21.15.84:0/2792918566 conn(0x7f0948099830 msgr2=0x7f094806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.701+0000 7f0950273700 1 -- 172.21.15.84:0/2792918566 shutdown_connections 2023-10-06T03:24:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.701+0000 7f0950273700 1 -- 172.21.15.84:0/2792918566 wait complete. 2023-10-06T03:24:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.702+0000 7f0950273700 1 Processor -- start 2023-10-06T03:24:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.702+0000 7f0950273700 1 -- start start 2023-10-06T03:24:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.702+0000 7f0950273700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09480b07a0 0x7f094809bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.702+0000 7f0950273700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09480b49e0 0x7f0948157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.702+0000 7f0950273700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09481595a0 0x7f0948068400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.702+0000 7f0950273700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09480ac690 con 0x7f09480b49e0 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.702+0000 7f0950273700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094809c4b0 con 0x7f09480b07a0 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.702+0000 7f0950273700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0948157890 con 0x7f09481595a0 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094d80e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09480b49e0 0x7f0948157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094d80e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09480b49e0 0x7f0948157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52132/0 (socket says 172.21.15.84:52132) 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094d80e700 1 -- 172.21.15.84:0/2419517218 learned_addr learned my addr 172.21.15.84:0/2419517218 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094e810700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09481595a0 0x7f0948068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094e00f700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09480b07a0 0x7f094809bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094d80e700 1 -- 172.21.15.84:0/2419517218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09481595a0 msgr2=0x7f0948068400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094d80e700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09481595a0 0x7f0948068400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094d80e700 1 -- 172.21.15.84:0/2419517218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09480b07a0 msgr2=0x7f094809bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094d80e700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09480b07a0 0x7f094809bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094d80e700 1 -- 172.21.15.84:0/2419517218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c009420 con 0x7f09480b49e0 2023-10-06T03:24:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f094d80e700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09480b49e0 0x7f0948157350 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f093c00ecb0 tx=0x7f093c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f09467fc700 1 -- 172.21.15.84:0/2419517218 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00c9d0 con 0x7f09480b49e0 2023-10-06T03:24:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f09467fc700 1 -- 172.21.15.84:0/2419517218 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c00cb30 con 0x7f09480b49e0 2023-10-06T03:24:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f09467fc700 1 -- 172.21.15.84:0/2419517218 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00ceb0 con 0x7f09480b49e0 2023-10-06T03:24:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f0950273700 1 -- 172.21.15.84:0/2419517218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09380094f0 con 0x7f09480b49e0 2023-10-06T03:24:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.703+0000 7f0950273700 1 -- 172.21.15.84:0/2419517218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09480ae160 con 0x7f09480b49e0 2023-10-06T03:24:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.704+0000 7f0950273700 1 -- 172.21.15.84:0/2419517218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0948064ad0 con 0x7f09480b49e0 2023-10-06T03:24:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.705+0000 7f09467fc700 1 -- 172.21.15.84:0/2419517218 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f093c013680 con 0x7f09480b49e0 2023-10-06T03:24:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.705+0000 7f09467fc700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0934066f30 0x7f09340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.705+0000 7f09467fc700 1 -- 172.21.15.84:0/2419517218 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f093c084c40 con 0x7f09480b49e0 2023-10-06T03:24:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.705+0000 7f094e00f700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0934066f30 0x7f09340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.705+0000 7f094e00f700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0934066f30 0x7f09340693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0940007120 tx=0x7f09400018a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:43.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.709+0000 7f09467fc700 1 -- 172.21.15.84:0/2419517218 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f093c0559f0 con 0x7f09480b49e0 2023-10-06T03:24:43.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.963+0000 7f0950273700 1 -- 172.21.15.84:0/2419517218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f09480b1820 con 0x7f09480b49e0 2023-10-06T03:24:43.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.967+0000 7f09467fc700 1 -- 172.21.15.84:0/2419517218 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f093c055580 con 0x7f09480b49e0 2023-10-06T03:24:43.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 -- 172.21.15.84:0/2419517218 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0934066f30 msgr2=0x7f09340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0934066f30 0x7f09340693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0940007120 tx=0x7f09400018a0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 -- 172.21.15.84:0/2419517218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09480b49e0 msgr2=0x7f0948157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09480b49e0 0x7f0948157350 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f093c00ecb0 tx=0x7f093c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 -- 172.21.15.84:0/2419517218 shutdown_connections 2023-10-06T03:24:43.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0934066f30 0x7f09340693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09480b07a0 0x7f094809bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09481595a0 0x7f0948068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 --2- 172.21.15.84:0/2419517218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09480b49e0 0x7f0948157350 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 -- 172.21.15.84:0/2419517218 >> 172.21.15.84:0/2419517218 conn(0x7f0948099830 msgr2=0x7f0948158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 -- 172.21.15.84:0/2419517218 shutdown_connections 2023-10-06T03:24:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:43.969+0000 7f0950273700 1 -- 172.21.15.84:0/2419517218 wait complete. 2023-10-06T03:24:43.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T03:24:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.096+0000 7f3bc7fff700 1 Processor -- start 2023-10-06T03:24:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.096+0000 7f3bc7fff700 1 -- start start 2023-10-06T03:24:44.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.097+0000 7f3bc7fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3bc80c6060 0x7f3bc80ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.097+0000 7f3bc7fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc80ae250 con 0x7f3bc8159950 2023-10-06T03:24:44.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.097+0000 7f3bc7fff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc80ad640 con 0x7f3bc8159580 2023-10-06T03:24:44.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.097+0000 7f3bc7fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc80ad920 con 0x7f3bc80c6060 2023-10-06T03:24:44.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.097+0000 7f3bc67fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3bc8159950 0x7f3bc80ae6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40282/0 (socket says 172.21.15.84:40282) 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.097+0000 7f3bc67fc700 1 -- 172.21.15.84:0/474909054 learned_addr learned my addr 172.21.15.84:0/474909054 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc77fe700 1 --2- 172.21.15.84:0/474909054 >> v2:172.21.15.131:3300/0 conn(0x7f3bc80c6060 0x7f3bc80ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348859586 0 0) 0x7f3bc80ae250 con 0x7f3bc8159950 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb0003570 con 0x7f3bc8159950 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 692571292 0 0) 0x7f3bb0003570 con 0x7f3bc8159950 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 >> v2:172.21.15.131:3300/0 conn(0x7f3bc80c6060 msgr2=0x7f3bc80ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 --2- 172.21.15.84:0/474909054 >> v2:172.21.15.131:3300/0 conn(0x7f3bc80c6060 0x7f3bc80ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 >> v1:172.21.15.131:6789/0 conn(0x7f3bc8159580 legacy=0x7f3bc80ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80adc00 con 0x7f3bc8159950 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f3bbc001470 con 0x7f3bc8159950 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc77fe700 1 --2- 172.21.15.84:0/474909054 >> v2:172.21.15.131:3300/0 conn(0x7f3bc80c6060 0x7f3bc80ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 >> v1:172.21.15.84:6789/0 conn(0x7f3bc8159950 legacy=0x7f3bc80ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb0003a60 0x7f3bb0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb0004810 0x7f3bb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb00052e0 0x7f3bb000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80ad920 con 0x7f3bb0004810 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb000c2a0 con 0x7f3bb0003a60 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb000c460 con 0x7f3bb00052e0 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc67fc700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb0004810 0x7f3bb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc6ffd700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb0003a60 0x7f3bb0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc77fe700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb00052e0 0x7f3bb000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc67fc700 1 -- 172.21.15.84:0/474909054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb00052e0 msgr2=0x7f3bb000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc67fc700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb00052e0 0x7f3bb000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc67fc700 1 -- 172.21.15.84:0/474909054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb0003a60 msgr2=0x7f3bb0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc67fc700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb0003a60 0x7f3bb0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc67fc700 1 -- 172.21.15.84:0/474909054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0003570 con 0x7f3bb0004810 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc6ffd700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb0003a60 0x7f3bb0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.098+0000 7f3bc77fe700 1 -- 172.21.15.84:0/474909054 reap_dead start 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc67fc700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb0004810 0x7f3bb0004c80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00c3c0 tx=0x7f3bbc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca2313b66177290 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00cc90 con 0x7f3bb0004810 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00cdf0 con 0x7f3bb0004810 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc5ffb700 1 -- 172.21.15.84:0/474909054 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc005b50 con 0x7f3bb0004810 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc7fff700 1 -- 172.21.15.84:0/474909054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb0004810 msgr2=0x7f3bb0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc7fff700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb0004810 0x7f3bb0004c80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00c3c0 tx=0x7f3bbc001e50 comp rx=0 tx=0).stop 2023-10-06T03:24:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc7fff700 1 -- 172.21.15.84:0/474909054 shutdown_connections 2023-10-06T03:24:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc7fff700 1 --2- 172.21.15.84:0/474909054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb0004810 0x7f3bb0004c80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc7fff700 1 -- 172.21.15.84:0/474909054 >> 172.21.15.84:0/474909054 conn(0x7f3bc8099560 msgr2=0x7f3bc806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc7fff700 1 -- 172.21.15.84:0/474909054 shutdown_connections 2023-10-06T03:24:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.099+0000 7f3bc7fff700 1 -- 172.21.15.84:0/474909054 wait complete. 2023-10-06T03:24:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.100+0000 7f3bc7fff700 1 Processor -- start 2023-10-06T03:24:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc7fff700 1 -- start start 2023-10-06T03:24:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb0004810 0x7f3bc8158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bc80afbe0 0x7f3bc80b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc80c7d10 0x7f3bc80c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc7fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc81585b0 con 0x7f3bc80afbe0 2023-10-06T03:24:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc7fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc815c720 con 0x7f3bb0004810 2023-10-06T03:24:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc7fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80c86c0 con 0x7f3bc80c7d10 2023-10-06T03:24:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bc80afbe0 0x7f3bc80b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bc80afbe0 0x7f3bc80b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52152/0 (socket says 172.21.15.84:52152) 2023-10-06T03:24:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc67fc700 1 -- 172.21.15.84:0/1528511234 learned_addr learned my addr 172.21.15.84:0/1528511234 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc6ffd700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb0004810 0x7f3bc8158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.101+0000 7f3bc77fe700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc80c7d10 0x7f3bc80c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3bc67fc700 1 -- 172.21.15.84:0/1528511234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc80c7d10 msgr2=0x7f3bc80c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3bc67fc700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc80c7d10 0x7f3bc80c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3bc67fc700 1 -- 172.21.15.84:0/1528511234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb0004810 msgr2=0x7f3bc8158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3bc67fc700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb0004810 0x7f3bc8158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3bc67fc700 1 -- 172.21.15.84:0/1528511234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc815aaa0 con 0x7f3bc80afbe0 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3bc67fc700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bc80afbe0 0x7f3bc80b0050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000c270 tx=0x7f3bbc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3baeffd700 1 -- 172.21.15.84:0/1528511234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00cc90 con 0x7f3bc80afbe0 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3baeffd700 1 -- 172.21.15.84:0/1528511234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc001430 con 0x7f3bc80afbe0 2023-10-06T03:24:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3bc7fff700 1 -- 172.21.15.84:0/1528511234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc8159e90 con 0x7f3bc80afbe0 2023-10-06T03:24:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3baeffd700 1 -- 172.21.15.84:0/1528511234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc0072e0 con 0x7f3bc80afbe0 2023-10-06T03:24:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.102+0000 7f3bc7fff700 1 -- 172.21.15.84:0/1528511234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc815a450 con 0x7f3bc80afbe0 2023-10-06T03:24:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.103+0000 7f3bc7fff700 1 -- 172.21.15.84:0/1528511234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc815ac30 con 0x7f3bc80afbe0 2023-10-06T03:24:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.103+0000 7f3baeffd700 1 -- 172.21.15.84:0/1528511234 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bbc0076d0 con 0x7f3bc80afbe0 2023-10-06T03:24:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.104+0000 7f3baeffd700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3bb4066f30 0x7f3bb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.104+0000 7f3baeffd700 1 -- 172.21.15.84:0/1528511234 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f3bbc0859a0 con 0x7f3bc80afbe0 2023-10-06T03:24:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.104+0000 7f3bc6ffd700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3bb4066f30 0x7f3bb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.104+0000 7f3bc6ffd700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3bb4066f30 0x7f3bb40693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8000f80 tx=0x7f3bb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.108+0000 7f3baeffd700 1 -- 172.21.15.84:0/1528511234 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bbc052d70 con 0x7f3bc80afbe0 2023-10-06T03:24:44.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.370+0000 7f3bc7fff700 1 -- 172.21.15.84:0/1528511234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3bc805f270 con 0x7f3bc80afbe0 2023-10-06T03:24:44.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.373+0000 7f3baeffd700 1 -- 172.21.15.84:0/1528511234 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3bbc017020 con 0x7f3bc80afbe0 2023-10-06T03:24:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 -- 172.21.15.84:0/1528511234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3bb4066f30 msgr2=0x7f3bb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3bb4066f30 0x7f3bb40693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8000f80 tx=0x7f3bb8009040 comp rx=0 tx=0).stop 2023-10-06T03:24:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 -- 172.21.15.84:0/1528511234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bc80afbe0 msgr2=0x7f3bc80b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bc80afbe0 0x7f3bc80b0050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000c270 tx=0x7f3bbc015000 comp rx=0 tx=0).stop 2023-10-06T03:24:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 -- 172.21.15.84:0/1528511234 shutdown_connections 2023-10-06T03:24:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3bb4066f30 0x7f3bb40693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb0004810 0x7f3bc8158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc80c7d10 0x7f3bc80c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 --2- 172.21.15.84:0/1528511234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bc80afbe0 0x7f3bc80b0050 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 -- 172.21.15.84:0/1528511234 >> 172.21.15.84:0/1528511234 conn(0x7f3bc8099560 msgr2=0x7f3bc80699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:44.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 -- 172.21.15.84:0/1528511234 shutdown_connections 2023-10-06T03:24:44.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.375+0000 7f3bc7fff700 1 -- 172.21.15.84:0/1528511234 wait complete. 2023-10-06T03:24:44.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T03:24:44.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.502+0000 7fbcf219d700 1 Processor -- start 2023-10-06T03:24:44.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.502+0000 7fbcf219d700 1 -- start start 2023-10-06T03:24:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbcf219d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec0ad360 0x7fbcec0ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbcf219d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbcec0ad730 0x7fbcec068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbcf219d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec159f80 con 0x7fbcec068b40 2023-10-06T03:24:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbcf219d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcec068fc0 con 0x7fbcec0ad730 2023-10-06T03:24:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbcf219d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec15a260 con 0x7fbcec0ad360 2023-10-06T03:24:44.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbceaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbcec0ad730 0x7fbcec068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbceaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbcec0ad730 0x7fbcec068600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52168/0 (socket says 172.21.15.84:52168) 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbceaffd700 1 -- 172.21.15.84:0/1209879461 learned_addr learned my addr 172.21.15.84:0/1209879461 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbceb7fe700 1 --2- 172.21.15.84:0/1209879461 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec0ad360 0x7fbcec0ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbceaffd700 1 -- 172.21.15.84:0/1209879461 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec0ad360 msgr2=0x7fbcec0ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbceaffd700 1 --2- 172.21.15.84:0/1209879461 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec0ad360 0x7fbcec0ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbceaffd700 1 -- 172.21.15.84:0/1209879461 >> v1:172.21.15.131:6789/0 conn(0x7fbcec068b40 legacy=0x7fbcec15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbceaffd700 1 -- 172.21.15.84:0/1209879461 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec15a540 con 0x7fbcec0ad730 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbceaffd700 1 --2- 172.21.15.84:0/1209879461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 0x7fbcec068600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbce00099b0 tx=0x7fbce0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766b4c7fa32b1d11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.503+0000 7fbcea7fc700 1 -- 172.21.15.84:0/1209879461 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce000b820 con 0x7fbcec0ad730 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.504+0000 7fbcea7fc700 1 -- 172.21.15.84:0/1209879461 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce000b980 con 0x7fbcec0ad730 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.504+0000 7fbcea7fc700 1 -- 172.21.15.84:0/1209879461 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce000bd20 con 0x7fbcec0ad730 2023-10-06T03:24:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.504+0000 7fbcf219d700 1 -- 172.21.15.84:0/1209879461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 msgr2=0x7fbcec068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.504+0000 7fbcf219d700 1 --2- 172.21.15.84:0/1209879461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 0x7fbcec068600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbce00099b0 tx=0x7fbce0009250 comp rx=0 tx=0).stop 2023-10-06T03:24:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.504+0000 7fbcf219d700 1 -- 172.21.15.84:0/1209879461 shutdown_connections 2023-10-06T03:24:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.504+0000 7fbcf219d700 1 --2- 172.21.15.84:0/1209879461 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec0ad360 0x7fbcec0ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.504+0000 7fbcf219d700 1 --2- 172.21.15.84:0/1209879461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 0x7fbcec068600 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.504+0000 7fbcf219d700 1 -- 172.21.15.84:0/1209879461 >> 172.21.15.84:0/1209879461 conn(0x7fbcec06dd10 msgr2=0x7fbcec06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.504+0000 7fbcf219d700 1 -- 172.21.15.84:0/1209879461 shutdown_connections 2023-10-06T03:24:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.504+0000 7fbcf219d700 1 -- 172.21.15.84:0/1209879461 wait complete. 2023-10-06T03:24:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.505+0000 7fbcf219d700 1 Processor -- start 2023-10-06T03:24:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.505+0000 7fbcf219d700 1 -- start start 2023-10-06T03:24:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcf219d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec068b40 0x7fbcec15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcf219d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec0ad360 0x7fbcec15bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcf219d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 0x7fbcec16a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcf219d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec15d0e0 con 0x7fbcec0ad730 2023-10-06T03:24:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcf219d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec15d910 con 0x7fbcec068b40 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcf219d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec16ae70 con 0x7fbcec0ad360 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcebfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 0x7fbcec16a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcebfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 0x7fbcec16a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52184/0 (socket says 172.21.15.84:52184) 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcebfff700 1 -- 172.21.15.84:0/2936863491 learned_addr learned my addr 172.21.15.84:0/2936863491 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbceaffd700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec0ad360 0x7fbcec15bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbceb7fe700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec068b40 0x7fbcec15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcebfff700 1 -- 172.21.15.84:0/2936863491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec0ad360 msgr2=0x7fbcec15bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcebfff700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec0ad360 0x7fbcec15bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcebfff700 1 -- 172.21.15.84:0/2936863491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec068b40 msgr2=0x7fbcec15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcebfff700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec068b40 0x7fbcec15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.506+0000 7fbcebfff700 1 -- 172.21.15.84:0/2936863491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce00094f0 con 0x7fbcec0ad730 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.507+0000 7fbceb7fe700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec068b40 0x7fbcec15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.507+0000 7fbcebfff700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 0x7fbcec16a070 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbce400c5b0 tx=0x7fbce4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.507+0000 7fbcd37fe700 1 -- 172.21.15.84:0/2936863491 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4011590 con 0x7fbcec0ad730 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.507+0000 7fbcd37fe700 1 -- 172.21.15.84:0/2936863491 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce4011710 con 0x7fbcec0ad730 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.507+0000 7fbcd37fe700 1 -- 172.21.15.84:0/2936863491 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4011ad0 con 0x7fbcec0ad730 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.507+0000 7fbcf219d700 1 -- 172.21.15.84:0/2936863491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec15d2c0 con 0x7fbcec0ad730 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.507+0000 7fbcf219d700 1 -- 172.21.15.84:0/2936863491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcec0c4660 con 0x7fbcec0ad730 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.508+0000 7fbcf219d700 1 -- 172.21.15.84:0/2936863491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcec15daa0 con 0x7fbcec0ad730 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.508+0000 7fbcd37fe700 1 -- 172.21.15.84:0/2936863491 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbce401c460 con 0x7fbcec0ad730 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.508+0000 7fbcd37fe700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbcd8066f30 0x7fbcd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.509+0000 7fbcd37fe700 1 -- 172.21.15.84:0/2936863491 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fbce40840f0 con 0x7fbcec0ad730 2023-10-06T03:24:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.509+0000 7fbceb7fe700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbcd8066f30 0x7fbcd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.509+0000 7fbceb7fe700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbcd8066f30 0x7fbcd80693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbcec15c390 tx=0x7fbcdc009800 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.513+0000 7fbcd37fe700 1 -- 172.21.15.84:0/2936863491 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbce4051410 con 0x7fbcec0ad730 2023-10-06T03:24:44.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.771+0000 7fbcf219d700 1 -- 172.21.15.84:0/2936863491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fbcec064ad0 con 0x7fbcec0ad730 2023-10-06T03:24:44.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.775+0000 7fbcd37fe700 1 -- 172.21.15.84:0/2936863491 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbce4054a30 con 0x7fbcec0ad730 2023-10-06T03:24:44.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.776+0000 7fbcf219d700 1 -- 172.21.15.84:0/2936863491 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbcd8066f30 msgr2=0x7fbcd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.776+0000 7fbcf219d700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbcd8066f30 0x7fbcd80693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbcec15c390 tx=0x7fbcdc009800 comp rx=0 tx=0).stop 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.776+0000 7fbcf219d700 1 -- 172.21.15.84:0/2936863491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 msgr2=0x7fbcec16a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.776+0000 7fbcf219d700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 0x7fbcec16a070 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbce400c5b0 tx=0x7fbce4007f60 comp rx=0 tx=0).stop 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.777+0000 7fbcf219d700 1 -- 172.21.15.84:0/2936863491 shutdown_connections 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.777+0000 7fbcf219d700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbcd8066f30 0x7fbcd80693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.777+0000 7fbcf219d700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec068b40 0x7fbcec15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.777+0000 7fbcf219d700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcec0ad730 0x7fbcec16a070 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.777+0000 7fbcf219d700 1 --2- 172.21.15.84:0/2936863491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec0ad360 0x7fbcec15bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.777+0000 7fbcf219d700 1 -- 172.21.15.84:0/2936863491 >> 172.21.15.84:0/2936863491 conn(0x7fbcec06dd10 msgr2=0x7fbcec157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.777+0000 7fbcf219d700 1 -- 172.21.15.84:0/2936863491 shutdown_connections 2023-10-06T03:24:44.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.777+0000 7fbcf219d700 1 -- 172.21.15.84:0/2936863491 wait complete. 2023-10-06T03:24:44.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T03:24:44.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.903+0000 7f8dd7fff700 1 Processor -- start 2023-10-06T03:24:44.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.903+0000 7f8dd7fff700 1 -- start start 2023-10-06T03:24:44.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dd80cbc70 0x7f8dd80cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd7fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8dd80b2140 0x7f8dd80b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd7fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd80cb7e0 con 0x7f8dd8159480 2023-10-06T03:24:44.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd7fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd80b08a0 con 0x7f8dd80cbc70 2023-10-06T03:24:44.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd7fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd80cb190 con 0x7f8dd80b2140 2023-10-06T03:24:44.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8dd8159480 0x7f8dd80b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40294/0 (socket says 172.21.15.84:40294) 2023-10-06T03:24:44.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd67fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dd80cbc70 0x7f8dd80cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd6ffd700 1 -- 172.21.15.84:0/1919513923 learned_addr learned my addr 172.21.15.84:0/1919513923 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:44.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/1919513923 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19531498 0 0) 0x7f8dd80cb7e0 con 0x7f8dd8159480 2023-10-06T03:24:44.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/1919513923 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc0003570 con 0x7f8dd8159480 2023-10-06T03:24:44.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd67fc700 1 -- 172.21.15.84:0/1919513923 >> v2:172.21.15.131:3300/0 conn(0x7f8dd80b2140 msgr2=0x7f8dd80b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:44.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd67fc700 1 --2- 172.21.15.84:0/1919513923 >> v2:172.21.15.131:3300/0 conn(0x7f8dd80b2140 0x7f8dd80b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd67fc700 1 -- 172.21.15.84:0/1919513923 >> v1:172.21.15.84:6789/0 conn(0x7f8dd8159480 legacy=0x7f8dd80b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.904+0000 7f8dd67fc700 1 -- 172.21.15.84:0/1919513923 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd80cb470 con 0x7f8dd80cbc70 2023-10-06T03:24:44.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd67fc700 1 --2- 172.21.15.84:0/1919513923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80cbc70 0x7f8dd80cc0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80ca830 tx=0x7f8dcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b47e0d56aec960 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/1919513923 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc011630 con 0x7f8dd80cbc70 2023-10-06T03:24:44.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/1919513923 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc011790 con 0x7f8dd80cbc70 2023-10-06T03:24:44.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/1919513923 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc011b10 con 0x7f8dd80cbc70 2023-10-06T03:24:44.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1919513923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80cbc70 msgr2=0x7f8dd80cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd7fff700 1 --2- 172.21.15.84:0/1919513923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80cbc70 0x7f8dd80cc0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80ca830 tx=0x7f8dcc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1919513923 shutdown_connections 2023-10-06T03:24:44.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd7fff700 1 --2- 172.21.15.84:0/1919513923 >> v2:172.21.15.131:3300/0 conn(0x7f8dd80b2140 0x7f8dd80b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd7fff700 1 --2- 172.21.15.84:0/1919513923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80cbc70 0x7f8dd80cc0c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1919513923 >> 172.21.15.84:0/1919513923 conn(0x7f8dd806ed20 msgr2=0x7f8dd806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1919513923 shutdown_connections 2023-10-06T03:24:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.905+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1919513923 wait complete. 2023-10-06T03:24:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd7fff700 1 Processor -- start 2023-10-06T03:24:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd7fff700 1 -- start start 2023-10-06T03:24:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80b2140 0x7f8dd80c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dd80cbc70 0x7f8dd8153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dd8159480 0x7f8dd80c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd7fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80b05e0 con 0x7f8dd80b2140 2023-10-06T03:24:44.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd7fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80c8180 con 0x7f8dd80cbc70 2023-10-06T03:24:44.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd7fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80b0060 con 0x7f8dd8159480 2023-10-06T03:24:44.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80b2140 0x7f8dd80c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80b2140 0x7f8dd80c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52196/0 (socket says 172.21.15.84:52196) 2023-10-06T03:24:44.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.907+0000 7f8dd6ffd700 1 -- 172.21.15.84:0/1482223240 learned_addr learned my addr 172.21.15.84:0/1482223240 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:44.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dd77fe700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dd8159480 0x7f8dd80c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dd6ffd700 1 -- 172.21.15.84:0/1482223240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dd8159480 msgr2=0x7f8dd80c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dd6ffd700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dd8159480 0x7f8dd80c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dd6ffd700 1 -- 172.21.15.84:0/1482223240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dd80cbc70 msgr2=0x7f8dd8153a00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:24:44.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dd6ffd700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dd80cbc70 0x7f8dd8153a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dd6ffd700 1 -- 172.21.15.84:0/1482223240 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc009420 con 0x7f8dd80b2140 2023-10-06T03:24:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dd77fe700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dd8159480 0x7f8dd80c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dd6ffd700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80b2140 0x7f8dd80c7c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800cc40 tx=0x7f8dc8001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dbeffd700 1 -- 172.21.15.84:0/1482223240 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800a980 con 0x7f8dd80b2140 2023-10-06T03:24:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dbeffd700 1 -- 172.21.15.84:0/1482223240 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc800aae0 con 0x7f8dd80b2140 2023-10-06T03:24:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1482223240 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd8153f40 con 0x7f8dd80b2140 2023-10-06T03:24:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dbeffd700 1 -- 172.21.15.84:0/1482223240 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800ae80 con 0x7f8dd80b2140 2023-10-06T03:24:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.908+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1482223240 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd80c7440 con 0x7f8dd80b2140 2023-10-06T03:24:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.909+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1482223240 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd805f270 con 0x7f8dd80b2140 2023-10-06T03:24:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.909+0000 7f8dbeffd700 1 -- 172.21.15.84:0/1482223240 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8dc8007300 con 0x7f8dd80b2140 2023-10-06T03:24:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.910+0000 7f8dbeffd700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dc4066f30 0x7f8dc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.910+0000 7f8dbeffd700 1 -- 172.21.15.84:0/1482223240 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8dc8084850 con 0x7f8dd80b2140 2023-10-06T03:24:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.910+0000 7f8dd67fc700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dc4066f30 0x7f8dc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.910+0000 7f8dd67fc700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dc4066f30 0x7f8dc40693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8dd816cb60 tx=0x7f8dcc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:44.914+0000 7f8dbeffd700 1 -- 172.21.15.84:0/1482223240 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8dc8051bf0 con 0x7f8dd80b2140 2023-10-06T03:24:45.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.171+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1482223240 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f8dd80cd4d0 con 0x7f8dd80b2140 2023-10-06T03:24:45.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.175+0000 7f8dbeffd700 1 -- 172.21.15.84:0/1482223240 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8dc8055210 con 0x7f8dd80b2140 2023-10-06T03:24:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1482223240 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dc4066f30 msgr2=0x7f8dc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dc4066f30 0x7f8dc40693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8dd816cb60 tx=0x7f8dcc017000 comp rx=0 tx=0).stop 2023-10-06T03:24:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1482223240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80b2140 msgr2=0x7f8dd80c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80b2140 0x7f8dd80c7c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800cc40 tx=0x7f8dc8001a60 comp rx=0 tx=0).stop 2023-10-06T03:24:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1482223240 shutdown_connections 2023-10-06T03:24:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8dc4066f30 0x7f8dc40693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dd8159480 0x7f8dd80c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dd80b2140 0x7f8dd80c7c40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 --2- 172.21.15.84:0/1482223240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dd80cbc70 0x7f8dd8153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1482223240 >> 172.21.15.84:0/1482223240 conn(0x7f8dd806ed20 msgr2=0x7f8dd80b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1482223240 shutdown_connections 2023-10-06T03:24:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.177+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1482223240 wait complete. 2023-10-06T03:24:45.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:45.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.303+0000 7fd5805bd700 1 Processor -- start 2023-10-06T03:24:45.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.303+0000 7fd5805bd700 1 -- start start 2023-10-06T03:24:45.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd5805bd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5781595a0 0x7fd5780aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd5805bd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd5780b07a0 0x7fd5780b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd5805bd700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5780b0ca0 con 0x7fd5780b49e0 2023-10-06T03:24:45.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd5805bd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5780b0f80 con 0x7fd5780b07a0 2023-10-06T03:24:45.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd5805bd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780b1260 con 0x7fd5781595a0 2023-10-06T03:24:45.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd57e359700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5781595a0 0x7fd5780aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd57e359700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5781595a0 0x7fd5780aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:37448/0 (socket says 172.21.15.84:37448) 2023-10-06T03:24:45.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd57eb5a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd5780b07a0 0x7fd5780b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd57e359700 1 -- 172.21.15.84:0/4020189899 learned_addr learned my addr 172.21.15.84:0/4020189899 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:45.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd57e359700 1 -- 172.21.15.84:0/4020189899 >> v2:172.21.15.131:3300/0 conn(0x7fd5780b07a0 msgr2=0x7fd5780b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd57e359700 1 --2- 172.21.15.84:0/4020189899 >> v2:172.21.15.131:3300/0 conn(0x7fd5780b07a0 0x7fd5780b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd57e359700 1 -- 172.21.15.84:0/4020189899 >> v1:172.21.15.131:6789/0 conn(0x7fd5780b49e0 legacy=0x7fd5780aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.304+0000 7fd57e359700 1 -- 172.21.15.84:0/4020189899 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5780b1540 con 0x7fd5781595a0 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.305+0000 7fd57e359700 1 --2- 172.21.15.84:0/4020189899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5781595a0 0x7fd5780aa570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd570009f70 tx=0x7fd570009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de1a6f4f3a9d4fcb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.305+0000 7fd57d357700 1 -- 172.21.15.84:0/4020189899 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000e070 con 0x7fd5781595a0 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.305+0000 7fd57d357700 1 -- 172.21.15.84:0/4020189899 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57000ba20 con 0x7fd5781595a0 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.305+0000 7fd57d357700 1 -- 172.21.15.84:0/4020189899 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5700092e0 con 0x7fd5781595a0 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.305+0000 7fd5805bd700 1 -- 172.21.15.84:0/4020189899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5781595a0 msgr2=0x7fd5780aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.305+0000 7fd5805bd700 1 --2- 172.21.15.84:0/4020189899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5781595a0 0x7fd5780aa570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd570009f70 tx=0x7fd570009840 comp rx=0 tx=0).stop 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.305+0000 7fd5805bd700 1 -- 172.21.15.84:0/4020189899 shutdown_connections 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.305+0000 7fd5805bd700 1 --2- 172.21.15.84:0/4020189899 >> v2:172.21.15.131:3300/0 conn(0x7fd5780b07a0 0x7fd5780b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.305+0000 7fd5805bd700 1 --2- 172.21.15.84:0/4020189899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5781595a0 0x7fd5780aa570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.305+0000 7fd5805bd700 1 -- 172.21.15.84:0/4020189899 >> 172.21.15.84:0/4020189899 conn(0x7fd578099830 msgr2=0x7fd57806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:45.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.306+0000 7fd5805bd700 1 -- 172.21.15.84:0/4020189899 shutdown_connections 2023-10-06T03:24:45.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.306+0000 7fd5805bd700 1 -- 172.21.15.84:0/4020189899 wait complete. 2023-10-06T03:24:45.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd5805bd700 1 Processor -- start 2023-10-06T03:24:45.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd5805bd700 1 -- start start 2023-10-06T03:24:45.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd5805bd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5780b07a0 0x7fd57816b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd5805bd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5780b49e0 0x7fd578159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd5805bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5781595a0 0x7fd57816d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd5805bd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57815a000 con 0x7fd5781595a0 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd5805bd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57816c620 con 0x7fd5780b07a0 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd5805bd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57816ba10 con 0x7fd5780b49e0 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd57eb5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5781595a0 0x7fd57816d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd57e359700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5780b07a0 0x7fd57816b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd57eb5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5781595a0 0x7fd57816d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52204/0 (socket says 172.21.15.84:52204) 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd57eb5a700 1 -- 172.21.15.84:0/1304498709 learned_addr learned my addr 172.21.15.84:0/1304498709 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.307+0000 7fd57db58700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5780b49e0 0x7fd578159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd57eb5a700 1 -- 172.21.15.84:0/1304498709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5780b49e0 msgr2=0x7fd578159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd57eb5a700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5780b49e0 0x7fd578159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd57eb5a700 1 -- 172.21.15.84:0/1304498709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5780b07a0 msgr2=0x7fd57816b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd57eb5a700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5780b07a0 0x7fd57816b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd57eb5a700 1 -- 172.21.15.84:0/1304498709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570009ae0 con 0x7fd5781595a0 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd57eb5a700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5781595a0 0x7fd57816d0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd56800ea50 tx=0x7fd5680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd5767fc700 1 -- 172.21.15.84:0/1304498709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56800ee90 con 0x7fd5781595a0 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd5767fc700 1 -- 172.21.15.84:0/1304498709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56800c850 con 0x7fd5781595a0 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd5805bd700 1 -- 172.21.15.84:0/1304498709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57816bcf0 con 0x7fd5781595a0 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd5767fc700 1 -- 172.21.15.84:0/1304498709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56800cc10 con 0x7fd5781595a0 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.308+0000 7fd5805bd700 1 -- 172.21.15.84:0/1304498709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57816c2b0 con 0x7fd5781595a0 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.309+0000 7fd5805bd700 1 -- 172.21.15.84:0/1304498709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57816c7b0 con 0x7fd5781595a0 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.309+0000 7fd5767fc700 1 -- 172.21.15.84:0/1304498709 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd568013470 con 0x7fd5781595a0 2023-10-06T03:24:45.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.310+0000 7fd5767fc700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd564066f30 0x7fd5640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.310+0000 7fd5767fc700 1 -- 172.21.15.84:0/1304498709 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd5680846d0 con 0x7fd5781595a0 2023-10-06T03:24:45.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.310+0000 7fd57e359700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd564066f30 0x7fd5640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.310+0000 7fd57e359700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd564066f30 0x7fd5640693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd570009880 tx=0x7fd570018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.314+0000 7fd5767fc700 1 -- 172.21.15.84:0/1304498709 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5680519f0 con 0x7fd5781595a0 2023-10-06T03:24:45.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.499+0000 7fd5805bd700 1 -- 172.21.15.84:0/1304498709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd578064ad0 con 0x7fd5781595a0 2023-10-06T03:24:45.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.500+0000 7fd5767fc700 1 -- 172.21.15.84:0/1304498709 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13855 (secure 0 0 0) 0x7fd568055010 con 0x7fd5781595a0 2023-10-06T03:24:45.502 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:45.502 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":34,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:24:42.352918+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 -- 172.21.15.84:0/1304498709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd564066f30 msgr2=0x7fd5640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd564066f30 0x7fd5640693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd570009880 tx=0x7fd570018000 comp rx=0 tx=0).stop 2023-10-06T03:24:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 -- 172.21.15.84:0/1304498709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5781595a0 msgr2=0x7fd57816d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5781595a0 0x7fd57816d0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd56800ea50 tx=0x7fd5680091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 -- 172.21.15.84:0/1304498709 shutdown_connections 2023-10-06T03:24:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd564066f30 0x7fd5640693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5780b07a0 0x7fd57816b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5781595a0 0x7fd57816d0a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 --2- 172.21.15.84:0/1304498709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5780b49e0 0x7fd578159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 -- 172.21.15.84:0/1304498709 >> 172.21.15.84:0/1304498709 conn(0x7fd578099830 msgr2=0x7fd5780b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:45.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 -- 172.21.15.84:0/1304498709 shutdown_connections 2023-10-06T03:24:45.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.502+0000 7fd5805bd700 1 -- 172.21.15.84:0/1304498709 wait complete. 2023-10-06T03:24:45.515 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:24:45.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:45.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.632+0000 7f5bfeec2700 1 Processor -- start 2023-10-06T03:24:45.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.632+0000 7f5bfeec2700 1 -- start start 2023-10-06T03:24:45.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5bfeec2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5bf8159510 0x7f5bf80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5bfeec2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bf81598e0 0x7f5bf80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5bfeec2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf80cf350 con 0x7f5bf80ce820 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5bfeec2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf80cf610 con 0x7f5bf81598e0 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5bfeec2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80cf8f0 con 0x7f5bf8159510 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5beffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bf81598e0 0x7f5bf80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5beffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bf81598e0 0x7f5bf80cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52220/0 (socket says 172.21.15.84:52220) 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5beffff700 1 -- 172.21.15.84:0/3293189440 learned_addr learned my addr 172.21.15.84:0/3293189440 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5beffff700 1 -- 172.21.15.84:0/3293189440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5bf8159510 msgr2=0x7f5bf80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5beffff700 1 --2- 172.21.15.84:0/3293189440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5bf8159510 0x7f5bf80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5beffff700 1 -- 172.21.15.84:0/3293189440 >> v1:172.21.15.131:6789/0 conn(0x7f5bf80ce820 legacy=0x7f5bf80cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.633+0000 7f5beffff700 1 -- 172.21.15.84:0/3293189440 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf80cfbd0 con 0x7f5bf81598e0 2023-10-06T03:24:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5beffff700 1 --2- 172.21.15.84:0/3293189440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 0x7f5bf80cbae0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5be80099b0 tx=0x7f5be8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5b0e31d69765cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bef7fe700 1 -- 172.21.15.84:0/3293189440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800b820 con 0x7f5bf81598e0 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bef7fe700 1 -- 172.21.15.84:0/3293189440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be800b980 con 0x7f5bf81598e0 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bef7fe700 1 -- 172.21.15.84:0/3293189440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800bd20 con 0x7f5bf81598e0 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bfeec2700 1 -- 172.21.15.84:0/3293189440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 msgr2=0x7f5bf80cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bfeec2700 1 --2- 172.21.15.84:0/3293189440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 0x7f5bf80cbae0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5be80099b0 tx=0x7f5be8009250 comp rx=0 tx=0).stop 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bfeec2700 1 -- 172.21.15.84:0/3293189440 shutdown_connections 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bfeec2700 1 --2- 172.21.15.84:0/3293189440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5bf8159510 0x7f5bf80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bfeec2700 1 --2- 172.21.15.84:0/3293189440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 0x7f5bf80cbae0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bfeec2700 1 -- 172.21.15.84:0/3293189440 >> 172.21.15.84:0/3293189440 conn(0x7f5bf8089e90 msgr2=0x7f5bf80997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bfeec2700 1 -- 172.21.15.84:0/3293189440 shutdown_connections 2023-10-06T03:24:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.634+0000 7f5bfeec2700 1 -- 172.21.15.84:0/3293189440 wait complete. 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.635+0000 7f5bfeec2700 1 Processor -- start 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfeec2700 1 -- start start 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfeec2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bf80ce820 0x7f5bf81559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfeec2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5bf8159510 0x7f5bf8155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfeec2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 0x7f5bf815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfeec2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8156460 con 0x7f5bf81598e0 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfeec2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8156ba0 con 0x7f5bf80ce820 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfeec2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf816aa30 con 0x7f5bf8159510 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfd45f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 0x7f5bf815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfd45f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 0x7f5bf815be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52228/0 (socket says 172.21.15.84:52228) 2023-10-06T03:24:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfd45f700 1 -- 172.21.15.84:0/1274886056 learned_addr learned my addr 172.21.15.84:0/1274886056 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5beffff700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5bf8159510 0x7f5bf8155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.636+0000 7f5bfcc5e700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bf80ce820 0x7f5bf81559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5bfd45f700 1 -- 172.21.15.84:0/1274886056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5bf8159510 msgr2=0x7f5bf8155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5bfd45f700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5bf8159510 0x7f5bf8155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5bfd45f700 1 -- 172.21.15.84:0/1274886056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bf80ce820 msgr2=0x7f5bf81559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5bfd45f700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bf80ce820 0x7f5bf81559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5bfd45f700 1 -- 172.21.15.84:0/1274886056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80094f0 con 0x7f5bf81598e0 2023-10-06T03:24:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5bfd45f700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 0x7f5bf815be20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000b5e0 tx=0x7f5bf0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5becff9700 1 -- 172.21.15.84:0/1274886056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000f510 con 0x7f5bf81598e0 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5becff9700 1 -- 172.21.15.84:0/1274886056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf000f690 con 0x7f5bf81598e0 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5bfeec2700 1 -- 172.21.15.84:0/1274886056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf816ad10 con 0x7f5bf81598e0 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5becff9700 1 -- 172.21.15.84:0/1274886056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000fa50 con 0x7f5bf81598e0 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.637+0000 7f5bfeec2700 1 -- 172.21.15.84:0/1274886056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf816b2d0 con 0x7f5bf81598e0 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.638+0000 7f5bfeec2700 1 -- 172.21.15.84:0/1274886056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf8064ad0 con 0x7f5bf81598e0 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.638+0000 7f5becff9700 1 -- 172.21.15.84:0/1274886056 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bf001a400 con 0x7f5bf81598e0 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.638+0000 7f5becff9700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.639+0000 7f5becff9700 1 -- 172.21.15.84:0/1274886056 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5bf0083d90 con 0x7f5bf81598e0 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.639+0000 7f5bfcc5e700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.639+0000 7f5bfcc5e700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5be4066f30 0x7f5be40693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4007580 tx=0x7f5bf4009780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.643+0000 7f5becff9700 1 -- 172.21.15.84:0/1274886056 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bf0051130 con 0x7f5bf81598e0 2023-10-06T03:24:45.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.825+0000 7f5bfeec2700 1 -- 172.21.15.84:0/1274886056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5bf80cfeb0 con 0x7f5bf81598e0 2023-10-06T03:24:45.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.825+0000 7f5becff9700 1 -- 172.21.15.84:0/1274886056 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5bf0054750 con 0x7f5bf81598e0 2023-10-06T03:24:45.827 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:24:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 -- 172.21.15.84:0/1274886056 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5be4066f30 msgr2=0x7f5be40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5be4066f30 0x7f5be40693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4007580 tx=0x7f5bf4009780 comp rx=0 tx=0).stop 2023-10-06T03:24:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 -- 172.21.15.84:0/1274886056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 msgr2=0x7f5bf815be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 0x7f5bf815be20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000b5e0 tx=0x7f5bf0009120 comp rx=0 tx=0).stop 2023-10-06T03:24:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 -- 172.21.15.84:0/1274886056 shutdown_connections 2023-10-06T03:24:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bf80ce820 0x7f5bf81559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf81598e0 0x7f5bf815be20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 --2- 172.21.15.84:0/1274886056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5bf8159510 0x7f5bf8155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 -- 172.21.15.84:0/1274886056 >> 172.21.15.84:0/1274886056 conn(0x7f5bf8089e90 msgr2=0x7f5bf80c6130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 -- 172.21.15.84:0/1274886056 shutdown_connections 2023-10-06T03:24:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.827+0000 7f5bfeec2700 1 -- 172.21.15.84:0/1274886056 wait complete. 2023-10-06T03:24:45.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:45.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.956+0000 7f3e7ffa8700 1 Processor -- start 2023-10-06T03:24:45.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.956+0000 7f3e7ffa8700 1 -- start start 2023-10-06T03:24:45.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7ffa8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e78159510 0x7f3e780cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7ffa8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e780cbf20 con 0x7f3e780cbae0 2023-10-06T03:24:45.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7ffa8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e780cf610 con 0x7f3e781598e0 2023-10-06T03:24:45.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7ffa8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e780cf8f0 con 0x7f3e78159510 2023-10-06T03:24:45.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7dd44700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e78159510 0x7f3e780cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7e545700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3e780cbae0 0x7f3e780c56d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40296/0 (socket says 172.21.15.84:40296) 2023-10-06T03:24:45.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7e545700 1 -- 172.21.15.84:0/2554723566 learned_addr learned my addr 172.21.15.84:0/2554723566 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:45.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7dd44700 1 -- 172.21.15.84:0/2554723566 >> v1:172.21.15.131:6789/0 conn(0x7f3e781598e0 legacy=0x7f3e780ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:45.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7dd44700 1 -- 172.21.15.84:0/2554723566 >> v1:172.21.15.84:6789/0 conn(0x7f3e780cbae0 legacy=0x7f3e780c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7dd44700 1 -- 172.21.15.84:0/2554723566 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780cfbd0 con 0x7f3e78159510 2023-10-06T03:24:45.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7cd42700 1 -- 172.21.15.84:0/2554723566 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221427423 0 0) 0x7f3e780cbf20 con 0x7f3e780cbae0 2023-10-06T03:24:45.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7dd44700 1 --2- 172.21.15.84:0/2554723566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 0x7f3e780cb5a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009e60 tx=0x7f3e74009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ccc2db36e8017b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7cd42700 1 -- 172.21.15.84:0/2554723566 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7400e070 con 0x7f3e78159510 2023-10-06T03:24:45.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7cd42700 1 -- 172.21.15.84:0/2554723566 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7400bbf0 con 0x7f3e78159510 2023-10-06T03:24:45.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.957+0000 7f3e7cd42700 1 -- 172.21.15.84:0/2554723566 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74012430 con 0x7f3e78159510 2023-10-06T03:24:45.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.958+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/2554723566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 msgr2=0x7f3e780cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.958+0000 7f3e7ffa8700 1 --2- 172.21.15.84:0/2554723566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 0x7f3e780cb5a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009e60 tx=0x7f3e74009780 comp rx=0 tx=0).stop 2023-10-06T03:24:45.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.958+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/2554723566 shutdown_connections 2023-10-06T03:24:45.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.958+0000 7f3e7ffa8700 1 --2- 172.21.15.84:0/2554723566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 0x7f3e780cb5a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.958+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/2554723566 >> 172.21.15.84:0/2554723566 conn(0x7f3e78089e90 msgr2=0x7f3e780997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:45.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.958+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/2554723566 shutdown_connections 2023-10-06T03:24:45.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.958+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/2554723566 wait complete. 2023-10-06T03:24:45.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.959+0000 7f3e7ffa8700 1 Processor -- start 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.959+0000 7f3e7ffa8700 1 -- start start 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7ffa8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e780cbae0 0x7f3e780c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7ffa8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 0x7f3e7816ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7ffa8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e781598e0 0x7f3e780b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7ffa8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7816b060 con 0x7f3e78159510 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7ffa8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780b4e50 con 0x7f3e781598e0 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7ffa8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780b50f0 con 0x7f3e780cbae0 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7d543700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 0x7f3e7816ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7d543700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 0x7f3e7816ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52260/0 (socket says 172.21.15.84:52260) 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7d543700 1 -- 172.21.15.84:0/3441308594 learned_addr learned my addr 172.21.15.84:0/3441308594 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7dd44700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e780cbae0 0x7f3e780c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7e545700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e781598e0 0x7f3e780b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7d543700 1 -- 172.21.15.84:0/3441308594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e780cbae0 msgr2=0x7f3e780c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7d543700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e780cbae0 0x7f3e780c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7d543700 1 -- 172.21.15.84:0/3441308594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e781598e0 msgr2=0x7f3e780b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7d543700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e781598e0 0x7f3e780b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7d543700 1 -- 172.21.15.84:0/3441308594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74009a20 con 0x7f3e78159510 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7dd44700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e780cbae0 0x7f3e780c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7e545700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e781598e0 0x7f3e780b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7d543700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 0x7f3e7816ab20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800b510 tx=0x7f3e680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e6dffb700 1 -- 172.21.15.84:0/3441308594 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800f510 con 0x7f3e78159510 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e6dffb700 1 -- 172.21.15.84:0/3441308594 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6800f670 con 0x7f3e78159510 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/3441308594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e780b39b0 con 0x7f3e78159510 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.960+0000 7f3e6dffb700 1 -- 172.21.15.84:0/3441308594 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800fa30 con 0x7f3e78159510 2023-10-06T03:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.961+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/3441308594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e780b5390 con 0x7f3e78159510 2023-10-06T03:24:45.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.962+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/3441308594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e78064ad0 con 0x7f3e78159510 2023-10-06T03:24:45.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.962+0000 7f3e6dffb700 1 -- 172.21.15.84:0/3441308594 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e6801a400 con 0x7f3e78159510 2023-10-06T03:24:45.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.962+0000 7f3e6dffb700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.963+0000 7f3e6dffb700 1 -- 172.21.15.84:0/3441308594 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f3e68083ff0 con 0x7f3e78159510 2023-10-06T03:24:45.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.963+0000 7f3e7dd44700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.963+0000 7f3e7dd44700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e5c066f30 0x7f3e5c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3e740097c0 tx=0x7f3e74018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:45.966+0000 7f3e6dffb700 1 -- 172.21.15.84:0/3441308594 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e680513c0 con 0x7f3e78159510 2023-10-06T03:24:46.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.149+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/3441308594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e780cfeb0 con 0x7f3e78159510 2023-10-06T03:24:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.149+0000 7f3e6dffb700 1 -- 172.21.15.84:0/3441308594 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e680549e0 con 0x7f3e78159510 2023-10-06T03:24:46.151 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:24:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/3441308594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e5c066f30 msgr2=0x7f3e5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e5c066f30 0x7f3e5c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3e740097c0 tx=0x7f3e74018000 comp rx=0 tx=0).stop 2023-10-06T03:24:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/3441308594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 msgr2=0x7f3e7816ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 0x7f3e7816ab20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800b510 tx=0x7f3e680090f0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/3441308594 shutdown_connections 2023-10-06T03:24:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e781598e0 0x7f3e780b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e780cbae0 0x7f3e780c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 --2- 172.21.15.84:0/3441308594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e78159510 0x7f3e7816ab20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/3441308594 >> 172.21.15.84:0/3441308594 conn(0x7f3e78089e90 msgr2=0x7f3e780683b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/3441308594 shutdown_connections 2023-10-06T03:24:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.151+0000 7f3e7ffa8700 1 -- 172.21.15.84:0/3441308594 wait complete. 2023-10-06T03:24:46.164 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:24:46.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.276+0000 7f21c5e0d700 1 Processor -- start 2023-10-06T03:24:46.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.276+0000 7f21c5e0d700 1 -- start start 2023-10-06T03:24:46.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c5e0d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21c0159480 0x7f21c00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c5e0d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 0x7f21c00cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c5e0d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c00cb7e0 con 0x7f21c00cc1b0 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c5e0d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c00b08a0 con 0x7f21c0159480 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c5e0d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00cb190 con 0x7f21c00b3610 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c4e0b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21c0159480 0x7f21c00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c4e0b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21c0159480 0x7f21c00b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52264/0 (socket says 172.21.15.84:52264) 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c4e0b700 1 -- 172.21.15.84:0/4063321710 learned_addr learned my addr 172.21.15.84:0/4063321710 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21bffff700 1 --2- 172.21.15.84:0/4063321710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 0x7f21c00cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c4e0b700 1 -- 172.21.15.84:0/4063321710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 msgr2=0x7f21c00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c4e0b700 1 --2- 172.21.15.84:0/4063321710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 0x7f21c00cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c4e0b700 1 -- 172.21.15.84:0/4063321710 >> v1:172.21.15.131:6789/0 conn(0x7f21c00cc1b0 legacy=0x7f21c00b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21c4e0b700 1 -- 172.21.15.84:0/4063321710 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c00cb470 con 0x7f21c0159480 2023-10-06T03:24:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.277+0000 7f21bffff700 1 --2- 172.21.15.84:0/4063321710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 0x7f21c00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21c4e0b700 1 --2- 172.21.15.84:0/4063321710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 0x7f21c00b30d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009f20 tx=0x7f21b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bd7d2b13d4f27f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21bf7fe700 1 -- 172.21.15.84:0/4063321710 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000e070 con 0x7f21c0159480 2023-10-06T03:24:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21bf7fe700 1 -- 172.21.15.84:0/4063321710 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b000ba40 con 0x7f21c0159480 2023-10-06T03:24:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21bf7fe700 1 -- 172.21.15.84:0/4063321710 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b00092e0 con 0x7f21c0159480 2023-10-06T03:24:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21c5e0d700 1 -- 172.21.15.84:0/4063321710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 msgr2=0x7f21c00b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21c5e0d700 1 --2- 172.21.15.84:0/4063321710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 0x7f21c00b30d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009f20 tx=0x7f21b0009840 comp rx=0 tx=0).stop 2023-10-06T03:24:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21c5e0d700 1 -- 172.21.15.84:0/4063321710 shutdown_connections 2023-10-06T03:24:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21c5e0d700 1 --2- 172.21.15.84:0/4063321710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 0x7f21c00b30d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21c5e0d700 1 --2- 172.21.15.84:0/4063321710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 0x7f21c00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21c5e0d700 1 -- 172.21.15.84:0/4063321710 >> 172.21.15.84:0/4063321710 conn(0x7f21c006ed20 msgr2=0x7f21c006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:46.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21c5e0d700 1 -- 172.21.15.84:0/4063321710 shutdown_connections 2023-10-06T03:24:46.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.278+0000 7f21c5e0d700 1 -- 172.21.15.84:0/4063321710 wait complete. 2023-10-06T03:24:46.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.280+0000 7f21c5e0d700 1 Processor -- start 2023-10-06T03:24:46.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.280+0000 7f21c5e0d700 1 -- start start 2023-10-06T03:24:46.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.280+0000 7f21c5e0d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 0x7f21c00c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.280+0000 7f21c5e0d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c00cc1b0 0x7f21c0153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.280+0000 7f21c5e0d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 0x7f21c00cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.280+0000 7f21c5e0d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00c80d0 con 0x7f21c0159480 2023-10-06T03:24:46.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.280+0000 7f21c5e0d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0154140 con 0x7f21c00cc1b0 2023-10-06T03:24:46.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.280+0000 7f21c5e0d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00ce370 con 0x7f21c00b3610 2023-10-06T03:24:46.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c560c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 0x7f21c00cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c560c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 0x7f21c00cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52278/0 (socket says 172.21.15.84:52278) 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c560c700 1 -- 172.21.15.84:0/3960393815 learned_addr learned my addr 172.21.15.84:0/3960393815 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c4e0b700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 0x7f21c00c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21bffff700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c00cc1b0 0x7f21c0153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c560c700 1 -- 172.21.15.84:0/3960393815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 msgr2=0x7f21c00c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c560c700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 0x7f21c00c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c560c700 1 -- 172.21.15.84:0/3960393815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c00cc1b0 msgr2=0x7f21c0153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c560c700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c00cc1b0 0x7f21c0153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c560c700 1 -- 172.21.15.84:0/3960393815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0009ae0 con 0x7f21c0159480 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21bffff700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c00cc1b0 0x7f21c0153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c560c700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 0x7f21c00cde30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c5b0 tx=0x7f21b8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21bcff9700 1 -- 172.21.15.84:0/3960393815 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8011590 con 0x7f21c0159480 2023-10-06T03:24:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21bcff9700 1 -- 172.21.15.84:0/3960393815 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8011710 con 0x7f21c0159480 2023-10-06T03:24:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c5e0d700 1 -- 172.21.15.84:0/3960393815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c00ce610 con 0x7f21c0159480 2023-10-06T03:24:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21bcff9700 1 -- 172.21.15.84:0/3960393815 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8011ad0 con 0x7f21c0159480 2023-10-06T03:24:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.281+0000 7f21c5e0d700 1 -- 172.21.15.84:0/3960393815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00c7d60 con 0x7f21c0159480 2023-10-06T03:24:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.282+0000 7f21c5e0d700 1 -- 172.21.15.84:0/3960393815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c005f270 con 0x7f21c0159480 2023-10-06T03:24:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.282+0000 7f21bcff9700 1 -- 172.21.15.84:0/3960393815 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21b801c460 con 0x7f21c0159480 2023-10-06T03:24:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.283+0000 7f21bcff9700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21ac066f30 0x7f21ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.283+0000 7f21bcff9700 1 -- 172.21.15.84:0/3960393815 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f21b8084190 con 0x7f21c0159480 2023-10-06T03:24:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.283+0000 7f21c4e0b700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21ac066f30 0x7f21ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.283+0000 7f21c4e0b700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21ac066f30 0x7f21ac0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009880 tx=0x7f21b0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.287+0000 7f21bcff9700 1 -- 172.21.15.84:0/3960393815 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21b80514b0 con 0x7f21c0159480 2023-10-06T03:24:46.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.471+0000 7f21c5e0d700 1 -- 172.21.15.84:0/3960393815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f21c00c8210 con 0x7f21c0159480 2023-10-06T03:24:46.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.471+0000 7f21bcff9700 1 -- 172.21.15.84:0/3960393815 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7f21b8054ad0 con 0x7f21c0159480 2023-10-06T03:24:46.473 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:46.473 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T03:24:46.473 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:46.473 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T03:24:46.473 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T03:24:46.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:24:46.473 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:24:46.473 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T03:24:46.474 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T03:24:46.474 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:24:46.474 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T03:24:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 -- 172.21.15.84:0/3960393815 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21ac066f30 msgr2=0x7f21ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21ac066f30 0x7f21ac0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009880 tx=0x7f21b0017000 comp rx=0 tx=0).stop 2023-10-06T03:24:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 -- 172.21.15.84:0/3960393815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 msgr2=0x7f21c00cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 0x7f21c00cde30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c5b0 tx=0x7f21b8007f60 comp rx=0 tx=0).stop 2023-10-06T03:24:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 -- 172.21.15.84:0/3960393815 shutdown_connections 2023-10-06T03:24:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f21ac066f30 0x7f21ac0693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c0159480 0x7f21c00cde30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c00b3610 0x7f21c00c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 --2- 172.21.15.84:0/3960393815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c00cc1b0 0x7f21c0153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 -- 172.21.15.84:0/3960393815 >> 172.21.15.84:0/3960393815 conn(0x7f21c006ed20 msgr2=0x7f21c01586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 -- 172.21.15.84:0/3960393815 shutdown_connections 2023-10-06T03:24:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.473+0000 7f21c5e0d700 1 -- 172.21.15.84:0/3960393815 wait complete. 2023-10-06T03:24:46.486 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:24:46.487 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:24:46.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.604+0000 7fd1d6bec700 1 Processor -- start 2023-10-06T03:24:46.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.604+0000 7fd1d6bec700 1 -- start start 2023-10-06T03:24:46.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d6bec700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd1d00ccab0 0x7fd1d00d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d6bec700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1d00d0830 0x7fd1d00ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d6bec700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d00d0c90 con 0x7fd1d01539d0 2023-10-06T03:24:46.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d6bec700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d00cdc30 con 0x7fd1d00ccab0 2023-10-06T03:24:46.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d6bec700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00cb500 con 0x7fd1d00d0830 2023-10-06T03:24:46.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d5bea700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd1d01539d0 0x7fd1d015a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40302/0 (socket says 172.21.15.84:40302) 2023-10-06T03:24:46.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d5bea700 1 -- 172.21.15.84:0/3149011126 learned_addr learned my addr 172.21.15.84:0/3149011126 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d63eb700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1d00d0830 0x7fd1d00ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635026157 0 0) 0x7fd1c8001490 con 0x7fd1d01539d0 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b8003570 con 0x7fd1d01539d0 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032332382 0 0) 0x7fd1b8003570 con 0x7fd1d01539d0 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1d00d0830 msgr2=0x7fd1d00ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d4be8700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1d00d0830 0x7fd1d00ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 >> v2:172.21.15.131:3300/0 conn(0x7fd1d00ccab0 msgr2=0x7fd1d00d02f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d4be8700 1 --2- 172.21.15.84:0/3149011126 >> v2:172.21.15.131:3300/0 conn(0x7fd1d00ccab0 0x7fd1d00d02f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00cd020 con 0x7fd1d01539d0 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fd1c8001980 con 0x7fd1d01539d0 2023-10-06T03:24:46.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.605+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 >> v1:172.21.15.84:6789/0 conn(0x7fd1d01539d0 legacy=0x7fd1d015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d4be8700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1b8003a60 0x7fd1b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d4be8700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b8004810 0x7fd1b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d4be8700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1d00d0830 0x7fd1b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00cdc30 con 0x7fd1b8004810 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00cb500 con 0x7fd1b8003a60 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b800bbc0 con 0x7fd1d00d0830 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d53e9700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b8004810 0x7fd1b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d5bea700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1b8003a60 0x7fd1b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d53e9700 1 -- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1d00d0830 msgr2=0x7fd1b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d53e9700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1d00d0830 0x7fd1b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d53e9700 1 -- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1b8003a60 msgr2=0x7fd1b8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:46.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d53e9700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1b8003a60 0x7fd1b8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d53e9700 1 -- 172.21.15.84:0/3149011126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8003570 con 0x7fd1b8004810 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d5bea700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1b8003a60 0x7fd1b8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d53e9700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b8004810 0x7fd1b8004c80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009920 tx=0x7fd1c4006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316633b4940105a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4011400 con 0x7fd1b8004810 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4011580 con 0x7fd1b8004810 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.606+0000 7fd1d4be8700 1 -- 172.21.15.84:0/3149011126 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4011940 con 0x7fd1b8004810 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.607+0000 7fd1d6bec700 1 -- 172.21.15.84:0/3149011126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b8004810 msgr2=0x7fd1b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.607+0000 7fd1d6bec700 1 --2- 172.21.15.84:0/3149011126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b8004810 0x7fd1b8004c80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009920 tx=0x7fd1c4006ef0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.607+0000 7fd1d63eb700 1 -- 172.21.15.84:0/3149011126 reap_dead start 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.607+0000 7fd1d6bec700 1 -- 172.21.15.84:0/3149011126 shutdown_connections 2023-10-06T03:24:46.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.607+0000 7fd1d6bec700 1 -- 172.21.15.84:0/3149011126 >> 172.21.15.84:0/3149011126 conn(0x7fd1d0068100 msgr2=0x7fd1d00684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:46.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.607+0000 7fd1d6bec700 1 -- 172.21.15.84:0/3149011126 shutdown_connections 2023-10-06T03:24:46.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.607+0000 7fd1d6bec700 1 -- 172.21.15.84:0/3149011126 wait complete. 2023-10-06T03:24:46.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.608+0000 7fd1d6bec700 1 Processor -- start 2023-10-06T03:24:46.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.608+0000 7fd1d6bec700 1 -- start start 2023-10-06T03:24:46.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d6bec700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b8004810 0x7fd1d0148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d6bec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1d01698c0 0x7fd1d0169d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d6bec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1d0156250 0x7fd1d01566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d6bec700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d01494f0 con 0x7fd1d01698c0 2023-10-06T03:24:46.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d6bec700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0156c30 con 0x7fd1d0156250 2023-10-06T03:24:46.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d6bec700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0153da0 con 0x7fd1b8004810 2023-10-06T03:24:46.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d53e9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1d01698c0 0x7fd1d0169d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d53e9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1d01698c0 0x7fd1d0169d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52286/0 (socket says 172.21.15.84:52286) 2023-10-06T03:24:46.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d53e9700 1 -- 172.21.15.84:0/2984380601 learned_addr learned my addr 172.21.15.84:0/2984380601 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:46.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d53e9700 1 -- 172.21.15.84:0/2984380601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b8004810 msgr2=0x7fd1d0148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d53e9700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b8004810 0x7fd1d0148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d53e9700 1 -- 172.21.15.84:0/2984380601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1d0156250 msgr2=0x7fd1d01566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d53e9700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1d0156250 0x7fd1d01566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d53e9700 1 -- 172.21.15.84:0/2984380601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d0154360 con 0x7fd1d01698c0 2023-10-06T03:24:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d53e9700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1d01698c0 0x7fd1d0169d30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4010ed0 tx=0x7fd1c4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1cdffb700 1 -- 172.21.15.84:0/2984380601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40116f0 con 0x7fd1d01698c0 2023-10-06T03:24:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1cdffb700 1 -- 172.21.15.84:0/2984380601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4011850 con 0x7fd1d01698c0 2023-10-06T03:24:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d6bec700 1 -- 172.21.15.84:0/2984380601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d016a3c0 con 0x7fd1d01698c0 2023-10-06T03:24:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1cdffb700 1 -- 172.21.15.84:0/2984380601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c401d680 con 0x7fd1d01698c0 2023-10-06T03:24:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.609+0000 7fd1d6bec700 1 -- 172.21.15.84:0/2984380601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d0153ff0 con 0x7fd1d01698c0 2023-10-06T03:24:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.610+0000 7fd1d6bec700 1 -- 172.21.15.84:0/2984380601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d005f270 con 0x7fd1d01698c0 2023-10-06T03:24:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.611+0000 7fd1cdffb700 1 -- 172.21.15.84:0/2984380601 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1c401da30 con 0x7fd1d01698c0 2023-10-06T03:24:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.611+0000 7fd1cdffb700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1bc066f30 0x7fd1bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.611+0000 7fd1d5bea700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1bc066f30 0x7fd1bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.611+0000 7fd1cdffb700 1 -- 172.21.15.84:0/2984380601 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd1c4085f10 con 0x7fd1d01698c0 2023-10-06T03:24:46.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.612+0000 7fd1d5bea700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1bc066f30 0x7fd1bc0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8001190 tx=0x7fd1c8001250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.616+0000 7fd1cdffb700 1 -- 172.21.15.84:0/2984380601 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1c4053230 con 0x7fd1d01698c0 2023-10-06T03:24:46.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:46.802+0000 7fd1d6bec700 1 -- 172.21.15.84:0/2984380601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd1d01544f0 con 0x7fd1d01698c0 2023-10-06T03:24:47.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.788+0000 7fd1cdffb700 1 -- 172.21.15.84:0/2984380601 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd1c402a020 con 0x7fd1d01698c0 2023-10-06T03:24:47.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.792+0000 7fd1d6bec700 1 -- 172.21.15.84:0/2984380601 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1bc066f30 msgr2=0x7fd1bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.792+0000 7fd1d6bec700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1bc066f30 0x7fd1bc0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8001190 tx=0x7fd1c8001250 comp rx=0 tx=0).stop 2023-10-06T03:24:47.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.792+0000 7fd1d6bec700 1 -- 172.21.15.84:0/2984380601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1d01698c0 msgr2=0x7fd1d0169d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.792+0000 7fd1d6bec700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1d01698c0 0x7fd1d0169d30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4010ed0 tx=0x7fd1c4012000 comp rx=0 tx=0).stop 2023-10-06T03:24:47.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.794+0000 7fd1d6bec700 1 -- 172.21.15.84:0/2984380601 shutdown_connections 2023-10-06T03:24:47.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.794+0000 7fd1d6bec700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1bc066f30 0x7fd1bc0693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.794+0000 7fd1d6bec700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1d0156250 0x7fd1d01566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.794+0000 7fd1d6bec700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b8004810 0x7fd1d0148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.794+0000 7fd1d6bec700 1 --2- 172.21.15.84:0/2984380601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1d01698c0 0x7fd1d0169d30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.794+0000 7fd1d6bec700 1 -- 172.21.15.84:0/2984380601 >> 172.21.15.84:0/2984380601 conn(0x7fd1d0068100 msgr2=0x7fd1d00c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:47.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.794+0000 7fd1d6bec700 1 -- 172.21.15.84:0/2984380601 shutdown_connections 2023-10-06T03:24:47.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.795+0000 7fd1d6bec700 1 -- 172.21.15.84:0/2984380601 wait complete. 2023-10-06T03:24:47.797 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T03:24:47.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:24:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.935+0000 7f6245c7b700 1 Processor -- start 2023-10-06T03:24:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.935+0000 7f6245c7b700 1 -- start start 2023-10-06T03:24:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6245c7b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62400b2660 0x7f62400cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6245c7b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62400cf1f0 0x7f62400cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6245c7b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400cc9b0 con 0x7f62400b2a30 2023-10-06T03:24:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6245c7b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400cbda0 con 0x7f62400b2660 2023-10-06T03:24:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6245c7b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400cc080 con 0x7f62400cf1f0 2023-10-06T03:24:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6244c79700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62400b2660 0x7f62400cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6244c79700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62400b2660 0x7f62400cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52292/0 (socket says 172.21.15.84:52292) 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6244c79700 1 -- 172.21.15.84:0/1165561279 learned_addr learned my addr 172.21.15.84:0/1165561279 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f624547a700 1 --2- 172.21.15.84:0/1165561279 >> v2:172.21.15.131:3300/0 conn(0x7f62400cf1f0 0x7f62400cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6244c79700 1 -- 172.21.15.84:0/1165561279 >> v2:172.21.15.131:3300/0 conn(0x7f62400cf1f0 msgr2=0x7f62400cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6244c79700 1 --2- 172.21.15.84:0/1165561279 >> v2:172.21.15.131:3300/0 conn(0x7f62400cf1f0 0x7f62400cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6244c79700 1 -- 172.21.15.84:0/1165561279 >> v1:172.21.15.131:6789/0 conn(0x7f62400b2a30 legacy=0x7f62400ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6244c79700 1 -- 172.21.15.84:0/1165561279 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400cc360 con 0x7f62400b2660 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f6244c79700 1 --2- 172.21.15.84:0/1165561279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2660 0x7f62400cccf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f62400894b0 tx=0x7f6234009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8ee9a74ce0f2f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f623f7fe700 1 -- 172.21.15.84:0/1165561279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234005c10 con 0x7f62400b2660 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.936+0000 7f623f7fe700 1 -- 172.21.15.84:0/1165561279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6234005d70 con 0x7f62400b2660 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.937+0000 7f623f7fe700 1 -- 172.21.15.84:0/1165561279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400b840 con 0x7f62400b2660 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.937+0000 7f6245c7b700 1 -- 172.21.15.84:0/1165561279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2660 msgr2=0x7f62400cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.937+0000 7f6245c7b700 1 --2- 172.21.15.84:0/1165561279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2660 0x7f62400cccf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f62400894b0 tx=0x7f6234009220 comp rx=0 tx=0).stop 2023-10-06T03:24:47.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.937+0000 7f6245c7b700 1 -- 172.21.15.84:0/1165561279 shutdown_connections 2023-10-06T03:24:47.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.937+0000 7f6245c7b700 1 --2- 172.21.15.84:0/1165561279 >> v2:172.21.15.131:3300/0 conn(0x7f62400cf1f0 0x7f62400cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.937+0000 7f6245c7b700 1 --2- 172.21.15.84:0/1165561279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2660 0x7f62400cccf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.937+0000 7f6245c7b700 1 -- 172.21.15.84:0/1165561279 >> 172.21.15.84:0/1165561279 conn(0x7f6240099560 msgr2=0x7f624006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:47.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.937+0000 7f6245c7b700 1 -- 172.21.15.84:0/1165561279 shutdown_connections 2023-10-06T03:24:47.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.937+0000 7f6245c7b700 1 -- 172.21.15.84:0/1165561279 wait complete. 2023-10-06T03:24:47.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.938+0000 7f6245c7b700 1 Processor -- start 2023-10-06T03:24:47.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.938+0000 7f6245c7b700 1 -- start start 2023-10-06T03:24:47.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f6245c7b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62400b2660 0x7f62401563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f6245c7b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2a30 0x7f62400c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f6245c7b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62400cf1f0 0x7f62401698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f6245c7b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624015ad00 con 0x7f62400b2a30 2023-10-06T03:24:47.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f6245c7b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624015d690 con 0x7f62400cf1f0 2023-10-06T03:24:47.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f6245c7b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624015d970 con 0x7f62400b2660 2023-10-06T03:24:47.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f623ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2a30 0x7f62400c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f623ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2a30 0x7f62400c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52298/0 (socket says 172.21.15.84:52298) 2023-10-06T03:24:47.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f623ffff700 1 -- 172.21.15.84:0/3103525059 learned_addr learned my addr 172.21.15.84:0/3103525059 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:47.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f624547a700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62400cf1f0 0x7f62401698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f623ffff700 1 -- 172.21.15.84:0/3103525059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62400b2660 msgr2=0x7f62401563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f623ffff700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62400b2660 0x7f62401563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f623ffff700 1 -- 172.21.15.84:0/3103525059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62400cf1f0 msgr2=0x7f62401698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f623ffff700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62400cf1f0 0x7f62401698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f623ffff700 1 -- 172.21.15.84:0/3103525059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6234009480 con 0x7f62400b2a30 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.939+0000 7f624547a700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62400cf1f0 0x7f62401698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.940+0000 7f623ffff700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2a30 0x7f62400c9410 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f622c00b7e0 tx=0x7f622c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.940+0000 7f623cff9700 1 -- 172.21.15.84:0/3103525059 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c00f510 con 0x7f62400b2a30 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.940+0000 7f623cff9700 1 -- 172.21.15.84:0/3103525059 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c00f670 con 0x7f62400b2a30 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.940+0000 7f6245c7b700 1 -- 172.21.15.84:0/3103525059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624015a6b0 con 0x7f62400b2a30 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.940+0000 7f623cff9700 1 -- 172.21.15.84:0/3103525059 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c00fa10 con 0x7f62400b2a30 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.940+0000 7f6245c7b700 1 -- 172.21.15.84:0/3103525059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6240156920 con 0x7f62400b2a30 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.941+0000 7f6245c7b700 1 -- 172.21.15.84:0/3103525059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624005f270 con 0x7f62400b2a30 2023-10-06T03:24:47.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.941+0000 7f623cff9700 1 -- 172.21.15.84:0/3103525059 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f622c01a400 con 0x7f62400b2a30 2023-10-06T03:24:47.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.941+0000 7f623cff9700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.942+0000 7f623cff9700 1 -- 172.21.15.84:0/3103525059 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f622c0841b0 con 0x7f62400b2a30 2023-10-06T03:24:47.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.942+0000 7f6244c79700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.942+0000 7f6244c79700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6224066f30 0x7f62240693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62400c6430 tx=0x7f6234015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:47.946+0000 7f623cff9700 1 -- 172.21.15.84:0/3103525059 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f622c054dd0 con 0x7f62400b2a30 2023-10-06T03:24:48.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.129+0000 7f6245c7b700 1 -- 172.21.15.84:0/3103525059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f624015ae40 con 0x7f62400b2a30 2023-10-06T03:24:48.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.788+0000 7f623cff9700 1 -- 172.21.15.84:0/3103525059 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f622c054960 con 0x7f62400b2a30 2023-10-06T03:24:48.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.792+0000 7f6245c7b700 1 -- 172.21.15.84:0/3103525059 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6224066f30 msgr2=0x7f62240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.792+0000 7f6245c7b700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6224066f30 0x7f62240693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62400c6430 tx=0x7f6234015000 comp rx=0 tx=0).stop 2023-10-06T03:24:48.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.792+0000 7f6245c7b700 1 -- 172.21.15.84:0/3103525059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2a30 msgr2=0x7f62400c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.792+0000 7f6245c7b700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2a30 0x7f62400c9410 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f622c00b7e0 tx=0x7f622c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.793+0000 7f6245c7b700 1 -- 172.21.15.84:0/3103525059 shutdown_connections 2023-10-06T03:24:48.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.793+0000 7f6245c7b700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.793+0000 7f6245c7b700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62400cf1f0 0x7f62401698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.793+0000 7f6245c7b700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62400b2660 0x7f62401563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.793+0000 7f6245c7b700 1 --2- 172.21.15.84:0/3103525059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62400b2a30 0x7f62400c9410 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.793+0000 7f6245c7b700 1 -- 172.21.15.84:0/3103525059 >> 172.21.15.84:0/3103525059 conn(0x7f6240099560 msgr2=0x7f6240158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.795+0000 7f6245c7b700 1 -- 172.21.15.84:0/3103525059 shutdown_connections 2023-10-06T03:24:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.796+0000 7f6245c7b700 1 -- 172.21.15.84:0/3103525059 wait complete. 2023-10-06T03:24:48.801 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T03:24:48.819 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:24:48.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.935+0000 7f62f9acf700 1 Processor -- start 2023-10-06T03:24:48.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.935+0000 7f62f9acf700 1 -- start start 2023-10-06T03:24:48.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f9acf700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62f4159510 0x7f62f40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f9acf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62f40cbae0 0x7f62f40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f9acf700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f40cbf20 con 0x7f62f41598e0 2023-10-06T03:24:48.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f9acf700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f40cf610 con 0x7f62f40cbae0 2023-10-06T03:24:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f9acf700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f40cf8f0 con 0x7f62f4159510 2023-10-06T03:24:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62f40cbae0 0x7f62f40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62f40cbae0 0x7f62f40cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52306/0 (socket says 172.21.15.84:52306) 2023-10-06T03:24:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f3fff700 1 -- 172.21.15.84:0/4056084283 learned_addr learned my addr 172.21.15.84:0/4056084283 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f37fe700 1 --2- 172.21.15.84:0/4056084283 >> v2:172.21.15.131:3300/0 conn(0x7f62f4159510 0x7f62f40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f3fff700 1 -- 172.21.15.84:0/4056084283 >> v2:172.21.15.131:3300/0 conn(0x7f62f4159510 msgr2=0x7f62f40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f3fff700 1 --2- 172.21.15.84:0/4056084283 >> v2:172.21.15.131:3300/0 conn(0x7f62f4159510 0x7f62f40cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f3fff700 1 -- 172.21.15.84:0/4056084283 >> v1:172.21.15.131:6789/0 conn(0x7f62f41598e0 legacy=0x7f62f40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:48.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.936+0000 7f62f3fff700 1 -- 172.21.15.84:0/4056084283 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f40cfbd0 con 0x7f62f40cbae0 2023-10-06T03:24:48.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f3fff700 1 --2- 172.21.15.84:0/4056084283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f40cbae0 0x7f62f40cef30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f62f4088fb0 tx=0x7f62ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2a788169f3e929 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:48.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f27fc700 1 -- 172.21.15.84:0/4056084283 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00b820 con 0x7f62f40cbae0 2023-10-06T03:24:48.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f27fc700 1 -- 172.21.15.84:0/4056084283 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec00b980 con 0x7f62f40cbae0 2023-10-06T03:24:48.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f27fc700 1 -- 172.21.15.84:0/4056084283 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00bd20 con 0x7f62f40cbae0 2023-10-06T03:24:48.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f9acf700 1 -- 172.21.15.84:0/4056084283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f40cbae0 msgr2=0x7f62f40cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f9acf700 1 --2- 172.21.15.84:0/4056084283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f40cbae0 0x7f62f40cef30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f62f4088fb0 tx=0x7f62ec009250 comp rx=0 tx=0).stop 2023-10-06T03:24:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f9acf700 1 -- 172.21.15.84:0/4056084283 shutdown_connections 2023-10-06T03:24:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f9acf700 1 --2- 172.21.15.84:0/4056084283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f40cbae0 0x7f62f40cef30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f9acf700 1 --2- 172.21.15.84:0/4056084283 >> v2:172.21.15.131:3300/0 conn(0x7f62f4159510 0x7f62f40cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f9acf700 1 -- 172.21.15.84:0/4056084283 >> 172.21.15.84:0/4056084283 conn(0x7f62f4089e90 msgr2=0x7f62f40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f9acf700 1 -- 172.21.15.84:0/4056084283 shutdown_connections 2023-10-06T03:24:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.937+0000 7f62f9acf700 1 -- 172.21.15.84:0/4056084283 wait complete. 2023-10-06T03:24:48.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f9acf700 1 Processor -- start 2023-10-06T03:24:48.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f9acf700 1 -- start start 2023-10-06T03:24:48.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f9acf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f40cbae0 0x7f62f40b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f9acf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62f4159510 0x7f62f414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f9acf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f41598e0 0x7f62f414ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f9acf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40b44c0 con 0x7f62f41598e0 2023-10-06T03:24:48.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f9acf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40b41e0 con 0x7f62f40cbae0 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f9acf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40c9c90 con 0x7f62f4159510 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f41598e0 0x7f62f414ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f41598e0 0x7f62f414ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52320/0 (socket says 172.21.15.84:52320) 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f3fff700 1 -- 172.21.15.84:0/514557199 learned_addr learned my addr 172.21.15.84:0/514557199 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62f37fe700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f40cbae0 0x7f62f40b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.939+0000 7f62f2ffd700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62f4159510 0x7f62f414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62f3fff700 1 -- 172.21.15.84:0/514557199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62f4159510 msgr2=0x7f62f414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62f3fff700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62f4159510 0x7f62f414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62f3fff700 1 -- 172.21.15.84:0/514557199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f40cbae0 msgr2=0x7f62f40b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62f3fff700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f40cbae0 0x7f62f40b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62f3fff700 1 -- 172.21.15.84:0/514557199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec0094f0 con 0x7f62f41598e0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62f3fff700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f41598e0 0x7f62f414ac70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f62f40cc0b0 tx=0x7f62ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62db7fe700 1 -- 172.21.15.84:0/514557199 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec01b450 con 0x7f62f41598e0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62db7fe700 1 -- 172.21.15.84:0/514557199 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec020070 con 0x7f62f41598e0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62db7fe700 1 -- 172.21.15.84:0/514557199 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec01b820 con 0x7f62f41598e0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62f9acf700 1 -- 172.21.15.84:0/514557199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f40c9f70 con 0x7f62f41598e0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.940+0000 7f62f9acf700 1 -- 172.21.15.84:0/514557199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f40b62c0 con 0x7f62f41598e0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.941+0000 7f62f9acf700 1 -- 172.21.15.84:0/514557199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f40ca490 con 0x7f62f41598e0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.941+0000 7f62db7fe700 1 -- 172.21.15.84:0/514557199 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62ec022030 con 0x7f62f41598e0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.942+0000 7f62db7fe700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e0066f30 0x7f62e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.942+0000 7f62db7fe700 1 -- 172.21.15.84:0/514557199 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f62ec0867a0 con 0x7f62f41598e0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.942+0000 7f62f37fe700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e0066f30 0x7f62e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.942+0000 7f62f37fe700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e0066f30 0x7f62e00693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62e400f610 tx=0x7f62e40077f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:48.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:48.946+0000 7f62db7fe700 1 -- 172.21.15.84:0/514557199 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62f40ca490 con 0x7f62f41598e0 2023-10-06T03:24:49.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.170+0000 7f62f9acf700 1 -- 172.21.15.84:0/514557199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f62f40ca490 con 0x7f62f41598e0 2023-10-06T03:24:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.824+0000 7f62db7fe700 1 -- 172.21.15.84:0/514557199 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f62f40ca490 con 0x7f62f41598e0 2023-10-06T03:24:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.828+0000 7f62f9acf700 1 -- 172.21.15.84:0/514557199 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e0066f30 msgr2=0x7f62e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.828+0000 7f62f9acf700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e0066f30 0x7f62e00693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62e400f610 tx=0x7f62e40077f0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.828+0000 7f62f9acf700 1 -- 172.21.15.84:0/514557199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f41598e0 msgr2=0x7f62f414ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.828+0000 7f62f9acf700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f41598e0 0x7f62f414ac70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f62f40cc0b0 tx=0x7f62ec016000 comp rx=0 tx=0).stop 2023-10-06T03:24:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.829+0000 7f62f9acf700 1 -- 172.21.15.84:0/514557199 shutdown_connections 2023-10-06T03:24:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.829+0000 7f62f9acf700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e0066f30 0x7f62e00693e0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62e400f610 tx=0x7f62e40077f0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.829+0000 7f62f9acf700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f40cbae0 0x7f62f40b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.829+0000 7f62f9acf700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f41598e0 0x7f62f414ac70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.829+0000 7f62f9acf700 1 --2- 172.21.15.84:0/514557199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62f4159510 0x7f62f414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.829+0000 7f62f9acf700 1 -- 172.21.15.84:0/514557199 >> 172.21.15.84:0/514557199 conn(0x7f62f4089e90 msgr2=0x7f62f40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.829+0000 7f62f9acf700 1 -- 172.21.15.84:0/514557199 shutdown_connections 2023-10-06T03:24:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.829+0000 7f62f9acf700 1 -- 172.21.15.84:0/514557199 wait complete. 2023-10-06T03:24:49.833 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T03:24:49.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.958+0000 7ff24e118700 1 Processor -- start 2023-10-06T03:24:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.958+0000 7ff24e118700 1 -- start start 2023-10-06T03:24:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff24e118700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff2480cc920 0x7ff24806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff24e118700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff24806c1a0 0x7ff2480c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff24e118700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24806c9e0 con 0x7ff248156390 2023-10-06T03:24:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff24e118700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff248156b60 con 0x7ff2480cc920 2023-10-06T03:24:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff24e118700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff248156e40 con 0x7ff24806c1a0 2023-10-06T03:24:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff247fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff24806c1a0 0x7ff2480c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff246ffd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff2480cc920 0x7ff24806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff2477fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff248156390 0x7ff2480cc210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:57638/0 (socket says 172.21.15.84:57638) 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff2477fe700 1 -- 172.21.15.84:0/2891307269 learned_addr learned my addr 172.21.15.84:0/2891307269 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff247fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff24806c1a0 0x7ff2480c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:37542/0 (socket says 172.21.15.84:37542) 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.959+0000 7ff246ffd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff2480cc920 0x7ff24806bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:49714/0 (socket says 172.21.15.84:49714) 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff2467fc700 1 -- 172.21.15.84:0/2891307269 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231784725 0 0) 0x7ff24806c9e0 con 0x7ff248156390 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff2467fc700 1 -- 172.21.15.84:0/2891307269 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff230003570 con 0x7ff248156390 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff246ffd700 1 -- 172.21.15.84:0/2891307269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff24806c1a0 msgr2=0x7ff2480c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff246ffd700 1 --2- 172.21.15.84:0/2891307269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff24806c1a0 0x7ff2480c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff246ffd700 1 -- 172.21.15.84:0/2891307269 >> v1:172.21.15.131:6789/0 conn(0x7ff248156390 legacy=0x7ff2480cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff246ffd700 1 -- 172.21.15.84:0/2891307269 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff248157120 con 0x7ff2480cc920 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff247fff700 1 --2- 172.21.15.84:0/2891307269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff24806c1a0 0x7ff2480c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff246ffd700 1 --2- 172.21.15.84:0/2891307269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2480cc920 0x7ff24806bc60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0098e0 tx=0x7ff23c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59480e8d2e47ff95 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff2467fc700 1 -- 172.21.15.84:0/2891307269 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c011630 con 0x7ff2480cc920 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff2467fc700 1 -- 172.21.15.84:0/2891307269 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c011790 con 0x7ff2480cc920 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.960+0000 7ff2467fc700 1 -- 172.21.15.84:0/2891307269 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c011b10 con 0x7ff2480cc920 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.961+0000 7ff24e118700 1 -- 172.21.15.84:0/2891307269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2480cc920 msgr2=0x7ff24806bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.961+0000 7ff24e118700 1 --2- 172.21.15.84:0/2891307269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2480cc920 0x7ff24806bc60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0098e0 tx=0x7ff23c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.961+0000 7ff24e118700 1 -- 172.21.15.84:0/2891307269 shutdown_connections 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.961+0000 7ff24e118700 1 --2- 172.21.15.84:0/2891307269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff24806c1a0 0x7ff2480c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.961+0000 7ff24e118700 1 --2- 172.21.15.84:0/2891307269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2480cc920 0x7ff24806bc60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.961+0000 7ff24e118700 1 -- 172.21.15.84:0/2891307269 >> 172.21.15.84:0/2891307269 conn(0x7ff2480cdef0 msgr2=0x7ff2480c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.961+0000 7ff24e118700 1 -- 172.21.15.84:0/2891307269 shutdown_connections 2023-10-06T03:24:49.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.961+0000 7ff24e118700 1 -- 172.21.15.84:0/2891307269 wait complete. 2023-10-06T03:24:49.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.962+0000 7ff24e118700 1 Processor -- start 2023-10-06T03:24:49.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.962+0000 7ff24e118700 1 -- start start 2023-10-06T03:24:49.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff24e118700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff24806c1a0 0x7ff2481671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff24e118700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2480cc920 0x7ff2480676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff24e118700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff248156390 0x7ff248067c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff24e118700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480b2550 con 0x7ff2480cc920 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff24e118700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480b2830 con 0x7ff24806c1a0 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff24e118700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480b2b10 con 0x7ff248156390 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff246ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2480cc920 0x7ff2480676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff246ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2480cc920 0x7ff2480676e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52328/0 (socket says 172.21.15.84:52328) 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff246ffd700 1 -- 172.21.15.84:0/2198925921 learned_addr learned my addr 172.21.15.84:0/2198925921 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff247fff700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff248156390 0x7ff248067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff2477fe700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff24806c1a0 0x7ff2481671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff246ffd700 1 -- 172.21.15.84:0/2198925921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff248156390 msgr2=0x7ff248067c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff246ffd700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff248156390 0x7ff248067c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff246ffd700 1 -- 172.21.15.84:0/2198925921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff24806c1a0 msgr2=0x7ff2481671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff246ffd700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff24806c1a0 0x7ff2481671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff246ffd700 1 -- 172.21.15.84:0/2198925921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240009420 con 0x7ff2480cc920 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff246ffd700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2480cc920 0x7ff2480676e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff23c013000 tx=0x7ff23c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.963+0000 7ff22f7fe700 1 -- 172.21.15.84:0/2198925921 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c011b10 con 0x7ff2480cc920 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.964+0000 7ff22f7fe700 1 -- 172.21.15.84:0/2198925921 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c000c90 con 0x7ff2480cc920 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.964+0000 7ff24e118700 1 -- 172.21.15.84:0/2198925921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c009420 con 0x7ff2480cc920 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.964+0000 7ff22f7fe700 1 -- 172.21.15.84:0/2198925921 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c01a660 con 0x7ff2480cc920 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.964+0000 7ff24e118700 1 -- 172.21.15.84:0/2198925921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff248167710 con 0x7ff2480cc920 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.964+0000 7ff24e118700 1 -- 172.21.15.84:0/2198925921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff248167b90 con 0x7ff2480cc920 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.965+0000 7ff22f7fe700 1 -- 172.21.15.84:0/2198925921 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff23c01aa50 con 0x7ff2480cc920 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.965+0000 7ff22f7fe700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff234066f30 0x7ff2340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.965+0000 7ff22f7fe700 1 -- 172.21.15.84:0/2198925921 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff23c086390 con 0x7ff2480cc920 2023-10-06T03:24:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.965+0000 7ff2477fe700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff234066f30 0x7ff2340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.966+0000 7ff2477fe700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff234066f30 0x7ff2340693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff238005c50 tx=0x7ff238009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:49.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:49.969+0000 7ff22f7fe700 1 -- 172.21.15.84:0/2198925921 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff248167b90 con 0x7ff2480cc920 2023-10-06T03:24:50.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.154+0000 7ff24e118700 1 -- 172.21.15.84:0/2198925921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff248167b90 con 0x7ff2480cc920 2023-10-06T03:24:50.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.155+0000 7ff22f7fe700 1 -- 172.21.15.84:0/2198925921 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17084 (secure 0 0 0) 0x7ff248167b90 con 0x7ff2480cc920 2023-10-06T03:24:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:50.157 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:24:49.172056+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:46.821084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:48.147630+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 -- 172.21.15.84:0/2198925921 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff234066f30 msgr2=0x7ff2340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff234066f30 0x7ff2340693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff238005c50 tx=0x7ff238009040 comp rx=0 tx=0).stop 2023-10-06T03:24:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 -- 172.21.15.84:0/2198925921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2480cc920 msgr2=0x7ff2480676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2480cc920 0x7ff2480676e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff23c013000 tx=0x7ff23c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 -- 172.21.15.84:0/2198925921 shutdown_connections 2023-10-06T03:24:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff234066f30 0x7ff2340693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff24806c1a0 0x7ff2481671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff248156390 0x7ff248067c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 --2- 172.21.15.84:0/2198925921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2480cc920 0x7ff2480676e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 -- 172.21.15.84:0/2198925921 >> 172.21.15.84:0/2198925921 conn(0x7ff2480cdef0 msgr2=0x7ff2480c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 -- 172.21.15.84:0/2198925921 shutdown_connections 2023-10-06T03:24:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.157+0000 7ff24e118700 1 -- 172.21.15.84:0/2198925921 wait complete. 2023-10-06T03:24:50.172 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.284+0000 7f14a5760700 1 Processor -- start 2023-10-06T03:24:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.284+0000 7f14a5760700 1 -- start start 2023-10-06T03:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f14a5760700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 0x7f14a01582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f14a5760700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f14a00ce8e0 0x7f14a015af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f14a5760700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a0157e20 con 0x7f14a00adba0 2023-10-06T03:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f14a5760700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a00cbbd0 con 0x7f14a00ce8e0 2023-10-06T03:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f14a5760700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00cb610 con 0x7f14a00ca3b0 2023-10-06T03:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f14a00ce8e0 0x7f14a015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f14a00ce8e0 0x7f14a015af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52342/0 (socket says 172.21.15.84:52342) 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149f7fe700 1 -- 172.21.15.84:0/3307742349 learned_addr learned my addr 172.21.15.84:0/3307742349 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149e7fc700 1 --1- 172.21.15.84:0/3307742349 >> v1:172.21.15.84:6789/0 conn(0x7f14a00adba0 0x7f14a00ce1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40314/0 (socket says 172.21.15.84:40314) 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149effd700 1 --2- 172.21.15.84:0/3307742349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 0x7f14a01582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149f7fe700 1 -- 172.21.15.84:0/3307742349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 msgr2=0x7f14a01582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149f7fe700 1 --2- 172.21.15.84:0/3307742349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 0x7f14a01582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149f7fe700 1 -- 172.21.15.84:0/3307742349 >> v1:172.21.15.84:6789/0 conn(0x7f14a00adba0 legacy=0x7f14a00ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149f7fe700 1 -- 172.21.15.84:0/3307742349 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00cb8f0 con 0x7f14a00ce8e0 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149effd700 1 --2- 172.21.15.84:0/3307742349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 0x7f14a01582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149dffb700 1 -- 172.21.15.84:0/3307742349 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154285558 0 0) 0x7f14a0157e20 con 0x7f14a00adba0 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149f7fe700 1 --2- 172.21.15.84:0/3307742349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00ce8e0 0x7f14a015af10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1498009f20 tx=0x7f1498009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2812c12330efa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149dffb700 1 -- 172.21.15.84:0/3307742349 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800e070 con 0x7f14a00ce8e0 2023-10-06T03:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149dffb700 1 -- 172.21.15.84:0/3307742349 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149800ba80 con 0x7f14a00ce8e0 2023-10-06T03:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.285+0000 7f149dffb700 1 -- 172.21.15.84:0/3307742349 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980092e0 con 0x7f14a00ce8e0 2023-10-06T03:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.286+0000 7f14a5760700 1 -- 172.21.15.84:0/3307742349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00ce8e0 msgr2=0x7f14a015af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.286+0000 7f14a5760700 1 --2- 172.21.15.84:0/3307742349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00ce8e0 0x7f14a015af10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1498009f20 tx=0x7f1498009840 comp rx=0 tx=0).stop 2023-10-06T03:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.286+0000 7f14a5760700 1 -- 172.21.15.84:0/3307742349 shutdown_connections 2023-10-06T03:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.286+0000 7f14a5760700 1 --2- 172.21.15.84:0/3307742349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00ce8e0 0x7f14a015af10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.286+0000 7f14a5760700 1 --2- 172.21.15.84:0/3307742349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 0x7f14a01582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.286+0000 7f14a5760700 1 -- 172.21.15.84:0/3307742349 >> 172.21.15.84:0/3307742349 conn(0x7f14a0070810 msgr2=0x7f14a0070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.286+0000 7f14a5760700 1 -- 172.21.15.84:0/3307742349 shutdown_connections 2023-10-06T03:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.286+0000 7f14a5760700 1 -- 172.21.15.84:0/3307742349 wait complete. 2023-10-06T03:24:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.287+0000 7f14a5760700 1 Processor -- start 2023-10-06T03:24:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.287+0000 7f14a5760700 1 -- start start 2023-10-06T03:24:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f14a5760700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00adba0 0x7f14a00c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f14a5760700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 0x7f14a00c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f14a5760700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a00ce8e0 0x7f14a0146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f14a5760700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0145da0 con 0x7f14a00adba0 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f14a5760700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0146080 con 0x7f14a00ce8e0 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f14a5760700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0146360 con 0x7f14a00ca3b0 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00adba0 0x7f14a00c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00adba0 0x7f14a00c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52352/0 (socket says 172.21.15.84:52352) 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149effd700 1 -- 172.21.15.84:0/187872781 learned_addr learned my addr 172.21.15.84:0/187872781 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149e7fc700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 0x7f14a00c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149effd700 1 -- 172.21.15.84:0/187872781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 msgr2=0x7f14a00c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149effd700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 0x7f14a00c1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149f7fe700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a00ce8e0 0x7f14a0146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149effd700 1 -- 172.21.15.84:0/187872781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a00ce8e0 msgr2=0x7f14a0146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149effd700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a00ce8e0 0x7f14a0146e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149effd700 1 -- 172.21.15.84:0/187872781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1498009ae0 con 0x7f14a00adba0 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149e7fc700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 0x7f14a00c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.288+0000 7f149effd700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00adba0 0x7f14a00c4850 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f149000d860 tx=0x7f1490008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.289+0000 7f1486ffd700 1 -- 172.21.15.84:0/187872781 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14900125f0 con 0x7f14a00adba0 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.289+0000 7f1486ffd700 1 -- 172.21.15.84:0/187872781 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490012750 con 0x7f14a00adba0 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.289+0000 7f14a5760700 1 -- 172.21.15.84:0/187872781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a0146640 con 0x7f14a00adba0 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.289+0000 7f1486ffd700 1 -- 172.21.15.84:0/187872781 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490012ad0 con 0x7f14a00adba0 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.289+0000 7f14a5760700 1 -- 172.21.15.84:0/187872781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a00c4d90 con 0x7f14a00adba0 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.290+0000 7f14a5760700 1 -- 172.21.15.84:0/187872781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a0146c90 con 0x7f14a00adba0 2023-10-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.290+0000 7f1486ffd700 1 -- 172.21.15.84:0/187872781 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1490014430 con 0x7f14a00adba0 2023-10-06T03:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.290+0000 7f1486ffd700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f148c066f30 0x7f148c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.291+0000 7f149e7fc700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f148c066f30 0x7f148c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.291+0000 7f1486ffd700 1 -- 172.21.15.84:0/187872781 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1490084c20 con 0x7f14a00adba0 2023-10-06T03:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.291+0000 7f149e7fc700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f148c066f30 0x7f148c0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f14a00b3cf0 tx=0x7f1494009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.295+0000 7f1486ffd700 1 -- 172.21.15.84:0/187872781 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1490055680 con 0x7f14a00adba0 2023-10-06T03:24:50.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.480+0000 7f14a5760700 1 -- 172.21.15.84:0/187872781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14a0064ad0 con 0x7f14a00adba0 2023-10-06T03:24:50.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.481+0000 7f1486ffd700 1 -- 172.21.15.84:0/187872781 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17084 (secure 0 0 0) 0x7f1490055210 con 0x7f14a00adba0 2023-10-06T03:24:50.483 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:50.483 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:24:49.172056+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:46.821084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:48.147630+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 -- 172.21.15.84:0/187872781 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f148c066f30 msgr2=0x7f148c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f148c066f30 0x7f148c0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f14a00b3cf0 tx=0x7f1494009040 comp rx=0 tx=0).stop 2023-10-06T03:24:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 -- 172.21.15.84:0/187872781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00adba0 msgr2=0x7f14a00c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00adba0 0x7f14a00c4850 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f149000d860 tx=0x7f1490008040 comp rx=0 tx=0).stop 2023-10-06T03:24:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 -- 172.21.15.84:0/187872781 shutdown_connections 2023-10-06T03:24:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f148c066f30 0x7f148c0693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a00ce8e0 0x7f14a0146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14a00adba0 0x7f14a00c4850 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 --2- 172.21.15.84:0/187872781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14a00ca3b0 0x7f14a00c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 -- 172.21.15.84:0/187872781 >> 172.21.15.84:0/187872781 conn(0x7f14a0070810 msgr2=0x7f14a00cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:50.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 -- 172.21.15.84:0/187872781 shutdown_connections 2023-10-06T03:24:50.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.483+0000 7f14a5760700 1 -- 172.21.15.84:0/187872781 wait complete. 2023-10-06T03:24:50.496 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:24:50.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.611+0000 7fdef46e6700 1 Processor -- start 2023-10-06T03:24:50.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.611+0000 7fdef46e6700 1 -- start start 2023-10-06T03:24:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.612+0000 7fdef46e6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdeec159510 0x7fdeec0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.612+0000 7fdef46e6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 0x7fdeec0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.612+0000 7fdef46e6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdeec0ce820 0x7fdeec0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.612+0000 7fdef46e6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec0cf610 con 0x7fdeec159510 2023-10-06T03:24:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.612+0000 7fdef46e6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec0cf8f0 con 0x7fdeec0ce820 2023-10-06T03:24:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.612+0000 7fdef46e6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0cfbd0 con 0x7fdeec1598e0 2023-10-06T03:24:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef2482700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdeec159510 0x7fdeec0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef2482700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdeec159510 0x7fdeec0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57384/0 (socket says 172.21.15.84:57384) 2023-10-06T03:24:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef2482700 1 -- 172.21.15.84:0/2985811156 learned_addr learned my addr 172.21.15.84:0/2985811156 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef2c83700 1 --2- 172.21.15.84:0/2985811156 >> v2:172.21.15.131:3300/0 conn(0x7fdeec0ce820 0x7fdeec0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef1c81700 1 --2- 172.21.15.84:0/2985811156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 0x7fdeec0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef2482700 1 -- 172.21.15.84:0/2985811156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 msgr2=0x7fdeec0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef2482700 1 --2- 172.21.15.84:0/2985811156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 0x7fdeec0cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef2482700 1 -- 172.21.15.84:0/2985811156 >> v2:172.21.15.131:3300/0 conn(0x7fdeec0ce820 msgr2=0x7fdeec0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef2482700 1 --2- 172.21.15.84:0/2985811156 >> v2:172.21.15.131:3300/0 conn(0x7fdeec0ce820 0x7fdeec0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef2482700 1 -- 172.21.15.84:0/2985811156 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0cfeb0 con 0x7fdeec159510 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef2482700 1 --2- 172.21.15.84:0/2985811156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec159510 0x7fdeec0cb5a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdeec08acb0 tx=0x7fdee8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169819d2dd2ec8d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef1480700 1 -- 172.21.15.84:0/2985811156 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee800e070 con 0x7fdeec159510 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef1480700 1 -- 172.21.15.84:0/2985811156 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee800ba50 con 0x7fdeec159510 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.613+0000 7fdef1480700 1 -- 172.21.15.84:0/2985811156 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80092e0 con 0x7fdeec159510 2023-10-06T03:24:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.614+0000 7fdef46e6700 1 -- 172.21.15.84:0/2985811156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec159510 msgr2=0x7fdeec0cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.614+0000 7fdef46e6700 1 --2- 172.21.15.84:0/2985811156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec159510 0x7fdeec0cb5a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdeec08acb0 tx=0x7fdee8009840 comp rx=0 tx=0).stop 2023-10-06T03:24:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.614+0000 7fdef46e6700 1 -- 172.21.15.84:0/2985811156 shutdown_connections 2023-10-06T03:24:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.614+0000 7fdef46e6700 1 --2- 172.21.15.84:0/2985811156 >> v2:172.21.15.131:3300/0 conn(0x7fdeec0ce820 0x7fdeec0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.614+0000 7fdef46e6700 1 --2- 172.21.15.84:0/2985811156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec159510 0x7fdeec0cb5a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.614+0000 7fdef46e6700 1 --2- 172.21.15.84:0/2985811156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 0x7fdeec0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.614+0000 7fdef46e6700 1 -- 172.21.15.84:0/2985811156 >> 172.21.15.84:0/2985811156 conn(0x7fdeec089e90 msgr2=0x7fdeec0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.614+0000 7fdef46e6700 1 -- 172.21.15.84:0/2985811156 shutdown_connections 2023-10-06T03:24:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.614+0000 7fdef46e6700 1 -- 172.21.15.84:0/2985811156 wait complete. 2023-10-06T03:24:50.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.615+0000 7fdef46e6700 1 Processor -- start 2023-10-06T03:24:50.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.615+0000 7fdef46e6700 1 -- start start 2023-10-06T03:24:50.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.615+0000 7fdef46e6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec0ce820 0x7fdeec16e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.615+0000 7fdef46e6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdeec159510 0x7fdeec069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef46e6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 0x7fdeec069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef46e6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec15bcc0 con 0x7fdeec0ce820 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef46e6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec16e5f0 con 0x7fdeec159510 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef46e6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec15c590 con 0x7fdeec1598e0 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2482700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec0ce820 0x7fdeec16e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2482700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec0ce820 0x7fdeec16e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57396/0 (socket says 172.21.15.84:57396) 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2482700 1 -- 172.21.15.84:0/448447816 learned_addr learned my addr 172.21.15.84:0/448447816 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2c83700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 0x7fdeec069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef1c81700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdeec159510 0x7fdeec069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2482700 1 -- 172.21.15.84:0/448447816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 msgr2=0x7fdeec069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2482700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 0x7fdeec069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2482700 1 -- 172.21.15.84:0/448447816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdeec159510 msgr2=0x7fdeec069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2482700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdeec159510 0x7fdeec069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2482700 1 -- 172.21.15.84:0/448447816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8009ae0 con 0x7fdeec0ce820 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2c83700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 0x7fdeec069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef1c81700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdeec159510 0x7fdeec069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef2482700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec0ce820 0x7fdeec16e0b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdeec067c60 tx=0x7fdee8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdee27fc700 1 -- 172.21.15.84:0/448447816 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8008bb0 con 0x7fdeec0ce820 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdee27fc700 1 -- 172.21.15.84:0/448447816 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee8008d50 con 0x7fdeec0ce820 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef46e6700 1 -- 172.21.15.84:0/448447816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec15b0b0 con 0x7fdeec0ce820 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdee27fc700 1 -- 172.21.15.84:0/448447816 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80266b0 con 0x7fdeec0ce820 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.616+0000 7fdef46e6700 1 -- 172.21.15.84:0/448447816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec15b670 con 0x7fdeec0ce820 2023-10-06T03:24:50.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.617+0000 7fdef46e6700 1 -- 172.21.15.84:0/448447816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeec064ad0 con 0x7fdeec0ce820 2023-10-06T03:24:50.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.618+0000 7fdee27fc700 1 -- 172.21.15.84:0/448447816 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdee8003040 con 0x7fdeec0ce820 2023-10-06T03:24:50.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.618+0000 7fdee27fc700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded0066f30 0x7fded00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.618+0000 7fdee27fc700 1 -- 172.21.15.84:0/448447816 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdee8086020 con 0x7fdeec0ce820 2023-10-06T03:24:50.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.618+0000 7fdef1c81700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded0066f30 0x7fded00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.618+0000 7fdef1c81700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded0066f30 0x7fded00693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdeec16e810 tx=0x7fdedc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:50.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.622+0000 7fdee27fc700 1 -- 172.21.15.84:0/448447816 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdee80530a0 con 0x7fdeec0ce820 2023-10-06T03:24:50.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:50.848+0000 7fdef46e6700 1 -- 172.21.15.84:0/448447816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdeec0b4330 con 0x7fdeec0ce820 2023-10-06T03:24:51.622 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:24:51.620+0000 7f78825d6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:24:51.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.829+0000 7fdee27fc700 1 -- 172.21.15.84:0/448447816 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdee8009940 con 0x7fdeec0ce820 2023-10-06T03:24:51.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 -- 172.21.15.84:0/448447816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded0066f30 msgr2=0x7fded00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded0066f30 0x7fded00693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdeec16e810 tx=0x7fdedc008040 comp rx=0 tx=0).stop 2023-10-06T03:24:51.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 -- 172.21.15.84:0/448447816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec0ce820 msgr2=0x7fdeec16e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec0ce820 0x7fdeec16e0b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdeec067c60 tx=0x7fdee8018000 comp rx=0 tx=0).stop 2023-10-06T03:24:51.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 -- 172.21.15.84:0/448447816 shutdown_connections 2023-10-06T03:24:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded0066f30 0x7fded00693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeec1598e0 0x7fdeec069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec0ce820 0x7fdeec16e0b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 --2- 172.21.15.84:0/448447816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdeec159510 0x7fdeec069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 -- 172.21.15.84:0/448447816 >> 172.21.15.84:0/448447816 conn(0x7fdeec089e90 msgr2=0x7fdeec15da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 -- 172.21.15.84:0/448447816 shutdown_connections 2023-10-06T03:24:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.831+0000 7fdef46e6700 1 -- 172.21.15.84:0/448447816 wait complete. 2023-10-06T03:24:51.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:24:51.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.966+0000 7ffa1fa50700 1 Processor -- start 2023-10-06T03:24:51.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.966+0000 7ffa1fa50700 1 -- start start 2023-10-06T03:24:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.967+0000 7ffa1fa50700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffa180cc860 0x7ffa180ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.967+0000 7ffa1fa50700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1806eff0 0x7ffa180c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.967+0000 7ffa1fa50700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffa180675f0 0x7ffa18067a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.967+0000 7ffa1fa50700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa18159c00 con 0x7ffa180cc860 2023-10-06T03:24:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.967+0000 7ffa1fa50700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1806f460 con 0x7ffa180675f0 2023-10-06T03:24:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.967+0000 7ffa1fa50700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1815abb0 con 0x7ffa1806eff0 2023-10-06T03:24:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.967+0000 7ffa1d7ec700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffa180cc860 0x7ffa180ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.967+0000 7ffa1d7ec700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffa180cc860 0x7ffa180ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57402/0 (socket says 172.21.15.84:57402) 2023-10-06T03:24:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa1d7ec700 1 -- 172.21.15.84:0/390906850 learned_addr learned my addr 172.21.15.84:0/390906850 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa1cfeb700 1 --2- 172.21.15.84:0/390906850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1806eff0 0x7ffa180c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa1dfed700 1 --2- 172.21.15.84:0/390906850 >> v2:172.21.15.131:3300/0 conn(0x7ffa180675f0 0x7ffa18067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa1d7ec700 1 -- 172.21.15.84:0/390906850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1806eff0 msgr2=0x7ffa180c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa1d7ec700 1 --2- 172.21.15.84:0/390906850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1806eff0 0x7ffa180c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa1d7ec700 1 -- 172.21.15.84:0/390906850 >> v2:172.21.15.131:3300/0 conn(0x7ffa180675f0 msgr2=0x7ffa18067a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa1d7ec700 1 --2- 172.21.15.84:0/390906850 >> v2:172.21.15.131:3300/0 conn(0x7ffa180675f0 0x7ffa18067a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa1d7ec700 1 -- 172.21.15.84:0/390906850 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa180cbfb0 con 0x7ffa180cc860 2023-10-06T03:24:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa1d7ec700 1 --2- 172.21.15.84:0/390906850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa180cc860 0x7ffa180ccc30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffa180cdb80 tx=0x7ffa08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c4f02a39d48e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa17fff700 1 -- 172.21.15.84:0/390906850 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800e070 con 0x7ffa180cc860 2023-10-06T03:24:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa17fff700 1 -- 172.21.15.84:0/390906850 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0800ba40 con 0x7ffa180cc860 2023-10-06T03:24:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.968+0000 7ffa17fff700 1 -- 172.21.15.84:0/390906850 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080092e0 con 0x7ffa180cc860 2023-10-06T03:24:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.969+0000 7ffa1fa50700 1 -- 172.21.15.84:0/390906850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa180cc860 msgr2=0x7ffa180ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.969+0000 7ffa1fa50700 1 --2- 172.21.15.84:0/390906850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa180cc860 0x7ffa180ccc30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffa180cdb80 tx=0x7ffa08009840 comp rx=0 tx=0).stop 2023-10-06T03:24:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.969+0000 7ffa1fa50700 1 -- 172.21.15.84:0/390906850 shutdown_connections 2023-10-06T03:24:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.969+0000 7ffa1fa50700 1 --2- 172.21.15.84:0/390906850 >> v2:172.21.15.131:3300/0 conn(0x7ffa180675f0 0x7ffa18067a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.969+0000 7ffa1fa50700 1 --2- 172.21.15.84:0/390906850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa180cc860 0x7ffa180ccc30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.969+0000 7ffa1fa50700 1 --2- 172.21.15.84:0/390906850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1806eff0 0x7ffa180c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.969+0000 7ffa1fa50700 1 -- 172.21.15.84:0/390906850 >> 172.21.15.84:0/390906850 conn(0x7ffa180691d0 msgr2=0x7ffa180cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.969+0000 7ffa1fa50700 1 -- 172.21.15.84:0/390906850 shutdown_connections 2023-10-06T03:24:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.969+0000 7ffa1fa50700 1 -- 172.21.15.84:0/390906850 wait complete. 2023-10-06T03:24:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.970+0000 7ffa1fa50700 1 Processor -- start 2023-10-06T03:24:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.970+0000 7ffa1fa50700 1 -- start start 2023-10-06T03:24:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1fa50700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa180675f0 0x7ffa180adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1fa50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa1806eff0 0x7ffa180ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1fa50700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa180cc860 0x7ffa18169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1fa50700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1816b9c0 con 0x7ffa1806eff0 2023-10-06T03:24:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1fa50700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1816adb0 con 0x7ffa180675f0 2023-10-06T03:24:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1fa50700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1816b090 con 0x7ffa180cc860 2023-10-06T03:24:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1cfeb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa1806eff0 0x7ffa180ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1cfeb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa1806eff0 0x7ffa180ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57408/0 (socket says 172.21.15.84:57408) 2023-10-06T03:24:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1cfeb700 1 -- 172.21.15.84:0/3407820769 learned_addr learned my addr 172.21.15.84:0/3407820769 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1dfed700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa180cc860 0x7ffa18169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1d7ec700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa180675f0 0x7ffa180adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1cfeb700 1 -- 172.21.15.84:0/3407820769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa180cc860 msgr2=0x7ffa18169ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1cfeb700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa180cc860 0x7ffa18169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1cfeb700 1 -- 172.21.15.84:0/3407820769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa180675f0 msgr2=0x7ffa180adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1cfeb700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa180675f0 0x7ffa180adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1cfeb700 1 -- 172.21.15.84:0/3407820769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa08009ae0 con 0x7ffa1806eff0 2023-10-06T03:24:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1cfeb700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa1806eff0 0x7ffa180ae070 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00d890 tx=0x7ffa0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa157fa700 1 -- 172.21.15.84:0/3407820769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c00b600 con 0x7ffa1806eff0 2023-10-06T03:24:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa157fa700 1 -- 172.21.15.84:0/3407820769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c00b760 con 0x7ffa1806eff0 2023-10-06T03:24:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.971+0000 7ffa1fa50700 1 -- 172.21.15.84:0/3407820769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1816b370 con 0x7ffa1806eff0 2023-10-06T03:24:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.972+0000 7ffa157fa700 1 -- 172.21.15.84:0/3407820769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c00bae0 con 0x7ffa1806eff0 2023-10-06T03:24:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.972+0000 7ffa1fa50700 1 -- 172.21.15.84:0/3407820769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa180ae5b0 con 0x7ffa1806eff0 2023-10-06T03:24:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.972+0000 7ffa1fa50700 1 -- 172.21.15.84:0/3407820769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa18064ad0 con 0x7ffa1806eff0 2023-10-06T03:24:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.973+0000 7ffa157fa700 1 -- 172.21.15.84:0/3407820769 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa0c01e460 con 0x7ffa1806eff0 2023-10-06T03:24:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.973+0000 7ffa157fa700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ffa04066f30 0x7ffa040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.973+0000 7ffa157fa700 1 -- 172.21.15.84:0/3407820769 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffa0c084eb0 con 0x7ffa1806eff0 2023-10-06T03:24:51.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.973+0000 7ffa1d7ec700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ffa04066f30 0x7ffa040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.974+0000 7ffa1d7ec700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ffa04066f30 0x7ffa040693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009ea0 tx=0x7ffa08018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:51.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:51.977+0000 7ffa157fa700 1 -- 172.21.15.84:0/3407820769 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa0c051e80 con 0x7ffa1806eff0 2023-10-06T03:24:52.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.200+0000 7ffa1fa50700 1 -- 172.21.15.84:0/3407820769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffa18156540 con 0x7ffa1806eff0 2023-10-06T03:24:52.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.830+0000 7ffa157fa700 1 -- 172.21.15.84:0/3407820769 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffa0c0554a0 con 0x7ffa1806eff0 2023-10-06T03:24:52.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 -- 172.21.15.84:0/3407820769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ffa04066f30 msgr2=0x7ffa040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ffa04066f30 0x7ffa040693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009ea0 tx=0x7ffa08018000 comp rx=0 tx=0).stop 2023-10-06T03:24:52.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 -- 172.21.15.84:0/3407820769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa1806eff0 msgr2=0x7ffa180ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa1806eff0 0x7ffa180ae070 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00d890 tx=0x7ffa0c008040 comp rx=0 tx=0).stop 2023-10-06T03:24:52.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 -- 172.21.15.84:0/3407820769 shutdown_connections 2023-10-06T03:24:52.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ffa04066f30 0x7ffa040693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa180675f0 0x7ffa180adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa180cc860 0x7ffa18169ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 --2- 172.21.15.84:0/3407820769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa1806eff0 0x7ffa180ae070 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 -- 172.21.15.84:0/3407820769 >> 172.21.15.84:0/3407820769 conn(0x7ffa180691d0 msgr2=0x7ffa180a9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:52.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 -- 172.21.15.84:0/3407820769 shutdown_connections 2023-10-06T03:24:52.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.832+0000 7ffa1fa50700 1 -- 172.21.15.84:0/3407820769 wait complete. 2023-10-06T03:24:52.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:52.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.958+0000 7f51241b6700 1 Processor -- start 2023-10-06T03:24:52.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.959+0000 7f51241b6700 1 -- start start 2023-10-06T03:24:52.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.959+0000 7f51241b6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f511c0ca3b0 0x7f511c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.959+0000 7f51241b6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f511c0adba0 0x7f511c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.959+0000 7f51241b6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f511c0ce710 0x7f511c15af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.959+0000 7f51241b6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c0cbbd0 con 0x7f511c0ce710 2023-10-06T03:24:52.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.959+0000 7f51241b6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c157e20 con 0x7f511c0adba0 2023-10-06T03:24:52.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.959+0000 7f51241b6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0ceb30 con 0x7f511c0ca3b0 2023-10-06T03:24:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5122753700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f511c0ce710 0x7f511c15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5122753700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f511c0ce710 0x7f511c15af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57412/0 (socket says 172.21.15.84:57412) 2023-10-06T03:24:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5122753700 1 -- 172.21.15.84:0/3583830473 learned_addr learned my addr 172.21.15.84:0/3583830473 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5121751700 1 --2- 172.21.15.84:0/3583830473 >> v2:172.21.15.131:3300/0 conn(0x7f511c0adba0 0x7f511c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5121f52700 1 --2- 172.21.15.84:0/3583830473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f511c0ca3b0 0x7f511c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5122753700 1 -- 172.21.15.84:0/3583830473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f511c0ca3b0 msgr2=0x7f511c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5122753700 1 --2- 172.21.15.84:0/3583830473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f511c0ca3b0 0x7f511c1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5122753700 1 -- 172.21.15.84:0/3583830473 >> v2:172.21.15.131:3300/0 conn(0x7f511c0adba0 msgr2=0x7f511c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5122753700 1 --2- 172.21.15.84:0/3583830473 >> v2:172.21.15.131:3300/0 conn(0x7f511c0adba0 0x7f511c0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5122753700 1 -- 172.21.15.84:0/3583830473 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c0cb610 con 0x7f511c0ce710 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5122753700 1 --2- 172.21.15.84:0/3583830473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ce710 0x7f511c15af10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f511c06f260 tx=0x7f5114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99aa8bec30e8e108 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5120f50700 1 -- 172.21.15.84:0/3583830473 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511400b640 con 0x7f511c0ce710 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5120f50700 1 -- 172.21.15.84:0/3583830473 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511400b7a0 con 0x7f511c0ce710 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.960+0000 7f5120f50700 1 -- 172.21.15.84:0/3583830473 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511400bb60 con 0x7f511c0ce710 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.961+0000 7f51241b6700 1 -- 172.21.15.84:0/3583830473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ce710 msgr2=0x7f511c15af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.961+0000 7f51241b6700 1 --2- 172.21.15.84:0/3583830473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ce710 0x7f511c15af10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f511c06f260 tx=0x7f5114009250 comp rx=0 tx=0).stop 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.961+0000 7f51241b6700 1 -- 172.21.15.84:0/3583830473 shutdown_connections 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.961+0000 7f51241b6700 1 --2- 172.21.15.84:0/3583830473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ce710 0x7f511c15af10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.961+0000 7f51241b6700 1 --2- 172.21.15.84:0/3583830473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f511c0ca3b0 0x7f511c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.961+0000 7f51241b6700 1 --2- 172.21.15.84:0/3583830473 >> v2:172.21.15.131:3300/0 conn(0x7f511c0adba0 0x7f511c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.961+0000 7f51241b6700 1 -- 172.21.15.84:0/3583830473 >> 172.21.15.84:0/3583830473 conn(0x7f511c070810 msgr2=0x7f511c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.961+0000 7f51241b6700 1 -- 172.21.15.84:0/3583830473 shutdown_connections 2023-10-06T03:24:52.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.961+0000 7f51241b6700 1 -- 172.21.15.84:0/3583830473 wait complete. 2023-10-06T03:24:52.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.962+0000 7f51241b6700 1 Processor -- start 2023-10-06T03:24:52.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.962+0000 7f51241b6700 1 -- start start 2023-10-06T03:24:52.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f51241b6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f511c0adba0 0x7f511c167740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f51241b6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ca3b0 0x7f511c1466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f51241b6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f511c0ce710 0x7f511c159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f51241b6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c168670 con 0x7f511c0ca3b0 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f51241b6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0b2730 con 0x7f511c0ce710 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f51241b6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c167dd0 con 0x7f511c0adba0 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5121751700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ca3b0 0x7f511c1466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5121751700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ca3b0 0x7f511c1466c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57414/0 (socket says 172.21.15.84:57414) 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5121751700 1 -- 172.21.15.84:0/4244989701 learned_addr learned my addr 172.21.15.84:0/4244989701 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5122753700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f511c0ce710 0x7f511c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5121f52700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f511c0adba0 0x7f511c167740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5121751700 1 -- 172.21.15.84:0/4244989701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f511c0adba0 msgr2=0x7f511c167740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5121751700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f511c0adba0 0x7f511c167740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5121751700 1 -- 172.21.15.84:0/4244989701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f511c0ce710 msgr2=0x7f511c159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5121751700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f511c0ce710 0x7f511c159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5121751700 1 -- 172.21.15.84:0/4244989701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51140094f0 con 0x7f511c0ca3b0 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5122753700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f511c0ce710 0x7f511c159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5121751700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ca3b0 0x7f511c1466c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f510c00e930 tx=0x7f510c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5111ffb700 1 -- 172.21.15.84:0/4244989701 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c009510 con 0x7f511c0ca3b0 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5111ffb700 1 -- 172.21.15.84:0/4244989701 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c00c850 con 0x7f511c0ca3b0 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f5111ffb700 1 -- 172.21.15.84:0/4244989701 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c00cc10 con 0x7f511c0ca3b0 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.963+0000 7f51241b6700 1 -- 172.21.15.84:0/4244989701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c1680b0 con 0x7f511c0ca3b0 2023-10-06T03:24:52.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.964+0000 7f51241b6700 1 -- 172.21.15.84:0/4244989701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c0c3570 con 0x7f511c0ca3b0 2023-10-06T03:24:52.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.964+0000 7f51241b6700 1 -- 172.21.15.84:0/4244989701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c0b28a0 con 0x7f511c0ca3b0 2023-10-06T03:24:52.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.965+0000 7f5111ffb700 1 -- 172.21.15.84:0/4244989701 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f510c013470 con 0x7f511c0ca3b0 2023-10-06T03:24:52.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.965+0000 7f5111ffb700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5100066f30 0x7f51000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.965+0000 7f5111ffb700 1 -- 172.21.15.84:0/4244989701 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f510c084910 con 0x7f511c0ca3b0 2023-10-06T03:24:52.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.965+0000 7f5121f52700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5100066f30 0x7f51000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.966+0000 7f5121f52700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5100066f30 0x7f51000693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f511c159e40 tx=0x7f511800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:52.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:52.969+0000 7f5111ffb700 1 -- 172.21.15.84:0/4244989701 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f510c0518e0 con 0x7f511c0ca3b0 2023-10-06T03:24:53.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.195+0000 7f51241b6700 1 -- 172.21.15.84:0/4244989701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f511c064ad0 con 0x7f511c0ca3b0 2023-10-06T03:24:53.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.195+0000 7f5111ffb700 1 -- 172.21.15.84:0/4244989701 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f510c054f00 con 0x7f511c0ca3b0 2023-10-06T03:24:53.197 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:53.197 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1693550238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1693550238},{"type":"v1","addr":"172.21.15.131:6834","nonce":1693550238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2817652058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2817652058},{"type":"v1","addr":"172.21.15.131:6835","nonce":2817652058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/688702713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":688702713},{"type":"v1","addr":"172.21.15.84:6836","nonce":688702713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:24:49.172387+0000","modified":"2023-10-06T03:24:52.828381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/1939836196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1939836196},{"type":"v1","addr":"172.21.15.84:6837","nonce":1939836196}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:24:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 -- 172.21.15.84:0/4244989701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5100066f30 msgr2=0x7f51000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5100066f30 0x7f51000693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f511c159e40 tx=0x7f511800b040 comp rx=0 tx=0).stop 2023-10-06T03:24:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 -- 172.21.15.84:0/4244989701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ca3b0 msgr2=0x7f511c1466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ca3b0 0x7f511c1466c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f510c00e930 tx=0x7f510c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 -- 172.21.15.84:0/4244989701 shutdown_connections 2023-10-06T03:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5100066f30 0x7f51000693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f511c0ce710 0x7f511c159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f511c0adba0 0x7f511c167740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 --2- 172.21.15.84:0/4244989701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f511c0ca3b0 0x7f511c1466c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 -- 172.21.15.84:0/4244989701 >> 172.21.15.84:0/4244989701 conn(0x7f511c070810 msgr2=0x7f511c153310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 -- 172.21.15.84:0/4244989701 shutdown_connections 2023-10-06T03:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.197+0000 7f51241b6700 1 -- 172.21.15.84:0/4244989701 wait complete. 2023-10-06T03:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-10-06T03:24:53.211 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:53.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.323+0000 7f210f59e700 1 Processor -- start 2023-10-06T03:24:53.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.323+0000 7f210f59e700 1 -- start start 2023-10-06T03:24:53.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210f59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2110159480 0x7f21100b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210f59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21100b2140 0x7f21100b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210f59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21100cb7e0 con 0x7f21100b3610 2023-10-06T03:24:53.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210f59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21100b08a0 con 0x7f21100b2140 2023-10-06T03:24:53.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210f59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21100cb190 con 0x7f2110159480 2023-10-06T03:24:53.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21100b2140 0x7f21100b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210dd9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f21100b3610 0x7f21100cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50238/0 (socket says 172.21.15.84:50238) 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210dd9b700 1 -- 172.21.15.84:0/1545631298 learned_addr learned my addr 172.21.15.84:0/1545631298 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210e59c700 1 --2- 172.21.15.84:0/1545631298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2110159480 0x7f21100b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210ed9d700 1 -- 172.21.15.84:0/1545631298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2110159480 msgr2=0x7f21100b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210ed9d700 1 --2- 172.21.15.84:0/1545631298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2110159480 0x7f21100b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210ed9d700 1 -- 172.21.15.84:0/1545631298 >> v1:172.21.15.84:6789/0 conn(0x7f21100b3610 legacy=0x7f21100cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210ed9d700 1 -- 172.21.15.84:0/1545631298 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21100cb470 con 0x7f21100b2140 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.324+0000 7f210d59a700 1 -- 172.21.15.84:0/1545631298 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232890114 0 0) 0x7f21100cb7e0 con 0x7f21100b3610 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210ed9d700 1 --2- 172.21.15.84:0/1545631298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100b2140 0x7f21100b25c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2108009e60 tx=0x7f2108009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a037e3bde9b47ecf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210d59a700 1 -- 172.21.15.84:0/1545631298 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800e070 con 0x7f21100b2140 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210d59a700 1 -- 172.21.15.84:0/1545631298 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800bc30 con 0x7f21100b2140 2023-10-06T03:24:53.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210d59a700 1 -- 172.21.15.84:0/1545631298 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108012430 con 0x7f21100b2140 2023-10-06T03:24:53.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210f59e700 1 -- 172.21.15.84:0/1545631298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100b2140 msgr2=0x7f21100b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210f59e700 1 --2- 172.21.15.84:0/1545631298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100b2140 0x7f21100b25c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2108009e60 tx=0x7f2108009780 comp rx=0 tx=0).stop 2023-10-06T03:24:53.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210f59e700 1 -- 172.21.15.84:0/1545631298 shutdown_connections 2023-10-06T03:24:53.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210f59e700 1 --2- 172.21.15.84:0/1545631298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100b2140 0x7f21100b25c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210f59e700 1 --2- 172.21.15.84:0/1545631298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2110159480 0x7f21100b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210f59e700 1 -- 172.21.15.84:0/1545631298 >> 172.21.15.84:0/1545631298 conn(0x7f211006ed20 msgr2=0x7f211006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:53.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210f59e700 1 -- 172.21.15.84:0/1545631298 shutdown_connections 2023-10-06T03:24:53.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.325+0000 7f210f59e700 1 -- 172.21.15.84:0/1545631298 wait complete. 2023-10-06T03:24:53.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.326+0000 7f210f59e700 1 Processor -- start 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210f59e700 1 -- start start 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210f59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21100b2140 0x7f211016a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210f59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21100b3610 0x7f2110151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210f59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2110159480 0x7f21100d0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210f59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21100c61e0 con 0x7f2110159480 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210f59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21100ce620 con 0x7f21100b3610 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210f59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21100c5f00 con 0x7f21100b2140 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2110159480 0x7f21100d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2110159480 0x7f21100d0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57422/0 (socket says 172.21.15.84:57422) 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210ed9d700 1 -- 172.21.15.84:0/2977240156 learned_addr learned my addr 172.21.15.84:0/2977240156 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210e59c700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21100b2140 0x7f211016a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.327+0000 7f210dd9b700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21100b3610 0x7f2110151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f210ed9d700 1 -- 172.21.15.84:0/2977240156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21100b2140 msgr2=0x7f211016a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f210ed9d700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21100b2140 0x7f211016a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f210ed9d700 1 -- 172.21.15.84:0/2977240156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21100b3610 msgr2=0x7f2110151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f210ed9d700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21100b3610 0x7f2110151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f210ed9d700 1 -- 172.21.15.84:0/2977240156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009a20 con 0x7f2110159480 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f210ed9d700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2110159480 0x7f21100d0170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2110069190 tx=0x7f2108019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f20fe7fc700 1 -- 172.21.15.84:0/2977240156 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108027470 con 0x7f2110159480 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f20fe7fc700 1 -- 172.21.15.84:0/2977240156 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21080275f0 con 0x7f2110159480 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f210f59e700 1 -- 172.21.15.84:0/2977240156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21100cdfd0 con 0x7f2110159480 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f20fe7fc700 1 -- 172.21.15.84:0/2977240156 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080279b0 con 0x7f2110159480 2023-10-06T03:24:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.328+0000 7f210f59e700 1 -- 172.21.15.84:0/2977240156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2110151e90 con 0x7f2110159480 2023-10-06T03:24:53.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.329+0000 7f210f59e700 1 -- 172.21.15.84:0/2977240156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21100cde30 con 0x7f2110159480 2023-10-06T03:24:53.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.329+0000 7f20fe7fc700 1 -- 172.21.15.84:0/2977240156 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2108024070 con 0x7f2110159480 2023-10-06T03:24:53.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.330+0000 7f20fe7fc700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f20f0066f30 0x7f20f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.330+0000 7f20fe7fc700 1 -- 172.21.15.84:0/2977240156 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2108086ff0 con 0x7f2110159480 2023-10-06T03:24:53.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.330+0000 7f210e59c700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f20f0066f30 0x7f20f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.330+0000 7f210e59c700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f20f0066f30 0x7f20f00693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2100006fd0 tx=0x7f2100008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.334+0000 7f20fe7fc700 1 -- 172.21.15.84:0/2977240156 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21100cde30 con 0x7f2110159480 2023-10-06T03:24:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.518+0000 7f210f59e700 1 -- 172.21.15.84:0/2977240156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21100cde30 con 0x7f2110159480 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.519+0000 7f20fe7fc700 1 -- 172.21.15.84:0/2977240156 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f21100cde30 con 0x7f2110159480 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:24:50.800397+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:46.821084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:48.147630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:53.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 -- 172.21.15.84:0/2977240156 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f20f0066f30 msgr2=0x7f20f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f20f0066f30 0x7f20f00693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2100006fd0 tx=0x7f2100008040 comp rx=0 tx=0).stop 2023-10-06T03:24:53.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 -- 172.21.15.84:0/2977240156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2110159480 msgr2=0x7f21100d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2110159480 0x7f21100d0170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2110069190 tx=0x7f2108019000 comp rx=0 tx=0).stop 2023-10-06T03:24:53.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 -- 172.21.15.84:0/2977240156 shutdown_connections 2023-10-06T03:24:53.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f20f0066f30 0x7f20f00693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2110159480 0x7f21100d0170 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21100b2140 0x7f211016a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 --2- 172.21.15.84:0/2977240156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21100b3610 0x7f2110151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 -- 172.21.15.84:0/2977240156 >> 172.21.15.84:0/2977240156 conn(0x7f211006ed20 msgr2=0x7f21101568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 -- 172.21.15.84:0/2977240156 shutdown_connections 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.521+0000 7f210f59e700 1 -- 172.21.15.84:0/2977240156 wait complete. 2023-10-06T03:24:53.535 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:24:53.535 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:53.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.647+0000 7f6a0da61700 1 Processor -- start 2023-10-06T03:24:53.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.647+0000 7f6a0da61700 1 -- start start 2023-10-06T03:24:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f6a0da61700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a080cbc70 0x7f6a080cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f6a0da61700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a080cb7e0 con 0x7f6a08159480 2023-10-06T03:24:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f6a0da61700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a080b08a0 con 0x7f6a080b2140 2023-10-06T03:24:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f6a0da61700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a080cb190 con 0x7f6a080cbc70 2023-10-06T03:24:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f69fffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a080cbc70 0x7f6a080cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f6a0ca5f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a08159480 0x7f6a080b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50240/0 (socket says 172.21.15.84:50240) 2023-10-06T03:24:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f6a0ca5f700 1 -- 172.21.15.84:0/870748296 learned_addr learned my addr 172.21.15.84:0/870748296 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f69fffff700 1 -- 172.21.15.84:0/870748296 >> v1:172.21.15.131:6789/0 conn(0x7f6a080b2140 legacy=0x7f6a080b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f69fffff700 1 -- 172.21.15.84:0/870748296 >> v1:172.21.15.84:6789/0 conn(0x7f6a08159480 legacy=0x7f6a080b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f69ff7fe700 1 -- 172.21.15.84:0/870748296 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818215079 0 0) 0x7f6a080cb7e0 con 0x7f6a08159480 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f69fffff700 1 -- 172.21.15.84:0/870748296 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080cb470 con 0x7f6a080cbc70 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.648+0000 7f69fffff700 1 --2- 172.21.15.84:0/870748296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080cbc70 0x7f6a080cc0c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f69f80098e0 tx=0x7f69f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38fe3c00925dae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.649+0000 7f69ff7fe700 1 -- 172.21.15.84:0/870748296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8009e80 con 0x7f6a080cbc70 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.649+0000 7f69ff7fe700 1 -- 172.21.15.84:0/870748296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f800b860 con 0x7f6a080cbc70 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.649+0000 7f69ff7fe700 1 -- 172.21.15.84:0/870748296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f800bbe0 con 0x7f6a080cbc70 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.649+0000 7f6a0da61700 1 -- 172.21.15.84:0/870748296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080cbc70 msgr2=0x7f6a080cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.649+0000 7f6a0da61700 1 --2- 172.21.15.84:0/870748296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080cbc70 0x7f6a080cc0c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f69f80098e0 tx=0x7f69f80091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.649+0000 7f6a0da61700 1 -- 172.21.15.84:0/870748296 shutdown_connections 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.649+0000 7f6a0da61700 1 --2- 172.21.15.84:0/870748296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080cbc70 0x7f6a080cc0c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.649+0000 7f6a0da61700 1 -- 172.21.15.84:0/870748296 >> 172.21.15.84:0/870748296 conn(0x7f6a0806ed20 msgr2=0x7f6a0806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.649+0000 7f6a0da61700 1 -- 172.21.15.84:0/870748296 shutdown_connections 2023-10-06T03:24:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.649+0000 7f6a0da61700 1 -- 172.21.15.84:0/870748296 wait complete. 2023-10-06T03:24:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.650+0000 7f6a0da61700 1 Processor -- start 2023-10-06T03:24:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.650+0000 7f6a0da61700 1 -- start start 2023-10-06T03:24:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0da61700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080b2140 0x7f6a08154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0da61700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a080cbc70 0x7f6a08153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0da61700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a08159480 0x7f6a080c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0da61700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c54b0 con 0x7f6a080b2140 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0da61700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c44b0 con 0x7f6a080cbc70 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0da61700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c5020 con 0x7f6a08159480 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0ca5f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080b2140 0x7f6a08154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0ca5f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080b2140 0x7f6a08154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57432/0 (socket says 172.21.15.84:57432) 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0ca5f700 1 -- 172.21.15.84:0/416188655 learned_addr learned my addr 172.21.15.84:0/416188655 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f69fffff700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a080cbc70 0x7f6a08153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0d260700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a08159480 0x7f6a080c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0ca5f700 1 -- 172.21.15.84:0/416188655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a08159480 msgr2=0x7f6a080c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0ca5f700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a08159480 0x7f6a080c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0ca5f700 1 -- 172.21.15.84:0/416188655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a080cbc70 msgr2=0x7f6a08153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0ca5f700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a080cbc70 0x7f6a08153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0ca5f700 1 -- 172.21.15.84:0/416188655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f8009420 con 0x7f6a080b2140 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.651+0000 7f6a0d260700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a08159480 0x7f6a080c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.652+0000 7f6a0ca5f700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080b2140 0x7f6a08154690 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400cc70 tx=0x7f6a04001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.652+0000 7f69fcff9700 1 -- 172.21.15.84:0/416188655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400ce80 con 0x7f6a080b2140 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.652+0000 7f69fcff9700 1 -- 172.21.15.84:0/416188655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400ab10 con 0x7f6a080b2140 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.652+0000 7f6a0da61700 1 -- 172.21.15.84:0/416188655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a08154440 con 0x7f6a080b2140 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.652+0000 7f69fcff9700 1 -- 172.21.15.84:0/416188655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400ae90 con 0x7f6a080b2140 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.652+0000 7f6a0da61700 1 -- 172.21.15.84:0/416188655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a080c49d0 con 0x7f6a080b2140 2023-10-06T03:24:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.653+0000 7f6a0da61700 1 -- 172.21.15.84:0/416188655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0805f270 con 0x7f6a080b2140 2023-10-06T03:24:53.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.653+0000 7f69fcff9700 1 -- 172.21.15.84:0/416188655 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a04007300 con 0x7f6a080b2140 2023-10-06T03:24:53.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.653+0000 7f69fcff9700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f69f4066f30 0x7f69f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.654+0000 7f69fcff9700 1 -- 172.21.15.84:0/416188655 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6a04084c30 con 0x7f6a080b2140 2023-10-06T03:24:53.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.654+0000 7f69fffff700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f69f4066f30 0x7f69f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.654+0000 7f69fffff700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f69f4066f30 0x7f69f40693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69f80091e0 tx=0x7f69f8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.658+0000 7f69fcff9700 1 -- 172.21.15.84:0/416188655 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a04051c80 con 0x7f6a080b2140 2023-10-06T03:24:53.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.835+0000 7f6a0da61700 1 -- 172.21.15.84:0/416188655 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a080c5160 con 0x7f69f4066f30 2023-10-06T03:24:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.845+0000 7f69fcff9700 1 -- 172.21.15.84:0/416188655 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304506 (secure 0 0 0) 0x7f69f8000bc0 con 0x7f69f4066f30 2023-10-06T03:24:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 -- 172.21.15.84:0/416188655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f69f4066f30 msgr2=0x7f69f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f69f4066f30 0x7f69f40693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69f80091e0 tx=0x7f69f8016000 comp rx=0 tx=0).stop 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 -- 172.21.15.84:0/416188655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080b2140 msgr2=0x7f6a08154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080b2140 0x7f6a08154690 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400cc70 tx=0x7f6a04001a30 comp rx=0 tx=0).stop 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 -- 172.21.15.84:0/416188655 shutdown_connections 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f69f4066f30 0x7f69f40693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a08159480 0x7f6a080c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080b2140 0x7f6a08154690 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 --2- 172.21.15.84:0/416188655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a080cbc70 0x7f6a08153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 -- 172.21.15.84:0/416188655 >> 172.21.15.84:0/416188655 conn(0x7f6a0806ed20 msgr2=0x7f6a080b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 -- 172.21.15.84:0/416188655 shutdown_connections 2023-10-06T03:24:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:53.848+0000 7f6a0da61700 1 -- 172.21.15.84:0/416188655 wait complete. 2023-10-06T03:24:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:24:53.861 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-10-06T03:24:53.054527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592086,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382756,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591964,"statfs":{"total":773094113280,"available":770654171136,"internally_reserved":0,"allocated":4558848,"data_stored":2656817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1718,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.267183"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824579+0000","last_change":"2023-10-06T03:24:49.817728+0000","last_active":"2023-10-06T03:24:49.824579+0000","last_peered":"2023-10-06T03:24:49.824579+0000","last_clean":"2023-10-06T03:24:49.824579+0000","last_became_active":"2023-10-06T03:24:49.817464+0000","last_became_peered":"2023-10-06T03:24:49.817464+0000","last_unstale":"2023-10-06T03:24:49.824579+0000","last_undegraded":"2023-10-06T03:24:49.824579+0000","last_fullsized":"2023-10-06T03:24:49.824579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:57.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827956+0000","last_change":"2023-10-06T03:24:49.819543+0000","last_active":"2023-10-06T03:24:49.827956+0000","last_peered":"2023-10-06T03:24:49.827956+0000","last_clean":"2023-10-06T03:24:49.827956+0000","last_became_active":"2023-10-06T03:24:49.819278+0000","last_became_peered":"2023-10-06T03:24:49.819278+0000","last_unstale":"2023-10-06T03:24:49.827956+0000","last_undegraded":"2023-10-06T03:24:49.827956+0000","last_fullsized":"2023-10-06T03:24:49.827956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:57.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.828011+0000","last_change":"2023-10-06T03:24:49.821082+0000","last_active":"2023-10-06T03:24:49.828011+0000","last_peered":"2023-10-06T03:24:49.828011+0000","last_clean":"2023-10-06T03:24:49.828011+0000","last_became_active":"2023-10-06T03:24:49.820543+0000","last_became_peered":"2023-10-06T03:24:49.820543+0000","last_unstale":"2023-10-06T03:24:49.828011+0000","last_undegraded":"2023-10-06T03:24:49.828011+0000","last_fullsized":"2023-10-06T03:24:49.828011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:50.921698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827193+0000","last_change":"2023-10-06T03:24:49.822892+0000","last_active":"2023-10-06T03:24:49.827193+0000","last_peered":"2023-10-06T03:24:49.827193+0000","last_clean":"2023-10-06T03:24:49.827193+0000","last_became_active":"2023-10-06T03:24:49.822618+0000","last_became_peered":"2023-10-06T03:24:49.822618+0000","last_unstale":"2023-10-06T03:24:49.827193+0000","last_undegraded":"2023-10-06T03:24:49.827193+0000","last_fullsized":"2023-10-06T03:24:49.827193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:50.921698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827992+0000","last_change":"2023-10-06T03:24:49.821318+0000","last_active":"2023-10-06T03:24:49.827992+0000","last_peered":"2023-10-06T03:24:49.827992+0000","last_clean":"2023-10-06T03:24:49.827992+0000","last_became_active":"2023-10-06T03:24:49.821044+0000","last_became_peered":"2023-10-06T03:24:49.821044+0000","last_unstale":"2023-10-06T03:24:49.827992+0000","last_undegraded":"2023-10-06T03:24:49.827992+0000","last_fullsized":"2023-10-06T03:24:49.827992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:03.473599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824382+0000","last_change":"2023-10-06T03:24:49.816559+0000","last_active":"2023-10-06T03:24:49.824382+0000","last_peered":"2023-10-06T03:24:49.824382+0000","last_clean":"2023-10-06T03:24:49.824382+0000","last_became_active":"2023-10-06T03:24:49.816292+0000","last_became_peered":"2023-10-06T03:24:49.816292+0000","last_unstale":"2023-10-06T03:24:49.824382+0000","last_undegraded":"2023-10-06T03:24:49.824382+0000","last_fullsized":"2023-10-06T03:24:49.824382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:05.207479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821296+0000","last_change":"2023-10-06T03:24:49.813984+0000","last_active":"2023-10-06T03:24:49.821296+0000","last_peered":"2023-10-06T03:24:49.821296+0000","last_clean":"2023-10-06T03:24:49.821296+0000","last_became_active":"2023-10-06T03:24:49.813685+0000","last_became_peered":"2023-10-06T03:24:49.813685+0000","last_unstale":"2023-10-06T03:24:49.821296+0000","last_undegraded":"2023-10-06T03:24:49.821296+0000","last_fullsized":"2023-10-06T03:24:49.821296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:47.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821221+0000","last_change":"2023-10-06T03:24:49.813389+0000","last_active":"2023-10-06T03:24:49.821221+0000","last_peered":"2023-10-06T03:24:49.821221+0000","last_clean":"2023-10-06T03:24:49.821221+0000","last_became_active":"2023-10-06T03:24:49.813141+0000","last_became_peered":"2023-10-06T03:24:49.813141+0000","last_unstale":"2023-10-06T03:24:49.821221+0000","last_undegraded":"2023-10-06T03:24:49.821221+0000","last_fullsized":"2023-10-06T03:24:49.821221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.832354+0000","last_change":"2023-10-06T03:24:49.822042+0000","last_active":"2023-10-06T03:24:49.832354+0000","last_peered":"2023-10-06T03:24:49.832354+0000","last_clean":"2023-10-06T03:24:49.832354+0000","last_became_active":"2023-10-06T03:24:49.821756+0000","last_became_peered":"2023-10-06T03:24:49.821756+0000","last_unstale":"2023-10-06T03:24:49.832354+0000","last_undegraded":"2023-10-06T03:24:49.832354+0000","last_fullsized":"2023-10-06T03:24:49.832354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.820701+0000","last_change":"2023-10-06T03:24:49.813020+0000","last_active":"2023-10-06T03:24:49.820701+0000","last_peered":"2023-10-06T03:24:49.820701+0000","last_clean":"2023-10-06T03:24:49.820701+0000","last_became_active":"2023-10-06T03:24:49.812753+0000","last_became_peered":"2023-10-06T03:24:49.812753+0000","last_unstale":"2023-10-06T03:24:49.820701+0000","last_undegraded":"2023-10-06T03:24:49.820701+0000","last_fullsized":"2023-10-06T03:24:49.820701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:59.096514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.823952+0000","last_change":"2023-10-06T03:24:49.817948+0000","last_active":"2023-10-06T03:24:49.823952+0000","last_peered":"2023-10-06T03:24:49.823952+0000","last_clean":"2023-10-06T03:24:49.823952+0000","last_became_active":"2023-10-06T03:24:49.817685+0000","last_became_peered":"2023-10-06T03:24:49.817685+0000","last_unstale":"2023-10-06T03:24:49.823952+0000","last_undegraded":"2023-10-06T03:24:49.823952+0000","last_fullsized":"2023-10-06T03:24:49.823952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.793089+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:15.333445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.788345+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:20.530045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827894+0000","last_change":"2023-10-06T03:24:49.816862+0000","last_active":"2023-10-06T03:24:49.827894+0000","last_peered":"2023-10-06T03:24:49.827894+0000","last_clean":"2023-10-06T03:24:49.827894+0000","last_became_active":"2023-10-06T03:24:49.816603+0000","last_became_peered":"2023-10-06T03:24:49.816603+0000","last_unstale":"2023-10-06T03:24:49.827894+0000","last_undegraded":"2023-10-06T03:24:49.827894+0000","last_fullsized":"2023-10-06T03:24:49.827894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833645+0000","last_change":"2023-10-06T03:24:48.806740+0000","last_active":"2023-10-06T03:24:49.833645+0000","last_peered":"2023-10-06T03:24:49.833645+0000","last_clean":"2023-10-06T03:24:49.833645+0000","last_became_active":"2023-10-06T03:24:48.806456+0000","last_became_peered":"2023-10-06T03:24:48.806456+0000","last_unstale":"2023-10-06T03:24:49.833645+0000","last_undegraded":"2023-10-06T03:24:49.833645+0000","last_fullsized":"2023-10-06T03:24:49.833645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:47.026999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824000+0000","last_change":"2023-10-06T03:24:49.818654+0000","last_active":"2023-10-06T03:24:49.824000+0000","last_peered":"2023-10-06T03:24:49.824000+0000","last_clean":"2023-10-06T03:24:49.824000+0000","last_became_active":"2023-10-06T03:24:49.818417+0000","last_became_peered":"2023-10-06T03:24:49.818417+0000","last_unstale":"2023-10-06T03:24:49.824000+0000","last_undegraded":"2023-10-06T03:24:49.824000+0000","last_fullsized":"2023-10-06T03:24:49.824000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:05.207479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835772+0000","last_change":"2023-10-06T03:24:48.805439+0000","last_active":"2023-10-06T03:24:49.835772+0000","last_peered":"2023-10-06T03:24:49.835772+0000","last_clean":"2023-10-06T03:24:49.835772+0000","last_became_active":"2023-10-06T03:24:48.805143+0000","last_became_peered":"2023-10-06T03:24:48.805143+0000","last_unstale":"2023-10-06T03:24:49.835772+0000","last_undegraded":"2023-10-06T03:24:49.835772+0000","last_fullsized":"2023-10-06T03:24:49.835772+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.792607+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:37.630223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.787994+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:44.317412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.808388+0000","last_change":"2023-10-06T03:24:48.809322+0000","last_active":"2023-10-06T03:24:49.808388+0000","last_peered":"2023-10-06T03:24:49.808388+0000","last_clean":"2023-10-06T03:24:49.808388+0000","last_became_active":"2023-10-06T03:24:48.809018+0000","last_became_peered":"2023-10-06T03:24:48.809018+0000","last_unstale":"2023-10-06T03:24:49.808388+0000","last_undegraded":"2023-10-06T03:24:49.808388+0000","last_fullsized":"2023-10-06T03:24:49.808388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.795743+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:46.243326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.787728+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:15.333445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827169+0000","last_change":"2023-10-06T03:24:49.823044+0000","last_active":"2023-10-06T03:24:49.827169+0000","last_peered":"2023-10-06T03:24:49.827169+0000","last_clean":"2023-10-06T03:24:49.827169+0000","last_became_active":"2023-10-06T03:24:49.822784+0000","last_became_peered":"2023-10-06T03:24:49.822784+0000","last_unstale":"2023-10-06T03:24:49.827169+0000","last_undegraded":"2023-10-06T03:24:49.827169+0000","last_fullsized":"2023-10-06T03:24:49.827169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:03.473599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.794835+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:50.513385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836475+0000","last_change":"2023-10-06T03:24:48.809455+0000","last_active":"2023-10-06T03:24:49.836475+0000","last_peered":"2023-10-06T03:24:49.836475+0000","last_clean":"2023-10-06T03:24:49.836475+0000","last_became_active":"2023-10-06T03:24:48.809202+0000","last_became_peered":"2023-10-06T03:24:48.809202+0000","last_unstale":"2023-10-06T03:24:49.836475+0000","last_undegraded":"2023-10-06T03:24:49.836475+0000","last_fullsized":"2023-10-06T03:24:49.836475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824323+0000","last_change":"2023-10-06T03:24:49.818062+0000","last_active":"2023-10-06T03:24:49.824323+0000","last_peered":"2023-10-06T03:24:49.824323+0000","last_clean":"2023-10-06T03:24:49.824323+0000","last_became_active":"2023-10-06T03:24:49.817792+0000","last_became_peered":"2023-10-06T03:24:49.817792+0000","last_unstale":"2023-10-06T03:24:49.824323+0000","last_undegraded":"2023-10-06T03:24:49.824323+0000","last_fullsized":"2023-10-06T03:24:49.824323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.837509+0000","last_change":"2023-10-06T03:24:48.796352+0000","last_active":"2023-10-06T03:24:49.837509+0000","last_peered":"2023-10-06T03:24:49.837509+0000","last_clean":"2023-10-06T03:24:49.837509+0000","last_became_active":"2023-10-06T03:24:48.796076+0000","last_became_peered":"2023-10-06T03:24:48.796076+0000","last_unstale":"2023-10-06T03:24:49.837509+0000","last_undegraded":"2023-10-06T03:24:49.837509+0000","last_fullsized":"2023-10-06T03:24:49.837509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:22.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.792151+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810931+0000","last_change":"2023-10-06T03:24:48.804776+0000","last_active":"2023-10-06T03:24:49.810931+0000","last_peered":"2023-10-06T03:24:49.810931+0000","last_clean":"2023-10-06T03:24:49.810931+0000","last_became_active":"2023-10-06T03:24:48.804506+0000","last_became_peered":"2023-10-06T03:24:48.804506+0000","last_unstale":"2023-10-06T03:24:49.810931+0000","last_undegraded":"2023-10-06T03:24:49.810931+0000","last_fullsized":"2023-10-06T03:24:49.810931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:46.243326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.791630+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824599+0000","last_change":"2023-10-06T03:24:49.818605+0000","last_active":"2023-10-06T03:24:49.824599+0000","last_peered":"2023-10-06T03:24:49.824599+0000","last_clean":"2023-10-06T03:24:49.824599+0000","last_became_active":"2023-10-06T03:24:49.818270+0000","last_became_peered":"2023-10-06T03:24:49.818270+0000","last_unstale":"2023-10-06T03:24:49.824599+0000","last_undegraded":"2023-10-06T03:24:49.824599+0000","last_fullsized":"2023-10-06T03:24:49.824599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.795260+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:33.675684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821360+0000","last_change":"2023-10-06T03:24:49.815067+0000","last_active":"2023-10-06T03:24:49.821360+0000","last_peered":"2023-10-06T03:24:49.821360+0000","last_clean":"2023-10-06T03:24:49.821360+0000","last_became_active":"2023-10-06T03:24:49.814854+0000","last_became_peered":"2023-10-06T03:24:49.814854+0000","last_unstale":"2023-10-06T03:24:49.821360+0000","last_undegraded":"2023-10-06T03:24:49.821360+0000","last_fullsized":"2023-10-06T03:24:49.821360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.678893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834912+0000","last_change":"2023-10-06T03:24:48.803799+0000","last_active":"2023-10-06T03:24:49.834912+0000","last_peered":"2023-10-06T03:24:49.834912+0000","last_clean":"2023-10-06T03:24:49.834912+0000","last_became_active":"2023-10-06T03:24:48.803302+0000","last_became_peered":"2023-10-06T03:24:48.803302+0000","last_unstale":"2023-10-06T03:24:49.834912+0000","last_undegraded":"2023-10-06T03:24:49.834912+0000","last_fullsized":"2023-10-06T03:24:49.834912+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:29.960671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.788836+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:44.687691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836098+0000","last_change":"2023-10-06T03:24:48.810309+0000","last_active":"2023-10-06T03:24:49.836098+0000","last_peered":"2023-10-06T03:24:49.836098+0000","last_clean":"2023-10-06T03:24:49.836098+0000","last_became_active":"2023-10-06T03:24:48.809835+0000","last_became_peered":"2023-10-06T03:24:48.809835+0000","last_unstale":"2023-10-06T03:24:49.836098+0000","last_undegraded":"2023-10-06T03:24:49.836098+0000","last_fullsized":"2023-10-06T03:24:49.836098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.792662+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:53.768279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.791822+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.831359+0000","last_change":"2023-10-06T03:24:49.827821+0000","last_active":"2023-10-06T03:24:49.831359+0000","last_peered":"2023-10-06T03:24:49.831359+0000","last_clean":"2023-10-06T03:24:49.831359+0000","last_became_active":"2023-10-06T03:24:49.827574+0000","last_became_peered":"2023-10-06T03:24:49.827574+0000","last_unstale":"2023-10-06T03:24:49.831359+0000","last_undegraded":"2023-10-06T03:24:49.831359+0000","last_fullsized":"2023-10-06T03:24:49.831359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:47.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.807618+0000","last_change":"2023-10-06T03:24:48.809255+0000","last_active":"2023-10-06T03:24:49.807618+0000","last_peered":"2023-10-06T03:24:49.807618+0000","last_clean":"2023-10-06T03:24:49.807618+0000","last_became_active":"2023-10-06T03:24:48.808968+0000","last_became_peered":"2023-10-06T03:24:48.808968+0000","last_unstale":"2023-10-06T03:24:49.807618+0000","last_undegraded":"2023-10-06T03:24:49.807618+0000","last_fullsized":"2023-10-06T03:24:49.807618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824339+0000","last_change":"2023-10-06T03:24:49.816246+0000","last_active":"2023-10-06T03:24:49.824339+0000","last_peered":"2023-10-06T03:24:49.824339+0000","last_clean":"2023-10-06T03:24:49.824339+0000","last_became_active":"2023-10-06T03:24:49.816004+0000","last_became_peered":"2023-10-06T03:24:49.816004+0000","last_unstale":"2023-10-06T03:24:49.824339+0000","last_undegraded":"2023-10-06T03:24:49.824339+0000","last_fullsized":"2023-10-06T03:24:49.824339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:34.682483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.794884+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:37.160766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810056+0000","last_change":"2023-10-06T03:24:48.804171+0000","last_active":"2023-10-06T03:24:49.810056+0000","last_peered":"2023-10-06T03:24:49.810056+0000","last_clean":"2023-10-06T03:24:49.810056+0000","last_became_active":"2023-10-06T03:24:48.803906+0000","last_became_peered":"2023-10-06T03:24:48.803906+0000","last_unstale":"2023-10-06T03:24:49.810056+0000","last_undegraded":"2023-10-06T03:24:49.810056+0000","last_fullsized":"2023-10-06T03:24:49.810056+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.788483+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:02.125182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:42.970967+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:24:42.970967+0000","last_peered":"2023-10-06T03:24:42.970967+0000","last_clean":"2023-10-06T03:24:42.970967+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:24:42.970967+0000","last_undegraded":"2023-10-06T03:24:42.970967+0000","last_fullsized":"2023-10-06T03:24:42.970967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.811849+0000","last_change":"2023-10-06T03:24:48.809341+0000","last_active":"2023-10-06T03:24:49.811849+0000","last_peered":"2023-10-06T03:24:49.811849+0000","last_clean":"2023-10-06T03:24:49.811849+0000","last_became_active":"2023-10-06T03:24:48.809095+0000","last_became_peered":"2023-10-06T03:24:48.809095+0000","last_unstale":"2023-10-06T03:24:49.811849+0000","last_undegraded":"2023-10-06T03:24:49.811849+0000","last_fullsized":"2023-10-06T03:24:49.811849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:42.355969+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:24:42.355969+0000","last_peered":"2023-10-06T03:24:42.355969+0000","last_clean":"2023-10-06T03:24:42.355969+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:24:42.355969+0000","last_undegraded":"2023-10-06T03:24:42.355969+0000","last_fullsized":"2023-10-06T03:24:42.355969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827049+0000","last_change":"2023-10-06T03:24:49.822079+0000","last_active":"2023-10-06T03:24:49.827049+0000","last_peered":"2023-10-06T03:24:49.827049+0000","last_clean":"2023-10-06T03:24:49.827049+0000","last_became_active":"2023-10-06T03:24:49.821820+0000","last_became_peered":"2023-10-06T03:24:49.821820+0000","last_unstale":"2023-10-06T03:24:49.827049+0000","last_undegraded":"2023-10-06T03:24:49.827049+0000","last_fullsized":"2023-10-06T03:24:49.827049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:42.414642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812317+0000","last_change":"2023-10-06T03:24:48.805388+0000","last_active":"2023-10-06T03:24:49.812317+0000","last_peered":"2023-10-06T03:24:49.812317+0000","last_clean":"2023-10-06T03:24:49.812317+0000","last_became_active":"2023-10-06T03:24:48.805136+0000","last_became_peered":"2023-10-06T03:24:48.805136+0000","last_unstale":"2023-10-06T03:24:49.812317+0000","last_undegraded":"2023-10-06T03:24:49.812317+0000","last_fullsized":"2023-10-06T03:24:49.812317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:09.893072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812416+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:24:49.812416+0000","last_peered":"2023-10-06T03:24:49.812416+0000","last_clean":"2023-10-06T03:24:49.812416+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:24:49.812416+0000","last_undegraded":"2023-10-06T03:24:49.812416+0000","last_fullsized":"2023-10-06T03:24:49.812416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810235+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:24:49.810235+0000","last_peered":"2023-10-06T03:24:49.810235+0000","last_clean":"2023-10-06T03:24:49.810235+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:24:49.810235+0000","last_undegraded":"2023-10-06T03:24:49.810235+0000","last_fullsized":"2023-10-06T03:24:49.810235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810543+0000","last_change":"2023-10-06T03:24:48.808937+0000","last_active":"2023-10-06T03:24:49.810543+0000","last_peered":"2023-10-06T03:24:49.810543+0000","last_clean":"2023-10-06T03:24:49.810543+0000","last_became_active":"2023-10-06T03:24:48.808657+0000","last_became_peered":"2023-10-06T03:24:48.808657+0000","last_unstale":"2023-10-06T03:24:49.810543+0000","last_undegraded":"2023-10-06T03:24:49.810543+0000","last_fullsized":"2023-10-06T03:24:49.810543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.811011+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:24:49.811011+0000","last_peered":"2023-10-06T03:24:49.811011+0000","last_clean":"2023-10-06T03:24:49.811011+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:24:49.811011+0000","last_undegraded":"2023-10-06T03:24:49.811011+0000","last_fullsized":"2023-10-06T03:24:49.811011+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834982+0000","last_change":"2023-10-06T03:24:48.806288+0000","last_active":"2023-10-06T03:24:49.834982+0000","last_peered":"2023-10-06T03:24:49.834982+0000","last_clean":"2023-10-06T03:24:49.834982+0000","last_became_active":"2023-10-06T03:24:48.806067+0000","last_became_peered":"2023-10-06T03:24:48.806067+0000","last_unstale":"2023-10-06T03:24:49.834982+0000","last_undegraded":"2023-10-06T03:24:49.834982+0000","last_fullsized":"2023-10-06T03:24:49.834982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810142+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:24:49.810142+0000","last_peered":"2023-10-06T03:24:49.810142+0000","last_clean":"2023-10-06T03:24:49.810142+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:24:49.810142+0000","last_undegraded":"2023-10-06T03:24:49.810142+0000","last_fullsized":"2023-10-06T03:24:49.810142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.791302+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.808489+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:24:49.808489+0000","last_peered":"2023-10-06T03:24:49.808489+0000","last_clean":"2023-10-06T03:24:49.808489+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:24:49.808489+0000","last_undegraded":"2023-10-06T03:24:49.808489+0000","last_fullsized":"2023-10-06T03:24:49.808489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.828176+0000","last_change":"2023-10-06T03:24:49.818136+0000","last_active":"2023-10-06T03:24:49.828176+0000","last_peered":"2023-10-06T03:24:49.828176+0000","last_clean":"2023-10-06T03:24:49.828176+0000","last_became_active":"2023-10-06T03:24:49.817838+0000","last_became_peered":"2023-10-06T03:24:49.817838+0000","last_unstale":"2023-10-06T03:24:49.828176+0000","last_undegraded":"2023-10-06T03:24:49.828176+0000","last_fullsized":"2023-10-06T03:24:49.828176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:03.131980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812143+0000","last_change":"2023-10-06T03:24:48.811843+0000","last_active":"2023-10-06T03:24:49.812143+0000","last_peered":"2023-10-06T03:24:49.812143+0000","last_clean":"2023-10-06T03:24:49.812143+0000","last_became_active":"2023-10-06T03:24:48.811661+0000","last_became_peered":"2023-10-06T03:24:48.811661+0000","last_unstale":"2023-10-06T03:24:49.812143+0000","last_undegraded":"2023-10-06T03:24:49.812143+0000","last_fullsized":"2023-10-06T03:24:49.812143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:51.862931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:44.290913+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:24:44.290913+0000","last_peered":"2023-10-06T03:24:44.290913+0000","last_clean":"2023-10-06T03:24:44.290913+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:24:44.290913+0000","last_undegraded":"2023-10-06T03:24:44.290913+0000","last_fullsized":"2023-10-06T03:24:44.290913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.794408+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:09.893072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:44.290937+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:24:44.290937+0000","last_peered":"2023-10-06T03:24:44.290937+0000","last_clean":"2023-10-06T03:24:44.290937+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:24:44.290937+0000","last_undegraded":"2023-10-06T03:24:44.290937+0000","last_fullsized":"2023-10-06T03:24:44.290937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1718,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":786386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52200000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.627},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":174603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":6.3680000000000003,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.5039999999999996,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.4740000000000002,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":1}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.042},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":6.4359999999999999,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.93000000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":1.53},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.89700000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":1.6679999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":1.1459999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":786366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.375}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.31}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":397312,"data_stored":173250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":12.19,"5min":12.19,"15min":12.19},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":8.3900000000000006,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.20100000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.26600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.251},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.318}]},{"osd":4,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.948,"5min":16.948,"15min":16.948},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.501}]},{"osd":7,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":16.881,"5min":16.881,"15min":16.881},"last":0.45900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":197486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.308}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":174603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.27200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70699999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.77800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":168125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.758,"5min":4.758,"15min":4.758},"last":0.505},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":9.7690000000000001,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.379},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.624}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":195998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:53.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:54.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.014+0000 7f7a93b0e700 1 Processor -- start 2023-10-06T03:24:54.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.014+0000 7f7a93b0e700 1 -- start start 2023-10-06T03:24:54.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.015+0000 7f7a93b0e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c142db0 0x7f7a8c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.015+0000 7f7a93b0e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7a8c06f970 0x7f7a8c0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.015+0000 7f7a93b0e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c0cc7e0 con 0x7f7a8c143180 2023-10-06T03:24:54.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.015+0000 7f7a93b0e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8c0ce400 con 0x7f7a8c06f970 2023-10-06T03:24:54.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.015+0000 7f7a93b0e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0ccac0 con 0x7f7a8c142db0 2023-10-06T03:24:54.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.015+0000 7f7a920ab700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7a8c143180 0x7f7a8c15d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50242/0 (socket says 172.21.15.84:50242) 2023-10-06T03:24:54.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.015+0000 7f7a920ab700 1 -- 172.21.15.84:0/1734317482 learned_addr learned my addr 172.21.15.84:0/1734317482 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:54.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a910a9700 1 --2- 172.21.15.84:0/1734317482 >> v2:172.21.15.131:3300/0 conn(0x7f7a8c06f970 0x7f7a8c0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a918aa700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c142db0 0x7f7a8c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068340968 0 0) 0x7f7a8c0cc7e0 con 0x7f7a8c143180 2023-10-06T03:24:54.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a78003570 con 0x7f7a8c143180 2023-10-06T03:24:54.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1936140320 0 0) 0x7f7a78003570 con 0x7f7a8c143180 2023-10-06T03:24:54.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c142db0 msgr2=0x7f7a8c06f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:54.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c142db0 0x7f7a8c06f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 >> v2:172.21.15.131:3300/0 conn(0x7f7a8c06f970 msgr2=0x7f7a8c0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:54.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 --2- 172.21.15.84:0/1734317482 >> v2:172.21.15.131:3300/0 conn(0x7f7a8c06f970 0x7f7a8c0d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0ccda0 con 0x7f7a8c143180 2023-10-06T03:24:54.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f7a84001470 con 0x7f7a8c143180 2023-10-06T03:24:54.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 >> v1:172.21.15.84:6789/0 conn(0x7f7a8c143180 legacy=0x7f7a8c15d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c142db0 0x7f7a78003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a78003fe0 0x7f7a78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a78004d50 0x7f7a780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0ce400 con 0x7f7a78003fe0 2023-10-06T03:24:54.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0ccac0 con 0x7f7a78004d50 2023-10-06T03:24:54.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7800ba90 con 0x7f7a8c142db0 2023-10-06T03:24:54.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a910a9700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a78003fe0 0x7f7a78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a918aa700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c142db0 0x7f7a78003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a920ab700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a78004d50 0x7f7a780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a910a9700 1 -- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c142db0 msgr2=0x7f7a78003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a910a9700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c142db0 0x7f7a78003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a910a9700 1 -- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a78004d50 msgr2=0x7f7a780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a910a9700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a78004d50 0x7f7a780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a910a9700 1 -- 172.21.15.84:0/1734317482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a78003570 con 0x7f7a78003fe0 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a920ab700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a78004d50 0x7f7a780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.016+0000 7f7a910a9700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a78003fe0 0x7f7a78004810 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009c00 tx=0x7f7a7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d032738b7fb92edf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.017+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00e6b0 con 0x7f7a78003fe0 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.017+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c00e810 con 0x7f7a78003fe0 2023-10-06T03:24:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.017+0000 7f7a908a8700 1 -- 172.21.15.84:0/1734317482 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00ebd0 con 0x7f7a78003fe0 2023-10-06T03:24:54.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.017+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1734317482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a78003fe0 msgr2=0x7f7a78004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.017+0000 7f7a93b0e700 1 --2- 172.21.15.84:0/1734317482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a78003fe0 0x7f7a78004810 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009c00 tx=0x7f7a7c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.017+0000 7f7a920ab700 1 -- 172.21.15.84:0/1734317482 reap_dead start 2023-10-06T03:24:54.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.017+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1734317482 shutdown_connections 2023-10-06T03:24:54.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.017+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1734317482 >> 172.21.15.84:0/1734317482 conn(0x7f7a8c068db0 msgr2=0x7f7a8c06ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:54.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.017+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1734317482 shutdown_connections 2023-10-06T03:24:54.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.017+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1734317482 wait complete. 2023-10-06T03:24:54.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.018+0000 7f7a93b0e700 1 Processor -- start 2023-10-06T03:24:54.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.018+0000 7f7a93b0e700 1 -- start start 2023-10-06T03:24:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a93b0e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a78003fe0 0x7f7a8c130950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a93b0e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c0c9040 0x7f7a8c16d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a93b0e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a8c0c94b0 0x7f7a8c16d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a93b0e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0c6bb0 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a93b0e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0c7970 con 0x7f7a78003fe0 2023-10-06T03:24:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a93b0e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0c6da0 con 0x7f7a8c0c9040 2023-10-06T03:24:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a920ab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a8c0c94b0 0x7f7a8c16d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a920ab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a8c0c94b0 0x7f7a8c16d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57458/0 (socket says 172.21.15.84:57458) 2023-10-06T03:24:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a920ab700 1 -- 172.21.15.84:0/1761645072 learned_addr learned my addr 172.21.15.84:0/1761645072 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a918aa700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a78003fe0 0x7f7a8c130950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a910a9700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c0c9040 0x7f7a8c16d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a920ab700 1 -- 172.21.15.84:0/1761645072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c0c9040 msgr2=0x7f7a8c16d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a920ab700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c0c9040 0x7f7a8c16d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a920ab700 1 -- 172.21.15.84:0/1761645072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a78003fe0 msgr2=0x7f7a8c130950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a920ab700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a78003fe0 0x7f7a8c130950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.019+0000 7f7a920ab700 1 -- 172.21.15.84:0/1761645072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0c7040 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.020+0000 7f7a910a9700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c0c9040 0x7f7a8c16d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:54.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.020+0000 7f7a920ab700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a8c0c94b0 0x7f7a8c16d6d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c089360 tx=0x7f7a84001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.020+0000 7f7a81ffb700 1 -- 172.21.15.84:0/1761645072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84017070 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.020+0000 7f7a81ffb700 1 -- 172.21.15.84:0/1761645072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a84012590 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.020+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1761645072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8c0c7320 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.020+0000 7f7a81ffb700 1 -- 172.21.15.84:0/1761645072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84012970 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.020+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1761645072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c0cbbc0 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.021+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1761645072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8c0cbde0 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.021+0000 7f7a81ffb700 1 -- 172.21.15.84:0/1761645072 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a84012ce0 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.021+0000 7f7a81ffb700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a70066f30 0x7f7a700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.022+0000 7f7a81ffb700 1 -- 172.21.15.84:0/1761645072 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7a84083d10 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.022+0000 7f7a918aa700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a70066f30 0x7f7a700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.022+0000 7f7a918aa700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a70066f30 0x7f7a700693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7a880094d0 tx=0x7f7a8800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:54.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.026+0000 7f7a81ffb700 1 -- 172.21.15.84:0/1761645072 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a84050ce0 con 0x7f7a8c0c94b0 2023-10-06T03:24:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.202+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1761645072 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a8c0c7b00 con 0x7f7a70066f30 2023-10-06T03:24:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.210+0000 7f7a81ffb700 1 -- 172.21.15.84:0/1761645072 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304506 (secure 0 0 0) 0x7f7a8c0c7b00 con 0x7f7a70066f30 2023-10-06T03:24:54.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1761645072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a70066f30 msgr2=0x7f7a700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a70066f30 0x7f7a700693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7a880094d0 tx=0x7f7a8800b040 comp rx=0 tx=0).stop 2023-10-06T03:24:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1761645072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a8c0c94b0 msgr2=0x7f7a8c16d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a8c0c94b0 0x7f7a8c16d6d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c089360 tx=0x7f7a84001be0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1761645072 shutdown_connections 2023-10-06T03:24:54.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a70066f30 0x7f7a700693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a78003fe0 0x7f7a8c130950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a8c0c94b0 0x7f7a8c16d6d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 --2- 172.21.15.84:0/1761645072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a8c0c9040 0x7f7a8c16d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1761645072 >> 172.21.15.84:0/1761645072 conn(0x7f7a8c068db0 msgr2=0x7f7a8c0b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:54.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1761645072 shutdown_connections 2023-10-06T03:24:54.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.214+0000 7f7a93b0e700 1 -- 172.21.15.84:0/1761645072 wait complete. 2023-10-06T03:24:54.219 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:24:54.227 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-10-06T03:24:53.054527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592086,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382756,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591964,"statfs":{"total":773094113280,"available":770654171136,"internally_reserved":0,"allocated":4558848,"data_stored":2656817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1718,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.267183"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824579+0000","last_change":"2023-10-06T03:24:49.817728+0000","last_active":"2023-10-06T03:24:49.824579+0000","last_peered":"2023-10-06T03:24:49.824579+0000","last_clean":"2023-10-06T03:24:49.824579+0000","last_became_active":"2023-10-06T03:24:49.817464+0000","last_became_peered":"2023-10-06T03:24:49.817464+0000","last_unstale":"2023-10-06T03:24:49.824579+0000","last_undegraded":"2023-10-06T03:24:49.824579+0000","last_fullsized":"2023-10-06T03:24:49.824579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:57.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827956+0000","last_change":"2023-10-06T03:24:49.819543+0000","last_active":"2023-10-06T03:24:49.827956+0000","last_peered":"2023-10-06T03:24:49.827956+0000","last_clean":"2023-10-06T03:24:49.827956+0000","last_became_active":"2023-10-06T03:24:49.819278+0000","last_became_peered":"2023-10-06T03:24:49.819278+0000","last_unstale":"2023-10-06T03:24:49.827956+0000","last_undegraded":"2023-10-06T03:24:49.827956+0000","last_fullsized":"2023-10-06T03:24:49.827956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:57.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.828011+0000","last_change":"2023-10-06T03:24:49.821082+0000","last_active":"2023-10-06T03:24:49.828011+0000","last_peered":"2023-10-06T03:24:49.828011+0000","last_clean":"2023-10-06T03:24:49.828011+0000","last_became_active":"2023-10-06T03:24:49.820543+0000","last_became_peered":"2023-10-06T03:24:49.820543+0000","last_unstale":"2023-10-06T03:24:49.828011+0000","last_undegraded":"2023-10-06T03:24:49.828011+0000","last_fullsized":"2023-10-06T03:24:49.828011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:50.921698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827193+0000","last_change":"2023-10-06T03:24:49.822892+0000","last_active":"2023-10-06T03:24:49.827193+0000","last_peered":"2023-10-06T03:24:49.827193+0000","last_clean":"2023-10-06T03:24:49.827193+0000","last_became_active":"2023-10-06T03:24:49.822618+0000","last_became_peered":"2023-10-06T03:24:49.822618+0000","last_unstale":"2023-10-06T03:24:49.827193+0000","last_undegraded":"2023-10-06T03:24:49.827193+0000","last_fullsized":"2023-10-06T03:24:49.827193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:50.921698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827992+0000","last_change":"2023-10-06T03:24:49.821318+0000","last_active":"2023-10-06T03:24:49.827992+0000","last_peered":"2023-10-06T03:24:49.827992+0000","last_clean":"2023-10-06T03:24:49.827992+0000","last_became_active":"2023-10-06T03:24:49.821044+0000","last_became_peered":"2023-10-06T03:24:49.821044+0000","last_unstale":"2023-10-06T03:24:49.827992+0000","last_undegraded":"2023-10-06T03:24:49.827992+0000","last_fullsized":"2023-10-06T03:24:49.827992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:03.473599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824382+0000","last_change":"2023-10-06T03:24:49.816559+0000","last_active":"2023-10-06T03:24:49.824382+0000","last_peered":"2023-10-06T03:24:49.824382+0000","last_clean":"2023-10-06T03:24:49.824382+0000","last_became_active":"2023-10-06T03:24:49.816292+0000","last_became_peered":"2023-10-06T03:24:49.816292+0000","last_unstale":"2023-10-06T03:24:49.824382+0000","last_undegraded":"2023-10-06T03:24:49.824382+0000","last_fullsized":"2023-10-06T03:24:49.824382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:05.207479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821296+0000","last_change":"2023-10-06T03:24:49.813984+0000","last_active":"2023-10-06T03:24:49.821296+0000","last_peered":"2023-10-06T03:24:49.821296+0000","last_clean":"2023-10-06T03:24:49.821296+0000","last_became_active":"2023-10-06T03:24:49.813685+0000","last_became_peered":"2023-10-06T03:24:49.813685+0000","last_unstale":"2023-10-06T03:24:49.821296+0000","last_undegraded":"2023-10-06T03:24:49.821296+0000","last_fullsized":"2023-10-06T03:24:49.821296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:47.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821221+0000","last_change":"2023-10-06T03:24:49.813389+0000","last_active":"2023-10-06T03:24:49.821221+0000","last_peered":"2023-10-06T03:24:49.821221+0000","last_clean":"2023-10-06T03:24:49.821221+0000","last_became_active":"2023-10-06T03:24:49.813141+0000","last_became_peered":"2023-10-06T03:24:49.813141+0000","last_unstale":"2023-10-06T03:24:49.821221+0000","last_undegraded":"2023-10-06T03:24:49.821221+0000","last_fullsized":"2023-10-06T03:24:49.821221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.832354+0000","last_change":"2023-10-06T03:24:49.822042+0000","last_active":"2023-10-06T03:24:49.832354+0000","last_peered":"2023-10-06T03:24:49.832354+0000","last_clean":"2023-10-06T03:24:49.832354+0000","last_became_active":"2023-10-06T03:24:49.821756+0000","last_became_peered":"2023-10-06T03:24:49.821756+0000","last_unstale":"2023-10-06T03:24:49.832354+0000","last_undegraded":"2023-10-06T03:24:49.832354+0000","last_fullsized":"2023-10-06T03:24:49.832354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.820701+0000","last_change":"2023-10-06T03:24:49.813020+0000","last_active":"2023-10-06T03:24:49.820701+0000","last_peered":"2023-10-06T03:24:49.820701+0000","last_clean":"2023-10-06T03:24:49.820701+0000","last_became_active":"2023-10-06T03:24:49.812753+0000","last_became_peered":"2023-10-06T03:24:49.812753+0000","last_unstale":"2023-10-06T03:24:49.820701+0000","last_undegraded":"2023-10-06T03:24:49.820701+0000","last_fullsized":"2023-10-06T03:24:49.820701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:59.096514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.823952+0000","last_change":"2023-10-06T03:24:49.817948+0000","last_active":"2023-10-06T03:24:49.823952+0000","last_peered":"2023-10-06T03:24:49.823952+0000","last_clean":"2023-10-06T03:24:49.823952+0000","last_became_active":"2023-10-06T03:24:49.817685+0000","last_became_peered":"2023-10-06T03:24:49.817685+0000","last_unstale":"2023-10-06T03:24:49.823952+0000","last_undegraded":"2023-10-06T03:24:49.823952+0000","last_fullsized":"2023-10-06T03:24:49.823952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.793089+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:15.333445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.788345+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:20.530045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827894+0000","last_change":"2023-10-06T03:24:49.816862+0000","last_active":"2023-10-06T03:24:49.827894+0000","last_peered":"2023-10-06T03:24:49.827894+0000","last_clean":"2023-10-06T03:24:49.827894+0000","last_became_active":"2023-10-06T03:24:49.816603+0000","last_became_peered":"2023-10-06T03:24:49.816603+0000","last_unstale":"2023-10-06T03:24:49.827894+0000","last_undegraded":"2023-10-06T03:24:49.827894+0000","last_fullsized":"2023-10-06T03:24:49.827894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833645+0000","last_change":"2023-10-06T03:24:48.806740+0000","last_active":"2023-10-06T03:24:49.833645+0000","last_peered":"2023-10-06T03:24:49.833645+0000","last_clean":"2023-10-06T03:24:49.833645+0000","last_became_active":"2023-10-06T03:24:48.806456+0000","last_became_peered":"2023-10-06T03:24:48.806456+0000","last_unstale":"2023-10-06T03:24:49.833645+0000","last_undegraded":"2023-10-06T03:24:49.833645+0000","last_fullsized":"2023-10-06T03:24:49.833645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:47.026999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824000+0000","last_change":"2023-10-06T03:24:49.818654+0000","last_active":"2023-10-06T03:24:49.824000+0000","last_peered":"2023-10-06T03:24:49.824000+0000","last_clean":"2023-10-06T03:24:49.824000+0000","last_became_active":"2023-10-06T03:24:49.818417+0000","last_became_peered":"2023-10-06T03:24:49.818417+0000","last_unstale":"2023-10-06T03:24:49.824000+0000","last_undegraded":"2023-10-06T03:24:49.824000+0000","last_fullsized":"2023-10-06T03:24:49.824000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:05.207479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835772+0000","last_change":"2023-10-06T03:24:48.805439+0000","last_active":"2023-10-06T03:24:49.835772+0000","last_peered":"2023-10-06T03:24:49.835772+0000","last_clean":"2023-10-06T03:24:49.835772+0000","last_became_active":"2023-10-06T03:24:48.805143+0000","last_became_peered":"2023-10-06T03:24:48.805143+0000","last_unstale":"2023-10-06T03:24:49.835772+0000","last_undegraded":"2023-10-06T03:24:49.835772+0000","last_fullsized":"2023-10-06T03:24:49.835772+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.792607+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:37.630223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.787994+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:44.317412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.808388+0000","last_change":"2023-10-06T03:24:48.809322+0000","last_active":"2023-10-06T03:24:49.808388+0000","last_peered":"2023-10-06T03:24:49.808388+0000","last_clean":"2023-10-06T03:24:49.808388+0000","last_became_active":"2023-10-06T03:24:48.809018+0000","last_became_peered":"2023-10-06T03:24:48.809018+0000","last_unstale":"2023-10-06T03:24:49.808388+0000","last_undegraded":"2023-10-06T03:24:49.808388+0000","last_fullsized":"2023-10-06T03:24:49.808388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.795743+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:46.243326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.787728+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:15.333445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827169+0000","last_change":"2023-10-06T03:24:49.823044+0000","last_active":"2023-10-06T03:24:49.827169+0000","last_peered":"2023-10-06T03:24:49.827169+0000","last_clean":"2023-10-06T03:24:49.827169+0000","last_became_active":"2023-10-06T03:24:49.822784+0000","last_became_peered":"2023-10-06T03:24:49.822784+0000","last_unstale":"2023-10-06T03:24:49.827169+0000","last_undegraded":"2023-10-06T03:24:49.827169+0000","last_fullsized":"2023-10-06T03:24:49.827169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:03.473599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.794835+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:50.513385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836475+0000","last_change":"2023-10-06T03:24:48.809455+0000","last_active":"2023-10-06T03:24:49.836475+0000","last_peered":"2023-10-06T03:24:49.836475+0000","last_clean":"2023-10-06T03:24:49.836475+0000","last_became_active":"2023-10-06T03:24:48.809202+0000","last_became_peered":"2023-10-06T03:24:48.809202+0000","last_unstale":"2023-10-06T03:24:49.836475+0000","last_undegraded":"2023-10-06T03:24:49.836475+0000","last_fullsized":"2023-10-06T03:24:49.836475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824323+0000","last_change":"2023-10-06T03:24:49.818062+0000","last_active":"2023-10-06T03:24:49.824323+0000","last_peered":"2023-10-06T03:24:49.824323+0000","last_clean":"2023-10-06T03:24:49.824323+0000","last_became_active":"2023-10-06T03:24:49.817792+0000","last_became_peered":"2023-10-06T03:24:49.817792+0000","last_unstale":"2023-10-06T03:24:49.824323+0000","last_undegraded":"2023-10-06T03:24:49.824323+0000","last_fullsized":"2023-10-06T03:24:49.824323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.837509+0000","last_change":"2023-10-06T03:24:48.796352+0000","last_active":"2023-10-06T03:24:49.837509+0000","last_peered":"2023-10-06T03:24:49.837509+0000","last_clean":"2023-10-06T03:24:49.837509+0000","last_became_active":"2023-10-06T03:24:48.796076+0000","last_became_peered":"2023-10-06T03:24:48.796076+0000","last_unstale":"2023-10-06T03:24:49.837509+0000","last_undegraded":"2023-10-06T03:24:49.837509+0000","last_fullsized":"2023-10-06T03:24:49.837509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:22.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.792151+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810931+0000","last_change":"2023-10-06T03:24:48.804776+0000","last_active":"2023-10-06T03:24:49.810931+0000","last_peered":"2023-10-06T03:24:49.810931+0000","last_clean":"2023-10-06T03:24:49.810931+0000","last_became_active":"2023-10-06T03:24:48.804506+0000","last_became_peered":"2023-10-06T03:24:48.804506+0000","last_unstale":"2023-10-06T03:24:49.810931+0000","last_undegraded":"2023-10-06T03:24:49.810931+0000","last_fullsized":"2023-10-06T03:24:49.810931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:46.243326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.791630+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824599+0000","last_change":"2023-10-06T03:24:49.818605+0000","last_active":"2023-10-06T03:24:49.824599+0000","last_peered":"2023-10-06T03:24:49.824599+0000","last_clean":"2023-10-06T03:24:49.824599+0000","last_became_active":"2023-10-06T03:24:49.818270+0000","last_became_peered":"2023-10-06T03:24:49.818270+0000","last_unstale":"2023-10-06T03:24:49.824599+0000","last_undegraded":"2023-10-06T03:24:49.824599+0000","last_fullsized":"2023-10-06T03:24:49.824599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.795260+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:33.675684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821360+0000","last_change":"2023-10-06T03:24:49.815067+0000","last_active":"2023-10-06T03:24:49.821360+0000","last_peered":"2023-10-06T03:24:49.821360+0000","last_clean":"2023-10-06T03:24:49.821360+0000","last_became_active":"2023-10-06T03:24:49.814854+0000","last_became_peered":"2023-10-06T03:24:49.814854+0000","last_unstale":"2023-10-06T03:24:49.821360+0000","last_undegraded":"2023-10-06T03:24:49.821360+0000","last_fullsized":"2023-10-06T03:24:49.821360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.678893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834912+0000","last_change":"2023-10-06T03:24:48.803799+0000","last_active":"2023-10-06T03:24:49.834912+0000","last_peered":"2023-10-06T03:24:49.834912+0000","last_clean":"2023-10-06T03:24:49.834912+0000","last_became_active":"2023-10-06T03:24:48.803302+0000","last_became_peered":"2023-10-06T03:24:48.803302+0000","last_unstale":"2023-10-06T03:24:49.834912+0000","last_undegraded":"2023-10-06T03:24:49.834912+0000","last_fullsized":"2023-10-06T03:24:49.834912+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:29.960671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.788836+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:44.687691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836098+0000","last_change":"2023-10-06T03:24:48.810309+0000","last_active":"2023-10-06T03:24:49.836098+0000","last_peered":"2023-10-06T03:24:49.836098+0000","last_clean":"2023-10-06T03:24:49.836098+0000","last_became_active":"2023-10-06T03:24:48.809835+0000","last_became_peered":"2023-10-06T03:24:48.809835+0000","last_unstale":"2023-10-06T03:24:49.836098+0000","last_undegraded":"2023-10-06T03:24:49.836098+0000","last_fullsized":"2023-10-06T03:24:49.836098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.792662+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:53.768279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.791822+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.831359+0000","last_change":"2023-10-06T03:24:49.827821+0000","last_active":"2023-10-06T03:24:49.831359+0000","last_peered":"2023-10-06T03:24:49.831359+0000","last_clean":"2023-10-06T03:24:49.831359+0000","last_became_active":"2023-10-06T03:24:49.827574+0000","last_became_peered":"2023-10-06T03:24:49.827574+0000","last_unstale":"2023-10-06T03:24:49.831359+0000","last_undegraded":"2023-10-06T03:24:49.831359+0000","last_fullsized":"2023-10-06T03:24:49.831359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:47.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.807618+0000","last_change":"2023-10-06T03:24:48.809255+0000","last_active":"2023-10-06T03:24:49.807618+0000","last_peered":"2023-10-06T03:24:49.807618+0000","last_clean":"2023-10-06T03:24:49.807618+0000","last_became_active":"2023-10-06T03:24:48.808968+0000","last_became_peered":"2023-10-06T03:24:48.808968+0000","last_unstale":"2023-10-06T03:24:49.807618+0000","last_undegraded":"2023-10-06T03:24:49.807618+0000","last_fullsized":"2023-10-06T03:24:49.807618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824339+0000","last_change":"2023-10-06T03:24:49.816246+0000","last_active":"2023-10-06T03:24:49.824339+0000","last_peered":"2023-10-06T03:24:49.824339+0000","last_clean":"2023-10-06T03:24:49.824339+0000","last_became_active":"2023-10-06T03:24:49.816004+0000","last_became_peered":"2023-10-06T03:24:49.816004+0000","last_unstale":"2023-10-06T03:24:49.824339+0000","last_undegraded":"2023-10-06T03:24:49.824339+0000","last_fullsized":"2023-10-06T03:24:49.824339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:34.682483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.794884+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:37.160766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810056+0000","last_change":"2023-10-06T03:24:48.804171+0000","last_active":"2023-10-06T03:24:49.810056+0000","last_peered":"2023-10-06T03:24:49.810056+0000","last_clean":"2023-10-06T03:24:49.810056+0000","last_became_active":"2023-10-06T03:24:48.803906+0000","last_became_peered":"2023-10-06T03:24:48.803906+0000","last_unstale":"2023-10-06T03:24:49.810056+0000","last_undegraded":"2023-10-06T03:24:49.810056+0000","last_fullsized":"2023-10-06T03:24:49.810056+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.788483+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:02.125182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:42.970967+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:24:42.970967+0000","last_peered":"2023-10-06T03:24:42.970967+0000","last_clean":"2023-10-06T03:24:42.970967+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:24:42.970967+0000","last_undegraded":"2023-10-06T03:24:42.970967+0000","last_fullsized":"2023-10-06T03:24:42.970967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.811849+0000","last_change":"2023-10-06T03:24:48.809341+0000","last_active":"2023-10-06T03:24:49.811849+0000","last_peered":"2023-10-06T03:24:49.811849+0000","last_clean":"2023-10-06T03:24:49.811849+0000","last_became_active":"2023-10-06T03:24:48.809095+0000","last_became_peered":"2023-10-06T03:24:48.809095+0000","last_unstale":"2023-10-06T03:24:49.811849+0000","last_undegraded":"2023-10-06T03:24:49.811849+0000","last_fullsized":"2023-10-06T03:24:49.811849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:42.355969+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:24:42.355969+0000","last_peered":"2023-10-06T03:24:42.355969+0000","last_clean":"2023-10-06T03:24:42.355969+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:24:42.355969+0000","last_undegraded":"2023-10-06T03:24:42.355969+0000","last_fullsized":"2023-10-06T03:24:42.355969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827049+0000","last_change":"2023-10-06T03:24:49.822079+0000","last_active":"2023-10-06T03:24:49.827049+0000","last_peered":"2023-10-06T03:24:49.827049+0000","last_clean":"2023-10-06T03:24:49.827049+0000","last_became_active":"2023-10-06T03:24:49.821820+0000","last_became_peered":"2023-10-06T03:24:49.821820+0000","last_unstale":"2023-10-06T03:24:49.827049+0000","last_undegraded":"2023-10-06T03:24:49.827049+0000","last_fullsized":"2023-10-06T03:24:49.827049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:42.414642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812317+0000","last_change":"2023-10-06T03:24:48.805388+0000","last_active":"2023-10-06T03:24:49.812317+0000","last_peered":"2023-10-06T03:24:49.812317+0000","last_clean":"2023-10-06T03:24:49.812317+0000","last_became_active":"2023-10-06T03:24:48.805136+0000","last_became_peered":"2023-10-06T03:24:48.805136+0000","last_unstale":"2023-10-06T03:24:49.812317+0000","last_undegraded":"2023-10-06T03:24:49.812317+0000","last_fullsized":"2023-10-06T03:24:49.812317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:09.893072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812416+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:24:49.812416+0000","last_peered":"2023-10-06T03:24:49.812416+0000","last_clean":"2023-10-06T03:24:49.812416+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:24:49.812416+0000","last_undegraded":"2023-10-06T03:24:49.812416+0000","last_fullsized":"2023-10-06T03:24:49.812416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810235+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:24:49.810235+0000","last_peered":"2023-10-06T03:24:49.810235+0000","last_clean":"2023-10-06T03:24:49.810235+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:24:49.810235+0000","last_undegraded":"2023-10-06T03:24:49.810235+0000","last_fullsized":"2023-10-06T03:24:49.810235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810543+0000","last_change":"2023-10-06T03:24:48.808937+0000","last_active":"2023-10-06T03:24:49.810543+0000","last_peered":"2023-10-06T03:24:49.810543+0000","last_clean":"2023-10-06T03:24:49.810543+0000","last_became_active":"2023-10-06T03:24:48.808657+0000","last_became_peered":"2023-10-06T03:24:48.808657+0000","last_unstale":"2023-10-06T03:24:49.810543+0000","last_undegraded":"2023-10-06T03:24:49.810543+0000","last_fullsized":"2023-10-06T03:24:49.810543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.811011+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:24:49.811011+0000","last_peered":"2023-10-06T03:24:49.811011+0000","last_clean":"2023-10-06T03:24:49.811011+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:24:49.811011+0000","last_undegraded":"2023-10-06T03:24:49.811011+0000","last_fullsized":"2023-10-06T03:24:49.811011+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834982+0000","last_change":"2023-10-06T03:24:48.806288+0000","last_active":"2023-10-06T03:24:49.834982+0000","last_peered":"2023-10-06T03:24:49.834982+0000","last_clean":"2023-10-06T03:24:49.834982+0000","last_became_active":"2023-10-06T03:24:48.806067+0000","last_became_peered":"2023-10-06T03:24:48.806067+0000","last_unstale":"2023-10-06T03:24:49.834982+0000","last_undegraded":"2023-10-06T03:24:49.834982+0000","last_fullsized":"2023-10-06T03:24:49.834982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810142+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:24:49.810142+0000","last_peered":"2023-10-06T03:24:49.810142+0000","last_clean":"2023-10-06T03:24:49.810142+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:24:49.810142+0000","last_undegraded":"2023-10-06T03:24:49.810142+0000","last_fullsized":"2023-10-06T03:24:49.810142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.791302+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.808489+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:24:49.808489+0000","last_peered":"2023-10-06T03:24:49.808489+0000","last_clean":"2023-10-06T03:24:49.808489+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:24:49.808489+0000","last_undegraded":"2023-10-06T03:24:49.808489+0000","last_fullsized":"2023-10-06T03:24:49.808489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.828176+0000","last_change":"2023-10-06T03:24:49.818136+0000","last_active":"2023-10-06T03:24:49.828176+0000","last_peered":"2023-10-06T03:24:49.828176+0000","last_clean":"2023-10-06T03:24:49.828176+0000","last_became_active":"2023-10-06T03:24:49.817838+0000","last_became_peered":"2023-10-06T03:24:49.817838+0000","last_unstale":"2023-10-06T03:24:49.828176+0000","last_undegraded":"2023-10-06T03:24:49.828176+0000","last_fullsized":"2023-10-06T03:24:49.828176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:03.131980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812143+0000","last_change":"2023-10-06T03:24:48.811843+0000","last_active":"2023-10-06T03:24:49.812143+0000","last_peered":"2023-10-06T03:24:49.812143+0000","last_clean":"2023-10-06T03:24:49.812143+0000","last_became_active":"2023-10-06T03:24:48.811661+0000","last_became_peered":"2023-10-06T03:24:48.811661+0000","last_unstale":"2023-10-06T03:24:49.812143+0000","last_undegraded":"2023-10-06T03:24:49.812143+0000","last_fullsized":"2023-10-06T03:24:49.812143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:51.862931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:44.290913+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:24:44.290913+0000","last_peered":"2023-10-06T03:24:44.290913+0000","last_clean":"2023-10-06T03:24:44.290913+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:24:44.290913+0000","last_undegraded":"2023-10-06T03:24:44.290913+0000","last_fullsized":"2023-10-06T03:24:44.290913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.794408+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:09.893072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:44.290937+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:24:44.290937+0000","last_peered":"2023-10-06T03:24:44.290937+0000","last_clean":"2023-10-06T03:24:44.290937+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:24:44.290937+0000","last_undegraded":"2023-10-06T03:24:44.290937+0000","last_fullsized":"2023-10-06T03:24:44.290937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1718,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":786386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52200000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.627},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":174603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":6.3680000000000003,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.5039999999999996,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.4740000000000002,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":1}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.042},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":6.4359999999999999,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.93000000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":1.53},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.89700000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":1.6679999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":1.1459999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":786366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.375}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.31}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":397312,"data_stored":173250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":12.19,"5min":12.19,"15min":12.19},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":8.3900000000000006,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.20100000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.26600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.251},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.318}]},{"osd":4,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.948,"5min":16.948,"15min":16.948},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.501}]},{"osd":7,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":16.881,"5min":16.881,"15min":16.881},"last":0.45900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":197486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.308}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":174603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.27200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70699999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.77800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":168125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.758,"5min":4.758,"15min":4.758},"last":0.505},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":9.7690000000000001,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.379},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.624}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":195998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:54.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:54.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.379+0000 7fb45366f700 1 Processor -- start 2023-10-06T03:24:54.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.379+0000 7fb45366f700 1 -- start start 2023-10-06T03:24:54.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.380+0000 7fb45366f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb44c0ad250 0x7fb44c0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.380+0000 7fb45366f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb44c0ad620 0x7fb44c15d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.380+0000 7fb45366f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c0ced30 con 0x7fb44c15d980 2023-10-06T03:24:54.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.380+0000 7fb45366f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c15de00 con 0x7fb44c0ad620 2023-10-06T03:24:54.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.380+0000 7fb45366f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0cf010 con 0x7fb44c0ad250 2023-10-06T03:24:54.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb450c0a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb44c0ad620 0x7fb44c15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb45140b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb44c0ad250 0x7fb44c0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb450c0a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb44c0ad620 0x7fb44c15d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:41786/0 (socket says 172.21.15.84:41786) 2023-10-06T03:24:54.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb450c0a700 1 -- 172.21.15.84:0/2628624039 learned_addr learned my addr 172.21.15.84:0/2628624039 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:54.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb450c0a700 1 -- 172.21.15.84:0/2628624039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb44c0ad250 msgr2=0x7fb44c0cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb450c0a700 1 --2- 172.21.15.84:0/2628624039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb44c0ad250 0x7fb44c0cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb450c0a700 1 -- 172.21.15.84:0/2628624039 >> v1:172.21.15.131:6789/0 conn(0x7fb44c15d980 legacy=0x7fb44c068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb450c0a700 1 -- 172.21.15.84:0/2628624039 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0ccad0 con 0x7fb44c0ad620 2023-10-06T03:24:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb443fff700 1 -- 172.21.15.84:0/2628624039 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423650910 0 0) 0x7fb44c0ced30 con 0x7fb44c15d980 2023-10-06T03:24:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb450c0a700 1 --2- 172.21.15.84:0/2628624039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb44c0ad620 0x7fb44c15d440 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0099b0 tx=0x7fb43c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b7cfe3c083be7d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb443fff700 1 -- 172.21.15.84:0/2628624039 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c009ea0 con 0x7fb44c0ad620 2023-10-06T03:24:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb443fff700 1 -- 172.21.15.84:0/2628624039 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c00b860 con 0x7fb44c0ad620 2023-10-06T03:24:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.381+0000 7fb443fff700 1 -- 172.21.15.84:0/2628624039 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00bc00 con 0x7fb44c0ad620 2023-10-06T03:24:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.382+0000 7fb45366f700 1 -- 172.21.15.84:0/2628624039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb44c0ad620 msgr2=0x7fb44c15d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.382+0000 7fb45366f700 1 --2- 172.21.15.84:0/2628624039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb44c0ad620 0x7fb44c15d440 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0099b0 tx=0x7fb43c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.382+0000 7fb45366f700 1 -- 172.21.15.84:0/2628624039 shutdown_connections 2023-10-06T03:24:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.382+0000 7fb45366f700 1 --2- 172.21.15.84:0/2628624039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb44c0ad250 0x7fb44c0cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.382+0000 7fb45366f700 1 --2- 172.21.15.84:0/2628624039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb44c0ad620 0x7fb44c15d440 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.382+0000 7fb45366f700 1 -- 172.21.15.84:0/2628624039 >> 172.21.15.84:0/2628624039 conn(0x7fb44c067dd0 msgr2=0x7fb44c0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.382+0000 7fb45366f700 1 -- 172.21.15.84:0/2628624039 shutdown_connections 2023-10-06T03:24:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.382+0000 7fb45366f700 1 -- 172.21.15.84:0/2628624039 wait complete. 2023-10-06T03:24:54.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.383+0000 7fb45366f700 1 Processor -- start 2023-10-06T03:24:54.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.383+0000 7fb45366f700 1 -- start start 2023-10-06T03:24:54.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb45366f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb44c0ad250 0x7fb44c159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb45366f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb44c0ad620 0x7fb44c0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb45366f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb44c15d980 0x7fb44c169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb45366f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c15a3c0 con 0x7fb44c0ad620 2023-10-06T03:24:54.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb45366f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0c2120 con 0x7fb44c0ad250 2023-10-06T03:24:54.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb45366f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c16aa60 con 0x7fb44c15d980 2023-10-06T03:24:54.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb450c0a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb44c0ad620 0x7fb44c0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb450c0a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb44c0ad620 0x7fb44c0c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57466/0 (socket says 172.21.15.84:57466) 2023-10-06T03:24:54.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb450c0a700 1 -- 172.21.15.84:0/1254398367 learned_addr learned my addr 172.21.15.84:0/1254398367 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:54.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb451c0c700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb44c15d980 0x7fb44c169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb45140b700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb44c0ad250 0x7fb44c159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb450c0a700 1 -- 172.21.15.84:0/1254398367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb44c15d980 msgr2=0x7fb44c169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb450c0a700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb44c15d980 0x7fb44c169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb450c0a700 1 -- 172.21.15.84:0/1254398367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb44c0ad250 msgr2=0x7fb44c159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb450c0a700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb44c0ad250 0x7fb44c159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.384+0000 7fb450c0a700 1 -- 172.21.15.84:0/1254398367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0094f0 con 0x7fb44c0ad620 2023-10-06T03:24:54.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.385+0000 7fb450c0a700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb44c0ad620 0x7fb44c0c6500 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0704c0 tx=0x7fb43c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:54.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.385+0000 7fb4417fa700 1 -- 172.21.15.84:0/1254398367 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c000d10 con 0x7fb44c0ad620 2023-10-06T03:24:54.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.385+0000 7fb4417fa700 1 -- 172.21.15.84:0/1254398367 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c00bbe0 con 0x7fb44c0ad620 2023-10-06T03:24:54.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.385+0000 7fb45366f700 1 -- 172.21.15.84:0/1254398367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c16ad40 con 0x7fb44c0ad620 2023-10-06T03:24:54.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.385+0000 7fb4417fa700 1 -- 172.21.15.84:0/1254398367 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c011670 con 0x7fb44c0ad620 2023-10-06T03:24:54.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.385+0000 7fb45366f700 1 -- 172.21.15.84:0/1254398367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c0c6a40 con 0x7fb44c0ad620 2023-10-06T03:24:54.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.386+0000 7fb45366f700 1 -- 172.21.15.84:0/1254398367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c0c22b0 con 0x7fb44c0ad620 2023-10-06T03:24:54.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.386+0000 7fb4417fa700 1 -- 172.21.15.84:0/1254398367 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb43c011aa0 con 0x7fb44c0ad620 2023-10-06T03:24:54.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.387+0000 7fb4417fa700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb430066f30 0x7fb4300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.387+0000 7fb4417fa700 1 -- 172.21.15.84:0/1254398367 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb43c085fa0 con 0x7fb44c0ad620 2023-10-06T03:24:54.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.387+0000 7fb45140b700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb430066f30 0x7fb4300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.387+0000 7fb45140b700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb430066f30 0x7fb4300693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb448009da0 tx=0x7fb448009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:54.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.391+0000 7fb4417fa700 1 -- 172.21.15.84:0/1254398367 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb43c0b75a0 con 0x7fb44c0ad620 2023-10-06T03:24:54.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.566+0000 7fb45366f700 1 -- 172.21.15.84:0/1254398367 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb44c064ad0 con 0x7fb430066f30 2023-10-06T03:24:54.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.575+0000 7fb4417fa700 1 -- 172.21.15.84:0/1254398367 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304506 (secure 0 0 0) 0x7fb44c064ad0 con 0x7fb430066f30 2023-10-06T03:24:54.580 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 -- 172.21.15.84:0/1254398367 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb430066f30 msgr2=0x7fb4300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb430066f30 0x7fb4300693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb448009da0 tx=0x7fb448009120 comp rx=0 tx=0).stop 2023-10-06T03:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 -- 172.21.15.84:0/1254398367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb44c0ad620 msgr2=0x7fb44c0c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb44c0ad620 0x7fb44c0c6500 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0704c0 tx=0x7fb43c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 -- 172.21.15.84:0/1254398367 shutdown_connections 2023-10-06T03:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb430066f30 0x7fb4300693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb44c0ad250 0x7fb44c159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb44c15d980 0x7fb44c169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 --2- 172.21.15.84:0/1254398367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb44c0ad620 0x7fb44c0c6500 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 -- 172.21.15.84:0/1254398367 >> 172.21.15.84:0/1254398367 conn(0x7fb44c067dd0 msgr2=0x7fb44c06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 -- 172.21.15.84:0/1254398367 shutdown_connections 2023-10-06T03:24:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.578+0000 7fb45366f700 1 -- 172.21.15.84:0/1254398367 wait complete. 2023-10-06T03:24:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:24:54.592 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-10-06T03:24:53.054527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592086,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382756,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591964,"statfs":{"total":773094113280,"available":770654171136,"internally_reserved":0,"allocated":4558848,"data_stored":2656817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1718,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.267183"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824579+0000","last_change":"2023-10-06T03:24:49.817728+0000","last_active":"2023-10-06T03:24:49.824579+0000","last_peered":"2023-10-06T03:24:49.824579+0000","last_clean":"2023-10-06T03:24:49.824579+0000","last_became_active":"2023-10-06T03:24:49.817464+0000","last_became_peered":"2023-10-06T03:24:49.817464+0000","last_unstale":"2023-10-06T03:24:49.824579+0000","last_undegraded":"2023-10-06T03:24:49.824579+0000","last_fullsized":"2023-10-06T03:24:49.824579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:57.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827956+0000","last_change":"2023-10-06T03:24:49.819543+0000","last_active":"2023-10-06T03:24:49.827956+0000","last_peered":"2023-10-06T03:24:49.827956+0000","last_clean":"2023-10-06T03:24:49.827956+0000","last_became_active":"2023-10-06T03:24:49.819278+0000","last_became_peered":"2023-10-06T03:24:49.819278+0000","last_unstale":"2023-10-06T03:24:49.827956+0000","last_undegraded":"2023-10-06T03:24:49.827956+0000","last_fullsized":"2023-10-06T03:24:49.827956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:57.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.828011+0000","last_change":"2023-10-06T03:24:49.821082+0000","last_active":"2023-10-06T03:24:49.828011+0000","last_peered":"2023-10-06T03:24:49.828011+0000","last_clean":"2023-10-06T03:24:49.828011+0000","last_became_active":"2023-10-06T03:24:49.820543+0000","last_became_peered":"2023-10-06T03:24:49.820543+0000","last_unstale":"2023-10-06T03:24:49.828011+0000","last_undegraded":"2023-10-06T03:24:49.828011+0000","last_fullsized":"2023-10-06T03:24:49.828011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:50.921698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827193+0000","last_change":"2023-10-06T03:24:49.822892+0000","last_active":"2023-10-06T03:24:49.827193+0000","last_peered":"2023-10-06T03:24:49.827193+0000","last_clean":"2023-10-06T03:24:49.827193+0000","last_became_active":"2023-10-06T03:24:49.822618+0000","last_became_peered":"2023-10-06T03:24:49.822618+0000","last_unstale":"2023-10-06T03:24:49.827193+0000","last_undegraded":"2023-10-06T03:24:49.827193+0000","last_fullsized":"2023-10-06T03:24:49.827193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:50.921698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827992+0000","last_change":"2023-10-06T03:24:49.821318+0000","last_active":"2023-10-06T03:24:49.827992+0000","last_peered":"2023-10-06T03:24:49.827992+0000","last_clean":"2023-10-06T03:24:49.827992+0000","last_became_active":"2023-10-06T03:24:49.821044+0000","last_became_peered":"2023-10-06T03:24:49.821044+0000","last_unstale":"2023-10-06T03:24:49.827992+0000","last_undegraded":"2023-10-06T03:24:49.827992+0000","last_fullsized":"2023-10-06T03:24:49.827992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:03.473599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824382+0000","last_change":"2023-10-06T03:24:49.816559+0000","last_active":"2023-10-06T03:24:49.824382+0000","last_peered":"2023-10-06T03:24:49.824382+0000","last_clean":"2023-10-06T03:24:49.824382+0000","last_became_active":"2023-10-06T03:24:49.816292+0000","last_became_peered":"2023-10-06T03:24:49.816292+0000","last_unstale":"2023-10-06T03:24:49.824382+0000","last_undegraded":"2023-10-06T03:24:49.824382+0000","last_fullsized":"2023-10-06T03:24:49.824382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:05.207479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821296+0000","last_change":"2023-10-06T03:24:49.813984+0000","last_active":"2023-10-06T03:24:49.821296+0000","last_peered":"2023-10-06T03:24:49.821296+0000","last_clean":"2023-10-06T03:24:49.821296+0000","last_became_active":"2023-10-06T03:24:49.813685+0000","last_became_peered":"2023-10-06T03:24:49.813685+0000","last_unstale":"2023-10-06T03:24:49.821296+0000","last_undegraded":"2023-10-06T03:24:49.821296+0000","last_fullsized":"2023-10-06T03:24:49.821296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:47.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821221+0000","last_change":"2023-10-06T03:24:49.813389+0000","last_active":"2023-10-06T03:24:49.821221+0000","last_peered":"2023-10-06T03:24:49.821221+0000","last_clean":"2023-10-06T03:24:49.821221+0000","last_became_active":"2023-10-06T03:24:49.813141+0000","last_became_peered":"2023-10-06T03:24:49.813141+0000","last_unstale":"2023-10-06T03:24:49.821221+0000","last_undegraded":"2023-10-06T03:24:49.821221+0000","last_fullsized":"2023-10-06T03:24:49.821221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.832354+0000","last_change":"2023-10-06T03:24:49.822042+0000","last_active":"2023-10-06T03:24:49.832354+0000","last_peered":"2023-10-06T03:24:49.832354+0000","last_clean":"2023-10-06T03:24:49.832354+0000","last_became_active":"2023-10-06T03:24:49.821756+0000","last_became_peered":"2023-10-06T03:24:49.821756+0000","last_unstale":"2023-10-06T03:24:49.832354+0000","last_undegraded":"2023-10-06T03:24:49.832354+0000","last_fullsized":"2023-10-06T03:24:49.832354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.820701+0000","last_change":"2023-10-06T03:24:49.813020+0000","last_active":"2023-10-06T03:24:49.820701+0000","last_peered":"2023-10-06T03:24:49.820701+0000","last_clean":"2023-10-06T03:24:49.820701+0000","last_became_active":"2023-10-06T03:24:49.812753+0000","last_became_peered":"2023-10-06T03:24:49.812753+0000","last_unstale":"2023-10-06T03:24:49.820701+0000","last_undegraded":"2023-10-06T03:24:49.820701+0000","last_fullsized":"2023-10-06T03:24:49.820701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:59.096514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.823952+0000","last_change":"2023-10-06T03:24:49.817948+0000","last_active":"2023-10-06T03:24:49.823952+0000","last_peered":"2023-10-06T03:24:49.823952+0000","last_clean":"2023-10-06T03:24:49.823952+0000","last_became_active":"2023-10-06T03:24:49.817685+0000","last_became_peered":"2023-10-06T03:24:49.817685+0000","last_unstale":"2023-10-06T03:24:49.823952+0000","last_undegraded":"2023-10-06T03:24:49.823952+0000","last_fullsized":"2023-10-06T03:24:49.823952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.793089+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:15.333445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.788345+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:20.530045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827894+0000","last_change":"2023-10-06T03:24:49.816862+0000","last_active":"2023-10-06T03:24:49.827894+0000","last_peered":"2023-10-06T03:24:49.827894+0000","last_clean":"2023-10-06T03:24:49.827894+0000","last_became_active":"2023-10-06T03:24:49.816603+0000","last_became_peered":"2023-10-06T03:24:49.816603+0000","last_unstale":"2023-10-06T03:24:49.827894+0000","last_undegraded":"2023-10-06T03:24:49.827894+0000","last_fullsized":"2023-10-06T03:24:49.827894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833645+0000","last_change":"2023-10-06T03:24:48.806740+0000","last_active":"2023-10-06T03:24:49.833645+0000","last_peered":"2023-10-06T03:24:49.833645+0000","last_clean":"2023-10-06T03:24:49.833645+0000","last_became_active":"2023-10-06T03:24:48.806456+0000","last_became_peered":"2023-10-06T03:24:48.806456+0000","last_unstale":"2023-10-06T03:24:49.833645+0000","last_undegraded":"2023-10-06T03:24:49.833645+0000","last_fullsized":"2023-10-06T03:24:49.833645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:47.026999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824000+0000","last_change":"2023-10-06T03:24:49.818654+0000","last_active":"2023-10-06T03:24:49.824000+0000","last_peered":"2023-10-06T03:24:49.824000+0000","last_clean":"2023-10-06T03:24:49.824000+0000","last_became_active":"2023-10-06T03:24:49.818417+0000","last_became_peered":"2023-10-06T03:24:49.818417+0000","last_unstale":"2023-10-06T03:24:49.824000+0000","last_undegraded":"2023-10-06T03:24:49.824000+0000","last_fullsized":"2023-10-06T03:24:49.824000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:05.207479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835772+0000","last_change":"2023-10-06T03:24:48.805439+0000","last_active":"2023-10-06T03:24:49.835772+0000","last_peered":"2023-10-06T03:24:49.835772+0000","last_clean":"2023-10-06T03:24:49.835772+0000","last_became_active":"2023-10-06T03:24:48.805143+0000","last_became_peered":"2023-10-06T03:24:48.805143+0000","last_unstale":"2023-10-06T03:24:49.835772+0000","last_undegraded":"2023-10-06T03:24:49.835772+0000","last_fullsized":"2023-10-06T03:24:49.835772+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.792607+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:37.630223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.787994+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:44.317412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.808388+0000","last_change":"2023-10-06T03:24:48.809322+0000","last_active":"2023-10-06T03:24:49.808388+0000","last_peered":"2023-10-06T03:24:49.808388+0000","last_clean":"2023-10-06T03:24:49.808388+0000","last_became_active":"2023-10-06T03:24:48.809018+0000","last_became_peered":"2023-10-06T03:24:48.809018+0000","last_unstale":"2023-10-06T03:24:49.808388+0000","last_undegraded":"2023-10-06T03:24:49.808388+0000","last_fullsized":"2023-10-06T03:24:49.808388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.795743+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:46.243326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.787728+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:15.333445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827169+0000","last_change":"2023-10-06T03:24:49.823044+0000","last_active":"2023-10-06T03:24:49.827169+0000","last_peered":"2023-10-06T03:24:49.827169+0000","last_clean":"2023-10-06T03:24:49.827169+0000","last_became_active":"2023-10-06T03:24:49.822784+0000","last_became_peered":"2023-10-06T03:24:49.822784+0000","last_unstale":"2023-10-06T03:24:49.827169+0000","last_undegraded":"2023-10-06T03:24:49.827169+0000","last_fullsized":"2023-10-06T03:24:49.827169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:03.473599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.794835+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:50.513385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836475+0000","last_change":"2023-10-06T03:24:48.809455+0000","last_active":"2023-10-06T03:24:49.836475+0000","last_peered":"2023-10-06T03:24:49.836475+0000","last_clean":"2023-10-06T03:24:49.836475+0000","last_became_active":"2023-10-06T03:24:48.809202+0000","last_became_peered":"2023-10-06T03:24:48.809202+0000","last_unstale":"2023-10-06T03:24:49.836475+0000","last_undegraded":"2023-10-06T03:24:49.836475+0000","last_fullsized":"2023-10-06T03:24:49.836475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824323+0000","last_change":"2023-10-06T03:24:49.818062+0000","last_active":"2023-10-06T03:24:49.824323+0000","last_peered":"2023-10-06T03:24:49.824323+0000","last_clean":"2023-10-06T03:24:49.824323+0000","last_became_active":"2023-10-06T03:24:49.817792+0000","last_became_peered":"2023-10-06T03:24:49.817792+0000","last_unstale":"2023-10-06T03:24:49.824323+0000","last_undegraded":"2023-10-06T03:24:49.824323+0000","last_fullsized":"2023-10-06T03:24:49.824323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.837509+0000","last_change":"2023-10-06T03:24:48.796352+0000","last_active":"2023-10-06T03:24:49.837509+0000","last_peered":"2023-10-06T03:24:49.837509+0000","last_clean":"2023-10-06T03:24:49.837509+0000","last_became_active":"2023-10-06T03:24:48.796076+0000","last_became_peered":"2023-10-06T03:24:48.796076+0000","last_unstale":"2023-10-06T03:24:49.837509+0000","last_undegraded":"2023-10-06T03:24:49.837509+0000","last_fullsized":"2023-10-06T03:24:49.837509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:22.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.792151+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810931+0000","last_change":"2023-10-06T03:24:48.804776+0000","last_active":"2023-10-06T03:24:49.810931+0000","last_peered":"2023-10-06T03:24:49.810931+0000","last_clean":"2023-10-06T03:24:49.810931+0000","last_became_active":"2023-10-06T03:24:48.804506+0000","last_became_peered":"2023-10-06T03:24:48.804506+0000","last_unstale":"2023-10-06T03:24:49.810931+0000","last_undegraded":"2023-10-06T03:24:49.810931+0000","last_fullsized":"2023-10-06T03:24:49.810931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:46.243326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.791630+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824599+0000","last_change":"2023-10-06T03:24:49.818605+0000","last_active":"2023-10-06T03:24:49.824599+0000","last_peered":"2023-10-06T03:24:49.824599+0000","last_clean":"2023-10-06T03:24:49.824599+0000","last_became_active":"2023-10-06T03:24:49.818270+0000","last_became_peered":"2023-10-06T03:24:49.818270+0000","last_unstale":"2023-10-06T03:24:49.824599+0000","last_undegraded":"2023-10-06T03:24:49.824599+0000","last_fullsized":"2023-10-06T03:24:49.824599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.795260+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:33.675684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821360+0000","last_change":"2023-10-06T03:24:49.815067+0000","last_active":"2023-10-06T03:24:49.821360+0000","last_peered":"2023-10-06T03:24:49.821360+0000","last_clean":"2023-10-06T03:24:49.821360+0000","last_became_active":"2023-10-06T03:24:49.814854+0000","last_became_peered":"2023-10-06T03:24:49.814854+0000","last_unstale":"2023-10-06T03:24:49.821360+0000","last_undegraded":"2023-10-06T03:24:49.821360+0000","last_fullsized":"2023-10-06T03:24:49.821360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.678893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834912+0000","last_change":"2023-10-06T03:24:48.803799+0000","last_active":"2023-10-06T03:24:49.834912+0000","last_peered":"2023-10-06T03:24:49.834912+0000","last_clean":"2023-10-06T03:24:49.834912+0000","last_became_active":"2023-10-06T03:24:48.803302+0000","last_became_peered":"2023-10-06T03:24:48.803302+0000","last_unstale":"2023-10-06T03:24:49.834912+0000","last_undegraded":"2023-10-06T03:24:49.834912+0000","last_fullsized":"2023-10-06T03:24:49.834912+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:29.960671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.788836+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:44.687691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836098+0000","last_change":"2023-10-06T03:24:48.810309+0000","last_active":"2023-10-06T03:24:49.836098+0000","last_peered":"2023-10-06T03:24:49.836098+0000","last_clean":"2023-10-06T03:24:49.836098+0000","last_became_active":"2023-10-06T03:24:48.809835+0000","last_became_peered":"2023-10-06T03:24:48.809835+0000","last_unstale":"2023-10-06T03:24:49.836098+0000","last_undegraded":"2023-10-06T03:24:49.836098+0000","last_fullsized":"2023-10-06T03:24:49.836098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.792662+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:53.768279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.791822+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.831359+0000","last_change":"2023-10-06T03:24:49.827821+0000","last_active":"2023-10-06T03:24:49.831359+0000","last_peered":"2023-10-06T03:24:49.831359+0000","last_clean":"2023-10-06T03:24:49.831359+0000","last_became_active":"2023-10-06T03:24:49.827574+0000","last_became_peered":"2023-10-06T03:24:49.827574+0000","last_unstale":"2023-10-06T03:24:49.831359+0000","last_undegraded":"2023-10-06T03:24:49.831359+0000","last_fullsized":"2023-10-06T03:24:49.831359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:47.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.807618+0000","last_change":"2023-10-06T03:24:48.809255+0000","last_active":"2023-10-06T03:24:49.807618+0000","last_peered":"2023-10-06T03:24:49.807618+0000","last_clean":"2023-10-06T03:24:49.807618+0000","last_became_active":"2023-10-06T03:24:48.808968+0000","last_became_peered":"2023-10-06T03:24:48.808968+0000","last_unstale":"2023-10-06T03:24:49.807618+0000","last_undegraded":"2023-10-06T03:24:49.807618+0000","last_fullsized":"2023-10-06T03:24:49.807618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824339+0000","last_change":"2023-10-06T03:24:49.816246+0000","last_active":"2023-10-06T03:24:49.824339+0000","last_peered":"2023-10-06T03:24:49.824339+0000","last_clean":"2023-10-06T03:24:49.824339+0000","last_became_active":"2023-10-06T03:24:49.816004+0000","last_became_peered":"2023-10-06T03:24:49.816004+0000","last_unstale":"2023-10-06T03:24:49.824339+0000","last_undegraded":"2023-10-06T03:24:49.824339+0000","last_fullsized":"2023-10-06T03:24:49.824339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:34.682483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.794884+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:37.160766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810056+0000","last_change":"2023-10-06T03:24:48.804171+0000","last_active":"2023-10-06T03:24:49.810056+0000","last_peered":"2023-10-06T03:24:49.810056+0000","last_clean":"2023-10-06T03:24:49.810056+0000","last_became_active":"2023-10-06T03:24:48.803906+0000","last_became_peered":"2023-10-06T03:24:48.803906+0000","last_unstale":"2023-10-06T03:24:49.810056+0000","last_undegraded":"2023-10-06T03:24:49.810056+0000","last_fullsized":"2023-10-06T03:24:49.810056+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.788483+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:02.125182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:42.970967+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:24:42.970967+0000","last_peered":"2023-10-06T03:24:42.970967+0000","last_clean":"2023-10-06T03:24:42.970967+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:24:42.970967+0000","last_undegraded":"2023-10-06T03:24:42.970967+0000","last_fullsized":"2023-10-06T03:24:42.970967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.811849+0000","last_change":"2023-10-06T03:24:48.809341+0000","last_active":"2023-10-06T03:24:49.811849+0000","last_peered":"2023-10-06T03:24:49.811849+0000","last_clean":"2023-10-06T03:24:49.811849+0000","last_became_active":"2023-10-06T03:24:48.809095+0000","last_became_peered":"2023-10-06T03:24:48.809095+0000","last_unstale":"2023-10-06T03:24:49.811849+0000","last_undegraded":"2023-10-06T03:24:49.811849+0000","last_fullsized":"2023-10-06T03:24:49.811849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:42.355969+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:24:42.355969+0000","last_peered":"2023-10-06T03:24:42.355969+0000","last_clean":"2023-10-06T03:24:42.355969+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:24:42.355969+0000","last_undegraded":"2023-10-06T03:24:42.355969+0000","last_fullsized":"2023-10-06T03:24:42.355969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827049+0000","last_change":"2023-10-06T03:24:49.822079+0000","last_active":"2023-10-06T03:24:49.827049+0000","last_peered":"2023-10-06T03:24:49.827049+0000","last_clean":"2023-10-06T03:24:49.827049+0000","last_became_active":"2023-10-06T03:24:49.821820+0000","last_became_peered":"2023-10-06T03:24:49.821820+0000","last_unstale":"2023-10-06T03:24:49.827049+0000","last_undegraded":"2023-10-06T03:24:49.827049+0000","last_fullsized":"2023-10-06T03:24:49.827049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:42.414642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812317+0000","last_change":"2023-10-06T03:24:48.805388+0000","last_active":"2023-10-06T03:24:49.812317+0000","last_peered":"2023-10-06T03:24:49.812317+0000","last_clean":"2023-10-06T03:24:49.812317+0000","last_became_active":"2023-10-06T03:24:48.805136+0000","last_became_peered":"2023-10-06T03:24:48.805136+0000","last_unstale":"2023-10-06T03:24:49.812317+0000","last_undegraded":"2023-10-06T03:24:49.812317+0000","last_fullsized":"2023-10-06T03:24:49.812317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:09.893072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812416+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:24:49.812416+0000","last_peered":"2023-10-06T03:24:49.812416+0000","last_clean":"2023-10-06T03:24:49.812416+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:24:49.812416+0000","last_undegraded":"2023-10-06T03:24:49.812416+0000","last_fullsized":"2023-10-06T03:24:49.812416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810235+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:24:49.810235+0000","last_peered":"2023-10-06T03:24:49.810235+0000","last_clean":"2023-10-06T03:24:49.810235+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:24:49.810235+0000","last_undegraded":"2023-10-06T03:24:49.810235+0000","last_fullsized":"2023-10-06T03:24:49.810235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810543+0000","last_change":"2023-10-06T03:24:48.808937+0000","last_active":"2023-10-06T03:24:49.810543+0000","last_peered":"2023-10-06T03:24:49.810543+0000","last_clean":"2023-10-06T03:24:49.810543+0000","last_became_active":"2023-10-06T03:24:48.808657+0000","last_became_peered":"2023-10-06T03:24:48.808657+0000","last_unstale":"2023-10-06T03:24:49.810543+0000","last_undegraded":"2023-10-06T03:24:49.810543+0000","last_fullsized":"2023-10-06T03:24:49.810543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.811011+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:24:49.811011+0000","last_peered":"2023-10-06T03:24:49.811011+0000","last_clean":"2023-10-06T03:24:49.811011+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:24:49.811011+0000","last_undegraded":"2023-10-06T03:24:49.811011+0000","last_fullsized":"2023-10-06T03:24:49.811011+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834982+0000","last_change":"2023-10-06T03:24:48.806288+0000","last_active":"2023-10-06T03:24:49.834982+0000","last_peered":"2023-10-06T03:24:49.834982+0000","last_clean":"2023-10-06T03:24:49.834982+0000","last_became_active":"2023-10-06T03:24:48.806067+0000","last_became_peered":"2023-10-06T03:24:48.806067+0000","last_unstale":"2023-10-06T03:24:49.834982+0000","last_undegraded":"2023-10-06T03:24:49.834982+0000","last_fullsized":"2023-10-06T03:24:49.834982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810142+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:24:49.810142+0000","last_peered":"2023-10-06T03:24:49.810142+0000","last_clean":"2023-10-06T03:24:49.810142+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:24:49.810142+0000","last_undegraded":"2023-10-06T03:24:49.810142+0000","last_fullsized":"2023-10-06T03:24:49.810142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.791302+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.808489+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:24:49.808489+0000","last_peered":"2023-10-06T03:24:49.808489+0000","last_clean":"2023-10-06T03:24:49.808489+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:24:49.808489+0000","last_undegraded":"2023-10-06T03:24:49.808489+0000","last_fullsized":"2023-10-06T03:24:49.808489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.828176+0000","last_change":"2023-10-06T03:24:49.818136+0000","last_active":"2023-10-06T03:24:49.828176+0000","last_peered":"2023-10-06T03:24:49.828176+0000","last_clean":"2023-10-06T03:24:49.828176+0000","last_became_active":"2023-10-06T03:24:49.817838+0000","last_became_peered":"2023-10-06T03:24:49.817838+0000","last_unstale":"2023-10-06T03:24:49.828176+0000","last_undegraded":"2023-10-06T03:24:49.828176+0000","last_fullsized":"2023-10-06T03:24:49.828176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:03.131980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812143+0000","last_change":"2023-10-06T03:24:48.811843+0000","last_active":"2023-10-06T03:24:49.812143+0000","last_peered":"2023-10-06T03:24:49.812143+0000","last_clean":"2023-10-06T03:24:49.812143+0000","last_became_active":"2023-10-06T03:24:48.811661+0000","last_became_peered":"2023-10-06T03:24:48.811661+0000","last_unstale":"2023-10-06T03:24:49.812143+0000","last_undegraded":"2023-10-06T03:24:49.812143+0000","last_fullsized":"2023-10-06T03:24:49.812143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:51.862931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:44.290913+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:24:44.290913+0000","last_peered":"2023-10-06T03:24:44.290913+0000","last_clean":"2023-10-06T03:24:44.290913+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:24:44.290913+0000","last_undegraded":"2023-10-06T03:24:44.290913+0000","last_fullsized":"2023-10-06T03:24:44.290913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:24:48.784733+0000","last_change":"2023-10-06T03:24:48.784733+0000","last_active":"2023-10-06T03:24:48.784733+0000","last_peered":"2023-10-06T03:24:48.784733+0000","last_clean":"2023-10-06T03:24:48.784733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:48.784733+0000","last_undegraded":"2023-10-06T03:24:48.784733+0000","last_fullsized":"2023-10-06T03:24:48.784733+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:24:47.777934+0000","last_change":"2023-10-06T03:24:47.794408+0000","last_active":"2023-10-06T03:24:47.777934+0000","last_peered":"2023-10-06T03:24:47.777934+0000","last_clean":"2023-10-06T03:24:47.777934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:24:47.777934+0000","last_undegraded":"2023-10-06T03:24:47.777934+0000","last_fullsized":"2023-10-06T03:24:47.777934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:09.893072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:24:44.290937+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:24:44.290937+0000","last_peered":"2023-10-06T03:24:44.290937+0000","last_clean":"2023-10-06T03:24:44.290937+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:24:44.290937+0000","last_undegraded":"2023-10-06T03:24:44.290937+0000","last_fullsized":"2023-10-06T03:24:44.290937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1718,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":786386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52200000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.627},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":174603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":6.3680000000000003,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.5039999999999996,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.4740000000000002,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":1}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.042},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":6.4359999999999999,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.93000000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":1.53},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.89700000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":1.6679999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":1.1459999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":786366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.375}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.31}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":397312,"data_stored":173250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":12.19,"5min":12.19,"15min":12.19},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":8.3900000000000006,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.20100000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.26600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.251},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.318}]},{"osd":4,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.948,"5min":16.948,"15min":16.948},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.501}]},{"osd":7,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":16.881,"5min":16.881,"15min":16.881},"last":0.45900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":197486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.308}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":174603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.27200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70699999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.77800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":168125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.758,"5min":4.758,"15min":4.758},"last":0.505},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":9.7690000000000001,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.379},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.624}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":195998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:54.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-10-06T03:24:54.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-10-06T03:24:54.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-10-06T03:24:54.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-10-06T03:24:54.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-10-06T03:24:54.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-10-06T03:24:54.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-10-06T03:24:54.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-10-06T03:24:54.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-10-06T03:24:54.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-10-06T03:24:54.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-10-06T03:24:54.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-10-06T03:24:54.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-10-06T03:24:54.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-10-06T03:24:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-10-06T03:24:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-10-06T03:24:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-10-06T03:24:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-10-06T03:24:54.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-10-06T03:24:54.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-10-06T03:24:54.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-10-06T03:24:54.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-10-06T03:24:54.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-10-06T03:24:54.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.793089+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:27:15.333445+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:24:54.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-10-06T03:24:54.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-10-06T03:24:54.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.788345+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:21:20.530045+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:24:54.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-10-06T03:24:54.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-10-06T03:24:54.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.792607+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:59:37.630223+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:24:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-10-06T03:24:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-10-06T03:24:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.787994+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:13:44.317412+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:24:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-10-06T03:24:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-10-06T03:24:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-10-06T03:24:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.795743+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:34:46.243326+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:24:54.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-10-06T03:24:54.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-10-06T03:24:54.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.787728+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:27:15.333445+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:24:54.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-10-06T03:24:54.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.794835+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:50.513385+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:24:54.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-10-06T03:24:54.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-10-06T03:24:54.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-10-06T03:24:54.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.792151+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:24:54.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-10-06T03:24:54.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-10-06T03:24:54.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-10-06T03:24:54.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.791630+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:24:54.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-10-06T03:24:54.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.795260+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:21:33.675684+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:24:54.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-10-06T03:24:54.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-10-06T03:24:54.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.788836+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:22:44.687691+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:24:54.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-10-06T03:24:54.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-10-06T03:24:54.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-10-06T03:24:54.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.792662+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:07:53.768279+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:24:54.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-10-06T03:24:54.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-10-06T03:24:54.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.791822+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:24:54.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-10-06T03:24:54.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.794884+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:54:37.160766+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:24:54.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-10-06T03:24:54.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-10-06T03:24:54.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-10-06T03:24:54.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.788483+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:27:02.125182+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:24:54.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-10-06T03:24:54.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-10-06T03:24:54.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-10-06T03:24:54.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-10-06T03:24:54.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-10-06T03:24:54.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.791302+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:24:54.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-10-06T03:24:54.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:24:48.784733+0000', 'last_change': '2023-10-06T03:24:48.784733+0000', 'last_active': '2023-10-06T03:24:48.784733+0000', 'last_peered': '2023-10-06T03:24:48.784733+0000', 'last_clean': '2023-10-06T03:24:48.784733+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:48.784733+0000', 'last_undegraded': '2023-10-06T03:24:48.784733+0000', 'last_fullsized': '2023-10-06T03:24:48.784733+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:48.784733+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:24:54.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-10-06T03:24:54.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:24:47.777934+0000', 'last_change': '2023-10-06T03:24:47.794408+0000', 'last_active': '2023-10-06T03:24:47.777934+0000', 'last_peered': '2023-10-06T03:24:47.777934+0000', 'last_clean': '2023-10-06T03:24:47.777934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:24:47.777934+0000', 'last_undegraded': '2023-10-06T03:24:47.777934+0000', 'last_fullsized': '2023-10-06T03:24:47.777934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'last_clean_scrub_stamp': '2023-10-06T03:24:47.777934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:10:09.893072+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:24:54.612 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:24:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.743+0000 7fd9b38a7700 1 Processor -- start 2023-10-06T03:24:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.743+0000 7fd9b38a7700 1 -- start start 2023-10-06T03:24:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.744+0000 7fd9b38a7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9ac1595a0 0x7fd9ac0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.744+0000 7fd9b38a7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd9ac0b07a0 0x7fd9ac0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.744+0000 7fd9b38a7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ac0b0ca0 con 0x7fd9ac0b49e0 2023-10-06T03:24:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.744+0000 7fd9b38a7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac0b0f80 con 0x7fd9ac1595a0 2023-10-06T03:24:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.744+0000 7fd9b38a7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac0b1260 con 0x7fd9ac0b07a0 2023-10-06T03:24:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.744+0000 7fd9b1643700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9ac1595a0 0x7fd9ac0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.744+0000 7fd9b1643700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9ac1595a0 0x7fd9ac0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57476/0 (socket says 172.21.15.84:57476) 2023-10-06T03:24:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.744+0000 7fd9b1643700 1 -- 172.21.15.84:0/1473511679 learned_addr learned my addr 172.21.15.84:0/1473511679 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.744+0000 7fd9b1e44700 1 --2- 172.21.15.84:0/1473511679 >> v2:172.21.15.131:3300/0 conn(0x7fd9ac0b07a0 0x7fd9ac0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b1643700 1 -- 172.21.15.84:0/1473511679 >> v2:172.21.15.131:3300/0 conn(0x7fd9ac0b07a0 msgr2=0x7fd9ac0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b1643700 1 --2- 172.21.15.84:0/1473511679 >> v2:172.21.15.131:3300/0 conn(0x7fd9ac0b07a0 0x7fd9ac0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b1643700 1 -- 172.21.15.84:0/1473511679 >> v1:172.21.15.131:6789/0 conn(0x7fd9ac0b49e0 legacy=0x7fd9ac0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b1643700 1 -- 172.21.15.84:0/1473511679 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac0b1540 con 0x7fd9ac1595a0 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b1643700 1 --2- 172.21.15.84:0/1473511679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 0x7fd9ac0aa570 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009990 tx=0x7fd9a8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1930cfee428381ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9a3fff700 1 -- 172.21.15.84:0/1473511679 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8005c10 con 0x7fd9ac1595a0 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9a3fff700 1 -- 172.21.15.84:0/1473511679 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a8005d70 con 0x7fd9ac1595a0 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9a3fff700 1 -- 172.21.15.84:0/1473511679 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a800b800 con 0x7fd9ac1595a0 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1473511679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 msgr2=0x7fd9ac0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b38a7700 1 --2- 172.21.15.84:0/1473511679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 0x7fd9ac0aa570 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009990 tx=0x7fd9a8009220 comp rx=0 tx=0).stop 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1473511679 shutdown_connections 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b38a7700 1 --2- 172.21.15.84:0/1473511679 >> v2:172.21.15.131:3300/0 conn(0x7fd9ac0b07a0 0x7fd9ac0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b38a7700 1 --2- 172.21.15.84:0/1473511679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 0x7fd9ac0aa570 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.745+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1473511679 >> 172.21.15.84:0/1473511679 conn(0x7fd9ac099830 msgr2=0x7fd9ac06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.746+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1473511679 shutdown_connections 2023-10-06T03:24:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.746+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1473511679 wait complete. 2023-10-06T03:24:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.747+0000 7fd9b38a7700 1 Processor -- start 2023-10-06T03:24:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.747+0000 7fd9b38a7700 1 -- start start 2023-10-06T03:24:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.747+0000 7fd9b38a7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9ac0b07a0 0x7fd9ac0ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.747+0000 7fd9b38a7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9ac0b49e0 0x7fd9ac09b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.747+0000 7fd9b38a7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 0x7fd9ac09c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.747+0000 7fd9b38a7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0ab780 con 0x7fd9ac1595a0 2023-10-06T03:24:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.747+0000 7fd9b38a7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac09a3f0 con 0x7fd9ac0b07a0 2023-10-06T03:24:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.747+0000 7fd9b38a7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac09a6d0 con 0x7fd9ac0b49e0 2023-10-06T03:24:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b1e44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 0x7fd9ac09c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b1e44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 0x7fd9ac09c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57480/0 (socket says 172.21.15.84:57480) 2023-10-06T03:24:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b1e44700 1 -- 172.21.15.84:0/1687978897 learned_addr learned my addr 172.21.15.84:0/1687978897 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b1643700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9ac0b07a0 0x7fd9ac0ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b0e42700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9ac0b49e0 0x7fd9ac09b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b1e44700 1 -- 172.21.15.84:0/1687978897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9ac0b49e0 msgr2=0x7fd9ac09b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b1e44700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9ac0b49e0 0x7fd9ac09b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b1e44700 1 -- 172.21.15.84:0/1687978897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9ac0b07a0 msgr2=0x7fd9ac0ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b1e44700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9ac0b07a0 0x7fd9ac0ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b1e44700 1 -- 172.21.15.84:0/1687978897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8009480 con 0x7fd9ac1595a0 2023-10-06T03:24:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b0e42700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9ac0b49e0 0x7fd9ac09b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b1e44700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 0x7fd9ac09c170 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009fa0 tx=0x7fd9a4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9a17fa700 1 -- 172.21.15.84:0/1687978897 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a400ed20 con 0x7fd9ac1595a0 2023-10-06T03:24:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9a17fa700 1 -- 172.21.15.84:0/1687978897 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a400ee80 con 0x7fd9ac1595a0 2023-10-06T03:24:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1687978897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac09a9b0 con 0x7fd9ac1595a0 2023-10-06T03:24:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9a17fa700 1 -- 172.21.15.84:0/1687978897 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4014670 con 0x7fd9ac1595a0 2023-10-06T03:24:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.748+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1687978897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac09ad40 con 0x7fd9ac1595a0 2023-10-06T03:24:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.749+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1687978897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac09b2e0 con 0x7fd9ac1595a0 2023-10-06T03:24:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.749+0000 7fd9a17fa700 1 -- 172.21.15.84:0/1687978897 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9a40149e0 con 0x7fd9ac1595a0 2023-10-06T03:24:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.750+0000 7fd9a17fa700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd990066f30 0x7fd9900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.750+0000 7fd9a17fa700 1 -- 172.21.15.84:0/1687978897 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd9a4084fc0 con 0x7fd9ac1595a0 2023-10-06T03:24:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.750+0000 7fd9b1643700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd990066f30 0x7fd9900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.750+0000 7fd9b1643700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd990066f30 0x7fd9900693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8007fd0 tx=0x7fd9a8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:54.754+0000 7fd9a17fa700 1 -- 172.21.15.84:0/1687978897 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9a4051f90 con 0x7fd9ac1595a0 2023-10-06T03:24:55.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.014+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1687978897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd9ac08aa50 con 0x7fd9ac1595a0 2023-10-06T03:24:55.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.015+0000 7fd9a17fa700 1 -- 172.21.15.84:0/1687978897 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1725 (secure 0 0 0) 0x7fd9a40555b0 con 0x7fd9ac1595a0 2023-10-06T03:24:55.017 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:55.017 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1696562622,"num_in_osds":8,"osd_in_since":1696562613,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":45},{"state_name":"unknown","count":43},{"state_name":"creating+peering","count":17}],"num_pgs":105,"num_pools":4,"num_objects":13,"data_bytes":592086,"bytes_used":2439942144,"bytes_avail":770654171136,"bytes_total":773094113280,"unknown_pgs_ratio":0.40952381491661072,"inactive_pgs_ratio":0.16190476715564728,"write_bytes_sec":1166,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5112}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-06T03:24:45.053197+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:24:55.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1687978897 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd990066f30 msgr2=0x7fd9900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd990066f30 0x7fd9900693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8007fd0 tx=0x7fd9a8015000 comp rx=0 tx=0).stop 2023-10-06T03:24:55.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1687978897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 msgr2=0x7fd9ac09c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 0x7fd9ac09c170 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009fa0 tx=0x7fd9a4009900 comp rx=0 tx=0).stop 2023-10-06T03:24:55.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1687978897 shutdown_connections 2023-10-06T03:24:55.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd990066f30 0x7fd9900693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9ac0b07a0 0x7fd9ac0ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9ac1595a0 0x7fd9ac09c170 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 --2- 172.21.15.84:0/1687978897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9ac0b49e0 0x7fd9ac09b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1687978897 >> 172.21.15.84:0/1687978897 conn(0x7fd9ac099830 msgr2=0x7fd9ac0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:55.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1687978897 shutdown_connections 2023-10-06T03:24:55.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.017+0000 7fd9b38a7700 1 -- 172.21.15.84:0/1687978897 wait complete. 2023-10-06T03:24:55.030 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T03:24:55.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:55.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.142+0000 7f27e63fc700 1 Processor -- start 2023-10-06T03:24:55.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.142+0000 7f27e63fc700 1 -- start start 2023-10-06T03:24:55.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.143+0000 7f27e63fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f27e0159990 0x7f27e00675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.143+0000 7f27e63fc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e0067f40 con 0x7f27e01595c0 2023-10-06T03:24:55.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.143+0000 7f27e63fc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e00cde70 con 0x7f27e0067b30 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.143+0000 7f27e63fc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e006ef60 con 0x7f27e0159990 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.143+0000 7f27dffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f27e01595c0 0x7f27e006e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50252/0 (socket says 172.21.15.84:50252) 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.143+0000 7f27dffff700 1 -- 172.21.15.84:0/2572049157 learned_addr learned my addr 172.21.15.84:0/2572049157 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27df7fe700 1 --2- 172.21.15.84:0/2572049157 >> v2:172.21.15.131:3300/0 conn(0x7f27e0159990 0x7f27e00675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146586268 0 0) 0x7f27e0067f40 con 0x7f27e01595c0 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c8003570 con 0x7f27e01595c0 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4178346260 0 0) 0x7f27c8003570 con 0x7f27e01595c0 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 >> v2:172.21.15.131:3300/0 conn(0x7f27e0159990 msgr2=0x7f27e00675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 --2- 172.21.15.84:0/2572049157 >> v2:172.21.15.131:3300/0 conn(0x7f27e0159990 0x7f27e00675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 >> v1:172.21.15.131:6789/0 conn(0x7f27e0067b30 legacy=0x7f27e00b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e006f240 con 0x7f27e01595c0 2023-10-06T03:24:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f27d0001470 con 0x7f27e01595c0 2023-10-06T03:24:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 >> v1:172.21.15.84:6789/0 conn(0x7f27e01595c0 legacy=0x7f27e006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c8003a60 0x7f27c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27c8004810 0x7f27c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c80051c0 0x7f27c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e006ef60 con 0x7f27c8003a60 2023-10-06T03:24:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c800c0d0 con 0x7f27c80051c0 2023-10-06T03:24:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c800c290 con 0x7f27c8004810 2023-10-06T03:24:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27dffff700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c8003a60 0x7f27c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27df7fe700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27c8004810 0x7f27c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27e4999700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c80051c0 0x7f27c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27dffff700 1 -- 172.21.15.84:0/2572049157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27c8004810 msgr2=0x7f27c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27dffff700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27c8004810 0x7f27c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27dffff700 1 -- 172.21.15.84:0/2572049157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c80051c0 msgr2=0x7f27c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27dffff700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c80051c0 0x7f27c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27e4999700 1 -- 172.21.15.84:0/2572049157 reap_dead start 2023-10-06T03:24:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.144+0000 7f27dffff700 1 -- 172.21.15.84:0/2572049157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c8003570 con 0x7f27c8003a60 2023-10-06T03:24:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27dffff700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c8003a60 0x7f27c8003e70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c3c0 tx=0x7f27d0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992c6f2e03c26b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d000cc90 con 0x7f27c8003a60 2023-10-06T03:24:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d000cdf0 con 0x7f27c8003a60 2023-10-06T03:24:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27deffd700 1 -- 172.21.15.84:0/2572049157 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0005b50 con 0x7f27c8003a60 2023-10-06T03:24:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27e63fc700 1 -- 172.21.15.84:0/2572049157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c8003a60 msgr2=0x7f27c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27e63fc700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c8003a60 0x7f27c8003e70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c3c0 tx=0x7f27d0001e50 comp rx=0 tx=0).stop 2023-10-06T03:24:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27e63fc700 1 -- 172.21.15.84:0/2572049157 shutdown_connections 2023-10-06T03:24:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27e63fc700 1 --2- 172.21.15.84:0/2572049157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c8003a60 0x7f27c8003e70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27e63fc700 1 -- 172.21.15.84:0/2572049157 >> 172.21.15.84:0/2572049157 conn(0x7f27e0069180 msgr2=0x7f27e00cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:55.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27e63fc700 1 -- 172.21.15.84:0/2572049157 shutdown_connections 2023-10-06T03:24:55.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.145+0000 7f27e63fc700 1 -- 172.21.15.84:0/2572049157 wait complete. 2023-10-06T03:24:55.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.146+0000 7f27e63fc700 1 Processor -- start 2023-10-06T03:24:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27e63fc700 1 -- start start 2023-10-06T03:24:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27e63fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c8003a60 0x7f27e0144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27e63fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27e015be20 0x7f27e015c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27e63fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27e015aff0 0x7f27e015b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27e63fc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e015b9a0 con 0x7f27e015aff0 2023-10-06T03:24:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27e63fc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e016cf90 con 0x7f27c8003a60 2023-10-06T03:24:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27e63fc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e016d230 con 0x7f27e015be20 2023-10-06T03:24:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27e4999700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27e015aff0 0x7f27e015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27e4999700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27e015aff0 0x7f27e015b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57502/0 (socket says 172.21.15.84:57502) 2023-10-06T03:24:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27dffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c8003a60 0x7f27e0144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27e4999700 1 -- 172.21.15.84:0/1379476436 learned_addr learned my addr 172.21.15.84:0/1379476436 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.147+0000 7f27df7fe700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27e015be20 0x7f27e015c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27e4999700 1 -- 172.21.15.84:0/1379476436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27e015be20 msgr2=0x7f27e015c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27e4999700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27e015be20 0x7f27e015c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27e4999700 1 -- 172.21.15.84:0/1379476436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c8003a60 msgr2=0x7f27e0144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27e4999700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c8003a60 0x7f27e0144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27e4999700 1 -- 172.21.15.84:0/1379476436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e016d510 con 0x7f27e015aff0 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27e4999700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27e015aff0 0x7f27e015b460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f27e00cad00 tx=0x7f27d8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27c7fff700 1 -- 172.21.15.84:0/1379476436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d800ee70 con 0x7f27e015aff0 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27c7fff700 1 -- 172.21.15.84:0/1379476436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8001aa0 con 0x7f27e015aff0 2023-10-06T03:24:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27e63fc700 1 -- 172.21.15.84:0/1379476436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e016d7f0 con 0x7f27e015aff0 2023-10-06T03:24:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27c7fff700 1 -- 172.21.15.84:0/1379476436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8001e60 con 0x7f27e015aff0 2023-10-06T03:24:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.148+0000 7f27e63fc700 1 -- 172.21.15.84:0/1379476436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e01588d0 con 0x7f27e015aff0 2023-10-06T03:24:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.149+0000 7f27e63fc700 1 -- 172.21.15.84:0/1379476436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e0064ad0 con 0x7f27e015aff0 2023-10-06T03:24:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.149+0000 7f27c7fff700 1 -- 172.21.15.84:0/1379476436 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27d80032e0 con 0x7f27e015aff0 2023-10-06T03:24:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.150+0000 7f27c7fff700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f27cc066f30 0x7f27cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.150+0000 7f27c7fff700 1 -- 172.21.15.84:0/1379476436 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f27d80848b0 con 0x7f27e015aff0 2023-10-06T03:24:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.150+0000 7f27dffff700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f27cc066f30 0x7f27cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.150+0000 7f27dffff700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f27cc066f30 0x7f27cc0693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27d0007cd0 tx=0x7f27d0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:55.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.154+0000 7f27c7fff700 1 -- 172.21.15.84:0/1379476436 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27d8055310 con 0x7f27e015aff0 2023-10-06T03:24:55.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.334+0000 7f27e63fc700 1 -- 172.21.15.84:0/1379476436 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27e00b0190 con 0x7f27cc066f30 2023-10-06T03:24:55.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.342+0000 7f27c7fff700 1 -- 172.21.15.84:0/1379476436 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311374 (secure 0 0 0) 0x7f27e00b0190 con 0x7f27cc066f30 2023-10-06T03:24:55.347 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 -- 172.21.15.84:0/1379476436 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f27cc066f30 msgr2=0x7f27cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f27cc066f30 0x7f27cc0693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27d0007cd0 tx=0x7f27d0015000 comp rx=0 tx=0).stop 2023-10-06T03:24:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 -- 172.21.15.84:0/1379476436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27e015aff0 msgr2=0x7f27e015b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27e015aff0 0x7f27e015b460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f27e00cad00 tx=0x7f27d8009040 comp rx=0 tx=0).stop 2023-10-06T03:24:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 -- 172.21.15.84:0/1379476436 shutdown_connections 2023-10-06T03:24:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f27cc066f30 0x7f27cc0693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c8003a60 0x7f27e0144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27e015aff0 0x7f27e015b460 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 --2- 172.21.15.84:0/1379476436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27e015be20 0x7f27e015c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 -- 172.21.15.84:0/1379476436 >> 172.21.15.84:0/1379476436 conn(0x7f27e0069180 msgr2=0x7f27e00b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:55.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 -- 172.21.15.84:0/1379476436 shutdown_connections 2023-10-06T03:24:55.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:55.345+0000 7f27e63fc700 1 -- 172.21.15.84:0/1379476436 wait complete. 2023-10-06T03:24:55.355 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:24:55.359 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-06T03:24:55.054867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382948,"kb_used_data":4644,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591772,"statfs":{"total":773094113280,"available":770653974528,"internally_reserved":0,"allocated":4755456,"data_stored":2751419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.267724"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824579+0000","last_change":"2023-10-06T03:24:49.817728+0000","last_active":"2023-10-06T03:24:49.824579+0000","last_peered":"2023-10-06T03:24:49.824579+0000","last_clean":"2023-10-06T03:24:49.824579+0000","last_became_active":"2023-10-06T03:24:49.817464+0000","last_became_peered":"2023-10-06T03:24:49.817464+0000","last_unstale":"2023-10-06T03:24:49.824579+0000","last_undegraded":"2023-10-06T03:24:49.824579+0000","last_fullsized":"2023-10-06T03:24:49.824579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:57.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827956+0000","last_change":"2023-10-06T03:24:49.819543+0000","last_active":"2023-10-06T03:24:49.827956+0000","last_peered":"2023-10-06T03:24:49.827956+0000","last_clean":"2023-10-06T03:24:49.827956+0000","last_became_active":"2023-10-06T03:24:49.819278+0000","last_became_peered":"2023-10-06T03:24:49.819278+0000","last_unstale":"2023-10-06T03:24:49.827956+0000","last_undegraded":"2023-10-06T03:24:49.827956+0000","last_fullsized":"2023-10-06T03:24:49.827956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:57.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821890+0000","last_change":"2023-10-06T03:24:49.816848+0000","last_active":"2023-10-06T03:24:49.821890+0000","last_peered":"2023-10-06T03:24:49.821890+0000","last_clean":"2023-10-06T03:24:49.821890+0000","last_became_active":"2023-10-06T03:24:49.816595+0000","last_became_peered":"2023-10-06T03:24:49.816595+0000","last_unstale":"2023-10-06T03:24:49.821890+0000","last_undegraded":"2023-10-06T03:24:49.821890+0000","last_fullsized":"2023-10-06T03:24:49.821890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:08.179862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.825995+0000","last_change":"2023-10-06T03:24:49.818689+0000","last_active":"2023-10-06T03:24:49.825995+0000","last_peered":"2023-10-06T03:24:49.825995+0000","last_clean":"2023-10-06T03:24:49.825995+0000","last_became_active":"2023-10-06T03:24:49.818435+0000","last_became_peered":"2023-10-06T03:24:49.818435+0000","last_unstale":"2023-10-06T03:24:49.825995+0000","last_undegraded":"2023-10-06T03:24:49.825995+0000","last_fullsized":"2023-10-06T03:24:49.825995+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:24.602629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.828011+0000","last_change":"2023-10-06T03:24:49.821082+0000","last_active":"2023-10-06T03:24:49.828011+0000","last_peered":"2023-10-06T03:24:49.828011+0000","last_clean":"2023-10-06T03:24:49.828011+0000","last_became_active":"2023-10-06T03:24:49.820543+0000","last_became_peered":"2023-10-06T03:24:49.820543+0000","last_unstale":"2023-10-06T03:24:49.828011+0000","last_undegraded":"2023-10-06T03:24:49.828011+0000","last_fullsized":"2023-10-06T03:24:49.828011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:50.921698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.816805+0000","last_change":"2023-10-06T03:24:49.814806+0000","last_active":"2023-10-06T03:24:49.816805+0000","last_peered":"2023-10-06T03:24:49.816805+0000","last_clean":"2023-10-06T03:24:49.816805+0000","last_became_active":"2023-10-06T03:24:49.814546+0000","last_became_peered":"2023-10-06T03:24:49.814546+0000","last_unstale":"2023-10-06T03:24:49.816805+0000","last_undegraded":"2023-10-06T03:24:49.816805+0000","last_fullsized":"2023-10-06T03:24:49.816805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:33.894597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827193+0000","last_change":"2023-10-06T03:24:49.822892+0000","last_active":"2023-10-06T03:24:49.827193+0000","last_peered":"2023-10-06T03:24:49.827193+0000","last_clean":"2023-10-06T03:24:49.827193+0000","last_became_active":"2023-10-06T03:24:49.822618+0000","last_became_peered":"2023-10-06T03:24:49.822618+0000","last_unstale":"2023-10-06T03:24:49.827193+0000","last_undegraded":"2023-10-06T03:24:49.827193+0000","last_fullsized":"2023-10-06T03:24:49.827193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:50.921698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.825952+0000","last_change":"2023-10-06T03:24:49.817948+0000","last_active":"2023-10-06T03:24:49.825952+0000","last_peered":"2023-10-06T03:24:49.825952+0000","last_clean":"2023-10-06T03:24:49.825952+0000","last_became_active":"2023-10-06T03:24:49.817509+0000","last_became_peered":"2023-10-06T03:24:49.817509+0000","last_unstale":"2023-10-06T03:24:49.825952+0000","last_undegraded":"2023-10-06T03:24:49.825952+0000","last_fullsized":"2023-10-06T03:24:49.825952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:46.157152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824623+0000","last_change":"2023-10-06T03:24:49.816965+0000","last_active":"2023-10-06T03:24:49.824623+0000","last_peered":"2023-10-06T03:24:49.824623+0000","last_clean":"2023-10-06T03:24:49.824623+0000","last_became_active":"2023-10-06T03:24:49.816730+0000","last_became_peered":"2023-10-06T03:24:49.816730+0000","last_unstale":"2023-10-06T03:24:49.824623+0000","last_undegraded":"2023-10-06T03:24:49.824623+0000","last_fullsized":"2023-10-06T03:24:49.824623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.826018+0000","last_change":"2023-10-06T03:24:49.818768+0000","last_active":"2023-10-06T03:24:49.826018+0000","last_peered":"2023-10-06T03:24:49.826018+0000","last_clean":"2023-10-06T03:24:49.826018+0000","last_became_active":"2023-10-06T03:24:49.818480+0000","last_became_peered":"2023-10-06T03:24:49.818480+0000","last_unstale":"2023-10-06T03:24:49.826018+0000","last_undegraded":"2023-10-06T03:24:49.826018+0000","last_fullsized":"2023-10-06T03:24:49.826018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:50.360845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.825947+0000","last_change":"2023-10-06T03:24:49.818169+0000","last_active":"2023-10-06T03:24:49.825947+0000","last_peered":"2023-10-06T03:24:49.825947+0000","last_clean":"2023-10-06T03:24:49.825947+0000","last_became_active":"2023-10-06T03:24:49.817895+0000","last_became_peered":"2023-10-06T03:24:49.817895+0000","last_unstale":"2023-10-06T03:24:49.825947+0000","last_undegraded":"2023-10-06T03:24:49.825947+0000","last_fullsized":"2023-10-06T03:24:49.825947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:46.908108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827992+0000","last_change":"2023-10-06T03:24:49.821318+0000","last_active":"2023-10-06T03:24:49.827992+0000","last_peered":"2023-10-06T03:24:49.827992+0000","last_clean":"2023-10-06T03:24:49.827992+0000","last_became_active":"2023-10-06T03:24:49.821044+0000","last_became_peered":"2023-10-06T03:24:49.821044+0000","last_unstale":"2023-10-06T03:24:49.827992+0000","last_undegraded":"2023-10-06T03:24:49.827992+0000","last_fullsized":"2023-10-06T03:24:49.827992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:03.473599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824382+0000","last_change":"2023-10-06T03:24:49.816559+0000","last_active":"2023-10-06T03:24:49.824382+0000","last_peered":"2023-10-06T03:24:49.824382+0000","last_clean":"2023-10-06T03:24:49.824382+0000","last_became_active":"2023-10-06T03:24:49.816292+0000","last_became_peered":"2023-10-06T03:24:49.816292+0000","last_unstale":"2023-10-06T03:24:49.824382+0000","last_undegraded":"2023-10-06T03:24:49.824382+0000","last_fullsized":"2023-10-06T03:24:49.824382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:05.207479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824628+0000","last_change":"2023-10-06T03:24:49.816874+0000","last_active":"2023-10-06T03:24:49.824628+0000","last_peered":"2023-10-06T03:24:49.824628+0000","last_clean":"2023-10-06T03:24:49.824628+0000","last_became_active":"2023-10-06T03:24:49.816621+0000","last_became_peered":"2023-10-06T03:24:49.816621+0000","last_unstale":"2023-10-06T03:24:49.824628+0000","last_undegraded":"2023-10-06T03:24:49.824628+0000","last_fullsized":"2023-10-06T03:24:49.824628+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:35.429205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824131+0000","last_change":"2023-10-06T03:24:49.819662+0000","last_active":"2023-10-06T03:24:49.824131+0000","last_peered":"2023-10-06T03:24:49.824131+0000","last_clean":"2023-10-06T03:24:49.824131+0000","last_became_active":"2023-10-06T03:24:49.819446+0000","last_became_peered":"2023-10-06T03:24:49.819446+0000","last_unstale":"2023-10-06T03:24:49.824131+0000","last_undegraded":"2023-10-06T03:24:49.824131+0000","last_fullsized":"2023-10-06T03:24:49.824131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:57.868100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833165+0000","last_change":"2023-10-06T03:24:49.825694+0000","last_active":"2023-10-06T03:24:49.833165+0000","last_peered":"2023-10-06T03:24:49.833165+0000","last_clean":"2023-10-06T03:24:49.833165+0000","last_became_active":"2023-10-06T03:24:49.825403+0000","last_became_peered":"2023-10-06T03:24:49.825403+0000","last_unstale":"2023-10-06T03:24:49.833165+0000","last_undegraded":"2023-10-06T03:24:49.833165+0000","last_fullsized":"2023-10-06T03:24:49.833165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:51.520184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827818+0000","last_change":"2023-10-06T03:24:49.823596+0000","last_active":"2023-10-06T03:24:49.827818+0000","last_peered":"2023-10-06T03:24:49.827818+0000","last_clean":"2023-10-06T03:24:49.827818+0000","last_became_active":"2023-10-06T03:24:49.823297+0000","last_became_peered":"2023-10-06T03:24:49.823297+0000","last_unstale":"2023-10-06T03:24:49.827818+0000","last_undegraded":"2023-10-06T03:24:49.827818+0000","last_fullsized":"2023-10-06T03:24:49.827818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:50.360845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827930+0000","last_change":"2023-10-06T03:24:49.826272+0000","last_active":"2023-10-06T03:24:49.827930+0000","last_peered":"2023-10-06T03:24:49.827930+0000","last_clean":"2023-10-06T03:24:49.827930+0000","last_became_active":"2023-10-06T03:24:49.825947+0000","last_became_peered":"2023-10-06T03:24:49.825947+0000","last_unstale":"2023-10-06T03:24:49.827930+0000","last_undegraded":"2023-10-06T03:24:49.827930+0000","last_fullsized":"2023-10-06T03:24:49.827930+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:25.442095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833100+0000","last_change":"2023-10-06T03:24:49.825066+0000","last_active":"2023-10-06T03:24:49.833100+0000","last_peered":"2023-10-06T03:24:49.833100+0000","last_clean":"2023-10-06T03:24:49.833100+0000","last_became_active":"2023-10-06T03:24:49.824843+0000","last_became_peered":"2023-10-06T03:24:49.824843+0000","last_unstale":"2023-10-06T03:24:49.833100+0000","last_undegraded":"2023-10-06T03:24:49.833100+0000","last_fullsized":"2023-10-06T03:24:49.833100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:40.332231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821296+0000","last_change":"2023-10-06T03:24:49.813984+0000","last_active":"2023-10-06T03:24:49.821296+0000","last_peered":"2023-10-06T03:24:49.821296+0000","last_clean":"2023-10-06T03:24:49.821296+0000","last_became_active":"2023-10-06T03:24:49.813685+0000","last_became_peered":"2023-10-06T03:24:49.813685+0000","last_unstale":"2023-10-06T03:24:49.821296+0000","last_undegraded":"2023-10-06T03:24:49.821296+0000","last_fullsized":"2023-10-06T03:24:49.821296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:47.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.823659+0000","last_change":"2023-10-06T03:24:49.818710+0000","last_active":"2023-10-06T03:24:49.823659+0000","last_peered":"2023-10-06T03:24:49.823659+0000","last_clean":"2023-10-06T03:24:49.823659+0000","last_became_active":"2023-10-06T03:24:49.818476+0000","last_became_peered":"2023-10-06T03:24:49.818476+0000","last_unstale":"2023-10-06T03:24:49.823659+0000","last_undegraded":"2023-10-06T03:24:49.823659+0000","last_fullsized":"2023-10-06T03:24:49.823659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:08.179862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.826008+0000","last_change":"2023-10-06T03:24:49.818743+0000","last_active":"2023-10-06T03:24:49.826008+0000","last_peered":"2023-10-06T03:24:49.826008+0000","last_clean":"2023-10-06T03:24:49.826008+0000","last_became_active":"2023-10-06T03:24:49.818497+0000","last_became_peered":"2023-10-06T03:24:49.818497+0000","last_unstale":"2023-10-06T03:24:49.826008+0000","last_undegraded":"2023-10-06T03:24:49.826008+0000","last_fullsized":"2023-10-06T03:24:49.826008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:33.894597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824566+0000","last_change":"2023-10-06T03:24:49.818853+0000","last_active":"2023-10-06T03:24:49.824566+0000","last_peered":"2023-10-06T03:24:49.824566+0000","last_clean":"2023-10-06T03:24:49.824566+0000","last_became_active":"2023-10-06T03:24:49.818587+0000","last_became_peered":"2023-10-06T03:24:49.818587+0000","last_unstale":"2023-10-06T03:24:49.824566+0000","last_undegraded":"2023-10-06T03:24:49.824566+0000","last_fullsized":"2023-10-06T03:24:49.824566+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:10.899871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.829804+0000","last_change":"2023-10-06T03:24:49.820988+0000","last_active":"2023-10-06T03:24:49.829804+0000","last_peered":"2023-10-06T03:24:49.829804+0000","last_clean":"2023-10-06T03:24:49.829804+0000","last_became_active":"2023-10-06T03:24:49.820720+0000","last_became_peered":"2023-10-06T03:24:49.820720+0000","last_unstale":"2023-10-06T03:24:49.829804+0000","last_undegraded":"2023-10-06T03:24:49.829804+0000","last_fullsized":"2023-10-06T03:24:49.829804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:23.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.832300+0000","last_change":"2023-10-06T03:24:49.823590+0000","last_active":"2023-10-06T03:24:49.832300+0000","last_peered":"2023-10-06T03:24:49.832300+0000","last_clean":"2023-10-06T03:24:49.832300+0000","last_became_active":"2023-10-06T03:24:49.823291+0000","last_became_peered":"2023-10-06T03:24:49.823291+0000","last_unstale":"2023-10-06T03:24:49.832300+0000","last_undegraded":"2023-10-06T03:24:49.832300+0000","last_fullsized":"2023-10-06T03:24:49.832300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.678893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821221+0000","last_change":"2023-10-06T03:24:49.813389+0000","last_active":"2023-10-06T03:24:49.821221+0000","last_peered":"2023-10-06T03:24:49.821221+0000","last_clean":"2023-10-06T03:24:49.821221+0000","last_became_active":"2023-10-06T03:24:49.813141+0000","last_became_peered":"2023-10-06T03:24:49.813141+0000","last_unstale":"2023-10-06T03:24:49.821221+0000","last_undegraded":"2023-10-06T03:24:49.821221+0000","last_fullsized":"2023-10-06T03:24:49.821221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827809+0000","last_change":"2023-10-06T03:24:49.823413+0000","last_active":"2023-10-06T03:24:49.827809+0000","last_peered":"2023-10-06T03:24:49.827809+0000","last_clean":"2023-10-06T03:24:49.827809+0000","last_became_active":"2023-10-06T03:24:49.823197+0000","last_became_peered":"2023-10-06T03:24:49.823197+0000","last_unstale":"2023-10-06T03:24:49.827809+0000","last_undegraded":"2023-10-06T03:24:49.827809+0000","last_fullsized":"2023-10-06T03:24:49.827809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:24.602629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.832354+0000","last_change":"2023-10-06T03:24:49.822042+0000","last_active":"2023-10-06T03:24:49.832354+0000","last_peered":"2023-10-06T03:24:49.832354+0000","last_clean":"2023-10-06T03:24:49.832354+0000","last_became_active":"2023-10-06T03:24:49.821756+0000","last_became_peered":"2023-10-06T03:24:49.821756+0000","last_unstale":"2023-10-06T03:24:49.832354+0000","last_undegraded":"2023-10-06T03:24:49.832354+0000","last_fullsized":"2023-10-06T03:24:49.832354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.830707+0000","last_change":"2023-10-06T03:24:49.822810+0000","last_active":"2023-10-06T03:24:49.830707+0000","last_peered":"2023-10-06T03:24:49.830707+0000","last_clean":"2023-10-06T03:24:49.830707+0000","last_became_active":"2023-10-06T03:24:49.822543+0000","last_became_peered":"2023-10-06T03:24:49.822543+0000","last_unstale":"2023-10-06T03:24:49.830707+0000","last_undegraded":"2023-10-06T03:24:49.830707+0000","last_fullsized":"2023-10-06T03:24:49.830707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:34.682483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.826958+0000","last_change":"2023-10-06T03:24:49.821697+0000","last_active":"2023-10-06T03:24:49.826958+0000","last_peered":"2023-10-06T03:24:49.826958+0000","last_clean":"2023-10-06T03:24:49.826958+0000","last_became_active":"2023-10-06T03:24:49.821441+0000","last_became_peered":"2023-10-06T03:24:49.821441+0000","last_unstale":"2023-10-06T03:24:49.826958+0000","last_undegraded":"2023-10-06T03:24:49.826958+0000","last_fullsized":"2023-10-06T03:24:49.826958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:35.429205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824564+0000","last_change":"2023-10-06T03:24:49.822944+0000","last_active":"2023-10-06T03:24:49.824564+0000","last_peered":"2023-10-06T03:24:49.824564+0000","last_clean":"2023-10-06T03:24:49.824564+0000","last_became_active":"2023-10-06T03:24:49.822774+0000","last_became_peered":"2023-10-06T03:24:49.822774+0000","last_unstale":"2023-10-06T03:24:49.824564+0000","last_undegraded":"2023-10-06T03:24:49.824564+0000","last_fullsized":"2023-10-06T03:24:49.824564+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:35.540004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.820701+0000","last_change":"2023-10-06T03:24:49.813020+0000","last_active":"2023-10-06T03:24:49.820701+0000","last_peered":"2023-10-06T03:24:49.820701+0000","last_clean":"2023-10-06T03:24:49.820701+0000","last_became_active":"2023-10-06T03:24:49.812753+0000","last_became_peered":"2023-10-06T03:24:49.812753+0000","last_unstale":"2023-10-06T03:24:49.820701+0000","last_undegraded":"2023-10-06T03:24:49.820701+0000","last_fullsized":"2023-10-06T03:24:49.820701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:59.096514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.823952+0000","last_change":"2023-10-06T03:24:49.817948+0000","last_active":"2023-10-06T03:24:49.823952+0000","last_peered":"2023-10-06T03:24:49.823952+0000","last_clean":"2023-10-06T03:24:49.823952+0000","last_became_active":"2023-10-06T03:24:49.817685+0000","last_became_peered":"2023-10-06T03:24:49.817685+0000","last_unstale":"2023-10-06T03:24:49.823952+0000","last_undegraded":"2023-10-06T03:24:49.823952+0000","last_fullsized":"2023-10-06T03:24:49.823952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836416+0000","last_change":"2023-10-06T03:24:48.812118+0000","last_active":"2023-10-06T03:24:49.836416+0000","last_peered":"2023-10-06T03:24:49.836416+0000","last_clean":"2023-10-06T03:24:49.836416+0000","last_became_active":"2023-10-06T03:24:48.811913+0000","last_became_peered":"2023-10-06T03:24:48.811913+0000","last_unstale":"2023-10-06T03:24:49.836416+0000","last_undegraded":"2023-10-06T03:24:49.836416+0000","last_fullsized":"2023-10-06T03:24:49.836416+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:44.687691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.832279+0000","last_change":"2023-10-06T03:24:49.822041+0000","last_active":"2023-10-06T03:24:49.832279+0000","last_peered":"2023-10-06T03:24:49.832279+0000","last_clean":"2023-10-06T03:24:49.832279+0000","last_became_active":"2023-10-06T03:24:49.821784+0000","last_became_peered":"2023-10-06T03:24:49.821784+0000","last_unstale":"2023-10-06T03:24:49.832279+0000","last_undegraded":"2023-10-06T03:24:49.832279+0000","last_fullsized":"2023-10-06T03:24:49.832279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:21.178115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835977+0000","last_change":"2023-10-06T03:24:48.810340+0000","last_active":"2023-10-06T03:24:49.835977+0000","last_peered":"2023-10-06T03:24:49.835977+0000","last_clean":"2023-10-06T03:24:49.835977+0000","last_became_active":"2023-10-06T03:24:48.810047+0000","last_became_peered":"2023-10-06T03:24:48.810047+0000","last_unstale":"2023-10-06T03:24:49.835977+0000","last_undegraded":"2023-10-06T03:24:49.835977+0000","last_fullsized":"2023-10-06T03:24:49.835977+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:49.950377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827894+0000","last_change":"2023-10-06T03:24:49.816862+0000","last_active":"2023-10-06T03:24:49.827894+0000","last_peered":"2023-10-06T03:24:49.827894+0000","last_clean":"2023-10-06T03:24:49.827894+0000","last_became_active":"2023-10-06T03:24:49.816603+0000","last_became_peered":"2023-10-06T03:24:49.816603+0000","last_unstale":"2023-10-06T03:24:49.827894+0000","last_undegraded":"2023-10-06T03:24:49.827894+0000","last_fullsized":"2023-10-06T03:24:49.827894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833645+0000","last_change":"2023-10-06T03:24:48.806740+0000","last_active":"2023-10-06T03:24:49.833645+0000","last_peered":"2023-10-06T03:24:49.833645+0000","last_clean":"2023-10-06T03:24:49.833645+0000","last_became_active":"2023-10-06T03:24:48.806456+0000","last_became_peered":"2023-10-06T03:24:48.806456+0000","last_unstale":"2023-10-06T03:24:49.833645+0000","last_undegraded":"2023-10-06T03:24:49.833645+0000","last_fullsized":"2023-10-06T03:24:49.833645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:47.026999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824000+0000","last_change":"2023-10-06T03:24:49.818654+0000","last_active":"2023-10-06T03:24:49.824000+0000","last_peered":"2023-10-06T03:24:49.824000+0000","last_clean":"2023-10-06T03:24:49.824000+0000","last_became_active":"2023-10-06T03:24:49.818417+0000","last_became_peered":"2023-10-06T03:24:49.818417+0000","last_unstale":"2023-10-06T03:24:49.824000+0000","last_undegraded":"2023-10-06T03:24:49.824000+0000","last_fullsized":"2023-10-06T03:24:49.824000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:05.207479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835772+0000","last_change":"2023-10-06T03:24:48.805439+0000","last_active":"2023-10-06T03:24:49.835772+0000","last_peered":"2023-10-06T03:24:49.835772+0000","last_clean":"2023-10-06T03:24:49.835772+0000","last_became_active":"2023-10-06T03:24:48.805143+0000","last_became_peered":"2023-10-06T03:24:48.805143+0000","last_unstale":"2023-10-06T03:24:49.835772+0000","last_undegraded":"2023-10-06T03:24:49.835772+0000","last_fullsized":"2023-10-06T03:24:49.835772+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824221+0000","last_change":"2023-10-06T03:24:49.817595+0000","last_active":"2023-10-06T03:24:49.824221+0000","last_peered":"2023-10-06T03:24:49.824221+0000","last_clean":"2023-10-06T03:24:49.824221+0000","last_became_active":"2023-10-06T03:24:49.817341+0000","last_became_peered":"2023-10-06T03:24:49.817341+0000","last_unstale":"2023-10-06T03:24:49.824221+0000","last_undegraded":"2023-10-06T03:24:49.824221+0000","last_fullsized":"2023-10-06T03:24:49.824221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:56.995991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835862+0000","last_change":"2023-10-06T03:24:48.803540+0000","last_active":"2023-10-06T03:24:49.835862+0000","last_peered":"2023-10-06T03:24:49.835862+0000","last_clean":"2023-10-06T03:24:49.835862+0000","last_became_active":"2023-10-06T03:24:48.802661+0000","last_became_peered":"2023-10-06T03:24:48.802661+0000","last_unstale":"2023-10-06T03:24:49.835862+0000","last_undegraded":"2023-10-06T03:24:49.835862+0000","last_fullsized":"2023-10-06T03:24:49.835862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:20.530045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824440+0000","last_change":"2023-10-06T03:24:49.814413+0000","last_active":"2023-10-06T03:24:49.824440+0000","last_peered":"2023-10-06T03:24:49.824440+0000","last_clean":"2023-10-06T03:24:49.824440+0000","last_became_active":"2023-10-06T03:24:49.814154+0000","last_became_peered":"2023-10-06T03:24:49.814154+0000","last_unstale":"2023-10-06T03:24:49.824440+0000","last_undegraded":"2023-10-06T03:24:49.824440+0000","last_fullsized":"2023-10-06T03:24:49.824440+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:08.179862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833882+0000","last_change":"2023-10-06T03:24:48.804186+0000","last_active":"2023-10-06T03:24:49.833882+0000","last_peered":"2023-10-06T03:24:49.833882+0000","last_clean":"2023-10-06T03:24:49.833882+0000","last_became_active":"2023-10-06T03:24:48.803706+0000","last_became_peered":"2023-10-06T03:24:48.803706+0000","last_unstale":"2023-10-06T03:24:49.833882+0000","last_undegraded":"2023-10-06T03:24:49.833882+0000","last_fullsized":"2023-10-06T03:24:49.833882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:41.407843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.825932+0000","last_change":"2023-10-06T03:24:49.817790+0000","last_active":"2023-10-06T03:24:49.825932+0000","last_peered":"2023-10-06T03:24:49.825932+0000","last_clean":"2023-10-06T03:24:49.825932+0000","last_became_active":"2023-10-06T03:24:49.817135+0000","last_became_peered":"2023-10-06T03:24:49.817135+0000","last_unstale":"2023-10-06T03:24:49.825932+0000","last_undegraded":"2023-10-06T03:24:49.825932+0000","last_fullsized":"2023-10-06T03:24:49.825932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:55.132669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.808388+0000","last_change":"2023-10-06T03:24:48.809322+0000","last_active":"2023-10-06T03:24:49.808388+0000","last_peered":"2023-10-06T03:24:49.808388+0000","last_clean":"2023-10-06T03:24:49.808388+0000","last_became_active":"2023-10-06T03:24:48.809018+0000","last_became_peered":"2023-10-06T03:24:48.809018+0000","last_unstale":"2023-10-06T03:24:49.808388+0000","last_undegraded":"2023-10-06T03:24:49.808388+0000","last_fullsized":"2023-10-06T03:24:49.808388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824545+0000","last_change":"2023-10-06T03:24:49.818817+0000","last_active":"2023-10-06T03:24:49.824545+0000","last_peered":"2023-10-06T03:24:49.824545+0000","last_clean":"2023-10-06T03:24:49.824545+0000","last_became_active":"2023-10-06T03:24:49.818484+0000","last_became_peered":"2023-10-06T03:24:49.818484+0000","last_unstale":"2023-10-06T03:24:49.824545+0000","last_undegraded":"2023-10-06T03:24:49.824545+0000","last_fullsized":"2023-10-06T03:24:49.824545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:48.033798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.804689+0000","last_change":"2023-10-06T03:24:48.808266+0000","last_active":"2023-10-06T03:24:49.804689+0000","last_peered":"2023-10-06T03:24:49.804689+0000","last_clean":"2023-10-06T03:24:49.804689+0000","last_became_active":"2023-10-06T03:24:48.808019+0000","last_became_peered":"2023-10-06T03:24:48.808019+0000","last_unstale":"2023-10-06T03:24:49.804689+0000","last_undegraded":"2023-10-06T03:24:49.804689+0000","last_fullsized":"2023-10-06T03:24:49.804689+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827918+0000","last_change":"2023-10-06T03:24:49.826156+0000","last_active":"2023-10-06T03:24:49.827918+0000","last_peered":"2023-10-06T03:24:49.827918+0000","last_clean":"2023-10-06T03:24:49.827918+0000","last_became_active":"2023-10-06T03:24:49.825639+0000","last_became_peered":"2023-10-06T03:24:49.825639+0000","last_unstale":"2023-10-06T03:24:49.827918+0000","last_undegraded":"2023-10-06T03:24:49.827918+0000","last_fullsized":"2023-10-06T03:24:49.827918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:52.254985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812940+0000","last_change":"2023-10-06T03:24:48.800912+0000","last_active":"2023-10-06T03:24:49.812940+0000","last_peered":"2023-10-06T03:24:49.812940+0000","last_clean":"2023-10-06T03:24:49.812940+0000","last_became_active":"2023-10-06T03:24:48.800595+0000","last_became_peered":"2023-10-06T03:24:48.800595+0000","last_unstale":"2023-10-06T03:24:49.812940+0000","last_undegraded":"2023-10-06T03:24:49.812940+0000","last_fullsized":"2023-10-06T03:24:49.812940+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:56.091547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827169+0000","last_change":"2023-10-06T03:24:49.823044+0000","last_active":"2023-10-06T03:24:49.827169+0000","last_peered":"2023-10-06T03:24:49.827169+0000","last_clean":"2023-10-06T03:24:49.827169+0000","last_became_active":"2023-10-06T03:24:49.822784+0000","last_became_peered":"2023-10-06T03:24:49.822784+0000","last_unstale":"2023-10-06T03:24:49.827169+0000","last_undegraded":"2023-10-06T03:24:49.827169+0000","last_fullsized":"2023-10-06T03:24:49.827169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:03.473599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.807107+0000","last_change":"2023-10-06T03:24:48.803402+0000","last_active":"2023-10-06T03:24:49.807107+0000","last_peered":"2023-10-06T03:24:49.807107+0000","last_clean":"2023-10-06T03:24:49.807107+0000","last_became_active":"2023-10-06T03:24:48.803148+0000","last_became_peered":"2023-10-06T03:24:48.803148+0000","last_unstale":"2023-10-06T03:24:49.807107+0000","last_undegraded":"2023-10-06T03:24:49.807107+0000","last_fullsized":"2023-10-06T03:24:49.807107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:58.089716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.816821+0000","last_change":"2023-10-06T03:24:49.811159+0000","last_active":"2023-10-06T03:24:49.816821+0000","last_peered":"2023-10-06T03:24:49.816821+0000","last_clean":"2023-10-06T03:24:49.816821+0000","last_became_active":"2023-10-06T03:24:49.810918+0000","last_became_peered":"2023-10-06T03:24:49.810918+0000","last_unstale":"2023-10-06T03:24:49.816821+0000","last_undegraded":"2023-10-06T03:24:49.816821+0000","last_fullsized":"2023-10-06T03:24:49.816821+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:24.602629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836475+0000","last_change":"2023-10-06T03:24:48.809455+0000","last_active":"2023-10-06T03:24:49.836475+0000","last_peered":"2023-10-06T03:24:49.836475+0000","last_clean":"2023-10-06T03:24:49.836475+0000","last_became_active":"2023-10-06T03:24:48.809202+0000","last_became_peered":"2023-10-06T03:24:48.809202+0000","last_unstale":"2023-10-06T03:24:49.836475+0000","last_undegraded":"2023-10-06T03:24:49.836475+0000","last_fullsized":"2023-10-06T03:24:49.836475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824323+0000","last_change":"2023-10-06T03:24:49.818062+0000","last_active":"2023-10-06T03:24:49.824323+0000","last_peered":"2023-10-06T03:24:49.824323+0000","last_clean":"2023-10-06T03:24:49.824323+0000","last_became_active":"2023-10-06T03:24:49.817792+0000","last_became_peered":"2023-10-06T03:24:49.817792+0000","last_unstale":"2023-10-06T03:24:49.824323+0000","last_undegraded":"2023-10-06T03:24:49.824323+0000","last_fullsized":"2023-10-06T03:24:49.824323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.837509+0000","last_change":"2023-10-06T03:24:48.796352+0000","last_active":"2023-10-06T03:24:49.837509+0000","last_peered":"2023-10-06T03:24:49.837509+0000","last_clean":"2023-10-06T03:24:49.837509+0000","last_became_active":"2023-10-06T03:24:48.796076+0000","last_became_peered":"2023-10-06T03:24:48.796076+0000","last_unstale":"2023-10-06T03:24:49.837509+0000","last_undegraded":"2023-10-06T03:24:49.837509+0000","last_fullsized":"2023-10-06T03:24:49.837509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:22.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833097+0000","last_change":"2023-10-06T03:24:49.825550+0000","last_active":"2023-10-06T03:24:49.833097+0000","last_peered":"2023-10-06T03:24:49.833097+0000","last_clean":"2023-10-06T03:24:49.833097+0000","last_became_active":"2023-10-06T03:24:49.825258+0000","last_became_peered":"2023-10-06T03:24:49.825258+0000","last_unstale":"2023-10-06T03:24:49.833097+0000","last_undegraded":"2023-10-06T03:24:49.833097+0000","last_fullsized":"2023-10-06T03:24:49.833097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:38.167564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835466+0000","last_change":"2023-10-06T03:24:48.807313+0000","last_active":"2023-10-06T03:24:49.835466+0000","last_peered":"2023-10-06T03:24:49.835466+0000","last_clean":"2023-10-06T03:24:49.835466+0000","last_became_active":"2023-10-06T03:24:48.807050+0000","last_became_peered":"2023-10-06T03:24:48.807050+0000","last_unstale":"2023-10-06T03:24:49.835466+0000","last_undegraded":"2023-10-06T03:24:49.835466+0000","last_fullsized":"2023-10-06T03:24:49.835466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:49.914899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824641+0000","last_change":"2023-10-06T03:24:49.815735+0000","last_active":"2023-10-06T03:24:49.824641+0000","last_peered":"2023-10-06T03:24:49.824641+0000","last_clean":"2023-10-06T03:24:49.824641+0000","last_became_active":"2023-10-06T03:24:49.815461+0000","last_became_peered":"2023-10-06T03:24:49.815461+0000","last_unstale":"2023-10-06T03:24:49.824641+0000","last_undegraded":"2023-10-06T03:24:49.824641+0000","last_fullsized":"2023-10-06T03:24:49.824641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:35.540004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810931+0000","last_change":"2023-10-06T03:24:48.804776+0000","last_active":"2023-10-06T03:24:49.810931+0000","last_peered":"2023-10-06T03:24:49.810931+0000","last_clean":"2023-10-06T03:24:49.810931+0000","last_became_active":"2023-10-06T03:24:48.804506+0000","last_became_peered":"2023-10-06T03:24:48.804506+0000","last_unstale":"2023-10-06T03:24:49.810931+0000","last_undegraded":"2023-10-06T03:24:49.810931+0000","last_fullsized":"2023-10-06T03:24:49.810931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:46.243326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.816422+0000","last_change":"2023-10-06T03:24:49.811189+0000","last_active":"2023-10-06T03:24:49.816422+0000","last_peered":"2023-10-06T03:24:49.816422+0000","last_clean":"2023-10-06T03:24:49.816422+0000","last_became_active":"2023-10-06T03:24:49.810972+0000","last_became_peered":"2023-10-06T03:24:49.810972+0000","last_unstale":"2023-10-06T03:24:49.816422+0000","last_undegraded":"2023-10-06T03:24:49.816422+0000","last_fullsized":"2023-10-06T03:24:49.816422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:50.360845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.807087+0000","last_change":"2023-10-06T03:24:48.807022+0000","last_active":"2023-10-06T03:24:49.807087+0000","last_peered":"2023-10-06T03:24:49.807087+0000","last_clean":"2023-10-06T03:24:49.807087+0000","last_became_active":"2023-10-06T03:24:48.806684+0000","last_became_peered":"2023-10-06T03:24:48.806684+0000","last_unstale":"2023-10-06T03:24:49.807087+0000","last_undegraded":"2023-10-06T03:24:49.807087+0000","last_fullsized":"2023-10-06T03:24:49.807087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:56.091547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824599+0000","last_change":"2023-10-06T03:24:49.818605+0000","last_active":"2023-10-06T03:24:49.824599+0000","last_peered":"2023-10-06T03:24:49.824599+0000","last_clean":"2023-10-06T03:24:49.824599+0000","last_became_active":"2023-10-06T03:24:49.818270+0000","last_became_peered":"2023-10-06T03:24:49.818270+0000","last_unstale":"2023-10-06T03:24:49.824599+0000","last_undegraded":"2023-10-06T03:24:49.824599+0000","last_fullsized":"2023-10-06T03:24:49.824599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834407+0000","last_change":"2023-10-06T03:24:48.804584+0000","last_active":"2023-10-06T03:24:49.834407+0000","last_peered":"2023-10-06T03:24:49.834407+0000","last_clean":"2023-10-06T03:24:49.834407+0000","last_became_active":"2023-10-06T03:24:48.804337+0000","last_became_peered":"2023-10-06T03:24:48.804337+0000","last_unstale":"2023-10-06T03:24:49.834407+0000","last_undegraded":"2023-10-06T03:24:49.834407+0000","last_fullsized":"2023-10-06T03:24:49.834407+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821360+0000","last_change":"2023-10-06T03:24:49.815067+0000","last_active":"2023-10-06T03:24:49.821360+0000","last_peered":"2023-10-06T03:24:49.821360+0000","last_clean":"2023-10-06T03:24:49.821360+0000","last_became_active":"2023-10-06T03:24:49.814854+0000","last_became_peered":"2023-10-06T03:24:49.814854+0000","last_unstale":"2023-10-06T03:24:49.821360+0000","last_undegraded":"2023-10-06T03:24:49.821360+0000","last_fullsized":"2023-10-06T03:24:49.821360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.678893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834912+0000","last_change":"2023-10-06T03:24:48.803799+0000","last_active":"2023-10-06T03:24:49.834912+0000","last_peered":"2023-10-06T03:24:49.834912+0000","last_clean":"2023-10-06T03:24:49.834912+0000","last_became_active":"2023-10-06T03:24:48.803302+0000","last_became_peered":"2023-10-06T03:24:48.803302+0000","last_unstale":"2023-10-06T03:24:49.834912+0000","last_undegraded":"2023-10-06T03:24:49.834912+0000","last_fullsized":"2023-10-06T03:24:49.834912+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:29.960671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824184+0000","last_change":"2023-10-06T03:24:49.811332+0000","last_active":"2023-10-06T03:24:49.824184+0000","last_peered":"2023-10-06T03:24:49.824184+0000","last_clean":"2023-10-06T03:24:49.824184+0000","last_became_active":"2023-10-06T03:24:49.811057+0000","last_became_peered":"2023-10-06T03:24:49.811057+0000","last_unstale":"2023-10-06T03:24:49.824184+0000","last_undegraded":"2023-10-06T03:24:49.824184+0000","last_fullsized":"2023-10-06T03:24:49.824184+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:27.416317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833453+0000","last_change":"2023-10-06T03:24:48.808134+0000","last_active":"2023-10-06T03:24:49.833453+0000","last_peered":"2023-10-06T03:24:49.833453+0000","last_clean":"2023-10-06T03:24:49.833453+0000","last_became_active":"2023-10-06T03:24:48.807838+0000","last_became_peered":"2023-10-06T03:24:48.807838+0000","last_unstale":"2023-10-06T03:24:49.833453+0000","last_undegraded":"2023-10-06T03:24:49.833453+0000","last_fullsized":"2023-10-06T03:24:49.833453+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:02.466800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.829591+0000","last_change":"2023-10-06T03:24:49.821689+0000","last_active":"2023-10-06T03:24:49.829591+0000","last_peered":"2023-10-06T03:24:49.829591+0000","last_clean":"2023-10-06T03:24:49.829591+0000","last_became_active":"2023-10-06T03:24:49.821368+0000","last_became_peered":"2023-10-06T03:24:49.821368+0000","last_unstale":"2023-10-06T03:24:49.829591+0000","last_undegraded":"2023-10-06T03:24:49.829591+0000","last_fullsized":"2023-10-06T03:24:49.829591+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836098+0000","last_change":"2023-10-06T03:24:48.810309+0000","last_active":"2023-10-06T03:24:49.836098+0000","last_peered":"2023-10-06T03:24:49.836098+0000","last_clean":"2023-10-06T03:24:49.836098+0000","last_became_active":"2023-10-06T03:24:48.809835+0000","last_became_peered":"2023-10-06T03:24:48.809835+0000","last_unstale":"2023-10-06T03:24:49.836098+0000","last_undegraded":"2023-10-06T03:24:49.836098+0000","last_fullsized":"2023-10-06T03:24:49.836098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.829832+0000","last_change":"2023-10-06T03:24:49.822763+0000","last_active":"2023-10-06T03:24:49.829832+0000","last_peered":"2023-10-06T03:24:49.829832+0000","last_clean":"2023-10-06T03:24:49.829832+0000","last_became_active":"2023-10-06T03:24:49.822496+0000","last_became_peered":"2023-10-06T03:24:49.822496+0000","last_unstale":"2023-10-06T03:24:49.829832+0000","last_undegraded":"2023-10-06T03:24:49.829832+0000","last_fullsized":"2023-10-06T03:24:49.829832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:59.096514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.804864+0000","last_change":"2023-10-06T03:24:48.808985+0000","last_active":"2023-10-06T03:24:49.804864+0000","last_peered":"2023-10-06T03:24:49.804864+0000","last_clean":"2023-10-06T03:24:49.804864+0000","last_became_active":"2023-10-06T03:24:48.808690+0000","last_became_peered":"2023-10-06T03:24:48.808690+0000","last_unstale":"2023-10-06T03:24:49.804864+0000","last_undegraded":"2023-10-06T03:24:49.804864+0000","last_fullsized":"2023-10-06T03:24:49.804864+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:02.125182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.816790+0000","last_change":"2023-10-06T03:24:49.812643+0000","last_active":"2023-10-06T03:24:49.816790+0000","last_peered":"2023-10-06T03:24:49.816790+0000","last_clean":"2023-10-06T03:24:49.816790+0000","last_became_active":"2023-10-06T03:24:49.812384+0000","last_became_peered":"2023-10-06T03:24:49.812384+0000","last_unstale":"2023-10-06T03:24:49.816790+0000","last_undegraded":"2023-10-06T03:24:49.816790+0000","last_fullsized":"2023-10-06T03:24:49.816790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:52.254985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835941+0000","last_change":"2023-10-06T03:24:48.807439+0000","last_active":"2023-10-06T03:24:49.835941+0000","last_peered":"2023-10-06T03:24:49.835941+0000","last_clean":"2023-10-06T03:24:49.835941+0000","last_became_active":"2023-10-06T03:24:48.807169+0000","last_became_peered":"2023-10-06T03:24:48.807169+0000","last_unstale":"2023-10-06T03:24:49.835941+0000","last_undegraded":"2023-10-06T03:24:49.835941+0000","last_fullsized":"2023-10-06T03:24:49.835941+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:44.317412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.831359+0000","last_change":"2023-10-06T03:24:49.827821+0000","last_active":"2023-10-06T03:24:49.831359+0000","last_peered":"2023-10-06T03:24:49.831359+0000","last_clean":"2023-10-06T03:24:49.831359+0000","last_became_active":"2023-10-06T03:24:49.827574+0000","last_became_peered":"2023-10-06T03:24:49.827574+0000","last_unstale":"2023-10-06T03:24:49.831359+0000","last_undegraded":"2023-10-06T03:24:49.831359+0000","last_fullsized":"2023-10-06T03:24:49.831359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:47.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.807618+0000","last_change":"2023-10-06T03:24:48.809255+0000","last_active":"2023-10-06T03:24:49.807618+0000","last_peered":"2023-10-06T03:24:49.807618+0000","last_clean":"2023-10-06T03:24:49.807618+0000","last_became_active":"2023-10-06T03:24:48.808968+0000","last_became_peered":"2023-10-06T03:24:48.808968+0000","last_unstale":"2023-10-06T03:24:49.807618+0000","last_undegraded":"2023-10-06T03:24:49.807618+0000","last_fullsized":"2023-10-06T03:24:49.807618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824339+0000","last_change":"2023-10-06T03:24:49.816246+0000","last_active":"2023-10-06T03:24:49.824339+0000","last_peered":"2023-10-06T03:24:49.824339+0000","last_clean":"2023-10-06T03:24:49.824339+0000","last_became_active":"2023-10-06T03:24:49.816004+0000","last_became_peered":"2023-10-06T03:24:49.816004+0000","last_unstale":"2023-10-06T03:24:49.824339+0000","last_undegraded":"2023-10-06T03:24:49.824339+0000","last_fullsized":"2023-10-06T03:24:49.824339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:34.682483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.805935+0000","last_change":"2023-10-06T03:24:48.805052+0000","last_active":"2023-10-06T03:24:49.805935+0000","last_peered":"2023-10-06T03:24:49.805935+0000","last_clean":"2023-10-06T03:24:49.805935+0000","last_became_active":"2023-10-06T03:24:48.804765+0000","last_became_peered":"2023-10-06T03:24:48.804765+0000","last_unstale":"2023-10-06T03:24:49.805935+0000","last_undegraded":"2023-10-06T03:24:49.805935+0000","last_fullsized":"2023-10-06T03:24:49.805935+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:02.598795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824984+0000","last_change":"2023-10-06T03:24:49.817616+0000","last_active":"2023-10-06T03:24:49.824984+0000","last_peered":"2023-10-06T03:24:49.824984+0000","last_clean":"2023-10-06T03:24:49.824984+0000","last_became_active":"2023-10-06T03:24:49.817439+0000","last_became_peered":"2023-10-06T03:24:49.817439+0000","last_unstale":"2023-10-06T03:24:49.824984+0000","last_undegraded":"2023-10-06T03:24:49.824984+0000","last_fullsized":"2023-10-06T03:24:49.824984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:16.340244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810056+0000","last_change":"2023-10-06T03:24:48.804171+0000","last_active":"2023-10-06T03:24:49.810056+0000","last_peered":"2023-10-06T03:24:49.810056+0000","last_clean":"2023-10-06T03:24:49.810056+0000","last_became_active":"2023-10-06T03:24:48.803906+0000","last_became_peered":"2023-10-06T03:24:48.803906+0000","last_unstale":"2023-10-06T03:24:49.810056+0000","last_undegraded":"2023-10-06T03:24:49.810056+0000","last_fullsized":"2023-10-06T03:24:49.810056+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.816527+0000","last_change":"2023-10-06T03:24:49.811632+0000","last_active":"2023-10-06T03:24:49.816527+0000","last_peered":"2023-10-06T03:24:49.816527+0000","last_clean":"2023-10-06T03:24:49.816527+0000","last_became_active":"2023-10-06T03:24:49.811398+0000","last_became_peered":"2023-10-06T03:24:49.811398+0000","last_unstale":"2023-10-06T03:24:49.816527+0000","last_undegraded":"2023-10-06T03:24:49.816527+0000","last_fullsized":"2023-10-06T03:24:49.816527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:35.429205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812640+0000","last_change":"2023-10-06T03:24:48.801628+0000","last_active":"2023-10-06T03:24:49.812640+0000","last_peered":"2023-10-06T03:24:49.812640+0000","last_clean":"2023-10-06T03:24:49.812640+0000","last_became_active":"2023-10-06T03:24:48.801318+0000","last_became_peered":"2023-10-06T03:24:48.801318+0000","last_unstale":"2023-10-06T03:24:49.812640+0000","last_undegraded":"2023-10-06T03:24:49.812640+0000","last_fullsized":"2023-10-06T03:24:49.812640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:49.914899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812513+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:24:49.812513+0000","last_peered":"2023-10-06T03:24:49.812513+0000","last_clean":"2023-10-06T03:24:49.812513+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:24:49.812513+0000","last_undegraded":"2023-10-06T03:24:49.812513+0000","last_fullsized":"2023-10-06T03:24:49.812513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.823636+0000","last_change":"2023-10-06T03:24:49.816707+0000","last_active":"2023-10-06T03:24:49.823636+0000","last_peered":"2023-10-06T03:24:49.823636+0000","last_clean":"2023-10-06T03:24:49.823636+0000","last_became_active":"2023-10-06T03:24:49.816479+0000","last_became_peered":"2023-10-06T03:24:49.816479+0000","last_unstale":"2023-10-06T03:24:49.823636+0000","last_undegraded":"2023-10-06T03:24:49.823636+0000","last_fullsized":"2023-10-06T03:24:49.823636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:49.531455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.811849+0000","last_change":"2023-10-06T03:24:48.809341+0000","last_active":"2023-10-06T03:24:49.811849+0000","last_peered":"2023-10-06T03:24:49.811849+0000","last_clean":"2023-10-06T03:24:49.811849+0000","last_became_active":"2023-10-06T03:24:48.809095+0000","last_became_peered":"2023-10-06T03:24:48.809095+0000","last_unstale":"2023-10-06T03:24:49.811849+0000","last_undegraded":"2023-10-06T03:24:49.811849+0000","last_fullsized":"2023-10-06T03:24:49.811849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.804931+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:24:49.804931+0000","last_peered":"2023-10-06T03:24:49.804931+0000","last_clean":"2023-10-06T03:24:49.804931+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:24:49.804931+0000","last_undegraded":"2023-10-06T03:24:49.804931+0000","last_fullsized":"2023-10-06T03:24:49.804931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827049+0000","last_change":"2023-10-06T03:24:49.822079+0000","last_active":"2023-10-06T03:24:49.827049+0000","last_peered":"2023-10-06T03:24:49.827049+0000","last_clean":"2023-10-06T03:24:49.827049+0000","last_became_active":"2023-10-06T03:24:49.821820+0000","last_became_peered":"2023-10-06T03:24:49.821820+0000","last_unstale":"2023-10-06T03:24:49.827049+0000","last_undegraded":"2023-10-06T03:24:49.827049+0000","last_fullsized":"2023-10-06T03:24:49.827049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:42.414642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812317+0000","last_change":"2023-10-06T03:24:48.805388+0000","last_active":"2023-10-06T03:24:49.812317+0000","last_peered":"2023-10-06T03:24:49.812317+0000","last_clean":"2023-10-06T03:24:49.812317+0000","last_became_active":"2023-10-06T03:24:48.805136+0000","last_became_peered":"2023-10-06T03:24:48.805136+0000","last_unstale":"2023-10-06T03:24:49.812317+0000","last_undegraded":"2023-10-06T03:24:49.812317+0000","last_fullsized":"2023-10-06T03:24:49.812317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:09.893072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812416+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:24:49.812416+0000","last_peered":"2023-10-06T03:24:49.812416+0000","last_clean":"2023-10-06T03:24:49.812416+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:24:49.812416+0000","last_undegraded":"2023-10-06T03:24:49.812416+0000","last_fullsized":"2023-10-06T03:24:49.812416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810235+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:24:49.810235+0000","last_peered":"2023-10-06T03:24:49.810235+0000","last_clean":"2023-10-06T03:24:49.810235+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:24:49.810235+0000","last_undegraded":"2023-10-06T03:24:49.810235+0000","last_fullsized":"2023-10-06T03:24:49.810235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824956+0000","last_change":"2023-10-06T03:24:49.817449+0000","last_active":"2023-10-06T03:24:49.824956+0000","last_peered":"2023-10-06T03:24:49.824956+0000","last_clean":"2023-10-06T03:24:49.824956+0000","last_became_active":"2023-10-06T03:24:49.817203+0000","last_became_peered":"2023-10-06T03:24:49.817203+0000","last_unstale":"2023-10-06T03:24:49.824956+0000","last_undegraded":"2023-10-06T03:24:49.824956+0000","last_fullsized":"2023-10-06T03:24:49.824956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:57.868100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810543+0000","last_change":"2023-10-06T03:24:48.808937+0000","last_active":"2023-10-06T03:24:49.810543+0000","last_peered":"2023-10-06T03:24:49.810543+0000","last_clean":"2023-10-06T03:24:49.810543+0000","last_became_active":"2023-10-06T03:24:48.808657+0000","last_became_peered":"2023-10-06T03:24:48.808657+0000","last_unstale":"2023-10-06T03:24:49.810543+0000","last_undegraded":"2023-10-06T03:24:49.810543+0000","last_fullsized":"2023-10-06T03:24:49.810543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.811011+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:24:49.811011+0000","last_peered":"2023-10-06T03:24:49.811011+0000","last_clean":"2023-10-06T03:24:49.811011+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:24:49.811011+0000","last_undegraded":"2023-10-06T03:24:49.811011+0000","last_fullsized":"2023-10-06T03:24:49.811011+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824553+0000","last_change":"2023-10-06T03:24:49.815716+0000","last_active":"2023-10-06T03:24:49.824553+0000","last_peered":"2023-10-06T03:24:49.824553+0000","last_clean":"2023-10-06T03:24:49.824553+0000","last_became_active":"2023-10-06T03:24:49.815456+0000","last_became_peered":"2023-10-06T03:24:49.815456+0000","last_unstale":"2023-10-06T03:24:49.824553+0000","last_undegraded":"2023-10-06T03:24:49.824553+0000","last_fullsized":"2023-10-06T03:24:49.824553+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:49.531455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834982+0000","last_change":"2023-10-06T03:24:48.806288+0000","last_active":"2023-10-06T03:24:49.834982+0000","last_peered":"2023-10-06T03:24:49.834982+0000","last_clean":"2023-10-06T03:24:49.834982+0000","last_became_active":"2023-10-06T03:24:48.806067+0000","last_became_peered":"2023-10-06T03:24:48.806067+0000","last_unstale":"2023-10-06T03:24:49.834982+0000","last_undegraded":"2023-10-06T03:24:49.834982+0000","last_fullsized":"2023-10-06T03:24:49.834982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810142+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:24:49.810142+0000","last_peered":"2023-10-06T03:24:49.810142+0000","last_clean":"2023-10-06T03:24:49.810142+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:24:49.810142+0000","last_undegraded":"2023-10-06T03:24:49.810142+0000","last_fullsized":"2023-10-06T03:24:49.810142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833124+0000","last_change":"2023-10-06T03:24:49.825686+0000","last_active":"2023-10-06T03:24:49.833124+0000","last_peered":"2023-10-06T03:24:49.833124+0000","last_clean":"2023-10-06T03:24:49.833124+0000","last_became_active":"2023-10-06T03:24:49.825421+0000","last_became_peered":"2023-10-06T03:24:49.825421+0000","last_unstale":"2023-10-06T03:24:49.833124+0000","last_undegraded":"2023-10-06T03:24:49.833124+0000","last_fullsized":"2023-10-06T03:24:49.833124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:03.162349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.806027+0000","last_change":"2023-10-06T03:24:48.802162+0000","last_active":"2023-10-06T03:24:49.806027+0000","last_peered":"2023-10-06T03:24:49.806027+0000","last_clean":"2023-10-06T03:24:49.806027+0000","last_became_active":"2023-10-06T03:24:48.801890+0000","last_became_peered":"2023-10-06T03:24:48.801890+0000","last_unstale":"2023-10-06T03:24:49.806027+0000","last_undegraded":"2023-10-06T03:24:49.806027+0000","last_fullsized":"2023-10-06T03:24:49.806027+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.808489+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:24:49.808489+0000","last_peered":"2023-10-06T03:24:49.808489+0000","last_clean":"2023-10-06T03:24:49.808489+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:24:49.808489+0000","last_undegraded":"2023-10-06T03:24:49.808489+0000","last_fullsized":"2023-10-06T03:24:49.808489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.828176+0000","last_change":"2023-10-06T03:24:49.818136+0000","last_active":"2023-10-06T03:24:49.828176+0000","last_peered":"2023-10-06T03:24:49.828176+0000","last_clean":"2023-10-06T03:24:49.828176+0000","last_became_active":"2023-10-06T03:24:49.817838+0000","last_became_peered":"2023-10-06T03:24:49.817838+0000","last_unstale":"2023-10-06T03:24:49.828176+0000","last_undegraded":"2023-10-06T03:24:49.828176+0000","last_fullsized":"2023-10-06T03:24:49.828176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:03.131980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812143+0000","last_change":"2023-10-06T03:24:48.811843+0000","last_active":"2023-10-06T03:24:49.812143+0000","last_peered":"2023-10-06T03:24:49.812143+0000","last_clean":"2023-10-06T03:24:49.812143+0000","last_became_active":"2023-10-06T03:24:48.811661+0000","last_became_peered":"2023-10-06T03:24:48.811661+0000","last_unstale":"2023-10-06T03:24:49.812143+0000","last_undegraded":"2023-10-06T03:24:49.812143+0000","last_fullsized":"2023-10-06T03:24:49.812143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:51.862931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.815959+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:24:49.815959+0000","last_peered":"2023-10-06T03:24:49.815959+0000","last_clean":"2023-10-06T03:24:49.815959+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:24:49.815959+0000","last_undegraded":"2023-10-06T03:24:49.815959+0000","last_fullsized":"2023-10-06T03:24:49.815959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824225+0000","last_change":"2023-10-06T03:24:49.820217+0000","last_active":"2023-10-06T03:24:49.824225+0000","last_peered":"2023-10-06T03:24:49.824225+0000","last_clean":"2023-10-06T03:24:49.824225+0000","last_became_active":"2023-10-06T03:24:49.819940+0000","last_became_peered":"2023-10-06T03:24:49.819940+0000","last_unstale":"2023-10-06T03:24:49.824225+0000","last_undegraded":"2023-10-06T03:24:49.824225+0000","last_fullsized":"2023-10-06T03:24:49.824225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:33.894597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.806698+0000","last_change":"2023-10-06T03:24:48.805748+0000","last_active":"2023-10-06T03:24:49.806698+0000","last_peered":"2023-10-06T03:24:49.806698+0000","last_clean":"2023-10-06T03:24:49.806698+0000","last_became_active":"2023-10-06T03:24:48.805532+0000","last_became_peered":"2023-10-06T03:24:48.805532+0000","last_unstale":"2023-10-06T03:24:49.806698+0000","last_undegraded":"2023-10-06T03:24:49.806698+0000","last_fullsized":"2023-10-06T03:24:49.806698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.815921+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:24:49.815921+0000","last_peered":"2023-10-06T03:24:49.815921+0000","last_clean":"2023-10-06T03:24:49.815921+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:24:49.815921+0000","last_undegraded":"2023-10-06T03:24:49.815921+0000","last_fullsized":"2023-10-06T03:24:49.815921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":786386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52200000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.627},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":446464,"data_stored":196572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.64100000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":6.3680000000000003,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.5039999999999996,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.4740000000000002,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":6.4359999999999999,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.625},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":786366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.375}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.31}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":194609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":12.19,"5min":12.19,"15min":12.19},"last":0.435},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":8.3900000000000006,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.318}]},{"osd":2,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.38300000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.948,"5min":16.948,"15min":16.948},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.497},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":16.881,"5min":16.881,"15min":16.881},"last":0.56100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":197486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.308}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":196538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.20699999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.28199999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.625},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.752}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.72299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.758,"5min":4.758,"15min":4.758},"last":0.505},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":9.7690000000000001,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.379},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.624}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":195998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:55.888 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:24:55.890 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:24:58.367 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.489+0000 7fe89528f700 1 Processor -- start 2023-10-06T03:24:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.489+0000 7fe89528f700 1 -- start start 2023-10-06T03:24:58.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.489+0000 7fe89528f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8900b49e0 0x7fe8900aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.489+0000 7fe89528f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8900b0ca0 con 0x7fe8900b07a0 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.489+0000 7fe89528f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8900b0f80 con 0x7fe8901595a0 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.489+0000 7fe89528f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900b1260 con 0x7fe8900b49e0 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe8900b07a0 0x7fe8900b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50262/0 (socket says 172.21.15.84:50262) 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88f7fe700 1 -- 172.21.15.84:0/2916429816 learned_addr learned my addr 172.21.15.84:0/2916429816 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88e7fc700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8900b49e0 0x7fe8900aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064468061 0 0) 0x7fe8900b0ca0 con 0x7fe8900b07a0 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe87c003570 con 0x7fe8900b07a0 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637945229 0 0) 0x7fe8900b0f80 con 0x7fe8901595a0 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8900b0ca0 con 0x7fe8901595a0 2023-10-06T03:24:58.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1177229819 0 0) 0x7fe87c003570 con 0x7fe8900b07a0 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8900b49e0 msgr2=0x7fe8900aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8900b49e0 0x7fe8900aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 >> v1:172.21.15.131:6789/0 conn(0x7fe8901595a0 legacy=0x7fe8900aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8900b1540 con 0x7fe8900b07a0 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fe880001470 con 0x7fe8900b07a0 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88e7fc700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8900b49e0 0x7fe8900aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 >> v1:172.21.15.84:6789/0 conn(0x7fe8900b07a0 legacy=0x7fe8900b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe87c003c20 0x7fe87c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe87c004810 0x7fe87c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8900b49e0 0x7fe87c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900b1260 con 0x7fe87c004810 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c00bbb0 con 0x7fe87c003c20 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c00bd70 con 0x7fe8900b49e0 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88e7fc700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe87c004810 0x7fe87c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88f7fe700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8900b49e0 0x7fe87c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.490+0000 7fe88effd700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe87c003c20 0x7fe87c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe88e7fc700 1 -- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8900b49e0 msgr2=0x7fe87c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe88e7fc700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8900b49e0 0x7fe87c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe88e7fc700 1 -- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe87c003c20 msgr2=0x7fe87c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe88e7fc700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe87c003c20 0x7fe87c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe88e7fc700 1 -- 172.21.15.84:0/2916429816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878009420 con 0x7fe87c004810 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe88e7fc700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe87c004810 0x7fe87c004c80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe878009df0 tx=0x7fe8780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2cfd503ea2d1f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:58.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878009740 con 0x7fe87c004810 2023-10-06T03:24:58.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87800e920 con 0x7fe87c004810 2023-10-06T03:24:58.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe88dffb700 1 -- 172.21.15.84:0/2916429816 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800ece0 con 0x7fe87c004810 2023-10-06T03:24:58.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe89528f700 1 -- 172.21.15.84:0/2916429816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe87c004810 msgr2=0x7fe87c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe89528f700 1 --2- 172.21.15.84:0/2916429816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe87c004810 0x7fe87c004c80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe878009df0 tx=0x7fe8780091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.491+0000 7fe88f7fe700 1 -- 172.21.15.84:0/2916429816 reap_dead start 2023-10-06T03:24:58.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.492+0000 7fe89528f700 1 -- 172.21.15.84:0/2916429816 shutdown_connections 2023-10-06T03:24:58.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.492+0000 7fe89528f700 1 -- 172.21.15.84:0/2916429816 >> 172.21.15.84:0/2916429816 conn(0x7fe890099830 msgr2=0x7fe89006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:58.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.492+0000 7fe89528f700 1 -- 172.21.15.84:0/2916429816 shutdown_connections 2023-10-06T03:24:58.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.492+0000 7fe89528f700 1 -- 172.21.15.84:0/2916429816 wait complete. 2023-10-06T03:24:58.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.493+0000 7fe89528f700 1 Processor -- start 2023-10-06T03:24:58.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.493+0000 7fe89528f700 1 -- start start 2023-10-06T03:24:58.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe89528f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe87c004810 0x7fe8901507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe89528f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8901564d0 0x7fe89015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe89528f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe890156940 0x7fe89015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe89528f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe890159e60 con 0x7fe8901564d0 2023-10-06T03:24:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe89528f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900cc730 con 0x7fe890156940 2023-10-06T03:24:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe89528f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900cca10 con 0x7fe87c004810 2023-10-06T03:24:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe88e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8901564d0 0x7fe89015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe88e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8901564d0 0x7fe89015a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57520/0 (socket says 172.21.15.84:57520) 2023-10-06T03:24:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe88e7fc700 1 -- 172.21.15.84:0/953056769 learned_addr learned my addr 172.21.15.84:0/953056769 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe88f7fe700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe890156940 0x7fe89015b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe88e7fc700 1 -- 172.21.15.84:0/953056769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe87c004810 msgr2=0x7fe8901507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe88e7fc700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe87c004810 0x7fe8901507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe88e7fc700 1 -- 172.21.15.84:0/953056769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe890156940 msgr2=0x7fe89015b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe88e7fc700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe890156940 0x7fe89015b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe88e7fc700 1 -- 172.21.15.84:0/953056769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890159af0 con 0x7fe8901564d0 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe88e7fc700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8901564d0 0x7fe89015a2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe8780091e0 tx=0x7fe87801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe886ffd700 1 -- 172.21.15.84:0/953056769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878022070 con 0x7fe8901564d0 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe886ffd700 1 -- 172.21.15.84:0/953056769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe878013be0 con 0x7fe8901564d0 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe89528f700 1 -- 172.21.15.84:0/953056769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe890159e60 con 0x7fe8901564d0 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe886ffd700 1 -- 172.21.15.84:0/953056769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87801c450 con 0x7fe8901564d0 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.494+0000 7fe89528f700 1 -- 172.21.15.84:0/953056769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe890157a60 con 0x7fe8901564d0 2023-10-06T03:24:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.495+0000 7fe89528f700 1 -- 172.21.15.84:0/953056769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89015a140 con 0x7fe8901564d0 2023-10-06T03:24:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.496+0000 7fe886ffd700 1 -- 172.21.15.84:0/953056769 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe878026070 con 0x7fe8901564d0 2023-10-06T03:24:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.496+0000 7fe886ffd700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe870066f30 0x7fe8700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.496+0000 7fe886ffd700 1 -- 172.21.15.84:0/953056769 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe878085fa0 con 0x7fe8901564d0 2023-10-06T03:24:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.496+0000 7fe88effd700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe870066f30 0x7fe8700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.496+0000 7fe88effd700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe870066f30 0x7fe8700693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8880042e0 tx=0x7fe888001bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.500+0000 7fe886ffd700 1 -- 172.21.15.84:0/953056769 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8780b75a0 con 0x7fe8901564d0 2023-10-06T03:24:58.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.676+0000 7fe89528f700 1 -- 172.21.15.84:0/953056769 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe890159970 con 0x7fe870066f30 2023-10-06T03:24:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.685+0000 7fe886ffd700 1 -- 172.21.15.84:0/953056769 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311374 (secure 0 0 0) 0x7fe88800cd10 con 0x7fe870066f30 2023-10-06T03:24:58.690 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 -- 172.21.15.84:0/953056769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe870066f30 msgr2=0x7fe8700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe870066f30 0x7fe8700693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8880042e0 tx=0x7fe888001bd0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 -- 172.21.15.84:0/953056769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8901564d0 msgr2=0x7fe89015a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8901564d0 0x7fe89015a2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe8780091e0 tx=0x7fe87801a000 comp rx=0 tx=0).stop 2023-10-06T03:24:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 -- 172.21.15.84:0/953056769 shutdown_connections 2023-10-06T03:24:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe870066f30 0x7fe8700693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe890156940 0x7fe89015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe87c004810 0x7fe8901507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 --2- 172.21.15.84:0/953056769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8901564d0 0x7fe89015a2f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 -- 172.21.15.84:0/953056769 >> 172.21.15.84:0/953056769 conn(0x7fe890099830 msgr2=0x7fe890068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 -- 172.21.15.84:0/953056769 shutdown_connections 2023-10-06T03:24:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.688+0000 7fe89528f700 1 -- 172.21.15.84:0/953056769 wait complete. 2023-10-06T03:24:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:24:58.702 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-10-06T03:24:57.055287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382948,"kb_used_data":4644,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591772,"statfs":{"total":773094113280,"available":770653974528,"internally_reserved":0,"allocated":4755456,"data_stored":2751419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001422"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824579+0000","last_change":"2023-10-06T03:24:49.817728+0000","last_active":"2023-10-06T03:24:49.824579+0000","last_peered":"2023-10-06T03:24:49.824579+0000","last_clean":"2023-10-06T03:24:49.824579+0000","last_became_active":"2023-10-06T03:24:49.817464+0000","last_became_peered":"2023-10-06T03:24:49.817464+0000","last_unstale":"2023-10-06T03:24:49.824579+0000","last_undegraded":"2023-10-06T03:24:49.824579+0000","last_fullsized":"2023-10-06T03:24:49.824579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:57.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827956+0000","last_change":"2023-10-06T03:24:49.819543+0000","last_active":"2023-10-06T03:24:49.827956+0000","last_peered":"2023-10-06T03:24:49.827956+0000","last_clean":"2023-10-06T03:24:49.827956+0000","last_became_active":"2023-10-06T03:24:49.819278+0000","last_became_peered":"2023-10-06T03:24:49.819278+0000","last_unstale":"2023-10-06T03:24:49.827956+0000","last_undegraded":"2023-10-06T03:24:49.827956+0000","last_fullsized":"2023-10-06T03:24:49.827956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:57.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821890+0000","last_change":"2023-10-06T03:24:49.816848+0000","last_active":"2023-10-06T03:24:49.821890+0000","last_peered":"2023-10-06T03:24:49.821890+0000","last_clean":"2023-10-06T03:24:49.821890+0000","last_became_active":"2023-10-06T03:24:49.816595+0000","last_became_peered":"2023-10-06T03:24:49.816595+0000","last_unstale":"2023-10-06T03:24:49.821890+0000","last_undegraded":"2023-10-06T03:24:49.821890+0000","last_fullsized":"2023-10-06T03:24:49.821890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:08.179862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.825995+0000","last_change":"2023-10-06T03:24:49.818689+0000","last_active":"2023-10-06T03:24:49.825995+0000","last_peered":"2023-10-06T03:24:49.825995+0000","last_clean":"2023-10-06T03:24:49.825995+0000","last_became_active":"2023-10-06T03:24:49.818435+0000","last_became_peered":"2023-10-06T03:24:49.818435+0000","last_unstale":"2023-10-06T03:24:49.825995+0000","last_undegraded":"2023-10-06T03:24:49.825995+0000","last_fullsized":"2023-10-06T03:24:49.825995+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:24.602629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.828011+0000","last_change":"2023-10-06T03:24:49.821082+0000","last_active":"2023-10-06T03:24:49.828011+0000","last_peered":"2023-10-06T03:24:49.828011+0000","last_clean":"2023-10-06T03:24:49.828011+0000","last_became_active":"2023-10-06T03:24:49.820543+0000","last_became_peered":"2023-10-06T03:24:49.820543+0000","last_unstale":"2023-10-06T03:24:49.828011+0000","last_undegraded":"2023-10-06T03:24:49.828011+0000","last_fullsized":"2023-10-06T03:24:49.828011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:50.921698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.816805+0000","last_change":"2023-10-06T03:24:49.814806+0000","last_active":"2023-10-06T03:24:49.816805+0000","last_peered":"2023-10-06T03:24:49.816805+0000","last_clean":"2023-10-06T03:24:49.816805+0000","last_became_active":"2023-10-06T03:24:49.814546+0000","last_became_peered":"2023-10-06T03:24:49.814546+0000","last_unstale":"2023-10-06T03:24:49.816805+0000","last_undegraded":"2023-10-06T03:24:49.816805+0000","last_fullsized":"2023-10-06T03:24:49.816805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:33.894597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827193+0000","last_change":"2023-10-06T03:24:49.822892+0000","last_active":"2023-10-06T03:24:49.827193+0000","last_peered":"2023-10-06T03:24:49.827193+0000","last_clean":"2023-10-06T03:24:49.827193+0000","last_became_active":"2023-10-06T03:24:49.822618+0000","last_became_peered":"2023-10-06T03:24:49.822618+0000","last_unstale":"2023-10-06T03:24:49.827193+0000","last_undegraded":"2023-10-06T03:24:49.827193+0000","last_fullsized":"2023-10-06T03:24:49.827193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:50.921698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.825952+0000","last_change":"2023-10-06T03:24:49.817948+0000","last_active":"2023-10-06T03:24:49.825952+0000","last_peered":"2023-10-06T03:24:49.825952+0000","last_clean":"2023-10-06T03:24:49.825952+0000","last_became_active":"2023-10-06T03:24:49.817509+0000","last_became_peered":"2023-10-06T03:24:49.817509+0000","last_unstale":"2023-10-06T03:24:49.825952+0000","last_undegraded":"2023-10-06T03:24:49.825952+0000","last_fullsized":"2023-10-06T03:24:49.825952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:46.157152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824623+0000","last_change":"2023-10-06T03:24:49.816965+0000","last_active":"2023-10-06T03:24:49.824623+0000","last_peered":"2023-10-06T03:24:49.824623+0000","last_clean":"2023-10-06T03:24:49.824623+0000","last_became_active":"2023-10-06T03:24:49.816730+0000","last_became_peered":"2023-10-06T03:24:49.816730+0000","last_unstale":"2023-10-06T03:24:49.824623+0000","last_undegraded":"2023-10-06T03:24:49.824623+0000","last_fullsized":"2023-10-06T03:24:49.824623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.826018+0000","last_change":"2023-10-06T03:24:49.818768+0000","last_active":"2023-10-06T03:24:49.826018+0000","last_peered":"2023-10-06T03:24:49.826018+0000","last_clean":"2023-10-06T03:24:49.826018+0000","last_became_active":"2023-10-06T03:24:49.818480+0000","last_became_peered":"2023-10-06T03:24:49.818480+0000","last_unstale":"2023-10-06T03:24:49.826018+0000","last_undegraded":"2023-10-06T03:24:49.826018+0000","last_fullsized":"2023-10-06T03:24:49.826018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:50.360845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.825947+0000","last_change":"2023-10-06T03:24:49.818169+0000","last_active":"2023-10-06T03:24:49.825947+0000","last_peered":"2023-10-06T03:24:49.825947+0000","last_clean":"2023-10-06T03:24:49.825947+0000","last_became_active":"2023-10-06T03:24:49.817895+0000","last_became_peered":"2023-10-06T03:24:49.817895+0000","last_unstale":"2023-10-06T03:24:49.825947+0000","last_undegraded":"2023-10-06T03:24:49.825947+0000","last_fullsized":"2023-10-06T03:24:49.825947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:46.908108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827992+0000","last_change":"2023-10-06T03:24:49.821318+0000","last_active":"2023-10-06T03:24:49.827992+0000","last_peered":"2023-10-06T03:24:49.827992+0000","last_clean":"2023-10-06T03:24:49.827992+0000","last_became_active":"2023-10-06T03:24:49.821044+0000","last_became_peered":"2023-10-06T03:24:49.821044+0000","last_unstale":"2023-10-06T03:24:49.827992+0000","last_undegraded":"2023-10-06T03:24:49.827992+0000","last_fullsized":"2023-10-06T03:24:49.827992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:03.473599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824382+0000","last_change":"2023-10-06T03:24:49.816559+0000","last_active":"2023-10-06T03:24:49.824382+0000","last_peered":"2023-10-06T03:24:49.824382+0000","last_clean":"2023-10-06T03:24:49.824382+0000","last_became_active":"2023-10-06T03:24:49.816292+0000","last_became_peered":"2023-10-06T03:24:49.816292+0000","last_unstale":"2023-10-06T03:24:49.824382+0000","last_undegraded":"2023-10-06T03:24:49.824382+0000","last_fullsized":"2023-10-06T03:24:49.824382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:05.207479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824628+0000","last_change":"2023-10-06T03:24:49.816874+0000","last_active":"2023-10-06T03:24:49.824628+0000","last_peered":"2023-10-06T03:24:49.824628+0000","last_clean":"2023-10-06T03:24:49.824628+0000","last_became_active":"2023-10-06T03:24:49.816621+0000","last_became_peered":"2023-10-06T03:24:49.816621+0000","last_unstale":"2023-10-06T03:24:49.824628+0000","last_undegraded":"2023-10-06T03:24:49.824628+0000","last_fullsized":"2023-10-06T03:24:49.824628+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:35.429205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824131+0000","last_change":"2023-10-06T03:24:49.819662+0000","last_active":"2023-10-06T03:24:49.824131+0000","last_peered":"2023-10-06T03:24:49.824131+0000","last_clean":"2023-10-06T03:24:49.824131+0000","last_became_active":"2023-10-06T03:24:49.819446+0000","last_became_peered":"2023-10-06T03:24:49.819446+0000","last_unstale":"2023-10-06T03:24:49.824131+0000","last_undegraded":"2023-10-06T03:24:49.824131+0000","last_fullsized":"2023-10-06T03:24:49.824131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:57.868100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833165+0000","last_change":"2023-10-06T03:24:49.825694+0000","last_active":"2023-10-06T03:24:49.833165+0000","last_peered":"2023-10-06T03:24:49.833165+0000","last_clean":"2023-10-06T03:24:49.833165+0000","last_became_active":"2023-10-06T03:24:49.825403+0000","last_became_peered":"2023-10-06T03:24:49.825403+0000","last_unstale":"2023-10-06T03:24:49.833165+0000","last_undegraded":"2023-10-06T03:24:49.833165+0000","last_fullsized":"2023-10-06T03:24:49.833165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:51.520184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827818+0000","last_change":"2023-10-06T03:24:49.823596+0000","last_active":"2023-10-06T03:24:49.827818+0000","last_peered":"2023-10-06T03:24:49.827818+0000","last_clean":"2023-10-06T03:24:49.827818+0000","last_became_active":"2023-10-06T03:24:49.823297+0000","last_became_peered":"2023-10-06T03:24:49.823297+0000","last_unstale":"2023-10-06T03:24:49.827818+0000","last_undegraded":"2023-10-06T03:24:49.827818+0000","last_fullsized":"2023-10-06T03:24:49.827818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:50.360845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827930+0000","last_change":"2023-10-06T03:24:49.826272+0000","last_active":"2023-10-06T03:24:49.827930+0000","last_peered":"2023-10-06T03:24:49.827930+0000","last_clean":"2023-10-06T03:24:49.827930+0000","last_became_active":"2023-10-06T03:24:49.825947+0000","last_became_peered":"2023-10-06T03:24:49.825947+0000","last_unstale":"2023-10-06T03:24:49.827930+0000","last_undegraded":"2023-10-06T03:24:49.827930+0000","last_fullsized":"2023-10-06T03:24:49.827930+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:25.442095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833100+0000","last_change":"2023-10-06T03:24:49.825066+0000","last_active":"2023-10-06T03:24:49.833100+0000","last_peered":"2023-10-06T03:24:49.833100+0000","last_clean":"2023-10-06T03:24:49.833100+0000","last_became_active":"2023-10-06T03:24:49.824843+0000","last_became_peered":"2023-10-06T03:24:49.824843+0000","last_unstale":"2023-10-06T03:24:49.833100+0000","last_undegraded":"2023-10-06T03:24:49.833100+0000","last_fullsized":"2023-10-06T03:24:49.833100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:40.332231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821296+0000","last_change":"2023-10-06T03:24:49.813984+0000","last_active":"2023-10-06T03:24:49.821296+0000","last_peered":"2023-10-06T03:24:49.821296+0000","last_clean":"2023-10-06T03:24:49.821296+0000","last_became_active":"2023-10-06T03:24:49.813685+0000","last_became_peered":"2023-10-06T03:24:49.813685+0000","last_unstale":"2023-10-06T03:24:49.821296+0000","last_undegraded":"2023-10-06T03:24:49.821296+0000","last_fullsized":"2023-10-06T03:24:49.821296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:47.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.823659+0000","last_change":"2023-10-06T03:24:49.818710+0000","last_active":"2023-10-06T03:24:49.823659+0000","last_peered":"2023-10-06T03:24:49.823659+0000","last_clean":"2023-10-06T03:24:49.823659+0000","last_became_active":"2023-10-06T03:24:49.818476+0000","last_became_peered":"2023-10-06T03:24:49.818476+0000","last_unstale":"2023-10-06T03:24:49.823659+0000","last_undegraded":"2023-10-06T03:24:49.823659+0000","last_fullsized":"2023-10-06T03:24:49.823659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:08.179862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.826008+0000","last_change":"2023-10-06T03:24:49.818743+0000","last_active":"2023-10-06T03:24:49.826008+0000","last_peered":"2023-10-06T03:24:49.826008+0000","last_clean":"2023-10-06T03:24:49.826008+0000","last_became_active":"2023-10-06T03:24:49.818497+0000","last_became_peered":"2023-10-06T03:24:49.818497+0000","last_unstale":"2023-10-06T03:24:49.826008+0000","last_undegraded":"2023-10-06T03:24:49.826008+0000","last_fullsized":"2023-10-06T03:24:49.826008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:33.894597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824566+0000","last_change":"2023-10-06T03:24:49.818853+0000","last_active":"2023-10-06T03:24:49.824566+0000","last_peered":"2023-10-06T03:24:49.824566+0000","last_clean":"2023-10-06T03:24:49.824566+0000","last_became_active":"2023-10-06T03:24:49.818587+0000","last_became_peered":"2023-10-06T03:24:49.818587+0000","last_unstale":"2023-10-06T03:24:49.824566+0000","last_undegraded":"2023-10-06T03:24:49.824566+0000","last_fullsized":"2023-10-06T03:24:49.824566+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:10.899871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.829804+0000","last_change":"2023-10-06T03:24:49.820988+0000","last_active":"2023-10-06T03:24:49.829804+0000","last_peered":"2023-10-06T03:24:49.829804+0000","last_clean":"2023-10-06T03:24:49.829804+0000","last_became_active":"2023-10-06T03:24:49.820720+0000","last_became_peered":"2023-10-06T03:24:49.820720+0000","last_unstale":"2023-10-06T03:24:49.829804+0000","last_undegraded":"2023-10-06T03:24:49.829804+0000","last_fullsized":"2023-10-06T03:24:49.829804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:23.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.832300+0000","last_change":"2023-10-06T03:24:49.823590+0000","last_active":"2023-10-06T03:24:49.832300+0000","last_peered":"2023-10-06T03:24:49.832300+0000","last_clean":"2023-10-06T03:24:49.832300+0000","last_became_active":"2023-10-06T03:24:49.823291+0000","last_became_peered":"2023-10-06T03:24:49.823291+0000","last_unstale":"2023-10-06T03:24:49.832300+0000","last_undegraded":"2023-10-06T03:24:49.832300+0000","last_fullsized":"2023-10-06T03:24:49.832300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.678893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821221+0000","last_change":"2023-10-06T03:24:49.813389+0000","last_active":"2023-10-06T03:24:49.821221+0000","last_peered":"2023-10-06T03:24:49.821221+0000","last_clean":"2023-10-06T03:24:49.821221+0000","last_became_active":"2023-10-06T03:24:49.813141+0000","last_became_peered":"2023-10-06T03:24:49.813141+0000","last_unstale":"2023-10-06T03:24:49.821221+0000","last_undegraded":"2023-10-06T03:24:49.821221+0000","last_fullsized":"2023-10-06T03:24:49.821221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827809+0000","last_change":"2023-10-06T03:24:49.823413+0000","last_active":"2023-10-06T03:24:49.827809+0000","last_peered":"2023-10-06T03:24:49.827809+0000","last_clean":"2023-10-06T03:24:49.827809+0000","last_became_active":"2023-10-06T03:24:49.823197+0000","last_became_peered":"2023-10-06T03:24:49.823197+0000","last_unstale":"2023-10-06T03:24:49.827809+0000","last_undegraded":"2023-10-06T03:24:49.827809+0000","last_fullsized":"2023-10-06T03:24:49.827809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:24.602629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.832354+0000","last_change":"2023-10-06T03:24:49.822042+0000","last_active":"2023-10-06T03:24:49.832354+0000","last_peered":"2023-10-06T03:24:49.832354+0000","last_clean":"2023-10-06T03:24:49.832354+0000","last_became_active":"2023-10-06T03:24:49.821756+0000","last_became_peered":"2023-10-06T03:24:49.821756+0000","last_unstale":"2023-10-06T03:24:49.832354+0000","last_undegraded":"2023-10-06T03:24:49.832354+0000","last_fullsized":"2023-10-06T03:24:49.832354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.830707+0000","last_change":"2023-10-06T03:24:49.822810+0000","last_active":"2023-10-06T03:24:49.830707+0000","last_peered":"2023-10-06T03:24:49.830707+0000","last_clean":"2023-10-06T03:24:49.830707+0000","last_became_active":"2023-10-06T03:24:49.822543+0000","last_became_peered":"2023-10-06T03:24:49.822543+0000","last_unstale":"2023-10-06T03:24:49.830707+0000","last_undegraded":"2023-10-06T03:24:49.830707+0000","last_fullsized":"2023-10-06T03:24:49.830707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:34.682483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.826958+0000","last_change":"2023-10-06T03:24:49.821697+0000","last_active":"2023-10-06T03:24:49.826958+0000","last_peered":"2023-10-06T03:24:49.826958+0000","last_clean":"2023-10-06T03:24:49.826958+0000","last_became_active":"2023-10-06T03:24:49.821441+0000","last_became_peered":"2023-10-06T03:24:49.821441+0000","last_unstale":"2023-10-06T03:24:49.826958+0000","last_undegraded":"2023-10-06T03:24:49.826958+0000","last_fullsized":"2023-10-06T03:24:49.826958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:35.429205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824564+0000","last_change":"2023-10-06T03:24:49.822944+0000","last_active":"2023-10-06T03:24:49.824564+0000","last_peered":"2023-10-06T03:24:49.824564+0000","last_clean":"2023-10-06T03:24:49.824564+0000","last_became_active":"2023-10-06T03:24:49.822774+0000","last_became_peered":"2023-10-06T03:24:49.822774+0000","last_unstale":"2023-10-06T03:24:49.824564+0000","last_undegraded":"2023-10-06T03:24:49.824564+0000","last_fullsized":"2023-10-06T03:24:49.824564+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:35.540004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.820701+0000","last_change":"2023-10-06T03:24:49.813020+0000","last_active":"2023-10-06T03:24:49.820701+0000","last_peered":"2023-10-06T03:24:49.820701+0000","last_clean":"2023-10-06T03:24:49.820701+0000","last_became_active":"2023-10-06T03:24:49.812753+0000","last_became_peered":"2023-10-06T03:24:49.812753+0000","last_unstale":"2023-10-06T03:24:49.820701+0000","last_undegraded":"2023-10-06T03:24:49.820701+0000","last_fullsized":"2023-10-06T03:24:49.820701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:59.096514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.823952+0000","last_change":"2023-10-06T03:24:49.817948+0000","last_active":"2023-10-06T03:24:49.823952+0000","last_peered":"2023-10-06T03:24:49.823952+0000","last_clean":"2023-10-06T03:24:49.823952+0000","last_became_active":"2023-10-06T03:24:49.817685+0000","last_became_peered":"2023-10-06T03:24:49.817685+0000","last_unstale":"2023-10-06T03:24:49.823952+0000","last_undegraded":"2023-10-06T03:24:49.823952+0000","last_fullsized":"2023-10-06T03:24:49.823952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836416+0000","last_change":"2023-10-06T03:24:48.812118+0000","last_active":"2023-10-06T03:24:49.836416+0000","last_peered":"2023-10-06T03:24:49.836416+0000","last_clean":"2023-10-06T03:24:49.836416+0000","last_became_active":"2023-10-06T03:24:48.811913+0000","last_became_peered":"2023-10-06T03:24:48.811913+0000","last_unstale":"2023-10-06T03:24:49.836416+0000","last_undegraded":"2023-10-06T03:24:49.836416+0000","last_fullsized":"2023-10-06T03:24:49.836416+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:44.687691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.832279+0000","last_change":"2023-10-06T03:24:49.822041+0000","last_active":"2023-10-06T03:24:49.832279+0000","last_peered":"2023-10-06T03:24:49.832279+0000","last_clean":"2023-10-06T03:24:49.832279+0000","last_became_active":"2023-10-06T03:24:49.821784+0000","last_became_peered":"2023-10-06T03:24:49.821784+0000","last_unstale":"2023-10-06T03:24:49.832279+0000","last_undegraded":"2023-10-06T03:24:49.832279+0000","last_fullsized":"2023-10-06T03:24:49.832279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:21.178115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835977+0000","last_change":"2023-10-06T03:24:48.810340+0000","last_active":"2023-10-06T03:24:49.835977+0000","last_peered":"2023-10-06T03:24:49.835977+0000","last_clean":"2023-10-06T03:24:49.835977+0000","last_became_active":"2023-10-06T03:24:48.810047+0000","last_became_peered":"2023-10-06T03:24:48.810047+0000","last_unstale":"2023-10-06T03:24:49.835977+0000","last_undegraded":"2023-10-06T03:24:49.835977+0000","last_fullsized":"2023-10-06T03:24:49.835977+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:49.950377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827894+0000","last_change":"2023-10-06T03:24:49.816862+0000","last_active":"2023-10-06T03:24:49.827894+0000","last_peered":"2023-10-06T03:24:49.827894+0000","last_clean":"2023-10-06T03:24:49.827894+0000","last_became_active":"2023-10-06T03:24:49.816603+0000","last_became_peered":"2023-10-06T03:24:49.816603+0000","last_unstale":"2023-10-06T03:24:49.827894+0000","last_undegraded":"2023-10-06T03:24:49.827894+0000","last_fullsized":"2023-10-06T03:24:49.827894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833645+0000","last_change":"2023-10-06T03:24:48.806740+0000","last_active":"2023-10-06T03:24:49.833645+0000","last_peered":"2023-10-06T03:24:49.833645+0000","last_clean":"2023-10-06T03:24:49.833645+0000","last_became_active":"2023-10-06T03:24:48.806456+0000","last_became_peered":"2023-10-06T03:24:48.806456+0000","last_unstale":"2023-10-06T03:24:49.833645+0000","last_undegraded":"2023-10-06T03:24:49.833645+0000","last_fullsized":"2023-10-06T03:24:49.833645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:47.026999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824000+0000","last_change":"2023-10-06T03:24:49.818654+0000","last_active":"2023-10-06T03:24:49.824000+0000","last_peered":"2023-10-06T03:24:49.824000+0000","last_clean":"2023-10-06T03:24:49.824000+0000","last_became_active":"2023-10-06T03:24:49.818417+0000","last_became_peered":"2023-10-06T03:24:49.818417+0000","last_unstale":"2023-10-06T03:24:49.824000+0000","last_undegraded":"2023-10-06T03:24:49.824000+0000","last_fullsized":"2023-10-06T03:24:49.824000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:05.207479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835772+0000","last_change":"2023-10-06T03:24:48.805439+0000","last_active":"2023-10-06T03:24:49.835772+0000","last_peered":"2023-10-06T03:24:49.835772+0000","last_clean":"2023-10-06T03:24:49.835772+0000","last_became_active":"2023-10-06T03:24:48.805143+0000","last_became_peered":"2023-10-06T03:24:48.805143+0000","last_unstale":"2023-10-06T03:24:49.835772+0000","last_undegraded":"2023-10-06T03:24:49.835772+0000","last_fullsized":"2023-10-06T03:24:49.835772+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824221+0000","last_change":"2023-10-06T03:24:49.817595+0000","last_active":"2023-10-06T03:24:49.824221+0000","last_peered":"2023-10-06T03:24:49.824221+0000","last_clean":"2023-10-06T03:24:49.824221+0000","last_became_active":"2023-10-06T03:24:49.817341+0000","last_became_peered":"2023-10-06T03:24:49.817341+0000","last_unstale":"2023-10-06T03:24:49.824221+0000","last_undegraded":"2023-10-06T03:24:49.824221+0000","last_fullsized":"2023-10-06T03:24:49.824221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:56.995991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835862+0000","last_change":"2023-10-06T03:24:48.803540+0000","last_active":"2023-10-06T03:24:49.835862+0000","last_peered":"2023-10-06T03:24:49.835862+0000","last_clean":"2023-10-06T03:24:49.835862+0000","last_became_active":"2023-10-06T03:24:48.802661+0000","last_became_peered":"2023-10-06T03:24:48.802661+0000","last_unstale":"2023-10-06T03:24:49.835862+0000","last_undegraded":"2023-10-06T03:24:49.835862+0000","last_fullsized":"2023-10-06T03:24:49.835862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:20.530045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824440+0000","last_change":"2023-10-06T03:24:49.814413+0000","last_active":"2023-10-06T03:24:49.824440+0000","last_peered":"2023-10-06T03:24:49.824440+0000","last_clean":"2023-10-06T03:24:49.824440+0000","last_became_active":"2023-10-06T03:24:49.814154+0000","last_became_peered":"2023-10-06T03:24:49.814154+0000","last_unstale":"2023-10-06T03:24:49.824440+0000","last_undegraded":"2023-10-06T03:24:49.824440+0000","last_fullsized":"2023-10-06T03:24:49.824440+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:08.179862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833882+0000","last_change":"2023-10-06T03:24:48.804186+0000","last_active":"2023-10-06T03:24:49.833882+0000","last_peered":"2023-10-06T03:24:49.833882+0000","last_clean":"2023-10-06T03:24:49.833882+0000","last_became_active":"2023-10-06T03:24:48.803706+0000","last_became_peered":"2023-10-06T03:24:48.803706+0000","last_unstale":"2023-10-06T03:24:49.833882+0000","last_undegraded":"2023-10-06T03:24:49.833882+0000","last_fullsized":"2023-10-06T03:24:49.833882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:41.407843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.825932+0000","last_change":"2023-10-06T03:24:49.817790+0000","last_active":"2023-10-06T03:24:49.825932+0000","last_peered":"2023-10-06T03:24:49.825932+0000","last_clean":"2023-10-06T03:24:49.825932+0000","last_became_active":"2023-10-06T03:24:49.817135+0000","last_became_peered":"2023-10-06T03:24:49.817135+0000","last_unstale":"2023-10-06T03:24:49.825932+0000","last_undegraded":"2023-10-06T03:24:49.825932+0000","last_fullsized":"2023-10-06T03:24:49.825932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:55.132669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.808388+0000","last_change":"2023-10-06T03:24:48.809322+0000","last_active":"2023-10-06T03:24:49.808388+0000","last_peered":"2023-10-06T03:24:49.808388+0000","last_clean":"2023-10-06T03:24:49.808388+0000","last_became_active":"2023-10-06T03:24:48.809018+0000","last_became_peered":"2023-10-06T03:24:48.809018+0000","last_unstale":"2023-10-06T03:24:49.808388+0000","last_undegraded":"2023-10-06T03:24:49.808388+0000","last_fullsized":"2023-10-06T03:24:49.808388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824545+0000","last_change":"2023-10-06T03:24:49.818817+0000","last_active":"2023-10-06T03:24:49.824545+0000","last_peered":"2023-10-06T03:24:49.824545+0000","last_clean":"2023-10-06T03:24:49.824545+0000","last_became_active":"2023-10-06T03:24:49.818484+0000","last_became_peered":"2023-10-06T03:24:49.818484+0000","last_unstale":"2023-10-06T03:24:49.824545+0000","last_undegraded":"2023-10-06T03:24:49.824545+0000","last_fullsized":"2023-10-06T03:24:49.824545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:48.033798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.804689+0000","last_change":"2023-10-06T03:24:48.808266+0000","last_active":"2023-10-06T03:24:49.804689+0000","last_peered":"2023-10-06T03:24:49.804689+0000","last_clean":"2023-10-06T03:24:49.804689+0000","last_became_active":"2023-10-06T03:24:48.808019+0000","last_became_peered":"2023-10-06T03:24:48.808019+0000","last_unstale":"2023-10-06T03:24:49.804689+0000","last_undegraded":"2023-10-06T03:24:49.804689+0000","last_fullsized":"2023-10-06T03:24:49.804689+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827918+0000","last_change":"2023-10-06T03:24:49.826156+0000","last_active":"2023-10-06T03:24:49.827918+0000","last_peered":"2023-10-06T03:24:49.827918+0000","last_clean":"2023-10-06T03:24:49.827918+0000","last_became_active":"2023-10-06T03:24:49.825639+0000","last_became_peered":"2023-10-06T03:24:49.825639+0000","last_unstale":"2023-10-06T03:24:49.827918+0000","last_undegraded":"2023-10-06T03:24:49.827918+0000","last_fullsized":"2023-10-06T03:24:49.827918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:52.254985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812940+0000","last_change":"2023-10-06T03:24:48.800912+0000","last_active":"2023-10-06T03:24:49.812940+0000","last_peered":"2023-10-06T03:24:49.812940+0000","last_clean":"2023-10-06T03:24:49.812940+0000","last_became_active":"2023-10-06T03:24:48.800595+0000","last_became_peered":"2023-10-06T03:24:48.800595+0000","last_unstale":"2023-10-06T03:24:49.812940+0000","last_undegraded":"2023-10-06T03:24:49.812940+0000","last_fullsized":"2023-10-06T03:24:49.812940+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:56.091547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827169+0000","last_change":"2023-10-06T03:24:49.823044+0000","last_active":"2023-10-06T03:24:49.827169+0000","last_peered":"2023-10-06T03:24:49.827169+0000","last_clean":"2023-10-06T03:24:49.827169+0000","last_became_active":"2023-10-06T03:24:49.822784+0000","last_became_peered":"2023-10-06T03:24:49.822784+0000","last_unstale":"2023-10-06T03:24:49.827169+0000","last_undegraded":"2023-10-06T03:24:49.827169+0000","last_fullsized":"2023-10-06T03:24:49.827169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:03.473599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.807107+0000","last_change":"2023-10-06T03:24:48.803402+0000","last_active":"2023-10-06T03:24:49.807107+0000","last_peered":"2023-10-06T03:24:49.807107+0000","last_clean":"2023-10-06T03:24:49.807107+0000","last_became_active":"2023-10-06T03:24:48.803148+0000","last_became_peered":"2023-10-06T03:24:48.803148+0000","last_unstale":"2023-10-06T03:24:49.807107+0000","last_undegraded":"2023-10-06T03:24:49.807107+0000","last_fullsized":"2023-10-06T03:24:49.807107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:58.089716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.816821+0000","last_change":"2023-10-06T03:24:49.811159+0000","last_active":"2023-10-06T03:24:49.816821+0000","last_peered":"2023-10-06T03:24:49.816821+0000","last_clean":"2023-10-06T03:24:49.816821+0000","last_became_active":"2023-10-06T03:24:49.810918+0000","last_became_peered":"2023-10-06T03:24:49.810918+0000","last_unstale":"2023-10-06T03:24:49.816821+0000","last_undegraded":"2023-10-06T03:24:49.816821+0000","last_fullsized":"2023-10-06T03:24:49.816821+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:24.602629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836475+0000","last_change":"2023-10-06T03:24:48.809455+0000","last_active":"2023-10-06T03:24:49.836475+0000","last_peered":"2023-10-06T03:24:49.836475+0000","last_clean":"2023-10-06T03:24:49.836475+0000","last_became_active":"2023-10-06T03:24:48.809202+0000","last_became_peered":"2023-10-06T03:24:48.809202+0000","last_unstale":"2023-10-06T03:24:49.836475+0000","last_undegraded":"2023-10-06T03:24:49.836475+0000","last_fullsized":"2023-10-06T03:24:49.836475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:02.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824323+0000","last_change":"2023-10-06T03:24:49.818062+0000","last_active":"2023-10-06T03:24:49.824323+0000","last_peered":"2023-10-06T03:24:49.824323+0000","last_clean":"2023-10-06T03:24:49.824323+0000","last_became_active":"2023-10-06T03:24:49.817792+0000","last_became_peered":"2023-10-06T03:24:49.817792+0000","last_unstale":"2023-10-06T03:24:49.824323+0000","last_undegraded":"2023-10-06T03:24:49.824323+0000","last_fullsized":"2023-10-06T03:24:49.824323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:50.957176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.837509+0000","last_change":"2023-10-06T03:24:48.796352+0000","last_active":"2023-10-06T03:24:49.837509+0000","last_peered":"2023-10-06T03:24:49.837509+0000","last_clean":"2023-10-06T03:24:49.837509+0000","last_became_active":"2023-10-06T03:24:48.796076+0000","last_became_peered":"2023-10-06T03:24:48.796076+0000","last_unstale":"2023-10-06T03:24:49.837509+0000","last_undegraded":"2023-10-06T03:24:49.837509+0000","last_fullsized":"2023-10-06T03:24:49.837509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:22.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833097+0000","last_change":"2023-10-06T03:24:49.825550+0000","last_active":"2023-10-06T03:24:49.833097+0000","last_peered":"2023-10-06T03:24:49.833097+0000","last_clean":"2023-10-06T03:24:49.833097+0000","last_became_active":"2023-10-06T03:24:49.825258+0000","last_became_peered":"2023-10-06T03:24:49.825258+0000","last_unstale":"2023-10-06T03:24:49.833097+0000","last_undegraded":"2023-10-06T03:24:49.833097+0000","last_fullsized":"2023-10-06T03:24:49.833097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:38.167564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835466+0000","last_change":"2023-10-06T03:24:48.807313+0000","last_active":"2023-10-06T03:24:49.835466+0000","last_peered":"2023-10-06T03:24:49.835466+0000","last_clean":"2023-10-06T03:24:49.835466+0000","last_became_active":"2023-10-06T03:24:48.807050+0000","last_became_peered":"2023-10-06T03:24:48.807050+0000","last_unstale":"2023-10-06T03:24:49.835466+0000","last_undegraded":"2023-10-06T03:24:49.835466+0000","last_fullsized":"2023-10-06T03:24:49.835466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:49.914899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824641+0000","last_change":"2023-10-06T03:24:49.815735+0000","last_active":"2023-10-06T03:24:49.824641+0000","last_peered":"2023-10-06T03:24:49.824641+0000","last_clean":"2023-10-06T03:24:49.824641+0000","last_became_active":"2023-10-06T03:24:49.815461+0000","last_became_peered":"2023-10-06T03:24:49.815461+0000","last_unstale":"2023-10-06T03:24:49.824641+0000","last_undegraded":"2023-10-06T03:24:49.824641+0000","last_fullsized":"2023-10-06T03:24:49.824641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:35.540004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810931+0000","last_change":"2023-10-06T03:24:48.804776+0000","last_active":"2023-10-06T03:24:49.810931+0000","last_peered":"2023-10-06T03:24:49.810931+0000","last_clean":"2023-10-06T03:24:49.810931+0000","last_became_active":"2023-10-06T03:24:48.804506+0000","last_became_peered":"2023-10-06T03:24:48.804506+0000","last_unstale":"2023-10-06T03:24:49.810931+0000","last_undegraded":"2023-10-06T03:24:49.810931+0000","last_fullsized":"2023-10-06T03:24:49.810931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:46.243326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.816422+0000","last_change":"2023-10-06T03:24:49.811189+0000","last_active":"2023-10-06T03:24:49.816422+0000","last_peered":"2023-10-06T03:24:49.816422+0000","last_clean":"2023-10-06T03:24:49.816422+0000","last_became_active":"2023-10-06T03:24:49.810972+0000","last_became_peered":"2023-10-06T03:24:49.810972+0000","last_unstale":"2023-10-06T03:24:49.816422+0000","last_undegraded":"2023-10-06T03:24:49.816422+0000","last_fullsized":"2023-10-06T03:24:49.816422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:50.360845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.807087+0000","last_change":"2023-10-06T03:24:48.807022+0000","last_active":"2023-10-06T03:24:49.807087+0000","last_peered":"2023-10-06T03:24:49.807087+0000","last_clean":"2023-10-06T03:24:49.807087+0000","last_became_active":"2023-10-06T03:24:48.806684+0000","last_became_peered":"2023-10-06T03:24:48.806684+0000","last_unstale":"2023-10-06T03:24:49.807087+0000","last_undegraded":"2023-10-06T03:24:49.807087+0000","last_fullsized":"2023-10-06T03:24:49.807087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:56.091547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824599+0000","last_change":"2023-10-06T03:24:49.818605+0000","last_active":"2023-10-06T03:24:49.824599+0000","last_peered":"2023-10-06T03:24:49.824599+0000","last_clean":"2023-10-06T03:24:49.824599+0000","last_became_active":"2023-10-06T03:24:49.818270+0000","last_became_peered":"2023-10-06T03:24:49.818270+0000","last_unstale":"2023-10-06T03:24:49.824599+0000","last_undegraded":"2023-10-06T03:24:49.824599+0000","last_fullsized":"2023-10-06T03:24:49.824599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834407+0000","last_change":"2023-10-06T03:24:48.804584+0000","last_active":"2023-10-06T03:24:49.834407+0000","last_peered":"2023-10-06T03:24:49.834407+0000","last_clean":"2023-10-06T03:24:49.834407+0000","last_became_active":"2023-10-06T03:24:48.804337+0000","last_became_peered":"2023-10-06T03:24:48.804337+0000","last_unstale":"2023-10-06T03:24:49.834407+0000","last_undegraded":"2023-10-06T03:24:49.834407+0000","last_fullsized":"2023-10-06T03:24:49.834407+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.821360+0000","last_change":"2023-10-06T03:24:49.815067+0000","last_active":"2023-10-06T03:24:49.821360+0000","last_peered":"2023-10-06T03:24:49.821360+0000","last_clean":"2023-10-06T03:24:49.821360+0000","last_became_active":"2023-10-06T03:24:49.814854+0000","last_became_peered":"2023-10-06T03:24:49.814854+0000","last_unstale":"2023-10-06T03:24:49.821360+0000","last_undegraded":"2023-10-06T03:24:49.821360+0000","last_fullsized":"2023-10-06T03:24:49.821360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.678893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834912+0000","last_change":"2023-10-06T03:24:48.803799+0000","last_active":"2023-10-06T03:24:49.834912+0000","last_peered":"2023-10-06T03:24:49.834912+0000","last_clean":"2023-10-06T03:24:49.834912+0000","last_became_active":"2023-10-06T03:24:48.803302+0000","last_became_peered":"2023-10-06T03:24:48.803302+0000","last_unstale":"2023-10-06T03:24:49.834912+0000","last_undegraded":"2023-10-06T03:24:49.834912+0000","last_fullsized":"2023-10-06T03:24:49.834912+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:29.960671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824184+0000","last_change":"2023-10-06T03:24:49.811332+0000","last_active":"2023-10-06T03:24:49.824184+0000","last_peered":"2023-10-06T03:24:49.824184+0000","last_clean":"2023-10-06T03:24:49.824184+0000","last_became_active":"2023-10-06T03:24:49.811057+0000","last_became_peered":"2023-10-06T03:24:49.811057+0000","last_unstale":"2023-10-06T03:24:49.824184+0000","last_undegraded":"2023-10-06T03:24:49.824184+0000","last_fullsized":"2023-10-06T03:24:49.824184+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:27.416317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833453+0000","last_change":"2023-10-06T03:24:48.808134+0000","last_active":"2023-10-06T03:24:49.833453+0000","last_peered":"2023-10-06T03:24:49.833453+0000","last_clean":"2023-10-06T03:24:49.833453+0000","last_became_active":"2023-10-06T03:24:48.807838+0000","last_became_peered":"2023-10-06T03:24:48.807838+0000","last_unstale":"2023-10-06T03:24:49.833453+0000","last_undegraded":"2023-10-06T03:24:49.833453+0000","last_fullsized":"2023-10-06T03:24:49.833453+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:02.466800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.829591+0000","last_change":"2023-10-06T03:24:49.821689+0000","last_active":"2023-10-06T03:24:49.829591+0000","last_peered":"2023-10-06T03:24:49.829591+0000","last_clean":"2023-10-06T03:24:49.829591+0000","last_became_active":"2023-10-06T03:24:49.821368+0000","last_became_peered":"2023-10-06T03:24:49.821368+0000","last_unstale":"2023-10-06T03:24:49.829591+0000","last_undegraded":"2023-10-06T03:24:49.829591+0000","last_fullsized":"2023-10-06T03:24:49.829591+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:03.605593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.836098+0000","last_change":"2023-10-06T03:24:48.810309+0000","last_active":"2023-10-06T03:24:49.836098+0000","last_peered":"2023-10-06T03:24:49.836098+0000","last_clean":"2023-10-06T03:24:49.836098+0000","last_became_active":"2023-10-06T03:24:48.809835+0000","last_became_peered":"2023-10-06T03:24:48.809835+0000","last_unstale":"2023-10-06T03:24:49.836098+0000","last_undegraded":"2023-10-06T03:24:49.836098+0000","last_fullsized":"2023-10-06T03:24:49.836098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.829832+0000","last_change":"2023-10-06T03:24:49.822763+0000","last_active":"2023-10-06T03:24:49.829832+0000","last_peered":"2023-10-06T03:24:49.829832+0000","last_clean":"2023-10-06T03:24:49.829832+0000","last_became_active":"2023-10-06T03:24:49.822496+0000","last_became_peered":"2023-10-06T03:24:49.822496+0000","last_unstale":"2023-10-06T03:24:49.829832+0000","last_undegraded":"2023-10-06T03:24:49.829832+0000","last_fullsized":"2023-10-06T03:24:49.829832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:59.096514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.804864+0000","last_change":"2023-10-06T03:24:48.808985+0000","last_active":"2023-10-06T03:24:49.804864+0000","last_peered":"2023-10-06T03:24:49.804864+0000","last_clean":"2023-10-06T03:24:49.804864+0000","last_became_active":"2023-10-06T03:24:48.808690+0000","last_became_peered":"2023-10-06T03:24:48.808690+0000","last_unstale":"2023-10-06T03:24:49.804864+0000","last_undegraded":"2023-10-06T03:24:49.804864+0000","last_fullsized":"2023-10-06T03:24:49.804864+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:02.125182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.816790+0000","last_change":"2023-10-06T03:24:49.812643+0000","last_active":"2023-10-06T03:24:49.816790+0000","last_peered":"2023-10-06T03:24:49.816790+0000","last_clean":"2023-10-06T03:24:49.816790+0000","last_became_active":"2023-10-06T03:24:49.812384+0000","last_became_peered":"2023-10-06T03:24:49.812384+0000","last_unstale":"2023-10-06T03:24:49.816790+0000","last_undegraded":"2023-10-06T03:24:49.816790+0000","last_fullsized":"2023-10-06T03:24:49.816790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:52.254985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.835941+0000","last_change":"2023-10-06T03:24:48.807439+0000","last_active":"2023-10-06T03:24:49.835941+0000","last_peered":"2023-10-06T03:24:49.835941+0000","last_clean":"2023-10-06T03:24:49.835941+0000","last_became_active":"2023-10-06T03:24:48.807169+0000","last_became_peered":"2023-10-06T03:24:48.807169+0000","last_unstale":"2023-10-06T03:24:49.835941+0000","last_undegraded":"2023-10-06T03:24:49.835941+0000","last_fullsized":"2023-10-06T03:24:49.835941+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:44.317412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.831359+0000","last_change":"2023-10-06T03:24:49.827821+0000","last_active":"2023-10-06T03:24:49.831359+0000","last_peered":"2023-10-06T03:24:49.831359+0000","last_clean":"2023-10-06T03:24:49.831359+0000","last_became_active":"2023-10-06T03:24:49.827574+0000","last_became_peered":"2023-10-06T03:24:49.827574+0000","last_unstale":"2023-10-06T03:24:49.831359+0000","last_undegraded":"2023-10-06T03:24:49.831359+0000","last_fullsized":"2023-10-06T03:24:49.831359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:47.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.807618+0000","last_change":"2023-10-06T03:24:48.809255+0000","last_active":"2023-10-06T03:24:49.807618+0000","last_peered":"2023-10-06T03:24:49.807618+0000","last_clean":"2023-10-06T03:24:49.807618+0000","last_became_active":"2023-10-06T03:24:48.808968+0000","last_became_peered":"2023-10-06T03:24:48.808968+0000","last_unstale":"2023-10-06T03:24:49.807618+0000","last_undegraded":"2023-10-06T03:24:49.807618+0000","last_fullsized":"2023-10-06T03:24:49.807618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:49.672094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824339+0000","last_change":"2023-10-06T03:24:49.816246+0000","last_active":"2023-10-06T03:24:49.824339+0000","last_peered":"2023-10-06T03:24:49.824339+0000","last_clean":"2023-10-06T03:24:49.824339+0000","last_became_active":"2023-10-06T03:24:49.816004+0000","last_became_peered":"2023-10-06T03:24:49.816004+0000","last_unstale":"2023-10-06T03:24:49.824339+0000","last_undegraded":"2023-10-06T03:24:49.824339+0000","last_fullsized":"2023-10-06T03:24:49.824339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:34.682483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.805935+0000","last_change":"2023-10-06T03:24:48.805052+0000","last_active":"2023-10-06T03:24:49.805935+0000","last_peered":"2023-10-06T03:24:49.805935+0000","last_clean":"2023-10-06T03:24:49.805935+0000","last_became_active":"2023-10-06T03:24:48.804765+0000","last_became_peered":"2023-10-06T03:24:48.804765+0000","last_unstale":"2023-10-06T03:24:49.805935+0000","last_undegraded":"2023-10-06T03:24:49.805935+0000","last_fullsized":"2023-10-06T03:24:49.805935+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:02.598795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824984+0000","last_change":"2023-10-06T03:24:49.817616+0000","last_active":"2023-10-06T03:24:49.824984+0000","last_peered":"2023-10-06T03:24:49.824984+0000","last_clean":"2023-10-06T03:24:49.824984+0000","last_became_active":"2023-10-06T03:24:49.817439+0000","last_became_peered":"2023-10-06T03:24:49.817439+0000","last_unstale":"2023-10-06T03:24:49.824984+0000","last_undegraded":"2023-10-06T03:24:49.824984+0000","last_fullsized":"2023-10-06T03:24:49.824984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:16.340244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810056+0000","last_change":"2023-10-06T03:24:48.804171+0000","last_active":"2023-10-06T03:24:49.810056+0000","last_peered":"2023-10-06T03:24:49.810056+0000","last_clean":"2023-10-06T03:24:49.810056+0000","last_became_active":"2023-10-06T03:24:48.803906+0000","last_became_peered":"2023-10-06T03:24:48.803906+0000","last_unstale":"2023-10-06T03:24:49.810056+0000","last_undegraded":"2023-10-06T03:24:49.810056+0000","last_fullsized":"2023-10-06T03:24:49.810056+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.816527+0000","last_change":"2023-10-06T03:24:49.811632+0000","last_active":"2023-10-06T03:24:49.816527+0000","last_peered":"2023-10-06T03:24:49.816527+0000","last_clean":"2023-10-06T03:24:49.816527+0000","last_became_active":"2023-10-06T03:24:49.811398+0000","last_became_peered":"2023-10-06T03:24:49.811398+0000","last_unstale":"2023-10-06T03:24:49.816527+0000","last_undegraded":"2023-10-06T03:24:49.816527+0000","last_fullsized":"2023-10-06T03:24:49.816527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:35.429205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812640+0000","last_change":"2023-10-06T03:24:48.801628+0000","last_active":"2023-10-06T03:24:49.812640+0000","last_peered":"2023-10-06T03:24:49.812640+0000","last_clean":"2023-10-06T03:24:49.812640+0000","last_became_active":"2023-10-06T03:24:48.801318+0000","last_became_peered":"2023-10-06T03:24:48.801318+0000","last_unstale":"2023-10-06T03:24:49.812640+0000","last_undegraded":"2023-10-06T03:24:49.812640+0000","last_fullsized":"2023-10-06T03:24:49.812640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:49.914899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812513+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:24:49.812513+0000","last_peered":"2023-10-06T03:24:49.812513+0000","last_clean":"2023-10-06T03:24:49.812513+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:24:49.812513+0000","last_undegraded":"2023-10-06T03:24:49.812513+0000","last_fullsized":"2023-10-06T03:24:49.812513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.823636+0000","last_change":"2023-10-06T03:24:49.816707+0000","last_active":"2023-10-06T03:24:49.823636+0000","last_peered":"2023-10-06T03:24:49.823636+0000","last_clean":"2023-10-06T03:24:49.823636+0000","last_became_active":"2023-10-06T03:24:49.816479+0000","last_became_peered":"2023-10-06T03:24:49.816479+0000","last_unstale":"2023-10-06T03:24:49.823636+0000","last_undegraded":"2023-10-06T03:24:49.823636+0000","last_fullsized":"2023-10-06T03:24:49.823636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:49.531455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.811849+0000","last_change":"2023-10-06T03:24:48.809341+0000","last_active":"2023-10-06T03:24:49.811849+0000","last_peered":"2023-10-06T03:24:49.811849+0000","last_clean":"2023-10-06T03:24:49.811849+0000","last_became_active":"2023-10-06T03:24:48.809095+0000","last_became_peered":"2023-10-06T03:24:48.809095+0000","last_unstale":"2023-10-06T03:24:49.811849+0000","last_undegraded":"2023-10-06T03:24:49.811849+0000","last_fullsized":"2023-10-06T03:24:49.811849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.804931+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:24:49.804931+0000","last_peered":"2023-10-06T03:24:49.804931+0000","last_clean":"2023-10-06T03:24:49.804931+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:24:49.804931+0000","last_undegraded":"2023-10-06T03:24:49.804931+0000","last_fullsized":"2023-10-06T03:24:49.804931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.827049+0000","last_change":"2023-10-06T03:24:49.822079+0000","last_active":"2023-10-06T03:24:49.827049+0000","last_peered":"2023-10-06T03:24:49.827049+0000","last_clean":"2023-10-06T03:24:49.827049+0000","last_became_active":"2023-10-06T03:24:49.821820+0000","last_became_peered":"2023-10-06T03:24:49.821820+0000","last_unstale":"2023-10-06T03:24:49.827049+0000","last_undegraded":"2023-10-06T03:24:49.827049+0000","last_fullsized":"2023-10-06T03:24:49.827049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:42.414642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812317+0000","last_change":"2023-10-06T03:24:48.805388+0000","last_active":"2023-10-06T03:24:49.812317+0000","last_peered":"2023-10-06T03:24:49.812317+0000","last_clean":"2023-10-06T03:24:49.812317+0000","last_became_active":"2023-10-06T03:24:48.805136+0000","last_became_peered":"2023-10-06T03:24:48.805136+0000","last_unstale":"2023-10-06T03:24:49.812317+0000","last_undegraded":"2023-10-06T03:24:49.812317+0000","last_fullsized":"2023-10-06T03:24:49.812317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:09.893072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812416+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:24:49.812416+0000","last_peered":"2023-10-06T03:24:49.812416+0000","last_clean":"2023-10-06T03:24:49.812416+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:24:49.812416+0000","last_undegraded":"2023-10-06T03:24:49.812416+0000","last_fullsized":"2023-10-06T03:24:49.812416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810235+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:24:49.810235+0000","last_peered":"2023-10-06T03:24:49.810235+0000","last_clean":"2023-10-06T03:24:49.810235+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:24:49.810235+0000","last_undegraded":"2023-10-06T03:24:49.810235+0000","last_fullsized":"2023-10-06T03:24:49.810235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824956+0000","last_change":"2023-10-06T03:24:49.817449+0000","last_active":"2023-10-06T03:24:49.824956+0000","last_peered":"2023-10-06T03:24:49.824956+0000","last_clean":"2023-10-06T03:24:49.824956+0000","last_became_active":"2023-10-06T03:24:49.817203+0000","last_became_peered":"2023-10-06T03:24:49.817203+0000","last_unstale":"2023-10-06T03:24:49.824956+0000","last_undegraded":"2023-10-06T03:24:49.824956+0000","last_fullsized":"2023-10-06T03:24:49.824956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:57.868100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810543+0000","last_change":"2023-10-06T03:24:48.808937+0000","last_active":"2023-10-06T03:24:49.810543+0000","last_peered":"2023-10-06T03:24:49.810543+0000","last_clean":"2023-10-06T03:24:49.810543+0000","last_became_active":"2023-10-06T03:24:48.808657+0000","last_became_peered":"2023-10-06T03:24:48.808657+0000","last_unstale":"2023-10-06T03:24:49.810543+0000","last_undegraded":"2023-10-06T03:24:49.810543+0000","last_fullsized":"2023-10-06T03:24:49.810543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.811011+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:24:49.811011+0000","last_peered":"2023-10-06T03:24:49.811011+0000","last_clean":"2023-10-06T03:24:49.811011+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:24:49.811011+0000","last_undegraded":"2023-10-06T03:24:49.811011+0000","last_fullsized":"2023-10-06T03:24:49.811011+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824553+0000","last_change":"2023-10-06T03:24:49.815716+0000","last_active":"2023-10-06T03:24:49.824553+0000","last_peered":"2023-10-06T03:24:49.824553+0000","last_clean":"2023-10-06T03:24:49.824553+0000","last_became_active":"2023-10-06T03:24:49.815456+0000","last_became_peered":"2023-10-06T03:24:49.815456+0000","last_unstale":"2023-10-06T03:24:49.824553+0000","last_undegraded":"2023-10-06T03:24:49.824553+0000","last_fullsized":"2023-10-06T03:24:49.824553+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:49.531455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.834982+0000","last_change":"2023-10-06T03:24:48.806288+0000","last_active":"2023-10-06T03:24:49.834982+0000","last_peered":"2023-10-06T03:24:49.834982+0000","last_clean":"2023-10-06T03:24:49.834982+0000","last_became_active":"2023-10-06T03:24:48.806067+0000","last_became_peered":"2023-10-06T03:24:48.806067+0000","last_unstale":"2023-10-06T03:24:49.834982+0000","last_undegraded":"2023-10-06T03:24:49.834982+0000","last_fullsized":"2023-10-06T03:24:49.834982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.810142+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:24:49.810142+0000","last_peered":"2023-10-06T03:24:49.810142+0000","last_clean":"2023-10-06T03:24:49.810142+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:24:49.810142+0000","last_undegraded":"2023-10-06T03:24:49.810142+0000","last_fullsized":"2023-10-06T03:24:49.810142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.833124+0000","last_change":"2023-10-06T03:24:49.825686+0000","last_active":"2023-10-06T03:24:49.833124+0000","last_peered":"2023-10-06T03:24:49.833124+0000","last_clean":"2023-10-06T03:24:49.833124+0000","last_became_active":"2023-10-06T03:24:49.825421+0000","last_became_peered":"2023-10-06T03:24:49.825421+0000","last_unstale":"2023-10-06T03:24:49.833124+0000","last_undegraded":"2023-10-06T03:24:49.833124+0000","last_fullsized":"2023-10-06T03:24:49.833124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:03.162349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.806027+0000","last_change":"2023-10-06T03:24:48.802162+0000","last_active":"2023-10-06T03:24:49.806027+0000","last_peered":"2023-10-06T03:24:49.806027+0000","last_clean":"2023-10-06T03:24:49.806027+0000","last_became_active":"2023-10-06T03:24:48.801890+0000","last_became_peered":"2023-10-06T03:24:48.801890+0000","last_unstale":"2023-10-06T03:24:49.806027+0000","last_undegraded":"2023-10-06T03:24:49.806027+0000","last_fullsized":"2023-10-06T03:24:49.806027+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:20.171317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.808489+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:24:49.808489+0000","last_peered":"2023-10-06T03:24:49.808489+0000","last_clean":"2023-10-06T03:24:49.808489+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:24:49.808489+0000","last_undegraded":"2023-10-06T03:24:49.808489+0000","last_fullsized":"2023-10-06T03:24:49.808489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.828176+0000","last_change":"2023-10-06T03:24:49.818136+0000","last_active":"2023-10-06T03:24:49.828176+0000","last_peered":"2023-10-06T03:24:49.828176+0000","last_clean":"2023-10-06T03:24:49.828176+0000","last_became_active":"2023-10-06T03:24:49.817838+0000","last_became_peered":"2023-10-06T03:24:49.817838+0000","last_unstale":"2023-10-06T03:24:49.828176+0000","last_undegraded":"2023-10-06T03:24:49.828176+0000","last_fullsized":"2023-10-06T03:24:49.828176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:03.131980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.812143+0000","last_change":"2023-10-06T03:24:48.811843+0000","last_active":"2023-10-06T03:24:49.812143+0000","last_peered":"2023-10-06T03:24:49.812143+0000","last_clean":"2023-10-06T03:24:49.812143+0000","last_became_active":"2023-10-06T03:24:48.811661+0000","last_became_peered":"2023-10-06T03:24:48.811661+0000","last_unstale":"2023-10-06T03:24:49.812143+0000","last_undegraded":"2023-10-06T03:24:49.812143+0000","last_fullsized":"2023-10-06T03:24:49.812143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:51.862931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.815959+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:24:49.815959+0000","last_peered":"2023-10-06T03:24:49.815959+0000","last_clean":"2023-10-06T03:24:49.815959+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:24:49.815959+0000","last_undegraded":"2023-10-06T03:24:49.815959+0000","last_fullsized":"2023-10-06T03:24:49.815959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.824225+0000","last_change":"2023-10-06T03:24:49.820217+0000","last_active":"2023-10-06T03:24:49.824225+0000","last_peered":"2023-10-06T03:24:49.824225+0000","last_clean":"2023-10-06T03:24:49.824225+0000","last_became_active":"2023-10-06T03:24:49.819940+0000","last_became_peered":"2023-10-06T03:24:49.819940+0000","last_unstale":"2023-10-06T03:24:49.824225+0000","last_undegraded":"2023-10-06T03:24:49.824225+0000","last_fullsized":"2023-10-06T03:24:49.824225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:48.784733+0000","last_clean_scrub_stamp":"2023-10-06T03:24:48.784733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:33.894597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.806698+0000","last_change":"2023-10-06T03:24:48.805748+0000","last_active":"2023-10-06T03:24:49.806698+0000","last_peered":"2023-10-06T03:24:49.806698+0000","last_clean":"2023-10-06T03:24:49.806698+0000","last_became_active":"2023-10-06T03:24:48.805532+0000","last_became_peered":"2023-10-06T03:24:48.805532+0000","last_unstale":"2023-10-06T03:24:49.806698+0000","last_undegraded":"2023-10-06T03:24:49.806698+0000","last_fullsized":"2023-10-06T03:24:49.806698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:47.777934+0000","last_clean_scrub_stamp":"2023-10-06T03:24:47.777934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:39.325432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:49.815921+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:24:49.815921+0000","last_peered":"2023-10-06T03:24:49.815921+0000","last_clean":"2023-10-06T03:24:49.815921+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:24:49.815921+0000","last_undegraded":"2023-10-06T03:24:49.815921+0000","last_fullsized":"2023-10-06T03:24:49.815921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":786386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52200000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.627},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":446464,"data_stored":196572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.64100000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":6.3680000000000003,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.5039999999999996,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.4740000000000002,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":6.4359999999999999,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.625},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":786366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.375}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.31}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":194609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":12.19,"5min":12.19,"15min":12.19},"last":0.435},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":8.3900000000000006,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.318}]},{"osd":2,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.38300000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.948,"5min":16.948,"15min":16.948},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.497},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":16.881,"5min":16.881,"15min":16.881},"last":0.56100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":197486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.308}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":196538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.20699999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.28199999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.625},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.752}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.72299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.758,"5min":4.758,"15min":4.758},"last":0.505},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":9.7690000000000001,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.379},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.624}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":195998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:58.709 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:24:58.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:24:58.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.862+0000 7f7b58d67700 1 Processor -- start 2023-10-06T03:24:58.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.862+0000 7f7b58d67700 1 -- start start 2023-10-06T03:24:58.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.862+0000 7f7b58d67700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b540cd980 0x7f7b54159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.862+0000 7f7b58d67700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b540b4eb0 0x7f7b54163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b58d67700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b540b5f30 con 0x7f7b540b4a60 2023-10-06T03:24:58.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b58d67700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b540b3640 con 0x7f7b540cd980 2023-10-06T03:24:58.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b58d67700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540b63c0 con 0x7f7b540b4eb0 2023-10-06T03:24:58.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b5259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b540cd980 0x7f7b54159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b49d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7b540b4a60 0x7f7b540d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50266/0 (socket says 172.21.15.84:50266) 2023-10-06T03:24:58.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b49d9b700 1 -- 172.21.15.84:0/587626459 learned_addr learned my addr 172.21.15.84:0/587626459 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b5259c700 1 --2- 172.21.15.84:0/587626459 >> v2:172.21.15.84:3300/0 conn(0x7f7b540cd980 0x7f7b54159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57528/0 (socket says 172.21.15.84:57528) 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b52d9d700 1 --2- 172.21.15.84:0/587626459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b540b4eb0 0x7f7b54163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b5259c700 1 -- 172.21.15.84:0/587626459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b540b4eb0 msgr2=0x7f7b54163240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b5259c700 1 --2- 172.21.15.84:0/587626459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b540b4eb0 0x7f7b54163240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b5259c700 1 -- 172.21.15.84:0/587626459 >> v1:172.21.15.84:6789/0 conn(0x7f7b540b4a60 legacy=0x7f7b540d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b51d9b700 1 -- 172.21.15.84:0/587626459 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535928668 0 0) 0x7f7b540b5f30 con 0x7f7b540b4a60 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b5259c700 1 -- 172.21.15.84:0/587626459 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b540b5320 con 0x7f7b540cd980 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b5259c700 1 --2- 172.21.15.84:0/587626459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 0x7f7b54159c10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7b440098e0 tx=0x7f7b440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ffd237e687ce84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b51d9b700 1 -- 172.21.15.84:0/587626459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44009e80 con 0x7f7b540cd980 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b51d9b700 1 -- 172.21.15.84:0/587626459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4400b860 con 0x7f7b540cd980 2023-10-06T03:24:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.863+0000 7f7b51d9b700 1 -- 172.21.15.84:0/587626459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400bbe0 con 0x7f7b540cd980 2023-10-06T03:24:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.864+0000 7f7b58d67700 1 -- 172.21.15.84:0/587626459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 msgr2=0x7f7b54159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.864+0000 7f7b58d67700 1 --2- 172.21.15.84:0/587626459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 0x7f7b54159c10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7b440098e0 tx=0x7f7b440091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.864+0000 7f7b58d67700 1 -- 172.21.15.84:0/587626459 shutdown_connections 2023-10-06T03:24:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.864+0000 7f7b58d67700 1 --2- 172.21.15.84:0/587626459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b540b4eb0 0x7f7b54163240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.864+0000 7f7b58d67700 1 --2- 172.21.15.84:0/587626459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 0x7f7b54159c10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.864+0000 7f7b58d67700 1 -- 172.21.15.84:0/587626459 >> 172.21.15.84:0/587626459 conn(0x7f7b5406ed20 msgr2=0x7f7b5406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.864+0000 7f7b58d67700 1 -- 172.21.15.84:0/587626459 shutdown_connections 2023-10-06T03:24:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.864+0000 7f7b58d67700 1 -- 172.21.15.84:0/587626459 wait complete. 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.865+0000 7f7b58d67700 1 Processor -- start 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.865+0000 7f7b58d67700 1 -- start start 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b58d67700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b540b4a60 0x7f7b5416a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b58d67700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b540b4eb0 0x7f7b540cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b58d67700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 0x7f7b541559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b58d67700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5416dc10 con 0x7f7b540cd980 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b58d67700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540d0270 con 0x7f7b540b4eb0 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b58d67700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5416d320 con 0x7f7b540b4a60 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b52d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 0x7f7b541559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b52d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 0x7f7b541559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57544/0 (socket says 172.21.15.84:57544) 2023-10-06T03:24:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b52d9d700 1 -- 172.21.15.84:0/2324809072 learned_addr learned my addr 172.21.15.84:0/2324809072 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b5259c700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b540b4a60 0x7f7b5416a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b49d9b700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b540b4eb0 0x7f7b540cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b52d9d700 1 -- 172.21.15.84:0/2324809072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b540b4a60 msgr2=0x7f7b5416a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b52d9d700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b540b4a60 0x7f7b5416a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b52d9d700 1 -- 172.21.15.84:0/2324809072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b540b4eb0 msgr2=0x7f7b540cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b52d9d700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b540b4eb0 0x7f7b540cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b52d9d700 1 -- 172.21.15.84:0/2324809072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44009420 con 0x7f7b540cd980 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b49d9b700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b540b4eb0 0x7f7b540cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b52d9d700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 0x7f7b541559a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009fa0 tx=0x7f7b4c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.866+0000 7f7b4affd700 1 -- 172.21.15.84:0/2324809072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c00ec70 con 0x7f7b540cd980 2023-10-06T03:24:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.867+0000 7f7b4affd700 1 -- 172.21.15.84:0/2324809072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c00edd0 con 0x7f7b540cd980 2023-10-06T03:24:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.867+0000 7f7b58d67700 1 -- 172.21.15.84:0/2324809072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b540cffd0 con 0x7f7b540cd980 2023-10-06T03:24:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.867+0000 7f7b4affd700 1 -- 172.21.15.84:0/2324809072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c014670 con 0x7f7b540cd980 2023-10-06T03:24:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.867+0000 7f7b58d67700 1 -- 172.21.15.84:0/2324809072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5416d5c0 con 0x7f7b540cd980 2023-10-06T03:24:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.867+0000 7f7b58d67700 1 -- 172.21.15.84:0/2324809072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5416ddc0 con 0x7f7b540cd980 2023-10-06T03:24:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.868+0000 7f7b4affd700 1 -- 172.21.15.84:0/2324809072 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b4c0149e0 con 0x7f7b540cd980 2023-10-06T03:24:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.868+0000 7f7b4affd700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7b34066f30 0x7f7b340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.868+0000 7f7b4affd700 1 -- 172.21.15.84:0/2324809072 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7b4c084eb0 con 0x7f7b540cd980 2023-10-06T03:24:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.868+0000 7f7b5259c700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7b34066f30 0x7f7b340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.869+0000 7f7b5259c700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7b34066f30 0x7f7b340693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b440091e0 tx=0x7f7b44017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:58.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:58.872+0000 7f7b4affd700 1 -- 172.21.15.84:0/2324809072 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b5416ddc0 con 0x7f7b540cd980 2023-10-06T03:24:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.129+0000 7f7b58d67700 1 -- 172.21.15.84:0/2324809072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7b54064ad0 con 0x7f7b540cd980 2023-10-06T03:24:59.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.132+0000 7f7b4affd700 1 -- 172.21.15.84:0/2324809072 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7b4c051e80 con 0x7f7b540cd980 2023-10-06T03:24:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.134+0000 7f7b58d67700 1 -- 172.21.15.84:0/2324809072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7b34066f30 msgr2=0x7f7b340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.134+0000 7f7b58d67700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7b34066f30 0x7f7b340693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b440091e0 tx=0x7f7b44017000 comp rx=0 tx=0).stop 2023-10-06T03:24:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.134+0000 7f7b58d67700 1 -- 172.21.15.84:0/2324809072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 msgr2=0x7f7b541559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.134+0000 7f7b58d67700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 0x7f7b541559a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009fa0 tx=0x7f7b4c009900 comp rx=0 tx=0).stop 2023-10-06T03:24:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.134+0000 7f7b58d67700 1 -- 172.21.15.84:0/2324809072 shutdown_connections 2023-10-06T03:24:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.134+0000 7f7b58d67700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7b34066f30 0x7f7b340693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.134+0000 7f7b58d67700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540cd980 0x7f7b541559a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.134+0000 7f7b58d67700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b540b4a60 0x7f7b5416a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.134+0000 7f7b58d67700 1 --2- 172.21.15.84:0/2324809072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b540b4eb0 0x7f7b540cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.134+0000 7f7b58d67700 1 -- 172.21.15.84:0/2324809072 >> 172.21.15.84:0/2324809072 conn(0x7f7b5406ed20 msgr2=0x7f7b541524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.135+0000 7f7b58d67700 1 -- 172.21.15.84:0/2324809072 shutdown_connections 2023-10-06T03:24:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.135+0000 7f7b58d67700 1 -- 172.21.15.84:0/2324809072 wait complete. 2023-10-06T03:24:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T03:24:59.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:59.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.261+0000 7fe78906b700 1 Processor -- start 2023-10-06T03:24:59.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.261+0000 7fe78906b700 1 -- start start 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe78906b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe7841595a0 0x7fe7840aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe78906b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe7840b07a0 0x7fe7840b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe78906b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7840b0ca0 con 0x7fe7840b49e0 2023-10-06T03:24:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe78906b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840b0f80 con 0x7fe7841595a0 2023-10-06T03:24:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe78906b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840b1260 con 0x7fe7840b07a0 2023-10-06T03:24:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe782d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe7841595a0 0x7fe7840aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe782d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe7841595a0 0x7fe7840aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57554/0 (socket says 172.21.15.84:57554) 2023-10-06T03:24:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe782d9d700 1 -- 172.21.15.84:0/371770090 learned_addr learned my addr 172.21.15.84:0/371770090 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe78359e700 1 --2- 172.21.15.84:0/371770090 >> v2:172.21.15.131:3300/0 conn(0x7fe7840b07a0 0x7fe7840b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe782d9d700 1 -- 172.21.15.84:0/371770090 >> v2:172.21.15.131:3300/0 conn(0x7fe7840b07a0 msgr2=0x7fe7840b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe782d9d700 1 --2- 172.21.15.84:0/371770090 >> v2:172.21.15.131:3300/0 conn(0x7fe7840b07a0 0x7fe7840b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe782d9d700 1 -- 172.21.15.84:0/371770090 >> v1:172.21.15.131:6789/0 conn(0x7fe7840b49e0 legacy=0x7fe7840aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe782d9d700 1 -- 172.21.15.84:0/371770090 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840b1540 con 0x7fe7841595a0 2023-10-06T03:24:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe782d9d700 1 --2- 172.21.15.84:0/371770090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841595a0 0x7fe7840aa570 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe774009990 tx=0x7fe774009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d258649a0931c21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe781d9b700 1 -- 172.21.15.84:0/371770090 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774009e80 con 0x7fe7841595a0 2023-10-06T03:24:59.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe781d9b700 1 -- 172.21.15.84:0/371770090 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe774005c10 con 0x7fe7841595a0 2023-10-06T03:24:59.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.262+0000 7fe781d9b700 1 -- 172.21.15.84:0/371770090 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400b610 con 0x7fe7841595a0 2023-10-06T03:24:59.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.263+0000 7fe78906b700 1 -- 172.21.15.84:0/371770090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841595a0 msgr2=0x7fe7840aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.263+0000 7fe78906b700 1 --2- 172.21.15.84:0/371770090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841595a0 0x7fe7840aa570 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe774009990 tx=0x7fe774009220 comp rx=0 tx=0).stop 2023-10-06T03:24:59.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.263+0000 7fe78906b700 1 -- 172.21.15.84:0/371770090 shutdown_connections 2023-10-06T03:24:59.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.263+0000 7fe78906b700 1 --2- 172.21.15.84:0/371770090 >> v2:172.21.15.131:3300/0 conn(0x7fe7840b07a0 0x7fe7840b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.263+0000 7fe78906b700 1 --2- 172.21.15.84:0/371770090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841595a0 0x7fe7840aa570 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.263+0000 7fe78906b700 1 -- 172.21.15.84:0/371770090 >> 172.21.15.84:0/371770090 conn(0x7fe784099830 msgr2=0x7fe78406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.263+0000 7fe78906b700 1 -- 172.21.15.84:0/371770090 shutdown_connections 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.263+0000 7fe78906b700 1 -- 172.21.15.84:0/371770090 wait complete. 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.264+0000 7fe78906b700 1 Processor -- start 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.264+0000 7fe78906b700 1 -- start start 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe78906b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7840b07a0 0x7fe7840af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe78906b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7840b49e0 0x7fe78414a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe78906b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7841595a0 0x7fe7840ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe78906b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78409c800 con 0x7fe7840b07a0 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe78906b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840af740 con 0x7fe7840b49e0 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe78906b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78409db70 con 0x7fe7841595a0 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe782d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7840b07a0 0x7fe7840af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe782d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7840b07a0 0x7fe7840af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57556/0 (socket says 172.21.15.84:57556) 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe782d9d700 1 -- 172.21.15.84:0/1018124459 learned_addr learned my addr 172.21.15.84:0/1018124459 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe78259c700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7840b49e0 0x7fe78414a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe78359e700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7841595a0 0x7fe7840ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe782d9d700 1 -- 172.21.15.84:0/1018124459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7841595a0 msgr2=0x7fe7840ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe782d9d700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7841595a0 0x7fe7840ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe782d9d700 1 -- 172.21.15.84:0/1018124459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7840b49e0 msgr2=0x7fe78414a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe782d9d700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7840b49e0 0x7fe78414a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe782d9d700 1 -- 172.21.15.84:0/1018124459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe774009480 con 0x7fe7840b07a0 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe78359e700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7841595a0 0x7fe7840ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.265+0000 7fe782d9d700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7840b07a0 0x7fe7840af200 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe784067c60 tx=0x7fe774016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.266+0000 7fe76affd700 1 -- 172.21.15.84:0/1018124459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774011bf0 con 0x7fe7840b07a0 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.266+0000 7fe76affd700 1 -- 172.21.15.84:0/1018124459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe774011d50 con 0x7fe7840b07a0 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.266+0000 7fe78906b700 1 -- 172.21.15.84:0/1018124459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78409de50 con 0x7fe7840b07a0 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.266+0000 7fe76affd700 1 -- 172.21.15.84:0/1018124459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77401b680 con 0x7fe7840b07a0 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.266+0000 7fe78906b700 1 -- 172.21.15.84:0/1018124459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78409c490 con 0x7fe7840b07a0 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.266+0000 7fe78906b700 1 -- 172.21.15.84:0/1018124459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe784064ad0 con 0x7fe7840b07a0 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.267+0000 7fe76affd700 1 -- 172.21.15.84:0/1018124459 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe77401ba70 con 0x7fe7840b07a0 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.267+0000 7fe76affd700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe770066f30 0x7fe7700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.267+0000 7fe76affd700 1 -- 172.21.15.84:0/1018124459 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe7740860e0 con 0x7fe7840b07a0 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.267+0000 7fe78259c700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe770066f30 0x7fe7700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.268+0000 7fe78259c700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe770066f30 0x7fe7700693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe7840cedf0 tx=0x7fe778007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.272+0000 7fe76affd700 1 -- 172.21.15.84:0/1018124459 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7740530b0 con 0x7fe7840b07a0 2023-10-06T03:24:59.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.501+0000 7fe78906b700 1 -- 172.21.15.84:0/1018124459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7840b1820 con 0x7fe7840b07a0 2023-10-06T03:24:59.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.501+0000 7fe76affd700 1 -- 172.21.15.84:0/1018124459 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fe7740566d0 con 0x7fe7840b07a0 2023-10-06T03:24:59.503 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:24:59.503 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1693550238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1693550238},{"type":"v1","addr":"172.21.15.131:6834","nonce":1693550238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2817652058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2817652058},{"type":"v1","addr":"172.21.15.131:6835","nonce":2817652058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/688702713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":688702713},{"type":"v1","addr":"172.21.15.84:6836","nonce":688702713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:24:49.172387+0000","modified":"2023-10-06T03:24:52.828381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/1939836196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1939836196},{"type":"v1","addr":"172.21.15.84:6837","nonce":1939836196}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:24:59.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 -- 172.21.15.84:0/1018124459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe770066f30 msgr2=0x7fe7700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe770066f30 0x7fe7700693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe7840cedf0 tx=0x7fe778007ec0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 -- 172.21.15.84:0/1018124459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7840b07a0 msgr2=0x7fe7840af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7840b07a0 0x7fe7840af200 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe784067c60 tx=0x7fe774016000 comp rx=0 tx=0).stop 2023-10-06T03:24:59.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 -- 172.21.15.84:0/1018124459 shutdown_connections 2023-10-06T03:24:59.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe770066f30 0x7fe7700693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7841595a0 0x7fe7840ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7840b07a0 0x7fe7840af200 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 --2- 172.21.15.84:0/1018124459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7840b49e0 0x7fe78414a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 -- 172.21.15.84:0/1018124459 >> 172.21.15.84:0/1018124459 conn(0x7fe784099830 msgr2=0x7fe7840b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 -- 172.21.15.84:0/1018124459 shutdown_connections 2023-10-06T03:24:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:24:59.503+0000 7fe78906b700 1 -- 172.21.15.84:0/1018124459 wait complete. 2023-10-06T03:24:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-10-06T03:24:59.920 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:24:49.172387+0000', 'modified': '2023-10-06T03:24:52.828381+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5112}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5112': {'gid': 5112, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.84:6837/1939836196', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 1939836196}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 1939836196}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:24:59.920 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:24:59.920 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:25:00.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.035+0000 7fb447f8f700 1 Processor -- start 2023-10-06T03:25:00.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.035+0000 7fb447f8f700 1 -- start start 2023-10-06T03:25:00.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.036+0000 7fb447f8f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb440157640 0x7fb44006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.036+0000 7fb447f8f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4400ca980 0x7fb4400b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.036+0000 7fb447f8f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44006bd00 con 0x7fb4400675f0 2023-10-06T03:25:00.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.036+0000 7fb447f8f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4400b0720 con 0x7fb4400ca980 2023-10-06T03:25:00.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.036+0000 7fb447f8f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4400ca730 con 0x7fb440157640 2023-10-06T03:25:00.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.036+0000 7fb44552a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4400ca980 0x7fb4400b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.036+0000 7fb44552a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4400ca980 0x7fb4400b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57572/0 (socket says 172.21.15.84:57572) 2023-10-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.036+0000 7fb44552a700 1 -- 172.21.15.84:0/1773701151 learned_addr learned my addr 172.21.15.84:0/1773701151 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb445d2b700 1 --2- 172.21.15.84:0/1773701151 >> v2:172.21.15.131:3300/0 conn(0x7fb440157640 0x7fb44006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb44552a700 1 -- 172.21.15.84:0/1773701151 >> v2:172.21.15.131:3300/0 conn(0x7fb440157640 msgr2=0x7fb44006e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb44552a700 1 --2- 172.21.15.84:0/1773701151 >> v2:172.21.15.131:3300/0 conn(0x7fb440157640 0x7fb44006e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb44552a700 1 -- 172.21.15.84:0/1773701151 >> v1:172.21.15.131:6789/0 conn(0x7fb4400675f0 legacy=0x7fb4400679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb44552a700 1 -- 172.21.15.84:0/1773701151 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44006ed10 con 0x7fb4400ca980 2023-10-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb44552a700 1 --2- 172.21.15.84:0/1773701151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4400ca980 0x7fb4400b01e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb440071320 tx=0x7fb430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1888dba49ff54784 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:00.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb444d29700 1 -- 172.21.15.84:0/1773701151 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43000b820 con 0x7fb4400ca980 2023-10-06T03:25:00.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb444d29700 1 -- 172.21.15.84:0/1773701151 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43000b980 con 0x7fb4400ca980 2023-10-06T03:25:00.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb444d29700 1 -- 172.21.15.84:0/1773701151 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43000bd20 con 0x7fb4400ca980 2023-10-06T03:25:00.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb447f8f700 1 -- 172.21.15.84:0/1773701151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4400ca980 msgr2=0x7fb4400b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.037+0000 7fb447f8f700 1 --2- 172.21.15.84:0/1773701151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4400ca980 0x7fb4400b01e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb440071320 tx=0x7fb430009250 comp rx=0 tx=0).stop 2023-10-06T03:25:00.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.038+0000 7fb447f8f700 1 -- 172.21.15.84:0/1773701151 shutdown_connections 2023-10-06T03:25:00.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.038+0000 7fb447f8f700 1 --2- 172.21.15.84:0/1773701151 >> v2:172.21.15.131:3300/0 conn(0x7fb440157640 0x7fb44006e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.038+0000 7fb447f8f700 1 --2- 172.21.15.84:0/1773701151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4400ca980 0x7fb4400b01e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.038+0000 7fb447f8f700 1 -- 172.21.15.84:0/1773701151 >> 172.21.15.84:0/1773701151 conn(0x7fb4400cdef0 msgr2=0x7fb4400c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:00.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.038+0000 7fb447f8f700 1 -- 172.21.15.84:0/1773701151 shutdown_connections 2023-10-06T03:25:00.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.038+0000 7fb447f8f700 1 -- 172.21.15.84:0/1773701151 wait complete. 2023-10-06T03:25:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.039+0000 7fb447f8f700 1 Processor -- start 2023-10-06T03:25:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.039+0000 7fb447f8f700 1 -- start start 2023-10-06T03:25:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.039+0000 7fb447f8f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4400675f0 0x7fb4400c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.039+0000 7fb447f8f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4400ca980 0x7fb440151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.039+0000 7fb447f8f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb440157640 0x7fb440152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.039+0000 7fb447f8f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb440158830 con 0x7fb440157640 2023-10-06T03:25:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.039+0000 7fb447f8f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4401512a0 con 0x7fb4400675f0 2023-10-06T03:25:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.039+0000 7fb447f8f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4401584e0 con 0x7fb4400ca980 2023-10-06T03:25:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44652c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb440157640 0x7fb440152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44652c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb440157640 0x7fb440152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57574/0 (socket says 172.21.15.84:57574) 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44652c700 1 -- 172.21.15.84:0/1838647792 learned_addr learned my addr 172.21.15.84:0/1838647792 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44552a700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4400ca980 0x7fb440151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb445d2b700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4400675f0 0x7fb4400c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44652c700 1 -- 172.21.15.84:0/1838647792 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4400ca980 msgr2=0x7fb440151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44652c700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4400ca980 0x7fb440151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44652c700 1 -- 172.21.15.84:0/1838647792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4400675f0 msgr2=0x7fb4400c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44652c700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4400675f0 0x7fb4400c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44652c700 1 -- 172.21.15.84:0/1838647792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4300094f0 con 0x7fb440157640 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44552a700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4400ca980 0x7fb440151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb445d2b700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4400675f0 0x7fb4400c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb44652c700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb440157640 0x7fb440152150 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c5b0 tx=0x7fb438007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb435ffb700 1 -- 172.21.15.84:0/1838647792 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438011590 con 0x7fb440157640 2023-10-06T03:25:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb435ffb700 1 -- 172.21.15.84:0/1838647792 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb438011710 con 0x7fb440157640 2023-10-06T03:25:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb447f8f700 1 -- 172.21.15.84:0/1838647792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4400c7420 con 0x7fb440157640 2023-10-06T03:25:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb435ffb700 1 -- 172.21.15.84:0/1838647792 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438011ad0 con 0x7fb440157640 2023-10-06T03:25:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.040+0000 7fb447f8f700 1 -- 172.21.15.84:0/1838647792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4400c79e0 con 0x7fb440157640 2023-10-06T03:25:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.042+0000 7fb435ffb700 1 -- 172.21.15.84:0/1838647792 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb43801c460 con 0x7fb440157640 2023-10-06T03:25:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.042+0000 7fb435ffb700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb424066f30 0x7fb4240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.042+0000 7fb435ffb700 1 -- 172.21.15.84:0/1838647792 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb4380844a0 con 0x7fb440157640 2023-10-06T03:25:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.042+0000 7fb445d2b700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb424066f30 0x7fb4240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.042+0000 7fb445d2b700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb424066f30 0x7fb4240693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb43c007460 tx=0x7fb43c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.044+0000 7fb451287b80 1 Processor -- start 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.044+0000 7fb451287b80 1 -- start start 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb451287b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608461840 0x559608461c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb451287b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608462cc0 0x5596084b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb451287b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596084b1c00 0x5596084b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb451287b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596083b8a70 con 0x559608461840 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb451287b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596083b6270 con 0x5596084b1c00 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb451287b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596083b2060 con 0x559608462cc0 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb445d2b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608461840 0x559608461c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb445d2b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608461840 0x559608461c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57576/0 (socket says 172.21.15.84:57576) 2023-10-06T03:25:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb445d2b700 1 -- 172.21.15.84:0/1186004245 learned_addr learned my addr 172.21.15.84:0/1186004245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb445d2b700 1 -- 172.21.15.84:0/1186004245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608462cc0 msgr2=0x5596084b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb445d2b700 1 --2- 172.21.15.84:0/1186004245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608462cc0 0x5596084b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb445d2b700 1 -- 172.21.15.84:0/1186004245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596084b1c00 msgr2=0x5596084b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb445d2b700 1 --2- 172.21.15.84:0/1186004245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596084b1c00 0x5596084b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb445d2b700 1 -- 172.21.15.84:0/1186004245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55960824c270 con 0x559608461840 2023-10-06T03:25:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb445d2b700 1 --2- 172.21.15.84:0/1186004245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608461840 0x559608461c10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0197a0 tx=0x7fb43c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2346ac3d5c91a81d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb42affd700 1 -- 172.21.15.84:0/1186004245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c01e070 con 0x559608461840 2023-10-06T03:25:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb42affd700 1 -- 172.21.15.84:0/1186004245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c014490 con 0x559608461840 2023-10-06T03:25:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.045+0000 7fb42affd700 1 -- 172.21.15.84:0/1186004245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c014810 con 0x559608461840 2023-10-06T03:25:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.046+0000 7fb451287b80 1 -- 172.21.15.84:0/1186004245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608461840 msgr2=0x559608461c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.046+0000 7fb451287b80 1 --2- 172.21.15.84:0/1186004245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608461840 0x559608461c10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0197a0 tx=0x7fb43c014000 comp rx=0 tx=0).stop 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.046+0000 7fb451287b80 1 -- 172.21.15.84:0/1186004245 shutdown_connections 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.046+0000 7fb451287b80 1 --2- 172.21.15.84:0/1186004245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596084b1c00 0x5596084b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.046+0000 7fb451287b80 1 --2- 172.21.15.84:0/1186004245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608461840 0x559608461c10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.046+0000 7fb451287b80 1 --2- 172.21.15.84:0/1186004245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608462cc0 0x5596084b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.046+0000 7fb451287b80 1 -- 172.21.15.84:0/1186004245 >> 172.21.15.84:0/1186004245 conn(0x559608463160 msgr2=0x559608463530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.046+0000 7fb451287b80 1 -- 172.21.15.84:0/1186004245 shutdown_connections 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.046+0000 7fb451287b80 1 -- 172.21.15.84:0/1186004245 wait complete. 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.047+0000 7fb451287b80 1 -- start start 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.047+0000 7fb451287b80 1 Processor -- start 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb451287b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608461840 0x5596084a8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb451287b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x5596084a8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb451287b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596084b1c00 0x5596084aa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb451287b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960835d890 con 0x559608462cc0 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb451287b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559608378ea0 con 0x5596084b1c00 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb451287b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559608234e30 con 0x559608461840 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb451287b80 10 client.0 _ll_register_callbacks cb 0x559608424e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb44552a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x5596084a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb44552a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x5596084a8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57582/0 (socket says 172.21.15.84:57582) 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb44552a700 1 -- 172.21.15.84:0/2960660265 learned_addr learned my addr 172.21.15.84:0/2960660265 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb445d2b700 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608461840 0x5596084a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb44552a700 1 -- 172.21.15.84:0/2960660265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608461840 msgr2=0x5596084a8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb44552a700 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608461840 0x5596084a8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb44652c700 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596084b1c00 0x5596084aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb44552a700 1 -- 172.21.15.84:0/2960660265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596084b1c00 msgr2=0x5596084aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb44552a700 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596084b1c00 0x5596084aa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb44552a700 1 -- 172.21.15.84:0/2960660265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c019420 con 0x559608462cc0 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb445d2b700 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608461840 0x5596084a8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb44552a700 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x5596084a8670 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb43000b3c0 tx=0x7fb430016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b36c8ae26891493 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb41ffff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb41ffff700 1 -- 172.21.15.84:0/2960660265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430011630 con 0x559608462cc0 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb41ffff700 1 -- 172.21.15.84:0/2960660265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb430011790 con 0x559608462cc0 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb451287b80 1 -- 172.21.15.84:0/2960660265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559608456940 con 0x559608462cc0 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb41ffff700 1 -- 172.21.15.84:0/2960660265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb430011b60 con 0x559608462cc0 2023-10-06T03:25:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb451287b80 10 client.5322 fetch_fsmap learned FSMap version 16 2023-10-06T03:25:00.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.048+0000 7fb451287b80 1 -- 172.21.15.84:0/2960660265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5596081eefe0 con 0x559608462cc0 2023-10-06T03:25:00.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb41ffff700 1 -- 172.21.15.84:0/2960660265 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559608456940 con 0x559608462cc0 2023-10-06T03:25:00.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb41ffff700 1 -- 172.21.15.84:0/2960660265 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb430018070 con 0x559608462cc0 2023-10-06T03:25:00.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb451287b80 10 client.5322 fetch_fsmap finished waiting for FSMap version 16 2023-10-06T03:25:00.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb451287b80 10 client.5322 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:25:00.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb451287b80 20 client.5322 populate_metadata read hostname 'smithi084' 2023-10-06T03:25:00.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb451287b80 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.84:6835/1939836196,v1:172.21.15.84:6837/1939836196] conn(0x5596084aaae0 0x5596084aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb451287b80 4 client.5322 mds_command: new command op to 5112 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:25:00.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb451287b80 1 -- 172.21.15.84:0/2960660265 --> [v2:172.21.15.84:6835/1939836196,v1:172.21.15.84:6837/1939836196] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559608433870 con 0x5596084aaae0 2023-10-06T03:25:00.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb445d2b700 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.84:6835/1939836196,v1:172.21.15.84:6837/1939836196] conn(0x5596084aaae0 0x5596084aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb41ffff700 10 client.5322 ms_handle_connect on v2:172.21.15.84:6835/1939836196 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.049+0000 7fb445d2b700 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.84:6835/1939836196,v1:172.21.15.84:6837/1939836196] conn(0x5596084aaae0 0x5596084aaeb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d9b486704f10963 server_cookie=766cec1a784f90e1 in_seq=0 out_seq=0 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb41ffff700 1 -- 172.21.15.84:0/2960660265 <== mds.0 v2:172.21.15.84:6835/1939836196 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559608433870 con 0x5596084aaae0 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb41ffff700 10 client.5322 handle_command_reply: tid=0 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 client.5322 shutdown 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 -- 172.21.15.84:0/2960660265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 msgr2=0x5596084a8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x5596084a8670 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb43000b3c0 tx=0x7fb430016000 comp rx=0 tx=0).stop 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 -- 172.21.15.84:0/2960660265 shutdown_connections 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.84:6835/1939836196,v1:172.21.15.84:6837/1939836196] conn(0x5596084aaae0 0x5596084aaeb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596084b1c00 0x5596084aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608461840 0x5596084a8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb41ffff700 0 client.5322 ms_handle_reset on v2:172.21.15.84:6835/1939836196 2023-10-06T03:25:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 --2- 172.21.15.84:0/2960660265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x5596084a8670 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 -- 172.21.15.84:0/2960660265 >> 172.21.15.84:0/2960660265 conn(0x559608463160 msgr2=0x5596084a51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 -- 172.21.15.84:0/2960660265 shutdown_connections 2023-10-06T03:25:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 1 -- 172.21.15.84:0/2960660265 wait complete. 2023-10-06T03:25:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.050+0000 7fb451287b80 20 client.5322 trim_cache size 0 max 16384 2023-10-06T03:25:00.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.067+0000 7fb451287b80 1 Processor -- start 2023-10-06T03:25:00.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.067+0000 7fb451287b80 1 -- start start 2023-10-06T03:25:00.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.067+0000 7fb451287b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559608461840 0x55960847de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.067+0000 7fb451287b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x559608463530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.067+0000 7fb451287b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596084b1c00 0x559608463a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.067+0000 7fb451287b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559608491ca0 con 0x559608462cc0 2023-10-06T03:25:00.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.067+0000 7fb451287b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960848a810 con 0x559608461840 2023-10-06T03:25:00.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.067+0000 7fb451287b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596084a09c0 con 0x5596084b1c00 2023-10-06T03:25:00.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb44552a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x559608463530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb44552a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x559608463530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57594/0 (socket says 172.21.15.84:57594) 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb44552a700 1 -- 172.21.15.84:0/2651060769 learned_addr learned my addr 172.21.15.84:0/2651060769 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb44652c700 1 --2- 172.21.15.84:0/2651060769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596084b1c00 0x559608463a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb445d2b700 1 --2- 172.21.15.84:0/2651060769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559608461840 0x55960847de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb44552a700 1 -- 172.21.15.84:0/2651060769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596084b1c00 msgr2=0x559608463a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb44552a700 1 --2- 172.21.15.84:0/2651060769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596084b1c00 0x559608463a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb44552a700 1 -- 172.21.15.84:0/2651060769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559608461840 msgr2=0x55960847de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb44552a700 1 --2- 172.21.15.84:0/2651060769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559608461840 0x55960847de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb44552a700 1 -- 172.21.15.84:0/2651060769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55960845fb30 con 0x559608462cc0 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb44552a700 1 --2- 172.21.15.84:0/2651060769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x559608463530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb43000bee0 tx=0x7fb43001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d419538e48776f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb42b7fe700 1 -- 172.21.15.84:0/2651060769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430011de0 con 0x559608462cc0 2023-10-06T03:25:00.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb42b7fe700 1 -- 172.21.15.84:0/2651060769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb430011b60 con 0x559608462cc0 2023-10-06T03:25:00.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb42b7fe700 1 -- 172.21.15.84:0/2651060769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430011630 con 0x559608462cc0 2023-10-06T03:25:00.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb451287b80 1 -- 172.21.15.84:0/2651060769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 msgr2=0x559608463530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.068+0000 7fb451287b80 1 --2- 172.21.15.84:0/2651060769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x559608463530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb43000bee0 tx=0x7fb43001e040 comp rx=0 tx=0).stop 2023-10-06T03:25:00.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.069+0000 7fb451287b80 1 -- 172.21.15.84:0/2651060769 shutdown_connections 2023-10-06T03:25:00.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.069+0000 7fb451287b80 1 --2- 172.21.15.84:0/2651060769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559608461840 0x55960847de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.069+0000 7fb451287b80 1 --2- 172.21.15.84:0/2651060769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596084b1c00 0x559608463a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.069+0000 7fb451287b80 1 --2- 172.21.15.84:0/2651060769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559608462cc0 0x559608463530 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.069+0000 7fb451287b80 1 -- 172.21.15.84:0/2651060769 >> 172.21.15.84:0/2651060769 conn(0x559608463160 msgr2=0x5596084aa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:00.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.069+0000 7fb451287b80 1 -- 172.21.15.84:0/2651060769 shutdown_connections 2023-10-06T03:25:00.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.069+0000 7fb451287b80 1 -- 172.21.15.84:0/2651060769 wait complete. 2023-10-06T03:25:00.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.069+0000 7fb451287b80 1 -- start start 2023-10-06T03:25:00.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.069+0000 7fb451287b80 1 Processor -- start 2023-10-06T03:25:00.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb451287b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559608461840 0x55960845e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb451287b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608462cc0 0x5596084b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb451287b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596084b1c00 0x559608463990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb451287b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596084a7c80 con 0x5596084b1c00 2023-10-06T03:25:00.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb451287b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559608512e90 con 0x559608461840 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb451287b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596084be780 con 0x559608462cc0 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb451287b80 10 client.0 _ll_register_callbacks cb 0x559608424e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb44652c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596084b1c00 0x559608463990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb44652c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596084b1c00 0x559608463990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57608/0 (socket says 172.21.15.84:57608) 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb44652c700 1 -- 172.21.15.84:0/2544290790 learned_addr learned my addr 172.21.15.84:0/2544290790 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb44552a700 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608462cc0 0x5596084b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb445d2b700 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559608461840 0x55960845e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb44652c700 1 -- 172.21.15.84:0/2544290790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608462cc0 msgr2=0x5596084b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb44652c700 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608462cc0 0x5596084b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb44652c700 1 -- 172.21.15.84:0/2544290790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559608461840 msgr2=0x55960845e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb44652c700 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559608461840 0x55960845e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.070+0000 7fb44652c700 1 -- 172.21.15.84:0/2544290790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596081eefe0 con 0x5596084b1c00 2023-10-06T03:25:00.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb44652c700 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596084b1c00 0x559608463990 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb43800cd00 tx=0x7fb438084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207d553486d5234d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:00.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb41ffff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:25:00.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb41ffff700 1 -- 172.21.15.84:0/2544290790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438055830 con 0x5596084b1c00 2023-10-06T03:25:00.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb41ffff700 1 -- 172.21.15.84:0/2544290790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb438055130 con 0x5596084b1c00 2023-10-06T03:25:00.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb451287b80 1 -- 172.21.15.84:0/2544290790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb43c014490 con 0x5596084b1c00 2023-10-06T03:25:00.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb41ffff700 1 -- 172.21.15.84:0/2544290790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb438058380 con 0x5596084b1c00 2023-10-06T03:25:00.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb451287b80 10 client.5328 fetch_fsmap learned FSMap version 16 2023-10-06T03:25:00.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb451287b80 1 -- 172.21.15.84:0/2544290790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559608380780 con 0x5596084b1c00 2023-10-06T03:25:00.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb41ffff700 1 -- 172.21.15.84:0/2544290790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c014490 con 0x5596084b1c00 2023-10-06T03:25:00.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb41ffff700 1 -- 172.21.15.84:0/2544290790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb438054620 con 0x5596084b1c00 2023-10-06T03:25:00.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb451287b80 10 client.5328 fetch_fsmap finished waiting for FSMap version 16 2023-10-06T03:25:00.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb451287b80 10 client.5328 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:25:00.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb451287b80 20 client.5328 populate_metadata read hostname 'smithi084' 2023-10-06T03:25:00.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb451287b80 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.84:6835/1939836196,v1:172.21.15.84:6837/1939836196] conn(0x55960850f120 0x55960850f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb451287b80 4 client.5328 mds_command: new command op to 5112 tid=0[{"prefix": "status"}] 2023-10-06T03:25:00.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb451287b80 1 -- 172.21.15.84:0/2544290790 --> [v2:172.21.15.84:6835/1939836196,v1:172.21.15.84:6837/1939836196] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559608354e00 con 0x55960850f120 2023-10-06T03:25:00.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb445d2b700 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.84:6835/1939836196,v1:172.21.15.84:6837/1939836196] conn(0x55960850f120 0x55960850f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.071+0000 7fb41ffff700 10 client.5328 ms_handle_connect on v2:172.21.15.84:6835/1939836196 2023-10-06T03:25:00.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb445d2b700 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.84:6835/1939836196,v1:172.21.15.84:6837/1939836196] conn(0x55960850f120 0x55960850f4f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21165cf202075931 server_cookie=d32e414936cae4db in_seq=0 out_seq=0 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb41ffff700 1 -- 172.21.15.84:0/2544290790 <== mds.0 v2:172.21.15.84:6835/1939836196 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x559608354e00 con 0x55960850f120 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb41ffff700 10 client.5328 handle_command_reply: tid=0 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 client.5328 shutdown 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 -- 172.21.15.84:0/2544290790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596084b1c00 msgr2=0x559608463990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596084b1c00 0x559608463990 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb43800cd00 tx=0x7fb438084040 comp rx=0 tx=0).stop 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 -- 172.21.15.84:0/2544290790 shutdown_connections 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.84:6835/1939836196,v1:172.21.15.84:6837/1939836196] conn(0x55960850f120 0x55960850f4f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559608461840 0x55960845e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb41ffff700 0 client.5328 ms_handle_reset on v2:172.21.15.84:6835/1939836196 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596084b1c00 0x559608463990 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 --2- 172.21.15.84:0/2544290790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559608462cc0 0x5596084b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 -- 172.21.15.84:0/2544290790 >> 172.21.15.84:0/2544290790 conn(0x559608463160 msgr2=0x55960848a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:00.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 -- 172.21.15.84:0/2544290790 shutdown_connections 2023-10-06T03:25:00.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 1 -- 172.21.15.84:0/2544290790 wait complete. 2023-10-06T03:25:00.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb451287b80 20 client.5328 trim_cache size 0 max 16384 2023-10-06T03:25:00.083 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:25:00.083 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:25:00.083 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:25:00.084 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5112, 2023-10-06T03:25:00.084 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:25:00.084 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:25:00.084 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:25:00.084 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 10.252225848, 2023-10-06T03:25:00.084 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 16, 2023-10-06T03:25:00.084 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 38, 2023-10-06T03:25:00.084 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 38, 2023-10-06T03:25:00.084 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 19.298622647999998 2023-10-06T03:25:00.084 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:25:00.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb447f8f700 1 -- 172.21.15.84:0/1838647792 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb424066f30 msgr2=0x7fb4240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.072+0000 7fb447f8f700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb424066f30 0x7fb4240693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb43c007460 tx=0x7fb43c00b040 comp rx=0 tx=0).stop 2023-10-06T03:25:00.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.073+0000 7fb447f8f700 1 -- 172.21.15.84:0/1838647792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb440157640 msgr2=0x7fb440152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.073+0000 7fb447f8f700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb440157640 0x7fb440152150 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c5b0 tx=0x7fb438007f60 comp rx=0 tx=0).stop 2023-10-06T03:25:00.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.073+0000 7fb447f8f700 1 -- 172.21.15.84:0/1838647792 shutdown_connections 2023-10-06T03:25:00.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.073+0000 7fb447f8f700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb424066f30 0x7fb4240693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.073+0000 7fb447f8f700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4400675f0 0x7fb4400c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.073+0000 7fb447f8f700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb440157640 0x7fb440152150 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.073+0000 7fb447f8f700 1 --2- 172.21.15.84:0/1838647792 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4400ca980 0x7fb440151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.073+0000 7fb447f8f700 1 -- 172.21.15.84:0/1838647792 >> 172.21.15.84:0/1838647792 conn(0x7fb4400cdef0 msgr2=0x7fb4400b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:00.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.073+0000 7fb447f8f700 1 -- 172.21.15.84:0/1838647792 shutdown_connections 2023-10-06T03:25:00.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.073+0000 7fb447f8f700 1 -- 172.21.15.84:0/1838647792 wait complete. 2023-10-06T03:25:00.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:25:00.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.199+0000 7fc826493700 1 Processor -- start 2023-10-06T03:25:00.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.199+0000 7fc826493700 1 -- start start 2023-10-06T03:25:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc826493700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc8201595a0 0x7fc8200aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc826493700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc8200b49e0 0x7fc8200aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc826493700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8200b0ca0 con 0x7fc8200b07a0 2023-10-06T03:25:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc826493700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8200b0f80 con 0x7fc8200b49e0 2023-10-06T03:25:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc826493700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8200b1260 con 0x7fc8201595a0 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc8200b49e0 0x7fc8200aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc8200b49e0 0x7fc8200aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57618/0 (socket says 172.21.15.84:57618) 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81f7fe700 1 -- 172.21.15.84:0/24458166 learned_addr learned my addr 172.21.15.84:0/24458166 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81ffff700 1 --2- 172.21.15.84:0/24458166 >> v2:172.21.15.131:3300/0 conn(0x7fc8201595a0 0x7fc8200aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81f7fe700 1 -- 172.21.15.84:0/24458166 >> v2:172.21.15.131:3300/0 conn(0x7fc8201595a0 msgr2=0x7fc8200aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81f7fe700 1 --2- 172.21.15.84:0/24458166 >> v2:172.21.15.131:3300/0 conn(0x7fc8201595a0 0x7fc8200aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81f7fe700 1 -- 172.21.15.84:0/24458166 >> v1:172.21.15.131:6789/0 conn(0x7fc8200b07a0 legacy=0x7fc8200b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81f7fe700 1 -- 172.21.15.84:0/24458166 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200b1540 con 0x7fc8200b49e0 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81f7fe700 1 --2- 172.21.15.84:0/24458166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8200b49e0 0x7fc8200aaab0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc8140099b0 tx=0x7fc814009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc055411d392f561 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81effd700 1 -- 172.21.15.84:0/24458166 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81400b7e0 con 0x7fc8200b49e0 2023-10-06T03:25:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81effd700 1 -- 172.21.15.84:0/24458166 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81400b940 con 0x7fc8200b49e0 2023-10-06T03:25:00.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.200+0000 7fc81effd700 1 -- 172.21.15.84:0/24458166 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81400bce0 con 0x7fc8200b49e0 2023-10-06T03:25:00.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.201+0000 7fc826493700 1 -- 172.21.15.84:0/24458166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8200b49e0 msgr2=0x7fc8200aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.201+0000 7fc826493700 1 --2- 172.21.15.84:0/24458166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8200b49e0 0x7fc8200aaab0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc8140099b0 tx=0x7fc814009250 comp rx=0 tx=0).stop 2023-10-06T03:25:00.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.201+0000 7fc826493700 1 -- 172.21.15.84:0/24458166 shutdown_connections 2023-10-06T03:25:00.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.201+0000 7fc826493700 1 --2- 172.21.15.84:0/24458166 >> v2:172.21.15.131:3300/0 conn(0x7fc8201595a0 0x7fc8200aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.201+0000 7fc826493700 1 --2- 172.21.15.84:0/24458166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8200b49e0 0x7fc8200aaab0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.201+0000 7fc826493700 1 -- 172.21.15.84:0/24458166 >> 172.21.15.84:0/24458166 conn(0x7fc820099830 msgr2=0x7fc82006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:00.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.201+0000 7fc826493700 1 -- 172.21.15.84:0/24458166 shutdown_connections 2023-10-06T03:25:00.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.201+0000 7fc826493700 1 -- 172.21.15.84:0/24458166 wait complete. 2023-10-06T03:25:00.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.202+0000 7fc826493700 1 Processor -- start 2023-10-06T03:25:00.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.202+0000 7fc826493700 1 -- start start 2023-10-06T03:25:00.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc826493700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8200b07a0 0x7fc82009a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc826493700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8200b49e0 0x7fc820155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc826493700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8201595a0 0x7fc8200cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc826493700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82015ad60 con 0x7fc8201595a0 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc826493700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82009d520 con 0x7fc8200b49e0 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc826493700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82009d800 con 0x7fc8200b07a0 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc824a30700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8201595a0 0x7fc8200cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc824a30700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8201595a0 0x7fc8200cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57622/0 (socket says 172.21.15.84:57622) 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc824a30700 1 -- 172.21.15.84:0/1765779383 learned_addr learned my addr 172.21.15.84:0/1765779383 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc81ffff700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8200b07a0 0x7fc82009a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc81f7fe700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8200b49e0 0x7fc820155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc824a30700 1 -- 172.21.15.84:0/1765779383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8200b07a0 msgr2=0x7fc82009a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc824a30700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8200b07a0 0x7fc82009a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc824a30700 1 -- 172.21.15.84:0/1765779383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8200b49e0 msgr2=0x7fc820155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc824a30700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8200b49e0 0x7fc820155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc824a30700 1 -- 172.21.15.84:0/1765779383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8140094f0 con 0x7fc8201595a0 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.203+0000 7fc81f7fe700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8200b49e0 0x7fc820155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.204+0000 7fc824a30700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8201595a0 0x7fc8200cde20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c930 tx=0x7fc8180026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.204+0000 7fc807fff700 1 -- 172.21.15.84:0/1765779383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818012630 con 0x7fc8201595a0 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.204+0000 7fc807fff700 1 -- 172.21.15.84:0/1765779383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8180127d0 con 0x7fc8201595a0 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.204+0000 7fc826493700 1 -- 172.21.15.84:0/1765779383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82009dae0 con 0x7fc8201595a0 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.204+0000 7fc807fff700 1 -- 172.21.15.84:0/1765779383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818012b90 con 0x7fc8201595a0 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.204+0000 7fc826493700 1 -- 172.21.15.84:0/1765779383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82009aee0 con 0x7fc8201595a0 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.205+0000 7fc826493700 1 -- 172.21.15.84:0/1765779383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82015aed0 con 0x7fc8201595a0 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.205+0000 7fc807fff700 1 -- 172.21.15.84:0/1765779383 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc81800a3b0 con 0x7fc8201595a0 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.205+0000 7fc807fff700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc80c066f30 0x7fc80c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.206+0000 7fc807fff700 1 -- 172.21.15.84:0/1765779383 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc8180844a0 con 0x7fc8201595a0 2023-10-06T03:25:00.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.206+0000 7fc81ffff700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc80c066f30 0x7fc80c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:00.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.206+0000 7fc81ffff700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc80c066f30 0x7fc80c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc8100061f0 tx=0x7fc810008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:00.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.210+0000 7fc807fff700 1 -- 172.21.15.84:0/1765779383 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc818051470 con 0x7fc8201595a0 2023-10-06T03:25:00.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.438+0000 7fc826493700 1 -- 172.21.15.84:0/1765779383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc820064ad0 con 0x7fc8201595a0 2023-10-06T03:25:00.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.438+0000 7fc807fff700 1 -- 172.21.15.84:0/1765779383 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc818054a90 con 0x7fc8201595a0 2023-10-06T03:25:00.440 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:25:00.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.440+0000 7fc826493700 1 -- 172.21.15.84:0/1765779383 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc80c066f30 msgr2=0x7fc80c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.440+0000 7fc826493700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc80c066f30 0x7fc80c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc8100061f0 tx=0x7fc810008040 comp rx=0 tx=0).stop 2023-10-06T03:25:00.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.440+0000 7fc826493700 1 -- 172.21.15.84:0/1765779383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8201595a0 msgr2=0x7fc8200cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:00.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.440+0000 7fc826493700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8201595a0 0x7fc8200cde20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c930 tx=0x7fc8180026e0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.440+0000 7fc826493700 1 -- 172.21.15.84:0/1765779383 shutdown_connections 2023-10-06T03:25:00.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.440+0000 7fc826493700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc80c066f30 0x7fc80c0693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.440+0000 7fc826493700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8201595a0 0x7fc8200cde20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.440+0000 7fc826493700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8200b07a0 0x7fc82009a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.440+0000 7fc826493700 1 --2- 172.21.15.84:0/1765779383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8200b49e0 0x7fc820155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:00.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.440+0000 7fc826493700 1 -- 172.21.15.84:0/1765779383 >> 172.21.15.84:0/1765779383 conn(0x7fc820099830 msgr2=0x7fc820157810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:00.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.441+0000 7fc826493700 1 -- 172.21.15.84:0/1765779383 shutdown_connections 2023-10-06T03:25:00.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:00.441+0000 7fc826493700 1 -- 172.21.15.84:0/1765779383 wait complete. 2023-10-06T03:25:00.454 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:25:00.454 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:25:00.454 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:25:00.454 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:25:00.454 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:00.454 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:25:00.454 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:25:00.455 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:25:00.455 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:00.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:00.455 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:25:00.470 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:25:00.470 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:25:00.470 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:25:00.470 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:00.470 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:25:00.470 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:25:00.471 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42454sec preferred_lft 42454sec 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9c01:bbff:fec1:72ce/64 scope link 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::74a6:25ff:fe2a:c673/64 scope link 2023-10-06T03:25:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:00.473 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:00.473 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether de:34:c5:3f:21:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:25:00.473 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc34:c5ff:fe3f:21c3/64 scope link 2023-10-06T03:25:00.473 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:00.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:00.473 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:25:00.533 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:25:00.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:00.534 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:25:00.590 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:25:00.590 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:25:00.590 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:25:00.591 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:25:00.591 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:25:00.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:00.591 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:25:00.591 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:25:00.591 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:25:00.591 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:25:00.591 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:25:00.591 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:25:00.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:00.690 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:25:00.705 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:25:00.705 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:25:00.705 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:00.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:00.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:25:00.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:00.771 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:00.825 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:00.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:00.825 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:00.880 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:25:00.880 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:25:00.881 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:00.960 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:00.960 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:00.978 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:00.978 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:00.978 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:00.979 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:00.979 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:00.979 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:00.979 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:00.979 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:01.002 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:01.002 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:01.002 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:01.002 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:01.002 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:01.002 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:01.002 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:01.003 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:01.003 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:25:01.003 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:25:01.003 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:25:01.004 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:25:01.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:01.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:01.069 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:25:01.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.221+0000 7fd80b433700 1 Processor -- start 2023-10-06T03:25:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.221+0000 7fd80b433700 1 -- start start 2023-10-06T03:25:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.222+0000 7fd80b433700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 0x7fd8040aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.222+0000 7fd80b433700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd8040b49e0 0x7fd8040aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.222+0000 7fd80b433700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040b0ca0 con 0x7fd8040b07a0 2023-10-06T03:25:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.222+0000 7fd80b433700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040b0f80 con 0x7fd8040b49e0 2023-10-06T03:25:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.222+0000 7fd80b433700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040b1260 con 0x7fd8041595a0 2023-10-06T03:25:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.222+0000 7fd8089ce700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd8040b49e0 0x7fd8040aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.222+0000 7fd8091cf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 0x7fd8040aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.222+0000 7fd8089ce700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd8040b49e0 0x7fd8040aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:53354/0 (socket says 172.21.15.84:53354) 2023-10-06T03:25:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.222+0000 7fd8089ce700 1 -- 172.21.15.84:0/3166431642 learned_addr learned my addr 172.21.15.84:0/3166431642 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.222+0000 7fd8099d0700 1 --1- 172.21.15.84:0/3166431642 >> v1:172.21.15.131:6789/0 conn(0x7fd8040b07a0 0x7fd8040b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:35738/0 (socket says 172.21.15.84:35738) 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.223+0000 7fd8091cf700 1 -- 172.21.15.84:0/3166431642 >> v2:172.21.15.131:3300/0 conn(0x7fd8040b49e0 msgr2=0x7fd8040aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.223+0000 7fd8091cf700 1 --2- 172.21.15.84:0/3166431642 >> v2:172.21.15.131:3300/0 conn(0x7fd8040b49e0 0x7fd8040aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.223+0000 7fd8091cf700 1 -- 172.21.15.84:0/3166431642 >> v1:172.21.15.131:6789/0 conn(0x7fd8040b07a0 legacy=0x7fd8040b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.223+0000 7fd8091cf700 1 -- 172.21.15.84:0/3166431642 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040b1540 con 0x7fd8041595a0 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.223+0000 7fd8091cf700 1 --2- 172.21.15.84:0/3166431642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 0x7fd8040aa570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8000098d0 tx=0x7fd800009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9e80abe7a956273 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.223+0000 7fd7fbfff700 1 -- 172.21.15.84:0/3166431642 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800005c10 con 0x7fd8041595a0 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.223+0000 7fd7fbfff700 1 -- 172.21.15.84:0/3166431642 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800005d70 con 0x7fd8041595a0 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.223+0000 7fd7fbfff700 1 -- 172.21.15.84:0/3166431642 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800006280 con 0x7fd8041595a0 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.224+0000 7fd80b433700 1 -- 172.21.15.84:0/3166431642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 msgr2=0x7fd8040aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.224+0000 7fd80b433700 1 --2- 172.21.15.84:0/3166431642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 0x7fd8040aa570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8000098d0 tx=0x7fd800009120 comp rx=0 tx=0).stop 2023-10-06T03:25:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.224+0000 7fd80b433700 1 -- 172.21.15.84:0/3166431642 shutdown_connections 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.224+0000 7fd80b433700 1 --2- 172.21.15.84:0/3166431642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 0x7fd8040aa570 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.224+0000 7fd80b433700 1 --2- 172.21.15.84:0/3166431642 >> v2:172.21.15.131:3300/0 conn(0x7fd8040b49e0 0x7fd8040aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.224+0000 7fd80b433700 1 -- 172.21.15.84:0/3166431642 >> 172.21.15.84:0/3166431642 conn(0x7fd804099830 msgr2=0x7fd80406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.224+0000 7fd80b433700 1 -- 172.21.15.84:0/3166431642 shutdown_connections 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.224+0000 7fd80b433700 1 -- 172.21.15.84:0/3166431642 wait complete. 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.225+0000 7fd80b433700 1 Processor -- start 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.225+0000 7fd80b433700 1 -- start start 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd80b433700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8040b07a0 0x7fd8040c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd80b433700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8040b49e0 0x7fd804157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd80b433700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 0x7fd804169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd80b433700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd804158020 con 0x7fd8040b07a0 2023-10-06T03:25:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd80b433700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80416d2c0 con 0x7fd8040b49e0 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd80b433700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80416cf70 con 0x7fd8041595a0 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8091cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8040b07a0 0x7fd8040c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8091cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8040b07a0 0x7fd8040c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55070/0 (socket says 172.21.15.84:55070) 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8091cf700 1 -- 172.21.15.84:0/1038273129 learned_addr learned my addr 172.21.15.84:0/1038273129 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8099d0700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 0x7fd804169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8089ce700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8040b49e0 0x7fd804157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8091cf700 1 -- 172.21.15.84:0/1038273129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 msgr2=0x7fd804169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8091cf700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 0x7fd804169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8091cf700 1 -- 172.21.15.84:0/1038273129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8040b49e0 msgr2=0x7fd804157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8091cf700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8040b49e0 0x7fd804157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8091cf700 1 -- 172.21.15.84:0/1038273129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8000093c0 con 0x7fd8040b07a0 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8089ce700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8040b49e0 0x7fd804157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.226+0000 7fd8091cf700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8040b07a0 0x7fd8040c7aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd800009f70 tx=0x7fd800016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.227+0000 7fd7f97fa700 1 -- 172.21.15.84:0/1038273129 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80001d780 con 0x7fd8040b07a0 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.227+0000 7fd7f97fa700 1 -- 172.21.15.84:0/1038273129 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80001d8e0 con 0x7fd8040b07a0 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.227+0000 7fd80b433700 1 -- 172.21.15.84:0/1038273129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80416a1c0 con 0x7fd8040b07a0 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.227+0000 7fd7f97fa700 1 -- 172.21.15.84:0/1038273129 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80001dc80 con 0x7fd8040b07a0 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.227+0000 7fd80b433700 1 -- 172.21.15.84:0/1038273129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80416a780 con 0x7fd8040b07a0 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.227+0000 7fd80b433700 1 -- 172.21.15.84:0/1038273129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd804064ad0 con 0x7fd8040b07a0 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.228+0000 7fd7f97fa700 1 -- 172.21.15.84:0/1038273129 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd80001b690 con 0x7fd8040b07a0 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.228+0000 7fd7f97fa700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd7e8066f30 0x7fd7e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.228+0000 7fd7f97fa700 1 -- 172.21.15.84:0/1038273129 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd800086480 con 0x7fd8040b07a0 2023-10-06T03:25:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.228+0000 7fd8089ce700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd7e8066f30 0x7fd7e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.229+0000 7fd8089ce700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd7e8066f30 0x7fd7e80693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4006d40 tx=0x7fd7f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.232+0000 7fd7f97fa700 1 -- 172.21.15.84:0/1038273129 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd800053450 con 0x7fd8040b07a0 2023-10-06T03:25:01.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.460+0000 7fd80b433700 1 -- 172.21.15.84:0/1038273129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd8040b1820 con 0x7fd8040b07a0 2023-10-06T03:25:01.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.460+0000 7fd7f97fa700 1 -- 172.21.15.84:0/1038273129 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd800056a70 con 0x7fd8040b07a0 2023-10-06T03:25:01.462 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:25:01.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 -- 172.21.15.84:0/1038273129 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd7e8066f30 msgr2=0x7fd7e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd7e8066f30 0x7fd7e80693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4006d40 tx=0x7fd7f4008040 comp rx=0 tx=0).stop 2023-10-06T03:25:01.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 -- 172.21.15.84:0/1038273129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8040b07a0 msgr2=0x7fd8040c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8040b07a0 0x7fd8040c7aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd800009f70 tx=0x7fd800016000 comp rx=0 tx=0).stop 2023-10-06T03:25:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 -- 172.21.15.84:0/1038273129 shutdown_connections 2023-10-06T03:25:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd7e8066f30 0x7fd7e80693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8041595a0 0x7fd804169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8040b07a0 0x7fd8040c7aa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 --2- 172.21.15.84:0/1038273129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8040b49e0 0x7fd804157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 -- 172.21.15.84:0/1038273129 >> 172.21.15.84:0/1038273129 conn(0x7fd804099830 msgr2=0x7fd8040cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 -- 172.21.15.84:0/1038273129 shutdown_connections 2023-10-06T03:25:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:01.462+0000 7fd80b433700 1 -- 172.21.15.84:0/1038273129 wait complete. 2023-10-06T03:25:01.475 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:25:01.476 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:25:01.476 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T03:25:01.476 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:25:01.476 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:01.476 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:25:01.476 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:25:01.476 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:25:01.476 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:25:01.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:01.476 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T03:25:01.495 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:25:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:25:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:25:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:25:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:25:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42451sec preferred_lft 42451sec 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::a0d2:65ff:fe0e:962d/64 scope link 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether e6:c9:c5:59:18:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::e4c9:c5ff:fe59:18bb/64 scope link 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:01.497 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:01.498 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:25:01.498 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4f1:c0ff:fe85:853d/64 scope link 2023-10-06T03:25:01.498 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:01.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:01.498 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:25:01.562 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T03:25:01.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:01.564 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T03:25:01.621 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T03:25:01.622 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:25:01.622 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:25:01.622 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:25:01.622 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:25:01.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:01.622 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:25:01.623 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:25:01.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:25:01.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:25:01.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:25:01.623 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:25:01.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:01.728 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:25:01.742 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:25:01.743 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:25:01.743 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:25:01.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:01.743 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-10-06T03:25:01.808 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:01.808 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:01.863 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:25:01.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:01.863 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:01.917 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T03:25:01.918 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:25:01.918 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:01.997 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:01.997 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:02.016 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:02.016 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:02.016 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:02.016 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:02.016 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:02.017 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:02.017 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:02.017 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:02.040 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:25:02.040 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:25:02.040 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:25:02.041 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:25:02.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:02.043 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:02.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2023-10-06T03:25:02.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.223+0000 7f09aa87a700 1 Processor -- start 2023-10-06T03:25:02.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.223+0000 7f09aa87a700 1 -- start start 2023-10-06T03:25:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.224+0000 7f09aa87a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40cbcb0 0x7f09a40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.224+0000 7f09aa87a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a40cf610 con 0x7f09a41598e0 2023-10-06T03:25:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.224+0000 7f09aa87a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a40cf8f0 con 0x7f09a4159510 2023-10-06T03:25:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.224+0000 7f09aa87a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40cfbd0 con 0x7f09a40cbcb0 2023-10-06T03:25:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.224+0000 7f09a37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f09a41598e0 0x7f09a40ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57748/0 (socket says 172.21.15.84:57748) 2023-10-06T03:25:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.224+0000 7f09a37fe700 1 -- 172.21.15.84:0/3281714782 learned_addr learned my addr 172.21.15.84:0/3281714782 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.224+0000 7f09a8e17700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40cbcb0 0x7f09a40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.224+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079451241 0 0) 0x7f09a40cf610 con 0x7f09a41598e0 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f098c003570 con 0x7f09a41598e0 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750106257 0 0) 0x7f09a40cf8f0 con 0x7f09a4159510 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a40cf610 con 0x7f09a4159510 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 650872166 0 0) 0x7f098c003570 con 0x7f09a41598e0 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40cbcb0 msgr2=0x7f09a40cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40cbcb0 0x7f09a40cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 >> v1:172.21.15.131:6789/0 conn(0x7f09a4159510 legacy=0x7f09a40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a40cfeb0 con 0x7f09a41598e0 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f0998001470 con 0x7f09a41598e0 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a8e17700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40cbcb0 0x7f09a40cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 >> v1:172.21.15.84:6789/0 conn(0x7f09a41598e0 legacy=0x7f09a40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 0x7f098c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40cbcb0 0x7f098c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f098c004d50 0x7f098c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40cfbd0 con 0x7f098c003c20 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c00bb10 con 0x7f098c004d50 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c00bcd0 con 0x7f09a40cbcb0 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a3fff700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 0x7f098c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a37fe700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40cbcb0 0x7f098c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a8e17700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f098c004d50 0x7f098c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a3fff700 1 -- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40cbcb0 msgr2=0x7f098c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a3fff700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40cbcb0 0x7f098c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a3fff700 1 -- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f098c004d50 msgr2=0x7f098c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a3fff700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f098c004d50 0x7f098c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a3fff700 1 -- 172.21.15.84:0/3281714782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c009a20 con 0x7f098c003c20 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.225+0000 7f09a3fff700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 0x7f098c004010 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0994001a10 tx=0x7f0994007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f7510245f20d7c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.226+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400c5d0 con 0x7f098c003c20 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.226+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099400c730 con 0x7f098c003c20 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.226+0000 7f09a2ffd700 1 -- 172.21.15.84:0/3281714782 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400cad0 con 0x7f098c003c20 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.226+0000 7f09aa87a700 1 -- 172.21.15.84:0/3281714782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 msgr2=0x7f098c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.226+0000 7f09aa87a700 1 --2- 172.21.15.84:0/3281714782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 0x7f098c004010 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0994001a10 tx=0x7f0994007d30 comp rx=0 tx=0).stop 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.226+0000 7f09a8e17700 1 -- 172.21.15.84:0/3281714782 reap_dead start 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.226+0000 7f09aa87a700 1 -- 172.21.15.84:0/3281714782 shutdown_connections 2023-10-06T03:25:02.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.226+0000 7f09aa87a700 1 -- 172.21.15.84:0/3281714782 >> 172.21.15.84:0/3281714782 conn(0x7f09a4089e90 msgr2=0x7f09a40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.226+0000 7f09aa87a700 1 -- 172.21.15.84:0/3281714782 shutdown_connections 2023-10-06T03:25:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.226+0000 7f09aa87a700 1 -- 172.21.15.84:0/3281714782 wait complete. 2023-10-06T03:25:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.227+0000 7f09aa87a700 1 Processor -- start 2023-10-06T03:25:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.227+0000 7f09aa87a700 1 -- start start 2023-10-06T03:25:02.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09aa87a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 0x7f09a4152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09aa87a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09a40b5f50 0x7f09a4155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09aa87a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40c9630 0x7f09a40c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09aa87a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40ca000 con 0x7f098c003c20 2023-10-06T03:25:02.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09aa87a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40b3dc0 con 0x7f09a40b5f50 2023-10-06T03:25:02.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09aa87a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40b3490 con 0x7f09a40c9630 2023-10-06T03:25:02.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 0x7f09a4152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 0x7f09a4152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55086/0 (socket says 172.21.15.84:55086) 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09a3fff700 1 -- 172.21.15.84:0/4162891181 learned_addr learned my addr 172.21.15.84:0/4162891181 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09a37fe700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09a40b5f50 0x7f09a4155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.228+0000 7f09a8e17700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40c9630 0x7f09a40c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f09a3fff700 1 -- 172.21.15.84:0/4162891181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40c9630 msgr2=0x7f09a40c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f09a3fff700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40c9630 0x7f09a40c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f09a3fff700 1 -- 172.21.15.84:0/4162891181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09a40b5f50 msgr2=0x7f09a4155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f09a3fff700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09a40b5f50 0x7f09a4155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f09a3fff700 1 -- 172.21.15.84:0/4162891181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a40b3770 con 0x7f098c003c20 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f09a3fff700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 0x7f09a4152550 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f099400c3c0 tx=0x7f0994015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:02.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f098bfff700 1 -- 172.21.15.84:0/4162891181 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400c5d0 con 0x7f098c003c20 2023-10-06T03:25:02.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f098bfff700 1 -- 172.21.15.84:0/4162891181 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0994000fe0 con 0x7f098c003c20 2023-10-06T03:25:02.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f09aa87a700 1 -- 172.21.15.84:0/4162891181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a40b3a50 con 0x7f098c003c20 2023-10-06T03:25:02.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f098bfff700 1 -- 172.21.15.84:0/4162891181 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994006a50 con 0x7f098c003c20 2023-10-06T03:25:02.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.229+0000 7f09aa87a700 1 -- 172.21.15.84:0/4162891181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a4155ea0 con 0x7f098c003c20 2023-10-06T03:25:02.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.230+0000 7f09aa87a700 1 -- 172.21.15.84:0/4162891181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a4064ad0 con 0x7f098c003c20 2023-10-06T03:25:02.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.230+0000 7f098bfff700 1 -- 172.21.15.84:0/4162891181 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0994019070 con 0x7f098c003c20 2023-10-06T03:25:02.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.231+0000 7f098bfff700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0990066f30 0x7f09900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.231+0000 7f09a37fe700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0990066f30 0x7f09900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.231+0000 7f098bfff700 1 -- 172.21.15.84:0/4162891181 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0994085a50 con 0x7f098c003c20 2023-10-06T03:25:02.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.231+0000 7f09a37fe700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0990066f30 0x7f09900693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f09a40c6470 tx=0x7f0998001df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:02.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.235+0000 7f098bfff700 1 -- 172.21.15.84:0/4162891181 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0994052a20 con 0x7f098c003c20 2023-10-06T03:25:02.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.418+0000 7f09aa87a700 1 -- 172.21.15.84:0/4162891181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) v1 -- 0x7f09a40b40a0 con 0x7f098c003c20 2023-10-06T03:25:02.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.421+0000 7f098bfff700 1 -- 172.21.15.84:0/4162891181 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v11)=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7f09940230c0 con 0x7f098c003c20 2023-10-06T03:25:02.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 -- 172.21.15.84:0/4162891181 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0990066f30 msgr2=0x7f09900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0990066f30 0x7f09900693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f09a40c6470 tx=0x7f0998001df0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 -- 172.21.15.84:0/4162891181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 msgr2=0x7f09a4152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 0x7f09a4152550 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f099400c3c0 tx=0x7f0994015000 comp rx=0 tx=0).stop 2023-10-06T03:25:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 -- 172.21.15.84:0/4162891181 shutdown_connections 2023-10-06T03:25:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0990066f30 0x7f09900693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09a40c9630 0x7f09a40c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f098c003c20 0x7f09a4152550 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 --2- 172.21.15.84:0/4162891181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09a40b5f50 0x7f09a4155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 -- 172.21.15.84:0/4162891181 >> 172.21.15.84:0/4162891181 conn(0x7f09a4089e90 msgr2=0x7f09a40d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 -- 172.21.15.84:0/4162891181 shutdown_connections 2023-10-06T03:25:02.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.424+0000 7f09aa87a700 1 -- 172.21.15.84:0/4162891181 wait complete. 2023-10-06T03:25:02.437 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:25:02.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:25:02.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:02.484 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:25:02.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:02.484 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:25:02.499 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:25:02.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:25:02.499 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:02.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:25:02.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:02.548 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:25:02.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:02.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.675+0000 7ff01de0b700 1 Processor -- start 2023-10-06T03:25:02.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.675+0000 7ff01de0b700 1 -- start start 2023-10-06T03:25:02.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.675+0000 7ff01de0b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0181595a0 0x7ff0180aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.675+0000 7ff01de0b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff0180b49e0 0x7ff0180aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.675+0000 7ff01de0b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0180b0ca0 con 0x7ff0180b07a0 2023-10-06T03:25:02.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.675+0000 7ff01de0b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0180b0f80 con 0x7ff0181595a0 2023-10-06T03:25:02.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.675+0000 7ff01de0b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0180b1260 con 0x7ff0180b49e0 2023-10-06T03:25:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff0177fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0181595a0 0x7ff0180aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff0177fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0181595a0 0x7ff0180aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55096/0 (socket says 172.21.15.84:55096) 2023-10-06T03:25:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff0177fe700 1 -- 172.21.15.84:0/2596053024 learned_addr learned my addr 172.21.15.84:0/2596053024 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff00effd700 1 --2- 172.21.15.84:0/2596053024 >> v2:172.21.15.131:3300/0 conn(0x7ff0180b49e0 0x7ff0180aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff0177fe700 1 -- 172.21.15.84:0/2596053024 >> v2:172.21.15.131:3300/0 conn(0x7ff0180b49e0 msgr2=0x7ff0180aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff0177fe700 1 --2- 172.21.15.84:0/2596053024 >> v2:172.21.15.131:3300/0 conn(0x7ff0180b49e0 0x7ff0180aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff0177fe700 1 -- 172.21.15.84:0/2596053024 >> v1:172.21.15.131:6789/0 conn(0x7ff0180b07a0 legacy=0x7ff0180b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff0177fe700 1 -- 172.21.15.84:0/2596053024 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0180b1540 con 0x7ff0181595a0 2023-10-06T03:25:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff0177fe700 1 --2- 172.21.15.84:0/2596053024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0181595a0 0x7ff0180aa570 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff008009990 tx=0x7ff008009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9a357f4df46668 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff016ffd700 1 -- 172.21.15.84:0/2596053024 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008005c10 con 0x7ff0181595a0 2023-10-06T03:25:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff016ffd700 1 -- 172.21.15.84:0/2596053024 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008005d70 con 0x7ff0181595a0 2023-10-06T03:25:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.676+0000 7ff016ffd700 1 -- 172.21.15.84:0/2596053024 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00800b800 con 0x7ff0181595a0 2023-10-06T03:25:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.677+0000 7ff01de0b700 1 -- 172.21.15.84:0/2596053024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0181595a0 msgr2=0x7ff0180aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.677+0000 7ff01de0b700 1 --2- 172.21.15.84:0/2596053024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0181595a0 0x7ff0180aa570 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff008009990 tx=0x7ff008009220 comp rx=0 tx=0).stop 2023-10-06T03:25:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.677+0000 7ff01de0b700 1 -- 172.21.15.84:0/2596053024 shutdown_connections 2023-10-06T03:25:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.677+0000 7ff01de0b700 1 --2- 172.21.15.84:0/2596053024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0181595a0 0x7ff0180aa570 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.677+0000 7ff01de0b700 1 --2- 172.21.15.84:0/2596053024 >> v2:172.21.15.131:3300/0 conn(0x7ff0180b49e0 0x7ff0180aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.677+0000 7ff01de0b700 1 -- 172.21.15.84:0/2596053024 >> 172.21.15.84:0/2596053024 conn(0x7ff018099830 msgr2=0x7ff01806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:02.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.677+0000 7ff01de0b700 1 -- 172.21.15.84:0/2596053024 shutdown_connections 2023-10-06T03:25:02.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.677+0000 7ff01de0b700 1 -- 172.21.15.84:0/2596053024 wait complete. 2023-10-06T03:25:02.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.678+0000 7ff01de0b700 1 Processor -- start 2023-10-06T03:25:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.678+0000 7ff01de0b700 1 -- start start 2023-10-06T03:25:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff01de0b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0180b07a0 0x7ff018156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff01de0b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0180b49e0 0x7ff01815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff01de0b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0181595a0 0x7ff01809d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff01de0b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01809b0f0 con 0x7ff0180b49e0 2023-10-06T03:25:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff01de0b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01809a4e0 con 0x7ff0180b07a0 2023-10-06T03:25:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff01de0b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01809a7c0 con 0x7ff0181595a0 2023-10-06T03:25:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0180b49e0 0x7ff01815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0180b49e0 0x7ff01815b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55110/0 (socket says 172.21.15.84:55110) 2023-10-06T03:25:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00effd700 1 -- 172.21.15.84:0/217493705 learned_addr learned my addr 172.21.15.84:0/217493705 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff0177fe700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0180b07a0 0x7ff018156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff017fff700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0181595a0 0x7ff01809d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00effd700 1 -- 172.21.15.84:0/217493705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0181595a0 msgr2=0x7ff01809d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00effd700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0181595a0 0x7ff01809d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00effd700 1 -- 172.21.15.84:0/217493705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0180b07a0 msgr2=0x7ff018156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00effd700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0180b07a0 0x7ff018156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00effd700 1 -- 172.21.15.84:0/217493705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008009480 con 0x7ff0180b49e0 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff017fff700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0181595a0 0x7ff01809d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00effd700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0180b49e0 0x7ff01815b8d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c880 tx=0x7ff000008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00ffff700 1 -- 172.21.15.84:0/217493705 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011600 con 0x7ff0180b49e0 2023-10-06T03:25:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00ffff700 1 -- 172.21.15.84:0/217493705 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000011780 con 0x7ff0180b49e0 2023-10-06T03:25:02.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff01de0b700 1 -- 172.21.15.84:0/217493705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01809aaa0 con 0x7ff0180b49e0 2023-10-06T03:25:02.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.679+0000 7ff00ffff700 1 -- 172.21.15.84:0/217493705 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011b40 con 0x7ff0180b49e0 2023-10-06T03:25:02.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.680+0000 7ff01de0b700 1 -- 172.21.15.84:0/217493705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff018157140 con 0x7ff0180b49e0 2023-10-06T03:25:02.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.680+0000 7ff01de0b700 1 -- 172.21.15.84:0/217493705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff018064ad0 con 0x7ff0180b49e0 2023-10-06T03:25:02.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.681+0000 7ff00ffff700 1 -- 172.21.15.84:0/217493705 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0000193f0 con 0x7ff0180b49e0 2023-10-06T03:25:02.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.681+0000 7ff00ffff700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feff8066fb0 0x7feff8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.681+0000 7ff00ffff700 1 -- 172.21.15.84:0/217493705 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff000084b60 con 0x7ff0180b49e0 2023-10-06T03:25:02.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.681+0000 7ff0177fe700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feff8066fb0 0x7feff8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.682+0000 7ff0177fe700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feff8066fb0 0x7feff8069460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff008003080 tx=0x7ff008015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:02.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.686+0000 7ff00ffff700 1 -- 172.21.15.84:0/217493705 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff000051b40 con 0x7ff0180b49e0 2023-10-06T03:25:02.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.913+0000 7ff01de0b700 1 -- 172.21.15.84:0/217493705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0180b1820 con 0x7ff0180b49e0 2023-10-06T03:25:02.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.913+0000 7ff00ffff700 1 -- 172.21.15.84:0/217493705 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7ff000055160 con 0x7ff0180b49e0 2023-10-06T03:25:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:02.915 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1693550238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1693550238},{"type":"v1","addr":"172.21.15.131:6834","nonce":1693550238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2817652058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2817652058},{"type":"v1","addr":"172.21.15.131:6835","nonce":2817652058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/688702713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":688702713},{"type":"v1","addr":"172.21.15.84:6836","nonce":688702713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:24:49.172387+0000","modified":"2023-10-06T03:24:52.828381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/1939836196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1939836196},{"type":"v1","addr":"172.21.15.84:6837","nonce":1939836196}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:25:02.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 -- 172.21.15.84:0/217493705 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feff8066fb0 msgr2=0x7feff8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feff8066fb0 0x7feff8069460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff008003080 tx=0x7ff008015000 comp rx=0 tx=0).stop 2023-10-06T03:25:02.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 -- 172.21.15.84:0/217493705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0180b49e0 msgr2=0x7ff01815b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0180b49e0 0x7ff01815b8d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c880 tx=0x7ff000008040 comp rx=0 tx=0).stop 2023-10-06T03:25:02.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 -- 172.21.15.84:0/217493705 shutdown_connections 2023-10-06T03:25:02.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7feff8066fb0 0x7feff8069460 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0180b07a0 0x7ff018156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0181595a0 0x7ff01809d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 --2- 172.21.15.84:0/217493705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0180b49e0 0x7ff01815b8d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 -- 172.21.15.84:0/217493705 >> 172.21.15.84:0/217493705 conn(0x7ff018099830 msgr2=0x7ff0180b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:02.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 -- 172.21.15.84:0/217493705 shutdown_connections 2023-10-06T03:25:02.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:02.915+0000 7ff01de0b700 1 -- 172.21.15.84:0/217493705 wait complete. 2023-10-06T03:25:02.921 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-10-06T03:25:02.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2023-10-06T03:25:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":20,"msgr_send_messages":21,"msgr_recv_bytes":5122,"msgr_send_bytes":11349,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.003694497,"msgr_running_send_time":0.000278087,"msgr_running_recv_time":0.001856764,"msgr_running_fast_dispatch_time":0.000331184,"msgr_send_messages_queue_lat":{"avgcount":20,"sum":0.026932485,"avgtime":0.001346624},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":82,"msgr_send_messages":75,"msgr_recv_bytes":114049,"msgr_send_bytes":42411,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.006644072,"msgr_running_send_time":0.001501294,"msgr_running_recv_time":0.011031466,"msgr_running_fast_dispatch_time":0.000370842,"msgr_send_messages_queue_lat":{"avgcount":75,"sum":0.011243120,"avgtime":0.000149908},"msgr_handle_ack_lat":{"avgcount":7,"sum":0.000003150,"avgtime":0.000000450}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":17,"msgr_send_messages":23,"msgr_recv_bytes":4193,"msgr_send_bytes":94338,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.003511192,"msgr_running_send_time":0.000507728,"msgr_running_recv_time":0.002757784,"msgr_running_fast_dispatch_time":0.000223309,"msgr_send_messages_queue_lat":{"avgcount":21,"sum":0.012815289,"avgtime":0.000610251},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000002021,"avgtime":0.000001010}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":59,"sum":0.001709331,"avgtime":0.000028971}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010845,"avgtime":0.000005422}},"mds":{"request":4,"reply":4,"reply_latency":{"avgcount":4,"sum":0.000865965,"avgtime":0.000216491},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":7,"traverse_hit":7,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":175,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196957,"rdpos":0,"jlat":{"avgcount":5,"sum":0.007674547,"avgtime":0.001534909},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":34988,"heap":207104},"mds_server":{"dispatch_client_request":4,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":3,"sum":0.000586830,"avgtime":0.000195610},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000279135,"avgtime":0.000279135},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":3,"average_load":1,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":212695,"buffer_anon_items":59,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6216,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50464,"mds_co_items":205,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13597,"op_resend":37,"op_reply":43,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":38,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":114,"get_sum":108864,"get_or_fail_fail":0,"get_or_fail_success":114,"take":0,"take_sum":0,"put":114,"put_sum":108864,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13597,"put":43,"put_sum":13597,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55b3b2475e00":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":2653,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":5,"put_sum":2653,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:25:03.063 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 5122, "msgr_recv_messages": 20, "msgr_running_fast_dispatch_time": 0.000331184, "msgr_running_recv_time": 0.001856764, "msgr_running_send_time": 0.000278087, "msgr_running_total_time": 0.003694497, "msgr_send_bytes": 11349, "msgr_send_messages": 21, "msgr_send_messages_queue_lat": { "avgcount": 20, "avgtime": 0.001346624, "sum": 0.026932485 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 7, "avgtime": 4.5e-07, "sum": 3.15e-06 }, "msgr_recv_bytes": 114049, "msgr_recv_messages": 82, "msgr_running_fast_dispatch_time": 0.000370842, "msgr_running_recv_time": 0.011031466, "msgr_running_send_time": 0.001501294, "msgr_running_total_time": 0.006644072, "msgr_send_bytes": 42411, "msgr_send_messages": 75, "msgr_send_messages_queue_lat": { "avgcount": 75, "avgtime": 0.000149908, "sum": 0.01124312 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.01e-06, "sum": 2.021e-06 }, "msgr_recv_bytes": 4193, "msgr_recv_messages": 17, "msgr_running_fast_dispatch_time": 0.000223309, "msgr_running_recv_time": 0.002757784, "msgr_running_send_time": 0.000507728, "msgr_running_total_time": 0.003511192, "msgr_send_bytes": 94338, "msgr_send_messages": 23, "msgr_send_messages_queue_lat": { "avgcount": 21, "avgtime": 0.000610251, "sum": 0.012815289 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 59, "avgtime": 2.8971e-05, "sum": 0.001709331 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.422e-06, "sum": 1.0845e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 175, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 4, "reply_latency": { "avgcount": 4, "avgtime": 0.000216491, "sum": 0.000865965 }, "request": 4, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 7, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 7, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.001534909, "sum": 0.007674547 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196957 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207104, "ino": 13, "ino+": 13, "ino-": 0, "rss": 34988 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 3, "avgtime": 0.00019561, "sum": 0.00058683 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000279135, "sum": 0.000279135 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 3 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 212695, "buffer_anon_items": 59, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50464, "mds_co_items": 205, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6216, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 38, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 37, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13597, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 114, "get_or_fail_fail": 0, "get_or_fail_success": 114, "get_started": 0, "get_sum": 108864, "max": 104857600, "put": 114, "put_sum": 108864, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13597, "take": 43, "take_sum": 13597, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55b3b2475e00": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 2653, "max": 3758096384, "put": 5, "put_sum": 2653, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:25:03.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:25:03.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.176+0000 7fafacdf6700 1 Processor -- start 2023-10-06T03:25:03.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.176+0000 7fafacdf6700 1 -- start start 2023-10-06T03:25:03.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7fafacdf6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fafa80ab930 0x7fafa81573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7fafacdf6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafa80ca610 0x7fafa8068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7fafacdf6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa815aff0 con 0x7fafa8157010 2023-10-06T03:25:03.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7fafacdf6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa815bc70 con 0x7fafa80ab930 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7fafacdf6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa80cc830 con 0x7fafa80ca610 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7faf9dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fafa80ab930 0x7fafa81573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7fafa659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fafa8157010 0x7fafa80cc120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57754/0 (socket says 172.21.15.84:57754) 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7fafa659c700 1 -- 172.21.15.84:0/1998943511 learned_addr learned my addr 172.21.15.84:0/1998943511 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7fafa6d9d700 1 --2- 172.21.15.84:0/1998943511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafa80ca610 0x7fafa8068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7faf9dd9b700 1 -- 172.21.15.84:0/1998943511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafa80ca610 msgr2=0x7fafa8068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7faf9dd9b700 1 --2- 172.21.15.84:0/1998943511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafa80ca610 0x7fafa8068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7faf9dd9b700 1 -- 172.21.15.84:0/1998943511 >> v1:172.21.15.84:6789/0 conn(0x7fafa8157010 legacy=0x7fafa80cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7faf9dd9b700 1 -- 172.21.15.84:0/1998943511 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa815b2d0 con 0x7fafa80ab930 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.177+0000 7fafa5d9b700 1 -- 172.21.15.84:0/1998943511 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898694805 0 0) 0x7fafa815aff0 con 0x7fafa8157010 2023-10-06T03:25:03.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7faf9dd9b700 1 --2- 172.21.15.84:0/1998943511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa80ab930 0x7fafa81573e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7faf900098e0 tx=0x7faf900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76ee7610678f282 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafa5d9b700 1 -- 172.21.15.84:0/1998943511 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90009e80 con 0x7fafa80ab930 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafa5d9b700 1 -- 172.21.15.84:0/1998943511 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9000b860 con 0x7fafa80ab930 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafa5d9b700 1 -- 172.21.15.84:0/1998943511 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9000bbe0 con 0x7fafa80ab930 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafacdf6700 1 -- 172.21.15.84:0/1998943511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa80ab930 msgr2=0x7fafa81573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafacdf6700 1 --2- 172.21.15.84:0/1998943511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa80ab930 0x7fafa81573e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7faf900098e0 tx=0x7faf900091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafacdf6700 1 -- 172.21.15.84:0/1998943511 shutdown_connections 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafacdf6700 1 --2- 172.21.15.84:0/1998943511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafa80ca610 0x7fafa8068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafacdf6700 1 --2- 172.21.15.84:0/1998943511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa80ab930 0x7fafa81573e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafacdf6700 1 -- 172.21.15.84:0/1998943511 >> 172.21.15.84:0/1998943511 conn(0x7fafa806dd10 msgr2=0x7fafa806e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafacdf6700 1 -- 172.21.15.84:0/1998943511 shutdown_connections 2023-10-06T03:25:03.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.178+0000 7fafacdf6700 1 -- 172.21.15.84:0/1998943511 wait complete. 2023-10-06T03:25:03.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.179+0000 7fafacdf6700 1 Processor -- start 2023-10-06T03:25:03.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.180+0000 7fafacdf6700 1 -- start start 2023-10-06T03:25:03.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.180+0000 7fafacdf6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafa80ab930 0x7fafa814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.180+0000 7fafacdf6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafa80ca610 0x7fafa80aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.180+0000 7fafacdf6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa8157010 0x7fafa8155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.180+0000 7fafacdf6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa80aa820 con 0x7fafa8157010 2023-10-06T03:25:03.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.180+0000 7fafacdf6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa815a290 con 0x7fafa80ca610 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.180+0000 7fafacdf6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa8154370 con 0x7fafa80ab930 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.180+0000 7fafa6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa8157010 0x7fafa8155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.180+0000 7fafa6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa8157010 0x7fafa8155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55132/0 (socket says 172.21.15.84:55132) 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.180+0000 7fafa6d9d700 1 -- 172.21.15.84:0/359951120 learned_addr learned my addr 172.21.15.84:0/359951120 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7fafa659c700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafa80ab930 0x7fafa814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7faf9dd9b700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafa80ca610 0x7fafa80aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7fafa6d9d700 1 -- 172.21.15.84:0/359951120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafa80ab930 msgr2=0x7fafa814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7fafa6d9d700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafa80ab930 0x7fafa814dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7fafa6d9d700 1 -- 172.21.15.84:0/359951120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafa80ca610 msgr2=0x7fafa80aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7fafa6d9d700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafa80ca610 0x7fafa80aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7fafa6d9d700 1 -- 172.21.15.84:0/359951120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90009420 con 0x7fafa8157010 2023-10-06T03:25:03.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7faf9dd9b700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafa80ca610 0x7fafa80aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:03.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7fafa6d9d700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa8157010 0x7fafa8155820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009fd0 tx=0x7fafa0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:03.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7faf9effd700 1 -- 172.21.15.84:0/359951120 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa000ed50 con 0x7fafa8157010 2023-10-06T03:25:03.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7faf9effd700 1 -- 172.21.15.84:0/359951120 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa000eeb0 con 0x7fafa8157010 2023-10-06T03:25:03.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7fafacdf6700 1 -- 172.21.15.84:0/359951120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa8154090 con 0x7fafa8157010 2023-10-06T03:25:03.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7faf9effd700 1 -- 172.21.15.84:0/359951120 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0014650 con 0x7fafa8157010 2023-10-06T03:25:03.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.181+0000 7fafacdf6700 1 -- 172.21.15.84:0/359951120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa815a7a0 con 0x7fafa8157010 2023-10-06T03:25:03.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.182+0000 7fafacdf6700 1 -- 172.21.15.84:0/359951120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa8064ad0 con 0x7fafa8157010 2023-10-06T03:25:03.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.182+0000 7faf9effd700 1 -- 172.21.15.84:0/359951120 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafa00149c0 con 0x7fafa8157010 2023-10-06T03:25:03.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.182+0000 7faf9effd700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faf88066f30 0x7faf880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.183+0000 7faf9effd700 1 -- 172.21.15.84:0/359951120 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fafa0084fc0 con 0x7fafa8157010 2023-10-06T03:25:03.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.183+0000 7fafa659c700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faf88066f30 0x7faf880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.183+0000 7fafa659c700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faf88066f30 0x7faf880693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf9800c8f0 tx=0x7faf98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:03.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.187+0000 7faf9effd700 1 -- 172.21.15.84:0/359951120 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafa0051f90 con 0x7fafa8157010 2023-10-06T03:25:03.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.411+0000 7fafacdf6700 1 -- 172.21.15.84:0/359951120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fafa815b5b0 con 0x7fafa8157010 2023-10-06T03:25:03.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.412+0000 7faf9effd700 1 -- 172.21.15.84:0/359951120 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fafa00555b0 con 0x7fafa8157010 2023-10-06T03:25:03.414 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:25:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 -- 172.21.15.84:0/359951120 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faf88066f30 msgr2=0x7faf880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faf88066f30 0x7faf880693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf9800c8f0 tx=0x7faf98009040 comp rx=0 tx=0).stop 2023-10-06T03:25:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 -- 172.21.15.84:0/359951120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa8157010 msgr2=0x7fafa8155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa8157010 0x7fafa8155820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009fd0 tx=0x7fafa0009900 comp rx=0 tx=0).stop 2023-10-06T03:25:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 -- 172.21.15.84:0/359951120 shutdown_connections 2023-10-06T03:25:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faf88066f30 0x7faf880693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafa8157010 0x7fafa8155820 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafa80ab930 0x7fafa814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 --2- 172.21.15.84:0/359951120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafa80ca610 0x7fafa80aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 -- 172.21.15.84:0/359951120 >> 172.21.15.84:0/359951120 conn(0x7fafa806dd10 msgr2=0x7fafa814fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:03.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 -- 172.21.15.84:0/359951120 shutdown_connections 2023-10-06T03:25:03.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:03.414+0000 7fafacdf6700 1 -- 172.21.15.84:0/359951120 wait complete. 2023-10-06T03:25:03.427 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:25:03.427 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:25:03.428 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:25:03.428 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:25:03.428 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:03.428 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:25:03.429 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:25:03.429 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:25:03.429 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:03.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:03.429 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:25:03.444 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:25:03.444 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:25:03.444 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:25:03.444 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:03.444 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:25:03.444 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:03.444 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:03.444 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:03.444 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42451sec preferred_lft 42451sec 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:25:03.445 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9c01:bbff:fec1:72ce/64 scope link 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::74a6:25ff:fe2a:c673/64 scope link 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:03.446 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:03.447 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether de:34:c5:3f:21:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:25:03.447 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc34:c5ff:fe3f:21c3/64 scope link 2023-10-06T03:25:03.447 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:03.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:03.447 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:25:03.507 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:25:03.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:03.509 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:25:03.565 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:25:03.565 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:25:03.565 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:25:03.566 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:25:03.566 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:25:03.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:03.566 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:25:03.566 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:25:03.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:25:03.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:25:03.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:25:03.566 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:25:03.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:03.665 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:25:03.679 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:25:03.679 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:25:03.679 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:03.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:03.680 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:25:03.743 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:03.744 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:03.798 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:03.798 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:03.798 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:03.852 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:25:03.852 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:25:03.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:03.931 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:03.932 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:03.950 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:03.950 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:03.950 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:03.950 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:03.951 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:03.951 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:03.951 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:03.951 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:03.972 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:03.973 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:03.973 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:03.973 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:03.973 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:03.973 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:03.973 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:03.973 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:03.973 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:25:03.973 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:25:03.973 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:25:03.975 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:25:03.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:03.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:04.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2023-10-06T03:25:04.211 INFO:teuthology.orchestra.run.smithi084.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":21,"msgr_send_messages":22,"msgr_recv_bytes":5368,"msgr_send_bytes":11920,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.003823810,"msgr_running_send_time":0.000302832,"msgr_running_recv_time":0.001875658,"msgr_running_fast_dispatch_time":0.000353864,"msgr_send_messages_queue_lat":{"avgcount":21,"sum":0.026946819,"avgtime":0.001283181},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":84,"msgr_send_messages":77,"msgr_recv_bytes":114506,"msgr_send_bytes":43028,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.006982019,"msgr_running_send_time":0.001580344,"msgr_running_recv_time":0.011301026,"msgr_running_fast_dispatch_time":0.000370842,"msgr_send_messages_queue_lat":{"avgcount":77,"sum":0.011267819,"avgtime":0.000146335},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000004354,"avgtime":0.000000483}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":17,"msgr_send_messages":23,"msgr_recv_bytes":4193,"msgr_send_bytes":94338,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.003511192,"msgr_running_send_time":0.000507728,"msgr_running_recv_time":0.002757784,"msgr_running_fast_dispatch_time":0.000223309,"msgr_send_messages_queue_lat":{"avgcount":21,"sum":0.012815289,"avgtime":0.000610251},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000002021,"avgtime":0.000001010}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":61,"sum":0.001748324,"avgtime":0.000028661}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010845,"avgtime":0.000005422}},"mds":{"request":5,"reply":5,"reply_latency":{"avgcount":5,"sum":0.001002031,"avgtime":0.000200406},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":9,"traverse_hit":9,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":175,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197217,"rdpos":0,"jlat":{"avgcount":6,"sum":0.009472510,"avgtime":0.001578751},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":34988,"heap":207104},"mds_server":{"dispatch_client_request":5,"dispatch_server_request":0,"handle_client_request":5,"handle_client_session":7,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":4,"sum":0.000722896,"avgtime":0.000180724},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000279135,"avgtime":0.000279135},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":3,"session_remove":2,"sessions_open":1,"sessions_stale":0,"total_load":4,"average_load":4,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":212695,"buffer_anon_items":59,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6216,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50464,"mds_co_items":205,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":13857,"op_resend":37,"op_reply":44,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":6,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":38,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":117,"get_sum":109329,"get_or_fail_fail":0,"get_or_fail_success":117,"take":0,"take_sum":0,"put":117,"put_sum":109329,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":13857,"put":44,"put_sum":13857,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55b3b2475e00":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2913,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":6,"put_sum":2913,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:25:04.213 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 5368, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000353864, "msgr_running_recv_time": 0.001875658, "msgr_running_send_time": 0.000302832, "msgr_running_total_time": 0.00382381, "msgr_send_bytes": 11920, "msgr_send_messages": 22, "msgr_send_messages_queue_lat": { "avgcount": 21, "avgtime": 0.001283181, "sum": 0.026946819 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 4.83e-07, "sum": 4.354e-06 }, "msgr_recv_bytes": 114506, "msgr_recv_messages": 84, "msgr_running_fast_dispatch_time": 0.000370842, "msgr_running_recv_time": 0.011301026, "msgr_running_send_time": 0.001580344, "msgr_running_total_time": 0.006982019, "msgr_send_bytes": 43028, "msgr_send_messages": 77, "msgr_send_messages_queue_lat": { "avgcount": 77, "avgtime": 0.000146335, "sum": 0.011267819 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.01e-06, "sum": 2.021e-06 }, "msgr_recv_bytes": 4193, "msgr_recv_messages": 17, "msgr_running_fast_dispatch_time": 0.000223309, "msgr_running_recv_time": 0.002757784, "msgr_running_send_time": 0.000507728, "msgr_running_total_time": 0.003511192, "msgr_send_bytes": 94338, "msgr_send_messages": 23, "msgr_send_messages_queue_lat": { "avgcount": 21, "avgtime": 0.000610251, "sum": 0.012815289 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 61, "avgtime": 2.8661e-05, "sum": 0.001748324 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.422e-06, "sum": 1.0845e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 175, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 5, "reply_latency": { "avgcount": 5, "avgtime": 0.000200406, "sum": 0.001002031 }, "request": 5, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 9, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 9, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 6, "avgtime": 0.001578751, "sum": 0.00947251 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197217 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207104, "ino": 13, "ino+": 13, "ino-": 0, "rss": 34988 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 5, "dispatch_server_request": 0, "handle_client_request": 5, "handle_client_session": 7, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 4, "avgtime": 0.000180724, "sum": 0.000722896 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000279135, "sum": 0.000279135 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 4, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 3, "session_count": 1, "session_remove": 2, "sessions_open": 1, "sessions_stale": 0, "total_load": 4 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 212695, "buffer_anon_items": 59, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50464, "mds_co_items": 205, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6216, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 38, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 13857, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 6, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 117, "get_or_fail_fail": 0, "get_or_fail_success": 117, "get_started": 0, "get_sum": 109329, "max": 104857600, "put": 117, "put_sum": 109329, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 13857, "take": 44, "take_sum": 13857, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55b3b2475e00": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2913, "max": 3758096384, "put": 6, "put_sum": 2913, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:25:04.214 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:25:04.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:25:04.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:04.250 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:25:04.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:04.251 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:25:04.305 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2023-10-06T03:25:04.477 INFO:teuthology.orchestra.run.smithi084.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":22,"msgr_send_messages":23,"msgr_recv_bytes":5614,"msgr_send_bytes":12372,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.003947175,"msgr_running_send_time":0.000354515,"msgr_running_recv_time":0.001896369,"msgr_running_fast_dispatch_time":0.000381392,"msgr_send_messages_queue_lat":{"avgcount":22,"sum":0.026982222,"avgtime":0.001226464},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":86,"msgr_send_messages":78,"msgr_recv_bytes":114710,"msgr_send_bytes":43131,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.007175253,"msgr_running_send_time":0.001638733,"msgr_running_recv_time":0.011471901,"msgr_running_fast_dispatch_time":0.000370842,"msgr_send_messages_queue_lat":{"avgcount":78,"sum":0.011279634,"avgtime":0.000144610},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000004354,"avgtime":0.000000483}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":17,"msgr_send_messages":23,"msgr_recv_bytes":4193,"msgr_send_bytes":94338,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.003511192,"msgr_running_send_time":0.000507728,"msgr_running_recv_time":0.002757784,"msgr_running_fast_dispatch_time":0.000223309,"msgr_send_messages_queue_lat":{"avgcount":21,"sum":0.012815289,"avgtime":0.000610251},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000002021,"avgtime":0.000001010}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":63,"sum":0.001805240,"avgtime":0.000028654}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010845,"avgtime":0.000005422}},"mds":{"request":5,"reply":5,"reply_latency":{"avgcount":5,"sum":0.001002031,"avgtime":0.000200406},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":9,"traverse_hit":9,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":175,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":9,"evex":0,"evtrm":0,"ev":9,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197358,"rdpos":0,"jlat":{"avgcount":7,"sum":0.011148722,"avgtime":0.001592674},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":34988,"heap":207104},"mds_server":{"dispatch_client_request":5,"dispatch_server_request":0,"handle_client_request":5,"handle_client_session":9,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":4,"sum":0.000722896,"avgtime":0.000180724},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000279135,"avgtime":0.000279135},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":3,"session_remove":3,"sessions_open":0,"sessions_stale":0,"total_load":4,"average_load":4,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":212695,"buffer_anon_items":59,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6216,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50464,"mds_co_items":205,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":45,"op_send_bytes":13998,"op_resend":37,"op_reply":45,"oplen_avg":{"avgcount":45,"sum":69},"op":45,"op_r":0,"op_w":45,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":7,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":38,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":120,"get_sum":109541,"get_or_fail_fail":0,"get_or_fail_success":120,"take":0,"take_sum":0,"put":120,"put_sum":109541,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":13998,"put":45,"put_sum":13998,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":45,"put":45,"put_sum":45,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55b3b2475e00":{"val":0,"max":3758096384,"get_started":0,"get":9,"get_sum":3054,"get_or_fail_fail":0,"get_or_fail_success":9,"take":0,"take_sum":0,"put":7,"put_sum":3054,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:25:04.478 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 5614, "msgr_recv_messages": 22, "msgr_running_fast_dispatch_time": 0.000381392, "msgr_running_recv_time": 0.001896369, "msgr_running_send_time": 0.000354515, "msgr_running_total_time": 0.003947175, "msgr_send_bytes": 12372, "msgr_send_messages": 23, "msgr_send_messages_queue_lat": { "avgcount": 22, "avgtime": 0.001226464, "sum": 0.026982222 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 4.83e-07, "sum": 4.354e-06 }, "msgr_recv_bytes": 114710, "msgr_recv_messages": 86, "msgr_running_fast_dispatch_time": 0.000370842, "msgr_running_recv_time": 0.011471901, "msgr_running_send_time": 0.001638733, "msgr_running_total_time": 0.007175253, "msgr_send_bytes": 43131, "msgr_send_messages": 78, "msgr_send_messages_queue_lat": { "avgcount": 78, "avgtime": 0.00014461, "sum": 0.011279634 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.01e-06, "sum": 2.021e-06 }, "msgr_recv_bytes": 4193, "msgr_recv_messages": 17, "msgr_running_fast_dispatch_time": 0.000223309, "msgr_running_recv_time": 0.002757784, "msgr_running_send_time": 0.000507728, "msgr_running_total_time": 0.003511192, "msgr_send_bytes": 94338, "msgr_send_messages": 23, "msgr_send_messages_queue_lat": { "avgcount": 21, "avgtime": 0.000610251, "sum": 0.012815289 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 63, "avgtime": 2.8654e-05, "sum": 0.00180524 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.422e-06, "sum": 1.0845e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 175, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 5, "reply_latency": { "avgcount": 5, "avgtime": 0.000200406, "sum": 0.001002031 }, "request": 5, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 9, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 9, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 9, "evadd": 9, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 7, "avgtime": 0.001592674, "sum": 0.011148722 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197358 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207104, "ino": 13, "ino+": 13, "ino-": 0, "rss": 34988 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 5, "dispatch_server_request": 0, "handle_client_request": 5, "handle_client_session": 9, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 4, "avgtime": 0.000180724, "sum": 0.000722896 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000279135, "sum": 0.000279135 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 4, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 3, "session_count": 0, "session_remove": 3, "sessions_open": 0, "sessions_stale": 0, "total_load": 4 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 212695, "buffer_anon_items": 59, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50464, "mds_co_items": 205, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6216, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 38, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 45, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 45, "op_resend": 37, "op_rmw": 0, "op_send": 45, "op_send_bytes": 13998, "op_w": 45, "oplen_avg": { "avgcount": 45, "sum": 69 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 7, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 120, "get_or_fail_fail": 0, "get_or_fail_success": 120, "get_started": 0, "get_sum": 109541, "max": 104857600, "put": 120, "put_sum": 109541, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 45, "put_sum": 13998, "take": 45, "take_sum": 13998, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 45, "put_sum": 45, "take": 45, "take_sum": 45, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55b3b2475e00": { "get": 9, "get_or_fail_fail": 0, "get_or_fail_success": 9, "get_started": 0, "get_sum": 3054, "max": 3758096384, "put": 7, "put_sum": 3054, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:25:04.481 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T03:25:04.481 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:25:04.481 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:04.521 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:04.573 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:25:04.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.686+0000 7fc5364f5700 1 Processor -- start 2023-10-06T03:25:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.686+0000 7fc5364f5700 1 -- start start 2023-10-06T03:25:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc5364f5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc5301595a0 0x7fc5300aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc5364f5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5300b49e0 0x7fc5300aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc5364f5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5300b0ca0 con 0x7fc5300b07a0 2023-10-06T03:25:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc5364f5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5300b0f80 con 0x7fc5300b49e0 2023-10-06T03:25:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc5364f5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5300b1260 con 0x7fc5301595a0 2023-10-06T03:25:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc52f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5300b49e0 0x7fc5300aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc52f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5300b49e0 0x7fc5300aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55148/0 (socket says 172.21.15.84:55148) 2023-10-06T03:25:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc52f7fe700 1 -- 172.21.15.84:0/2498878788 learned_addr learned my addr 172.21.15.84:0/2498878788 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc52ffff700 1 --2- 172.21.15.84:0/2498878788 >> v2:172.21.15.131:3300/0 conn(0x7fc5301595a0 0x7fc5300aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc52f7fe700 1 -- 172.21.15.84:0/2498878788 >> v2:172.21.15.131:3300/0 conn(0x7fc5301595a0 msgr2=0x7fc5300aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.687+0000 7fc52f7fe700 1 --2- 172.21.15.84:0/2498878788 >> v2:172.21.15.131:3300/0 conn(0x7fc5301595a0 0x7fc5300aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc52f7fe700 1 -- 172.21.15.84:0/2498878788 >> v1:172.21.15.131:6789/0 conn(0x7fc5300b07a0 legacy=0x7fc5300b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc52f7fe700 1 -- 172.21.15.84:0/2498878788 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5300b1540 con 0x7fc5300b49e0 2023-10-06T03:25:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc52ffff700 1 --2- 172.21.15.84:0/2498878788 >> v2:172.21.15.131:3300/0 conn(0x7fc5301595a0 0x7fc5300aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc52f7fe700 1 --2- 172.21.15.84:0/2498878788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b49e0 0x7fc5300aaab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc5240099b0 tx=0x7fc524009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191096d2bbfc3c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc52effd700 1 -- 172.21.15.84:0/2498878788 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400b7e0 con 0x7fc5300b49e0 2023-10-06T03:25:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc52effd700 1 -- 172.21.15.84:0/2498878788 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52400b940 con 0x7fc5300b49e0 2023-10-06T03:25:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc52effd700 1 -- 172.21.15.84:0/2498878788 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400bce0 con 0x7fc5300b49e0 2023-10-06T03:25:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc5364f5700 1 -- 172.21.15.84:0/2498878788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b49e0 msgr2=0x7fc5300aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc5364f5700 1 --2- 172.21.15.84:0/2498878788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b49e0 0x7fc5300aaab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc5240099b0 tx=0x7fc524009250 comp rx=0 tx=0).stop 2023-10-06T03:25:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc5364f5700 1 -- 172.21.15.84:0/2498878788 shutdown_connections 2023-10-06T03:25:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc5364f5700 1 --2- 172.21.15.84:0/2498878788 >> v2:172.21.15.131:3300/0 conn(0x7fc5301595a0 0x7fc5300aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc5364f5700 1 --2- 172.21.15.84:0/2498878788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b49e0 0x7fc5300aaab0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc5364f5700 1 -- 172.21.15.84:0/2498878788 >> 172.21.15.84:0/2498878788 conn(0x7fc530099830 msgr2=0x7fc53006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc5364f5700 1 -- 172.21.15.84:0/2498878788 shutdown_connections 2023-10-06T03:25:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.688+0000 7fc5364f5700 1 -- 172.21.15.84:0/2498878788 wait complete. 2023-10-06T03:25:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.689+0000 7fc5364f5700 1 Processor -- start 2023-10-06T03:25:04.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.690+0000 7fc5364f5700 1 -- start start 2023-10-06T03:25:04.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.690+0000 7fc5364f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b07a0 0x7fc530155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.690+0000 7fc5364f5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5300b49e0 0x7fc53009d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.690+0000 7fc5364f5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5301595a0 0x7fc5300ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.690+0000 7fc5364f5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53015b880 con 0x7fc5300b07a0 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.690+0000 7fc5364f5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53009ddc0 con 0x7fc5300b49e0 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.690+0000 7fc5364f5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53009dae0 con 0x7fc5301595a0 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.690+0000 7fc52ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b07a0 0x7fc530155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.690+0000 7fc52ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b07a0 0x7fc530155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55162/0 (socket says 172.21.15.84:55162) 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.690+0000 7fc52ffff700 1 -- 172.21.15.84:0/955834672 learned_addr learned my addr 172.21.15.84:0/955834672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc52f7fe700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5300b49e0 0x7fc53009d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc534a92700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5301595a0 0x7fc5300ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc52ffff700 1 -- 172.21.15.84:0/955834672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5301595a0 msgr2=0x7fc5300ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc52ffff700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5301595a0 0x7fc5300ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc52ffff700 1 -- 172.21.15.84:0/955834672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5300b49e0 msgr2=0x7fc53009d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc52ffff700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5300b49e0 0x7fc53009d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc52ffff700 1 -- 172.21.15.84:0/955834672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240094f0 con 0x7fc5300b07a0 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc52ffff700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b07a0 0x7fc530155b70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc52000c880 tx=0x7fc520008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc517fff700 1 -- 172.21.15.84:0/955834672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520005a00 con 0x7fc5300b07a0 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc517fff700 1 -- 172.21.15.84:0/955834672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520005b60 con 0x7fc5300b07a0 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc5364f5700 1 -- 172.21.15.84:0/955834672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53015b230 con 0x7fc5300b07a0 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc517fff700 1 -- 172.21.15.84:0/955834672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520011600 con 0x7fc5300b07a0 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.691+0000 7fc5364f5700 1 -- 172.21.15.84:0/955834672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53009ac40 con 0x7fc5300b07a0 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.692+0000 7fc5364f5700 1 -- 172.21.15.84:0/955834672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc530064ad0 con 0x7fc5300b07a0 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.692+0000 7fc517fff700 1 -- 172.21.15.84:0/955834672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5200119f0 con 0x7fc5300b07a0 2023-10-06T03:25:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.693+0000 7fc517fff700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc51c066f30 0x7fc51c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.693+0000 7fc517fff700 1 -- 172.21.15.84:0/955834672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc5200845e0 con 0x7fc5300b07a0 2023-10-06T03:25:04.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.693+0000 7fc52f7fe700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc51c066f30 0x7fc51c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.693+0000 7fc52f7fe700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc51c066f30 0x7fc51c0693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc530088e20 tx=0x7fc524016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:04.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.697+0000 7fc517fff700 1 -- 172.21.15.84:0/955834672 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5200515b0 con 0x7fc5300b07a0 2023-10-06T03:25:04.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.926+0000 7fc5364f5700 1 -- 172.21.15.84:0/955834672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5300b1820 con 0x7fc5300b07a0 2023-10-06T03:25:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.926+0000 7fc517fff700 1 -- 172.21.15.84:0/955834672 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fc520054bd0 con 0x7fc5300b07a0 2023-10-06T03:25:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:04.929 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1693550238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1693550238},{"type":"v1","addr":"172.21.15.131:6834","nonce":1693550238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2817652058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2817652058},{"type":"v1","addr":"172.21.15.131:6835","nonce":2817652058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/688702713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":688702713},{"type":"v1","addr":"172.21.15.84:6836","nonce":688702713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:24:49.172387+0000","modified":"2023-10-06T03:24:52.828381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/1939836196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1939836196},{"type":"v1","addr":"172.21.15.84:6837","nonce":1939836196}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:25:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.928+0000 7fc5364f5700 1 -- 172.21.15.84:0/955834672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc51c066f30 msgr2=0x7fc51c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.928+0000 7fc5364f5700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc51c066f30 0x7fc51c0693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc530088e20 tx=0x7fc524016000 comp rx=0 tx=0).stop 2023-10-06T03:25:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.928+0000 7fc5364f5700 1 -- 172.21.15.84:0/955834672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b07a0 msgr2=0x7fc530155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.928+0000 7fc5364f5700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b07a0 0x7fc530155b70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc52000c880 tx=0x7fc520008040 comp rx=0 tx=0).stop 2023-10-06T03:25:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.928+0000 7fc5364f5700 1 -- 172.21.15.84:0/955834672 shutdown_connections 2023-10-06T03:25:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.928+0000 7fc5364f5700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc51c066f30 0x7fc51c0693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.928+0000 7fc5364f5700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5301595a0 0x7fc5300ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.928+0000 7fc5364f5700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5300b07a0 0x7fc530155b70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.928+0000 7fc5364f5700 1 --2- 172.21.15.84:0/955834672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5300b49e0 0x7fc53009d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.928+0000 7fc5364f5700 1 -- 172.21.15.84:0/955834672 >> 172.21.15.84:0/955834672 conn(0x7fc530099830 msgr2=0x7fc5300692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.929+0000 7fc5364f5700 1 -- 172.21.15.84:0/955834672 shutdown_connections 2023-10-06T03:25:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:04.929+0000 7fc5364f5700 1 -- 172.21.15.84:0/955834672 wait complete. 2023-10-06T03:25:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-10-06T03:25:04.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:05.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.055+0000 7fb7436ec700 1 Processor -- start 2023-10-06T03:25:05.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.055+0000 7fb7436ec700 1 -- start start 2023-10-06T03:25:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.056+0000 7fb7436ec700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb73c157640 0x7fb73c06e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.056+0000 7fb7436ec700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb73c067d00 0x7fb73c0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.056+0000 7fb7436ec700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73c06bd00 con 0x7fb73c0ca980 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.056+0000 7fb7436ec700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73c0b0720 con 0x7fb73c157640 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.056+0000 7fb7436ec700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c0ca730 con 0x7fb73c067d00 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.056+0000 7fb741488700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb73c157640 0x7fb73c06e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.056+0000 7fb741488700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb73c157640 0x7fb73c06e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55168/0 (socket says 172.21.15.84:55168) 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.056+0000 7fb741488700 1 -- 172.21.15.84:0/3633239442 learned_addr learned my addr 172.21.15.84:0/3633239442 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb741c89700 1 --2- 172.21.15.84:0/3633239442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb73c067d00 0x7fb73c0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb741488700 1 -- 172.21.15.84:0/3633239442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb73c067d00 msgr2=0x7fb73c0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb741488700 1 --2- 172.21.15.84:0/3633239442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb73c067d00 0x7fb73c0b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb741488700 1 -- 172.21.15.84:0/3633239442 >> v1:172.21.15.131:6789/0 conn(0x7fb73c0ca980 legacy=0x7fb73c0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb741488700 1 -- 172.21.15.84:0/3633239442 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c06ed10 con 0x7fb73c157640 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb741488700 1 --2- 172.21.15.84:0/3633239442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c157640 0x7fb73c06e6c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009f20 tx=0x7fb72c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d66010bb218066 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb73bfff700 1 -- 172.21.15.84:0/3633239442 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00e070 con 0x7fb73c157640 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb73bfff700 1 -- 172.21.15.84:0/3633239442 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c00ba80 con 0x7fb73c157640 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb73bfff700 1 -- 172.21.15.84:0/3633239442 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0092e0 con 0x7fb73c157640 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb7436ec700 1 -- 172.21.15.84:0/3633239442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c157640 msgr2=0x7fb73c06e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb7436ec700 1 --2- 172.21.15.84:0/3633239442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c157640 0x7fb73c06e6c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009f20 tx=0x7fb72c009840 comp rx=0 tx=0).stop 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb7436ec700 1 -- 172.21.15.84:0/3633239442 shutdown_connections 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.057+0000 7fb7436ec700 1 --2- 172.21.15.84:0/3633239442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb73c067d00 0x7fb73c0b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.058+0000 7fb7436ec700 1 --2- 172.21.15.84:0/3633239442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c157640 0x7fb73c06e6c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.058+0000 7fb7436ec700 1 -- 172.21.15.84:0/3633239442 >> 172.21.15.84:0/3633239442 conn(0x7fb73c0cdef0 msgr2=0x7fb73c0c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.058+0000 7fb7436ec700 1 -- 172.21.15.84:0/3633239442 shutdown_connections 2023-10-06T03:25:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.058+0000 7fb7436ec700 1 -- 172.21.15.84:0/3633239442 wait complete. 2023-10-06T03:25:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.059+0000 7fb7436ec700 1 Processor -- start 2023-10-06T03:25:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.059+0000 7fb7436ec700 1 -- start start 2023-10-06T03:25:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7436ec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb73c067d00 0x7fb73c0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7436ec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c0ca980 0x7fb73c153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7436ec700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb73c157640 0x7fb73c1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7436ec700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c0c8070 con 0x7fb73c0ca980 2023-10-06T03:25:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7436ec700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c1543a0 con 0x7fb73c067d00 2023-10-06T03:25:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7436ec700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c153790 con 0x7fb73c157640 2023-10-06T03:25:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb740c87700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c0ca980 0x7fb73c153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb740c87700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c0ca980 0x7fb73c153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55176/0 (socket says 172.21.15.84:55176) 2023-10-06T03:25:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb740c87700 1 -- 172.21.15.84:0/815534111 learned_addr learned my addr 172.21.15.84:0/815534111 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb741c89700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb73c157640 0x7fb73c1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb741488700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb73c067d00 0x7fb73c0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb740c87700 1 -- 172.21.15.84:0/815534111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb73c157640 msgr2=0x7fb73c1501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb740c87700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb73c157640 0x7fb73c1501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb740c87700 1 -- 172.21.15.84:0/815534111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb73c067d00 msgr2=0x7fb73c0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb740c87700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb73c067d00 0x7fb73c0af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb740c87700 1 -- 172.21.15.84:0/815534111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c009ae0 con 0x7fb73c0ca980 2023-10-06T03:25:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb741488700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb73c067d00 0x7fb73c0af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb740c87700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c0ca980 0x7fb73c153120 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb73000c790 tx=0x7fb730007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7397fa700 1 -- 172.21.15.84:0/815534111 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb730011590 con 0x7fb73c0ca980 2023-10-06T03:25:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7397fa700 1 -- 172.21.15.84:0/815534111 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb730011710 con 0x7fb73c0ca980 2023-10-06T03:25:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7436ec700 1 -- 172.21.15.84:0/815534111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73c153a70 con 0x7fb73c0ca980 2023-10-06T03:25:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7397fa700 1 -- 172.21.15.84:0/815534111 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb730011ad0 con 0x7fb73c0ca980 2023-10-06T03:25:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.060+0000 7fb7436ec700 1 -- 172.21.15.84:0/815534111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73c154030 con 0x7fb73c0ca980 2023-10-06T03:25:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.061+0000 7fb7436ec700 1 -- 172.21.15.84:0/815534111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73c064ad0 con 0x7fb73c0ca980 2023-10-06T03:25:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.062+0000 7fb7397fa700 1 -- 172.21.15.84:0/815534111 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb73001b3b0 con 0x7fb73c0ca980 2023-10-06T03:25:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.062+0000 7fb7397fa700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb728066f30 0x7fb7280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.062+0000 7fb7397fa700 1 -- 172.21.15.84:0/815534111 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb730083c90 con 0x7fb73c0ca980 2023-10-06T03:25:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.062+0000 7fb741488700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb728066f30 0x7fb7280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.062+0000 7fb741488700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb728066f30 0x7fb7280693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009880 tx=0x7fb72c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.066+0000 7fb7397fa700 1 -- 172.21.15.84:0/815534111 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb730050c60 con 0x7fb73c0ca980 2023-10-06T03:25:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.249+0000 7fb7436ec700 1 -- 172.21.15.84:0/815534111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb73c06eff0 con 0x7fb73c0ca980 2023-10-06T03:25:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.249+0000 7fb7397fa700 1 -- 172.21.15.84:0/815534111 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fb730017070 con 0x7fb73c0ca980 2023-10-06T03:25:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:05.252 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:24:50.800397+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:46.821084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:48.147630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:05.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.251+0000 7fb7436ec700 1 -- 172.21.15.84:0/815534111 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb728066f30 msgr2=0x7fb7280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.251+0000 7fb7436ec700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb728066f30 0x7fb7280693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009880 tx=0x7fb72c018000 comp rx=0 tx=0).stop 2023-10-06T03:25:05.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.251+0000 7fb7436ec700 1 -- 172.21.15.84:0/815534111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c0ca980 msgr2=0x7fb73c153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.251+0000 7fb7436ec700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c0ca980 0x7fb73c153120 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb73000c790 tx=0x7fb730007f40 comp rx=0 tx=0).stop 2023-10-06T03:25:05.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.251+0000 7fb7436ec700 1 -- 172.21.15.84:0/815534111 shutdown_connections 2023-10-06T03:25:05.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.251+0000 7fb7436ec700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb728066f30 0x7fb7280693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.251+0000 7fb7436ec700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb73c067d00 0x7fb73c0af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.251+0000 7fb7436ec700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb73c157640 0x7fb73c1501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.251+0000 7fb7436ec700 1 --2- 172.21.15.84:0/815534111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c0ca980 0x7fb73c153120 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.252+0000 7fb7436ec700 1 -- 172.21.15.84:0/815534111 >> 172.21.15.84:0/815534111 conn(0x7fb73c0cdef0 msgr2=0x7fb73c0c3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:05.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.252+0000 7fb7436ec700 1 -- 172.21.15.84:0/815534111 shutdown_connections 2023-10-06T03:25:05.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.252+0000 7fb7436ec700 1 -- 172.21.15.84:0/815534111 wait complete. 2023-10-06T03:25:05.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:24:46.821084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:24:48.147630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:25:05.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:25:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.381+0000 7ff8e7413700 1 Processor -- start 2023-10-06T03:25:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.381+0000 7ff8e7413700 1 -- start start 2023-10-06T03:25:05.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e7413700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8e0159510 0x7ff8e00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e7413700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff8e01598e0 0x7ff8e00cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e7413700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e00cf370 con 0x7ff8e00ce820 2023-10-06T03:25:05.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e7413700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e00cf610 con 0x7ff8e0159510 2023-10-06T03:25:05.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e7413700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e00cf8f0 con 0x7ff8e01598e0 2023-10-06T03:25:05.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e51af700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8e0159510 0x7ff8e00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e59b0700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff8e00ce820 0x7ff8e00cec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57758/0 (socket says 172.21.15.84:57758) 2023-10-06T03:25:05.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e59b0700 1 -- 172.21.15.84:0/3155187184 learned_addr learned my addr 172.21.15.84:0/3155187184 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:05.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e49ae700 1 --2- 172.21.15.84:0/3155187184 >> v2:172.21.15.131:3300/0 conn(0x7ff8e01598e0 0x7ff8e00cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e51af700 1 -- 172.21.15.84:0/3155187184 >> v2:172.21.15.131:3300/0 conn(0x7ff8e01598e0 msgr2=0x7ff8e00cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e51af700 1 --2- 172.21.15.84:0/3155187184 >> v2:172.21.15.131:3300/0 conn(0x7ff8e01598e0 0x7ff8e00cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e51af700 1 -- 172.21.15.84:0/3155187184 >> v1:172.21.15.84:6789/0 conn(0x7ff8e00ce820 legacy=0x7ff8e00cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8d7fff700 1 -- 172.21.15.84:0/3155187184 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992580274 0 0) 0x7ff8e00cf370 con 0x7ff8e00ce820 2023-10-06T03:25:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e51af700 1 -- 172.21.15.84:0/3155187184 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e00cfbd0 con 0x7ff8e0159510 2023-10-06T03:25:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.382+0000 7ff8e49ae700 1 --2- 172.21.15.84:0/3155187184 >> v2:172.21.15.131:3300/0 conn(0x7ff8e01598e0 0x7ff8e00cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8e51af700 1 --2- 172.21.15.84:0/3155187184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 0x7ff8e00cb5a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00c73b0 tx=0x7ff8dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81b095fed9f8f60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8d7fff700 1 -- 172.21.15.84:0/3155187184 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc00b6b0 con 0x7ff8e0159510 2023-10-06T03:25:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8d7fff700 1 -- 172.21.15.84:0/3155187184 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc00b810 con 0x7ff8e0159510 2023-10-06T03:25:05.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8d7fff700 1 -- 172.21.15.84:0/3155187184 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc00bbb0 con 0x7ff8e0159510 2023-10-06T03:25:05.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8e7413700 1 -- 172.21.15.84:0/3155187184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 msgr2=0x7ff8e00cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8e7413700 1 --2- 172.21.15.84:0/3155187184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 0x7ff8e00cb5a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00c73b0 tx=0x7ff8dc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8e7413700 1 -- 172.21.15.84:0/3155187184 shutdown_connections 2023-10-06T03:25:05.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8e7413700 1 --2- 172.21.15.84:0/3155187184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 0x7ff8e00cb5a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8e7413700 1 --2- 172.21.15.84:0/3155187184 >> v2:172.21.15.131:3300/0 conn(0x7ff8e01598e0 0x7ff8e00cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8e7413700 1 -- 172.21.15.84:0/3155187184 >> 172.21.15.84:0/3155187184 conn(0x7ff8e0089e90 msgr2=0x7ff8e00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:05.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8e7413700 1 -- 172.21.15.84:0/3155187184 shutdown_connections 2023-10-06T03:25:05.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.383+0000 7ff8e7413700 1 -- 172.21.15.84:0/3155187184 wait complete. 2023-10-06T03:25:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.384+0000 7ff8e7413700 1 Processor -- start 2023-10-06T03:25:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.384+0000 7ff8e7413700 1 -- start start 2023-10-06T03:25:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.385+0000 7ff8e7413700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e00ce820 0x7ff8e0155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.385+0000 7ff8e7413700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 0x7ff8e014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.385+0000 7ff8e7413700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e01598e0 0x7ff8e0156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.385+0000 7ff8e7413700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00c98f0 con 0x7ff8e0159510 2023-10-06T03:25:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.385+0000 7ff8e7413700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00c9bd0 con 0x7ff8e00ce820 2023-10-06T03:25:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.385+0000 7ff8e7413700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00c9eb0 con 0x7ff8e01598e0 2023-10-06T03:25:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.385+0000 7ff8e49ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 0x7ff8e014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.385+0000 7ff8e49ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 0x7ff8e014e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55180/0 (socket says 172.21.15.84:55180) 2023-10-06T03:25:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.385+0000 7ff8e49ae700 1 -- 172.21.15.84:0/3617856522 learned_addr learned my addr 172.21.15.84:0/3617856522 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8e51af700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e00ce820 0x7ff8e0155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8e59b0700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e01598e0 0x7ff8e0156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8e49ae700 1 -- 172.21.15.84:0/3617856522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e01598e0 msgr2=0x7ff8e0156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8e49ae700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e01598e0 0x7ff8e0156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8e49ae700 1 -- 172.21.15.84:0/3617856522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e00ce820 msgr2=0x7ff8e0155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8e49ae700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e00ce820 0x7ff8e0155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8e49ae700 1 -- 172.21.15.84:0/3617856522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc009420 con 0x7ff8e0159510 2023-10-06T03:25:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8e49ae700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 0x7ff8e014e140 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d860 tx=0x7ff8d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8d57fa700 1 -- 172.21.15.84:0/3617856522 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00125f0 con 0x7ff8e0159510 2023-10-06T03:25:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8d57fa700 1 -- 172.21.15.84:0/3617856522 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d0012750 con 0x7ff8e0159510 2023-10-06T03:25:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8e7413700 1 -- 172.21.15.84:0/3617856522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e00ca190 con 0x7ff8e0159510 2023-10-06T03:25:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8d57fa700 1 -- 172.21.15.84:0/3617856522 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0012b10 con 0x7ff8e0159510 2023-10-06T03:25:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.386+0000 7ff8e7413700 1 -- 172.21.15.84:0/3617856522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e01574e0 con 0x7ff8e0159510 2023-10-06T03:25:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.387+0000 7ff8e7413700 1 -- 172.21.15.84:0/3617856522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e00b4350 con 0x7ff8e0159510 2023-10-06T03:25:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.387+0000 7ff8d57fa700 1 -- 172.21.15.84:0/3617856522 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8d001e460 con 0x7ff8e0159510 2023-10-06T03:25:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.388+0000 7ff8d57fa700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff8c4066f30 0x7ff8c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.388+0000 7ff8d57fa700 1 -- 172.21.15.84:0/3617856522 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff8d0084df0 con 0x7ff8e0159510 2023-10-06T03:25:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.388+0000 7ff8e51af700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff8c4066f30 0x7ff8c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.388+0000 7ff8e51af700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff8c4066f30 0x7ff8c40693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0091e0 tx=0x7ff8dc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.392+0000 7ff8d57fa700 1 -- 172.21.15.84:0/3617856522 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8e00b4350 con 0x7ff8e0159510 2023-10-06T03:25:05.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.574+0000 7ff8e7413700 1 -- 172.21.15.84:0/3617856522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff8e00b4350 con 0x7ff8e0159510 2023-10-06T03:25:05.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.575+0000 7ff8d57fa700 1 -- 172.21.15.84:0/3617856522 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff8e00b4350 con 0x7ff8e0159510 2023-10-06T03:25:05.577 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:25:05.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 -- 172.21.15.84:0/3617856522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff8c4066f30 msgr2=0x7ff8c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff8c4066f30 0x7ff8c40693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0091e0 tx=0x7ff8dc017000 comp rx=0 tx=0).stop 2023-10-06T03:25:05.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 -- 172.21.15.84:0/3617856522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 msgr2=0x7ff8e014e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 0x7ff8e014e140 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d860 tx=0x7ff8d0008040 comp rx=0 tx=0).stop 2023-10-06T03:25:05.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 -- 172.21.15.84:0/3617856522 shutdown_connections 2023-10-06T03:25:05.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff8c4066f30 0x7ff8c40693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e00ce820 0x7ff8e0155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e01598e0 0x7ff8e0156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 --2- 172.21.15.84:0/3617856522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e0159510 0x7ff8e014e140 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 -- 172.21.15.84:0/3617856522 >> 172.21.15.84:0/3617856522 conn(0x7ff8e0089e90 msgr2=0x7ff8e015bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:05.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 -- 172.21.15.84:0/3617856522 shutdown_connections 2023-10-06T03:25:05.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.577+0000 7ff8e7413700 1 -- 172.21.15.84:0/3617856522 wait complete. 2023-10-06T03:25:05.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:25:05.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.706+0000 7fe8f96c9700 1 Processor -- start 2023-10-06T03:25:05.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.706+0000 7fe8f96c9700 1 -- start start 2023-10-06T03:25:05.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f96c9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8f40b2660 0x7fe8f40cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f96c9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f40cc9b0 con 0x7fe8f40cf1f0 2023-10-06T03:25:05.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f96c9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f40cbda0 con 0x7fe8f40b2a30 2023-10-06T03:25:05.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f96c9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f40cc080 con 0x7fe8f40b2660 2023-10-06T03:25:05.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8f40b2660 0x7fe8f40cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f8ec8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe8f40cf1f0 0x7fe8f40c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57760/0 (socket says 172.21.15.84:57760) 2023-10-06T03:25:05.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f8ec8700 1 -- 172.21.15.84:0/2911732444 learned_addr learned my addr 172.21.15.84:0/2911732444 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f3fff700 1 -- 172.21.15.84:0/2911732444 >> v1:172.21.15.131:6789/0 conn(0x7fe8f40b2a30 legacy=0x7fe8f40ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f3fff700 1 -- 172.21.15.84:0/2911732444 >> v1:172.21.15.84:6789/0 conn(0x7fe8f40cf1f0 legacy=0x7fe8f40c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f3fff700 1 -- 172.21.15.84:0/2911732444 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f40cc360 con 0x7fe8f40b2660 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f3fff700 1 --2- 172.21.15.84:0/2911732444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 0x7fe8f40cccf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40098d0 tx=0x7fe8e4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e79e2aa2e3a2c4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.707+0000 7fe8f2ffd700 1 -- 172.21.15.84:0/2911732444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4009e70 con 0x7fe8f40b2660 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.708+0000 7fe8f2ffd700 1 -- 172.21.15.84:0/2911732444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e4005c10 con 0x7fe8f40b2660 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.708+0000 7fe8f2ffd700 1 -- 172.21.15.84:0/2911732444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400b650 con 0x7fe8f40b2660 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.708+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2911732444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 msgr2=0x7fe8f40cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.708+0000 7fe8f96c9700 1 --2- 172.21.15.84:0/2911732444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 0x7fe8f40cccf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40098d0 tx=0x7fe8e4009120 comp rx=0 tx=0).stop 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.708+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2911732444 shutdown_connections 2023-10-06T03:25:05.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.708+0000 7fe8f96c9700 1 --2- 172.21.15.84:0/2911732444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 0x7fe8f40cccf0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.708+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2911732444 >> 172.21.15.84:0/2911732444 conn(0x7fe8f4099560 msgr2=0x7fe8f406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:05.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.708+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2911732444 shutdown_connections 2023-10-06T03:25:05.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.708+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2911732444 wait complete. 2023-10-06T03:25:05.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.709+0000 7fe8f96c9700 1 Processor -- start 2023-10-06T03:25:05.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.709+0000 7fe8f96c9700 1 -- start start 2023-10-06T03:25:05.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f96c9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 0x7fe8f4156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f96c9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8f40b2a30 0x7fe8f40c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f96c9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8f40cf1f0 0x7fe8f415be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f96c9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40b4f10 con 0x7fe8f40b2660 2023-10-06T03:25:05.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f96c9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40b4320 con 0x7fe8f40cf1f0 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f96c9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40b45e0 con 0x7fe8f40b2a30 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 0x7fe8f4156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 0x7fe8f4156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55212/0 (socket says 172.21.15.84:55212) 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f3fff700 1 -- 172.21.15.84:0/2111279013 learned_addr learned my addr 172.21.15.84:0/2111279013 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f8ec8700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8f40cf1f0 0x7fe8f415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f37fe700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8f40b2a30 0x7fe8f40c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f3fff700 1 -- 172.21.15.84:0/2111279013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8f40b2a30 msgr2=0x7fe8f40c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f3fff700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8f40b2a30 0x7fe8f40c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f3fff700 1 -- 172.21.15.84:0/2111279013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8f40cf1f0 msgr2=0x7fe8f415be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f3fff700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8f40cf1f0 0x7fe8f415be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f3fff700 1 -- 172.21.15.84:0/2111279013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e40093c0 con 0x7fe8f40b2660 2023-10-06T03:25:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.710+0000 7fe8f8ec8700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8f40cf1f0 0x7fe8f415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.711+0000 7fe8f3fff700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 0x7fe8f4156ce0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009160 tx=0x7fe8e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.711+0000 7fe8dbfff700 1 -- 172.21.15.84:0/2111279013 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4006390 con 0x7fe8f40b2660 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.711+0000 7fe8dbfff700 1 -- 172.21.15.84:0/2111279013 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e4006510 con 0x7fe8f40b2660 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.711+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2111279013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f40b48c0 con 0x7fe8f40b2660 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.711+0000 7fe8dbfff700 1 -- 172.21.15.84:0/2111279013 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e40068d0 con 0x7fe8f40b2660 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.711+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2111279013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f40c83c0 con 0x7fe8f40b2660 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.712+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2111279013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f405f270 con 0x7fe8f40b2660 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.712+0000 7fe8dbfff700 1 -- 172.21.15.84:0/2111279013 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8e401b690 con 0x7fe8f40b2660 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.712+0000 7fe8dbfff700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe8e0066f30 0x7fe8e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.712+0000 7fe8dbfff700 1 -- 172.21.15.84:0/2111279013 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe8e4086b00 con 0x7fe8f40b2660 2023-10-06T03:25:05.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.713+0000 7fe8f37fe700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe8e0066f30 0x7fe8e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:05.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.713+0000 7fe8f37fe700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe8e0066f30 0x7fe8e00693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4159c20 tx=0x7fe8e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:05.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.717+0000 7fe8dbfff700 1 -- 172.21.15.84:0/2111279013 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8e4053ad0 con 0x7fe8f40b2660 2023-10-06T03:25:05.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.902+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2111279013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8f40cc640 con 0x7fe8f40b2660 2023-10-06T03:25:05.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.902+0000 7fe8dbfff700 1 -- 172.21.15.84:0/2111279013 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8e40570f0 con 0x7fe8f40b2660 2023-10-06T03:25:05.904 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:25:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2111279013 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe8e0066f30 msgr2=0x7fe8e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe8e0066f30 0x7fe8e00693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4159c20 tx=0x7fe8e8009040 comp rx=0 tx=0).stop 2023-10-06T03:25:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2111279013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 msgr2=0x7fe8f4156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 0x7fe8f4156ce0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009160 tx=0x7fe8e4016000 comp rx=0 tx=0).stop 2023-10-06T03:25:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2111279013 shutdown_connections 2023-10-06T03:25:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe8e0066f30 0x7fe8e00693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8f40cf1f0 0x7fe8f415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f40b2660 0x7fe8f4156ce0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 --2- 172.21.15.84:0/2111279013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8f40b2a30 0x7fe8f40c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2111279013 >> 172.21.15.84:0/2111279013 conn(0x7fe8f4099560 msgr2=0x7fe8f40ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:05.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2111279013 shutdown_connections 2023-10-06T03:25:05.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:05.904+0000 7fe8f96c9700 1 -- 172.21.15.84:0/2111279013 wait complete. 2023-10-06T03:25:05.917 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:25:06.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.032+0000 7f73a545f700 1 Processor -- start 2023-10-06T03:25:06.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.032+0000 7f73a545f700 1 -- start start 2023-10-06T03:25:06.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f73a545f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73a00b2a30 0x7f73a0164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f73a545f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a00cc9b0 con 0x7f73a00b2660 2023-10-06T03:25:06.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f73a545f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a00cbda0 con 0x7f73a00cd400 2023-10-06T03:25:06.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f73a545f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a00cc080 con 0x7f73a00b2a30 2023-10-06T03:25:06.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f73a4c5e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73a00b2a30 0x7f73a0164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f739ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f73a00b2660 0x7f73a00cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57762/0 (socket says 172.21.15.84:57762) 2023-10-06T03:25:06.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f739ffff700 1 -- 172.21.15.84:0/466808178 learned_addr learned my addr 172.21.15.84:0/466808178 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:06.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f73a4c5e700 1 -- 172.21.15.84:0/466808178 >> v1:172.21.15.131:6789/0 conn(0x7f73a00cd400 legacy=0x7f73a00ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:06.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f73a4c5e700 1 -- 172.21.15.84:0/466808178 >> v1:172.21.15.84:6789/0 conn(0x7f73a00b2660 legacy=0x7f73a00cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f73a4c5e700 1 -- 172.21.15.84:0/466808178 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a00cc360 con 0x7f73a00b2a30 2023-10-06T03:25:06.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.033+0000 7f73a4c5e700 1 --2- 172.21.15.84:0/466808178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2a30 0x7f73a0164360 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7398009e60 tx=0x7f7398009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785c9ac42df90e02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.034+0000 7f739effd700 1 -- 172.21.15.84:0/466808178 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739800e070 con 0x7f73a00b2a30 2023-10-06T03:25:06.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.034+0000 7f739effd700 1 -- 172.21.15.84:0/466808178 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739800bbf0 con 0x7f73a00b2a30 2023-10-06T03:25:06.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.034+0000 7f739effd700 1 -- 172.21.15.84:0/466808178 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398012430 con 0x7f73a00b2a30 2023-10-06T03:25:06.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.034+0000 7f73a545f700 1 -- 172.21.15.84:0/466808178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2a30 msgr2=0x7f73a0164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.034+0000 7f73a545f700 1 --2- 172.21.15.84:0/466808178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2a30 0x7f73a0164360 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7398009e60 tx=0x7f7398009780 comp rx=0 tx=0).stop 2023-10-06T03:25:06.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.034+0000 7f73a545f700 1 -- 172.21.15.84:0/466808178 shutdown_connections 2023-10-06T03:25:06.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.034+0000 7f73a545f700 1 --2- 172.21.15.84:0/466808178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2a30 0x7f73a0164360 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.034+0000 7f73a545f700 1 -- 172.21.15.84:0/466808178 >> 172.21.15.84:0/466808178 conn(0x7f73a0099560 msgr2=0x7f73a006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:06.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.034+0000 7f73a545f700 1 -- 172.21.15.84:0/466808178 shutdown_connections 2023-10-06T03:25:06.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.034+0000 7f73a545f700 1 -- 172.21.15.84:0/466808178 wait complete. 2023-10-06T03:25:06.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.035+0000 7f73a545f700 1 Processor -- start 2023-10-06T03:25:06.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.035+0000 7f73a545f700 1 -- start start 2023-10-06T03:25:06.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.036+0000 7f73a545f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2660 0x7f73a015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.036+0000 7f73a545f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73a00b2a30 0x7f73a014fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.036+0000 7f73a545f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a00cd400 0x7f73a00c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.036+0000 7f73a545f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00b5d30 con 0x7f73a00b2660 2023-10-06T03:25:06.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.036+0000 7f73a545f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00b30d0 con 0x7f73a00cd400 2023-10-06T03:25:06.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.036+0000 7f73a545f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00b3c50 con 0x7f73a00b2a30 2023-10-06T03:25:06.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.036+0000 7f739ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2660 0x7f73a015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.036+0000 7f739ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2660 0x7f73a015a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55230/0 (socket says 172.21.15.84:55230) 2023-10-06T03:25:06.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.036+0000 7f739ffff700 1 -- 172.21.15.84:0/445247429 learned_addr learned my addr 172.21.15.84:0/445247429 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:06.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f73a4c5e700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a00cd400 0x7f73a00c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f739f7fe700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73a00b2a30 0x7f73a014fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f739ffff700 1 -- 172.21.15.84:0/445247429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73a00b2a30 msgr2=0x7f73a014fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f739ffff700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73a00b2a30 0x7f73a014fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f739ffff700 1 -- 172.21.15.84:0/445247429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a00cd400 msgr2=0x7f73a00c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f739ffff700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a00cd400 0x7f73a00c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f739ffff700 1 -- 172.21.15.84:0/445247429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7398009a20 con 0x7f73a00b2660 2023-10-06T03:25:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f73a4c5e700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a00cd400 0x7f73a00c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f739ffff700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2660 0x7f73a015a680 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f739000c5c0 tx=0x7f7390007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f7387fff700 1 -- 172.21.15.84:0/445247429 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390001160 con 0x7f73a00b2660 2023-10-06T03:25:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f7387fff700 1 -- 172.21.15.84:0/445247429 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73900072e0 con 0x7f73a00b2660 2023-10-06T03:25:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f73a545f700 1 -- 172.21.15.84:0/445247429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a015abc0 con 0x7f73a00b2660 2023-10-06T03:25:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f7387fff700 1 -- 172.21.15.84:0/445247429 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900057f0 con 0x7f73a00b2660 2023-10-06T03:25:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.037+0000 7f73a545f700 1 -- 172.21.15.84:0/445247429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a00b3680 con 0x7f73a00b2660 2023-10-06T03:25:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.038+0000 7f73a545f700 1 -- 172.21.15.84:0/445247429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a005f270 con 0x7f73a00b2660 2023-10-06T03:25:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.038+0000 7f7387fff700 1 -- 172.21.15.84:0/445247429 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7390005c20 con 0x7f73a00b2660 2023-10-06T03:25:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.039+0000 7f7387fff700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f738c066f30 0x7f738c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.039+0000 7f7387fff700 1 -- 172.21.15.84:0/445247429 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7390083c40 con 0x7f73a00b2660 2023-10-06T03:25:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.039+0000 7f739f7fe700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f738c066f30 0x7f738c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.039+0000 7f739f7fe700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f738c066f30 0x7f738c0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f73a00c8580 tx=0x7f7394009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.043+0000 7f7387fff700 1 -- 172.21.15.84:0/445247429 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7390050c10 con 0x7f73a00b2660 2023-10-06T03:25:06.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.223+0000 7f73a545f700 1 -- 172.21.15.84:0/445247429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73a00cc640 con 0x7f73a00b2660 2023-10-06T03:25:06.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.223+0000 7f7387fff700 1 -- 172.21.15.84:0/445247429 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7390017020 con 0x7f73a00b2660 2023-10-06T03:25:06.225 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:25:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 -- 172.21.15.84:0/445247429 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f738c066f30 msgr2=0x7f738c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f738c066f30 0x7f738c0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f73a00c8580 tx=0x7f7394009040 comp rx=0 tx=0).stop 2023-10-06T03:25:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 -- 172.21.15.84:0/445247429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2660 msgr2=0x7f73a015a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2660 0x7f73a015a680 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f739000c5c0 tx=0x7f7390007e40 comp rx=0 tx=0).stop 2023-10-06T03:25:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 -- 172.21.15.84:0/445247429 shutdown_connections 2023-10-06T03:25:06.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f738c066f30 0x7f738c0693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a00cd400 0x7f73a00c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a00b2660 0x7f73a015a680 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 --2- 172.21.15.84:0/445247429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73a00b2a30 0x7f73a014fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 -- 172.21.15.84:0/445247429 >> 172.21.15.84:0/445247429 conn(0x7f73a0099560 msgr2=0x7f73a0150c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:06.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 -- 172.21.15.84:0/445247429 shutdown_connections 2023-10-06T03:25:06.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.225+0000 7f73a545f700 1 -- 172.21.15.84:0/445247429 wait complete. 2023-10-06T03:25:06.239 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:25:06.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.354+0000 7f3c6858d700 1 Processor -- start 2023-10-06T03:25:06.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.354+0000 7f3c6858d700 1 -- start start 2023-10-06T03:25:06.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.355+0000 7f3c6858d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3c600b0860 0x7f3c60068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.355+0000 7f3c6858d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c600cc780 0x7f3c600ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.355+0000 7f3c6858d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c600c96b0 con 0x7f3c600c4490 2023-10-06T03:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.355+0000 7f3c6858d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c60159c40 con 0x7f3c600cc780 2023-10-06T03:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.355+0000 7f3c6858d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c600c8aa0 con 0x7f3c600b0860 2023-10-06T03:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.355+0000 7f3c66b2a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c600cc780 0x7f3c600ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.355+0000 7f3c66b2a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c600cc780 0x7f3c600ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55234/0 (socket says 172.21.15.84:55234) 2023-10-06T03:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.355+0000 7f3c66b2a700 1 -- 172.21.15.84:0/1772259556 learned_addr learned my addr 172.21.15.84:0/1772259556 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c66329700 1 --2- 172.21.15.84:0/1772259556 >> v2:172.21.15.131:3300/0 conn(0x7f3c600b0860 0x7f3c60068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c66b2a700 1 -- 172.21.15.84:0/1772259556 >> v2:172.21.15.131:3300/0 conn(0x7f3c600b0860 msgr2=0x7f3c60068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c66b2a700 1 --2- 172.21.15.84:0/1772259556 >> v2:172.21.15.131:3300/0 conn(0x7f3c600b0860 0x7f3c60068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c66b2a700 1 -- 172.21.15.84:0/1772259556 >> v1:172.21.15.131:6789/0 conn(0x7f3c600c4490 legacy=0x7f3c600cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c66b2a700 1 -- 172.21.15.84:0/1772259556 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c600c8d80 con 0x7f3c600cc780 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c66329700 1 --2- 172.21.15.84:0/1772259556 >> v2:172.21.15.131:3300/0 conn(0x7f3c600b0860 0x7f3c60068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c66b2a700 1 --2- 172.21.15.84:0/1772259556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600cc780 0x7f3c600ccba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3c6006e1c0 tx=0x7f3c58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc439ae843e1d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c65327700 1 -- 172.21.15.84:0/1772259556 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800e070 con 0x7f3c600cc780 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c65327700 1 -- 172.21.15.84:0/1772259556 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5800ba10 con 0x7f3c600cc780 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c65327700 1 -- 172.21.15.84:0/1772259556 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580092e0 con 0x7f3c600cc780 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c6858d700 1 -- 172.21.15.84:0/1772259556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600cc780 msgr2=0x7f3c600ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.356+0000 7f3c6858d700 1 --2- 172.21.15.84:0/1772259556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600cc780 0x7f3c600ccba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3c6006e1c0 tx=0x7f3c58009840 comp rx=0 tx=0).stop 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.357+0000 7f3c6858d700 1 -- 172.21.15.84:0/1772259556 shutdown_connections 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.357+0000 7f3c6858d700 1 --2- 172.21.15.84:0/1772259556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600cc780 0x7f3c600ccba0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.357+0000 7f3c6858d700 1 --2- 172.21.15.84:0/1772259556 >> v2:172.21.15.131:3300/0 conn(0x7f3c600b0860 0x7f3c60068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.357+0000 7f3c6858d700 1 -- 172.21.15.84:0/1772259556 >> 172.21.15.84:0/1772259556 conn(0x7f3c60088000 msgr2=0x7f3c600ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.357+0000 7f3c6858d700 1 -- 172.21.15.84:0/1772259556 shutdown_connections 2023-10-06T03:25:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.357+0000 7f3c6858d700 1 -- 172.21.15.84:0/1772259556 wait complete. 2023-10-06T03:25:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.358+0000 7f3c6858d700 1 Processor -- start 2023-10-06T03:25:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.358+0000 7f3c6858d700 1 -- start start 2023-10-06T03:25:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.358+0000 7f3c6858d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600b0860 0x7f3c600b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.358+0000 7f3c6858d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c600c4490 0x7f3c601553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.358+0000 7f3c6858d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c600cc780 0x7f3c600c3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.358+0000 7f3c6858d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6015a5b0 con 0x7f3c600b0860 2023-10-06T03:25:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.358+0000 7f3c6858d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600b1f00 con 0x7f3c600c4490 2023-10-06T03:25:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.358+0000 7f3c6858d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6015ab50 con 0x7f3c600cc780 2023-10-06T03:25:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c66329700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600b0860 0x7f3c600b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c66329700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600b0860 0x7f3c600b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55248/0 (socket says 172.21.15.84:55248) 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c66329700 1 -- 172.21.15.84:0/3345329770 learned_addr learned my addr 172.21.15.84:0/3345329770 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c66b2a700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c600cc780 0x7f3c600c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c65b28700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c600c4490 0x7f3c601553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c66329700 1 -- 172.21.15.84:0/3345329770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c600cc780 msgr2=0x7f3c600c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c66329700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c600cc780 0x7f3c600c3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c66329700 1 -- 172.21.15.84:0/3345329770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c600c4490 msgr2=0x7f3c601553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c66329700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c600c4490 0x7f3c601553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c66329700 1 -- 172.21.15.84:0/3345329770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58009ae0 con 0x7f3c600b0860 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c66329700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600b0860 0x7f3c600b10f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00c860 tx=0x7f3c5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c567fc700 1 -- 172.21.15.84:0/3345329770 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c005a00 con 0x7f3c600b0860 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c567fc700 1 -- 172.21.15.84:0/3345329770 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c005b60 con 0x7f3c600b0860 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c6858d700 1 -- 172.21.15.84:0/3345329770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c600b1940 con 0x7f3c600b0860 2023-10-06T03:25:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c567fc700 1 -- 172.21.15.84:0/3345329770 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c011600 con 0x7f3c600b0860 2023-10-06T03:25:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.359+0000 7f3c6858d700 1 -- 172.21.15.84:0/3345329770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6015a7e0 con 0x7f3c600b0860 2023-10-06T03:25:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.360+0000 7f3c6858d700 1 -- 172.21.15.84:0/3345329770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c600b1690 con 0x7f3c600b0860 2023-10-06T03:25:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.360+0000 7f3c567fc700 1 -- 172.21.15.84:0/3345329770 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c5c0119b0 con 0x7f3c600b0860 2023-10-06T03:25:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.361+0000 7f3c567fc700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c44066f30 0x7f3c440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.361+0000 7f3c65b28700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c44066f30 0x7f3c440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.361+0000 7f3c567fc700 1 -- 172.21.15.84:0/3345329770 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3c5c084690 con 0x7f3c600b0860 2023-10-06T03:25:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.361+0000 7f3c65b28700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c44066f30 0x7f3c440693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c6015e6a0 tx=0x7f3c50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.365+0000 7f3c567fc700 1 -- 172.21.15.84:0/3345329770 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c5c0550f0 con 0x7f3c600b0860 2023-10-06T03:25:06.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.546+0000 7f3c6858d700 1 -- 172.21.15.84:0/3345329770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c60064ad0 con 0x7f3c600b0860 2023-10-06T03:25:06.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.547+0000 7f3c567fc700 1 -- 172.21.15.84:0/3345329770 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3c5c054c80 con 0x7f3c600b0860 2023-10-06T03:25:06.549 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:25:06.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 -- 172.21.15.84:0/3345329770 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c44066f30 msgr2=0x7f3c440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c44066f30 0x7f3c440693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c6015e6a0 tx=0x7f3c50009040 comp rx=0 tx=0).stop 2023-10-06T03:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 -- 172.21.15.84:0/3345329770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600b0860 msgr2=0x7f3c600b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600b0860 0x7f3c600b10f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00c860 tx=0x7f3c5c008040 comp rx=0 tx=0).stop 2023-10-06T03:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 -- 172.21.15.84:0/3345329770 shutdown_connections 2023-10-06T03:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c44066f30 0x7f3c440693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c600cc780 0x7f3c600c3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c600b0860 0x7f3c600b10f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 --2- 172.21.15.84:0/3345329770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c600c4490 0x7f3c601553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 -- 172.21.15.84:0/3345329770 >> 172.21.15.84:0/3345329770 conn(0x7f3c60088000 msgr2=0x7f3c60068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 -- 172.21.15.84:0/3345329770 shutdown_connections 2023-10-06T03:25:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.549+0000 7f3c6858d700 1 -- 172.21.15.84:0/3345329770 wait complete. 2023-10-06T03:25:06.562 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.674+0000 7efeae19f700 1 Processor -- start 2023-10-06T03:25:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.675+0000 7efeae19f700 1 -- start start 2023-10-06T03:25:06.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.675+0000 7efeae19f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efea8159480 0x7efea80b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.675+0000 7efeae19f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efea80b3610 0x7efea80cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.675+0000 7efeae19f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea80cb7e0 con 0x7efea80cc1b0 2023-10-06T03:25:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.675+0000 7efeae19f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea80b08a0 con 0x7efea8159480 2023-10-06T03:25:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.675+0000 7efeae19f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea80cb190 con 0x7efea80b3610 2023-10-06T03:25:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efead19d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efea8159480 0x7efea80b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efead19d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efea8159480 0x7efea80b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55256/0 (socket says 172.21.15.84:55256) 2023-10-06T03:25:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efead19d700 1 -- 172.21.15.84:0/2937613171 learned_addr learned my addr 172.21.15.84:0/2937613171 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efeac99c700 1 --2- 172.21.15.84:0/2937613171 >> v2:172.21.15.131:3300/0 conn(0x7efea80b3610 0x7efea80cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efead19d700 1 -- 172.21.15.84:0/2937613171 >> v2:172.21.15.131:3300/0 conn(0x7efea80b3610 msgr2=0x7efea80cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efead19d700 1 --2- 172.21.15.84:0/2937613171 >> v2:172.21.15.131:3300/0 conn(0x7efea80b3610 0x7efea80cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efead19d700 1 -- 172.21.15.84:0/2937613171 >> v1:172.21.15.131:6789/0 conn(0x7efea80cc1b0 legacy=0x7efea80b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efead19d700 1 -- 172.21.15.84:0/2937613171 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea80cb470 con 0x7efea8159480 2023-10-06T03:25:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efeac99c700 1 --2- 172.21.15.84:0/2937613171 >> v2:172.21.15.131:3300/0 conn(0x7efea80b3610 0x7efea80cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efead19d700 1 --2- 172.21.15.84:0/2937613171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8159480 0x7efea80b30d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efea80d0260 tx=0x7efea4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a8dd45b40cdf56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efe9ffff700 1 -- 172.21.15.84:0/2937613171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400b860 con 0x7efea8159480 2023-10-06T03:25:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efe9ffff700 1 -- 172.21.15.84:0/2937613171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea400b9c0 con 0x7efea8159480 2023-10-06T03:25:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.676+0000 7efe9ffff700 1 -- 172.21.15.84:0/2937613171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400bd60 con 0x7efea8159480 2023-10-06T03:25:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.677+0000 7efeae19f700 1 -- 172.21.15.84:0/2937613171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8159480 msgr2=0x7efea80b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.677+0000 7efeae19f700 1 --2- 172.21.15.84:0/2937613171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8159480 0x7efea80b30d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efea80d0260 tx=0x7efea4009250 comp rx=0 tx=0).stop 2023-10-06T03:25:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.677+0000 7efeae19f700 1 -- 172.21.15.84:0/2937613171 shutdown_connections 2023-10-06T03:25:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.677+0000 7efeae19f700 1 --2- 172.21.15.84:0/2937613171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8159480 0x7efea80b30d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.677+0000 7efeae19f700 1 --2- 172.21.15.84:0/2937613171 >> v2:172.21.15.131:3300/0 conn(0x7efea80b3610 0x7efea80cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.677+0000 7efeae19f700 1 -- 172.21.15.84:0/2937613171 >> 172.21.15.84:0/2937613171 conn(0x7efea806ed20 msgr2=0x7efea806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.677+0000 7efeae19f700 1 -- 172.21.15.84:0/2937613171 shutdown_connections 2023-10-06T03:25:06.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.677+0000 7efeae19f700 1 -- 172.21.15.84:0/2937613171 wait complete. 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.678+0000 7efeae19f700 1 Processor -- start 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.678+0000 7efeae19f700 1 -- start start 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeae19f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efea80b3610 0x7efea8153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeae19f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea80cc1b0 0x7efea80c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeae19f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efea8159480 0x7efea80c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeae19f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea80ca2e0 con 0x7efea80cc1b0 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeae19f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea80c7310 con 0x7efea8159480 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeae19f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea80c3e50 con 0x7efea80b3610 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeac99c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea80cc1b0 0x7efea80c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeac99c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea80cc1b0 0x7efea80c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55272/0 (socket says 172.21.15.84:55272) 2023-10-06T03:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeac99c700 1 -- 172.21.15.84:0/1101628320 learned_addr learned my addr 172.21.15.84:0/1101628320 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efead19d700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efea80b3610 0x7efea8153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efead99e700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efea8159480 0x7efea80c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeac99c700 1 -- 172.21.15.84:0/1101628320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efea80b3610 msgr2=0x7efea8153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeac99c700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efea80b3610 0x7efea8153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeac99c700 1 -- 172.21.15.84:0/1101628320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efea8159480 msgr2=0x7efea80c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeac99c700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efea8159480 0x7efea80c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeac99c700 1 -- 172.21.15.84:0/1101628320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40094f0 con 0x7efea80cc1b0 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efead19d700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efea80b3610 0x7efea8153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeac99c700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea80cc1b0 0x7efea80c56d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efe9800e900 tx=0x7efe98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efe9d7fa700 1 -- 172.21.15.84:0/1101628320 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800eea0 con 0x7efea80cc1b0 2023-10-06T03:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efe9d7fa700 1 -- 172.21.15.84:0/1101628320 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9800c5e0 con 0x7efea80cc1b0 2023-10-06T03:25:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efeae19f700 1 -- 172.21.15.84:0/1101628320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea80c75b0 con 0x7efea80cc1b0 2023-10-06T03:25:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.679+0000 7efe9d7fa700 1 -- 172.21.15.84:0/1101628320 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800c980 con 0x7efea80cc1b0 2023-10-06T03:25:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.680+0000 7efeae19f700 1 -- 172.21.15.84:0/1101628320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea80c6590 con 0x7efea80cc1b0 2023-10-06T03:25:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.680+0000 7efeae19f700 1 -- 172.21.15.84:0/1101628320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea80c7740 con 0x7efea80cc1b0 2023-10-06T03:25:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.681+0000 7efe9d7fa700 1 -- 172.21.15.84:0/1101628320 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe9800cd30 con 0x7efea80cc1b0 2023-10-06T03:25:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.681+0000 7efe9d7fa700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe8c066f30 0x7efe8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.681+0000 7efead19d700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe8c066f30 0x7efe8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.681+0000 7efe9d7fa700 1 -- 172.21.15.84:0/1101628320 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7efe98084620 con 0x7efea80cc1b0 2023-10-06T03:25:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.682+0000 7efead19d700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe8c066f30 0x7efe8c0693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efea80d0260 tx=0x7efea4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.685+0000 7efe9d7fa700 1 -- 172.21.15.84:0/1101628320 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe98055080 con 0x7efea80cc1b0 2023-10-06T03:25:06.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.910+0000 7efeae19f700 1 -- 172.21.15.84:0/1101628320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efea805f270 con 0x7efea80cc1b0 2023-10-06T03:25:06.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.911+0000 7efe9d7fa700 1 -- 172.21.15.84:0/1101628320 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7efe98054c10 con 0x7efea80cc1b0 2023-10-06T03:25:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:06.914 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1693550238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1693550238},{"type":"v1","addr":"172.21.15.131:6834","nonce":1693550238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2817652058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2817652058},{"type":"v1","addr":"172.21.15.131:6835","nonce":2817652058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/688702713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":688702713},{"type":"v1","addr":"172.21.15.84:6836","nonce":688702713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:24:49.172387+0000","modified":"2023-10-06T03:24:52.828381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/1939836196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1939836196},{"type":"v1","addr":"172.21.15.84:6837","nonce":1939836196}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:25:06.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 -- 172.21.15.84:0/1101628320 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe8c066f30 msgr2=0x7efe8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe8c066f30 0x7efe8c0693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efea80d0260 tx=0x7efea4017000 comp rx=0 tx=0).stop 2023-10-06T03:25:06.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 -- 172.21.15.84:0/1101628320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea80cc1b0 msgr2=0x7efea80c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea80cc1b0 0x7efea80c56d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efe9800e900 tx=0x7efe98008040 comp rx=0 tx=0).stop 2023-10-06T03:25:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 -- 172.21.15.84:0/1101628320 shutdown_connections 2023-10-06T03:25:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe8c066f30 0x7efe8c0693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efea8159480 0x7efea80c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efea80b3610 0x7efea8153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 --2- 172.21.15.84:0/1101628320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea80cc1b0 0x7efea80c56d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 -- 172.21.15.84:0/1101628320 >> 172.21.15.84:0/1101628320 conn(0x7efea806ed20 msgr2=0x7efea81569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 -- 172.21.15.84:0/1101628320 shutdown_connections 2023-10-06T03:25:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:06.913+0000 7efeae19f700 1 -- 172.21.15.84:0/1101628320 wait complete. 2023-10-06T03:25:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-10-06T03:25:06.927 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.039+0000 7fcee2396700 1 Processor -- start 2023-10-06T03:25:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.039+0000 7fcee2396700 1 -- start start 2023-10-06T03:25:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcee2396700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcedc0ca3b0 0x7fcedc1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcee2396700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcedc0adba0 0x7fcedc0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcee2396700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcedc0ce710 0x7fcedc15af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcee2396700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0cbbd0 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcee2396700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0ceb70 con 0x7fcedc0ce710 2023-10-06T03:25:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcee2396700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc157e20 con 0x7fcedc0adba0 2023-10-06T03:25:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcedbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcedc0ca3b0 0x7fcedc1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcedbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcedc0ca3b0 0x7fcedc1582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55282/0 (socket says 172.21.15.84:55282) 2023-10-06T03:25:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcedbfff700 1 -- 172.21.15.84:0/3360305669 learned_addr learned my addr 172.21.15.84:0/3360305669 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcedb7fe700 1 --2- 172.21.15.84:0/3360305669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcedc0adba0 0x7fcedc0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.040+0000 7fcee0933700 1 --2- 172.21.15.84:0/3360305669 >> v2:172.21.15.131:3300/0 conn(0x7fcedc0ce710 0x7fcedc15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcedbfff700 1 -- 172.21.15.84:0/3360305669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcedc0adba0 msgr2=0x7fcedc0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcedbfff700 1 --2- 172.21.15.84:0/3360305669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcedc0adba0 0x7fcedc0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcedbfff700 1 -- 172.21.15.84:0/3360305669 >> v2:172.21.15.131:3300/0 conn(0x7fcedc0ce710 msgr2=0x7fcedc15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcedbfff700 1 --2- 172.21.15.84:0/3360305669 >> v2:172.21.15.131:3300/0 conn(0x7fcedc0ce710 0x7fcedc15af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcedbfff700 1 -- 172.21.15.84:0/3360305669 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc0cb610 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcedbfff700 1 --2- 172.21.15.84:0/3360305669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 0x7fcedc1582b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0c52b0 tx=0x7fcecc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa2966e85fbbd11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcedaffd700 1 -- 172.21.15.84:0/3360305669 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00b860 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcedaffd700 1 -- 172.21.15.84:0/3360305669 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00b9c0 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcedaffd700 1 -- 172.21.15.84:0/3360305669 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00bd60 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcee2396700 1 -- 172.21.15.84:0/3360305669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 msgr2=0x7fcedc1582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcee2396700 1 --2- 172.21.15.84:0/3360305669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 0x7fcedc1582b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0c52b0 tx=0x7fcecc009250 comp rx=0 tx=0).stop 2023-10-06T03:25:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcee2396700 1 -- 172.21.15.84:0/3360305669 shutdown_connections 2023-10-06T03:25:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcee2396700 1 --2- 172.21.15.84:0/3360305669 >> v2:172.21.15.131:3300/0 conn(0x7fcedc0ce710 0x7fcedc15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcee2396700 1 --2- 172.21.15.84:0/3360305669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 0x7fcedc1582b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcee2396700 1 --2- 172.21.15.84:0/3360305669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcedc0adba0 0x7fcedc0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcee2396700 1 -- 172.21.15.84:0/3360305669 >> 172.21.15.84:0/3360305669 conn(0x7fcedc070810 msgr2=0x7fcedc070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcee2396700 1 -- 172.21.15.84:0/3360305669 shutdown_connections 2023-10-06T03:25:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.041+0000 7fcee2396700 1 -- 172.21.15.84:0/3360305669 wait complete. 2023-10-06T03:25:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.042+0000 7fcee2396700 1 Processor -- start 2023-10-06T03:25:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.043+0000 7fcee2396700 1 -- start start 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.043+0000 7fcee2396700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcedc0adba0 0x7fcedc0c0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.043+0000 7fcee2396700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 0x7fcedc0c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.043+0000 7fcee2396700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcedc0ce710 0x7fcedc14eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.043+0000 7fcee2396700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc15b740 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.043+0000 7fcee2396700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc152ab0 con 0x7fcedc0ce710 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.043+0000 7fcee2396700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1524d0 con 0x7fcedc0adba0 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.043+0000 7fcedb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 0x7fcedc0c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.043+0000 7fcedb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 0x7fcedc0c1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55288/0 (socket says 172.21.15.84:55288) 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.043+0000 7fcedb7fe700 1 -- 172.21.15.84:0/3026458214 learned_addr learned my addr 172.21.15.84:0/3026458214 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcee0933700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcedc0ce710 0x7fcedc14eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcedbfff700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcedc0adba0 0x7fcedc0c0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcedb7fe700 1 -- 172.21.15.84:0/3026458214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcedc0adba0 msgr2=0x7fcedc0c0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcedb7fe700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcedc0adba0 0x7fcedc0c0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcedb7fe700 1 -- 172.21.15.84:0/3026458214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcedc0ce710 msgr2=0x7fcedc14eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcedb7fe700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcedc0ce710 0x7fcedc14eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcedb7fe700 1 -- 172.21.15.84:0/3026458214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0094f0 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcee0933700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcedc0ce710 0x7fcedc14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcedb7fe700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 0x7fcedc0c1d50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fced000d890 tx=0x7fced0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcec3fff700 1 -- 172.21.15.84:0/3026458214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0009610 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcec3fff700 1 -- 172.21.15.84:0/3026458214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0009770 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcee2396700 1 -- 172.21.15.84:0/3026458214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc0c2290 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcec3fff700 1 -- 172.21.15.84:0/3026458214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0009b30 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.044+0000 7fcee2396700 1 -- 172.21.15.84:0/3026458214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc15aea0 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.045+0000 7fcee2396700 1 -- 172.21.15.84:0/3026458214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc152c40 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.045+0000 7fcec3fff700 1 -- 172.21.15.84:0/3026458214 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fced001e460 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.046+0000 7fcec3fff700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcec8066f30 0x7fcec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.046+0000 7fcec3fff700 1 -- 172.21.15.84:0/3026458214 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fced0084e40 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.046+0000 7fcedbfff700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcec8066f30 0x7fcec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.046+0000 7fcedbfff700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcec8066f30 0x7fcec80693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0c52b0 tx=0x7fcecc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.050+0000 7fcec3fff700 1 -- 172.21.15.84:0/3026458214 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fced0051e10 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.233+0000 7fcee2396700 1 -- 172.21.15.84:0/3026458214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcedc15b1e0 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.234+0000 7fcec3fff700 1 -- 172.21.15.84:0/3026458214 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fced0055430 con 0x7fcedc0ca3b0 2023-10-06T03:25:07.236 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:07.236 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:24:50.800397+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:46.821084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:48.147630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:07.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 -- 172.21.15.84:0/3026458214 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcec8066f30 msgr2=0x7fcec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcec8066f30 0x7fcec80693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0c52b0 tx=0x7fcecc017000 comp rx=0 tx=0).stop 2023-10-06T03:25:07.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 -- 172.21.15.84:0/3026458214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 msgr2=0x7fcedc0c1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 0x7fcedc0c1d50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fced000d890 tx=0x7fced0008040 comp rx=0 tx=0).stop 2023-10-06T03:25:07.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 -- 172.21.15.84:0/3026458214 shutdown_connections 2023-10-06T03:25:07.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcec8066f30 0x7fcec80693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcedc0ce710 0x7fcedc14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcedc0adba0 0x7fcedc0c0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 --2- 172.21.15.84:0/3026458214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcedc0ca3b0 0x7fcedc0c1d50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 -- 172.21.15.84:0/3026458214 >> 172.21.15.84:0/3026458214 conn(0x7fcedc070810 msgr2=0x7fcedc155530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:07.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 -- 172.21.15.84:0/3026458214 shutdown_connections 2023-10-06T03:25:07.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.236+0000 7fcee2396700 1 -- 172.21.15.84:0/3026458214 wait complete. 2023-10-06T03:25:07.250 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:25:07.250 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.363+0000 7f5e53e8f700 1 Processor -- start 2023-10-06T03:25:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.363+0000 7f5e53e8f700 1 -- start start 2023-10-06T03:25:07.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e53e8f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e4c1595a0 0x7f5e4c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e53e8f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5e4c0b49e0 0x7f5e4c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e53e8f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e4c0b07a0 0x7f5e4c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e53e8f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c0b0ca0 con 0x7f5e4c1595a0 2023-10-06T03:25:07.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e53e8f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c0b0f80 con 0x7f5e4c0b49e0 2023-10-06T03:25:07.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e53e8f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0b1260 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e51c2b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e4c1595a0 0x7f5e4c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e51c2b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e4c1595a0 0x7f5e4c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55304/0 (socket says 172.21.15.84:55304) 2023-10-06T03:25:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e51c2b700 1 -- 172.21.15.84:0/2659936754 learned_addr learned my addr 172.21.15.84:0/2659936754 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e5142a700 1 --2- 172.21.15.84:0/2659936754 >> v2:172.21.15.131:3300/0 conn(0x7f5e4c0b49e0 0x7f5e4c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.364+0000 7f5e5242c700 1 --2- 172.21.15.84:0/2659936754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e4c0b07a0 0x7f5e4c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e51c2b700 1 -- 172.21.15.84:0/2659936754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e4c0b07a0 msgr2=0x7f5e4c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e51c2b700 1 --2- 172.21.15.84:0/2659936754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e4c0b07a0 0x7f5e4c0b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e51c2b700 1 -- 172.21.15.84:0/2659936754 >> v2:172.21.15.131:3300/0 conn(0x7f5e4c0b49e0 msgr2=0x7f5e4c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e51c2b700 1 --2- 172.21.15.84:0/2659936754 >> v2:172.21.15.131:3300/0 conn(0x7f5e4c0b49e0 0x7f5e4c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e51c2b700 1 -- 172.21.15.84:0/2659936754 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c0b1540 con 0x7f5e4c1595a0 2023-10-06T03:25:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e51c2b700 1 --2- 172.21.15.84:0/2659936754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c1595a0 0x7f5e4c0aa570 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009f70 tx=0x7f5e48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94891d8219be717b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e50c29700 1 -- 172.21.15.84:0/2659936754 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800e070 con 0x7f5e4c1595a0 2023-10-06T03:25:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e50c29700 1 -- 172.21.15.84:0/2659936754 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4800b930 con 0x7f5e4c1595a0 2023-10-06T03:25:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e50c29700 1 -- 172.21.15.84:0/2659936754 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480092e0 con 0x7f5e4c1595a0 2023-10-06T03:25:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2659936754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c1595a0 msgr2=0x7f5e4c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e53e8f700 1 --2- 172.21.15.84:0/2659936754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c1595a0 0x7f5e4c0aa570 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009f70 tx=0x7f5e48009840 comp rx=0 tx=0).stop 2023-10-06T03:25:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2659936754 shutdown_connections 2023-10-06T03:25:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e53e8f700 1 --2- 172.21.15.84:0/2659936754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e4c0b07a0 0x7f5e4c0b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e53e8f700 1 --2- 172.21.15.84:0/2659936754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c1595a0 0x7f5e4c0aa570 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e53e8f700 1 --2- 172.21.15.84:0/2659936754 >> v2:172.21.15.131:3300/0 conn(0x7f5e4c0b49e0 0x7f5e4c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.365+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2659936754 >> 172.21.15.84:0/2659936754 conn(0x7f5e4c099830 msgr2=0x7f5e4c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.366+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2659936754 shutdown_connections 2023-10-06T03:25:07.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.366+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2659936754 wait complete. 2023-10-06T03:25:07.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e53e8f700 1 Processor -- start 2023-10-06T03:25:07.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e53e8f700 1 -- start start 2023-10-06T03:25:07.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e53e8f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c0b07a0 0x7f5e4c15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e53e8f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e4c0b49e0 0x7f5e4c155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e53e8f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e4c1595a0 0x7f5e4c16d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e53e8f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c15bfc0 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e53e8f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c15b7b0 con 0x7f5e4c0b49e0 2023-10-06T03:25:07.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e53e8f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c16cf90 con 0x7f5e4c1595a0 2023-10-06T03:25:07.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e51c2b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c0b07a0 0x7f5e4c15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e51c2b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c0b07a0 0x7f5e4c15c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55310/0 (socket says 172.21.15.84:55310) 2023-10-06T03:25:07.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e51c2b700 1 -- 172.21.15.84:0/2422714176 learned_addr learned my addr 172.21.15.84:0/2422714176 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:07.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e5142a700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e4c0b49e0 0x7f5e4c155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.367+0000 7f5e5242c700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e4c1595a0 0x7f5e4c16d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e51c2b700 1 -- 172.21.15.84:0/2422714176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e4c1595a0 msgr2=0x7f5e4c16d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e51c2b700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e4c1595a0 0x7f5e4c16d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e51c2b700 1 -- 172.21.15.84:0/2422714176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e4c0b49e0 msgr2=0x7f5e4c155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e51c2b700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e4c0b49e0 0x7f5e4c155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e51c2b700 1 -- 172.21.15.84:0/2422714176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48009ae0 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e51c2b700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c0b07a0 0x7f5e4c15c780 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800b610 tx=0x7f5e48018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e41ffb700 1 -- 172.21.15.84:0/2422714176 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480087a0 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e41ffb700 1 -- 172.21.15.84:0/2422714176 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e48008900 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2422714176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4c156920 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e41ffb700 1 -- 172.21.15.84:0/2422714176 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48008cc0 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.368+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2422714176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c15bce0 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.369+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2422714176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4c16d270 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.369+0000 7f5e41ffb700 1 -- 172.21.15.84:0/2422714176 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e48003040 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.370+0000 7f5e41ffb700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5e30066f30 0x7f5e300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.370+0000 7f5e41ffb700 1 -- 172.21.15.84:0/2422714176 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5e48085a50 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.370+0000 7f5e5142a700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5e30066f30 0x7f5e300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.370+0000 7f5e5142a700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5e30066f30 0x7f5e300693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c156c00 tx=0x7f5e3c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.374+0000 7f5e41ffb700 1 -- 172.21.15.84:0/2422714176 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e48052a20 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.604+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2422714176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e4c064ad0 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.605+0000 7f5e41ffb700 1 -- 172.21.15.84:0/2422714176 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f5e48056040 con 0x7f5e4c0b07a0 2023-10-06T03:25:07.607 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:07.607 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1693550238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1693550238},{"type":"v1","addr":"172.21.15.131:6834","nonce":1693550238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2817652058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2817652058},{"type":"v1","addr":"172.21.15.131:6835","nonce":2817652058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/688702713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":688702713},{"type":"v1","addr":"172.21.15.84:6836","nonce":688702713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:24:49.172387+0000","modified":"2023-10-06T03:24:52.828381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/1939836196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1939836196},{"type":"v1","addr":"172.21.15.84:6837","nonce":1939836196}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:25:07.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2422714176 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5e30066f30 msgr2=0x7f5e300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5e30066f30 0x7f5e300693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c156c00 tx=0x7f5e3c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2422714176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c0b07a0 msgr2=0x7f5e4c15c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c0b07a0 0x7f5e4c15c780 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800b610 tx=0x7f5e48018000 comp rx=0 tx=0).stop 2023-10-06T03:25:07.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2422714176 shutdown_connections 2023-10-06T03:25:07.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5e30066f30 0x7f5e300693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e4c1595a0 0x7f5e4c16d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e4c0b07a0 0x7f5e4c15c780 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 --2- 172.21.15.84:0/2422714176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e4c0b49e0 0x7f5e4c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2422714176 >> 172.21.15.84:0/2422714176 conn(0x7f5e4c099830 msgr2=0x7f5e4c069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:07.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2422714176 shutdown_connections 2023-10-06T03:25:07.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.607+0000 7f5e53e8f700 1 -- 172.21.15.84:0/2422714176 wait complete. 2023-10-06T03:25:07.610 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-10-06T03:25:07.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.733+0000 7f5a9078d700 1 Processor -- start 2023-10-06T03:25:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.733+0000 7f5a9078d700 1 -- start start 2023-10-06T03:25:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.734+0000 7f5a9078d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a880cc920 0x7f5a8806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.734+0000 7f5a9078d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5a8806c1a0 0x7f5a880c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.734+0000 7f5a9078d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8806c9e0 con 0x7f5a88156390 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.734+0000 7f5a9078d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a88156b60 con 0x7f5a880cc920 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.734+0000 7f5a9078d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a88156e40 con 0x7f5a8806c1a0 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.734+0000 7f5a8dd28700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a880cc920 0x7f5a8806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.734+0000 7f5a8dd28700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a880cc920 0x7f5a8806bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55316/0 (socket says 172.21.15.84:55316) 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.734+0000 7f5a8dd28700 1 -- 172.21.15.84:0/4102925593 learned_addr learned my addr 172.21.15.84:0/4102925593 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.734+0000 7f5a8ed2a700 1 --2- 172.21.15.84:0/4102925593 >> v2:172.21.15.131:3300/0 conn(0x7f5a8806c1a0 0x7f5a880c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.735+0000 7f5a8dd28700 1 -- 172.21.15.84:0/4102925593 >> v2:172.21.15.131:3300/0 conn(0x7f5a8806c1a0 msgr2=0x7f5a880c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.735+0000 7f5a8dd28700 1 --2- 172.21.15.84:0/4102925593 >> v2:172.21.15.131:3300/0 conn(0x7f5a8806c1a0 0x7f5a880c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.735+0000 7f5a8dd28700 1 -- 172.21.15.84:0/4102925593 >> v1:172.21.15.131:6789/0 conn(0x7f5a88156390 legacy=0x7f5a880cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.735+0000 7f5a8dd28700 1 -- 172.21.15.84:0/4102925593 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a88157120 con 0x7f5a880cc920 2023-10-06T03:25:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.735+0000 7f5a8dd28700 1 --2- 172.21.15.84:0/4102925593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc920 0x7f5a8806bc60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5a8806d040 tx=0x7f5a78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be887468e729958 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.735+0000 7f5a8d527700 1 -- 172.21.15.84:0/4102925593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78009e70 con 0x7f5a880cc920 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.735+0000 7f5a8d527700 1 -- 172.21.15.84:0/4102925593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7800b860 con 0x7f5a880cc920 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.735+0000 7f5a8d527700 1 -- 172.21.15.84:0/4102925593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7800bc00 con 0x7f5a880cc920 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.735+0000 7f5a9078d700 1 -- 172.21.15.84:0/4102925593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc920 msgr2=0x7f5a8806bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.735+0000 7f5a9078d700 1 --2- 172.21.15.84:0/4102925593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc920 0x7f5a8806bc60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5a8806d040 tx=0x7f5a78009250 comp rx=0 tx=0).stop 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.736+0000 7f5a9078d700 1 -- 172.21.15.84:0/4102925593 shutdown_connections 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.736+0000 7f5a9078d700 1 --2- 172.21.15.84:0/4102925593 >> v2:172.21.15.131:3300/0 conn(0x7f5a8806c1a0 0x7f5a880c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.736+0000 7f5a9078d700 1 --2- 172.21.15.84:0/4102925593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc920 0x7f5a8806bc60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.736+0000 7f5a9078d700 1 -- 172.21.15.84:0/4102925593 >> 172.21.15.84:0/4102925593 conn(0x7f5a880cdef0 msgr2=0x7f5a880c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.736+0000 7f5a9078d700 1 -- 172.21.15.84:0/4102925593 shutdown_connections 2023-10-06T03:25:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.736+0000 7f5a9078d700 1 -- 172.21.15.84:0/4102925593 wait complete. 2023-10-06T03:25:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a9078d700 1 Processor -- start 2023-10-06T03:25:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a9078d700 1 -- start start 2023-10-06T03:25:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a9078d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8806c1a0 0x7f5a880a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a9078d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a880cc920 0x7f5a880b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a9078d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a88156390 0x7f5a880caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a9078d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880b1b90 con 0x7f5a8806c1a0 2023-10-06T03:25:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a9078d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880b1dc0 con 0x7f5a88156390 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a9078d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880b20a0 con 0x7f5a880cc920 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a8e529700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8806c1a0 0x7f5a880a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a8e529700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8806c1a0 0x7f5a880a56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55324/0 (socket says 172.21.15.84:55324) 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.737+0000 7f5a8e529700 1 -- 172.21.15.84:0/1634075124 learned_addr learned my addr 172.21.15.84:0/1634075124 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a8ed2a700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a88156390 0x7f5a880caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a8dd28700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a880cc920 0x7f5a880b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a8e529700 1 -- 172.21.15.84:0/1634075124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a880cc920 msgr2=0x7f5a880b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a8e529700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a880cc920 0x7f5a880b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a8e529700 1 -- 172.21.15.84:0/1634075124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a88156390 msgr2=0x7f5a880caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a8e529700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a88156390 0x7f5a880caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a8e529700 1 -- 172.21.15.84:0/1634075124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780094f0 con 0x7f5a8806c1a0 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a8dd28700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a880cc920 0x7f5a880b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a8e529700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8806c1a0 0x7f5a880a56d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000c910 tx=0x7f5a800016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a7e7fc700 1 -- 172.21.15.84:0/1634075124 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80012630 con 0x7f5a8806c1a0 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a7e7fc700 1 -- 172.21.15.84:0/1634075124 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a80012790 con 0x7f5a8806c1a0 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a9078d700 1 -- 172.21.15.84:0/1634075124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a880b2380 con 0x7f5a8806c1a0 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a7e7fc700 1 -- 172.21.15.84:0/1634075124 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80012b50 con 0x7f5a8806c1a0 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.738+0000 7f5a9078d700 1 -- 172.21.15.84:0/1634075124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a88147110 con 0x7f5a8806c1a0 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.739+0000 7f5a9078d700 1 -- 172.21.15.84:0/1634075124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a88064ad0 con 0x7f5a8806c1a0 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.739+0000 7f5a7e7fc700 1 -- 172.21.15.84:0/1634075124 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a80003030 con 0x7f5a8806c1a0 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.740+0000 7f5a7e7fc700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 0x7f5a6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.740+0000 7f5a8dd28700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 0x7f5a6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:07.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.740+0000 7f5a7e7fc700 1 -- 172.21.15.84:0/1634075124 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5a80084770 con 0x7f5a8806c1a0 2023-10-06T03:25:07.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.740+0000 7f5a8dd28700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 0x7f5a6c0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a8806d040 tx=0x7f5a78017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:07.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.744+0000 7f5a7e7fc700 1 -- 172.21.15.84:0/1634075124 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a800551d0 con 0x7f5a8806c1a0 2023-10-06T03:25:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.968+0000 7f5a9078d700 1 -- 172.21.15.84:0/1634075124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a88157400 con 0x7f5a8806c1a0 2023-10-06T03:25:07.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.969+0000 7f5a7e7fc700 1 -- 172.21.15.84:0/1634075124 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f5a80054d60 con 0x7f5a8806c1a0 2023-10-06T03:25:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:07.971 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1693550238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1693550238},{"type":"v1","addr":"172.21.15.131:6834","nonce":1693550238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2817652058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2817652058},{"type":"v1","addr":"172.21.15.131:6835","nonce":2817652058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/688702713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":688702713},{"type":"v1","addr":"172.21.15.84:6836","nonce":688702713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:24:49.172387+0000","modified":"2023-10-06T03:24:52.828381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/1939836196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1939836196},{"type":"v1","addr":"172.21.15.84:6837","nonce":1939836196}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:25:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 -- 172.21.15.84:0/1634075124 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 msgr2=0x7f5a6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 0x7f5a6c0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a8806d040 tx=0x7f5a78017000 comp rx=0 tx=0).stop 2023-10-06T03:25:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 -- 172.21.15.84:0/1634075124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8806c1a0 msgr2=0x7f5a880a56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8806c1a0 0x7f5a880a56d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000c910 tx=0x7f5a800016b0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 -- 172.21.15.84:0/1634075124 shutdown_connections 2023-10-06T03:25:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 0x7f5a6c0693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a88156390 0x7f5a880caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8806c1a0 0x7f5a880a56d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 --2- 172.21.15.84:0/1634075124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a880cc920 0x7f5a880b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 -- 172.21.15.84:0/1634075124 >> 172.21.15.84:0/1634075124 conn(0x7f5a880cdef0 msgr2=0x7f5a8806ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 -- 172.21.15.84:0/1634075124 shutdown_connections 2023-10-06T03:25:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:07.971+0000 7f5a9078d700 1 -- 172.21.15.84:0/1634075124 wait complete. 2023-10-06T03:25:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-10-06T03:25:07.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.097+0000 7fd34a532700 1 Processor -- start 2023-10-06T03:25:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.097+0000 7fd34a532700 1 -- start start 2023-10-06T03:25:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.097+0000 7fd34a532700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd3440b2620 0x7fd3440b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.097+0000 7fd34a532700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3440cbfe0 con 0x7fd344159870 2023-10-06T03:25:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.097+0000 7fd34a532700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3440cb3d0 con 0x7fd3440b29f0 2023-10-06T03:25:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.097+0000 7fd34a532700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3440cb6b0 con 0x7fd3440b2620 2023-10-06T03:25:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd343fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd3440b2620 0x7fd3440b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd348acf700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd344159870 0x7fd3440cc470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57770/0 (socket says 172.21.15.84:57770) 2023-10-06T03:25:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd348acf700 1 -- 172.21.15.84:0/3726496210 learned_addr learned my addr 172.21.15.84:0/3726496210 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd342ffd700 1 -- 172.21.15.84:0/3726496210 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543605224 0 0) 0x7fd3440cbfe0 con 0x7fd344159870 2023-10-06T03:25:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd342ffd700 1 -- 172.21.15.84:0/3726496210 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd32c003570 con 0x7fd344159870 2023-10-06T03:25:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd343fff700 1 -- 172.21.15.84:0/3726496210 >> v1:172.21.15.131:6789/0 conn(0x7fd3440b29f0 legacy=0x7fd344159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd343fff700 1 -- 172.21.15.84:0/3726496210 >> v1:172.21.15.84:6789/0 conn(0x7fd344159870 legacy=0x7fd3440cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd343fff700 1 -- 172.21.15.84:0/3726496210 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3440cb990 con 0x7fd3440b2620 2023-10-06T03:25:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd343fff700 1 --2- 172.21.15.84:0/3726496210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3440b2620 0x7fd3440b06d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd3340098d0 tx=0x7fd334009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb17fe05dbf0536e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd342ffd700 1 -- 172.21.15.84:0/3726496210 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334005c10 con 0x7fd3440b2620 2023-10-06T03:25:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd342ffd700 1 -- 172.21.15.84:0/3726496210 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334005d70 con 0x7fd3440b2620 2023-10-06T03:25:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.098+0000 7fd342ffd700 1 -- 172.21.15.84:0/3726496210 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334006280 con 0x7fd3440b2620 2023-10-06T03:25:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.099+0000 7fd34a532700 1 -- 172.21.15.84:0/3726496210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3440b2620 msgr2=0x7fd3440b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.099+0000 7fd34a532700 1 --2- 172.21.15.84:0/3726496210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3440b2620 0x7fd3440b06d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd3340098d0 tx=0x7fd334009120 comp rx=0 tx=0).stop 2023-10-06T03:25:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.099+0000 7fd34a532700 1 -- 172.21.15.84:0/3726496210 shutdown_connections 2023-10-06T03:25:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.099+0000 7fd34a532700 1 --2- 172.21.15.84:0/3726496210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3440b2620 0x7fd3440b06d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.099+0000 7fd34a532700 1 -- 172.21.15.84:0/3726496210 >> 172.21.15.84:0/3726496210 conn(0x7fd34406ed20 msgr2=0x7fd34406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.099+0000 7fd34a532700 1 -- 172.21.15.84:0/3726496210 shutdown_connections 2023-10-06T03:25:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.099+0000 7fd34a532700 1 -- 172.21.15.84:0/3726496210 wait complete. 2023-10-06T03:25:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.100+0000 7fd34a532700 1 Processor -- start 2023-10-06T03:25:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.100+0000 7fd34a532700 1 -- start start 2023-10-06T03:25:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd34a532700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3440b2620 0x7fd3440c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd34a532700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3440b29f0 0x7fd344169c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd34a532700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd344159870 0x7fd34416a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd34a532700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3440c6da0 con 0x7fd344159870 2023-10-06T03:25:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd34a532700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3440d04d0 con 0x7fd3440b29f0 2023-10-06T03:25:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd34a532700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3440d07b0 con 0x7fd3440b2620 2023-10-06T03:25:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd348acf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd344159870 0x7fd34416a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd348acf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd344159870 0x7fd34416a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55340/0 (socket says 172.21.15.84:55340) 2023-10-06T03:25:08.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd348acf700 1 -- 172.21.15.84:0/2370739621 learned_addr learned my addr 172.21.15.84:0/2370739621 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:08.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd348acf700 1 -- 172.21.15.84:0/2370739621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3440b2620 msgr2=0x7fd3440c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd348acf700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3440b2620 0x7fd3440c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd348acf700 1 -- 172.21.15.84:0/2370739621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3440b29f0 msgr2=0x7fd344169c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd348acf700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3440b29f0 0x7fd344169c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd348acf700 1 -- 172.21.15.84:0/2370739621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3340093c0 con 0x7fd344159870 2023-10-06T03:25:08.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd348acf700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd344159870 0x7fd34416a160 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd33c001460 tx=0x7fd33c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd32bfff700 1 -- 172.21.15.84:0/2370739621 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00a950 con 0x7fd344159870 2023-10-06T03:25:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd32bfff700 1 -- 172.21.15.84:0/2370739621 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c00aab0 con 0x7fd344159870 2023-10-06T03:25:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd34a532700 1 -- 172.21.15.84:0/2370739621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3440d0a90 con 0x7fd344159870 2023-10-06T03:25:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd32bfff700 1 -- 172.21.15.84:0/2370739621 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00ae30 con 0x7fd344159870 2023-10-06T03:25:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.101+0000 7fd34a532700 1 -- 172.21.15.84:0/2370739621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd344150c60 con 0x7fd344159870 2023-10-06T03:25:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.102+0000 7fd34a532700 1 -- 172.21.15.84:0/2370739621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd344064ad0 con 0x7fd344159870 2023-10-06T03:25:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.103+0000 7fd32bfff700 1 -- 172.21.15.84:0/2370739621 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd33c007300 con 0x7fd344159870 2023-10-06T03:25:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.103+0000 7fd32bfff700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd330066f30 0x7fd3300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.103+0000 7fd32bfff700 1 -- 172.21.15.84:0/2370739621 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd33c084c70 con 0x7fd344159870 2023-10-06T03:25:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.103+0000 7fd343fff700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd330066f30 0x7fd3300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.103+0000 7fd343fff700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd330066f30 0x7fd3300693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd3440cd910 tx=0x7fd334016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.107+0000 7fd32bfff700 1 -- 172.21.15.84:0/2370739621 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd33c051c30 con 0x7fd344159870 2023-10-06T03:25:08.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.290+0000 7fd34a532700 1 -- 172.21.15.84:0/2370739621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3440cbc70 con 0x7fd344159870 2023-10-06T03:25:08.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.291+0000 7fd32bfff700 1 -- 172.21.15.84:0/2370739621 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fd33c055250 con 0x7fd344159870 2023-10-06T03:25:08.293 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:08.293 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:24:50.800397+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:46.821084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:48.147630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:08.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 -- 172.21.15.84:0/2370739621 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd330066f30 msgr2=0x7fd3300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd330066f30 0x7fd3300693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd3440cd910 tx=0x7fd334016000 comp rx=0 tx=0).stop 2023-10-06T03:25:08.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 -- 172.21.15.84:0/2370739621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd344159870 msgr2=0x7fd34416a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd344159870 0x7fd34416a160 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd33c001460 tx=0x7fd33c001a40 comp rx=0 tx=0).stop 2023-10-06T03:25:08.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 -- 172.21.15.84:0/2370739621 shutdown_connections 2023-10-06T03:25:08.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd330066f30 0x7fd3300693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd344159870 0x7fd34416a160 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3440b2620 0x7fd3440c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 --2- 172.21.15.84:0/2370739621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3440b29f0 0x7fd344169c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 -- 172.21.15.84:0/2370739621 >> 172.21.15.84:0/2370739621 conn(0x7fd34406ed20 msgr2=0x7fd344153880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:08.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 -- 172.21.15.84:0/2370739621 shutdown_connections 2023-10-06T03:25:08.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.293+0000 7fd34a532700 1 -- 172.21.15.84:0/2370739621 wait complete. 2023-10-06T03:25:08.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:25:08.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.421+0000 7f6682334700 1 Processor -- start 2023-10-06T03:25:08.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.421+0000 7f6682334700 1 -- start start 2023-10-06T03:25:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6682334700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f667c0cbc70 0x7f667c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6682334700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f667c0b2140 0x7f667c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6682334700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c0cb7e0 con 0x7f667c159480 2023-10-06T03:25:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6682334700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0b08a0 con 0x7f667c0cbc70 2023-10-06T03:25:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6682334700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0cb190 con 0x7f667c0b2140 2023-10-06T03:25:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6680b31700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f667c0cbc70 0x7f667c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6681332700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f667c159480 0x7f667c0b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57780/0 (socket says 172.21.15.84:57780) 2023-10-06T03:25:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6681332700 1 -- 172.21.15.84:0/588319312 learned_addr learned my addr 172.21.15.84:0/588319312 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6681b33700 1 --2- 172.21.15.84:0/588319312 >> v2:172.21.15.131:3300/0 conn(0x7f667c0b2140 0x7f667c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6680b31700 1 -- 172.21.15.84:0/588319312 >> v2:172.21.15.131:3300/0 conn(0x7f667c0b2140 msgr2=0x7f667c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6680b31700 1 --2- 172.21.15.84:0/588319312 >> v2:172.21.15.131:3300/0 conn(0x7f667c0b2140 0x7f667c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6680b31700 1 -- 172.21.15.84:0/588319312 >> v1:172.21.15.84:6789/0 conn(0x7f667c159480 legacy=0x7f667c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6680b31700 1 -- 172.21.15.84:0/588319312 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0cb470 con 0x7f667c0cbc70 2023-10-06T03:25:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.422+0000 7f6681b33700 1 --2- 172.21.15.84:0/588319312 >> v2:172.21.15.131:3300/0 conn(0x7f667c0b2140 0x7f667c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6680b31700 1 --2- 172.21.15.84:0/588319312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0cbc70 0x7f667c0cc0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ca830 tx=0x7f666c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5daab3716d2ea8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6673fff700 1 -- 172.21.15.84:0/588319312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00b6b0 con 0x7f667c0cbc70 2023-10-06T03:25:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6673fff700 1 -- 172.21.15.84:0/588319312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c00b810 con 0x7f667c0cbc70 2023-10-06T03:25:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6673fff700 1 -- 172.21.15.84:0/588319312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00bbb0 con 0x7f667c0cbc70 2023-10-06T03:25:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6682334700 1 -- 172.21.15.84:0/588319312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0cbc70 msgr2=0x7f667c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6682334700 1 --2- 172.21.15.84:0/588319312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0cbc70 0x7f667c0cc0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ca830 tx=0x7f666c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6682334700 1 -- 172.21.15.84:0/588319312 shutdown_connections 2023-10-06T03:25:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6682334700 1 --2- 172.21.15.84:0/588319312 >> v2:172.21.15.131:3300/0 conn(0x7f667c0b2140 0x7f667c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6682334700 1 --2- 172.21.15.84:0/588319312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0cbc70 0x7f667c0cc0c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6682334700 1 -- 172.21.15.84:0/588319312 >> 172.21.15.84:0/588319312 conn(0x7f667c06ed20 msgr2=0x7f667c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6682334700 1 -- 172.21.15.84:0/588319312 shutdown_connections 2023-10-06T03:25:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.423+0000 7f6682334700 1 -- 172.21.15.84:0/588319312 wait complete. 2023-10-06T03:25:08.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.424+0000 7f6682334700 1 Processor -- start 2023-10-06T03:25:08.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.424+0000 7f6682334700 1 -- start start 2023-10-06T03:25:08.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.425+0000 7f6682334700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0b2140 0x7f667c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.425+0000 7f6682334700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f667c0cbc70 0x7f667c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.425+0000 7f6682334700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f667c159480 0x7f667c0c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.425+0000 7f6682334700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0cde30 con 0x7f667c0b2140 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.425+0000 7f6682334700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0c9230 con 0x7f667c159480 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.425+0000 7f6682334700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0c9510 con 0x7f667c0cbc70 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.425+0000 7f6681332700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0b2140 0x7f667c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.425+0000 7f6681332700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0b2140 0x7f667c0c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55358/0 (socket says 172.21.15.84:55358) 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.425+0000 7f6681332700 1 -- 172.21.15.84:0/3310807658 learned_addr learned my addr 172.21.15.84:0/3310807658 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.425+0000 7f6680b31700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f667c0cbc70 0x7f667c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f6681b33700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f667c159480 0x7f667c0c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f6681332700 1 -- 172.21.15.84:0/3310807658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f667c0cbc70 msgr2=0x7f667c1547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f6681332700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f667c0cbc70 0x7f667c1547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f6681332700 1 -- 172.21.15.84:0/3310807658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f667c159480 msgr2=0x7f667c0c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f6681332700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f667c159480 0x7f667c0c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f6681332700 1 -- 172.21.15.84:0/3310807658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009420 con 0x7f667c0b2140 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f6681332700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0b2140 0x7f667c0c82a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f667800c560 tx=0x7f6678001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f66717fa700 1 -- 172.21.15.84:0/3310807658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678005b30 con 0x7f667c0b2140 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f66717fa700 1 -- 172.21.15.84:0/3310807658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678005cb0 con 0x7f667c0b2140 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f6682334700 1 -- 172.21.15.84:0/3310807658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c0c97f0 con 0x7f667c0b2140 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f66717fa700 1 -- 172.21.15.84:0/3310807658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678007320 con 0x7f667c0b2140 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.426+0000 7f6682334700 1 -- 172.21.15.84:0/3310807658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c0c52a0 con 0x7f667c0b2140 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.427+0000 7f6682334700 1 -- 172.21.15.84:0/3310807658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c0c4e20 con 0x7f667c0b2140 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.427+0000 7f66717fa700 1 -- 172.21.15.84:0/3310807658 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f667801b3b0 con 0x7f667c0b2140 2023-10-06T03:25:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.428+0000 7f66717fa700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6660066f30 0x7f66600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.428+0000 7f66717fa700 1 -- 172.21.15.84:0/3310807658 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6678083cf0 con 0x7f667c0b2140 2023-10-06T03:25:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.428+0000 7f6680b31700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6660066f30 0x7f66600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.428+0000 7f6680b31700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6660066f30 0x7f66600693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f666c0093f0 tx=0x7f666c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.432+0000 7f66717fa700 1 -- 172.21.15.84:0/3310807658 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f667c0c4e20 con 0x7f667c0b2140 2023-10-06T03:25:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.658+0000 7f6682334700 1 -- 172.21.15.84:0/3310807658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f667c0c4e20 con 0x7f667c0b2140 2023-10-06T03:25:08.660 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:25:08.659+0000 7f573ff98700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:25:08.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.664+0000 7f66717fa700 1 -- 172.21.15.84:0/3310807658 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f667c0c4e20 con 0x7f667c0b2140 2023-10-06T03:25:08.667 INFO:tasks.ceph.mds.a.smithi084.stderr: -895> 2023-10-06T03:24:51.620+0000 7f78825d6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:25:08.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 -- 172.21.15.84:0/3310807658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6660066f30 msgr2=0x7f66600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6660066f30 0x7f66600693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f666c0093f0 tx=0x7f666c017000 comp rx=0 tx=0).stop 2023-10-06T03:25:08.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 -- 172.21.15.84:0/3310807658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0b2140 msgr2=0x7f667c0c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0b2140 0x7f667c0c82a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f667800c560 tx=0x7f6678001020 comp rx=0 tx=0).stop 2023-10-06T03:25:08.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 -- 172.21.15.84:0/3310807658 shutdown_connections 2023-10-06T03:25:08.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6660066f30 0x7f66600693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f667c159480 0x7f667c0c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f667c0b2140 0x7f667c0c82a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 --2- 172.21.15.84:0/3310807658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f667c0cbc70 0x7f667c1547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 -- 172.21.15.84:0/3310807658 >> 172.21.15.84:0/3310807658 conn(0x7f667c06ed20 msgr2=0x7f667c15c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:08.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 -- 172.21.15.84:0/3310807658 shutdown_connections 2023-10-06T03:25:08.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.667+0000 7f6682334700 1 -- 172.21.15.84:0/3310807658 wait complete. 2023-10-06T03:25:08.670 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:25:08.682 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:25:08.689 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:25:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.795+0000 7f15ec420700 1 Processor -- start 2023-10-06T03:25:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.795+0000 7f15ec420700 1 -- start start 2023-10-06T03:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15ec420700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40b2a90 0x7f15e40cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15ec420700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f15e40cb980 0x7f15e40ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15ec420700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40cbdf0 con 0x7f15e40ced90 2023-10-06T03:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15ec420700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e40b2e60 con 0x7f15e40cb980 2023-10-06T03:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15ec420700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40cf5d0 con 0x7f15e40b2a90 2023-10-06T03:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15e99bb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f15e40cb980 0x7f15e40ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15ea1bc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40b2a90 0x7f15e40cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15ea1bc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40b2a90 0x7f15e40cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:59772/0 (socket says 172.21.15.84:59772) 2023-10-06T03:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15ea9bd700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f15e40ced90 0x7f15e40c5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:35824/0 (socket says 172.21.15.84:35824) 2023-10-06T03:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15e99bb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f15e40cb980 0x7f15e40ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:53626/0 (socket says 172.21.15.84:53626) 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.796+0000 7f15ea1bc700 1 -- 172.21.15.84:0/4076876763 learned_addr learned my addr 172.21.15.84:0/4076876763 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.797+0000 7f15e99bb700 1 -- 172.21.15.84:0/4076876763 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40b2a90 msgr2=0x7f15e40cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.797+0000 7f15e99bb700 1 --2- 172.21.15.84:0/4076876763 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40b2a90 0x7f15e40cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.797+0000 7f15e99bb700 1 -- 172.21.15.84:0/4076876763 >> v1:172.21.15.131:6789/0 conn(0x7f15e40ced90 legacy=0x7f15e40c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.797+0000 7f15e99bb700 1 -- 172.21.15.84:0/4076876763 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e40cf8b0 con 0x7f15e40cb980 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.797+0000 7f15e91ba700 1 -- 172.21.15.84:0/4076876763 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728486499 0 0) 0x7f15e40cbdf0 con 0x7f15e40ced90 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.797+0000 7f15e99bb700 1 --2- 172.21.15.84:0/4076876763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15e40cb980 0x7f15e40ce850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f15d40098e0 tx=0x7f15d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fae4f5cbaffa4476 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.797+0000 7f15e91ba700 1 -- 172.21.15.84:0/4076876763 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400b640 con 0x7f15e40cb980 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.797+0000 7f15e91ba700 1 -- 172.21.15.84:0/4076876763 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d400b7a0 con 0x7f15e40cb980 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.797+0000 7f15e91ba700 1 -- 172.21.15.84:0/4076876763 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400bb40 con 0x7f15e40cb980 2023-10-06T03:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.798+0000 7f15ec420700 1 -- 172.21.15.84:0/4076876763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15e40cb980 msgr2=0x7f15e40ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.798+0000 7f15ec420700 1 --2- 172.21.15.84:0/4076876763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15e40cb980 0x7f15e40ce850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f15d40098e0 tx=0x7f15d40091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.798+0000 7f15ec420700 1 -- 172.21.15.84:0/4076876763 shutdown_connections 2023-10-06T03:25:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.798+0000 7f15ec420700 1 --2- 172.21.15.84:0/4076876763 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40b2a90 0x7f15e40cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.798+0000 7f15ec420700 1 --2- 172.21.15.84:0/4076876763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15e40cb980 0x7f15e40ce850 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.798+0000 7f15ec420700 1 -- 172.21.15.84:0/4076876763 >> 172.21.15.84:0/4076876763 conn(0x7f15e4099740 msgr2=0x7f15e406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.798+0000 7f15ec420700 1 -- 172.21.15.84:0/4076876763 shutdown_connections 2023-10-06T03:25:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.798+0000 7f15ec420700 1 -- 172.21.15.84:0/4076876763 wait complete. 2023-10-06T03:25:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.799+0000 7f15ec420700 1 Processor -- start 2023-10-06T03:25:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.799+0000 7f15ec420700 1 -- start start 2023-10-06T03:25:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.799+0000 7f15ec420700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15e40b2a90 0x7f15e415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15ec420700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15e40cb980 0x7f15e415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15ec420700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40ced90 0x7f15e4156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15ec420700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40c7640 con 0x7f15e40cb980 2023-10-06T03:25:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15ec420700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40c7920 con 0x7f15e40b2a90 2023-10-06T03:25:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15ec420700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40c7c00 con 0x7f15e40ced90 2023-10-06T03:25:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15e99bb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15e40cb980 0x7f15e415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15e99bb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15e40cb980 0x7f15e415dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55394/0 (socket says 172.21.15.84:55394) 2023-10-06T03:25:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15e99bb700 1 -- 172.21.15.84:0/3746071720 learned_addr learned my addr 172.21.15.84:0/3746071720 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15ea1bc700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15e40b2a90 0x7f15e415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15ea9bd700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40ced90 0x7f15e4156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15e99bb700 1 -- 172.21.15.84:0/3746071720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40ced90 msgr2=0x7f15e4156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15e99bb700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40ced90 0x7f15e4156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15e99bb700 1 -- 172.21.15.84:0/3746071720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15e40b2a90 msgr2=0x7f15e415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15e99bb700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15e40b2a90 0x7f15e415b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15e99bb700 1 -- 172.21.15.84:0/3746071720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d4009420 con 0x7f15e40cb980 2023-10-06T03:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15ea1bc700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15e40b2a90 0x7f15e415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15e99bb700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15e40cb980 0x7f15e415dd90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f15e4088fe0 tx=0x7f15d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15da7fc700 1 -- 172.21.15.84:0/3746071720 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400bb20 con 0x7f15e40cb980 2023-10-06T03:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15da7fc700 1 -- 172.21.15.84:0/3746071720 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d4011420 con 0x7f15e40cb980 2023-10-06T03:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15da7fc700 1 -- 172.21.15.84:0/3746071720 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40117a0 con 0x7f15e40cb980 2023-10-06T03:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15ec420700 1 -- 172.21.15.84:0/3746071720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e40c7ee0 con 0x7f15e40cb980 2023-10-06T03:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.800+0000 7f15ec420700 1 -- 172.21.15.84:0/3746071720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e415cfc0 con 0x7f15e40cb980 2023-10-06T03:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.801+0000 7f15ec420700 1 -- 172.21.15.84:0/3746071720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e40c8400 con 0x7f15e40cb980 2023-10-06T03:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.802+0000 7f15da7fc700 1 -- 172.21.15.84:0/3746071720 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15d4011b10 con 0x7f15e40cb980 2023-10-06T03:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.802+0000 7f15da7fc700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f15c8066f30 0x7f15c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.802+0000 7f15da7fc700 1 -- 172.21.15.84:0/3746071720 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f15d4085cb0 con 0x7f15e40cb980 2023-10-06T03:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.802+0000 7f15ea1bc700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f15c8066f30 0x7f15c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.802+0000 7f15ea1bc700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f15c8066f30 0x7f15c80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f15e0006f60 tx=0x7f15e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:08.806+0000 7f15da7fc700 1 -- 172.21.15.84:0/3746071720 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15e40c8400 con 0x7f15e40cb980 2023-10-06T03:25:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.030+0000 7f15ec420700 1 -- 172.21.15.84:0/3746071720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f15e40c8400 con 0x7f15e40cb980 2023-10-06T03:25:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.668+0000 7f15da7fc700 1 -- 172.21.15.84:0/3746071720 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f15e40c8400 con 0x7f15e40cb980 2023-10-06T03:25:09.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 -- 172.21.15.84:0/3746071720 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f15c8066f30 msgr2=0x7f15c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f15c8066f30 0x7f15c80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f15e0006f60 tx=0x7f15e0008040 comp rx=0 tx=0).stop 2023-10-06T03:25:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 -- 172.21.15.84:0/3746071720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15e40cb980 msgr2=0x7f15e415dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15e40cb980 0x7f15e415dd90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f15e4088fe0 tx=0x7f15d4017000 comp rx=0 tx=0).stop 2023-10-06T03:25:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 -- 172.21.15.84:0/3746071720 shutdown_connections 2023-10-06T03:25:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f15c8066f30 0x7f15c80693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15e40b2a90 0x7f15e415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15e40ced90 0x7f15e4156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 --2- 172.21.15.84:0/3746071720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15e40cb980 0x7f15e415dd90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 -- 172.21.15.84:0/3746071720 >> 172.21.15.84:0/3746071720 conn(0x7f15e4099740 msgr2=0x7f15e4158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 -- 172.21.15.84:0/3746071720 shutdown_connections 2023-10-06T03:25:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.670+0000 7f15ec420700 1 -- 172.21.15.84:0/3746071720 wait complete. 2023-10-06T03:25:09.685 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:25:09.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.844+0000 7f621107b700 1 Processor -- start 2023-10-06T03:25:09.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.844+0000 7f621107b700 1 -- start start 2023-10-06T03:25:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f621107b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f620c06ed20 0x7f620c0b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f621107b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f620c0aee20 0x7f620c0af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f621107b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620c0b2d20 con 0x7f620c06f0f0 2023-10-06T03:25:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f621107b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620c06fb80 con 0x7f620c0aee20 2023-10-06T03:25:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f621107b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620c0b0450 con 0x7f620c06ed20 2023-10-06T03:25:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f620b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f620c0aee20 0x7f620c0af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f620a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f620c06f0f0 0x7f620c0b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57800/0 (socket says 172.21.15.84:57800) 2023-10-06T03:25:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f620a59c700 1 -- 172.21.15.84:0/2597786279 learned_addr learned my addr 172.21.15.84:0/2597786279 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f620ad9d700 1 --2- 172.21.15.84:0/2597786279 >> v2:172.21.15.131:3300/0 conn(0x7f620c06ed20 0x7f620c0b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f620b59e700 1 -- 172.21.15.84:0/2597786279 >> v2:172.21.15.131:3300/0 conn(0x7f620c06ed20 msgr2=0x7f620c0b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f620b59e700 1 --2- 172.21.15.84:0/2597786279 >> v2:172.21.15.131:3300/0 conn(0x7f620c06ed20 0x7f620c0b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f620b59e700 1 -- 172.21.15.84:0/2597786279 >> v1:172.21.15.84:6789/0 conn(0x7f620c06f0f0 legacy=0x7f620c0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f6209d9b700 1 -- 172.21.15.84:0/2597786279 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355366183 0 0) 0x7f620c0b2d20 con 0x7f620c06f0f0 2023-10-06T03:25:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.845+0000 7f620b59e700 1 -- 172.21.15.84:0/2597786279 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c0af7c0 con 0x7f620c0aee20 2023-10-06T03:25:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f620ad9d700 1 --2- 172.21.15.84:0/2597786279 >> v2:172.21.15.131:3300/0 conn(0x7f620c06ed20 0x7f620c0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f620b59e700 1 --2- 172.21.15.84:0/2597786279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 0x7f620c0af280 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f620c0cdd30 tx=0x7f6204009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53bb5e8f15c9e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f6209d9b700 1 -- 172.21.15.84:0/2597786279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620400e070 con 0x7f620c0aee20 2023-10-06T03:25:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f6209d9b700 1 -- 172.21.15.84:0/2597786279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620400bc30 con 0x7f620c0aee20 2023-10-06T03:25:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f6209d9b700 1 -- 172.21.15.84:0/2597786279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204012430 con 0x7f620c0aee20 2023-10-06T03:25:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f621107b700 1 -- 172.21.15.84:0/2597786279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 msgr2=0x7f620c0af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f621107b700 1 --2- 172.21.15.84:0/2597786279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 0x7f620c0af280 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f620c0cdd30 tx=0x7f6204009780 comp rx=0 tx=0).stop 2023-10-06T03:25:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f621107b700 1 -- 172.21.15.84:0/2597786279 shutdown_connections 2023-10-06T03:25:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f621107b700 1 --2- 172.21.15.84:0/2597786279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 0x7f620c0af280 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f621107b700 1 --2- 172.21.15.84:0/2597786279 >> v2:172.21.15.131:3300/0 conn(0x7f620c06ed20 0x7f620c0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f621107b700 1 -- 172.21.15.84:0/2597786279 >> 172.21.15.84:0/2597786279 conn(0x7f620c068330 msgr2=0x7f620c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f621107b700 1 -- 172.21.15.84:0/2597786279 shutdown_connections 2023-10-06T03:25:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.846+0000 7f621107b700 1 -- 172.21.15.84:0/2597786279 wait complete. 2023-10-06T03:25:09.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f621107b700 1 Processor -- start 2023-10-06T03:25:09.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f621107b700 1 -- start start 2023-10-06T03:25:09.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f621107b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f620c06ed20 0x7f620c1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f621107b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f620c06f0f0 0x7f620c0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f621107b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 0x7f620c0b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f621107b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620c0c99a0 con 0x7f620c0aee20 2023-10-06T03:25:09.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f621107b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620c0c9c80 con 0x7f620c06f0f0 2023-10-06T03:25:09.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f621107b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620c0c9f60 con 0x7f620c06ed20 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f620b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 0x7f620c0b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f620b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 0x7f620c0b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55404/0 (socket says 172.21.15.84:55404) 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f620b59e700 1 -- 172.21.15.84:0/2299558814 learned_addr learned my addr 172.21.15.84:0/2299558814 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f620ad9d700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f620c06ed20 0x7f620c1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.848+0000 7f620a59c700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f620c06f0f0 0x7f620c0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f620b59e700 1 -- 172.21.15.84:0/2299558814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f620c06ed20 msgr2=0x7f620c1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f620b59e700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f620c06ed20 0x7f620c1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f620b59e700 1 -- 172.21.15.84:0/2299558814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f620c06f0f0 msgr2=0x7f620c0c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f620b59e700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f620c06f0f0 0x7f620c0c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f620b59e700 1 -- 172.21.15.84:0/2299558814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204009a20 con 0x7f620c0aee20 2023-10-06T03:25:09.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f620b59e700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 0x7f620c0b4110 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f620c0893c0 tx=0x7f6204019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f61f2ffd700 1 -- 172.21.15.84:0/2299558814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204027470 con 0x7f620c0aee20 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f61f2ffd700 1 -- 172.21.15.84:0/2299558814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62040275d0 con 0x7f620c0aee20 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f621107b700 1 -- 172.21.15.84:0/2299558814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620c0ca240 con 0x7f620c0aee20 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f61f2ffd700 1 -- 172.21.15.84:0/2299558814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204027990 con 0x7f620c0aee20 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.849+0000 7f621107b700 1 -- 172.21.15.84:0/2299558814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620c15a160 con 0x7f620c0aee20 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.850+0000 7f621107b700 1 -- 172.21.15.84:0/2299558814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620c15a410 con 0x7f620c0aee20 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.850+0000 7f61f2ffd700 1 -- 172.21.15.84:0/2299558814 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6204024070 con 0x7f620c0aee20 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.851+0000 7f61f2ffd700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61f8066f30 0x7f61f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.851+0000 7f620ad9d700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61f8066f30 0x7f61f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.851+0000 7f61f2ffd700 1 -- 172.21.15.84:0/2299558814 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f6204086fb0 con 0x7f620c0aee20 2023-10-06T03:25:09.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.851+0000 7f620ad9d700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61f8066f30 0x7f61f80693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f61fc006f00 tx=0x7f61fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:09.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:09.855+0000 7f61f2ffd700 1 -- 172.21.15.84:0/2299558814 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f620c15a410 con 0x7f620c0aee20 2023-10-06T03:25:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.035+0000 7f621107b700 1 -- 172.21.15.84:0/2299558814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f620c15a410 con 0x7f620c0aee20 2023-10-06T03:25:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.670+0000 7f61f2ffd700 1 -- 172.21.15.84:0/2299558814 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f620c15a410 con 0x7f620c0aee20 2023-10-06T03:25:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.678+0000 7f621107b700 1 -- 172.21.15.84:0/2299558814 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61f8066f30 msgr2=0x7f61f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61f8066f30 0x7f61f80693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f61fc006f00 tx=0x7f61fc008040 comp rx=0 tx=0).stop 2023-10-06T03:25:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 -- 172.21.15.84:0/2299558814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 msgr2=0x7f620c0b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 0x7f620c0b4110 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f620c0893c0 tx=0x7f6204019000 comp rx=0 tx=0).stop 2023-10-06T03:25:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 -- 172.21.15.84:0/2299558814 shutdown_connections 2023-10-06T03:25:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f61f8066f30 0x7f61f80693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f620c0aee20 0x7f620c0b4110 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f620c06ed20 0x7f620c1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 --2- 172.21.15.84:0/2299558814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f620c06f0f0 0x7f620c0c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 -- 172.21.15.84:0/2299558814 >> 172.21.15.84:0/2299558814 conn(0x7f620c068330 msgr2=0x7f620c1567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:10.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 -- 172.21.15.84:0/2299558814 shutdown_connections 2023-10-06T03:25:10.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.679+0000 7f621107b700 1 -- 172.21.15.84:0/2299558814 wait complete. 2023-10-06T03:25:10.682 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:25:10.695 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:25:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.816+0000 7f2acec58700 1 Processor -- start 2023-10-06T03:25:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.816+0000 7f2acec58700 1 -- start start 2023-10-06T03:25:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.817+0000 7f2acec58700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2ac80b23a0 0x7f2ac80b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.817+0000 7f2acec58700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ac80aee20 0x7f2ac80af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.817+0000 7f2acec58700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac80b2d20 con 0x7f2ac806ed20 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.817+0000 7f2acec58700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac806fb80 con 0x7f2ac80aee20 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.817+0000 7f2acec58700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac80b2840 con 0x7f2ac80b23a0 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.817+0000 7f2acd1f5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ac80aee20 0x7f2ac80af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.817+0000 7f2acd1f5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ac80aee20 0x7f2ac80af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56804/0 (socket says 172.21.15.84:56804) 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.817+0000 7f2acd1f5700 1 -- 172.21.15.84:0/1871831184 learned_addr learned my addr 172.21.15.84:0/1871831184 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acd1f5700 1 -- 172.21.15.84:0/1871831184 >> v2:172.21.15.131:3300/0 conn(0x7f2ac80b23a0 msgr2=0x7f2ac80b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.817+0000 7f2abffff700 1 --2- 172.21.15.84:0/1871831184 >> v2:172.21.15.131:3300/0 conn(0x7f2ac80b23a0 0x7f2ac80b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acd1f5700 1 --2- 172.21.15.84:0/1871831184 >> v2:172.21.15.131:3300/0 conn(0x7f2ac80b23a0 0x7f2ac80b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acd1f5700 1 -- 172.21.15.84:0/1871831184 >> v1:172.21.15.131:6789/0 conn(0x7f2ac806ed20 legacy=0x7f2ac806f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acd1f5700 1 -- 172.21.15.84:0/1871831184 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80b0450 con 0x7f2ac80aee20 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2abffff700 1 --2- 172.21.15.84:0/1871831184 >> v2:172.21.15.131:3300/0 conn(0x7f2ac80b23a0 0x7f2ac80b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acd1f5700 1 --2- 172.21.15.84:0/1871831184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac80aee20 0x7f2ac80af280 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80b03c0 tx=0x7f2ac0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3e3b37ac4ce0f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2abf7fe700 1 -- 172.21.15.84:0/1871831184 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000b820 con 0x7f2ac80aee20 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2abf7fe700 1 -- 172.21.15.84:0/1871831184 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac000b980 con 0x7f2ac80aee20 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2abf7fe700 1 -- 172.21.15.84:0/1871831184 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000bd20 con 0x7f2ac80aee20 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acec58700 1 -- 172.21.15.84:0/1871831184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac80aee20 msgr2=0x7f2ac80af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acec58700 1 --2- 172.21.15.84:0/1871831184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac80aee20 0x7f2ac80af280 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80b03c0 tx=0x7f2ac0009250 comp rx=0 tx=0).stop 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acec58700 1 -- 172.21.15.84:0/1871831184 shutdown_connections 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acec58700 1 --2- 172.21.15.84:0/1871831184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac80aee20 0x7f2ac80af280 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acec58700 1 --2- 172.21.15.84:0/1871831184 >> v2:172.21.15.131:3300/0 conn(0x7f2ac80b23a0 0x7f2ac80b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acec58700 1 -- 172.21.15.84:0/1871831184 >> 172.21.15.84:0/1871831184 conn(0x7f2ac8068330 msgr2=0x7f2ac8068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acec58700 1 -- 172.21.15.84:0/1871831184 shutdown_connections 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.818+0000 7f2acec58700 1 -- 172.21.15.84:0/1871831184 wait complete. 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.819+0000 7f2acec58700 1 Processor -- start 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.820+0000 7f2acec58700 1 -- start start 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.820+0000 7f2acec58700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac806ed20 0x7f2ac8154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.820+0000 7f2acec58700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ac80aee20 0x7f2ac81580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.820+0000 7f2acec58700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ac80b23a0 0x7f2ac80cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.820+0000 7f2acec58700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac815abe0 con 0x7f2ac806ed20 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.820+0000 7f2acec58700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8158c00 con 0x7f2ac80aee20 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.820+0000 7f2acec58700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8158ee0 con 0x7f2ac80b23a0 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.820+0000 7f2acc9f4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac806ed20 0x7f2ac8154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acc9f4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac806ed20 0x7f2ac8154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56820/0 (socket says 172.21.15.84:56820) 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acc9f4700 1 -- 172.21.15.84:0/649734098 learned_addr learned my addr 172.21.15.84:0/649734098 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2abffff700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ac80aee20 0x7f2ac81580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acd1f5700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ac80b23a0 0x7f2ac80cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acc9f4700 1 -- 172.21.15.84:0/649734098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ac80b23a0 msgr2=0x7f2ac80cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acc9f4700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ac80b23a0 0x7f2ac80cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acc9f4700 1 -- 172.21.15.84:0/649734098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ac80aee20 msgr2=0x7f2ac81580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acc9f4700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ac80aee20 0x7f2ac81580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acc9f4700 1 -- 172.21.15.84:0/649734098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac00094f0 con 0x7f2ac806ed20 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acd1f5700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ac80b23a0 0x7f2ac80cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2abffff700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ac80aee20 0x7f2ac81580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acc9f4700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac806ed20 0x7f2ac8154a20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400bc30 tx=0x7f2ac4009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2abcff9700 1 -- 172.21.15.84:0/649734098 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac400c9b0 con 0x7f2ac806ed20 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2abcff9700 1 -- 172.21.15.84:0/649734098 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac400cb50 con 0x7f2ac806ed20 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acec58700 1 -- 172.21.15.84:0/649734098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac81591c0 con 0x7f2ac806ed20 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2abcff9700 1 -- 172.21.15.84:0/649734098 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4014410 con 0x7f2ac806ed20 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.821+0000 7f2acec58700 1 -- 172.21.15.84:0/649734098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac8154f60 con 0x7f2ac806ed20 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.822+0000 7f2acec58700 1 -- 172.21.15.84:0/649734098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac815aa40 con 0x7f2ac806ed20 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.822+0000 7f2abcff9700 1 -- 172.21.15.84:0/649734098 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ac4014800 con 0x7f2ac806ed20 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.823+0000 7f2abcff9700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ab4066f30 0x7f2ab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.823+0000 7f2abcff9700 1 -- 172.21.15.84:0/649734098 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6026+0+0 (secure 0 0 0) 0x7f2ac4084760 con 0x7f2ac806ed20 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.823+0000 7f2abffff700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ab4066f30 0x7f2ab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.823+0000 7f2abffff700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ab4066f30 0x7f2ab40693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80c8e10 tx=0x7f2ab8006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:10.827+0000 7f2abcff9700 1 -- 172.21.15.84:0/649734098 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ac815aa40 con 0x7f2ac806ed20 2023-10-06T03:25:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.011+0000 7f2acec58700 1 -- 172.21.15.84:0/649734098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ac815aa40 con 0x7f2ac806ed20 2023-10-06T03:25:11.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.674+0000 7f2abcff9700 1 -- 172.21.15.84:0/649734098 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2ac815aa40 con 0x7f2ac806ed20 2023-10-06T03:25:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 -- 172.21.15.84:0/649734098 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ab4066f30 msgr2=0x7f2ab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ab4066f30 0x7f2ab40693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80c8e10 tx=0x7f2ab8006f90 comp rx=0 tx=0).stop 2023-10-06T03:25:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 -- 172.21.15.84:0/649734098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac806ed20 msgr2=0x7f2ac8154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac806ed20 0x7f2ac8154a20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400bc30 tx=0x7f2ac4009820 comp rx=0 tx=0).stop 2023-10-06T03:25:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 -- 172.21.15.84:0/649734098 shutdown_connections 2023-10-06T03:25:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ab4066f30 0x7f2ab40693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ac80b23a0 0x7f2ac80cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac806ed20 0x7f2ac8154a20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 --2- 172.21.15.84:0/649734098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ac80aee20 0x7f2ac81580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 -- 172.21.15.84:0/649734098 >> 172.21.15.84:0/649734098 conn(0x7f2ac8068330 msgr2=0x7f2ac806f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:11.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 -- 172.21.15.84:0/649734098 shutdown_connections 2023-10-06T03:25:11.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.678+0000 7f2acec58700 1 -- 172.21.15.84:0/649734098 wait complete. 2023-10-06T03:25:11.683 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T03:25:11.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2023-10-06T03:25:11.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.810+0000 7f51f174b700 1 Processor -- start 2023-10-06T03:25:12.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.810+0000 7f51f174b700 1 -- start start 2023-10-06T03:25:12.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.811+0000 7f51f174b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec0b2a90 0x7f51ec0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.811+0000 7f51f174b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0cbdf0 con 0x7f51ec0cb980 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.811+0000 7f51f174b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0b2e60 con 0x7f51ec0c6610 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.811+0000 7f51f174b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0cf5d0 con 0x7f51ec0b2a90 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.811+0000 7f51e27fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f51ec0cb980 0x7f51ec0ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45420/0 (socket says 172.21.15.84:45420) 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.811+0000 7f51e27fc700 1 -- 172.21.15.84:0/3928598306 learned_addr learned my addr 172.21.15.84:0/3928598306 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51eaffd700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec0b2a90 0x7f51ec0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839465069 0 0) 0x7f51ec0cbdf0 con 0x7f51ec0cb980 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d8003570 con 0x7f51ec0cb980 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2462748086 0 0) 0x7f51d8003570 con 0x7f51ec0cb980 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec0b2a90 msgr2=0x7f51ec0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec0b2a90 0x7f51ec0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 >> v1:172.21.15.131:6789/0 conn(0x7f51ec0c6610 legacy=0x7f51ec1631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0cf8b0 con 0x7f51ec0cb980 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f51d4001470 con 0x7f51ec0cb980 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 >> v1:172.21.15.84:6789/0 conn(0x7f51ec0cb980 legacy=0x7f51ec0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec0b2a90 0x7f51d8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51d8004010 0x7f51d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d8004d50 0x7f51d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0cf5d0 con 0x7f51d8004d50 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d800bbf0 con 0x7f51d8004010 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d800bdb0 con 0x7f51ec0b2a90 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51eb7fe700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d8004d50 0x7f51d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51e27fc700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51d8004010 0x7f51d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51eaffd700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec0b2a90 0x7f51d8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51eb7fe700 1 -- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec0b2a90 msgr2=0x7f51d8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51eb7fe700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec0b2a90 0x7f51d8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51eb7fe700 1 -- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51d8004010 msgr2=0x7f51d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51eb7fe700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51d8004010 0x7f51d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.812+0000 7f51eb7fe700 1 -- 172.21.15.84:0/3928598306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8003570 con 0x7f51d8004d50 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51eb7fe700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d8004d50 0x7f51d80051c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f51e4001f90 tx=0x7f51e4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442e2cb5563ad7da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4001950 con 0x7f51d8004d50 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400c8b0 con 0x7f51d8004d50 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51ea7fc700 1 -- 172.21.15.84:0/3928598306 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400cc70 con 0x7f51d8004d50 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51f174b700 1 -- 172.21.15.84:0/3928598306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d8004d50 msgr2=0x7f51d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51f174b700 1 --2- 172.21.15.84:0/3928598306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d8004d50 0x7f51d80051c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f51e4001f90 tx=0x7f51e4001640 comp rx=0 tx=0).stop 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51eb7fe700 1 -- 172.21.15.84:0/3928598306 reap_dead start 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51f174b700 1 -- 172.21.15.84:0/3928598306 shutdown_connections 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51f174b700 1 -- 172.21.15.84:0/3928598306 >> 172.21.15.84:0/3928598306 conn(0x7f51ec099740 msgr2=0x7f51ec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51f174b700 1 -- 172.21.15.84:0/3928598306 shutdown_connections 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.813+0000 7f51f174b700 1 -- 172.21.15.84:0/3928598306 wait complete. 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.814+0000 7f51f174b700 1 Processor -- start 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51f174b700 1 -- start start 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51f174b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec169bc0 0x7f51ec09b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51f174b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ec15db90 0x7f51ec169f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51f174b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec16a4d0 0x7f51ec0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51f174b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15ecc0 con 0x7f51ec15db90 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51f174b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec16add0 con 0x7f51ec169bc0 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51f174b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15e140 con 0x7f51ec16a4d0 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51e27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ec15db90 0x7f51ec169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51e27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ec15db90 0x7f51ec169f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56842/0 (socket says 172.21.15.84:56842) 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51e27fc700 1 -- 172.21.15.84:0/3153221532 learned_addr learned my addr 172.21.15.84:0/3153221532 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51eb7fe700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec16a4d0 0x7f51ec0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.815+0000 7f51eaffd700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec169bc0 0x7f51ec09b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51e27fc700 1 -- 172.21.15.84:0/3153221532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec16a4d0 msgr2=0x7f51ec0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51e27fc700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec16a4d0 0x7f51ec0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51e27fc700 1 -- 172.21.15.84:0/3153221532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec169bc0 msgr2=0x7f51ec09b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51e27fc700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec169bc0 0x7f51ec09b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51e27fc700 1 -- 172.21.15.84:0/3153221532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec15e420 con 0x7f51ec15db90 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51eaffd700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec169bc0 0x7f51ec09b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51e27fc700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ec15db90 0x7f51ec169f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f51d40015a0 tx=0x7f51d4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51e37fe700 1 -- 172.21.15.84:0/3153221532 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4018030 con 0x7f51ec15db90 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51e37fe700 1 -- 172.21.15.84:0/3153221532 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4007850 con 0x7f51ec15db90 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51f174b700 1 -- 172.21.15.84:0/3153221532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec15e700 con 0x7f51ec15db90 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51e37fe700 1 -- 172.21.15.84:0/3153221532 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400fa90 con 0x7f51ec15db90 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.816+0000 7f51f174b700 1 -- 172.21.15.84:0/3153221532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec09b660 con 0x7f51ec15db90 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.817+0000 7f51f174b700 1 -- 172.21.15.84:0/3153221532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec16af20 con 0x7f51ec15db90 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.817+0000 7f51e37fe700 1 -- 172.21.15.84:0/3153221532 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51d401b070 con 0x7f51ec15db90 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.818+0000 7f51e37fe700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f51cc066f30 0x7f51cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.818+0000 7f51e37fe700 1 -- 172.21.15.84:0/3153221532 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f51d4019070 con 0x7f51ec15db90 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.818+0000 7f51eaffd700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f51cc066f30 0x7f51cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.818+0000 7f51eaffd700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f51cc066f30 0x7f51cc0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f51dc006ea0 tx=0x7f51dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:11.822+0000 7f51e37fe700 1 -- 172.21.15.84:0/3153221532 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51ec16af20 con 0x7f51ec15db90 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.005+0000 7f51f174b700 1 -- 172.21.15.84:0/3153221532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) v1 -- 0x7f51ec16af20 con 0x7f51ec15db90 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.009+0000 7f51e37fe700 1 -- 172.21.15.84:0/3153221532 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v12) v1 ==== 106+0+0 (secure 0 0 0) 0x7f51ec16af20 con 0x7f51ec15db90 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 -- 172.21.15.84:0/3153221532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f51cc066f30 msgr2=0x7f51cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f51cc066f30 0x7f51cc0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f51dc006ea0 tx=0x7f51dc008040 comp rx=0 tx=0).stop 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 -- 172.21.15.84:0/3153221532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ec15db90 msgr2=0x7f51ec169f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ec15db90 0x7f51ec169f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f51d40015a0 tx=0x7f51d4001e50 comp rx=0 tx=0).stop 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 -- 172.21.15.84:0/3153221532 shutdown_connections 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f51cc066f30 0x7f51cc0693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec169bc0 0x7f51ec09b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ec16a4d0 0x7f51ec0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 --2- 172.21.15.84:0/3153221532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ec15db90 0x7f51ec169f90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 -- 172.21.15.84:0/3153221532 >> 172.21.15.84:0/3153221532 conn(0x7f51ec099740 msgr2=0x7f51ec069930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 -- 172.21.15.84:0/3153221532 shutdown_connections 2023-10-06T03:25:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.011+0000 7f51f174b700 1 -- 172.21.15.84:0/3153221532 wait complete. 2023-10-06T03:25:12.176 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:25:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.324+0000 7fc6d1926700 1 Processor -- start 2023-10-06T03:25:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.324+0000 7fc6d1926700 1 -- start start 2023-10-06T03:25:12.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6d1926700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2660 0x7fc6cc0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6d1926700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0b2a30 0x7fc6cc0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6d1926700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc6cc0ceae0 0x7fc6cc0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6d1926700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0cc9b0 con 0x7fc6cc0b2a30 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6d1926700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0cf4c0 con 0x7fc6cc0ceae0 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6d1926700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0cbda0 con 0x7fc6cc0b2660 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6cbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0b2a30 0x7fc6cc0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6cbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0b2a30 0x7fc6cc0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56854/0 (socket says 172.21.15.84:56854) 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6cbfff700 1 -- 172.21.15.84:0/4204027867 learned_addr learned my addr 172.21.15.84:0/4204027867 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6d0924700 1 --2- 172.21.15.84:0/4204027867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2660 0x7fc6cc0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6d1125700 1 --2- 172.21.15.84:0/4204027867 >> v2:172.21.15.131:3300/0 conn(0x7fc6cc0ceae0 0x7fc6cc0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6cbfff700 1 -- 172.21.15.84:0/4204027867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2660 msgr2=0x7fc6cc0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6cbfff700 1 --2- 172.21.15.84:0/4204027867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2660 0x7fc6cc0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6cbfff700 1 -- 172.21.15.84:0/4204027867 >> v2:172.21.15.131:3300/0 conn(0x7fc6cc0ceae0 msgr2=0x7fc6cc0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6cbfff700 1 --2- 172.21.15.84:0/4204027867 >> v2:172.21.15.131:3300/0 conn(0x7fc6cc0ceae0 0x7fc6cc0cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6cbfff700 1 -- 172.21.15.84:0/4204027867 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0cc080 con 0x7fc6cc0b2a30 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.325+0000 7fc6d0924700 1 --2- 172.21.15.84:0/4204027867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2660 0x7fc6cc0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6cbfff700 1 --2- 172.21.15.84:0/4204027867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2a30 0x7fc6cc0cd230 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc089690 tx=0x7fc6c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718aa9d4c6fed348 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6cb7fe700 1 -- 172.21.15.84:0/4204027867 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000b860 con 0x7fc6cc0b2a30 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6cb7fe700 1 -- 172.21.15.84:0/4204027867 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c000b9c0 con 0x7fc6cc0b2a30 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6cb7fe700 1 -- 172.21.15.84:0/4204027867 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000bd60 con 0x7fc6cc0b2a30 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6d1926700 1 -- 172.21.15.84:0/4204027867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2a30 msgr2=0x7fc6cc0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6d1926700 1 --2- 172.21.15.84:0/4204027867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2a30 0x7fc6cc0cd230 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc089690 tx=0x7fc6c0009250 comp rx=0 tx=0).stop 2023-10-06T03:25:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6d1926700 1 -- 172.21.15.84:0/4204027867 shutdown_connections 2023-10-06T03:25:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6d1926700 1 --2- 172.21.15.84:0/4204027867 >> v2:172.21.15.131:3300/0 conn(0x7fc6cc0ceae0 0x7fc6cc0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6d1926700 1 --2- 172.21.15.84:0/4204027867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2660 0x7fc6cc0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6d1926700 1 --2- 172.21.15.84:0/4204027867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2a30 0x7fc6cc0cd230 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6d1926700 1 -- 172.21.15.84:0/4204027867 >> 172.21.15.84:0/4204027867 conn(0x7fc6cc099560 msgr2=0x7fc6cc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6d1926700 1 -- 172.21.15.84:0/4204027867 shutdown_connections 2023-10-06T03:25:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.326+0000 7fc6d1926700 1 -- 172.21.15.84:0/4204027867 wait complete. 2023-10-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.327+0000 7fc6d1926700 1 Processor -- start 2023-10-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.328+0000 7fc6d1926700 1 -- start start 2023-10-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.328+0000 7fc6d1926700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2660 0x7fc6cc152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.328+0000 7fc6d1926700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2a30 0x7fc6cc0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.328+0000 7fc6d1926700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6cc0ceae0 0x7fc6cc14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.328+0000 7fc6d1926700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0c75f0 con 0x7fc6cc0b2660 2023-10-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.328+0000 7fc6d1926700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1529f0 con 0x7fc6cc0ceae0 2023-10-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.328+0000 7fc6d1926700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc152cd0 con 0x7fc6cc0b2a30 2023-10-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.328+0000 7fc6d0924700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2660 0x7fc6cc152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.328+0000 7fc6d0924700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2660 0x7fc6cc152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56868/0 (socket says 172.21.15.84:56868) 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.328+0000 7fc6d0924700 1 -- 172.21.15.84:0/1968363593 learned_addr learned my addr 172.21.15.84:0/1968363593 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6cbfff700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2a30 0x7fc6cc0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6d1125700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6cc0ceae0 0x7fc6cc14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6d0924700 1 -- 172.21.15.84:0/1968363593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2a30 msgr2=0x7fc6cc0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6d0924700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2a30 0x7fc6cc0ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6d0924700 1 -- 172.21.15.84:0/1968363593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6cc0ceae0 msgr2=0x7fc6cc14fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6d0924700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6cc0ceae0 0x7fc6cc14fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6d0924700 1 -- 172.21.15.84:0/1968363593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00094f0 con 0x7fc6cc0b2660 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6cbfff700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2a30 0x7fc6cc0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6d0924700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2660 0x7fc6cc152320 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00d180 tx=0x7fc6bc009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6c8ff9700 1 -- 172.21.15.84:0/1968363593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc00de20 con 0x7fc6cc0b2660 2023-10-06T03:25:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6c8ff9700 1 -- 172.21.15.84:0/1968363593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00f040 con 0x7fc6cc0b2660 2023-10-06T03:25:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6d1926700 1 -- 172.21.15.84:0/1968363593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc152fb0 con 0x7fc6cc0b2660 2023-10-06T03:25:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6c8ff9700 1 -- 172.21.15.84:0/1968363593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc015670 con 0x7fc6cc0b2660 2023-10-06T03:25:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.329+0000 7fc6d1926700 1 -- 172.21.15.84:0/1968363593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc1501b0 con 0x7fc6cc0b2660 2023-10-06T03:25:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.330+0000 7fc6d1926700 1 -- 172.21.15.84:0/1968363593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc05f270 con 0x7fc6cc0b2660 2023-10-06T03:25:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.330+0000 7fc6c8ff9700 1 -- 172.21.15.84:0/1968363593 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6bc015a60 con 0x7fc6cc0b2660 2023-10-06T03:25:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.331+0000 7fc6c8ff9700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6b8066f30 0x7fc6b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.331+0000 7fc6c8ff9700 1 -- 172.21.15.84:0/1968363593 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fc6bc0849f0 con 0x7fc6cc0b2660 2023-10-06T03:25:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.331+0000 7fc6cbfff700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6b8066f30 0x7fc6b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.331+0000 7fc6cbfff700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6b8066f30 0x7fc6b80693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc089690 tx=0x7fc6c0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.335+0000 7fc6c8ff9700 1 -- 172.21.15.84:0/1968363593 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6bc04e5a0 con 0x7fc6cc0b2660 2023-10-06T03:25:12.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.518+0000 7fc6d1926700 1 -- 172.21.15.84:0/1968363593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc6cc0cc360 con 0x7fc6cc0b2660 2023-10-06T03:25:12.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.521+0000 7fc6c8ff9700 1 -- 172.21.15.84:0/1968363593 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc6bc01a0a0 con 0x7fc6cc0b2660 2023-10-06T03:25:12.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 -- 172.21.15.84:0/1968363593 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6b8066f30 msgr2=0x7fc6b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6b8066f30 0x7fc6b80693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc089690 tx=0x7fc6c0017000 comp rx=0 tx=0).stop 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 -- 172.21.15.84:0/1968363593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2660 msgr2=0x7fc6cc152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2660 0x7fc6cc152320 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00d180 tx=0x7fc6bc009a40 comp rx=0 tx=0).stop 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 -- 172.21.15.84:0/1968363593 shutdown_connections 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6b8066f30 0x7fc6b80693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6cc0ceae0 0x7fc6cc14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0b2660 0x7fc6cc152320 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 --2- 172.21.15.84:0/1968363593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6cc0b2a30 0x7fc6cc0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 -- 172.21.15.84:0/1968363593 >> 172.21.15.84:0/1968363593 conn(0x7fc6cc099560 msgr2=0x7fc6cc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 -- 172.21.15.84:0/1968363593 shutdown_connections 2023-10-06T03:25:12.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.524+0000 7fc6d1926700 1 -- 172.21.15.84:0/1968363593 wait complete. 2023-10-06T03:25:12.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2023-10-06T03:25:12.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.649+0000 7f558fdc8700 1 Processor -- start 2023-10-06T03:25:12.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.649+0000 7f558fdc8700 1 -- start start 2023-10-06T03:25:12.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.650+0000 7f558fdc8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55881595a0 0x7f55880aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.650+0000 7f558fdc8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55880b49e0 0x7f55880aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.650+0000 7f558fdc8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55880b0ca0 con 0x7f55880b07a0 2023-10-06T03:25:12.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.650+0000 7f558fdc8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55880b0f80 con 0x7f55881595a0 2023-10-06T03:25:12.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.650+0000 7f558fdc8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55880b1260 con 0x7f55880b49e0 2023-10-06T03:25:12.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.650+0000 7f558db64700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55881595a0 0x7f55880aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.650+0000 7f558db64700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55881595a0 0x7f55880aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56870/0 (socket says 172.21.15.84:56870) 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.650+0000 7f558db64700 1 -- 172.21.15.84:0/1761846410 learned_addr learned my addr 172.21.15.84:0/1761846410 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558d363700 1 --2- 172.21.15.84:0/1761846410 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55880b49e0 0x7f55880aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558db64700 1 -- 172.21.15.84:0/1761846410 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55880b49e0 msgr2=0x7f55880aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558db64700 1 --2- 172.21.15.84:0/1761846410 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55880b49e0 0x7f55880aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558db64700 1 -- 172.21.15.84:0/1761846410 >> v1:172.21.15.131:6789/0 conn(0x7f55880b07a0 legacy=0x7f55880b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558db64700 1 -- 172.21.15.84:0/1761846410 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880b1540 con 0x7f55881595a0 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558db64700 1 --2- 172.21.15.84:0/1761846410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55881595a0 0x7f55880aa570 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5584009990 tx=0x7f5584009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a03dbd7fefee4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558cb62700 1 -- 172.21.15.84:0/1761846410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584005c10 con 0x7f55881595a0 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558cb62700 1 -- 172.21.15.84:0/1761846410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5584005d70 con 0x7f55881595a0 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558cb62700 1 -- 172.21.15.84:0/1761846410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558400b880 con 0x7f55881595a0 2023-10-06T03:25:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558fdc8700 1 -- 172.21.15.84:0/1761846410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55881595a0 msgr2=0x7f55880aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558fdc8700 1 --2- 172.21.15.84:0/1761846410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55881595a0 0x7f55880aa570 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5584009990 tx=0x7f5584009220 comp rx=0 tx=0).stop 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558fdc8700 1 -- 172.21.15.84:0/1761846410 shutdown_connections 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558fdc8700 1 --2- 172.21.15.84:0/1761846410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55881595a0 0x7f55880aa570 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.651+0000 7f558fdc8700 1 --2- 172.21.15.84:0/1761846410 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55880b49e0 0x7f55880aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.652+0000 7f558fdc8700 1 -- 172.21.15.84:0/1761846410 >> 172.21.15.84:0/1761846410 conn(0x7f5588099830 msgr2=0x7f558806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.652+0000 7f558fdc8700 1 -- 172.21.15.84:0/1761846410 shutdown_connections 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.652+0000 7f558fdc8700 1 -- 172.21.15.84:0/1761846410 wait complete. 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558fdc8700 1 Processor -- start 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558fdc8700 1 -- start start 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558fdc8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55880b07a0 0x7f558815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558fdc8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55880b49e0 0x7f55880cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558fdc8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55881595a0 0x7f55880cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558fdc8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588099f90 con 0x7f55880b49e0 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558fdc8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558809add0 con 0x7f55880b07a0 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558fdc8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558809a1c0 con 0x7f55881595a0 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558d363700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55880b49e0 0x7f55880cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558d363700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55880b49e0 0x7f55880cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56876/0 (socket says 172.21.15.84:56876) 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.653+0000 7f558d363700 1 -- 172.21.15.84:0/3811787712 learned_addr learned my addr 172.21.15.84:0/3811787712 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f558d363700 1 -- 172.21.15.84:0/3811787712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55881595a0 msgr2=0x7f55880cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f558d363700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55881595a0 0x7f55880cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f558d363700 1 -- 172.21.15.84:0/3811787712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55880b07a0 msgr2=0x7f558815c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f558d363700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55880b07a0 0x7f558815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f558d363700 1 -- 172.21.15.84:0/3811787712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5584009480 con 0x7f55880b49e0 2023-10-06T03:25:12.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f558d363700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55880b49e0 0x7f55880cb950 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f557800d890 tx=0x7f5578008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f557dffb700 1 -- 172.21.15.84:0/3811787712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780125f0 con 0x7f55880b49e0 2023-10-06T03:25:12.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f557dffb700 1 -- 172.21.15.84:0/3811787712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5578012770 con 0x7f55880b49e0 2023-10-06T03:25:12.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f557dffb700 1 -- 172.21.15.84:0/3811787712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578012b30 con 0x7f55880b49e0 2023-10-06T03:25:12.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f558fdc8700 1 -- 172.21.15.84:0/3811787712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558809a4a0 con 0x7f55880b49e0 2023-10-06T03:25:12.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.654+0000 7f558fdc8700 1 -- 172.21.15.84:0/3811787712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558809aa60 con 0x7f55880b49e0 2023-10-06T03:25:12.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.655+0000 7f558fdc8700 1 -- 172.21.15.84:0/3811787712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55880696c0 con 0x7f55880b49e0 2023-10-06T03:25:12.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.655+0000 7f557dffb700 1 -- 172.21.15.84:0/3811787712 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f557801e460 con 0x7f55880b49e0 2023-10-06T03:25:12.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.656+0000 7f557dffb700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f556c066f30 0x7f556c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.656+0000 7f557dffb700 1 -- 172.21.15.84:0/3811787712 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f5578084c10 con 0x7f55880b49e0 2023-10-06T03:25:12.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.656+0000 7f558db64700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f556c066f30 0x7f556c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.656+0000 7f558db64700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f556c066f30 0x7f556c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5584009260 tx=0x7f5584016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.660+0000 7f557dffb700 1 -- 172.21.15.84:0/3811787712 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5578051ee0 con 0x7f55880b49e0 2023-10-06T03:25:12.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:12.919+0000 7f558fdc8700 1 -- 172.21.15.84:0/3811787712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) v1 -- 0x7f5588064ad0 con 0x7f55880b49e0 2023-10-06T03:25:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.679+0000 7f557dffb700 1 -- 172.21.15.84:0/3811787712 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v97) v1 ==== 144+0+0 (secure 0 0 0) 0x7f5578055500 con 0x7f55880b49e0 2023-10-06T03:25:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 -- 172.21.15.84:0/3811787712 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f556c066f30 msgr2=0x7f556c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f556c066f30 0x7f556c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5584009260 tx=0x7f5584016000 comp rx=0 tx=0).stop 2023-10-06T03:25:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 -- 172.21.15.84:0/3811787712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55880b49e0 msgr2=0x7f55880cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55880b49e0 0x7f55880cb950 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f557800d890 tx=0x7f5578008040 comp rx=0 tx=0).stop 2023-10-06T03:25:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 -- 172.21.15.84:0/3811787712 shutdown_connections 2023-10-06T03:25:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f556c066f30 0x7f556c0693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55880b07a0 0x7f558815c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55881595a0 0x7f55880cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 --2- 172.21.15.84:0/3811787712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55880b49e0 0x7f55880cb950 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 -- 172.21.15.84:0/3811787712 >> 172.21.15.84:0/3811787712 conn(0x7f5588099830 msgr2=0x7f55880b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 -- 172.21.15.84:0/3811787712 shutdown_connections 2023-10-06T03:25:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.682+0000 7f558fdc8700 1 -- 172.21.15.84:0/3811787712 wait complete. 2023-10-06T03:25:13.696 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back ... ok 2023-10-06T03:25:13.697 INFO:tasks.cephfs_test_runner:Starting test: test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) Check that mds evicts blocklisted client 2023-10-06T03:25:13.697 INFO:tasks.cephfs_test_runner:test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T03:25:13.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2023-10-06T03:25:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.812+0000 7f31229f2700 1 Processor -- start 2023-10-06T03:25:13.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.812+0000 7f31229f2700 1 -- start start 2023-10-06T03:25:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f31229f2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f311c0cc920 0x7f311c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f31229f2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f311c06c1a0 0x7f311c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f31229f2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c06c9e0 con 0x7f311c156390 2023-10-06T03:25:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f31229f2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311c156b60 con 0x7f311c06c1a0 2023-10-06T03:25:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f31229f2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311c156e40 con 0x7f311c0cc920 2023-10-06T03:25:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f3120f8f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f311c06c1a0 0x7f311c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f311bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f311c156390 0x7f311c0cc210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45432/0 (socket says 172.21.15.84:45432) 2023-10-06T03:25:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f311bfff700 1 -- 172.21.15.84:0/1000209302 learned_addr learned my addr 172.21.15.84:0/1000209302 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f311b7fe700 1 --2- 172.21.15.84:0/1000209302 >> v2:172.21.15.131:3300/0 conn(0x7f311c0cc920 0x7f311c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f3120f8f700 1 -- 172.21.15.84:0/1000209302 >> v2:172.21.15.131:3300/0 conn(0x7f311c0cc920 msgr2=0x7f311c06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f3120f8f700 1 --2- 172.21.15.84:0/1000209302 >> v2:172.21.15.131:3300/0 conn(0x7f311c0cc920 0x7f311c06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f3120f8f700 1 -- 172.21.15.84:0/1000209302 >> v1:172.21.15.84:6789/0 conn(0x7f311c156390 legacy=0x7f311c0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f3120f8f700 1 -- 172.21.15.84:0/1000209302 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c157120 con 0x7f311c06c1a0 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f311affd700 1 -- 172.21.15.84:0/1000209302 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306033783 0 0) 0x7f311c06c9e0 con 0x7f311c156390 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f3120f8f700 1 --2- 172.21.15.84:0/1000209302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 0x7f311c0c88c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f311c0c4480 tx=0x7f3114009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7570f9fcc2967ad8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f311affd700 1 -- 172.21.15.84:0/1000209302 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311400e070 con 0x7f311c06c1a0 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f311affd700 1 -- 172.21.15.84:0/1000209302 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311400bc30 con 0x7f311c06c1a0 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.813+0000 7f311affd700 1 -- 172.21.15.84:0/1000209302 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114012430 con 0x7f311c06c1a0 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.814+0000 7f31229f2700 1 -- 172.21.15.84:0/1000209302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 msgr2=0x7f311c0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.814+0000 7f31229f2700 1 --2- 172.21.15.84:0/1000209302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 0x7f311c0c88c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f311c0c4480 tx=0x7f3114009780 comp rx=0 tx=0).stop 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.814+0000 7f31229f2700 1 -- 172.21.15.84:0/1000209302 shutdown_connections 2023-10-06T03:25:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.814+0000 7f31229f2700 1 --2- 172.21.15.84:0/1000209302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 0x7f311c0c88c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.814+0000 7f31229f2700 1 --2- 172.21.15.84:0/1000209302 >> v2:172.21.15.131:3300/0 conn(0x7f311c0cc920 0x7f311c06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.814+0000 7f31229f2700 1 -- 172.21.15.84:0/1000209302 >> 172.21.15.84:0/1000209302 conn(0x7f311c0cdef0 msgr2=0x7f311c0c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.814+0000 7f31229f2700 1 -- 172.21.15.84:0/1000209302 shutdown_connections 2023-10-06T03:25:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.814+0000 7f31229f2700 1 -- 172.21.15.84:0/1000209302 wait complete. 2023-10-06T03:25:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.815+0000 7f31229f2700 1 Processor -- start 2023-10-06T03:25:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.815+0000 7f31229f2700 1 -- start start 2023-10-06T03:25:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f31229f2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 0x7f311c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f31229f2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f311c0cc920 0x7f311c0c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f31229f2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c156390 0x7f311c0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f31229f2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c0ca100 con 0x7f311c06c1a0 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f31229f2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c153600 con 0x7f311c156390 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f31229f2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c0ca590 con 0x7f311c0cc920 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f311bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 0x7f311c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f311bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 0x7f311c1530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56898/0 (socket says 172.21.15.84:56898) 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f311bfff700 1 -- 172.21.15.84:0/3459471683 learned_addr learned my addr 172.21.15.84:0/3459471683 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f3120f8f700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c156390 0x7f311c0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f311b7fe700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f311c0cc920 0x7f311c0c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f311bfff700 1 -- 172.21.15.84:0/3459471683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f311c0cc920 msgr2=0x7f311c0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f311bfff700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f311c0cc920 0x7f311c0c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f311bfff700 1 -- 172.21.15.84:0/3459471683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c156390 msgr2=0x7f311c0c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f311bfff700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c156390 0x7f311c0c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.816+0000 7f311bfff700 1 -- 172.21.15.84:0/3459471683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3114009a20 con 0x7f311c06c1a0 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.817+0000 7f311bfff700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 0x7f311c1530c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c5e0 tx=0x7f310c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.817+0000 7f3103fff700 1 -- 172.21.15.84:0/3459471683 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c005b30 con 0x7f311c06c1a0 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.817+0000 7f3103fff700 1 -- 172.21.15.84:0/3459471683 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c005c90 con 0x7f311c06c1a0 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.817+0000 7f31229f2700 1 -- 172.21.15.84:0/3459471683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311c0b2a10 con 0x7f311c06c1a0 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.817+0000 7f3103fff700 1 -- 172.21.15.84:0/3459471683 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c007300 con 0x7f311c06c1a0 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.817+0000 7f31229f2700 1 -- 172.21.15.84:0/3459471683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c0c6c10 con 0x7f311c06c1a0 2023-10-06T03:25:13.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.818+0000 7f31229f2700 1 -- 172.21.15.84:0/3459471683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311c0ca3e0 con 0x7f311c06c1a0 2023-10-06T03:25:13.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.818+0000 7f3103fff700 1 -- 172.21.15.84:0/3459471683 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f310c01b3b0 con 0x7f311c06c1a0 2023-10-06T03:25:13.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.818+0000 7f3103fff700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3108066f30 0x7f31080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.818+0000 7f3103fff700 1 -- 172.21.15.84:0/3459471683 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f310c083920 con 0x7f311c06c1a0 2023-10-06T03:25:13.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.819+0000 7f311b7fe700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3108066f30 0x7f31080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.819+0000 7f311b7fe700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3108066f30 0x7f31080693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f311c0c5aa0 tx=0x7f3110008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:13.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:13.823+0000 7f3103fff700 1 -- 172.21.15.84:0/3459471683 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f310c050bf0 con 0x7f311c06c1a0 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.075+0000 7f31229f2700 1 -- 172.21.15.84:0/3459471683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) v1 -- 0x7f311c0cc580 con 0x7f311c06c1a0 2023-10-06T03:25:14.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.681+0000 7f3103fff700 1 -- 172.21.15.84:0/3459471683 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v98) v1 ==== 156+0+0 (secure 0 0 0) 0x7f310c017020 con 0x7f311c06c1a0 2023-10-06T03:25:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.683+0000 7f31229f2700 1 -- 172.21.15.84:0/3459471683 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3108066f30 msgr2=0x7f31080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.683+0000 7f31229f2700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3108066f30 0x7f31080693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f311c0c5aa0 tx=0x7f3110008040 comp rx=0 tx=0).stop 2023-10-06T03:25:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.683+0000 7f31229f2700 1 -- 172.21.15.84:0/3459471683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 msgr2=0x7f311c1530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.683+0000 7f31229f2700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 0x7f311c1530c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c5e0 tx=0x7f310c001070 comp rx=0 tx=0).stop 2023-10-06T03:25:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.683+0000 7f31229f2700 1 -- 172.21.15.84:0/3459471683 shutdown_connections 2023-10-06T03:25:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.683+0000 7f31229f2700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3108066f30 0x7f31080693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.683+0000 7f31229f2700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c156390 0x7f311c0c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.683+0000 7f31229f2700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311c06c1a0 0x7f311c1530c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.683+0000 7f31229f2700 1 --2- 172.21.15.84:0/3459471683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f311c0cc920 0x7f311c0c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.683+0000 7f31229f2700 1 -- 172.21.15.84:0/3459471683 >> 172.21.15.84:0/3459471683 conn(0x7f311c0cdef0 msgr2=0x7f311c0c38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.684+0000 7f31229f2700 1 -- 172.21.15.84:0/3459471683 shutdown_connections 2023-10-06T03:25:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.684+0000 7f31229f2700 1 -- 172.21.15.84:0/3459471683 wait complete. 2023-10-06T03:25:14.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:25:14.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.814+0000 7f650aba5700 1 Processor -- start 2023-10-06T03:25:14.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.814+0000 7f650aba5700 1 -- start start 2023-10-06T03:25:14.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f650aba5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f65041598e0 0x7f65040ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f650aba5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65040cbcb0 0x7f65040ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f650aba5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65040cf610 con 0x7f6504159510 2023-10-06T03:25:14.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f650aba5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65040cf8f0 con 0x7f65041598e0 2023-10-06T03:25:14.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f650aba5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65040cfbd0 con 0x7f65040cbcb0 2023-10-06T03:25:14.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f6508941700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6504159510 0x7f65040cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45448/0 (socket says 172.21.15.84:45448) 2023-10-06T03:25:14.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f6508941700 1 -- 172.21.15.84:0/1147777386 learned_addr learned my addr 172.21.15.84:0/1147777386 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:14.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fbfff700 1 --2- 172.21.15.84:0/1147777386 >> v2:172.21.15.131:3300/0 conn(0x7f65041598e0 0x7f65040ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f6509142700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65040cbcb0 0x7f65040ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779744519 0 0) 0x7f65040cf610 con 0x7f6504159510 2023-10-06T03:25:14.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64ec003570 con 0x7f6504159510 2023-10-06T03:25:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3109834507 0 0) 0x7f64ec003570 con 0x7f6504159510 2023-10-06T03:25:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65040cbcb0 msgr2=0x7f65040ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65040cbcb0 0x7f65040ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 >> v2:172.21.15.131:3300/0 conn(0x7f65041598e0 msgr2=0x7f65040ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 --2- 172.21.15.84:0/1147777386 >> v2:172.21.15.131:3300/0 conn(0x7f65041598e0 0x7f65040ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65040cfeb0 con 0x7f6504159510 2023-10-06T03:25:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f65000017f0 con 0x7f6504159510 2023-10-06T03:25:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 >> v1:172.21.15.84:6789/0 conn(0x7f6504159510 legacy=0x7f65040cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64ec003a60 0x7f64ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65040cbcb0 0x7f64ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec004d50 0x7f64ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040cf8f0 con 0x7f64ec004d50 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040cfbd0 con 0x7f64ec003a60 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec00ba60 con 0x7f65040cbcb0 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.815+0000 7f6509142700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec004d50 0x7f64ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f6508941700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64ec003a60 0x7f64ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f64fbfff700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65040cbcb0 0x7f64ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f6509142700 1 -- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65040cbcb0 msgr2=0x7f64ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f6509142700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65040cbcb0 0x7f64ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f6509142700 1 -- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64ec003a60 msgr2=0x7f64ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f6509142700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64ec003a60 0x7f64ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f6509142700 1 -- 172.21.15.84:0/1147777386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec003570 con 0x7f64ec004d50 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f6509142700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec004d50 0x7f64ec0051c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009c00 tx=0x7f64fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2637f30f2d8d99d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc00e6b0 con 0x7f64ec004d50 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc00e810 con 0x7f64ec004d50 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f64fb7fe700 1 -- 172.21.15.84:0/1147777386 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc00ebd0 con 0x7f64ec004d50 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f650aba5700 1 -- 172.21.15.84:0/1147777386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec004d50 msgr2=0x7f64ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f650aba5700 1 --2- 172.21.15.84:0/1147777386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec004d50 0x7f64ec0051c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009c00 tx=0x7f64fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.816+0000 7f6509142700 1 -- 172.21.15.84:0/1147777386 reap_dead start 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.817+0000 7f650aba5700 1 -- 172.21.15.84:0/1147777386 shutdown_connections 2023-10-06T03:25:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.817+0000 7f650aba5700 1 -- 172.21.15.84:0/1147777386 >> 172.21.15.84:0/1147777386 conn(0x7f6504089e90 msgr2=0x7f65040997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:14.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.817+0000 7f650aba5700 1 -- 172.21.15.84:0/1147777386 shutdown_connections 2023-10-06T03:25:14.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.817+0000 7f650aba5700 1 -- 172.21.15.84:0/1147777386 wait complete. 2023-10-06T03:25:14.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.818+0000 7f650aba5700 1 Processor -- start 2023-10-06T03:25:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.818+0000 7f650aba5700 1 -- start start 2023-10-06T03:25:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.818+0000 7f650aba5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650414aaf0 0x7f650414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f650aba5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65040c63f0 0x7f6504148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f650aba5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650414aec0 0x7f6504149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f650aba5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040b61c0 con 0x7f650414aaf0 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f650aba5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040b5890 con 0x7f65040c63f0 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f650aba5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65040b5b70 con 0x7f650414aec0 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f6508941700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650414aaf0 0x7f650414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f6508941700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650414aaf0 0x7f650414f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56918/0 (socket says 172.21.15.84:56918) 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f6508941700 1 -- 172.21.15.84:0/3771529161 learned_addr learned my addr 172.21.15.84:0/3771529161 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f6509142700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650414aec0 0x7f6504149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f6508941700 1 -- 172.21.15.84:0/3771529161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650414aec0 msgr2=0x7f6504149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f6508941700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650414aec0 0x7f6504149500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f6508941700 1 -- 172.21.15.84:0/3771529161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65040c63f0 msgr2=0x7f6504148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f64fbfff700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65040c63f0 0x7f6504148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f6508941700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65040c63f0 0x7f6504148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f6508941700 1 -- 172.21.15.84:0/3771529161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65040b5e50 con 0x7f650414aaf0 2023-10-06T03:25:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f6508941700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650414aaf0 0x7f650414f4b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f65000020a0 tx=0x7f6500002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f64f8ff9700 1 -- 172.21.15.84:0/3771529161 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500013600 con 0x7f650414aaf0 2023-10-06T03:25:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f64f8ff9700 1 -- 172.21.15.84:0/3771529161 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6500013780 con 0x7f650414aaf0 2023-10-06T03:25:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f650aba5700 1 -- 172.21.15.84:0/3771529161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65040b5580 con 0x7f650414aaf0 2023-10-06T03:25:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f64f8ff9700 1 -- 172.21.15.84:0/3771529161 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500013b40 con 0x7f650414aaf0 2023-10-06T03:25:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.819+0000 7f650aba5700 1 -- 172.21.15.84:0/3771529161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650415cfe0 con 0x7f650414aaf0 2023-10-06T03:25:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.820+0000 7f650aba5700 1 -- 172.21.15.84:0/3771529161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6504064ad0 con 0x7f650414aaf0 2023-10-06T03:25:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.821+0000 7f64f8ff9700 1 -- 172.21.15.84:0/3771529161 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f650001b3b0 con 0x7f650414aaf0 2023-10-06T03:25:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.821+0000 7f64f8ff9700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f0066f30 0x7f64f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.821+0000 7f64f8ff9700 1 -- 172.21.15.84:0/3771529161 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f6500085800 con 0x7f650414aaf0 2023-10-06T03:25:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.821+0000 7f64fbfff700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f0066f30 0x7f64f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.821+0000 7f64fbfff700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f0066f30 0x7f64f00693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f650414b7c0 tx=0x7f64f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:14.825+0000 7f64f8ff9700 1 -- 172.21.15.84:0/3771529161 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6500052b80 con 0x7f650414aaf0 2023-10-06T03:25:15.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.007+0000 7f650aba5700 1 -- 172.21.15.84:0/3771529161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f65040b5fe0 con 0x7f650414aaf0 2023-10-06T03:25:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.011+0000 7f64f8ff9700 1 -- 172.21.15.84:0/3771529161 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f65000170c0 con 0x7f650414aaf0 2023-10-06T03:25:15.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 -- 172.21.15.84:0/3771529161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f0066f30 msgr2=0x7f64f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f0066f30 0x7f64f00693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f650414b7c0 tx=0x7f64f4008040 comp rx=0 tx=0).stop 2023-10-06T03:25:15.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 -- 172.21.15.84:0/3771529161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650414aaf0 msgr2=0x7f650414f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650414aaf0 0x7f650414f4b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f65000020a0 tx=0x7f6500002210 comp rx=0 tx=0).stop 2023-10-06T03:25:15.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 -- 172.21.15.84:0/3771529161 shutdown_connections 2023-10-06T03:25:15.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f0066f30 0x7f64f00693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650414aec0 0x7f6504149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650414aaf0 0x7f650414f4b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 --2- 172.21.15.84:0/3771529161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65040c63f0 0x7f6504148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 -- 172.21.15.84:0/3771529161 >> 172.21.15.84:0/3771529161 conn(0x7f6504089e90 msgr2=0x7f65040ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:15.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 -- 172.21.15.84:0/3771529161 shutdown_connections 2023-10-06T03:25:15.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.013+0000 7f650aba5700 1 -- 172.21.15.84:0/3771529161 wait complete. 2023-10-06T03:25:15.026 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:25:15.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:15.063 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:15.109 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:25:15.109 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:25:15.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:15.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.221+0000 7f72e25aa700 1 Processor -- start 2023-10-06T03:25:15.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.221+0000 7f72e25aa700 1 -- start start 2023-10-06T03:25:15.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.222+0000 7f72e25aa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc1595a0 0x7f72dc0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.222+0000 7f72e25aa700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72dc0b07a0 0x7f72dc0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.222+0000 7f72e25aa700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc0b0ca0 con 0x7f72dc0b49e0 2023-10-06T03:25:15.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.222+0000 7f72e25aa700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc0b0f80 con 0x7f72dc0b07a0 2023-10-06T03:25:15.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.222+0000 7f72e25aa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0b1260 con 0x7f72dc1595a0 2023-10-06T03:25:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72dbfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc1595a0 0x7f72dc0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72dbfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc1595a0 0x7f72dc0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:33798/0 (socket says 172.21.15.84:33798) 2023-10-06T03:25:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72dbfff700 1 -- 172.21.15.84:0/2990457757 learned_addr learned my addr 172.21.15.84:0/2990457757 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72e0b47700 1 --2- 172.21.15.84:0/2990457757 >> v2:172.21.15.131:3300/0 conn(0x7f72dc0b07a0 0x7f72dc0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72dbfff700 1 -- 172.21.15.84:0/2990457757 >> v2:172.21.15.131:3300/0 conn(0x7f72dc0b07a0 msgr2=0x7f72dc0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72dbfff700 1 --2- 172.21.15.84:0/2990457757 >> v2:172.21.15.131:3300/0 conn(0x7f72dc0b07a0 0x7f72dc0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72dbfff700 1 -- 172.21.15.84:0/2990457757 >> v1:172.21.15.131:6789/0 conn(0x7f72dc0b49e0 legacy=0x7f72dc0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72dbfff700 1 -- 172.21.15.84:0/2990457757 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc0b1540 con 0x7f72dc1595a0 2023-10-06T03:25:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72e0b47700 1 --2- 172.21.15.84:0/2990457757 >> v2:172.21.15.131:3300/0 conn(0x7f72dc0b07a0 0x7f72dc0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72dbfff700 1 --2- 172.21.15.84:0/2990457757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc1595a0 0x7f72dc0aa570 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009990 tx=0x7f72cc009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e702c1092f9726b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72daffd700 1 -- 172.21.15.84:0/2990457757 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc009e80 con 0x7f72dc1595a0 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72daffd700 1 -- 172.21.15.84:0/2990457757 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc005c10 con 0x7f72dc1595a0 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.223+0000 7f72daffd700 1 -- 172.21.15.84:0/2990457757 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc00b650 con 0x7f72dc1595a0 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.224+0000 7f72e25aa700 1 -- 172.21.15.84:0/2990457757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc1595a0 msgr2=0x7f72dc0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.224+0000 7f72e25aa700 1 --2- 172.21.15.84:0/2990457757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc1595a0 0x7f72dc0aa570 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009990 tx=0x7f72cc009220 comp rx=0 tx=0).stop 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.224+0000 7f72e25aa700 1 -- 172.21.15.84:0/2990457757 shutdown_connections 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.224+0000 7f72e25aa700 1 --2- 172.21.15.84:0/2990457757 >> v2:172.21.15.131:3300/0 conn(0x7f72dc0b07a0 0x7f72dc0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.224+0000 7f72e25aa700 1 --2- 172.21.15.84:0/2990457757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc1595a0 0x7f72dc0aa570 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.224+0000 7f72e25aa700 1 -- 172.21.15.84:0/2990457757 >> 172.21.15.84:0/2990457757 conn(0x7f72dc099830 msgr2=0x7f72dc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.224+0000 7f72e25aa700 1 -- 172.21.15.84:0/2990457757 shutdown_connections 2023-10-06T03:25:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.224+0000 7f72e25aa700 1 -- 172.21.15.84:0/2990457757 wait complete. 2023-10-06T03:25:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.225+0000 7f72e25aa700 1 Processor -- start 2023-10-06T03:25:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.225+0000 7f72e25aa700 1 -- start start 2023-10-06T03:25:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72e25aa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72dc0b07a0 0x7f72dc1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72e25aa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc0b49e0 0x7f72dc16d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72e25aa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72dc1595a0 0x7f72dc169570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72e25aa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc16d7b0 con 0x7f72dc0b07a0 2023-10-06T03:25:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72e25aa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc16da10 con 0x7f72dc1595a0 2023-10-06T03:25:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72e25aa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc16dcf0 con 0x7f72dc0b49e0 2023-10-06T03:25:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72dbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72dc0b07a0 0x7f72dc1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72dbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72dc0b07a0 0x7f72dc1581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56934/0 (socket says 172.21.15.84:56934) 2023-10-06T03:25:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72dbfff700 1 -- 172.21.15.84:0/1973886699 learned_addr learned my addr 172.21.15.84:0/1973886699 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72e0b47700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72dc1595a0 0x7f72dc169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72db7fe700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc0b49e0 0x7f72dc16d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72dbfff700 1 -- 172.21.15.84:0/1973886699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc0b49e0 msgr2=0x7f72dc16d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72dbfff700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc0b49e0 0x7f72dc16d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72dbfff700 1 -- 172.21.15.84:0/1973886699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72dc1595a0 msgr2=0x7f72dc169570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72dbfff700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72dc1595a0 0x7f72dc169570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72dbfff700 1 -- 172.21.15.84:0/1973886699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4009a20 con 0x7f72dc0b07a0 2023-10-06T03:25:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.226+0000 7f72dbfff700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72dc0b07a0 0x7f72dc1581b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00b3c0 tx=0x7f72cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.227+0000 7f72c3fff700 1 -- 172.21.15.84:0/1973886699 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc011a30 con 0x7f72dc0b07a0 2023-10-06T03:25:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.227+0000 7f72c3fff700 1 -- 172.21.15.84:0/1973886699 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc020070 con 0x7f72dc0b07a0 2023-10-06T03:25:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.227+0000 7f72c3fff700 1 -- 172.21.15.84:0/1973886699 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc011dc0 con 0x7f72dc0b07a0 2023-10-06T03:25:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.227+0000 7f72e25aa700 1 -- 172.21.15.84:0/1973886699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc009480 con 0x7f72dc0b07a0 2023-10-06T03:25:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.227+0000 7f72e25aa700 1 -- 172.21.15.84:0/1973886699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc0ad240 con 0x7f72dc0b07a0 2023-10-06T03:25:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.228+0000 7f72e25aa700 1 -- 172.21.15.84:0/1973886699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc064ad0 con 0x7f72dc0b07a0 2023-10-06T03:25:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.228+0000 7f72c3fff700 1 -- 172.21.15.84:0/1973886699 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72cc022030 con 0x7f72dc0b07a0 2023-10-06T03:25:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.228+0000 7f72c3fff700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f72c8066f30 0x7f72c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.228+0000 7f72c3fff700 1 -- 172.21.15.84:0/1973886699 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f72cc085f30 con 0x7f72dc0b07a0 2023-10-06T03:25:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.228+0000 7f72db7fe700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f72c8066f30 0x7f72c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.229+0000 7f72db7fe700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f72c8066f30 0x7f72c80693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b4df0 tx=0x7f72d0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:15.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.232+0000 7f72c3fff700 1 -- 172.21.15.84:0/1973886699 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72cc0532c0 con 0x7f72dc0b07a0 2023-10-06T03:25:15.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.457+0000 7f72e25aa700 1 -- 172.21.15.84:0/1973886699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72dc0b1820 con 0x7f72dc0b07a0 2023-10-06T03:25:15.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.457+0000 7f72c3fff700 1 -- 172.21.15.84:0/1973886699 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f72cc0568e0 con 0x7f72dc0b07a0 2023-10-06T03:25:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:15.459 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1693550238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1693550238},{"type":"v1","addr":"172.21.15.131:6834","nonce":1693550238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2817652058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2817652058},{"type":"v1","addr":"172.21.15.131:6835","nonce":2817652058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/688702713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":688702713},{"type":"v1","addr":"172.21.15.84:6836","nonce":688702713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1276845209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1276845209},{"type":"v1","addr":"172.21.15.84:6837","nonce":1276845209}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-10-06T03:25:15.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 -- 172.21.15.84:0/1973886699 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f72c8066f30 msgr2=0x7f72c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f72c8066f30 0x7f72c80693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b4df0 tx=0x7f72d0007ec0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 -- 172.21.15.84:0/1973886699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72dc0b07a0 msgr2=0x7f72dc1581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72dc0b07a0 0x7f72dc1581b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00b3c0 tx=0x7f72cc016000 comp rx=0 tx=0).stop 2023-10-06T03:25:15.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 -- 172.21.15.84:0/1973886699 shutdown_connections 2023-10-06T03:25:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f72c8066f30 0x7f72c80693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72dc1595a0 0x7f72dc169570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72dc0b07a0 0x7f72dc1581b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 --2- 172.21.15.84:0/1973886699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72dc0b49e0 0x7f72dc16d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 -- 172.21.15.84:0/1973886699 >> 172.21.15.84:0/1973886699 conn(0x7f72dc099830 msgr2=0x7f72dc0698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 -- 172.21.15.84:0/1973886699 shutdown_connections 2023-10-06T03:25:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.459+0000 7f72e25aa700 1 -- 172.21.15.84:0/1973886699 wait complete. 2023-10-06T03:25:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-10-06T03:25:15.473 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:25:15.473 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:25:15.473 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:25:15.474 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:15.474 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:25:15.474 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:25:15.474 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:25:15.479 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:15.479 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:25:15.479 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:25:15.480 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:25:15.480 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:15.480 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:25:15.480 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:25:15.480 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:25:15.480 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:15.485 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:25:15.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:25:15.486 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:25:15.486 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:25:15.491 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:25:15.491 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:25:15.492 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:25:15.492 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:25:15.528 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:25:15.529 DEBUG:teuthology.parallel:result is None 2023-10-06T03:25:15.529 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:25:15.529 DEBUG:teuthology.parallel:result is None 2023-10-06T03:25:15.533 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:25:15.533 DEBUG:teuthology.parallel:result is None 2023-10-06T03:25:15.534 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:25:15.534 DEBUG:teuthology.parallel:result is None 2023-10-06T03:25:15.534 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:25:15.601 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:25:15.601 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:25:15.614 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:25:15.615 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:25:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.653+0000 7f06747f0700 1 Processor -- start 2023-10-06T03:25:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.653+0000 7f06747f0700 1 -- start start 2023-10-06T03:25:15.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f06747f0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c0cb630 0x7f066c0691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f06747f0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f066c069720 0x7f066c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f06747f0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f066c15a050 0x7f066c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f06747f0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c154060 con 0x7f066c069720 2023-10-06T03:25:15.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f06747f0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c15a490 con 0x7f066c15a050 2023-10-06T03:25:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f06747f0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c068d50 con 0x7f066c0cb630 2023-10-06T03:25:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f0671d8b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f066c069720 0x7f066c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f0671d8b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f066c069720 0x7f066c159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56984/0 (socket says 172.21.15.84:56984) 2023-10-06T03:25:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f0671d8b700 1 -- 172.21.15.84:0/1384192617 learned_addr learned my addr 172.21.15.84:0/1384192617 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f0672d8d700 1 --2- 172.21.15.84:0/1384192617 >> v2:172.21.15.131:3300/0 conn(0x7f066c15a050 0x7f066c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.654+0000 7f067258c700 1 --2- 172.21.15.84:0/1384192617 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c0cb630 0x7f066c0691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f0671d8b700 1 -- 172.21.15.84:0/1384192617 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c0cb630 msgr2=0x7f066c0691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f0671d8b700 1 --2- 172.21.15.84:0/1384192617 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c0cb630 0x7f066c0691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f0671d8b700 1 -- 172.21.15.84:0/1384192617 >> v2:172.21.15.131:3300/0 conn(0x7f066c15a050 msgr2=0x7f066c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f0671d8b700 1 --2- 172.21.15.84:0/1384192617 >> v2:172.21.15.131:3300/0 conn(0x7f066c15a050 0x7f066c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f0671d8b700 1 -- 172.21.15.84:0/1384192617 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c15a6b0 con 0x7f066c069720 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f067258c700 1 --2- 172.21.15.84:0/1384192617 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c0cb630 0x7f066c0691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f0671d8b700 1 --2- 172.21.15.84:0/1384192617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c069720 0x7f066c159b10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f066c0c8840 tx=0x7f0668009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c81953bccdb4a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f067158a700 1 -- 172.21.15.84:0/1384192617 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668009e70 con 0x7f066c069720 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f067158a700 1 -- 172.21.15.84:0/1384192617 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066800b860 con 0x7f066c069720 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f067158a700 1 -- 172.21.15.84:0/1384192617 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800bc00 con 0x7f066c069720 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f06747f0700 1 -- 172.21.15.84:0/1384192617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c069720 msgr2=0x7f066c159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f06747f0700 1 --2- 172.21.15.84:0/1384192617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c069720 0x7f066c159b10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f066c0c8840 tx=0x7f0668009250 comp rx=0 tx=0).stop 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f06747f0700 1 -- 172.21.15.84:0/1384192617 shutdown_connections 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f06747f0700 1 --2- 172.21.15.84:0/1384192617 >> v2:172.21.15.131:3300/0 conn(0x7f066c15a050 0x7f066c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f06747f0700 1 --2- 172.21.15.84:0/1384192617 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c0cb630 0x7f066c0691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f06747f0700 1 --2- 172.21.15.84:0/1384192617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c069720 0x7f066c159b10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f06747f0700 1 -- 172.21.15.84:0/1384192617 >> 172.21.15.84:0/1384192617 conn(0x7f066c070810 msgr2=0x7f066c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.655+0000 7f06747f0700 1 -- 172.21.15.84:0/1384192617 shutdown_connections 2023-10-06T03:25:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.656+0000 7f06747f0700 1 -- 172.21.15.84:0/1384192617 wait complete. 2023-10-06T03:25:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f06747f0700 1 Processor -- start 2023-10-06T03:25:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f06747f0700 1 -- start start 2023-10-06T03:25:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f06747f0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c069720 0x7f066c16d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f06747f0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c0cb630 0x7f066c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f06747f0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f066c15a050 0x7f066c147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f06747f0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c16dea0 con 0x7f066c0cb630 2023-10-06T03:25:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f06747f0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c152b10 con 0x7f066c15a050 2023-10-06T03:25:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f06747f0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c155610 con 0x7f066c069720 2023-10-06T03:25:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f0671d8b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c0cb630 0x7f066c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f0671d8b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c0cb630 0x7f066c15c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56996/0 (socket says 172.21.15.84:56996) 2023-10-06T03:25:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.657+0000 7f0671d8b700 1 -- 172.21.15.84:0/1749424569 learned_addr learned my addr 172.21.15.84:0/1749424569 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f067258c700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c069720 0x7f066c16d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f0672d8d700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f066c15a050 0x7f066c147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f0671d8b700 1 -- 172.21.15.84:0/1749424569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c069720 msgr2=0x7f066c16d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f0671d8b700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c069720 0x7f066c16d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f0671d8b700 1 -- 172.21.15.84:0/1749424569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f066c15a050 msgr2=0x7f066c147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f0671d8b700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f066c15a050 0x7f066c147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f0671d8b700 1 -- 172.21.15.84:0/1749424569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680094f0 con 0x7f066c0cb630 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f0671d8b700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c0cb630 0x7f066c15c440 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0668009290 tx=0x7f0668017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f06627fc700 1 -- 172.21.15.84:0/1749424569 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800bbe0 con 0x7f066c0cb630 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f06627fc700 1 -- 172.21.15.84:0/1749424569 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066801a450 con 0x7f066c0cb630 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f06627fc700 1 -- 172.21.15.84:0/1749424569 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066801a810 con 0x7f066c0cb630 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f06747f0700 1 -- 172.21.15.84:0/1749424569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066c1558f0 con 0x7f066c0cb630 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.658+0000 7f06747f0700 1 -- 172.21.15.84:0/1749424569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066c155eb0 con 0x7f066c0cb630 2023-10-06T03:25:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.659+0000 7f06747f0700 1 -- 172.21.15.84:0/1749424569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066c0c69c0 con 0x7f066c0cb630 2023-10-06T03:25:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.659+0000 7f06627fc700 1 -- 172.21.15.84:0/1749424569 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f066801ab80 con 0x7f066c0cb630 2023-10-06T03:25:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.660+0000 7f06627fc700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0650066f30 0x7f06500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.660+0000 7f06627fc700 1 -- 172.21.15.84:0/1749424569 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f0668085a60 con 0x7f066c0cb630 2023-10-06T03:25:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.660+0000 7f067258c700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0650066f30 0x7f06500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.660+0000 7f067258c700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0650066f30 0x7f06500693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f065c006f00 tx=0x7f065c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.664+0000 7f06627fc700 1 -- 172.21.15.84:0/1749424569 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0668052d30 con 0x7f066c0cb630 2023-10-06T03:25:15.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:15.870+0000 7f06747f0700 1 -- 172.21.15.84:0/1749424569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f066c064ad0 con 0x7f066c0cb630 2023-10-06T03:25:16.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.699+0000 7f06627fc700 1 -- 172.21.15.84:0/1749424569 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0668015080 con 0x7f066c0cb630 2023-10-06T03:25:16.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 -- 172.21.15.84:0/1749424569 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0650066f30 msgr2=0x7f06500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0650066f30 0x7f06500693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f065c006f00 tx=0x7f065c008040 comp rx=0 tx=0).stop 2023-10-06T03:25:16.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 -- 172.21.15.84:0/1749424569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c0cb630 msgr2=0x7f066c15c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c0cb630 0x7f066c15c440 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0668009290 tx=0x7f0668017000 comp rx=0 tx=0).stop 2023-10-06T03:25:16.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 -- 172.21.15.84:0/1749424569 shutdown_connections 2023-10-06T03:25:16.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0650066f30 0x7f06500693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f066c15a050 0x7f066c147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f066c069720 0x7f066c16d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 --2- 172.21.15.84:0/1749424569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f066c0cb630 0x7f066c15c440 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 -- 172.21.15.84:0/1749424569 >> 172.21.15.84:0/1749424569 conn(0x7f066c070810 msgr2=0x7f066c153740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:16.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 -- 172.21.15.84:0/1749424569 shutdown_connections 2023-10-06T03:25:16.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.702+0000 7f06747f0700 1 -- 172.21.15.84:0/1749424569 wait complete. 2023-10-06T03:25:16.705 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T03:25:16.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:25:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.828+0000 7f8e6e988700 1 Processor -- start 2023-10-06T03:25:16.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.828+0000 7f8e6e988700 1 -- start start 2023-10-06T03:25:16.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e6e988700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e681595a0 0x7f8e680aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e6e988700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8e680b07a0 0x7f8e680b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e6e988700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e680b0ca0 con 0x7f8e680b49e0 2023-10-06T03:25:16.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e6e988700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e680b0f80 con 0x7f8e680b07a0 2023-10-06T03:25:16.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e6e988700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e680b1260 con 0x7f8e681595a0 2023-10-06T03:25:16.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e677fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8e680b49e0 0x7f8e680aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45468/0 (socket says 172.21.15.84:45468) 2023-10-06T03:25:16.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e677fe700 1 -- 172.21.15.84:0/3635770394 learned_addr learned my addr 172.21.15.84:0/3635770394 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501439789 0 0) 0x7f8e680b0ca0 con 0x7f8e680b49e0 2023-10-06T03:25:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e50003570 con 0x7f8e680b49e0 2023-10-06T03:25:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e6cf25700 1 --2- 172.21.15.84:0/3635770394 >> v2:172.21.15.131:3300/0 conn(0x7f8e680b07a0 0x7f8e680b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e67fff700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e681595a0 0x7f8e680aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 374253025 0 0) 0x7f8e50003570 con 0x7f8e680b49e0 2023-10-06T03:25:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e681595a0 msgr2=0x7f8e680aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e681595a0 0x7f8e680aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 >> v2:172.21.15.131:3300/0 conn(0x7f8e680b07a0 msgr2=0x7f8e680b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 --2- 172.21.15.84:0/3635770394 >> v2:172.21.15.131:3300/0 conn(0x7f8e680b07a0 0x7f8e680b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e680b1540 con 0x7f8e680b49e0 2023-10-06T03:25:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f8e5c001470 con 0x7f8e680b49e0 2023-10-06T03:25:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 >> v1:172.21.15.84:6789/0 conn(0x7f8e680b49e0 legacy=0x7f8e680aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e50003a60 0x7f8e50003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e681595a0 0x7f8e50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e50004d50 0x7f8e500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e680b0f80 con 0x7f8e50004d50 2023-10-06T03:25:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e680b1260 con 0x7f8e50003a60 2023-10-06T03:25:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.829+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5000ba60 con 0x7f8e681595a0 2023-10-06T03:25:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e6cf25700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e50004d50 0x7f8e500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e677fe700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e681595a0 0x7f8e50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e67fff700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e50003a60 0x7f8e50003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e6cf25700 1 -- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e681595a0 msgr2=0x7f8e50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e6cf25700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e681595a0 0x7f8e50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e6cf25700 1 -- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e50003a60 msgr2=0x7f8e50003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e6cf25700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e50003a60 0x7f8e50003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e6cf25700 1 -- 172.21.15.84:0/3635770394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e50003570 con 0x7f8e50004d50 2023-10-06T03:25:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e677fe700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e681595a0 0x7f8e50004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e6cf25700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e50004d50 0x7f8e500051c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000e210 tx=0x7f8e6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a75b5ae620512b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000ea60 con 0x7f8e50004d50 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6000f040 con 0x7f8e50004d50 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.830+0000 7f8e66ffd700 1 -- 172.21.15.84:0/3635770394 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000ee10 con 0x7f8e50004d50 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.831+0000 7f8e6e988700 1 -- 172.21.15.84:0/3635770394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e50004d50 msgr2=0x7f8e500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.831+0000 7f8e6e988700 1 --2- 172.21.15.84:0/3635770394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e50004d50 0x7f8e500051c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000e210 tx=0x7f8e6000b040 comp rx=0 tx=0).stop 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.831+0000 7f8e6cf25700 1 -- 172.21.15.84:0/3635770394 reap_dead start 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.831+0000 7f8e6e988700 1 -- 172.21.15.84:0/3635770394 shutdown_connections 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.831+0000 7f8e6e988700 1 -- 172.21.15.84:0/3635770394 >> 172.21.15.84:0/3635770394 conn(0x7f8e68099830 msgr2=0x7f8e6806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.831+0000 7f8e6e988700 1 -- 172.21.15.84:0/3635770394 shutdown_connections 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.831+0000 7f8e6e988700 1 -- 172.21.15.84:0/3635770394 wait complete. 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.832+0000 7f8e6e988700 1 Processor -- start 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.832+0000 7f8e6e988700 1 -- start start 2023-10-06T03:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.832+0000 7f8e6e988700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e6809a710 0x7f8e68156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.832+0000 7f8e6e988700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e6809aae0 0x7f8e68156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6e988700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e6816a880 0x7f8e6816d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6e988700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68169b90 con 0x7f8e6816a880 2023-10-06T03:25:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6e988700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6816e130 con 0x7f8e6809a710 2023-10-06T03:25:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6e988700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6816a3f0 con 0x7f8e6809aae0 2023-10-06T03:25:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6cf25700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e6816a880 0x7f8e6816d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6cf25700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e6816a880 0x7f8e6816d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57018/0 (socket says 172.21.15.84:57018) 2023-10-06T03:25:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6cf25700 1 -- 172.21.15.84:0/3690916522 learned_addr learned my addr 172.21.15.84:0/3690916522 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e677fe700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e6809aae0 0x7f8e68156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e67fff700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e6809a710 0x7f8e68156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6cf25700 1 -- 172.21.15.84:0/3690916522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e6809aae0 msgr2=0x7f8e68156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6cf25700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e6809aae0 0x7f8e68156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6cf25700 1 -- 172.21.15.84:0/3690916522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e6809a710 msgr2=0x7f8e68156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6cf25700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e6809a710 0x7f8e68156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6cf25700 1 -- 172.21.15.84:0/3690916522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6816de50 con 0x7f8e6816a880 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6cf25700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e6816a880 0x7f8e6816d190 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000afd0 tx=0x7f8e6001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e4ffff700 1 -- 172.21.15.84:0/3690916522 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000ee60 con 0x7f8e6816a880 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e4ffff700 1 -- 172.21.15.84:0/3690916522 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e60022070 con 0x7f8e6816a880 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6e988700 1 -- 172.21.15.84:0/3690916522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e68169da0 con 0x7f8e6816a880 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e4ffff700 1 -- 172.21.15.84:0/3690916522 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6001e890 con 0x7f8e6816a880 2023-10-06T03:25:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.833+0000 7f8e6e988700 1 -- 172.21.15.84:0/3690916522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6816d6d0 con 0x7f8e6816a880 2023-10-06T03:25:16.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.834+0000 7f8e6e988700 1 -- 172.21.15.84:0/3690916522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e68064ad0 con 0x7f8e6816a880 2023-10-06T03:25:16.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.835+0000 7f8e4ffff700 1 -- 172.21.15.84:0/3690916522 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e60003040 con 0x7f8e6816a880 2023-10-06T03:25:16.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.835+0000 7f8e4ffff700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8e54066f30 0x7f8e540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.835+0000 7f8e4ffff700 1 -- 172.21.15.84:0/3690916522 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8e60024070 con 0x7f8e6816a880 2023-10-06T03:25:16.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.835+0000 7f8e67fff700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8e54066f30 0x7f8e540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.835+0000 7f8e67fff700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8e54066f30 0x7f8e540693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8e58006ea0 tx=0x7f8e58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:16.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:16.839+0000 7f8e4ffff700 1 -- 172.21.15.84:0/3690916522 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e60053a80 con 0x7f8e6816a880 2023-10-06T03:25:17.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.093+0000 7f8e6e988700 1 -- 172.21.15.84:0/3690916522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8e6816a530 con 0x7f8e6816a880 2023-10-06T03:25:17.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.093+0000 7f8e4ffff700 1 -- 172.21.15.84:0/3690916522 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8e600570a0 con 0x7f8e6816a880 2023-10-06T03:25:17.095 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:17.095 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:25:17.095 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T03:25:17.095 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.095 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T03:25:17.095 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lA8KvDxAA2irSaBc/QiMm9oI5GEK1PA==", 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lq2TnGhAAOzV6kE1Ji9yvQGuouda9GQ==", 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.096 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9l4w54FhAASOElKyXlWzXB7pDJV5TzVQ==", 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:17.097 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lh/61IRAANVLLVFSkTIhlvAyQkmkbqQ==", 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:25:17.098 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCVfR9lPd++MRAAikRAaM5HcwQgYYfszDoMzQ==", 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCYfR9l3ovfLxAAkuD96aBKGZX1SQvItQjbmA==", 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T03:25:17.100 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCbfR9lsbQpMBAApjEhKZ3RZXIXNFPmGrp3Rg==", 2023-10-06T03:25:17.101 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.101 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:17.101 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:17.101 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.101 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.101 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T03:25:17.101 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCefR9lOhnPMRAAinzeYJrHzI3Laz+kRo7U9w==", 2023-10-06T03:25:17.101 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCkfR9liYL2MhAAVzzPBy1+K4n9a324eCqKSg==", 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:17.102 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCnfR9lEe8GMBAAgXFWAPLix5BkHtrqQazDqA==", 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCqfR9lcprFMBAA4/ksqag9gsivr9htt3UDBg==", 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T03:25:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCtfR9leIi9MBAAaco3XMawt8uFNMNRbPQAQQ==", 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lGQaGJRAALZ28ylNKJSf4AhF9KcsrBg==", 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:17.105 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ls6nPLRAA/94kuDcXCPlYoYcCuqwN2A==", 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:25:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lY17ZKhAAyLFVSlBM5vWr4LSl+wwWZw==", 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lPWYyMxAAmgd5iQq7RQp80iK1oBfUww==", 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.108 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRfR9loncpLhAA2cZSGjrup5zj13Xtt9k6Xw==", 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ltUixDBAAQN/x3iVJcTKF7hTMehPYgQ==", 2023-10-06T03:25:17.109 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lFqqSBhAA1km5fSJT2+QAdMBBxBWrXQ==", 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:25:17.110 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:17.111 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.111 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:17.111 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T03:25:17.111 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:25:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 -- 172.21.15.84:0/3690916522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8e54066f30 msgr2=0x7f8e540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8e54066f30 0x7f8e540693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8e58006ea0 tx=0x7f8e58008040 comp rx=0 tx=0).stop 2023-10-06T03:25:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 -- 172.21.15.84:0/3690916522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e6816a880 msgr2=0x7f8e6816d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e6816a880 0x7f8e6816d190 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000afd0 tx=0x7f8e6001a000 comp rx=0 tx=0).stop 2023-10-06T03:25:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 -- 172.21.15.84:0/3690916522 shutdown_connections 2023-10-06T03:25:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8e54066f30 0x7f8e540693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e6809a710 0x7f8e68156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e6816a880 0x7f8e6816d190 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 --2- 172.21.15.84:0/3690916522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e6809aae0 0x7f8e68156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 -- 172.21.15.84:0/3690916522 >> 172.21.15.84:0/3690916522 conn(0x7f8e68099830 msgr2=0x7f8e680ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:17.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 -- 172.21.15.84:0/3690916522 shutdown_connections 2023-10-06T03:25:17.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.095+0000 7f8e6e988700 1 -- 172.21.15.84:0/3690916522 wait complete. 2023-10-06T03:25:17.114 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.226+0000 7fe82ecf5700 1 Processor -- start 2023-10-06T03:25:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.226+0000 7fe82ecf5700 1 -- start start 2023-10-06T03:25:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe82ecf5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8280b49e0 0x7fe8280aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe82ecf5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8280b07a0 0x7fe8280b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe82ecf5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8280b0ca0 con 0x7fe8281595a0 2023-10-06T03:25:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe82ecf5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8280b0f80 con 0x7fe8280b49e0 2023-10-06T03:25:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe82ecf5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280b1260 con 0x7fe8280b07a0 2023-10-06T03:25:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe81ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8280b49e0 0x7fe8280aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe82ca91700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe8281595a0 0x7fe8280aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45474/0 (socket says 172.21.15.84:45474) 2023-10-06T03:25:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe82ca91700 1 -- 172.21.15.84:0/3946449723 learned_addr learned my addr 172.21.15.84:0/3946449723 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe82d292700 1 --2- 172.21.15.84:0/3946449723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8280b07a0 0x7fe8280b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe81ffff700 1 -- 172.21.15.84:0/3946449723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8280b07a0 msgr2=0x7fe8280b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe81ffff700 1 --2- 172.21.15.84:0/3946449723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8280b07a0 0x7fe8280b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe81ffff700 1 -- 172.21.15.84:0/3946449723 >> v1:172.21.15.84:6789/0 conn(0x7fe8281595a0 legacy=0x7fe8280aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe81f7fe700 1 -- 172.21.15.84:0/3946449723 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345576580 0 0) 0x7fe8280b0ca0 con 0x7fe8281595a0 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.227+0000 7fe81ffff700 1 -- 172.21.15.84:0/3946449723 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8280b1540 con 0x7fe8280b49e0 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe81ffff700 1 --2- 172.21.15.84:0/3946449723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 0x7fe8280aac80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe818009910 tx=0x7fe8180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7376a9091902c84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe81f7fe700 1 -- 172.21.15.84:0/3946449723 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81800b640 con 0x7fe8280b49e0 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe81f7fe700 1 -- 172.21.15.84:0/3946449723 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81800b7a0 con 0x7fe8280b49e0 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe81f7fe700 1 -- 172.21.15.84:0/3946449723 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81800bb60 con 0x7fe8280b49e0 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe82ecf5700 1 -- 172.21.15.84:0/3946449723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 msgr2=0x7fe8280aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe82ecf5700 1 --2- 172.21.15.84:0/3946449723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 0x7fe8280aac80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe818009910 tx=0x7fe8180091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe82ecf5700 1 -- 172.21.15.84:0/3946449723 shutdown_connections 2023-10-06T03:25:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe82ecf5700 1 --2- 172.21.15.84:0/3946449723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8280b07a0 0x7fe8280b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe82ecf5700 1 --2- 172.21.15.84:0/3946449723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 0x7fe8280aac80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe82ecf5700 1 -- 172.21.15.84:0/3946449723 >> 172.21.15.84:0/3946449723 conn(0x7fe828099830 msgr2=0x7fe82806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe82ecf5700 1 -- 172.21.15.84:0/3946449723 shutdown_connections 2023-10-06T03:25:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.228+0000 7fe82ecf5700 1 -- 172.21.15.84:0/3946449723 wait complete. 2023-10-06T03:25:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.229+0000 7fe82ecf5700 1 Processor -- start 2023-10-06T03:25:17.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe82ecf5700 1 -- start start 2023-10-06T03:25:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe82ecf5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8280b07a0 0x7fe82815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe82ecf5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 0x7fe8280ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe82ecf5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8281595a0 0x7fe82814a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe82ecf5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe828156cb0 con 0x7fe8280b49e0 2023-10-06T03:25:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe82ecf5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82815d0a0 con 0x7fe8281595a0 2023-10-06T03:25:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe82ecf5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82815c490 con 0x7fe8280b07a0 2023-10-06T03:25:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 0x7fe8280ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 0x7fe8280ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57024/0 (socket says 172.21.15.84:57024) 2023-10-06T03:25:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe81ffff700 1 -- 172.21.15.84:0/348442300 learned_addr learned my addr 172.21.15.84:0/348442300 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe82d292700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8281595a0 0x7fe82814a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.230+0000 7fe82ca91700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8280b07a0 0x7fe82815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe81ffff700 1 -- 172.21.15.84:0/348442300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8280b07a0 msgr2=0x7fe82815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe81ffff700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8280b07a0 0x7fe82815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe81ffff700 1 -- 172.21.15.84:0/348442300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8281595a0 msgr2=0x7fe82814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe81ffff700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8281595a0 0x7fe82814a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe81ffff700 1 -- 172.21.15.84:0/348442300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818009420 con 0x7fe8280b49e0 2023-10-06T03:25:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe81ffff700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 0x7fe8280ae6f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe828067c60 tx=0x7fe818017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe81cff9700 1 -- 172.21.15.84:0/348442300 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81801f070 con 0x7fe8280b49e0 2023-10-06T03:25:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe81cff9700 1 -- 172.21.15.84:0/348442300 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe818000c90 con 0x7fe8280b49e0 2023-10-06T03:25:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe82ecf5700 1 -- 172.21.15.84:0/348442300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82815c770 con 0x7fe8280b49e0 2023-10-06T03:25:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe81cff9700 1 -- 172.21.15.84:0/348442300 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81800bb60 con 0x7fe8280b49e0 2023-10-06T03:25:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.231+0000 7fe82ecf5700 1 -- 172.21.15.84:0/348442300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82815cd30 con 0x7fe8280b49e0 2023-10-06T03:25:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.232+0000 7fe82ecf5700 1 -- 172.21.15.84:0/348442300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe828159970 con 0x7fe8280b49e0 2023-10-06T03:25:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.232+0000 7fe81cff9700 1 -- 172.21.15.84:0/348442300 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe818023070 con 0x7fe8280b49e0 2023-10-06T03:25:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.233+0000 7fe81cff9700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe814066f30 0x7fe8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.233+0000 7fe82ca91700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe814066f30 0x7fe8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.233+0000 7fe81cff9700 1 -- 172.21.15.84:0/348442300 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fe8180858e0 con 0x7fe8280b49e0 2023-10-06T03:25:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.233+0000 7fe82ca91700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe814066f30 0x7fe8140693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe824002800 tx=0x7fe824009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.237+0000 7fe81cff9700 1 -- 172.21.15.84:0/348442300 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe828159970 con 0x7fe8280b49e0 2023-10-06T03:25:17.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.420+0000 7fe82ecf5700 1 -- 172.21.15.84:0/348442300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe828159970 con 0x7fe8280b49e0 2023-10-06T03:25:17.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.421+0000 7fe81cff9700 1 -- 172.21.15.84:0/348442300 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+13855 (secure 0 0 0) 0x7fe828159970 con 0x7fe8280b49e0 2023-10-06T03:25:17.423 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:17.423 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:16.698405+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 -- 172.21.15.84:0/348442300 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe814066f30 msgr2=0x7fe8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe814066f30 0x7fe8140693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe824002800 tx=0x7fe824009040 comp rx=0 tx=0).stop 2023-10-06T03:25:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 -- 172.21.15.84:0/348442300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 msgr2=0x7fe8280ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 0x7fe8280ae6f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe828067c60 tx=0x7fe818017000 comp rx=0 tx=0).stop 2023-10-06T03:25:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 -- 172.21.15.84:0/348442300 shutdown_connections 2023-10-06T03:25:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe814066f30 0x7fe8140693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8281595a0 0x7fe82814a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8280b07a0 0x7fe82815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 --2- 172.21.15.84:0/348442300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8280b49e0 0x7fe8280ae6f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 -- 172.21.15.84:0/348442300 >> 172.21.15.84:0/348442300 conn(0x7fe828099830 msgr2=0x7fe8281589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:17.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 -- 172.21.15.84:0/348442300 shutdown_connections 2023-10-06T03:25:17.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.423+0000 7fe82ecf5700 1 -- 172.21.15.84:0/348442300 wait complete. 2023-10-06T03:25:17.437 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:25:17.437 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:25:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.552+0000 7fc6c6d1f700 1 Processor -- start 2023-10-06T03:25:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.552+0000 7fc6c6d1f700 1 -- start start 2023-10-06T03:25:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.553+0000 7fc6c6d1f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c01598e0 0x7fc6c00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.553+0000 7fc6c6d1f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc6c00cbcb0 0x7fc6c00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.553+0000 7fc6c6d1f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c00cf610 con 0x7fc6c0159510 2023-10-06T03:25:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.553+0000 7fc6c6d1f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c00cf8f0 con 0x7fc6c00cbcb0 2023-10-06T03:25:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.553+0000 7fc6c6d1f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00cfbd0 con 0x7fc6c01598e0 2023-10-06T03:25:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6b7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c01598e0 0x7fc6c00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6c52bc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc6c00cbcb0 0x7fc6c00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6c52bc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc6c00cbcb0 0x7fc6c00ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:45432/0 (socket says 172.21.15.84:45432) 2023-10-06T03:25:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6b7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c01598e0 0x7fc6c00ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:33912/0 (socket says 172.21.15.84:33912) 2023-10-06T03:25:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6c52bc700 1 -- 172.21.15.84:0/1840095632 learned_addr learned my addr 172.21.15.84:0/1840095632 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6c52bc700 1 -- 172.21.15.84:0/1840095632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c01598e0 msgr2=0x7fc6c00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6c52bc700 1 --2- 172.21.15.84:0/1840095632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c01598e0 0x7fc6c00ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6c52bc700 1 -- 172.21.15.84:0/1840095632 >> v1:172.21.15.131:6789/0 conn(0x7fc6c0159510 legacy=0x7fc6c00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6c52bc700 1 -- 172.21.15.84:0/1840095632 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00cfeb0 con 0x7fc6c00cbcb0 2023-10-06T03:25:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6b77fe700 1 -- 172.21.15.84:0/1840095632 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213910142 0 0) 0x7fc6c00cf610 con 0x7fc6c0159510 2023-10-06T03:25:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6c52bc700 1 --2- 172.21.15.84:0/1840095632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c00cbcb0 0x7fc6c00ced60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80099b0 tx=0x7fc6b8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eae4e52d87744abb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6b77fe700 1 -- 172.21.15.84:0/1840095632 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8009ea0 con 0x7fc6c00cbcb0 2023-10-06T03:25:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6b77fe700 1 -- 172.21.15.84:0/1840095632 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800b860 con 0x7fc6c00cbcb0 2023-10-06T03:25:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.554+0000 7fc6b77fe700 1 -- 172.21.15.84:0/1840095632 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800bc00 con 0x7fc6c00cbcb0 2023-10-06T03:25:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.555+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/1840095632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c00cbcb0 msgr2=0x7fc6c00ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.555+0000 7fc6c6d1f700 1 --2- 172.21.15.84:0/1840095632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c00cbcb0 0x7fc6c00ced60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80099b0 tx=0x7fc6b8009250 comp rx=0 tx=0).stop 2023-10-06T03:25:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.555+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/1840095632 shutdown_connections 2023-10-06T03:25:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.555+0000 7fc6c6d1f700 1 --2- 172.21.15.84:0/1840095632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c00cbcb0 0x7fc6c00ced60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.555+0000 7fc6c6d1f700 1 --2- 172.21.15.84:0/1840095632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c01598e0 0x7fc6c00ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.555+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/1840095632 >> 172.21.15.84:0/1840095632 conn(0x7fc6c0089e90 msgr2=0x7fc6c00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.555+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/1840095632 shutdown_connections 2023-10-06T03:25:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.555+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/1840095632 wait complete. 2023-10-06T03:25:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.556+0000 7fc6c6d1f700 1 Processor -- start 2023-10-06T03:25:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.556+0000 7fc6c6d1f700 1 -- start start 2023-10-06T03:25:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6c6d1f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00cbcb0 0x7fc6c0149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6c6d1f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6c0159510 0x7fc6c00c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6c6d1f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c01598e0 0x7fc6c00b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6c6d1f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00c9bf0 con 0x7fc6c0159510 2023-10-06T03:25:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6c6d1f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00b3680 con 0x7fc6c01598e0 2023-10-06T03:25:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6c6d1f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c014a0e0 con 0x7fc6c00cbcb0 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6c0159510 0x7fc6c00c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6c52bc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c01598e0 0x7fc6c00b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6c0159510 0x7fc6c00c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57040/0 (socket says 172.21.15.84:57040) 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6b7fff700 1 -- 172.21.15.84:0/758923643 learned_addr learned my addr 172.21.15.84:0/758923643 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.557+0000 7fc6c4abb700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00cbcb0 0x7fc6c0149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6c52bc700 1 -- 172.21.15.84:0/758923643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00cbcb0 msgr2=0x7fc6c0149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6c52bc700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00cbcb0 0x7fc6c0149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6c52bc700 1 -- 172.21.15.84:0/758923643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6c0159510 msgr2=0x7fc6c00c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6c52bc700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6c0159510 0x7fc6c00c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6c52bc700 1 -- 172.21.15.84:0/758923643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b80094f0 con 0x7fc6c01598e0 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6b7fff700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6c0159510 0x7fc6c00c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6c52bc700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c01598e0 0x7fc6c00b53e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0088fb0 tx=0x7fc6b8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6b4ff9700 1 -- 172.21.15.84:0/758923643 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8011420 con 0x7fc6c01598e0 2023-10-06T03:25:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6b4ff9700 1 -- 172.21.15.84:0/758923643 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b80115a0 con 0x7fc6c01598e0 2023-10-06T03:25:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/758923643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c00ca690 con 0x7fc6c01598e0 2023-10-06T03:25:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6b4ff9700 1 -- 172.21.15.84:0/758923643 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8011960 con 0x7fc6c01598e0 2023-10-06T03:25:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.558+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/758923643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c00ca0d0 con 0x7fc6c01598e0 2023-10-06T03:25:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.559+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/758923643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c015c6d0 con 0x7fc6c01598e0 2023-10-06T03:25:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.560+0000 7fc6b4ff9700 1 -- 172.21.15.84:0/758923643 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6b8011d50 con 0x7fc6c01598e0 2023-10-06T03:25:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.560+0000 7fc6b4ff9700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6ac066f30 0x7fc6ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.560+0000 7fc6b4ff9700 1 -- 172.21.15.84:0/758923643 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc6b8086100 con 0x7fc6c01598e0 2023-10-06T03:25:17.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.560+0000 7fc6c4abb700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6ac066f30 0x7fc6ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.560+0000 7fc6c4abb700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6ac066f30 0x7fc6ac0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc001560 tx=0x7fc6bc0016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.564+0000 7fc6b4ff9700 1 -- 172.21.15.84:0/758923643 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6b8053560 con 0x7fc6c01598e0 2023-10-06T03:25:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.747+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/758923643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6c0064ad0 con 0x7fc6c01598e0 2023-10-06T03:25:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.748+0000 7fc6b4ff9700 1 -- 172.21.15.84:0/758923643 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6b80150a0 con 0x7fc6c01598e0 2023-10-06T03:25:17.750 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:25:17.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/758923643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6ac066f30 msgr2=0x7fc6ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6ac066f30 0x7fc6ac0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc001560 tx=0x7fc6bc0016f0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/758923643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c01598e0 msgr2=0x7fc6c00b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c01598e0 0x7fc6c00b53e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0088fb0 tx=0x7fc6b8017000 comp rx=0 tx=0).stop 2023-10-06T03:25:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/758923643 shutdown_connections 2023-10-06T03:25:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc6ac066f30 0x7fc6ac0693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c01598e0 0x7fc6c00b53e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00cbcb0 0x7fc6c0149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 --2- 172.21.15.84:0/758923643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6c0159510 0x7fc6c00c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/758923643 >> 172.21.15.84:0/758923643 conn(0x7fc6c0089e90 msgr2=0x7fc6c014b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/758923643 shutdown_connections 2023-10-06T03:25:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.750+0000 7fc6c6d1f700 1 -- 172.21.15.84:0/758923643 wait complete. 2023-10-06T03:25:17.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:25:17.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.879+0000 7fd41646e700 1 Processor -- start 2023-10-06T03:25:17.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.879+0000 7fd41646e700 1 -- start start 2023-10-06T03:25:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.879+0000 7fd41646e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd410140d00 0x7fd4100c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.879+0000 7fd41646e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd4100c6c60 0x7fd41006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.879+0000 7fd41646e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4101410d0 con 0x7fd41006d920 2023-10-06T03:25:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.879+0000 7fd41646e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4100c7ea0 con 0x7fd4100c6c60 2023-10-06T03:25:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd41646e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41006f720 con 0x7fd410140d00 2023-10-06T03:25:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd4100c6c60 0x7fd41006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd414a0b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd41006d920 0x7fd41015af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45480/0 (socket says 172.21.15.84:45480) 2023-10-06T03:25:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd414a0b700 1 -- 172.21.15.84:0/490429929 learned_addr learned my addr 172.21.15.84:0/490429929 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40f7fe700 1 -- 172.21.15.84:0/490429929 >> v2:172.21.15.131:3300/0 conn(0x7fd410140d00 msgr2=0x7fd4100c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40ffff700 1 --2- 172.21.15.84:0/490429929 >> v2:172.21.15.131:3300/0 conn(0x7fd410140d00 0x7fd4100c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40f7fe700 1 --2- 172.21.15.84:0/490429929 >> v2:172.21.15.131:3300/0 conn(0x7fd410140d00 0x7fd4100c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40f7fe700 1 -- 172.21.15.84:0/490429929 >> v1:172.21.15.84:6789/0 conn(0x7fd41006d920 legacy=0x7fd41015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40effd700 1 -- 172.21.15.84:0/490429929 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946432389 0 0) 0x7fd4101410d0 con 0x7fd41006d920 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40f7fe700 1 -- 172.21.15.84:0/490429929 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41006dd20 con 0x7fd4100c6c60 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40f7fe700 1 --2- 172.21.15.84:0/490429929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 0x7fd41006d3e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd41006ce90 tx=0x7fd4000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c29ce4348e17d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40effd700 1 -- 172.21.15.84:0/490429929 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000b6b0 con 0x7fd4100c6c60 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40effd700 1 -- 172.21.15.84:0/490429929 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40000b810 con 0x7fd4100c6c60 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.880+0000 7fd40effd700 1 -- 172.21.15.84:0/490429929 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000bbb0 con 0x7fd4100c6c60 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.881+0000 7fd41646e700 1 -- 172.21.15.84:0/490429929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 msgr2=0x7fd41006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.881+0000 7fd41646e700 1 --2- 172.21.15.84:0/490429929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 0x7fd41006d3e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd41006ce90 tx=0x7fd4000091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.881+0000 7fd41646e700 1 -- 172.21.15.84:0/490429929 shutdown_connections 2023-10-06T03:25:17.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.881+0000 7fd41646e700 1 --2- 172.21.15.84:0/490429929 >> v2:172.21.15.131:3300/0 conn(0x7fd410140d00 0x7fd4100c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.881+0000 7fd41646e700 1 --2- 172.21.15.84:0/490429929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 0x7fd41006d3e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.881+0000 7fd41646e700 1 -- 172.21.15.84:0/490429929 >> 172.21.15.84:0/490429929 conn(0x7fd4100cc0e0 msgr2=0x7fd4100cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:17.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.881+0000 7fd41646e700 1 -- 172.21.15.84:0/490429929 shutdown_connections 2023-10-06T03:25:17.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.881+0000 7fd41646e700 1 -- 172.21.15.84:0/490429929 wait complete. 2023-10-06T03:25:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.882+0000 7fd41646e700 1 Processor -- start 2023-10-06T03:25:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.882+0000 7fd41646e700 1 -- start start 2023-10-06T03:25:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd41646e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd41006d920 0x7fd4100b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd41646e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 0x7fd4101570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd41646e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd410140d00 0x7fd4100af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd41646e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100aee80 con 0x7fd4100c6c60 2023-10-06T03:25:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd41646e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100b0d90 con 0x7fd410140d00 2023-10-06T03:25:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd41646e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100b1030 con 0x7fd41006d920 2023-10-06T03:25:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd40f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 0x7fd4101570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd40f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 0x7fd4101570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57062/0 (socket says 172.21.15.84:57062) 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd40f7fe700 1 -- 172.21.15.84:0/2109903421 learned_addr learned my addr 172.21.15.84:0/2109903421 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd40f7fe700 1 -- 172.21.15.84:0/2109903421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd41006d920 msgr2=0x7fd4100b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd40f7fe700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd41006d920 0x7fd4100b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd40f7fe700 1 -- 172.21.15.84:0/2109903421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd410140d00 msgr2=0x7fd4100af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd40f7fe700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd410140d00 0x7fd4100af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd40f7fe700 1 -- 172.21.15.84:0/2109903421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009420 con 0x7fd4100c6c60 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd40f7fe700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 0x7fd4101570f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd4100cbf60 tx=0x7fd400017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd3f7fff700 1 -- 172.21.15.84:0/2109903421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400011420 con 0x7fd4100c6c60 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd3f7fff700 1 -- 172.21.15.84:0/2109903421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd400011580 con 0x7fd4100c6c60 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.883+0000 7fd41646e700 1 -- 172.21.15.84:0/2109903421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4100b1310 con 0x7fd4100c6c60 2023-10-06T03:25:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.884+0000 7fd3f7fff700 1 -- 172.21.15.84:0/2109903421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400011940 con 0x7fd4100c6c60 2023-10-06T03:25:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.884+0000 7fd41646e700 1 -- 172.21.15.84:0/2109903421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4100af3b0 con 0x7fd4100c6c60 2023-10-06T03:25:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.884+0000 7fd41646e700 1 -- 172.21.15.84:0/2109903421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4100c6700 con 0x7fd4100c6c60 2023-10-06T03:25:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.885+0000 7fd3f7fff700 1 -- 172.21.15.84:0/2109903421 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd400011d30 con 0x7fd4100c6c60 2023-10-06T03:25:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.885+0000 7fd3f7fff700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd3fc066f30 0x7fd3fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.885+0000 7fd3f7fff700 1 -- 172.21.15.84:0/2109903421 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd400085bd0 con 0x7fd4100c6c60 2023-10-06T03:25:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.885+0000 7fd40ffff700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd3fc066f30 0x7fd3fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.886+0000 7fd40ffff700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd3fc066f30 0x7fd3fc0693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd404007970 tx=0x7fd404008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:17.889+0000 7fd3f7fff700 1 -- 172.21.15.84:0/2109903421 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd400052ef0 con 0x7fd4100c6c60 2023-10-06T03:25:18.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.073+0000 7fd41646e700 1 -- 172.21.15.84:0/2109903421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4100af5d0 con 0x7fd4100c6c60 2023-10-06T03:25:18.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.074+0000 7fd3f7fff700 1 -- 172.21.15.84:0/2109903421 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd400056510 con 0x7fd4100c6c60 2023-10-06T03:25:18.076 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:25:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 -- 172.21.15.84:0/2109903421 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd3fc066f30 msgr2=0x7fd3fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd3fc066f30 0x7fd3fc0693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd404007970 tx=0x7fd404008040 comp rx=0 tx=0).stop 2023-10-06T03:25:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 -- 172.21.15.84:0/2109903421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 msgr2=0x7fd4101570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 0x7fd4101570f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd4100cbf60 tx=0x7fd400017000 comp rx=0 tx=0).stop 2023-10-06T03:25:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 -- 172.21.15.84:0/2109903421 shutdown_connections 2023-10-06T03:25:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd3fc066f30 0x7fd3fc0693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd410140d00 0x7fd4100af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd41006d920 0x7fd4100b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 --2- 172.21.15.84:0/2109903421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4100c6c60 0x7fd4101570f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 -- 172.21.15.84:0/2109903421 >> 172.21.15.84:0/2109903421 conn(0x7fd4100cc0e0 msgr2=0x7fd4100cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 -- 172.21.15.84:0/2109903421 shutdown_connections 2023-10-06T03:25:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.076+0000 7fd41646e700 1 -- 172.21.15.84:0/2109903421 wait complete. 2023-10-06T03:25:18.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:25:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.202+0000 7f19fece4700 1 Processor -- start 2023-10-06T03:25:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.202+0000 7f19fece4700 1 -- start start 2023-10-06T03:25:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fece4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f80cbc70 0x7f19f80cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fece4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f19f80b2140 0x7f19f80b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fece4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f80cb7e0 con 0x7f19f8159480 2023-10-06T03:25:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fece4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f80b08a0 con 0x7f19f80b2140 2023-10-06T03:25:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fece4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f80cb190 con 0x7f19f80cbc70 2023-10-06T03:25:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fdce2700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f19f8159480 0x7f19f80b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45486/0 (socket says 172.21.15.84:45486) 2023-10-06T03:25:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fdce2700 1 -- 172.21.15.84:0/2267863875 learned_addr learned my addr 172.21.15.84:0/2267863875 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fe4e3700 1 --2- 172.21.15.84:0/2267863875 >> v2:172.21.15.131:3300/0 conn(0x7f19f80b2140 0x7f19f80b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228534555 0 0) 0x7f19f80cb7e0 con 0x7f19f8159480 2023-10-06T03:25:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fd4e1700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f80cbc70 0x7f19f80cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.203+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19e4003570 con 0x7f19f8159480 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1786033496 0 0) 0x7f19e4003570 con 0x7f19f8159480 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f80cbc70 msgr2=0x7f19f80cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f80cbc70 0x7f19f80cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 >> v2:172.21.15.131:3300/0 conn(0x7f19f80b2140 msgr2=0x7f19f80b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 --2- 172.21.15.84:0/2267863875 >> v2:172.21.15.131:3300/0 conn(0x7f19f80b2140 0x7f19f80b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80cb470 con 0x7f19f8159480 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f19f40017f0 con 0x7f19f8159480 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 >> v1:172.21.15.84:6789/0 conn(0x7f19f8159480 legacy=0x7f19f80b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e4003a60 0x7f19e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19e4004810 0x7f19e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f80cbc70 0x7f19e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f80b08a0 con 0x7f19e4003a60 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f80cb190 con 0x7f19e4004810 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e400ba60 con 0x7f19f80cbc70 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fdce2700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e4003a60 0x7f19e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fd4e1700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19e4004810 0x7f19e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fe4e3700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f80cbc70 0x7f19e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fdce2700 1 -- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f80cbc70 msgr2=0x7f19e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fdce2700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f80cbc70 0x7f19e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fdce2700 1 -- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19e4004810 msgr2=0x7f19e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fdce2700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19e4004810 0x7f19e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fdce2700 1 -- 172.21.15.84:0/2267863875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e4003570 con 0x7f19e4003a60 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.204+0000 7f19fdce2700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e4003a60 0x7f19e4003e70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f19f400a9a0 tx=0x7f19f4002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b89f6d68f37a30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.205+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4012440 con 0x7f19e4003a60 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.205+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f40125c0 con 0x7f19e4003a60 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.205+0000 7f19fcce0700 1 -- 172.21.15.84:0/2267863875 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4012980 con 0x7f19e4003a60 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.205+0000 7f19fece4700 1 -- 172.21.15.84:0/2267863875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e4003a60 msgr2=0x7f19e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.205+0000 7f19fece4700 1 --2- 172.21.15.84:0/2267863875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e4003a60 0x7f19e4003e70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f19f400a9a0 tx=0x7f19f4002210 comp rx=0 tx=0).stop 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.205+0000 7f19fe4e3700 1 -- 172.21.15.84:0/2267863875 reap_dead start 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.205+0000 7f19fece4700 1 -- 172.21.15.84:0/2267863875 shutdown_connections 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.205+0000 7f19fece4700 1 -- 172.21.15.84:0/2267863875 >> 172.21.15.84:0/2267863875 conn(0x7f19f806ed20 msgr2=0x7f19f806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.205+0000 7f19fece4700 1 -- 172.21.15.84:0/2267863875 shutdown_connections 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.205+0000 7f19fece4700 1 -- 172.21.15.84:0/2267863875 wait complete. 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.206+0000 7f19fece4700 1 Processor -- start 2023-10-06T03:25:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.206+0000 7f19fece4700 1 -- start start 2023-10-06T03:25:18.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fece4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e4003a60 0x7f19f815f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fece4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f80cf1d0 0x7f19f80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fece4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f80cf640 0x7f19f80d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fece4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f815e250 con 0x7f19f80cf640 2023-10-06T03:25:18.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fece4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f815ed90 con 0x7f19f80cf1d0 2023-10-06T03:25:18.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fece4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f815e460 con 0x7f19e4003a60 2023-10-06T03:25:18.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fe4e3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f80cf640 0x7f19f80d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fdce2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e4003a60 0x7f19f815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fe4e3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f80cf640 0x7f19f80d0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57074/0 (socket says 172.21.15.84:57074) 2023-10-06T03:25:18.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fe4e3700 1 -- 172.21.15.84:0/875740266 learned_addr learned my addr 172.21.15.84:0/875740266 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:18.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fd4e1700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f80cf1d0 0x7f19f80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fe4e3700 1 -- 172.21.15.84:0/875740266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e4003a60 msgr2=0x7f19f815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fe4e3700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e4003a60 0x7f19f815f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fe4e3700 1 -- 172.21.15.84:0/875740266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f80cf1d0 msgr2=0x7f19f80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fe4e3700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f80cf1d0 0x7f19f80d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.207+0000 7f19fe4e3700 1 -- 172.21.15.84:0/875740266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f815e740 con 0x7f19f80cf640 2023-10-06T03:25:18.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.208+0000 7f19fe4e3700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f80cf640 0x7f19f80d0840 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f19f80ca830 tx=0x7f19f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.208+0000 7f19edffb700 1 -- 172.21.15.84:0/875740266 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0013750 con 0x7f19f80cf640 2023-10-06T03:25:18.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.208+0000 7f19edffb700 1 -- 172.21.15.84:0/875740266 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f00138b0 con 0x7f19f80cf640 2023-10-06T03:25:18.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.208+0000 7f19fece4700 1 -- 172.21.15.84:0/875740266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f815ea20 con 0x7f19f80cf640 2023-10-06T03:25:18.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.208+0000 7f19edffb700 1 -- 172.21.15.84:0/875740266 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0013c50 con 0x7f19f80cf640 2023-10-06T03:25:18.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.208+0000 7f19fece4700 1 -- 172.21.15.84:0/875740266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f816cdc0 con 0x7f19f80cf640 2023-10-06T03:25:18.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.209+0000 7f19fece4700 1 -- 172.21.15.84:0/875740266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f815ef40 con 0x7f19f80cf640 2023-10-06T03:25:18.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.209+0000 7f19edffb700 1 -- 172.21.15.84:0/875740266 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19f0014440 con 0x7f19f80cf640 2023-10-06T03:25:18.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.210+0000 7f19edffb700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f19dc066f60 0x7f19dc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.210+0000 7f19edffb700 1 -- 172.21.15.84:0/875740266 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f19f0084960 con 0x7f19f80cf640 2023-10-06T03:25:18.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.210+0000 7f19fdce2700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f19dc066f60 0x7f19dc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.210+0000 7f19fdce2700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f19dc066f60 0x7f19dc069410 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f19f400a8c0 tx=0x7f19f4015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.214+0000 7f19edffb700 1 -- 172.21.15.84:0/875740266 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19f815ef40 con 0x7f19f80cf640 2023-10-06T03:25:18.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.398+0000 7f19fece4700 1 -- 172.21.15.84:0/875740266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f19f815ef00 con 0x7f19f80cf640 2023-10-06T03:25:18.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.398+0000 7f19edffb700 1 -- 172.21.15.84:0/875740266 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+126 (secure 0 0 0) 0x7f19f0022090 con 0x7f19f80cf640 2023-10-06T03:25:18.400 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:18.400 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T03:25:18.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:18.400 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T03:25:18.401 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T03:25:18.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:18.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:18.401 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T03:25:18.401 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T03:25:18.401 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:18.401 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T03:25:18.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 -- 172.21.15.84:0/875740266 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f19dc066f60 msgr2=0x7f19dc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f19dc066f60 0x7f19dc069410 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f19f400a8c0 tx=0x7f19f4015000 comp rx=0 tx=0).stop 2023-10-06T03:25:18.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 -- 172.21.15.84:0/875740266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f80cf640 msgr2=0x7f19f80d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f80cf640 0x7f19f80d0840 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f19f80ca830 tx=0x7f19f00091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 -- 172.21.15.84:0/875740266 shutdown_connections 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f19dc066f60 0x7f19dc069410 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f80cf640 0x7f19f80d0840 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e4003a60 0x7f19f815f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 --2- 172.21.15.84:0/875740266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f80cf1d0 0x7f19f80d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 -- 172.21.15.84:0/875740266 >> 172.21.15.84:0/875740266 conn(0x7f19f806ed20 msgr2=0x7f19f80b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 -- 172.21.15.84:0/875740266 shutdown_connections 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.400+0000 7f19fece4700 1 -- 172.21.15.84:0/875740266 wait complete. 2023-10-06T03:25:18.414 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:25:18.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:25:18.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.530+0000 7f73ddff2700 1 Processor -- start 2023-10-06T03:25:18.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.530+0000 7f73ddff2700 1 -- start start 2023-10-06T03:25:18.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.530+0000 7f73ddff2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73d806ed20 0x7f73d80b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.530+0000 7f73ddff2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73d806f0f0 0x7f73d80b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.530+0000 7f73ddff2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d80b2d20 con 0x7f73d80aee20 2023-10-06T03:25:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.530+0000 7f73ddff2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d806fb80 con 0x7f73d806ed20 2023-10-06T03:25:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.530+0000 7f73ddff2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80b0450 con 0x7f73d806f0f0 2023-10-06T03:25:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73d806ed20 0x7f73d80b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73d806ed20 0x7f73d80b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57080/0 (socket says 172.21.15.84:57080) 2023-10-06T03:25:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d77fe700 1 -- 172.21.15.84:0/634592527 learned_addr learned my addr 172.21.15.84:0/634592527 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d6ffd700 1 --2- 172.21.15.84:0/634592527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73d806f0f0 0x7f73d80b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d77fe700 1 -- 172.21.15.84:0/634592527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73d806f0f0 msgr2=0x7f73d80b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d77fe700 1 --2- 172.21.15.84:0/634592527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73d806f0f0 0x7f73d80b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d77fe700 1 -- 172.21.15.84:0/634592527 >> v1:172.21.15.131:6789/0 conn(0x7f73d80aee20 legacy=0x7f73d80af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d77fe700 1 -- 172.21.15.84:0/634592527 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80b2a40 con 0x7f73d806ed20 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d77fe700 1 --2- 172.21.15.84:0/634592527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 0x7f73d80b23a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009f50 tx=0x7f73c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa9d45ecec7d8d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d67fc700 1 -- 172.21.15.84:0/634592527 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c800e070 con 0x7f73d806ed20 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d67fc700 1 -- 172.21.15.84:0/634592527 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c800b9c0 con 0x7f73d806ed20 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.531+0000 7f73d67fc700 1 -- 172.21.15.84:0/634592527 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c80092e0 con 0x7f73d806ed20 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.532+0000 7f73ddff2700 1 -- 172.21.15.84:0/634592527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 msgr2=0x7f73d80b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.532+0000 7f73ddff2700 1 --2- 172.21.15.84:0/634592527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 0x7f73d80b23a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009f50 tx=0x7f73c8009840 comp rx=0 tx=0).stop 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.532+0000 7f73ddff2700 1 -- 172.21.15.84:0/634592527 shutdown_connections 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.532+0000 7f73ddff2700 1 --2- 172.21.15.84:0/634592527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 0x7f73d80b23a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.532+0000 7f73ddff2700 1 --2- 172.21.15.84:0/634592527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73d806f0f0 0x7f73d80b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.532+0000 7f73ddff2700 1 -- 172.21.15.84:0/634592527 >> 172.21.15.84:0/634592527 conn(0x7f73d8068330 msgr2=0x7f73d8068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:18.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.532+0000 7f73ddff2700 1 -- 172.21.15.84:0/634592527 shutdown_connections 2023-10-06T03:25:18.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.532+0000 7f73ddff2700 1 -- 172.21.15.84:0/634592527 wait complete. 2023-10-06T03:25:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.533+0000 7f73ddff2700 1 Processor -- start 2023-10-06T03:25:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.533+0000 7f73ddff2700 1 -- start start 2023-10-06T03:25:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73ddff2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 0x7f73d80ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73ddff2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73d806f0f0 0x7f73d80ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73ddff2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73d80aee20 0x7f73d80ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73ddff2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80a8fe0 con 0x7f73d806ed20 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73ddff2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80a9b60 con 0x7f73d80aee20 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73ddff2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80a9230 con 0x7f73d806f0f0 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 0x7f73d80ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 0x7f73d80ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57086/0 (socket says 172.21.15.84:57086) 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d77fe700 1 -- 172.21.15.84:0/3063735318 learned_addr learned my addr 172.21.15.84:0/3063735318 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d6ffd700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73d806f0f0 0x7f73d80ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d7fff700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73d80aee20 0x7f73d80ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d77fe700 1 -- 172.21.15.84:0/3063735318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73d806f0f0 msgr2=0x7f73d80ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d77fe700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73d806f0f0 0x7f73d80ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d77fe700 1 -- 172.21.15.84:0/3063735318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73d80aee20 msgr2=0x7f73d80ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d77fe700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73d80aee20 0x7f73d80ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d77fe700 1 -- 172.21.15.84:0/3063735318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8009ae0 con 0x7f73d806ed20 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73d77fe700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 0x7f73d80ae2a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f73d80893c0 tx=0x7f73c8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73cf7fe700 1 -- 172.21.15.84:0/3063735318 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c80088f0 con 0x7f73d806ed20 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73cf7fe700 1 -- 172.21.15.84:0/3063735318 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c8008a70 con 0x7f73d806ed20 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73cf7fe700 1 -- 172.21.15.84:0/3063735318 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8008e30 con 0x7f73d806ed20 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73ddff2700 1 -- 172.21.15.84:0/3063735318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d80a9510 con 0x7f73d806ed20 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.534+0000 7f73ddff2700 1 -- 172.21.15.84:0/3063735318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d80ab930 con 0x7f73d806ed20 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.535+0000 7f73ddff2700 1 -- 172.21.15.84:0/3063735318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d8064ad0 con 0x7f73d806ed20 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.536+0000 7f73cf7fe700 1 -- 172.21.15.84:0/3063735318 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73c8003040 con 0x7f73d806ed20 2023-10-06T03:25:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.536+0000 7f73cf7fe700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f73b8066f30 0x7f73b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.536+0000 7f73cf7fe700 1 -- 172.21.15.84:0/3063735318 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f73c80857d0 con 0x7f73d806ed20 2023-10-06T03:25:18.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.536+0000 7f73d6ffd700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f73b8066f30 0x7f73b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.536+0000 7f73d6ffd700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f73b8066f30 0x7f73b80693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f73d816cc30 tx=0x7f73c00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.540+0000 7f73cf7fe700 1 -- 172.21.15.84:0/3063735318 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73c8052af0 con 0x7f73d806ed20 2023-10-06T03:25:18.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:18.723+0000 7f73ddff2700 1 -- 172.21.15.84:0/3063735318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f73d804bb80 con 0x7f73d806ed20 2023-10-06T03:25:19.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.719+0000 7f73cf7fe700 1 -- 172.21.15.84:0/3063735318 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f73c8056110 con 0x7f73d806ed20 2023-10-06T03:25:19.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.723+0000 7f73ddff2700 1 -- 172.21.15.84:0/3063735318 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f73b8066f30 msgr2=0x7f73b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:19.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.723+0000 7f73ddff2700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f73b8066f30 0x7f73b80693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f73d816cc30 tx=0x7f73c00091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.723+0000 7f73ddff2700 1 -- 172.21.15.84:0/3063735318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 msgr2=0x7f73d80ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.723+0000 7f73ddff2700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 0x7f73d80ae2a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f73d80893c0 tx=0x7f73c8018000 comp rx=0 tx=0).stop 2023-10-06T03:25:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.724+0000 7f73ddff2700 1 -- 172.21.15.84:0/3063735318 shutdown_connections 2023-10-06T03:25:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.724+0000 7f73ddff2700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f73b8066f30 0x7f73b80693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.724+0000 7f73ddff2700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73d80aee20 0x7f73d80ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.724+0000 7f73ddff2700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d806ed20 0x7f73d80ae2a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.724+0000 7f73ddff2700 1 --2- 172.21.15.84:0/3063735318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73d806f0f0 0x7f73d80ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.724+0000 7f73ddff2700 1 -- 172.21.15.84:0/3063735318 >> 172.21.15.84:0/3063735318 conn(0x7f73d8068330 msgr2=0x7f73d80d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.724+0000 7f73ddff2700 1 -- 172.21.15.84:0/3063735318 shutdown_connections 2023-10-06T03:25:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.724+0000 7f73ddff2700 1 -- 172.21.15.84:0/3063735318 wait complete. 2023-10-06T03:25:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T03:25:19.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:25:19.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.866+0000 7f86b2ab4700 1 Processor -- start 2023-10-06T03:25:19.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.866+0000 7f86b2ab4700 1 -- start start 2023-10-06T03:25:19.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.867+0000 7f86b2ab4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f86ac1598e0 0x7f86ac0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:19.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.867+0000 7f86b2ab4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86ac0cbcb0 0x7f86ac0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:19.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.867+0000 7f86b2ab4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac0cf610 con 0x7f86ac159510 2023-10-06T03:25:19.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.867+0000 7f86b2ab4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac0cf8f0 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.867+0000 7f86b2ab4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac0cfbd0 con 0x7f86ac1598e0 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.867+0000 7f86b1051700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86ac0cbcb0 0x7f86ac0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.867+0000 7f86b0850700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f86ac159510 0x7f86ac0cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45502/0 (socket says 172.21.15.84:45502) 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.867+0000 7f86b0850700 1 -- 172.21.15.84:0/746500023 learned_addr learned my addr 172.21.15.84:0/746500023 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.867+0000 7f86abfff700 1 --2- 172.21.15.84:0/746500023 >> v2:172.21.15.131:3300/0 conn(0x7f86ac1598e0 0x7f86ac0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b1051700 1 -- 172.21.15.84:0/746500023 >> v2:172.21.15.131:3300/0 conn(0x7f86ac1598e0 msgr2=0x7f86ac0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b1051700 1 --2- 172.21.15.84:0/746500023 >> v2:172.21.15.131:3300/0 conn(0x7f86ac1598e0 0x7f86ac0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b1051700 1 -- 172.21.15.84:0/746500023 >> v1:172.21.15.84:6789/0 conn(0x7f86ac159510 legacy=0x7f86ac0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86ab7fe700 1 -- 172.21.15.84:0/746500023 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616188146 0 0) 0x7f86ac0cf610 con 0x7f86ac159510 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b1051700 1 -- 172.21.15.84:0/746500023 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac0cfeb0 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b1051700 1 --2- 172.21.15.84:0/746500023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 0x7f86ac0ced60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0c73b0 tx=0x7f86a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d841628df9aead server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86ab7fe700 1 -- 172.21.15.84:0/746500023 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a400b6b0 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86ab7fe700 1 -- 172.21.15.84:0/746500023 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a400b810 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86ab7fe700 1 -- 172.21.15.84:0/746500023 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a400bbb0 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b2ab4700 1 -- 172.21.15.84:0/746500023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 msgr2=0x7f86ac0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:19.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b2ab4700 1 --2- 172.21.15.84:0/746500023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 0x7f86ac0ced60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0c73b0 tx=0x7f86a40091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b2ab4700 1 -- 172.21.15.84:0/746500023 shutdown_connections 2023-10-06T03:25:19.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b2ab4700 1 --2- 172.21.15.84:0/746500023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 0x7f86ac0ced60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b2ab4700 1 --2- 172.21.15.84:0/746500023 >> v2:172.21.15.131:3300/0 conn(0x7f86ac1598e0 0x7f86ac0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b2ab4700 1 -- 172.21.15.84:0/746500023 >> 172.21.15.84:0/746500023 conn(0x7f86ac089e90 msgr2=0x7f86ac0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:19.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b2ab4700 1 -- 172.21.15.84:0/746500023 shutdown_connections 2023-10-06T03:25:19.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.868+0000 7f86b2ab4700 1 -- 172.21.15.84:0/746500023 wait complete. 2023-10-06T03:25:19.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.869+0000 7f86b2ab4700 1 Processor -- start 2023-10-06T03:25:19.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.870+0000 7f86b2ab4700 1 -- start start 2023-10-06T03:25:19.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.870+0000 7f86b2ab4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 0x7f86ac14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:19.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.870+0000 7f86b2ab4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86ac159510 0x7f86ac14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:19.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.870+0000 7f86b2ab4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ac1598e0 0x7f86ac14e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:19.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.870+0000 7f86b2ab4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac15c980 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.870+0000 7f86b2ab4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac14eac0 con 0x7f86ac1598e0 2023-10-06T03:25:19.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.870+0000 7f86b2ab4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0b3b10 con 0x7f86ac159510 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.870+0000 7f86b0850700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 0x7f86ac14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b0850700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 0x7f86ac14a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57102/0 (socket says 172.21.15.84:57102) 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b0850700 1 -- 172.21.15.84:0/4002657808 learned_addr learned my addr 172.21.15.84:0/4002657808 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b1051700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ac1598e0 0x7f86ac14e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86abfff700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86ac159510 0x7f86ac14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b0850700 1 -- 172.21.15.84:0/4002657808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86ac159510 msgr2=0x7f86ac14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b0850700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86ac159510 0x7f86ac14e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b0850700 1 -- 172.21.15.84:0/4002657808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ac1598e0 msgr2=0x7f86ac14e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b0850700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ac1598e0 0x7f86ac14e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b0850700 1 -- 172.21.15.84:0/4002657808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4009420 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b1051700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ac1598e0 0x7f86ac14e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b0850700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 0x7f86ac14a2c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f869c00cd80 tx=0x7f869c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86a8ff9700 1 -- 172.21.15.84:0/4002657808 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c00ab10 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86a8ff9700 1 -- 172.21.15.84:0/4002657808 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c00ac70 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b2ab4700 1 -- 172.21.15.84:0/4002657808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac0b3df0 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86a8ff9700 1 -- 172.21.15.84:0/4002657808 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0070f0 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.871+0000 7f86b2ab4700 1 -- 172.21.15.84:0/4002657808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac0b43b0 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.872+0000 7f86b2ab4700 1 -- 172.21.15.84:0/4002657808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ac0b45d0 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.872+0000 7f86a8ff9700 1 -- 172.21.15.84:0/4002657808 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f869c0074e0 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.873+0000 7f86a8ff9700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8698066f30 0x7f86980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.873+0000 7f86abfff700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8698066f30 0x7f86980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.873+0000 7f86a8ff9700 1 -- 172.21.15.84:0/4002657808 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f869c084b20 con 0x7f86ac0cbcb0 2023-10-06T03:25:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.873+0000 7f86abfff700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8698066f30 0x7f86980693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f86ac14c210 tx=0x7f86a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:19.877+0000 7f86a8ff9700 1 -- 172.21.15.84:0/4002657808 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f869c051d50 con 0x7f86ac0cbcb0 2023-10-06T03:25:20.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.060+0000 7f86b2ab4700 1 -- 172.21.15.84:0/4002657808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f86ac064ad0 con 0x7f86ac0cbcb0 2023-10-06T03:25:20.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.722+0000 7f86a8ff9700 1 -- 172.21.15.84:0/4002657808 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7f869c055370 con 0x7f86ac0cbcb0 2023-10-06T03:25:20.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.726+0000 7f86b2ab4700 1 -- 172.21.15.84:0/4002657808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8698066f30 msgr2=0x7f86980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.726+0000 7f86b2ab4700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8698066f30 0x7f86980693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f86ac14c210 tx=0x7f86a0008040 comp rx=0 tx=0).stop 2023-10-06T03:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.727+0000 7f86b2ab4700 1 -- 172.21.15.84:0/4002657808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 msgr2=0x7f86ac14a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.727+0000 7f86b2ab4700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 0x7f86ac14a2c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f869c00cd80 tx=0x7f869c001ae0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.728+0000 7f86b2ab4700 1 -- 172.21.15.84:0/4002657808 shutdown_connections 2023-10-06T03:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.728+0000 7f86b2ab4700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8698066f30 0x7f86980693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.728+0000 7f86b2ab4700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ac1598e0 0x7f86ac14e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.728+0000 7f86b2ab4700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0cbcb0 0x7f86ac14a2c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.728+0000 7f86b2ab4700 1 --2- 172.21.15.84:0/4002657808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86ac159510 0x7f86ac14e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.728+0000 7f86b2ab4700 1 -- 172.21.15.84:0/4002657808 >> 172.21.15.84:0/4002657808 conn(0x7f86ac089e90 msgr2=0x7f86ac14b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:20.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.730+0000 7f86b2ab4700 1 -- 172.21.15.84:0/4002657808 shutdown_connections 2023-10-06T03:25:20.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.730+0000 7f86b2ab4700 1 -- 172.21.15.84:0/4002657808 wait complete. 2023-10-06T03:25:20.737 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T03:25:20.752 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:25:20.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.869+0000 7f435c694700 1 Processor -- start 2023-10-06T03:25:20.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.869+0000 7f435c694700 1 -- start start 2023-10-06T03:25:20.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435c694700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f43540cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435c694700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f43541598e0 0x7f43540cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435c694700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43540cf350 con 0x7f43540ce820 2023-10-06T03:25:20.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435c694700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43540cf610 con 0x7f43541598e0 2023-10-06T03:25:20.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435c694700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43540cf8f0 con 0x7f4354159510 2023-10-06T03:25:20.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435ac31700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f43540ce820 0x7f43540cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56516/0 (socket says 172.21.15.84:56516) 2023-10-06T03:25:20.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435ac31700 1 -- 172.21.15.84:0/1381664900 learned_addr learned my addr 172.21.15.84:0/1381664900 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:20.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435a430700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f43540cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f4359c2f700 1 --2- 172.21.15.84:0/1381664900 >> v2:172.21.15.131:3300/0 conn(0x7f43541598e0 0x7f43540cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327011169 0 0) 0x7f43540cf350 con 0x7f43540ce820 2023-10-06T03:25:20.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4340003570 con 0x7f43540ce820 2023-10-06T03:25:20.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2615146673 0 0) 0x7f4340003570 con 0x7f43540ce820 2023-10-06T03:25:20.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 msgr2=0x7f43540cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:20.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f43540cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 >> v2:172.21.15.131:3300/0 conn(0x7f43541598e0 msgr2=0x7f43540cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:20.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 --2- 172.21.15.84:0/1381664900 >> v2:172.21.15.131:3300/0 conn(0x7f43541598e0 0x7f43540cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43540cfbd0 con 0x7f43540ce820 2023-10-06T03:25:20.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f434c0017f0 con 0x7f43540ce820 2023-10-06T03:25:20.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 >> v1:172.21.15.84:6789/0 conn(0x7f43540ce820 legacy=0x7f43540cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f4340003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.870+0000 7f435942e700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4340003fe0 0x7f4340004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435942e700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4340004d50 0x7f43400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43540cf610 con 0x7f4340003fe0 2023-10-06T03:25:20.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43540cf8f0 con 0x7f4340004d50 2023-10-06T03:25:20.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434000ba90 con 0x7f4354159510 2023-10-06T03:25:20.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f4359c2f700 1 --2- 172.21.15.84:0/1381664900 >> v2:172.21.15.131:3300/0 conn(0x7f43541598e0 0x7f43540cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:20.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435a430700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f4340003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435ac31700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4340004d50 0x7f43400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f4359c2f700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4340003fe0 0x7f4340004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435a430700 1 -- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4340004d50 msgr2=0x7f43400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435a430700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4340004d50 0x7f43400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435a430700 1 -- 172.21.15.84:0/1381664900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4340003fe0 msgr2=0x7f4340004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435a430700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4340003fe0 0x7f4340004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435a430700 1 -- 172.21.15.84:0/1381664900 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4340003570 con 0x7f4354159510 2023-10-06T03:25:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f4359c2f700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4340003fe0 0x7f4340004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435a430700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f4340003a60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4350009c00 tx=0x7f43500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8f72b3bf294fe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435000e6b0 con 0x7f4354159510 2023-10-06T03:25:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435000e810 con 0x7f4354159510 2023-10-06T03:25:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.871+0000 7f435942e700 1 -- 172.21.15.84:0/1381664900 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435000ebd0 con 0x7f4354159510 2023-10-06T03:25:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.872+0000 7f435c694700 1 -- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 msgr2=0x7f4340003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.872+0000 7f435c694700 1 --2- 172.21.15.84:0/1381664900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f4340003a60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4350009c00 tx=0x7f43500091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.872+0000 7f435ac31700 1 -- 172.21.15.84:0/1381664900 reap_dead start 2023-10-06T03:25:20.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.872+0000 7f435c694700 1 -- 172.21.15.84:0/1381664900 shutdown_connections 2023-10-06T03:25:20.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.872+0000 7f435c694700 1 -- 172.21.15.84:0/1381664900 >> 172.21.15.84:0/1381664900 conn(0x7f4354089e90 msgr2=0x7f43540997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:20.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.872+0000 7f435c694700 1 -- 172.21.15.84:0/1381664900 shutdown_connections 2023-10-06T03:25:20.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.872+0000 7f435c694700 1 -- 172.21.15.84:0/1381664900 wait complete. 2023-10-06T03:25:20.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.873+0000 7f435c694700 1 Processor -- start 2023-10-06T03:25:20.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.873+0000 7f435c694700 1 -- start start 2023-10-06T03:25:20.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435c694700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f43540b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435c694700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4354159d00 0x7f435414d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435c694700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435415b230 0x7f43540c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435c694700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4354169df0 con 0x7f435415b230 2023-10-06T03:25:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435c694700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435415a190 con 0x7f4354159d00 2023-10-06T03:25:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435c694700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435415a470 con 0x7f4354159510 2023-10-06T03:25:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435ac31700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435415b230 0x7f43540c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435ac31700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435415b230 0x7f43540c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33214/0 (socket says 172.21.15.84:33214) 2023-10-06T03:25:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435ac31700 1 -- 172.21.15.84:0/3046973762 learned_addr learned my addr 172.21.15.84:0/3046973762 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435a430700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f43540b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f4359c2f700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4354159d00 0x7f435414d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435ac31700 1 -- 172.21.15.84:0/3046973762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 msgr2=0x7f43540b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435ac31700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f43540b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435ac31700 1 -- 172.21.15.84:0/3046973762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4354159d00 msgr2=0x7f435414d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435ac31700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4354159d00 0x7f435414d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435ac31700 1 -- 172.21.15.84:0/3046973762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435415a750 con 0x7f435415b230 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.874+0000 7f435ac31700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435415b230 0x7f43540c58c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f434c000f80 tx=0x7f434c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.875+0000 7f434a7fc700 1 -- 172.21.15.84:0/3046973762 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c00acd0 con 0x7f435415b230 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.875+0000 7f434a7fc700 1 -- 172.21.15.84:0/3046973762 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c00ae70 con 0x7f435415b230 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.875+0000 7f435c694700 1 -- 172.21.15.84:0/3046973762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435415aa30 con 0x7f435415b230 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.875+0000 7f434a7fc700 1 -- 172.21.15.84:0/3046973762 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c013620 con 0x7f435415b230 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.875+0000 7f435c694700 1 -- 172.21.15.84:0/3046973762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435415b870 con 0x7f435415b230 2023-10-06T03:25:20.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.875+0000 7f435c694700 1 -- 172.21.15.84:0/3046973762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4354169f30 con 0x7f435415b230 2023-10-06T03:25:20.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.876+0000 7f434a7fc700 1 -- 172.21.15.84:0/3046973762 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f434c013990 con 0x7f435415b230 2023-10-06T03:25:20.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.876+0000 7f434a7fc700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4338066f30 0x7f43380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.876+0000 7f434a7fc700 1 -- 172.21.15.84:0/3046973762 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f434c085020 con 0x7f435415b230 2023-10-06T03:25:20.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.876+0000 7f435a430700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4338066f30 0x7f43380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.877+0000 7f435a430700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4338066f30 0x7f43380693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f43500091e0 tx=0x7f435001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:20.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:20.881+0000 7f434a7fc700 1 -- 172.21.15.84:0/3046973762 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4354169f30 con 0x7f435415b230 2023-10-06T03:25:21.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.109+0000 7f435c694700 1 -- 172.21.15.84:0/3046973762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4354169f30 con 0x7f435415b230 2023-10-06T03:25:21.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.735+0000 7f434a7fc700 1 -- 172.21.15.84:0/3046973762 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4354169f30 con 0x7f435415b230 2023-10-06T03:25:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 -- 172.21.15.84:0/3046973762 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4338066f30 msgr2=0x7f43380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4338066f30 0x7f43380693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f43500091e0 tx=0x7f435001a000 comp rx=0 tx=0).stop 2023-10-06T03:25:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 -- 172.21.15.84:0/3046973762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435415b230 msgr2=0x7f43540c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435415b230 0x7f43540c58c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f434c000f80 tx=0x7f434c002210 comp rx=0 tx=0).stop 2023-10-06T03:25:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 -- 172.21.15.84:0/3046973762 shutdown_connections 2023-10-06T03:25:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4338066f30 0x7f43380693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435415b230 0x7f43540c58c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4354159510 0x7f43540b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 --2- 172.21.15.84:0/3046973762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4354159d00 0x7f435414d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 -- 172.21.15.84:0/3046973762 >> 172.21.15.84:0/3046973762 conn(0x7f4354089e90 msgr2=0x7f435415bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 -- 172.21.15.84:0/3046973762 shutdown_connections 2023-10-06T03:25:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.739+0000 7f435c694700 1 -- 172.21.15.84:0/3046973762 wait complete. 2023-10-06T03:25:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 8 and data pool 9 2023-10-06T03:25:21.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:21.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.867+0000 7fb148eb8700 1 Processor -- start 2023-10-06T03:25:21.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.867+0000 7fb148eb8700 1 -- start start 2023-10-06T03:25:21.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.868+0000 7fb148eb8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb1441595c0 0x7fb14406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.868+0000 7fb148eb8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb144067d00 0x7fb1440b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.868+0000 7fb148eb8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1440cde70 con 0x7fb14406e9e0 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.868+0000 7fb148eb8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14406ef60 con 0x7fb144067d00 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.868+0000 7fb148eb8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14406f240 con 0x7fb1441595c0 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.868+0000 7fb142d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb144067d00 0x7fb1440b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.868+0000 7fb141d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb14406e9e0 0x7fb1440675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56528/0 (socket says 172.21.15.84:56528) 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.868+0000 7fb141d9b700 1 -- 172.21.15.84:0/2030615134 learned_addr learned my addr 172.21.15.84:0/2030615134 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.869+0000 7fb142d9d700 1 -- 172.21.15.84:0/2030615134 >> v2:172.21.15.131:3300/0 conn(0x7fb1441595c0 msgr2=0x7fb14406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.869+0000 7fb14259c700 1 --2- 172.21.15.84:0/2030615134 >> v2:172.21.15.131:3300/0 conn(0x7fb1441595c0 0x7fb14406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.869+0000 7fb14159a700 1 -- 172.21.15.84:0/2030615134 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737405960 0 0) 0x7fb1440cde70 con 0x7fb14406e9e0 2023-10-06T03:25:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.869+0000 7fb142d9d700 1 --2- 172.21.15.84:0/2030615134 >> v2:172.21.15.131:3300/0 conn(0x7fb1441595c0 0x7fb14406e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.869+0000 7fb142d9d700 1 -- 172.21.15.84:0/2030615134 >> v1:172.21.15.84:6789/0 conn(0x7fb14406e9e0 legacy=0x7fb1440675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.869+0000 7fb142d9d700 1 -- 172.21.15.84:0/2030615134 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440b0190 con 0x7fb144067d00 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.869+0000 7fb142d9d700 1 --2- 172.21.15.84:0/2030615134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 0x7fb1440b0990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb144070610 tx=0x7fb13c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ece443a34c35a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.869+0000 7fb14159a700 1 -- 172.21.15.84:0/2030615134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c005c60 con 0x7fb144067d00 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.869+0000 7fb14159a700 1 -- 172.21.15.84:0/2030615134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c005dc0 con 0x7fb144067d00 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.869+0000 7fb14159a700 1 -- 172.21.15.84:0/2030615134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c006280 con 0x7fb144067d00 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.870+0000 7fb148eb8700 1 -- 172.21.15.84:0/2030615134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 msgr2=0x7fb1440b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.870+0000 7fb148eb8700 1 --2- 172.21.15.84:0/2030615134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 0x7fb1440b0990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb144070610 tx=0x7fb13c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.870+0000 7fb148eb8700 1 -- 172.21.15.84:0/2030615134 shutdown_connections 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.870+0000 7fb148eb8700 1 --2- 172.21.15.84:0/2030615134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 0x7fb1440b0990 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.870+0000 7fb148eb8700 1 --2- 172.21.15.84:0/2030615134 >> v2:172.21.15.131:3300/0 conn(0x7fb1441595c0 0x7fb14406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.870+0000 7fb148eb8700 1 -- 172.21.15.84:0/2030615134 >> 172.21.15.84:0/2030615134 conn(0x7fb144069180 msgr2=0x7fb1440cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.870+0000 7fb148eb8700 1 -- 172.21.15.84:0/2030615134 shutdown_connections 2023-10-06T03:25:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.870+0000 7fb148eb8700 1 -- 172.21.15.84:0/2030615134 wait complete. 2023-10-06T03:25:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.871+0000 7fb148eb8700 1 Processor -- start 2023-10-06T03:25:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.871+0000 7fb148eb8700 1 -- start start 2023-10-06T03:25:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.871+0000 7fb148eb8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 0x7fb144143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.871+0000 7fb148eb8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14406e9e0 0x7fb1440c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb148eb8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1441595c0 0x7fb1440b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb148eb8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440c67b0 con 0x7fb144067d00 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb148eb8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440c5ba0 con 0x7fb1441595c0 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb148eb8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440c5e80 con 0x7fb14406e9e0 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb14259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 0x7fb144143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb14259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 0x7fb144143690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33234/0 (socket says 172.21.15.84:33234) 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb14259c700 1 -- 172.21.15.84:0/148111790 learned_addr learned my addr 172.21.15.84:0/148111790 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb142d9d700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1441595c0 0x7fb1440b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb141d9b700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14406e9e0 0x7fb1440c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb14259c700 1 -- 172.21.15.84:0/148111790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14406e9e0 msgr2=0x7fb1440c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb14259c700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14406e9e0 0x7fb1440c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb14259c700 1 -- 172.21.15.84:0/148111790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1441595c0 msgr2=0x7fb1440b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb14259c700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1441595c0 0x7fb1440b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb14259c700 1 -- 172.21.15.84:0/148111790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c009420 con 0x7fb144067d00 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb14259c700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 0x7fb144143690 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb13400ce10 tx=0x7fb134007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb1327fc700 1 -- 172.21.15.84:0/148111790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400ab90 con 0x7fb144067d00 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb1327fc700 1 -- 172.21.15.84:0/148111790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13400acf0 con 0x7fb144067d00 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb148eb8700 1 -- 172.21.15.84:0/148111790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1440c6160 con 0x7fb144067d00 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb1327fc700 1 -- 172.21.15.84:0/148111790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134017660 con 0x7fb144067d00 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.872+0000 7fb148eb8700 1 -- 172.21.15.84:0/148111790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb144143bd0 con 0x7fb144067d00 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.873+0000 7fb148eb8700 1 -- 172.21.15.84:0/148111790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb144064ad0 con 0x7fb144067d00 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.874+0000 7fb1327fc700 1 -- 172.21.15.84:0/148111790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb134003020 con 0x7fb144067d00 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.874+0000 7fb1327fc700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb124066f60 0x7fb124069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.874+0000 7fb1327fc700 1 -- 172.21.15.84:0/148111790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb134013070 con 0x7fb144067d00 2023-10-06T03:25:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.874+0000 7fb141d9b700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb124066f60 0x7fb124069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.874+0000 7fb141d9b700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb124066f60 0x7fb124069410 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb14416cb40 tx=0x7fb138009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:21.878+0000 7fb1327fc700 1 -- 172.21.15.84:0/148111790 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb134051d10 con 0x7fb144067d00 2023-10-06T03:25:22.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.063+0000 7fb148eb8700 1 -- 172.21.15.84:0/148111790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1440b0470 con 0x7fb144067d00 2023-10-06T03:25:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.064+0000 7fb1327fc700 1 -- 172.21.15.84:0/148111790 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+17084 (secure 0 0 0) 0x7fb13401c020 con 0x7fb144067d00 2023-10-06T03:25:22.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:22.067 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":49,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:21.110987+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:18.741959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:20.079553+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 -- 172.21.15.84:0/148111790 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb124066f60 msgr2=0x7fb124069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb124066f60 0x7fb124069410 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb14416cb40 tx=0x7fb138009040 comp rx=0 tx=0).stop 2023-10-06T03:25:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 -- 172.21.15.84:0/148111790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 msgr2=0x7fb144143690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 0x7fb144143690 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb13400ce10 tx=0x7fb134007810 comp rx=0 tx=0).stop 2023-10-06T03:25:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 -- 172.21.15.84:0/148111790 shutdown_connections 2023-10-06T03:25:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb124066f60 0x7fb124069410 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1441595c0 0x7fb1440b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb144067d00 0x7fb144143690 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 --2- 172.21.15.84:0/148111790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14406e9e0 0x7fb1440c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 -- 172.21.15.84:0/148111790 >> 172.21.15.84:0/148111790 conn(0x7fb144069180 msgr2=0x7fb1440675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 -- 172.21.15.84:0/148111790 shutdown_connections 2023-10-06T03:25:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.066+0000 7fb148eb8700 1 -- 172.21.15.84:0/148111790 wait complete. 2023-10-06T03:25:22.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:22.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.192+0000 7fb9f4901700 1 Processor -- start 2023-10-06T03:25:22.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.193+0000 7fb9f4901700 1 -- start start 2023-10-06T03:25:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.193+0000 7fb9f4901700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb9f01595a0 0x7fb9f00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.193+0000 7fb9f4901700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f00b0ca0 con 0x7fb9f00b49e0 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.193+0000 7fb9f4901700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f00b0f80 con 0x7fb9f00b07a0 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.193+0000 7fb9f4901700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f00b1260 con 0x7fb9f01595a0 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.193+0000 7fb9ee59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb9f01595a0 0x7fb9f00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.193+0000 7fb9ee59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb9f01595a0 0x7fb9f00aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33246/0 (socket says 172.21.15.84:33246) 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.194+0000 7fb9ee59c700 1 -- 172.21.15.84:0/125164425 learned_addr learned my addr 172.21.15.84:0/125164425 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.193+0000 7fb9e5d9b700 1 --1- 172.21.15.84:0/125164425 >> v1:172.21.15.84:6789/0 conn(0x7fb9f00b49e0 0x7fb9f00aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56542/0 (socket says 172.21.15.84:56542) 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.194+0000 7fb9ee59c700 1 -- 172.21.15.84:0/125164425 >> v1:172.21.15.131:6789/0 conn(0x7fb9f00b07a0 legacy=0x7fb9f00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.194+0000 7fb9ee59c700 1 -- 172.21.15.84:0/125164425 >> v1:172.21.15.84:6789/0 conn(0x7fb9f00b49e0 legacy=0x7fb9f00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.194+0000 7fb9ee59c700 1 -- 172.21.15.84:0/125164425 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f00b1540 con 0x7fb9f01595a0 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.194+0000 7fb9edd9b700 1 -- 172.21.15.84:0/125164425 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156288836 0 0) 0x7fb9f00b0ca0 con 0x7fb9f00b49e0 2023-10-06T03:25:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.194+0000 7fb9ee59c700 1 --2- 172.21.15.84:0/125164425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f01595a0 0x7fb9f00aa570 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00099c0 tx=0x7fb9e0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b24684119e11bef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.194+0000 7fb9edd9b700 1 -- 172.21.15.84:0/125164425 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0005c10 con 0x7fb9f01595a0 2023-10-06T03:25:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.194+0000 7fb9edd9b700 1 -- 172.21.15.84:0/125164425 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0005d70 con 0x7fb9f01595a0 2023-10-06T03:25:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.194+0000 7fb9edd9b700 1 -- 172.21.15.84:0/125164425 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000b800 con 0x7fb9f01595a0 2023-10-06T03:25:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.195+0000 7fb9f4901700 1 -- 172.21.15.84:0/125164425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f01595a0 msgr2=0x7fb9f00aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.195+0000 7fb9f4901700 1 --2- 172.21.15.84:0/125164425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f01595a0 0x7fb9f00aa570 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00099c0 tx=0x7fb9e0009220 comp rx=0 tx=0).stop 2023-10-06T03:25:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.195+0000 7fb9f4901700 1 -- 172.21.15.84:0/125164425 shutdown_connections 2023-10-06T03:25:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.195+0000 7fb9f4901700 1 --2- 172.21.15.84:0/125164425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f01595a0 0x7fb9f00aa570 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.195+0000 7fb9f4901700 1 -- 172.21.15.84:0/125164425 >> 172.21.15.84:0/125164425 conn(0x7fb9f0099830 msgr2=0x7fb9f006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.195+0000 7fb9f4901700 1 -- 172.21.15.84:0/125164425 shutdown_connections 2023-10-06T03:25:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.195+0000 7fb9f4901700 1 -- 172.21.15.84:0/125164425 wait complete. 2023-10-06T03:25:22.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.196+0000 7fb9f4901700 1 Processor -- start 2023-10-06T03:25:22.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.196+0000 7fb9f4901700 1 -- start start 2023-10-06T03:25:22.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9f4901700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f00b07a0 0x7fb9f016a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9f4901700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f00b49e0 0x7fb9f015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9f4901700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f01595a0 0x7fb9f015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9f4901700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f016de00 con 0x7fb9f00b07a0 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9f4901700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f00abf20 con 0x7fb9f00b49e0 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9f4901700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f016d4d0 con 0x7fb9f01595a0 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9ee59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f00b07a0 0x7fb9f016a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9ee59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f00b07a0 0x7fb9f016a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33254/0 (socket says 172.21.15.84:33254) 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9ee59c700 1 -- 172.21.15.84:0/2364393599 learned_addr learned my addr 172.21.15.84:0/2364393599 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9e5d9b700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f00b49e0 0x7fb9f015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9eed9d700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f01595a0 0x7fb9f015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9ee59c700 1 -- 172.21.15.84:0/2364393599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f01595a0 msgr2=0x7fb9f015c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9ee59c700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f01595a0 0x7fb9f015c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9ee59c700 1 -- 172.21.15.84:0/2364393599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f00b49e0 msgr2=0x7fb9f015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9ee59c700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f00b49e0 0x7fb9f015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9ee59c700 1 -- 172.21.15.84:0/2364393599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0009480 con 0x7fb9f00b07a0 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9e5d9b700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f00b49e0 0x7fb9f015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9eed9d700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f01595a0 0x7fb9f015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9ee59c700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f00b07a0 0x7fb9f016a4e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0003080 tx=0x7fb9e0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9e6ffd700 1 -- 172.21.15.84:0/2364393599 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0011cc0 con 0x7fb9f00b07a0 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9e6ffd700 1 -- 172.21.15.84:0/2364393599 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0011e40 con 0x7fb9f00b07a0 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9e6ffd700 1 -- 172.21.15.84:0/2364393599 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e001c670 con 0x7fb9f00b07a0 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9f4901700 1 -- 172.21.15.84:0/2364393599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f016d7b0 con 0x7fb9f00b07a0 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.197+0000 7fb9f4901700 1 -- 172.21.15.84:0/2364393599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f016aa20 con 0x7fb9f00b07a0 2023-10-06T03:25:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.198+0000 7fb9f4901700 1 -- 172.21.15.84:0/2364393599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f0064ad0 con 0x7fb9f00b07a0 2023-10-06T03:25:22.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.199+0000 7fb9e6ffd700 1 -- 172.21.15.84:0/2364393599 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9e001ca60 con 0x7fb9f00b07a0 2023-10-06T03:25:22.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.199+0000 7fb9e6ffd700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb9d0066f30 0x7fb9d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.199+0000 7fb9e6ffd700 1 -- 172.21.15.84:0/2364393599 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb9e00862b0 con 0x7fb9f00b07a0 2023-10-06T03:25:22.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.199+0000 7fb9e5d9b700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb9d0066f30 0x7fb9d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.199+0000 7fb9e5d9b700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb9d0066f30 0x7fb9d00693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00afdf0 tx=0x7fb9d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:22.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.203+0000 7fb9e6ffd700 1 -- 172.21.15.84:0/2364393599 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9e0053280 con 0x7fb9f00b07a0 2023-10-06T03:25:22.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.388+0000 7fb9f4901700 1 -- 172.21.15.84:0/2364393599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9f00b1820 con 0x7fb9f00b07a0 2023-10-06T03:25:22.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.388+0000 7fb9e6ffd700 1 -- 172.21.15.84:0/2364393599 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fb9e00568a0 con 0x7fb9f00b07a0 2023-10-06T03:25:22.390 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:22.390 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":50,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:22.337746+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:18.741959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:20.079553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 -- 172.21.15.84:0/2364393599 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb9d0066f30 msgr2=0x7fb9d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb9d0066f30 0x7fb9d00693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00afdf0 tx=0x7fb9d8009040 comp rx=0 tx=0).stop 2023-10-06T03:25:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 -- 172.21.15.84:0/2364393599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f00b07a0 msgr2=0x7fb9f016a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f00b07a0 0x7fb9f016a4e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0003080 tx=0x7fb9e0015000 comp rx=0 tx=0).stop 2023-10-06T03:25:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 -- 172.21.15.84:0/2364393599 shutdown_connections 2023-10-06T03:25:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb9d0066f30 0x7fb9d00693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f01595a0 0x7fb9f015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9f00b07a0 0x7fb9f016a4e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 --2- 172.21.15.84:0/2364393599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f00b49e0 0x7fb9f015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 -- 172.21.15.84:0/2364393599 >> 172.21.15.84:0/2364393599 conn(0x7fb9f0099830 msgr2=0x7fb9f0069a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.390+0000 7fb9f4901700 1 -- 172.21.15.84:0/2364393599 shutdown_connections 2023-10-06T03:25:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.391+0000 7fb9f4901700 1 -- 172.21.15.84:0/2364393599 wait complete. 2023-10-06T03:25:22.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:25:22.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.519+0000 7f9cfa870700 1 Processor -- start 2023-10-06T03:25:22.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.519+0000 7f9cfa870700 1 -- start start 2023-10-06T03:25:22.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cfa870700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40b2660 0x7f9cf40cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cfa870700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9cf40cf1f0 0x7f9cf40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cfa870700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf40cc9b0 con 0x7f9cf40b2a30 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cfa870700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf40cbda0 con 0x7f9cf40cf1f0 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cfa870700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40cc080 con 0x7f9cf40b2660 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf906d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9cf40b2a30 0x7f9cf40ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56554/0 (socket says 172.21.15.84:56554) 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf906d700 1 -- 172.21.15.84:0/2635274728 learned_addr learned my addr 172.21.15.84:0/2635274728 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf986e700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40b2660 0x7f9cf40cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cfa06f700 1 --2- 172.21.15.84:0/2635274728 >> v2:172.21.15.131:3300/0 conn(0x7f9cf40cf1f0 0x7f9cf40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991069250 0 0) 0x7f9cf40cc9b0 con 0x7f9cf40b2a30 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cdc003570 con 0x7f9cf40b2a30 2023-10-06T03:25:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3730617568 0 0) 0x7f9cdc003570 con 0x7f9cf40b2a30 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40b2660 msgr2=0x7f9cf40cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf886c700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40b2660 0x7f9cf40cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 >> v2:172.21.15.131:3300/0 conn(0x7f9cf40cf1f0 msgr2=0x7f9cf40cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf886c700 1 --2- 172.21.15.84:0/2635274728 >> v2:172.21.15.131:3300/0 conn(0x7f9cf40cf1f0 0x7f9cf40cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf40cc360 con 0x7f9cf40b2a30 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.520+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f9ce8001470 con 0x7f9cf40b2a30 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 >> v1:172.21.15.84:6789/0 conn(0x7f9cf40b2a30 legacy=0x7f9cf40ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf886c700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40b2660 0x7f9cdc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf886c700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 0x7f9cdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf886c700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cdc004d50 0x7f9cdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40cbda0 con 0x7f9cdc003fe0 2023-10-06T03:25:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40cc080 con 0x7f9cdc004d50 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc00ba90 con 0x7f9cf40b2660 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf906d700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 0x7f9cdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf986e700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40b2660 0x7f9cdc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cfa06f700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cdc004d50 0x7f9cdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf906d700 1 -- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40b2660 msgr2=0x7f9cdc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf906d700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40b2660 0x7f9cdc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf906d700 1 -- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cdc004d50 msgr2=0x7f9cdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf906d700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cdc004d50 0x7f9cdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf906d700 1 -- 172.21.15.84:0/2635274728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc003570 con 0x7f9cdc003fe0 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf906d700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 0x7f9cdc004810 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800c3c0 tx=0x7f9ce8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c95d165ad767aee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800cc30 con 0x7f9cdc003fe0 2023-10-06T03:25:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce800cdb0 con 0x7f9cdc003fe0 2023-10-06T03:25:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.521+0000 7f9cf886c700 1 -- 172.21.15.84:0/2635274728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8005b70 con 0x7f9cdc003fe0 2023-10-06T03:25:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.522+0000 7f9cfa870700 1 -- 172.21.15.84:0/2635274728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 msgr2=0x7f9cdc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.522+0000 7f9cfa870700 1 --2- 172.21.15.84:0/2635274728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 0x7f9cdc004810 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800c3c0 tx=0x7f9ce8001e90 comp rx=0 tx=0).stop 2023-10-06T03:25:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.522+0000 7f9cfa06f700 1 -- 172.21.15.84:0/2635274728 reap_dead start 2023-10-06T03:25:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.522+0000 7f9cfa870700 1 -- 172.21.15.84:0/2635274728 shutdown_connections 2023-10-06T03:25:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.522+0000 7f9cfa870700 1 -- 172.21.15.84:0/2635274728 >> 172.21.15.84:0/2635274728 conn(0x7f9cf4099560 msgr2=0x7f9cf406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.522+0000 7f9cfa870700 1 -- 172.21.15.84:0/2635274728 shutdown_connections 2023-10-06T03:25:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.522+0000 7f9cfa870700 1 -- 172.21.15.84:0/2635274728 wait complete. 2023-10-06T03:25:22.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.523+0000 7f9cfa870700 1 Processor -- start 2023-10-06T03:25:22.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.523+0000 7f9cfa870700 1 -- start start 2023-10-06T03:25:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cfa870700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 0x7f9cf4152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cfa870700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf4169820 0x7f9cf40c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cfa870700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c73c0 0x7f9cf40c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cfa870700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf4153790 con 0x7f9cdc003fe0 2023-10-06T03:25:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cfa870700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40c9930 con 0x7f9cf4169820 2023-10-06T03:25:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cfa870700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40b6050 con 0x7f9cf40c73c0 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf986e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 0x7f9cf4152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf986e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 0x7f9cf4152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33266/0 (socket says 172.21.15.84:33266) 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf986e700 1 -- 172.21.15.84:0/4143129477 learned_addr learned my addr 172.21.15.84:0/4143129477 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cfa06f700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c73c0 0x7f9cf40c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf906d700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf4169820 0x7f9cf40c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf986e700 1 -- 172.21.15.84:0/4143129477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c73c0 msgr2=0x7f9cf40c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf986e700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c73c0 0x7f9cf40c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf986e700 1 -- 172.21.15.84:0/4143129477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf4169820 msgr2=0x7f9cf40c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf986e700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf4169820 0x7f9cf40c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf986e700 1 -- 172.21.15.84:0/4143129477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf40b4e70 con 0x7f9cdc003fe0 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cfa06f700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c73c0 0x7f9cf40c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf906d700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf4169820 0x7f9cf40c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf986e700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 0x7f9cf4152ef0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009fd0 tx=0x7f9cec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf1ffb700 1 -- 172.21.15.84:0/4143129477 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00e040 con 0x7f9cdc003fe0 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf1ffb700 1 -- 172.21.15.84:0/4143129477 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec00f040 con 0x7f9cdc003fe0 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cfa870700 1 -- 172.21.15.84:0/4143129477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf41539e0 con 0x7f9cdc003fe0 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.524+0000 7f9cf1ffb700 1 -- 172.21.15.84:0/4143129477 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec015430 con 0x7f9cdc003fe0 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.525+0000 7f9cfa870700 1 -- 172.21.15.84:0/4143129477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf4153fa0 con 0x7f9cdc003fe0 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.526+0000 7f9cfa870700 1 -- 172.21.15.84:0/4143129477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf405f270 con 0x7f9cdc003fe0 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.526+0000 7f9cf1ffb700 1 -- 172.21.15.84:0/4143129477 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cec0157a0 con 0x7f9cdc003fe0 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.526+0000 7f9cf1ffb700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.526+0000 7f9cf1ffb700 1 -- 172.21.15.84:0/4143129477 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9cec0854c0 con 0x7f9cdc003fe0 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.526+0000 7f9cf906d700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.527+0000 7f9cf906d700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9ce0066f30 0x7f9ce00693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8001ed0 tx=0x7f9ce8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:22.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.531+0000 7f9cf1ffb700 1 -- 172.21.15.84:0/4143129477 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cec055f20 con 0x7f9cdc003fe0 2023-10-06T03:25:22.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:22.755+0000 7f9cfa870700 1 -- 172.21.15.84:0/4143129477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9cf40cc640 con 0x7f9cdc003fe0 2023-10-06T03:25:23.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.747+0000 7f9cf1ffb700 1 -- 172.21.15.84:0/4143129477 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9cec055ab0 con 0x7f9cdc003fe0 2023-10-06T03:25:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 -- 172.21.15.84:0/4143129477 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9ce0066f30 msgr2=0x7f9ce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9ce0066f30 0x7f9ce00693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8001ed0 tx=0x7f9ce8015000 comp rx=0 tx=0).stop 2023-10-06T03:25:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 -- 172.21.15.84:0/4143129477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 msgr2=0x7f9cf4152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 0x7f9cf4152ef0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009fd0 tx=0x7f9cec00b040 comp rx=0 tx=0).stop 2023-10-06T03:25:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 -- 172.21.15.84:0/4143129477 shutdown_connections 2023-10-06T03:25:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c73c0 0x7f9cf40c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc003fe0 0x7f9cf4152ef0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 --2- 172.21.15.84:0/4143129477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf4169820 0x7f9cf40c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 -- 172.21.15.84:0/4143129477 >> 172.21.15.84:0/4143129477 conn(0x7f9cf4099560 msgr2=0x7f9cf40c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 -- 172.21.15.84:0/4143129477 shutdown_connections 2023-10-06T03:25:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.750+0000 7f9cfa870700 1 -- 172.21.15.84:0/4143129477 wait complete. 2023-10-06T03:25:23.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:25:23.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.882+0000 7f1064520700 1 Processor -- start 2023-10-06T03:25:23.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.882+0000 7f1064520700 1 -- start start 2023-10-06T03:25:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1064520700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f105c1598e0 0x7f105c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1064520700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c0cf610 con 0x7f105c0cbcb0 2023-10-06T03:25:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1064520700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c0cf8f0 con 0x7f105c159510 2023-10-06T03:25:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1064520700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c0cfbd0 con 0x7f105c1598e0 2023-10-06T03:25:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1062abd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f105c0cbcb0 0x7f105c0ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56566/0 (socket says 172.21.15.84:56566) 2023-10-06T03:25:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1062abd700 1 -- 172.21.15.84:0/3128272887 learned_addr learned my addr 172.21.15.84:0/3128272887 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1061abb700 1 --2- 172.21.15.84:0/3128272887 >> v2:172.21.15.131:3300/0 conn(0x7f105c1598e0 0x7f105c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251188395 0 0) 0x7f105c0cf610 con 0x7f105c0cbcb0 2023-10-06T03:25:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1048003570 con 0x7f105c0cbcb0 2023-10-06T03:25:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1794238665 0 0) 0x7f1048003570 con 0x7f105c0cbcb0 2023-10-06T03:25:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 >> v2:172.21.15.131:3300/0 conn(0x7f105c1598e0 msgr2=0x7f105c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 --2- 172.21.15.84:0/3128272887 >> v2:172.21.15.131:3300/0 conn(0x7f105c1598e0 0x7f105c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 >> v1:172.21.15.131:6789/0 conn(0x7f105c159510 legacy=0x7f105c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0cfeb0 con 0x7f105c0cbcb0 2023-10-06T03:25:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f1054001470 con 0x7f105c0cbcb0 2023-10-06T03:25:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 >> v1:172.21.15.84:6789/0 conn(0x7f105c0cbcb0 legacy=0x7f105c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1048003a60 0x7f1048003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f1048004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10480051c0 0x7f104800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0cfbd0 con 0x7f1048004810 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104800c0d0 con 0x7f1048003a60 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104800c290 con 0x7f10480051c0 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1061abb700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f1048004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f10622bc700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1048003a60 0x7f1048003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1062abd700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10480051c0 0x7f104800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1061abb700 1 -- 172.21.15.84:0/3128272887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10480051c0 msgr2=0x7f104800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:23.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1061abb700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10480051c0 0x7f104800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1061abb700 1 -- 172.21.15.84:0/3128272887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1048003a60 msgr2=0x7f1048003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:23.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1061abb700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1048003a60 0x7f1048003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1062abd700 1 -- 172.21.15.84:0/3128272887 reap_dead start 2023-10-06T03:25:23.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.884+0000 7f1061abb700 1 -- 172.21.15.84:0/3128272887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1048003570 con 0x7f1048004810 2023-10-06T03:25:23.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f1061abb700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f1048004c80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f105c0cad40 tx=0x7f104c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464e110e454c66c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:23.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c00e6e0 con 0x7f1048004810 2023-10-06T03:25:23.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c00e840 con 0x7f1048004810 2023-10-06T03:25:23.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f10612ba700 1 -- 172.21.15.84:0/3128272887 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c00ec00 con 0x7f1048004810 2023-10-06T03:25:23.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f1064520700 1 -- 172.21.15.84:0/3128272887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 msgr2=0x7f1048004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f1064520700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f1048004c80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f105c0cad40 tx=0x7f104c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f1064520700 1 -- 172.21.15.84:0/3128272887 shutdown_connections 2023-10-06T03:25:23.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f1064520700 1 --2- 172.21.15.84:0/3128272887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f1048004c80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f1064520700 1 -- 172.21.15.84:0/3128272887 >> 172.21.15.84:0/3128272887 conn(0x7f105c089e90 msgr2=0x7f105c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:23.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f1064520700 1 -- 172.21.15.84:0/3128272887 shutdown_connections 2023-10-06T03:25:23.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.885+0000 7f1064520700 1 -- 172.21.15.84:0/3128272887 wait complete. 2023-10-06T03:25:23.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.886+0000 7f1064520700 1 Processor -- start 2023-10-06T03:25:23.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.886+0000 7f1064520700 1 -- start start 2023-10-06T03:25:23.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f1064520700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f105c158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f1064520700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f105c169d20 0x7f105c16aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f1064520700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f105c0b4ca0 0x7f105c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f1064520700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c16acf0 con 0x7f1048004810 2023-10-06T03:25:23.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f1064520700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c16b410 con 0x7f105c169d20 2023-10-06T03:25:23.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f1064520700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0c8e20 con 0x7f105c0b4ca0 2023-10-06T03:25:23.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f10622bc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f105c158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f10622bc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f105c158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33292/0 (socket says 172.21.15.84:33292) 2023-10-06T03:25:23.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f10622bc700 1 -- 172.21.15.84:0/2923889057 learned_addr learned my addr 172.21.15.84:0/2923889057 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:23.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f1061abb700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f105c169d20 0x7f105c16aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f1062abd700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f105c0b4ca0 0x7f105c069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f10622bc700 1 -- 172.21.15.84:0/2923889057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f105c0b4ca0 msgr2=0x7f105c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f10622bc700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f105c0b4ca0 0x7f105c069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f10622bc700 1 -- 172.21.15.84:0/2923889057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f105c169d20 msgr2=0x7f105c16aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f10622bc700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f105c169d20 0x7f105c16aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.887+0000 7f10622bc700 1 -- 172.21.15.84:0/2923889057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c16a190 con 0x7f1048004810 2023-10-06T03:25:23.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.888+0000 7f10622bc700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f105c158590 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f105800eb90 tx=0x7f1058001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:23.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.888+0000 7f10527fc700 1 -- 172.21.15.84:0/2923889057 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800eea0 con 0x7f1048004810 2023-10-06T03:25:23.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.888+0000 7f10527fc700 1 -- 172.21.15.84:0/2923889057 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800c7e0 con 0x7f1048004810 2023-10-06T03:25:23.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.888+0000 7f1064520700 1 -- 172.21.15.84:0/2923889057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c0b5110 con 0x7f1048004810 2023-10-06T03:25:23.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.888+0000 7f10527fc700 1 -- 172.21.15.84:0/2923889057 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800cb60 con 0x7f1048004810 2023-10-06T03:25:23.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.888+0000 7f1064520700 1 -- 172.21.15.84:0/2923889057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c16a730 con 0x7f1048004810 2023-10-06T03:25:23.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.889+0000 7f1064520700 1 -- 172.21.15.84:0/2923889057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c0b6390 con 0x7f1048004810 2023-10-06T03:25:23.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.889+0000 7f10527fc700 1 -- 172.21.15.84:0/2923889057 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f105801f460 con 0x7f1048004810 2023-10-06T03:25:23.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.890+0000 7f10527fc700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1040066fb0 0x7f1040069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.890+0000 7f10527fc700 1 -- 172.21.15.84:0/2923889057 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1058084e70 con 0x7f1048004810 2023-10-06T03:25:23.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.890+0000 7f1061abb700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1040066fb0 0x7f1040069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.890+0000 7f1061abb700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1040066fb0 0x7f1040069460 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f105c0cad40 tx=0x7f104c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:23.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:23.895+0000 7f10527fc700 1 -- 172.21.15.84:0/2923889057 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1058051da0 con 0x7f1048004810 2023-10-06T03:25:24.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.119+0000 7f1064520700 1 -- 172.21.15.84:0/2923889057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f105c064ad0 con 0x7f1048004810 2023-10-06T03:25:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.749+0000 7f10527fc700 1 -- 172.21.15.84:0/2923889057 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f10580553c0 con 0x7f1048004810 2023-10-06T03:25:24.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.751+0000 7f1064520700 1 -- 172.21.15.84:0/2923889057 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1040066fb0 msgr2=0x7f1040069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.751+0000 7f1064520700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1040066fb0 0x7f1040069460 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f105c0cad40 tx=0x7f104c01a000 comp rx=0 tx=0).stop 2023-10-06T03:25:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.751+0000 7f1064520700 1 -- 172.21.15.84:0/2923889057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 msgr2=0x7f105c158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.751+0000 7f1064520700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f105c158590 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f105800eb90 tx=0x7f1058001640 comp rx=0 tx=0).stop 2023-10-06T03:25:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.752+0000 7f1064520700 1 -- 172.21.15.84:0/2923889057 shutdown_connections 2023-10-06T03:25:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.752+0000 7f1064520700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1040066fb0 0x7f1040069460 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.752+0000 7f1064520700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f105c0b4ca0 0x7f105c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.752+0000 7f1064520700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1048004810 0x7f105c158590 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.752+0000 7f1064520700 1 --2- 172.21.15.84:0/2923889057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f105c169d20 0x7f105c16aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.752+0000 7f1064520700 1 -- 172.21.15.84:0/2923889057 >> 172.21.15.84:0/2923889057 conn(0x7f105c089e90 msgr2=0x7f105c1544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.752+0000 7f1064520700 1 -- 172.21.15.84:0/2923889057 shutdown_connections 2023-10-06T03:25:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.752+0000 7f1064520700 1 -- 172.21.15.84:0/2923889057 wait complete. 2023-10-06T03:25:24.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:24.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.879+0000 7f8f35e72700 1 Processor -- start 2023-10-06T03:25:24.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.879+0000 7f8f35e72700 1 -- start start 2023-10-06T03:25:24.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.879+0000 7f8f35e72700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8f30069c70 0x7f8f300c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.879+0000 7f8f35e72700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f300c7370 con 0x7f8f300ac040 2023-10-06T03:25:24.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.879+0000 7f8f35e72700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f300c6760 con 0x7f8f300adf60 2023-10-06T03:25:24.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.879+0000 7f8f35e72700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f30156150 con 0x7f8f30069c70 2023-10-06T03:25:24.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.880+0000 7f8f2ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8f30069c70 0x7f8f300c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.880+0000 7f8f2effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8f300ac040 0x7f8f30069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56572/0 (socket says 172.21.15.84:56572) 2023-10-06T03:25:24.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.880+0000 7f8f2effd700 1 -- 172.21.15.84:0/416311273 learned_addr learned my addr 172.21.15.84:0/416311273 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:24.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.880+0000 7f8f2ffff700 1 -- 172.21.15.84:0/416311273 >> v1:172.21.15.131:6789/0 conn(0x7f8f300adf60 legacy=0x7f8f3006e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.880+0000 7f8f2ffff700 1 -- 172.21.15.84:0/416311273 >> v1:172.21.15.84:6789/0 conn(0x7f8f300ac040 legacy=0x7f8f30069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.880+0000 7f8f2ffff700 1 -- 172.21.15.84:0/416311273 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f300c6a40 con 0x7f8f30069c70 2023-10-06T03:25:24.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.880+0000 7f8f2ffff700 1 --2- 172.21.15.84:0/416311273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f30069c70 0x7f8f300c7800 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8f280098e0 tx=0x7f8f280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b7f3a572dad9c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.880+0000 7f8f2e7fc700 1 -- 172.21.15.84:0/416311273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28009e80 con 0x7f8f30069c70 2023-10-06T03:25:24.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.880+0000 7f8f2e7fc700 1 -- 172.21.15.84:0/416311273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2800b860 con 0x7f8f30069c70 2023-10-06T03:25:24.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.880+0000 7f8f2e7fc700 1 -- 172.21.15.84:0/416311273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800bbe0 con 0x7f8f30069c70 2023-10-06T03:25:24.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.881+0000 7f8f35e72700 1 -- 172.21.15.84:0/416311273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f30069c70 msgr2=0x7f8f300c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.881+0000 7f8f35e72700 1 --2- 172.21.15.84:0/416311273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f30069c70 0x7f8f300c7800 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8f280098e0 tx=0x7f8f280091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.881+0000 7f8f35e72700 1 -- 172.21.15.84:0/416311273 shutdown_connections 2023-10-06T03:25:24.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.881+0000 7f8f35e72700 1 --2- 172.21.15.84:0/416311273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f30069c70 0x7f8f300c7800 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.881+0000 7f8f35e72700 1 -- 172.21.15.84:0/416311273 >> 172.21.15.84:0/416311273 conn(0x7f8f300680c0 msgr2=0x7f8f300cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:24.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.881+0000 7f8f35e72700 1 -- 172.21.15.84:0/416311273 shutdown_connections 2023-10-06T03:25:24.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.881+0000 7f8f35e72700 1 -- 172.21.15.84:0/416311273 wait complete. 2023-10-06T03:25:24.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.882+0000 7f8f35e72700 1 Processor -- start 2023-10-06T03:25:24.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.882+0000 7f8f35e72700 1 -- start start 2023-10-06T03:25:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f35e72700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f30069c70 0x7f8f3014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f35e72700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ac040 0x7f8f301571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f35e72700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f300adf60 0x7f8f300b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f35e72700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300c2bf0 con 0x7f8f300ac040 2023-10-06T03:25:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f35e72700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3014aae0 con 0x7f8f300adf60 2023-10-06T03:25:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f35e72700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f301576e0 con 0x7f8f30069c70 2023-10-06T03:25:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f2effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ac040 0x7f8f301571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f2effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ac040 0x7f8f301571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33312/0 (socket says 172.21.15.84:33312) 2023-10-06T03:25:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f2effd700 1 -- 172.21.15.84:0/3797055044 learned_addr learned my addr 172.21.15.84:0/3797055044 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f2effd700 1 -- 172.21.15.84:0/3797055044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f30069c70 msgr2=0x7f8f3014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f2effd700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f30069c70 0x7f8f3014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f2effd700 1 -- 172.21.15.84:0/3797055044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f300adf60 msgr2=0x7f8f300b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f2effd700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f300adf60 0x7f8f300b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f2effd700 1 -- 172.21.15.84:0/3797055044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f28009420 con 0x7f8f300ac040 2023-10-06T03:25:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f2effd700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ac040 0x7f8f301571a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400c7f0 tx=0x7f8f24007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f177fe700 1 -- 172.21.15.84:0/3797055044 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24005b30 con 0x7f8f300ac040 2023-10-06T03:25:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f177fe700 1 -- 172.21.15.84:0/3797055044 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24005cb0 con 0x7f8f300ac040 2023-10-06T03:25:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f177fe700 1 -- 172.21.15.84:0/3797055044 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24004a80 con 0x7f8f300ac040 2023-10-06T03:25:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f35e72700 1 -- 172.21.15.84:0/3797055044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f300c1f70 con 0x7f8f300ac040 2023-10-06T03:25:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.883+0000 7f8f35e72700 1 -- 172.21.15.84:0/3797055044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f300c2530 con 0x7f8f300ac040 2023-10-06T03:25:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.884+0000 7f8f35e72700 1 -- 172.21.15.84:0/3797055044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f30064ad0 con 0x7f8f300ac040 2023-10-06T03:25:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.885+0000 7f8f177fe700 1 -- 172.21.15.84:0/3797055044 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f240070f0 con 0x7f8f300ac040 2023-10-06T03:25:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.885+0000 7f8f177fe700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8f1c066f30 0x7f8f1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.885+0000 7f8f2f7fe700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8f1c066f30 0x7f8f1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.885+0000 7f8f177fe700 1 -- 172.21.15.84:0/3797055044 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8f24083c10 con 0x7f8f300ac040 2023-10-06T03:25:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.886+0000 7f8f2f7fe700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8f1c066f30 0x7f8f1c0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8f20001cf0 tx=0x7f8f20007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:24.889+0000 7f8f177fe700 1 -- 172.21.15.84:0/3797055044 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f24050c60 con 0x7f8f300ac040 2023-10-06T03:25:25.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.113+0000 7f8f35e72700 1 -- 172.21.15.84:0/3797055044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f300c6d20 con 0x7f8f300ac040 2023-10-06T03:25:25.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.114+0000 7f8f177fe700 1 -- 172.21.15.84:0/3797055044 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f8f24018070 con 0x7f8f300ac040 2023-10-06T03:25:25.115 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:25.115 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3103408955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3103408955},{"type":"v1","addr":"172.21.15.131:6834","nonce":3103408955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3982920665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3982920665},{"type":"v1","addr":"172.21.15.131:6835","nonce":3982920665}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1537563341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1537563341},{"type":"v1","addr":"172.21.15.84:6836","nonce":1537563341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:21.111306+0000","modified":"2023-10-06T03:25:24.747627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5526":{"gid":5526,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3473748806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3473748806},{"type":"v1","addr":"172.21.15.84:6837","nonce":3473748806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:25:25.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 -- 172.21.15.84:0/3797055044 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8f1c066f30 msgr2=0x7f8f1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8f1c066f30 0x7f8f1c0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8f20001cf0 tx=0x7f8f20007ec0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 -- 172.21.15.84:0/3797055044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ac040 msgr2=0x7f8f301571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ac040 0x7f8f301571a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400c7f0 tx=0x7f8f24007f70 comp rx=0 tx=0).stop 2023-10-06T03:25:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 -- 172.21.15.84:0/3797055044 shutdown_connections 2023-10-06T03:25:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8f1c066f30 0x7f8f1c0693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f300adf60 0x7f8f300b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f30069c70 0x7f8f3014a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 --2- 172.21.15.84:0/3797055044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ac040 0x7f8f301571a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 -- 172.21.15.84:0/3797055044 >> 172.21.15.84:0/3797055044 conn(0x7f8f300680c0 msgr2=0x7f8f300c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 -- 172.21.15.84:0/3797055044 shutdown_connections 2023-10-06T03:25:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.116+0000 7f8f35e72700 1 -- 172.21.15.84:0/3797055044 wait complete. 2023-10-06T03:25:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2023-10-06T03:25:25.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:25.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.242+0000 7f06df55a700 1 Processor -- start 2023-10-06T03:25:25.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.242+0000 7f06df55a700 1 -- start start 2023-10-06T03:25:25.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06df55a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d80b49e0 0x7f06d80aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06df55a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d80b0ca0 con 0x7f06d80b07a0 2023-10-06T03:25:25.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06df55a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d80b0f80 con 0x7f06d81595a0 2023-10-06T03:25:25.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06df55a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80b1260 con 0x7f06d80b49e0 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06ddaf7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f06d80b07a0 0x7f06d80b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56576/0 (socket says 172.21.15.84:56576) 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06ddaf7700 1 -- 172.21.15.84:0/1615719518 learned_addr learned my addr 172.21.15.84:0/1615719518 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06dcaf5700 1 --2- 172.21.15.84:0/1615719518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d80b49e0 0x7f06d80aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06d7fff700 1 -- 172.21.15.84:0/1615719518 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834203836 0 0) 0x7f06d80b0ca0 con 0x7f06d80b07a0 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06d7fff700 1 -- 172.21.15.84:0/1615719518 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c0003570 con 0x7f06d80b07a0 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06d7fff700 1 -- 172.21.15.84:0/1615719518 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809166643 0 0) 0x7f06d80b0f80 con 0x7f06d81595a0 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06d7fff700 1 -- 172.21.15.84:0/1615719518 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06d80b0ca0 con 0x7f06d81595a0 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06d7fff700 1 -- 172.21.15.84:0/1615719518 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4018573189 0 0) 0x7f06c0003570 con 0x7f06d80b07a0 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06dcaf5700 1 -- 172.21.15.84:0/1615719518 >> v1:172.21.15.131:6789/0 conn(0x7f06d81595a0 legacy=0x7f06d80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06dcaf5700 1 -- 172.21.15.84:0/1615719518 >> v1:172.21.15.84:6789/0 conn(0x7f06d80b07a0 legacy=0x7f06d80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.243+0000 7f06dcaf5700 1 -- 172.21.15.84:0/1615719518 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80b1540 con 0x7f06d80b49e0 2023-10-06T03:25:25.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06dcaf5700 1 --2- 172.21.15.84:0/1615719518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d80b49e0 0x7f06d80aac80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009910 tx=0x7f06cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f0eb9ff6370da0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06d7fff700 1 -- 172.21.15.84:0/1615719518 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8001470 con 0x7f06d80b49e0 2023-10-06T03:25:25.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06d7fff700 1 -- 172.21.15.84:0/1615719518 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc011420 con 0x7f06d80b49e0 2023-10-06T03:25:25.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06d7fff700 1 -- 172.21.15.84:0/1615719518 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0117a0 con 0x7f06d80b49e0 2023-10-06T03:25:25.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06df55a700 1 -- 172.21.15.84:0/1615719518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d80b49e0 msgr2=0x7f06d80aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06df55a700 1 --2- 172.21.15.84:0/1615719518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d80b49e0 0x7f06d80aac80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009910 tx=0x7f06cc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06df55a700 1 -- 172.21.15.84:0/1615719518 shutdown_connections 2023-10-06T03:25:25.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06df55a700 1 --2- 172.21.15.84:0/1615719518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d80b49e0 0x7f06d80aac80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06df55a700 1 -- 172.21.15.84:0/1615719518 >> 172.21.15.84:0/1615719518 conn(0x7f06d8099830 msgr2=0x7f06d806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06df55a700 1 -- 172.21.15.84:0/1615719518 shutdown_connections 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.244+0000 7f06df55a700 1 -- 172.21.15.84:0/1615719518 wait complete. 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.245+0000 7f06df55a700 1 Processor -- start 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.245+0000 7f06df55a700 1 -- start start 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.246+0000 7f06df55a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d80b07a0 0x7f06d8157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.246+0000 7f06df55a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06d80b49e0 0x7f06d80ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.246+0000 7f06df55a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d81595a0 0x7f06d815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.246+0000 7f06df55a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80ac130 con 0x7f06d80b07a0 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.246+0000 7f06df55a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80ac520 con 0x7f06d80b49e0 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.246+0000 7f06df55a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d809a2e0 con 0x7f06d81595a0 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.246+0000 7f06dd2f6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d80b07a0 0x7f06d8157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.246+0000 7f06dd2f6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d80b07a0 0x7f06d8157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33318/0 (socket says 172.21.15.84:33318) 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.246+0000 7f06dd2f6700 1 -- 172.21.15.84:0/3095730516 learned_addr learned my addr 172.21.15.84:0/3095730516 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06dcaf5700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06d80b49e0 0x7f06d80ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06ddaf7700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d81595a0 0x7f06d815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06dd2f6700 1 -- 172.21.15.84:0/3095730516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d81595a0 msgr2=0x7f06d815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06dd2f6700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d81595a0 0x7f06d815b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06dd2f6700 1 -- 172.21.15.84:0/3095730516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06d80b49e0 msgr2=0x7f06d80ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06dd2f6700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06d80b49e0 0x7f06d80ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06dd2f6700 1 -- 172.21.15.84:0/3095730516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc009420 con 0x7f06d80b07a0 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06dcaf5700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06d80b49e0 0x7f06d80ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06dd2f6700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d80b07a0 0x7f06d8157da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f06d000cd30 tx=0x7f06d0002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06d57fa700 1 -- 172.21.15.84:0/3095730516 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000ab70 con 0x7f06d80b07a0 2023-10-06T03:25:25.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06d57fa700 1 -- 172.21.15.84:0/3095730516 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000acd0 con 0x7f06d80b07a0 2023-10-06T03:25:25.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06df55a700 1 -- 172.21.15.84:0/3095730516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d80ab240 con 0x7f06d80b07a0 2023-10-06T03:25:25.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06d57fa700 1 -- 172.21.15.84:0/3095730516 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0012650 con 0x7f06d80b07a0 2023-10-06T03:25:25.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.247+0000 7f06df55a700 1 -- 172.21.15.84:0/3095730516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d80ab800 con 0x7f06d80b07a0 2023-10-06T03:25:25.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.248+0000 7f06df55a700 1 -- 172.21.15.84:0/3095730516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d8064ad0 con 0x7f06d80b07a0 2023-10-06T03:25:25.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.248+0000 7f06d57fa700 1 -- 172.21.15.84:0/3095730516 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06d0012a00 con 0x7f06d80b07a0 2023-10-06T03:25:25.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.249+0000 7f06d57fa700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.249+0000 7f06d57fa700 1 -- 172.21.15.84:0/3095730516 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f06d0084f70 con 0x7f06d80b07a0 2023-10-06T03:25:25.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.249+0000 7f06dcaf5700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.249+0000 7f06dcaf5700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f06c4066f30 0x7f06c40693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009860 tx=0x7f06cc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.253+0000 7f06d57fa700 1 -- 172.21.15.84:0/3095730516 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06d0051f40 con 0x7f06d80b07a0 2023-10-06T03:25:25.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.436+0000 7f06df55a700 1 -- 172.21.15.84:0/3095730516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06d80b1820 con 0x7f06d80b07a0 2023-10-06T03:25:25.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.437+0000 7f06d57fa700 1 -- 172.21.15.84:0/3095730516 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f06d0012cb0 con 0x7f06d80b07a0 2023-10-06T03:25:25.438 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:25.438 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":50,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:22.337746+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:18.741959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:20.079553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:25.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 -- 172.21.15.84:0/3095730516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f06c4066f30 msgr2=0x7f06c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f06c4066f30 0x7f06c40693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009860 tx=0x7f06cc016000 comp rx=0 tx=0).stop 2023-10-06T03:25:25.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 -- 172.21.15.84:0/3095730516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d80b07a0 msgr2=0x7f06d8157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d80b07a0 0x7f06d8157da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f06d000cd30 tx=0x7f06d0002b90 comp rx=0 tx=0).stop 2023-10-06T03:25:25.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 -- 172.21.15.84:0/3095730516 shutdown_connections 2023-10-06T03:25:25.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06d81595a0 0x7f06d815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d80b07a0 0x7f06d8157da0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 --2- 172.21.15.84:0/3095730516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06d80b49e0 0x7f06d80ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 -- 172.21.15.84:0/3095730516 >> 172.21.15.84:0/3095730516 conn(0x7f06d8099830 msgr2=0x7f06d80b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 -- 172.21.15.84:0/3095730516 shutdown_connections 2023-10-06T03:25:25.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.439+0000 7f06df55a700 1 -- 172.21.15.84:0/3095730516 wait complete. 2023-10-06T03:25:25.452 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:25:25.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:25:25.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.566+0000 7f25056dd700 1 Processor -- start 2023-10-06T03:25:25.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.566+0000 7f25056dd700 1 -- start start 2023-10-06T03:25:25.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.567+0000 7f25056dd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25000b2850 0x7f25000cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.567+0000 7f25056dd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25000cb7e0 con 0x7f25000cbc70 2023-10-06T03:25:25.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.567+0000 7f25056dd700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25000b08a0 con 0x7f2500159480 2023-10-06T03:25:25.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.567+0000 7f25056dd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000cb190 con 0x7f25000b2850 2023-10-06T03:25:25.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.567+0000 7f24ff7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f25000cbc70 0x7f25000b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56580/0 (socket says 172.21.15.84:56580) 2023-10-06T03:25:25.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.567+0000 7f24ff7fe700 1 -- 172.21.15.84:0/2148063084 learned_addr learned my addr 172.21.15.84:0/2148063084 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:25.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.567+0000 7f2504edc700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25000b2850 0x7f25000cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.567+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169833535 0 0) 0x7f25000cb7e0 con 0x7f25000cbc70 2023-10-06T03:25:25.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.567+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e8003570 con 0x7f25000cbc70 2023-10-06T03:25:25.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1678802427 0 0) 0x7f24e8003570 con 0x7f25000cbc70 2023-10-06T03:25:25.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25000b2850 msgr2=0x7f25000cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25000b2850 0x7f25000cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 >> v1:172.21.15.131:6789/0 conn(0x7f2500159480 legacy=0x7f25000b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000cb470 con 0x7f25000cbc70 2023-10-06T03:25:25.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f24f4001470 con 0x7f25000cbc70 2023-10-06T03:25:25.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 >> v1:172.21.15.84:6789/0 conn(0x7f25000cbc70 legacy=0x7f25000b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25000b2850 0x7f24e8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 0x7f24e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24e8004d50 0x7f24e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000cb190 con 0x7f24e8004010 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e800bbf0 con 0x7f24e8004d50 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e800bdb0 con 0x7f25000b2850 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24ff7fe700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 0x7f24e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24fffff700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25000b2850 0x7f24e8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f2504edc700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24e8004d50 0x7f24e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24ff7fe700 1 -- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25000b2850 msgr2=0x7f24e8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24ff7fe700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25000b2850 0x7f24e8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24ff7fe700 1 -- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24e8004d50 msgr2=0x7f24e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24ff7fe700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24e8004d50 0x7f24e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24ff7fe700 1 -- 172.21.15.84:0/2148063084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e8003570 con 0x7f24e8004010 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24fffff700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25000b2850 0x7f24e8003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f2504edc700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24e8004d50 0x7f24e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24ff7fe700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 0x7f24e8004810 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f24f400c390 tx=0x7f24f4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2adfd220eeddd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400cc60 con 0x7f24e8004010 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f400cdc0 con 0x7f24e8004010 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.568+0000 7f24feffd700 1 -- 172.21.15.84:0/2148063084 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f4005b50 con 0x7f24e8004010 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.569+0000 7f25056dd700 1 -- 172.21.15.84:0/2148063084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 msgr2=0x7f24e8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.569+0000 7f25056dd700 1 --2- 172.21.15.84:0/2148063084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 0x7f24e8004810 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f24f400c390 tx=0x7f24f4001e50 comp rx=0 tx=0).stop 2023-10-06T03:25:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.569+0000 7f2504edc700 1 -- 172.21.15.84:0/2148063084 reap_dead start 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.569+0000 7f25056dd700 1 -- 172.21.15.84:0/2148063084 shutdown_connections 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.569+0000 7f25056dd700 1 -- 172.21.15.84:0/2148063084 >> 172.21.15.84:0/2148063084 conn(0x7f250006ed20 msgr2=0x7f250006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.569+0000 7f25056dd700 1 -- 172.21.15.84:0/2148063084 shutdown_connections 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.569+0000 7f25056dd700 1 -- 172.21.15.84:0/2148063084 wait complete. 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.570+0000 7f25056dd700 1 Processor -- start 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.570+0000 7f25056dd700 1 -- start start 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f25056dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 0x7f25000cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f25056dd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f250015c1e0 0x7f25000d0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f25056dd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25000cf840 0x7f2500154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f25056dd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000cf3b0 con 0x7f24e8004010 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f25056dd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000ce7a0 con 0x7f25000cf840 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f25056dd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000cea80 con 0x7f250015c1e0 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24fffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 0x7f25000cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24fffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 0x7f25000cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33334/0 (socket says 172.21.15.84:33334) 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24fffff700 1 -- 172.21.15.84:0/364784632 learned_addr learned my addr 172.21.15.84:0/364784632 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f2504edc700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25000cf840 0x7f2500154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24fffff700 1 -- 172.21.15.84:0/364784632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f250015c1e0 msgr2=0x7f25000d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24fffff700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f250015c1e0 0x7f25000d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24fffff700 1 -- 172.21.15.84:0/364784632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25000cf840 msgr2=0x7f2500154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24fffff700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25000cf840 0x7f2500154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24fffff700 1 -- 172.21.15.84:0/364784632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000ced60 con 0x7f24e8004010 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24fffff700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 0x7f25000cde30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f24f000e840 tx=0x7f24f0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24e7fff700 1 -- 172.21.15.84:0/364784632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0017070 con 0x7f24e8004010 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f24e7fff700 1 -- 172.21.15.84:0/364784632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f0006820 con 0x7f24e8004010 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.571+0000 7f25056dd700 1 -- 172.21.15.84:0/364784632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25000cf040 con 0x7f24e8004010 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.572+0000 7f24e7fff700 1 -- 172.21.15.84:0/364784632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0006c00 con 0x7f24e8004010 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.572+0000 7f25056dd700 1 -- 172.21.15.84:0/364784632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25000d0da0 con 0x7f24e8004010 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.573+0000 7f25056dd700 1 -- 172.21.15.84:0/364784632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25000d0f90 con 0x7f24e8004010 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.573+0000 7f24e7fff700 1 -- 172.21.15.84:0/364784632 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24f0007230 con 0x7f24e8004010 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.573+0000 7f24e7fff700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f24ec066f30 0x7f24ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.573+0000 7f24e7fff700 1 -- 172.21.15.84:0/364784632 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f24f00843c0 con 0x7f24e8004010 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.573+0000 7f24ff7fe700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f24ec066f30 0x7f24ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.574+0000 7f24ff7fe700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f24ec066f30 0x7f24ec0693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f25000ca560 tx=0x7f24f4015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.578+0000 7f24e7fff700 1 -- 172.21.15.84:0/364784632 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24f0051390 con 0x7f24e8004010 2023-10-06T03:25:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.759+0000 7f25056dd700 1 -- 172.21.15.84:0/364784632 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25000cf4f0 con 0x7f24ec066f30 2023-10-06T03:25:25.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.768+0000 7f24e7fff700 1 -- 172.21.15.84:0/364784632 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311288 (secure 0 0 0) 0x7f24f400c9b0 con 0x7f24ec066f30 2023-10-06T03:25:25.772 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:25.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 -- 172.21.15.84:0/364784632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f24ec066f30 msgr2=0x7f24ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f24ec066f30 0x7f24ec0693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f25000ca560 tx=0x7f24f4015000 comp rx=0 tx=0).stop 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 -- 172.21.15.84:0/364784632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 msgr2=0x7f25000cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 0x7f25000cde30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f24f000e840 tx=0x7f24f0009040 comp rx=0 tx=0).stop 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 -- 172.21.15.84:0/364784632 shutdown_connections 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f24ec066f30 0x7f24ec0693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25000cf840 0x7f2500154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8004010 0x7f25000cde30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 --2- 172.21.15.84:0/364784632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f250015c1e0 0x7f25000d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 -- 172.21.15.84:0/364784632 >> 172.21.15.84:0/364784632 conn(0x7f250006ed20 msgr2=0x7f2500155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 -- 172.21.15.84:0/364784632 shutdown_connections 2023-10-06T03:25:25.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.771+0000 7f25056dd700 1 -- 172.21.15.84:0/364784632 wait complete. 2023-10-06T03:25:25.776 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:25:25.783 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-06T03:25:25.060690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384096,"kb_used_data":5792,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590624,"statfs":{"total":773094113280,"available":770652798976,"internally_reserved":0,"allocated":5931008,"data_stored":3327502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.342051"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.349517+0000","last_change":"2023-10-06T03:25:21.349517+0000","last_active":"2023-10-06T03:25:21.349517+0000","last_peered":"2023-10-06T03:25:21.349517+0000","last_clean":"2023-10-06T03:25:21.349517+0000","last_became_active":"2023-10-06T03:25:21.349263+0000","last_became_peered":"2023-10-06T03:25:21.349263+0000","last_unstale":"2023-10-06T03:25:21.349517+0000","last_undegraded":"2023-10-06T03:25:21.349517+0000","last_fullsized":"2023-10-06T03:25:21.349517+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:02.512702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357832+0000","last_change":"2023-10-06T03:25:21.354552+0000","last_active":"2023-10-06T03:25:21.357832+0000","last_peered":"2023-10-06T03:25:21.357832+0000","last_clean":"2023-10-06T03:25:21.357832+0000","last_became_active":"2023-10-06T03:25:21.354308+0000","last_became_peered":"2023-10-06T03:25:21.354308+0000","last_unstale":"2023-10-06T03:25:21.357832+0000","last_undegraded":"2023-10-06T03:25:21.357832+0000","last_fullsized":"2023-10-06T03:25:21.357832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:53.114728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.368877+0000","last_change":"2023-10-06T03:25:21.362461+0000","last_active":"2023-10-06T03:25:21.368877+0000","last_peered":"2023-10-06T03:25:21.368877+0000","last_clean":"2023-10-06T03:25:21.368877+0000","last_became_active":"2023-10-06T03:25:21.362193+0000","last_became_peered":"2023-10-06T03:25:21.362193+0000","last_unstale":"2023-10-06T03:25:21.368877+0000","last_undegraded":"2023-10-06T03:25:21.368877+0000","last_fullsized":"2023-10-06T03:25:21.368877+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.559930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.360758+0000","last_change":"2023-10-06T03:25:21.360758+0000","last_active":"2023-10-06T03:25:21.360758+0000","last_peered":"2023-10-06T03:25:21.360758+0000","last_clean":"2023-10-06T03:25:21.360758+0000","last_became_active":"2023-10-06T03:25:21.360566+0000","last_became_peered":"2023-10-06T03:25:21.360566+0000","last_unstale":"2023-10-06T03:25:21.360758+0000","last_undegraded":"2023-10-06T03:25:21.360758+0000","last_fullsized":"2023-10-06T03:25:21.360758+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:11.569466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357530+0000","last_change":"2023-10-06T03:25:21.357530+0000","last_active":"2023-10-06T03:25:21.357530+0000","last_peered":"2023-10-06T03:25:21.357530+0000","last_clean":"2023-10-06T03:25:21.357530+0000","last_became_active":"2023-10-06T03:25:21.357139+0000","last_became_peered":"2023-10-06T03:25:21.357139+0000","last_unstale":"2023-10-06T03:25:21.357530+0000","last_undegraded":"2023-10-06T03:25:21.357530+0000","last_fullsized":"2023-10-06T03:25:21.357530+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:41.144266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.347707+0000","last_change":"2023-10-06T03:25:21.347707+0000","last_active":"2023-10-06T03:25:21.347707+0000","last_peered":"2023-10-06T03:25:21.347707+0000","last_clean":"2023-10-06T03:25:21.347707+0000","last_became_active":"2023-10-06T03:25:21.347466+0000","last_became_peered":"2023-10-06T03:25:21.347466+0000","last_unstale":"2023-10-06T03:25:21.347707+0000","last_undegraded":"2023-10-06T03:25:21.347707+0000","last_fullsized":"2023-10-06T03:25:21.347707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:42.094179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.364013+0000","last_change":"2023-10-06T03:25:21.357272+0000","last_active":"2023-10-06T03:25:21.364013+0000","last_peered":"2023-10-06T03:25:21.364013+0000","last_clean":"2023-10-06T03:25:21.364013+0000","last_became_active":"2023-10-06T03:25:21.356972+0000","last_became_peered":"2023-10-06T03:25:21.356972+0000","last_unstale":"2023-10-06T03:25:21.364013+0000","last_undegraded":"2023-10-06T03:25:21.364013+0000","last_fullsized":"2023-10-06T03:25:21.364013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:42.094179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.368068+0000","last_change":"2023-10-06T03:25:21.362719+0000","last_active":"2023-10-06T03:25:21.368068+0000","last_peered":"2023-10-06T03:25:21.368068+0000","last_clean":"2023-10-06T03:25:21.368068+0000","last_became_active":"2023-10-06T03:25:21.362469+0000","last_became_peered":"2023-10-06T03:25:21.362469+0000","last_unstale":"2023-10-06T03:25:21.368068+0000","last_undegraded":"2023-10-06T03:25:21.368068+0000","last_fullsized":"2023-10-06T03:25:21.368068+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:21.078598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.363920+0000","last_change":"2023-10-06T03:25:21.355929+0000","last_active":"2023-10-06T03:25:21.363920+0000","last_peered":"2023-10-06T03:25:21.363920+0000","last_clean":"2023-10-06T03:25:21.363920+0000","last_became_active":"2023-10-06T03:25:21.355639+0000","last_became_peered":"2023-10-06T03:25:21.355639+0000","last_unstale":"2023-10-06T03:25:21.363920+0000","last_undegraded":"2023-10-06T03:25:21.363920+0000","last_fullsized":"2023-10-06T03:25:21.363920+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:30.136486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.351044+0000","last_change":"2023-10-06T03:25:21.351044+0000","last_active":"2023-10-06T03:25:21.351044+0000","last_peered":"2023-10-06T03:25:21.351044+0000","last_clean":"2023-10-06T03:25:21.351044+0000","last_became_active":"2023-10-06T03:25:21.350789+0000","last_became_peered":"2023-10-06T03:25:21.350789+0000","last_unstale":"2023-10-06T03:25:21.351044+0000","last_undegraded":"2023-10-06T03:25:21.351044+0000","last_fullsized":"2023-10-06T03:25:21.351044+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:28.535460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.352168+0000","last_change":"2023-10-06T03:25:21.352168+0000","last_active":"2023-10-06T03:25:21.352168+0000","last_peered":"2023-10-06T03:25:21.352168+0000","last_clean":"2023-10-06T03:25:21.352168+0000","last_became_active":"2023-10-06T03:25:21.351910+0000","last_became_peered":"2023-10-06T03:25:21.351910+0000","last_unstale":"2023-10-06T03:25:21.352168+0000","last_undegraded":"2023-10-06T03:25:21.352168+0000","last_fullsized":"2023-10-06T03:25:21.352168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:49.528962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359513+0000","last_change":"2023-10-06T03:25:21.359513+0000","last_active":"2023-10-06T03:25:21.359513+0000","last_peered":"2023-10-06T03:25:21.359513+0000","last_clean":"2023-10-06T03:25:21.359513+0000","last_became_active":"2023-10-06T03:25:21.359214+0000","last_became_peered":"2023-10-06T03:25:21.359214+0000","last_unstale":"2023-10-06T03:25:21.359513+0000","last_undegraded":"2023-10-06T03:25:21.359513+0000","last_fullsized":"2023-10-06T03:25:21.359513+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:55.021449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358671+0000","last_change":"2023-10-06T03:25:21.354844+0000","last_active":"2023-10-06T03:25:21.358671+0000","last_peered":"2023-10-06T03:25:21.358671+0000","last_clean":"2023-10-06T03:25:21.358671+0000","last_became_active":"2023-10-06T03:25:21.354554+0000","last_became_peered":"2023-10-06T03:25:21.354554+0000","last_unstale":"2023-10-06T03:25:21.358671+0000","last_undegraded":"2023-10-06T03:25:21.358671+0000","last_fullsized":"2023-10-06T03:25:21.358671+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.988433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.363976+0000","last_change":"2023-10-06T03:25:21.355953+0000","last_active":"2023-10-06T03:25:21.363976+0000","last_peered":"2023-10-06T03:25:21.363976+0000","last_clean":"2023-10-06T03:25:21.363976+0000","last_became_active":"2023-10-06T03:25:21.355658+0000","last_became_peered":"2023-10-06T03:25:21.355658+0000","last_unstale":"2023-10-06T03:25:21.363976+0000","last_undegraded":"2023-10-06T03:25:21.363976+0000","last_fullsized":"2023-10-06T03:25:21.363976+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:16.145387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.363882+0000","last_change":"2023-10-06T03:25:21.354619+0000","last_active":"2023-10-06T03:25:21.363882+0000","last_peered":"2023-10-06T03:25:21.363882+0000","last_clean":"2023-10-06T03:25:21.363882+0000","last_became_active":"2023-10-06T03:25:21.354343+0000","last_became_peered":"2023-10-06T03:25:21.354343+0000","last_unstale":"2023-10-06T03:25:21.363882+0000","last_undegraded":"2023-10-06T03:25:21.363882+0000","last_fullsized":"2023-10-06T03:25:21.363882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:52.441557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.349606+0000","last_change":"2023-10-06T03:25:21.349606+0000","last_active":"2023-10-06T03:25:21.349606+0000","last_peered":"2023-10-06T03:25:21.349606+0000","last_clean":"2023-10-06T03:25:21.349606+0000","last_became_active":"2023-10-06T03:25:21.349350+0000","last_became_peered":"2023-10-06T03:25:21.349350+0000","last_unstale":"2023-10-06T03:25:21.349606+0000","last_undegraded":"2023-10-06T03:25:21.349606+0000","last_fullsized":"2023-10-06T03:25:21.349606+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:40.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357748+0000","last_change":"2023-10-06T03:25:21.354628+0000","last_active":"2023-10-06T03:25:21.357748+0000","last_peered":"2023-10-06T03:25:21.357748+0000","last_clean":"2023-10-06T03:25:21.357748+0000","last_became_active":"2023-10-06T03:25:21.354348+0000","last_became_peered":"2023-10-06T03:25:21.354348+0000","last_unstale":"2023-10-06T03:25:21.357748+0000","last_undegraded":"2023-10-06T03:25:21.357748+0000","last_fullsized":"2023-10-06T03:25:21.357748+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:07.236477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.355362+0000","last_change":"2023-10-06T03:25:21.352064+0000","last_active":"2023-10-06T03:25:21.355362+0000","last_peered":"2023-10-06T03:25:21.355362+0000","last_clean":"2023-10-06T03:25:21.355362+0000","last_became_active":"2023-10-06T03:25:21.351324+0000","last_became_peered":"2023-10-06T03:25:21.351324+0000","last_unstale":"2023-10-06T03:25:21.355362+0000","last_undegraded":"2023-10-06T03:25:21.355362+0000","last_fullsized":"2023-10-06T03:25:21.355362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:23.487295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.353912+0000","last_change":"2023-10-06T03:25:21.353912+0000","last_active":"2023-10-06T03:25:21.353912+0000","last_peered":"2023-10-06T03:25:21.353912+0000","last_clean":"2023-10-06T03:25:21.353912+0000","last_became_active":"2023-10-06T03:25:21.353549+0000","last_became_peered":"2023-10-06T03:25:21.353549+0000","last_unstale":"2023-10-06T03:25:21.353912+0000","last_undegraded":"2023-10-06T03:25:21.353912+0000","last_fullsized":"2023-10-06T03:25:21.353912+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:02.231550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.354872+0000","last_change":"2023-10-06T03:25:21.349666+0000","last_active":"2023-10-06T03:25:21.354872+0000","last_peered":"2023-10-06T03:25:21.354872+0000","last_clean":"2023-10-06T03:25:21.354872+0000","last_became_active":"2023-10-06T03:25:21.349437+0000","last_became_peered":"2023-10-06T03:25:21.349437+0000","last_unstale":"2023-10-06T03:25:21.354872+0000","last_undegraded":"2023-10-06T03:25:21.354872+0000","last_fullsized":"2023-10-06T03:25:21.354872+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:35.000783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.361332+0000","last_change":"2023-10-06T03:25:21.358703+0000","last_active":"2023-10-06T03:25:21.361332+0000","last_peered":"2023-10-06T03:25:21.361332+0000","last_clean":"2023-10-06T03:25:21.361332+0000","last_became_active":"2023-10-06T03:25:21.358447+0000","last_became_peered":"2023-10-06T03:25:21.358447+0000","last_unstale":"2023-10-06T03:25:21.361332+0000","last_undegraded":"2023-10-06T03:25:21.361332+0000","last_fullsized":"2023-10-06T03:25:21.361332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:35.334273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357754+0000","last_change":"2023-10-06T03:25:21.352533+0000","last_active":"2023-10-06T03:25:21.357754+0000","last_peered":"2023-10-06T03:25:21.357754+0000","last_clean":"2023-10-06T03:25:21.357754+0000","last_became_active":"2023-10-06T03:25:21.352296+0000","last_became_peered":"2023-10-06T03:25:21.352296+0000","last_unstale":"2023-10-06T03:25:21.357754+0000","last_undegraded":"2023-10-06T03:25:21.357754+0000","last_fullsized":"2023-10-06T03:25:21.357754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:53.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358012+0000","last_change":"2023-10-06T03:25:21.353941+0000","last_active":"2023-10-06T03:25:21.358012+0000","last_peered":"2023-10-06T03:25:21.358012+0000","last_clean":"2023-10-06T03:25:21.358012+0000","last_became_active":"2023-10-06T03:25:21.353617+0000","last_became_peered":"2023-10-06T03:25:21.353617+0000","last_unstale":"2023-10-06T03:25:21.358012+0000","last_undegraded":"2023-10-06T03:25:21.358012+0000","last_fullsized":"2023-10-06T03:25:21.358012+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:29.834173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358676+0000","last_change":"2023-10-06T03:25:21.354967+0000","last_active":"2023-10-06T03:25:21.358676+0000","last_peered":"2023-10-06T03:25:21.358676+0000","last_clean":"2023-10-06T03:25:21.358676+0000","last_became_active":"2023-10-06T03:25:21.354656+0000","last_became_peered":"2023-10-06T03:25:21.354656+0000","last_unstale":"2023-10-06T03:25:21.358676+0000","last_undegraded":"2023-10-06T03:25:21.358676+0000","last_fullsized":"2023-10-06T03:25:21.358676+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:44.482597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.355231+0000","last_change":"2023-10-06T03:25:21.355231+0000","last_active":"2023-10-06T03:25:21.355231+0000","last_peered":"2023-10-06T03:25:21.355231+0000","last_clean":"2023-10-06T03:25:21.355231+0000","last_became_active":"2023-10-06T03:25:21.354904+0000","last_became_peered":"2023-10-06T03:25:21.354904+0000","last_unstale":"2023-10-06T03:25:21.355231+0000","last_undegraded":"2023-10-06T03:25:21.355231+0000","last_fullsized":"2023-10-06T03:25:21.355231+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:39.557149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.362826+0000","last_change":"2023-10-06T03:25:21.362826+0000","last_active":"2023-10-06T03:25:21.362826+0000","last_peered":"2023-10-06T03:25:21.362826+0000","last_clean":"2023-10-06T03:25:21.362826+0000","last_became_active":"2023-10-06T03:25:21.362548+0000","last_became_peered":"2023-10-06T03:25:21.362548+0000","last_unstale":"2023-10-06T03:25:21.362826+0000","last_undegraded":"2023-10-06T03:25:21.362826+0000","last_fullsized":"2023-10-06T03:25:21.362826+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:29.292113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.349584+0000","last_change":"2023-10-06T03:25:21.349584+0000","last_active":"2023-10-06T03:25:21.349584+0000","last_peered":"2023-10-06T03:25:21.349584+0000","last_clean":"2023-10-06T03:25:21.349584+0000","last_became_active":"2023-10-06T03:25:21.349333+0000","last_became_peered":"2023-10-06T03:25:21.349333+0000","last_unstale":"2023-10-06T03:25:21.349584+0000","last_undegraded":"2023-10-06T03:25:21.349584+0000","last_fullsized":"2023-10-06T03:25:21.349584+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:35.000783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357602+0000","last_change":"2023-10-06T03:25:21.357602+0000","last_active":"2023-10-06T03:25:21.357602+0000","last_peered":"2023-10-06T03:25:21.357602+0000","last_clean":"2023-10-06T03:25:21.357602+0000","last_became_active":"2023-10-06T03:25:21.357343+0000","last_became_peered":"2023-10-06T03:25:21.357343+0000","last_unstale":"2023-10-06T03:25:21.357602+0000","last_undegraded":"2023-10-06T03:25:21.357602+0000","last_fullsized":"2023-10-06T03:25:21.357602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:45.905066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.360095+0000","last_change":"2023-10-06T03:25:21.359523+0000","last_active":"2023-10-06T03:25:21.360095+0000","last_peered":"2023-10-06T03:25:21.360095+0000","last_clean":"2023-10-06T03:25:21.360095+0000","last_became_active":"2023-10-06T03:25:21.359264+0000","last_became_peered":"2023-10-06T03:25:21.359264+0000","last_unstale":"2023-10-06T03:25:21.360095+0000","last_undegraded":"2023-10-06T03:25:21.360095+0000","last_fullsized":"2023-10-06T03:25:21.360095+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:19.910252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359158+0000","last_change":"2023-10-06T03:25:21.357238+0000","last_active":"2023-10-06T03:25:21.359158+0000","last_peered":"2023-10-06T03:25:21.359158+0000","last_clean":"2023-10-06T03:25:21.359158+0000","last_became_active":"2023-10-06T03:25:21.356957+0000","last_became_peered":"2023-10-06T03:25:21.356957+0000","last_unstale":"2023-10-06T03:25:21.359158+0000","last_undegraded":"2023-10-06T03:25:21.359158+0000","last_fullsized":"2023-10-06T03:25:21.359158+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:29.292113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.355300+0000","last_change":"2023-10-06T03:25:21.355300+0000","last_active":"2023-10-06T03:25:21.355300+0000","last_peered":"2023-10-06T03:25:21.355300+0000","last_clean":"2023-10-06T03:25:21.355300+0000","last_became_active":"2023-10-06T03:25:21.355021+0000","last_became_peered":"2023-10-06T03:25:21.355021+0000","last_unstale":"2023-10-06T03:25:21.355300+0000","last_undegraded":"2023-10-06T03:25:21.355300+0000","last_fullsized":"2023-10-06T03:25:21.355300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:15.985118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.351103+0000","last_change":"2023-10-06T03:25:21.351103+0000","last_active":"2023-10-06T03:25:21.351103+0000","last_peered":"2023-10-06T03:25:21.351103+0000","last_clean":"2023-10-06T03:25:21.351103+0000","last_became_active":"2023-10-06T03:25:21.350849+0000","last_became_peered":"2023-10-06T03:25:21.350849+0000","last_unstale":"2023-10-06T03:25:21.351103+0000","last_undegraded":"2023-10-06T03:25:21.351103+0000","last_fullsized":"2023-10-06T03:25:21.351103+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:16.145387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.348981+0000","last_change":"2023-10-06T03:25:21.348981+0000","last_active":"2023-10-06T03:25:21.348981+0000","last_peered":"2023-10-06T03:25:21.348981+0000","last_clean":"2023-10-06T03:25:21.348981+0000","last_became_active":"2023-10-06T03:25:21.348719+0000","last_became_peered":"2023-10-06T03:25:21.348719+0000","last_unstale":"2023-10-06T03:25:21.348981+0000","last_undegraded":"2023-10-06T03:25:21.348981+0000","last_fullsized":"2023-10-06T03:25:21.348981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:53.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.748919+0000","last_change":"2023-10-06T03:25:20.743230+0000","last_active":"2023-10-06T03:25:21.748919+0000","last_peered":"2023-10-06T03:25:21.748919+0000","last_clean":"2023-10-06T03:25:21.748919+0000","last_became_active":"2023-10-06T03:25:20.742982+0000","last_became_peered":"2023-10-06T03:25:20.742982+0000","last_unstale":"2023-10-06T03:25:21.748919+0000","last_undegraded":"2023-10-06T03:25:21.748919+0000","last_fullsized":"2023-10-06T03:25:21.748919+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:33.060095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.353051+0000","last_change":"2023-10-06T03:25:21.353051+0000","last_active":"2023-10-06T03:25:21.353051+0000","last_peered":"2023-10-06T03:25:21.353051+0000","last_clean":"2023-10-06T03:25:21.353051+0000","last_became_active":"2023-10-06T03:25:21.352527+0000","last_became_peered":"2023-10-06T03:25:21.352527+0000","last_unstale":"2023-10-06T03:25:21.353051+0000","last_undegraded":"2023-10-06T03:25:21.353051+0000","last_fullsized":"2023-10-06T03:25:21.353051+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:46.058709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.743560+0000","last_change":"2023-10-06T03:25:20.735679+0000","last_active":"2023-10-06T03:25:21.743560+0000","last_peered":"2023-10-06T03:25:21.743560+0000","last_clean":"2023-10-06T03:25:21.743560+0000","last_became_active":"2023-10-06T03:25:20.735445+0000","last_became_peered":"2023-10-06T03:25:20.735445+0000","last_unstale":"2023-10-06T03:25:21.743560+0000","last_undegraded":"2023-10-06T03:25:21.743560+0000","last_fullsized":"2023-10-06T03:25:21.743560+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:33.550055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.347880+0000","last_change":"2023-10-06T03:25:21.347880+0000","last_active":"2023-10-06T03:25:21.347880+0000","last_peered":"2023-10-06T03:25:21.347880+0000","last_clean":"2023-10-06T03:25:21.347880+0000","last_became_active":"2023-10-06T03:25:21.347647+0000","last_became_peered":"2023-10-06T03:25:21.347647+0000","last_unstale":"2023-10-06T03:25:21.347880+0000","last_undegraded":"2023-10-06T03:25:21.347880+0000","last_fullsized":"2023-10-06T03:25:21.347880+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:00.883246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744229+0000","last_change":"2023-10-06T03:25:20.736506+0000","last_active":"2023-10-06T03:25:21.744229+0000","last_peered":"2023-10-06T03:25:21.744229+0000","last_clean":"2023-10-06T03:25:21.744229+0000","last_became_active":"2023-10-06T03:25:20.736253+0000","last_became_peered":"2023-10-06T03:25:20.736253+0000","last_unstale":"2023-10-06T03:25:21.744229+0000","last_undegraded":"2023-10-06T03:25:21.744229+0000","last_fullsized":"2023-10-06T03:25:21.744229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:53.486571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358375+0000","last_change":"2023-10-06T03:25:21.358375+0000","last_active":"2023-10-06T03:25:21.358375+0000","last_peered":"2023-10-06T03:25:21.358375+0000","last_clean":"2023-10-06T03:25:21.358375+0000","last_became_active":"2023-10-06T03:25:21.357798+0000","last_became_peered":"2023-10-06T03:25:21.357798+0000","last_unstale":"2023-10-06T03:25:21.358375+0000","last_undegraded":"2023-10-06T03:25:21.358375+0000","last_fullsized":"2023-10-06T03:25:21.358375+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.020799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744523+0000","last_change":"2023-10-06T03:25:20.741939+0000","last_active":"2023-10-06T03:25:21.744523+0000","last_peered":"2023-10-06T03:25:21.744523+0000","last_clean":"2023-10-06T03:25:21.744523+0000","last_became_active":"2023-10-06T03:25:20.741684+0000","last_became_peered":"2023-10-06T03:25:20.741684+0000","last_unstale":"2023-10-06T03:25:21.744523+0000","last_undegraded":"2023-10-06T03:25:21.744523+0000","last_fullsized":"2023-10-06T03:25:21.744523+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:38.851515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.355930+0000","last_change":"2023-10-06T03:25:21.352202+0000","last_active":"2023-10-06T03:25:21.355930+0000","last_peered":"2023-10-06T03:25:21.355930+0000","last_clean":"2023-10-06T03:25:21.355930+0000","last_became_active":"2023-10-06T03:25:21.351965+0000","last_became_peered":"2023-10-06T03:25:21.351965+0000","last_unstale":"2023-10-06T03:25:21.355930+0000","last_undegraded":"2023-10-06T03:25:21.355930+0000","last_fullsized":"2023-10-06T03:25:21.355930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.020799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744007+0000","last_change":"2023-10-06T03:25:20.738325+0000","last_active":"2023-10-06T03:25:21.744007+0000","last_peered":"2023-10-06T03:25:21.744007+0000","last_clean":"2023-10-06T03:25:21.744007+0000","last_became_active":"2023-10-06T03:25:20.738077+0000","last_became_peered":"2023-10-06T03:25:20.738077+0000","last_unstale":"2023-10-06T03:25:21.744007+0000","last_undegraded":"2023-10-06T03:25:21.744007+0000","last_fullsized":"2023-10-06T03:25:21.744007+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:54.011573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357688+0000","last_change":"2023-10-06T03:25:21.353232+0000","last_active":"2023-10-06T03:25:21.357688+0000","last_peered":"2023-10-06T03:25:21.357688+0000","last_clean":"2023-10-06T03:25:21.357688+0000","last_became_active":"2023-10-06T03:25:21.352954+0000","last_became_peered":"2023-10-06T03:25:21.352954+0000","last_unstale":"2023-10-06T03:25:21.357688+0000","last_undegraded":"2023-10-06T03:25:21.357688+0000","last_fullsized":"2023-10-06T03:25:21.357688+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:40.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.339435+0000","last_change":"2023-10-06T03:25:20.738130+0000","last_active":"2023-10-06T03:25:21.339435+0000","last_peered":"2023-10-06T03:25:21.339435+0000","last_clean":"2023-10-06T03:25:21.339435+0000","last_became_active":"2023-10-06T03:25:20.737896+0000","last_became_peered":"2023-10-06T03:25:20.737896+0000","last_unstale":"2023-10-06T03:25:21.339435+0000","last_undegraded":"2023-10-06T03:25:21.339435+0000","last_fullsized":"2023-10-06T03:25:21.339435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:10.559590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358653+0000","last_change":"2023-10-06T03:25:21.353699+0000","last_active":"2023-10-06T03:25:21.358653+0000","last_peered":"2023-10-06T03:25:21.358653+0000","last_clean":"2023-10-06T03:25:21.358653+0000","last_became_active":"2023-10-06T03:25:21.353423+0000","last_became_peered":"2023-10-06T03:25:21.353423+0000","last_unstale":"2023-10-06T03:25:21.358653+0000","last_undegraded":"2023-10-06T03:25:21.358653+0000","last_fullsized":"2023-10-06T03:25:21.358653+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:41.890988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.742403+0000","last_change":"2023-10-06T03:25:20.741344+0000","last_active":"2023-10-06T03:25:20.742403+0000","last_peered":"2023-10-06T03:25:20.742403+0000","last_clean":"2023-10-06T03:25:20.742403+0000","last_became_active":"2023-10-06T03:25:20.741075+0000","last_became_peered":"2023-10-06T03:25:20.741075+0000","last_unstale":"2023-10-06T03:25:20.742403+0000","last_undegraded":"2023-10-06T03:25:20.742403+0000","last_fullsized":"2023-10-06T03:25:20.742403+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:06.366935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359105+0000","last_change":"2023-10-06T03:25:21.357056+0000","last_active":"2023-10-06T03:25:21.359105+0000","last_peered":"2023-10-06T03:25:21.359105+0000","last_clean":"2023-10-06T03:25:21.359105+0000","last_became_active":"2023-10-06T03:25:21.356855+0000","last_became_peered":"2023-10-06T03:25:21.356855+0000","last_unstale":"2023-10-06T03:25:21.359105+0000","last_undegraded":"2023-10-06T03:25:21.359105+0000","last_fullsized":"2023-10-06T03:25:21.359105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:06.558071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.345345+0000","last_change":"2023-10-06T03:25:20.743465+0000","last_active":"2023-10-06T03:25:21.345345+0000","last_peered":"2023-10-06T03:25:21.345345+0000","last_clean":"2023-10-06T03:25:21.345345+0000","last_became_active":"2023-10-06T03:25:20.743217+0000","last_became_peered":"2023-10-06T03:25:20.743217+0000","last_unstale":"2023-10-06T03:25:21.345345+0000","last_undegraded":"2023-10-06T03:25:21.345345+0000","last_fullsized":"2023-10-06T03:25:21.345345+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:28.824297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.366230+0000","last_change":"2023-10-06T03:25:21.361870+0000","last_active":"2023-10-06T03:25:21.366230+0000","last_peered":"2023-10-06T03:25:21.366230+0000","last_clean":"2023-10-06T03:25:21.366230+0000","last_became_active":"2023-10-06T03:25:21.361628+0000","last_became_peered":"2023-10-06T03:25:21.361628+0000","last_unstale":"2023-10-06T03:25:21.366230+0000","last_undegraded":"2023-10-06T03:25:21.366230+0000","last_fullsized":"2023-10-06T03:25:21.366230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:29.486346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.342099+0000","last_change":"2023-10-06T03:25:20.743426+0000","last_active":"2023-10-06T03:25:21.342099+0000","last_peered":"2023-10-06T03:25:21.342099+0000","last_clean":"2023-10-06T03:25:21.342099+0000","last_became_active":"2023-10-06T03:25:20.742181+0000","last_became_peered":"2023-10-06T03:25:20.742181+0000","last_unstale":"2023-10-06T03:25:21.342099+0000","last_undegraded":"2023-10-06T03:25:21.342099+0000","last_fullsized":"2023-10-06T03:25:21.342099+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:49.191584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.355220+0000","last_change":"2023-10-06T03:25:21.352034+0000","last_active":"2023-10-06T03:25:21.355220+0000","last_peered":"2023-10-06T03:25:21.355220+0000","last_clean":"2023-10-06T03:25:21.355220+0000","last_became_active":"2023-10-06T03:25:21.351504+0000","last_became_peered":"2023-10-06T03:25:21.351504+0000","last_unstale":"2023-10-06T03:25:21.355220+0000","last_undegraded":"2023-10-06T03:25:21.355220+0000","last_fullsized":"2023-10-06T03:25:21.355220+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:11.569466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.348824+0000","last_change":"2023-10-06T03:25:20.738342+0000","last_active":"2023-10-06T03:25:21.348824+0000","last_peered":"2023-10-06T03:25:21.348824+0000","last_clean":"2023-10-06T03:25:21.348824+0000","last_became_active":"2023-10-06T03:25:20.737081+0000","last_became_peered":"2023-10-06T03:25:20.737081+0000","last_unstale":"2023-10-06T03:25:21.348824+0000","last_undegraded":"2023-10-06T03:25:21.348824+0000","last_fullsized":"2023-10-06T03:25:21.348824+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:54.011573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.361944+0000","last_change":"2023-10-06T03:25:21.361944+0000","last_active":"2023-10-06T03:25:21.361944+0000","last_peered":"2023-10-06T03:25:21.361944+0000","last_clean":"2023-10-06T03:25:21.361944+0000","last_became_active":"2023-10-06T03:25:21.361784+0000","last_became_peered":"2023-10-06T03:25:21.361784+0000","last_unstale":"2023-10-06T03:25:21.361944+0000","last_undegraded":"2023-10-06T03:25:21.361944+0000","last_fullsized":"2023-10-06T03:25:21.361944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:13.645325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744744+0000","last_change":"2023-10-06T03:25:20.736152+0000","last_active":"2023-10-06T03:25:21.744744+0000","last_peered":"2023-10-06T03:25:21.744744+0000","last_clean":"2023-10-06T03:25:21.744744+0000","last_became_active":"2023-10-06T03:25:20.735899+0000","last_became_peered":"2023-10-06T03:25:20.735899+0000","last_unstale":"2023-10-06T03:25:21.744744+0000","last_undegraded":"2023-10-06T03:25:21.744744+0000","last_fullsized":"2023-10-06T03:25:21.744744+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:49.292792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.352210+0000","last_change":"2023-10-06T03:25:21.347246+0000","last_active":"2023-10-06T03:25:21.352210+0000","last_peered":"2023-10-06T03:25:21.352210+0000","last_clean":"2023-10-06T03:25:21.352210+0000","last_became_active":"2023-10-06T03:25:21.346938+0000","last_became_peered":"2023-10-06T03:25:21.346938+0000","last_unstale":"2023-10-06T03:25:21.352210+0000","last_undegraded":"2023-10-06T03:25:21.352210+0000","last_fullsized":"2023-10-06T03:25:21.352210+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:15.669624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.756471+0000","last_change":"2023-10-06T03:25:20.743703+0000","last_active":"2023-10-06T03:25:21.756471+0000","last_peered":"2023-10-06T03:25:21.756471+0000","last_clean":"2023-10-06T03:25:21.756471+0000","last_became_active":"2023-10-06T03:25:20.743433+0000","last_became_peered":"2023-10-06T03:25:20.743433+0000","last_unstale":"2023-10-06T03:25:21.756471+0000","last_undegraded":"2023-10-06T03:25:21.756471+0000","last_fullsized":"2023-10-06T03:25:21.756471+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:53.486571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359224+0000","last_change":"2023-10-06T03:25:21.359224+0000","last_active":"2023-10-06T03:25:21.359224+0000","last_peered":"2023-10-06T03:25:21.359224+0000","last_clean":"2023-10-06T03:25:21.359224+0000","last_became_active":"2023-10-06T03:25:21.358929+0000","last_became_peered":"2023-10-06T03:25:21.358929+0000","last_unstale":"2023-10-06T03:25:21.359224+0000","last_undegraded":"2023-10-06T03:25:21.359224+0000","last_fullsized":"2023-10-06T03:25:21.359224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:34.069970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744843+0000","last_change":"2023-10-06T03:25:20.740651+0000","last_active":"2023-10-06T03:25:21.744843+0000","last_peered":"2023-10-06T03:25:21.744843+0000","last_clean":"2023-10-06T03:25:21.744843+0000","last_became_active":"2023-10-06T03:25:20.737032+0000","last_became_peered":"2023-10-06T03:25:20.737032+0000","last_unstale":"2023-10-06T03:25:21.744843+0000","last_undegraded":"2023-10-06T03:25:21.744843+0000","last_fullsized":"2023-10-06T03:25:21.744843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:10.559590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.351896+0000","last_change":"2023-10-06T03:25:21.349792+0000","last_active":"2023-10-06T03:25:21.351896+0000","last_peered":"2023-10-06T03:25:21.351896+0000","last_clean":"2023-10-06T03:25:21.351896+0000","last_became_active":"2023-10-06T03:25:21.349352+0000","last_became_peered":"2023-10-06T03:25:21.349352+0000","last_unstale":"2023-10-06T03:25:21.351896+0000","last_undegraded":"2023-10-06T03:25:21.351896+0000","last_fullsized":"2023-10-06T03:25:21.351896+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:10.994793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.346067+0000","last_change":"2023-10-06T03:25:20.734102+0000","last_active":"2023-10-06T03:25:21.346067+0000","last_peered":"2023-10-06T03:25:21.346067+0000","last_clean":"2023-10-06T03:25:21.346067+0000","last_became_active":"2023-10-06T03:25:20.733844+0000","last_became_peered":"2023-10-06T03:25:20.733844+0000","last_unstale":"2023-10-06T03:25:21.346067+0000","last_undegraded":"2023-10-06T03:25:21.346067+0000","last_fullsized":"2023-10-06T03:25:21.346067+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:01.221675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.363816+0000","last_change":"2023-10-06T03:25:21.354068+0000","last_active":"2023-10-06T03:25:21.363816+0000","last_peered":"2023-10-06T03:25:21.363816+0000","last_clean":"2023-10-06T03:25:21.363816+0000","last_became_active":"2023-10-06T03:25:21.353813+0000","last_became_peered":"2023-10-06T03:25:21.353813+0000","last_unstale":"2023-10-06T03:25:21.363816+0000","last_undegraded":"2023-10-06T03:25:21.363816+0000","last_fullsized":"2023-10-06T03:25:21.363816+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:16.414810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.741742+0000","last_change":"2023-10-06T03:25:20.735732+0000","last_active":"2023-10-06T03:25:20.741742+0000","last_peered":"2023-10-06T03:25:20.741742+0000","last_clean":"2023-10-06T03:25:20.741742+0000","last_became_active":"2023-10-06T03:25:20.735408+0000","last_became_peered":"2023-10-06T03:25:20.735408+0000","last_unstale":"2023-10-06T03:25:20.741742+0000","last_undegraded":"2023-10-06T03:25:20.741742+0000","last_fullsized":"2023-10-06T03:25:20.741742+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:51.770315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359109+0000","last_change":"2023-10-06T03:25:21.355609+0000","last_active":"2023-10-06T03:25:21.359109+0000","last_peered":"2023-10-06T03:25:21.359109+0000","last_clean":"2023-10-06T03:25:21.359109+0000","last_became_active":"2023-10-06T03:25:21.355186+0000","last_became_peered":"2023-10-06T03:25:21.355186+0000","last_unstale":"2023-10-06T03:25:21.359109+0000","last_undegraded":"2023-10-06T03:25:21.359109+0000","last_fullsized":"2023-10-06T03:25:21.359109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:34.069970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.745623+0000","last_change":"2023-10-06T03:25:20.741576+0000","last_active":"2023-10-06T03:25:21.745623+0000","last_peered":"2023-10-06T03:25:21.745623+0000","last_clean":"2023-10-06T03:25:21.745623+0000","last_became_active":"2023-10-06T03:25:20.741169+0000","last_became_peered":"2023-10-06T03:25:20.741169+0000","last_unstale":"2023-10-06T03:25:21.745623+0000","last_undegraded":"2023-10-06T03:25:21.745623+0000","last_fullsized":"2023-10-06T03:25:21.745623+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:48.519087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.356606+0000","last_change":"2023-10-06T03:25:21.356606+0000","last_active":"2023-10-06T03:25:21.356606+0000","last_peered":"2023-10-06T03:25:21.356606+0000","last_clean":"2023-10-06T03:25:21.356606+0000","last_became_active":"2023-10-06T03:25:21.356320+0000","last_became_peered":"2023-10-06T03:25:21.356320+0000","last_unstale":"2023-10-06T03:25:21.356606+0000","last_undegraded":"2023-10-06T03:25:21.356606+0000","last_fullsized":"2023-10-06T03:25:21.356606+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:15.669624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.748640+0000","last_change":"2023-10-06T03:25:20.734083+0000","last_active":"2023-10-06T03:25:21.748640+0000","last_peered":"2023-10-06T03:25:21.748640+0000","last_clean":"2023-10-06T03:25:21.748640+0000","last_became_active":"2023-10-06T03:25:20.733831+0000","last_became_peered":"2023-10-06T03:25:20.733831+0000","last_unstale":"2023-10-06T03:25:21.748640+0000","last_undegraded":"2023-10-06T03:25:21.748640+0000","last_fullsized":"2023-10-06T03:25:21.748640+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:36.284334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359994+0000","last_change":"2023-10-06T03:25:21.359994+0000","last_active":"2023-10-06T03:25:21.359994+0000","last_peered":"2023-10-06T03:25:21.359994+0000","last_clean":"2023-10-06T03:25:21.359994+0000","last_became_active":"2023-10-06T03:25:21.359611+0000","last_became_peered":"2023-10-06T03:25:21.359611+0000","last_unstale":"2023-10-06T03:25:21.359994+0000","last_undegraded":"2023-10-06T03:25:21.359994+0000","last_fullsized":"2023-10-06T03:25:21.359994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:29.834173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.744755+0000","last_change":"2023-10-06T03:25:20.737621+0000","last_active":"2023-10-06T03:25:20.744755+0000","last_peered":"2023-10-06T03:25:20.744755+0000","last_clean":"2023-10-06T03:25:20.744755+0000","last_became_active":"2023-10-06T03:25:20.737387+0000","last_became_peered":"2023-10-06T03:25:20.737387+0000","last_unstale":"2023-10-06T03:25:20.744755+0000","last_undegraded":"2023-10-06T03:25:20.744755+0000","last_fullsized":"2023-10-06T03:25:20.744755+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:54.011573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.362091+0000","last_change":"2023-10-06T03:25:21.362091+0000","last_active":"2023-10-06T03:25:21.362091+0000","last_peered":"2023-10-06T03:25:21.362091+0000","last_clean":"2023-10-06T03:25:21.362091+0000","last_became_active":"2023-10-06T03:25:21.361886+0000","last_became_peered":"2023-10-06T03:25:21.361886+0000","last_unstale":"2023-10-06T03:25:21.362091+0000","last_undegraded":"2023-10-06T03:25:21.362091+0000","last_fullsized":"2023-10-06T03:25:21.362091+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:50.201459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.344944+0000","last_change":"2023-10-06T03:25:20.732365+0000","last_active":"2023-10-06T03:25:21.344944+0000","last_peered":"2023-10-06T03:25:21.344944+0000","last_clean":"2023-10-06T03:25:21.344944+0000","last_became_active":"2023-10-06T03:25:20.732132+0000","last_became_peered":"2023-10-06T03:25:20.732132+0000","last_unstale":"2023-10-06T03:25:21.344944+0000","last_undegraded":"2023-10-06T03:25:21.344944+0000","last_fullsized":"2023-10-06T03:25:21.344944+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:38.547274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358404+0000","last_change":"2023-10-06T03:25:21.358404+0000","last_active":"2023-10-06T03:25:21.358404+0000","last_peered":"2023-10-06T03:25:21.358404+0000","last_clean":"2023-10-06T03:25:21.358404+0000","last_became_active":"2023-10-06T03:25:21.358120+0000","last_became_peered":"2023-10-06T03:25:21.358120+0000","last_unstale":"2023-10-06T03:25:21.358404+0000","last_undegraded":"2023-10-06T03:25:21.358404+0000","last_fullsized":"2023-10-06T03:25:21.358404+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:48.207789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.742020+0000","last_change":"2023-10-06T03:25:20.740486+0000","last_active":"2023-10-06T03:25:20.742020+0000","last_peered":"2023-10-06T03:25:20.742020+0000","last_clean":"2023-10-06T03:25:20.742020+0000","last_became_active":"2023-10-06T03:25:20.740154+0000","last_became_peered":"2023-10-06T03:25:20.740154+0000","last_unstale":"2023-10-06T03:25:20.742020+0000","last_undegraded":"2023-10-06T03:25:20.742020+0000","last_fullsized":"2023-10-06T03:25:20.742020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:57.402843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357764+0000","last_change":"2023-10-06T03:25:21.353372+0000","last_active":"2023-10-06T03:25:21.357764+0000","last_peered":"2023-10-06T03:25:21.357764+0000","last_clean":"2023-10-06T03:25:21.357764+0000","last_became_active":"2023-10-06T03:25:21.353133+0000","last_became_peered":"2023-10-06T03:25:21.353133+0000","last_unstale":"2023-10-06T03:25:21.357764+0000","last_undegraded":"2023-10-06T03:25:21.357764+0000","last_fullsized":"2023-10-06T03:25:21.357764+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:43.998365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.747279+0000","last_change":"2023-10-06T03:25:20.739624+0000","last_active":"2023-10-06T03:25:20.747279+0000","last_peered":"2023-10-06T03:25:20.747279+0000","last_clean":"2023-10-06T03:25:20.747279+0000","last_became_active":"2023-10-06T03:25:20.739412+0000","last_became_peered":"2023-10-06T03:25:20.739412+0000","last_unstale":"2023-10-06T03:25:20.747279+0000","last_undegraded":"2023-10-06T03:25:20.747279+0000","last_fullsized":"2023-10-06T03:25:20.747279+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:01.502826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.356690+0000","last_change":"2023-10-06T03:25:21.354068+0000","last_active":"2023-10-06T03:25:21.356690+0000","last_peered":"2023-10-06T03:25:21.356690+0000","last_clean":"2023-10-06T03:25:21.356690+0000","last_became_active":"2023-10-06T03:25:21.353746+0000","last_became_peered":"2023-10-06T03:25:21.353746+0000","last_unstale":"2023-10-06T03:25:21.356690+0000","last_undegraded":"2023-10-06T03:25:21.356690+0000","last_fullsized":"2023-10-06T03:25:21.356690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:54.922795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.345699+0000","last_change":"2023-10-06T03:25:20.739540+0000","last_active":"2023-10-06T03:25:21.345699+0000","last_peered":"2023-10-06T03:25:21.345699+0000","last_clean":"2023-10-06T03:25:21.345699+0000","last_became_active":"2023-10-06T03:25:20.739187+0000","last_became_peered":"2023-10-06T03:25:20.739187+0000","last_unstale":"2023-10-06T03:25:21.345699+0000","last_undegraded":"2023-10-06T03:25:21.345699+0000","last_fullsized":"2023-10-06T03:25:21.345699+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:33.550055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.349739+0000","last_change":"2023-10-06T03:25:21.349739+0000","last_active":"2023-10-06T03:25:21.349739+0000","last_peered":"2023-10-06T03:25:21.349739+0000","last_clean":"2023-10-06T03:25:21.349739+0000","last_became_active":"2023-10-06T03:25:21.349503+0000","last_became_peered":"2023-10-06T03:25:21.349503+0000","last_unstale":"2023-10-06T03:25:21.349739+0000","last_undegraded":"2023-10-06T03:25:21.349739+0000","last_fullsized":"2023-10-06T03:25:21.349739+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:14.383583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.747321+0000","last_change":"2023-10-06T03:25:20.743100+0000","last_active":"2023-10-06T03:25:20.747321+0000","last_peered":"2023-10-06T03:25:20.747321+0000","last_clean":"2023-10-06T03:25:20.747321+0000","last_became_active":"2023-10-06T03:25:20.742839+0000","last_became_peered":"2023-10-06T03:25:20.742839+0000","last_unstale":"2023-10-06T03:25:20.747321+0000","last_undegraded":"2023-10-06T03:25:20.747321+0000","last_fullsized":"2023-10-06T03:25:20.747321+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:17.147666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359087+0000","last_change":"2023-10-06T03:25:21.357005+0000","last_active":"2023-10-06T03:25:21.359087+0000","last_peered":"2023-10-06T03:25:21.359087+0000","last_clean":"2023-10-06T03:25:21.359087+0000","last_became_active":"2023-10-06T03:25:21.356782+0000","last_became_peered":"2023-10-06T03:25:21.356782+0000","last_unstale":"2023-10-06T03:25:21.359087+0000","last_undegraded":"2023-10-06T03:25:21.359087+0000","last_fullsized":"2023-10-06T03:25:21.359087+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:33.031472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.348427+0000","last_change":"2023-10-06T03:25:20.742287+0000","last_active":"2023-10-06T03:25:21.348427+0000","last_peered":"2023-10-06T03:25:21.348427+0000","last_clean":"2023-10-06T03:25:21.348427+0000","last_became_active":"2023-10-06T03:25:20.742017+0000","last_became_peered":"2023-10-06T03:25:20.742017+0000","last_unstale":"2023-10-06T03:25:21.348427+0000","last_undegraded":"2023-10-06T03:25:21.348427+0000","last_fullsized":"2023-10-06T03:25:21.348427+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:14.659749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.356720+0000","last_change":"2023-10-06T03:25:21.353419+0000","last_active":"2023-10-06T03:25:21.356720+0000","last_peered":"2023-10-06T03:25:21.356720+0000","last_clean":"2023-10-06T03:25:21.356720+0000","last_became_active":"2023-10-06T03:25:21.353108+0000","last_became_peered":"2023-10-06T03:25:21.353108+0000","last_unstale":"2023-10-06T03:25:21.356720+0000","last_undegraded":"2023-10-06T03:25:21.356720+0000","last_fullsized":"2023-10-06T03:25:21.356720+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:55.021449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.747420+0000","last_change":"2023-10-06T03:25:20.742079+0000","last_active":"2023-10-06T03:25:20.747420+0000","last_peered":"2023-10-06T03:25:20.747420+0000","last_clean":"2023-10-06T03:25:20.747420+0000","last_became_active":"2023-10-06T03:25:20.741799+0000","last_became_peered":"2023-10-06T03:25:20.741799+0000","last_unstale":"2023-10-06T03:25:20.747420+0000","last_undegraded":"2023-10-06T03:25:20.747420+0000","last_fullsized":"2023-10-06T03:25:20.747420+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:33.550055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":41,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.346881+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:25:21.346881+0000","last_peered":"2023-10-06T03:25:21.346881+0000","last_clean":"2023-10-06T03:25:21.346881+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:25:21.346881+0000","last_undegraded":"2023-10-06T03:25:21.346881+0000","last_fullsized":"2023-10-06T03:25:21.346881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.368049+0000","last_change":"2023-10-06T03:25:21.362684+0000","last_active":"2023-10-06T03:25:21.368049+0000","last_peered":"2023-10-06T03:25:21.368049+0000","last_clean":"2023-10-06T03:25:21.368049+0000","last_became_active":"2023-10-06T03:25:21.362472+0000","last_became_peered":"2023-10-06T03:25:21.362472+0000","last_unstale":"2023-10-06T03:25:21.368049+0000","last_undegraded":"2023-10-06T03:25:21.368049+0000","last_fullsized":"2023-10-06T03:25:21.368049+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:52.441557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.351604+0000","last_change":"2023-10-06T03:25:20.735264+0000","last_active":"2023-10-06T03:25:21.351604+0000","last_peered":"2023-10-06T03:25:21.351604+0000","last_clean":"2023-10-06T03:25:21.351604+0000","last_became_active":"2023-10-06T03:25:20.734972+0000","last_became_peered":"2023-10-06T03:25:20.734972+0000","last_unstale":"2023-10-06T03:25:21.351604+0000","last_undegraded":"2023-10-06T03:25:21.351604+0000","last_fullsized":"2023-10-06T03:25:21.351604+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:11.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.348992+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:25:21.348992+0000","last_peered":"2023-10-06T03:25:21.348992+0000","last_clean":"2023-10-06T03:25:21.348992+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:25:21.348992+0000","last_undegraded":"2023-10-06T03:25:21.348992+0000","last_fullsized":"2023-10-06T03:25:21.348992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.349717+0000","last_change":"2023-10-06T03:25:21.349717+0000","last_active":"2023-10-06T03:25:21.349717+0000","last_peered":"2023-10-06T03:25:21.349717+0000","last_clean":"2023-10-06T03:25:21.349717+0000","last_became_active":"2023-10-06T03:25:21.349465+0000","last_became_peered":"2023-10-06T03:25:21.349465+0000","last_unstale":"2023-10-06T03:25:21.349717+0000","last_undegraded":"2023-10-06T03:25:21.349717+0000","last_fullsized":"2023-10-06T03:25:21.349717+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:45.999668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.731366+0000","last_change":"2023-10-06T03:25:20.725557+0000","last_active":"2023-10-06T03:25:20.731366+0000","last_peered":"2023-10-06T03:25:20.731366+0000","last_clean":"2023-10-06T03:25:20.731366+0000","last_became_active":"2023-10-06T03:25:20.725249+0000","last_became_peered":"2023-10-06T03:25:20.725249+0000","last_unstale":"2023-10-06T03:25:20.731366+0000","last_undegraded":"2023-10-06T03:25:20.731366+0000","last_fullsized":"2023-10-06T03:25:20.731366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:01.221675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.724030+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:25:20.724030+0000","last_peered":"2023-10-06T03:25:20.724030+0000","last_clean":"2023-10-06T03:25:20.724030+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:25:20.724030+0000","last_undegraded":"2023-10-06T03:25:20.724030+0000","last_fullsized":"2023-10-06T03:25:20.724030+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":193,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.341978+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:25:21.341978+0000","last_peered":"2023-10-06T03:25:21.341978+0000","last_clean":"2023-10-06T03:25:21.341978+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:25:21.341978+0000","last_undegraded":"2023-10-06T03:25:21.341978+0000","last_fullsized":"2023-10-06T03:25:21.341978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357870+0000","last_change":"2023-10-06T03:25:21.357870+0000","last_active":"2023-10-06T03:25:21.357870+0000","last_peered":"2023-10-06T03:25:21.357870+0000","last_clean":"2023-10-06T03:25:21.357870+0000","last_became_active":"2023-10-06T03:25:21.355018+0000","last_became_peered":"2023-10-06T03:25:21.355018+0000","last_unstale":"2023-10-06T03:25:21.357870+0000","last_undegraded":"2023-10-06T03:25:21.357870+0000","last_fullsized":"2023-10-06T03:25:21.357870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:54.922795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744820+0000","last_change":"2023-10-06T03:25:20.735197+0000","last_active":"2023-10-06T03:25:21.744820+0000","last_peered":"2023-10-06T03:25:21.744820+0000","last_clean":"2023-10-06T03:25:21.744820+0000","last_became_active":"2023-10-06T03:25:20.734965+0000","last_became_peered":"2023-10-06T03:25:20.734965+0000","last_unstale":"2023-10-06T03:25:21.744820+0000","last_undegraded":"2023-10-06T03:25:21.744820+0000","last_fullsized":"2023-10-06T03:25:21.744820+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:28.824297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.343546+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:25:21.343546+0000","last_peered":"2023-10-06T03:25:21.343546+0000","last_clean":"2023-10-06T03:25:21.343546+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:25:21.343546+0000","last_undegraded":"2023-10-06T03:25:21.343546+0000","last_fullsized":"2023-10-06T03:25:21.343546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357731+0000","last_change":"2023-10-06T03:25:21.353221+0000","last_active":"2023-10-06T03:25:21.357731+0000","last_peered":"2023-10-06T03:25:21.357731+0000","last_clean":"2023-10-06T03:25:21.357731+0000","last_became_active":"2023-10-06T03:25:21.352965+0000","last_became_peered":"2023-10-06T03:25:21.352965+0000","last_unstale":"2023-10-06T03:25:21.357731+0000","last_undegraded":"2023-10-06T03:25:21.357731+0000","last_fullsized":"2023-10-06T03:25:21.357731+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:22.032998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.346025+0000","last_change":"2023-10-06T03:25:20.741561+0000","last_active":"2023-10-06T03:25:21.346025+0000","last_peered":"2023-10-06T03:25:21.346025+0000","last_clean":"2023-10-06T03:25:21.346025+0000","last_became_active":"2023-10-06T03:25:20.741296+0000","last_became_peered":"2023-10-06T03:25:20.741296+0000","last_unstale":"2023-10-06T03:25:21.346025+0000","last_undegraded":"2023-10-06T03:25:21.346025+0000","last_fullsized":"2023-10-06T03:25:21.346025+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:01.502826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.341399+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:25:21.341399+0000","last_peered":"2023-10-06T03:25:21.341399+0000","last_clean":"2023-10-06T03:25:21.341399+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:25:21.341399+0000","last_undegraded":"2023-10-06T03:25:21.341399+0000","last_fullsized":"2023-10-06T03:25:21.341399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.344762+0000","last_change":"2023-10-06T03:25:21.344762+0000","last_active":"2023-10-06T03:25:21.344762+0000","last_peered":"2023-10-06T03:25:21.344762+0000","last_clean":"2023-10-06T03:25:21.344762+0000","last_became_active":"2023-10-06T03:25:21.343976+0000","last_became_peered":"2023-10-06T03:25:21.343976+0000","last_unstale":"2023-10-06T03:25:21.344762+0000","last_undegraded":"2023-10-06T03:25:21.344762+0000","last_fullsized":"2023-10-06T03:25:21.344762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:01.237800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.747867+0000","last_change":"2023-10-06T03:25:20.743535+0000","last_active":"2023-10-06T03:25:20.747867+0000","last_peered":"2023-10-06T03:25:20.747867+0000","last_clean":"2023-10-06T03:25:20.747867+0000","last_became_active":"2023-10-06T03:25:20.743226+0000","last_became_peered":"2023-10-06T03:25:20.743226+0000","last_unstale":"2023-10-06T03:25:20.747867+0000","last_undegraded":"2023-10-06T03:25:20.747867+0000","last_fullsized":"2023-10-06T03:25:20.747867+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:15.802424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.734805+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:25:20.734805+0000","last_peered":"2023-10-06T03:25:20.734805+0000","last_clean":"2023-10-06T03:25:20.734805+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:25:20.734805+0000","last_undegraded":"2023-10-06T03:25:20.734805+0000","last_fullsized":"2023-10-06T03:25:20.734805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.368883+0000","last_change":"2023-10-06T03:25:21.363019+0000","last_active":"2023-10-06T03:25:21.368883+0000","last_peered":"2023-10-06T03:25:21.368883+0000","last_clean":"2023-10-06T03:25:21.368883+0000","last_became_active":"2023-10-06T03:25:21.362755+0000","last_became_peered":"2023-10-06T03:25:21.362755+0000","last_unstale":"2023-10-06T03:25:21.368883+0000","last_undegraded":"2023-10-06T03:25:21.368883+0000","last_fullsized":"2023-10-06T03:25:21.368883+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:54.496446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.748408+0000","last_change":"2023-10-06T03:25:20.737201+0000","last_active":"2023-10-06T03:25:21.748408+0000","last_peered":"2023-10-06T03:25:21.748408+0000","last_clean":"2023-10-06T03:25:21.748408+0000","last_became_active":"2023-10-06T03:25:20.736938+0000","last_became_peered":"2023-10-06T03:25:20.736938+0000","last_unstale":"2023-10-06T03:25:21.748408+0000","last_undegraded":"2023-10-06T03:25:21.748408+0000","last_fullsized":"2023-10-06T03:25:21.748408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:53.486571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.347426+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:25:21.347426+0000","last_peered":"2023-10-06T03:25:21.347426+0000","last_clean":"2023-10-06T03:25:21.347426+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:25:21.347426+0000","last_undegraded":"2023-10-06T03:25:21.347426+0000","last_fullsized":"2023-10-06T03:25:21.347426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359190+0000","last_change":"2023-10-06T03:25:21.359190+0000","last_active":"2023-10-06T03:25:21.359190+0000","last_peered":"2023-10-06T03:25:21.359190+0000","last_clean":"2023-10-06T03:25:21.359190+0000","last_became_active":"2023-10-06T03:25:21.357780+0000","last_became_peered":"2023-10-06T03:25:21.357780+0000","last_unstale":"2023-10-06T03:25:21.359190+0000","last_undegraded":"2023-10-06T03:25:21.359190+0000","last_fullsized":"2023-10-06T03:25:21.359190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:54.496446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744290+0000","last_change":"2023-10-06T03:25:20.737149+0000","last_active":"2023-10-06T03:25:21.744290+0000","last_peered":"2023-10-06T03:25:21.744290+0000","last_clean":"2023-10-06T03:25:21.744290+0000","last_became_active":"2023-10-06T03:25:20.736895+0000","last_became_peered":"2023-10-06T03:25:20.736895+0000","last_unstale":"2023-10-06T03:25:21.744290+0000","last_undegraded":"2023-10-06T03:25:21.744290+0000","last_fullsized":"2023-10-06T03:25:21.744290+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:28.824297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.346650+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:25:21.346650+0000","last_peered":"2023-10-06T03:25:21.346650+0000","last_clean":"2023-10-06T03:25:21.346650+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:25:21.346650+0000","last_undegraded":"2023-10-06T03:25:21.346650+0000","last_fullsized":"2023-10-06T03:25:21.346650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298444,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073396,"statfs":{"total":96636764160,"available":96331157504,"internally_reserved":0,"allocated":1183744,"data_stored":855934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.39500000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.377},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42999999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.503}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":272367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":6.3680000000000003,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.442},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.5039999999999996,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.4740000000000002,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":6.4359999999999999,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.748},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.504},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1179648,"data_stored":855864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.219},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.31}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.48099999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.434}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":266143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":12.19,"5min":12.19,"15min":12.19},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":8.3900000000000006,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.308},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.27600000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.437},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.38400000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.948,"5min":16.948,"15min":16.948},"last":0.39700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.505}]},{"osd":7,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":16.881,"5min":16.881,"15min":16.881},"last":0.41699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297864,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":589824,"data_stored":265462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.217},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.29399999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.247},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.307}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.36799999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.38100000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.439}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":602112,"data_stored":272423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.50700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":273903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.758,"5min":4.758,"15min":4.758},"last":0.375},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":9.7690000000000001,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297856,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":581632,"data_stored":265406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.748},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:25:25.792 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:25:25.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.938+0000 7f544b59e700 1 Processor -- start 2023-10-06T03:25:25.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.938+0000 7f544b59e700 1 -- start start 2023-10-06T03:25:25.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f544b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f544c0cbc70 0x7f544c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f544b59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f544c0b2140 0x7f544c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f544b59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544c0cb7e0 con 0x7f544c159480 2023-10-06T03:25:25.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f544b59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c0b08a0 con 0x7f544c0cbc70 2023-10-06T03:25:25.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f544b59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c0cb190 con 0x7f544c0b2140 2023-10-06T03:25:25.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f5449d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f544c0cbc70 0x7f544c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f5449d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f544c0cbc70 0x7f544c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33350/0 (socket says 172.21.15.84:33350) 2023-10-06T03:25:25.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f5449d9b700 1 -- 172.21.15.84:0/4094067256 learned_addr learned my addr 172.21.15.84:0/4094067256 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:25.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f544ad9d700 1 --2- 172.21.15.84:0/4094067256 >> v2:172.21.15.131:3300/0 conn(0x7f544c0b2140 0x7f544c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f5449d9b700 1 -- 172.21.15.84:0/4094067256 >> v2:172.21.15.131:3300/0 conn(0x7f544c0b2140 msgr2=0x7f544c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f5449d9b700 1 --2- 172.21.15.84:0/4094067256 >> v2:172.21.15.131:3300/0 conn(0x7f544c0b2140 0x7f544c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f5449d9b700 1 -- 172.21.15.84:0/4094067256 >> v1:172.21.15.131:6789/0 conn(0x7f544c159480 legacy=0x7f544c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f5449d9b700 1 -- 172.21.15.84:0/4094067256 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c0cb470 con 0x7f544c0cbc70 2023-10-06T03:25:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f544ad9d700 1 --2- 172.21.15.84:0/4094067256 >> v2:172.21.15.131:3300/0 conn(0x7f544c0b2140 0x7f544c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.939+0000 7f5449d9b700 1 --2- 172.21.15.84:0/4094067256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c0cbc70 0x7f544c0cc0c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f544c0ca830 tx=0x7f5434009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9628a868b5f0ceec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544959a700 1 -- 172.21.15.84:0/4094067256 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400b820 con 0x7f544c0cbc70 2023-10-06T03:25:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544959a700 1 -- 172.21.15.84:0/4094067256 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543400b980 con 0x7f544c0cbc70 2023-10-06T03:25:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544959a700 1 -- 172.21.15.84:0/4094067256 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400bd20 con 0x7f544c0cbc70 2023-10-06T03:25:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544b59e700 1 -- 172.21.15.84:0/4094067256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c0cbc70 msgr2=0x7f544c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544b59e700 1 --2- 172.21.15.84:0/4094067256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c0cbc70 0x7f544c0cc0c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f544c0ca830 tx=0x7f5434009250 comp rx=0 tx=0).stop 2023-10-06T03:25:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544b59e700 1 -- 172.21.15.84:0/4094067256 shutdown_connections 2023-10-06T03:25:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544b59e700 1 --2- 172.21.15.84:0/4094067256 >> v2:172.21.15.131:3300/0 conn(0x7f544c0b2140 0x7f544c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544b59e700 1 --2- 172.21.15.84:0/4094067256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c0cbc70 0x7f544c0cc0c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544b59e700 1 -- 172.21.15.84:0/4094067256 >> 172.21.15.84:0/4094067256 conn(0x7f544c06ed20 msgr2=0x7f544c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544b59e700 1 -- 172.21.15.84:0/4094067256 shutdown_connections 2023-10-06T03:25:25.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.940+0000 7f544b59e700 1 -- 172.21.15.84:0/4094067256 wait complete. 2023-10-06T03:25:25.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.941+0000 7f544b59e700 1 Processor -- start 2023-10-06T03:25:25.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.941+0000 7f544b59e700 1 -- start start 2023-10-06T03:25:25.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544b59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f544c0b2140 0x7f544c0d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544b59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f544c0cbc70 0x7f544c154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c159480 0x7f544c0c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544b59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c15e0b0 con 0x7f544c159480 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544b59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c15d4a0 con 0x7f544c0b2140 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544b59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c15d780 con 0x7f544c0cbc70 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c159480 0x7f544c0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c159480 0x7f544c0c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33364/0 (socket says 172.21.15.84:33364) 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544ad9d700 1 -- 172.21.15.84:0/3089063728 learned_addr learned my addr 172.21.15.84:0/3089063728 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f5449d9b700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f544c0cbc70 0x7f544c154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544a59c700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f544c0b2140 0x7f544c0d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544ad9d700 1 -- 172.21.15.84:0/3089063728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f544c0cbc70 msgr2=0x7f544c154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544ad9d700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f544c0cbc70 0x7f544c154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544ad9d700 1 -- 172.21.15.84:0/3089063728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f544c0b2140 msgr2=0x7f544c0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544ad9d700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f544c0b2140 0x7f544c0d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.942+0000 7f544ad9d700 1 -- 172.21.15.84:0/3089063728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54340094f0 con 0x7f544c159480 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.943+0000 7f544ad9d700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c159480 0x7f544c0c5c50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f543c00a380 tx=0x7f543c007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.943+0000 7f54427fc700 1 -- 172.21.15.84:0/3089063728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c00ae10 con 0x7f544c159480 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.943+0000 7f54427fc700 1 -- 172.21.15.84:0/3089063728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c00d650 con 0x7f544c159480 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.943+0000 7f544b59e700 1 -- 172.21.15.84:0/3089063728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544c15da60 con 0x7f544c159480 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.943+0000 7f54427fc700 1 -- 172.21.15.84:0/3089063728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c00da10 con 0x7f544c159480 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.943+0000 7f544b59e700 1 -- 172.21.15.84:0/3089063728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544c0d0720 con 0x7f544c159480 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.943+0000 7f544b59e700 1 -- 172.21.15.84:0/3089063728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544c15e220 con 0x7f544c159480 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.944+0000 7f54427fc700 1 -- 172.21.15.84:0/3089063728 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f543c01e3b0 con 0x7f544c159480 2023-10-06T03:25:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.944+0000 7f54427fc700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f542c066f30 0x7f542c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.944+0000 7f544a59c700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f542c066f30 0x7f542c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.945+0000 7f54427fc700 1 -- 172.21.15.84:0/3089063728 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f543c085220 con 0x7f544c159480 2023-10-06T03:25:25.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.945+0000 7f544a59c700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f542c066f30 0x7f542c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5444006fd0 tx=0x7f5444008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:25.949+0000 7f54427fc700 1 -- 172.21.15.84:0/3089063728 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f543c0521f0 con 0x7f544c159480 2023-10-06T03:25:26.020 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:25:26.019+0000 7f56ee6e6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:25:26.046 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:26.049 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:26.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.132+0000 7f544b59e700 1 -- 172.21.15.84:0/3089063728 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f544c05f270 con 0x7f542c066f30 2023-10-06T03:25:26.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.140+0000 7f54427fc700 1 -- 172.21.15.84:0/3089063728 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311288 (secure 0 0 0) 0x7f544c05f270 con 0x7f542c066f30 2023-10-06T03:25:26.145 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:26.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 -- 172.21.15.84:0/3089063728 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f542c066f30 msgr2=0x7f542c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f542c066f30 0x7f542c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5444006fd0 tx=0x7f5444008040 comp rx=0 tx=0).stop 2023-10-06T03:25:26.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 -- 172.21.15.84:0/3089063728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c159480 msgr2=0x7f544c0c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c159480 0x7f544c0c5c50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f543c00a380 tx=0x7f543c007900 comp rx=0 tx=0).stop 2023-10-06T03:25:26.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 -- 172.21.15.84:0/3089063728 shutdown_connections 2023-10-06T03:25:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f542c066f30 0x7f542c0693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f544c0b2140 0x7f544c0d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f544c159480 0x7f544c0c5c50 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 --2- 172.21.15.84:0/3089063728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f544c0cbc70 0x7f544c154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 -- 172.21.15.84:0/3089063728 >> 172.21.15.84:0/3089063728 conn(0x7f544c06ed20 msgr2=0x7f544c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 -- 172.21.15.84:0/3089063728 shutdown_connections 2023-10-06T03:25:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.143+0000 7f544b59e700 1 -- 172.21.15.84:0/3089063728 wait complete. 2023-10-06T03:25:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:25:26.156 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-06T03:25:25.060690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384096,"kb_used_data":5792,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590624,"statfs":{"total":773094113280,"available":770652798976,"internally_reserved":0,"allocated":5931008,"data_stored":3327502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.342051"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.349517+0000","last_change":"2023-10-06T03:25:21.349517+0000","last_active":"2023-10-06T03:25:21.349517+0000","last_peered":"2023-10-06T03:25:21.349517+0000","last_clean":"2023-10-06T03:25:21.349517+0000","last_became_active":"2023-10-06T03:25:21.349263+0000","last_became_peered":"2023-10-06T03:25:21.349263+0000","last_unstale":"2023-10-06T03:25:21.349517+0000","last_undegraded":"2023-10-06T03:25:21.349517+0000","last_fullsized":"2023-10-06T03:25:21.349517+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:02.512702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357832+0000","last_change":"2023-10-06T03:25:21.354552+0000","last_active":"2023-10-06T03:25:21.357832+0000","last_peered":"2023-10-06T03:25:21.357832+0000","last_clean":"2023-10-06T03:25:21.357832+0000","last_became_active":"2023-10-06T03:25:21.354308+0000","last_became_peered":"2023-10-06T03:25:21.354308+0000","last_unstale":"2023-10-06T03:25:21.357832+0000","last_undegraded":"2023-10-06T03:25:21.357832+0000","last_fullsized":"2023-10-06T03:25:21.357832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:53.114728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.368877+0000","last_change":"2023-10-06T03:25:21.362461+0000","last_active":"2023-10-06T03:25:21.368877+0000","last_peered":"2023-10-06T03:25:21.368877+0000","last_clean":"2023-10-06T03:25:21.368877+0000","last_became_active":"2023-10-06T03:25:21.362193+0000","last_became_peered":"2023-10-06T03:25:21.362193+0000","last_unstale":"2023-10-06T03:25:21.368877+0000","last_undegraded":"2023-10-06T03:25:21.368877+0000","last_fullsized":"2023-10-06T03:25:21.368877+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.559930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.360758+0000","last_change":"2023-10-06T03:25:21.360758+0000","last_active":"2023-10-06T03:25:21.360758+0000","last_peered":"2023-10-06T03:25:21.360758+0000","last_clean":"2023-10-06T03:25:21.360758+0000","last_became_active":"2023-10-06T03:25:21.360566+0000","last_became_peered":"2023-10-06T03:25:21.360566+0000","last_unstale":"2023-10-06T03:25:21.360758+0000","last_undegraded":"2023-10-06T03:25:21.360758+0000","last_fullsized":"2023-10-06T03:25:21.360758+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:11.569466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357530+0000","last_change":"2023-10-06T03:25:21.357530+0000","last_active":"2023-10-06T03:25:21.357530+0000","last_peered":"2023-10-06T03:25:21.357530+0000","last_clean":"2023-10-06T03:25:21.357530+0000","last_became_active":"2023-10-06T03:25:21.357139+0000","last_became_peered":"2023-10-06T03:25:21.357139+0000","last_unstale":"2023-10-06T03:25:21.357530+0000","last_undegraded":"2023-10-06T03:25:21.357530+0000","last_fullsized":"2023-10-06T03:25:21.357530+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:41.144266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.347707+0000","last_change":"2023-10-06T03:25:21.347707+0000","last_active":"2023-10-06T03:25:21.347707+0000","last_peered":"2023-10-06T03:25:21.347707+0000","last_clean":"2023-10-06T03:25:21.347707+0000","last_became_active":"2023-10-06T03:25:21.347466+0000","last_became_peered":"2023-10-06T03:25:21.347466+0000","last_unstale":"2023-10-06T03:25:21.347707+0000","last_undegraded":"2023-10-06T03:25:21.347707+0000","last_fullsized":"2023-10-06T03:25:21.347707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:42.094179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.364013+0000","last_change":"2023-10-06T03:25:21.357272+0000","last_active":"2023-10-06T03:25:21.364013+0000","last_peered":"2023-10-06T03:25:21.364013+0000","last_clean":"2023-10-06T03:25:21.364013+0000","last_became_active":"2023-10-06T03:25:21.356972+0000","last_became_peered":"2023-10-06T03:25:21.356972+0000","last_unstale":"2023-10-06T03:25:21.364013+0000","last_undegraded":"2023-10-06T03:25:21.364013+0000","last_fullsized":"2023-10-06T03:25:21.364013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:42.094179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.368068+0000","last_change":"2023-10-06T03:25:21.362719+0000","last_active":"2023-10-06T03:25:21.368068+0000","last_peered":"2023-10-06T03:25:21.368068+0000","last_clean":"2023-10-06T03:25:21.368068+0000","last_became_active":"2023-10-06T03:25:21.362469+0000","last_became_peered":"2023-10-06T03:25:21.362469+0000","last_unstale":"2023-10-06T03:25:21.368068+0000","last_undegraded":"2023-10-06T03:25:21.368068+0000","last_fullsized":"2023-10-06T03:25:21.368068+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:21.078598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.363920+0000","last_change":"2023-10-06T03:25:21.355929+0000","last_active":"2023-10-06T03:25:21.363920+0000","last_peered":"2023-10-06T03:25:21.363920+0000","last_clean":"2023-10-06T03:25:21.363920+0000","last_became_active":"2023-10-06T03:25:21.355639+0000","last_became_peered":"2023-10-06T03:25:21.355639+0000","last_unstale":"2023-10-06T03:25:21.363920+0000","last_undegraded":"2023-10-06T03:25:21.363920+0000","last_fullsized":"2023-10-06T03:25:21.363920+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:30.136486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.351044+0000","last_change":"2023-10-06T03:25:21.351044+0000","last_active":"2023-10-06T03:25:21.351044+0000","last_peered":"2023-10-06T03:25:21.351044+0000","last_clean":"2023-10-06T03:25:21.351044+0000","last_became_active":"2023-10-06T03:25:21.350789+0000","last_became_peered":"2023-10-06T03:25:21.350789+0000","last_unstale":"2023-10-06T03:25:21.351044+0000","last_undegraded":"2023-10-06T03:25:21.351044+0000","last_fullsized":"2023-10-06T03:25:21.351044+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:28.535460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.352168+0000","last_change":"2023-10-06T03:25:21.352168+0000","last_active":"2023-10-06T03:25:21.352168+0000","last_peered":"2023-10-06T03:25:21.352168+0000","last_clean":"2023-10-06T03:25:21.352168+0000","last_became_active":"2023-10-06T03:25:21.351910+0000","last_became_peered":"2023-10-06T03:25:21.351910+0000","last_unstale":"2023-10-06T03:25:21.352168+0000","last_undegraded":"2023-10-06T03:25:21.352168+0000","last_fullsized":"2023-10-06T03:25:21.352168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:49.528962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359513+0000","last_change":"2023-10-06T03:25:21.359513+0000","last_active":"2023-10-06T03:25:21.359513+0000","last_peered":"2023-10-06T03:25:21.359513+0000","last_clean":"2023-10-06T03:25:21.359513+0000","last_became_active":"2023-10-06T03:25:21.359214+0000","last_became_peered":"2023-10-06T03:25:21.359214+0000","last_unstale":"2023-10-06T03:25:21.359513+0000","last_undegraded":"2023-10-06T03:25:21.359513+0000","last_fullsized":"2023-10-06T03:25:21.359513+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:55.021449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358671+0000","last_change":"2023-10-06T03:25:21.354844+0000","last_active":"2023-10-06T03:25:21.358671+0000","last_peered":"2023-10-06T03:25:21.358671+0000","last_clean":"2023-10-06T03:25:21.358671+0000","last_became_active":"2023-10-06T03:25:21.354554+0000","last_became_peered":"2023-10-06T03:25:21.354554+0000","last_unstale":"2023-10-06T03:25:21.358671+0000","last_undegraded":"2023-10-06T03:25:21.358671+0000","last_fullsized":"2023-10-06T03:25:21.358671+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.988433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.363976+0000","last_change":"2023-10-06T03:25:21.355953+0000","last_active":"2023-10-06T03:25:21.363976+0000","last_peered":"2023-10-06T03:25:21.363976+0000","last_clean":"2023-10-06T03:25:21.363976+0000","last_became_active":"2023-10-06T03:25:21.355658+0000","last_became_peered":"2023-10-06T03:25:21.355658+0000","last_unstale":"2023-10-06T03:25:21.363976+0000","last_undegraded":"2023-10-06T03:25:21.363976+0000","last_fullsized":"2023-10-06T03:25:21.363976+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:16.145387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.363882+0000","last_change":"2023-10-06T03:25:21.354619+0000","last_active":"2023-10-06T03:25:21.363882+0000","last_peered":"2023-10-06T03:25:21.363882+0000","last_clean":"2023-10-06T03:25:21.363882+0000","last_became_active":"2023-10-06T03:25:21.354343+0000","last_became_peered":"2023-10-06T03:25:21.354343+0000","last_unstale":"2023-10-06T03:25:21.363882+0000","last_undegraded":"2023-10-06T03:25:21.363882+0000","last_fullsized":"2023-10-06T03:25:21.363882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:52.441557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.349606+0000","last_change":"2023-10-06T03:25:21.349606+0000","last_active":"2023-10-06T03:25:21.349606+0000","last_peered":"2023-10-06T03:25:21.349606+0000","last_clean":"2023-10-06T03:25:21.349606+0000","last_became_active":"2023-10-06T03:25:21.349350+0000","last_became_peered":"2023-10-06T03:25:21.349350+0000","last_unstale":"2023-10-06T03:25:21.349606+0000","last_undegraded":"2023-10-06T03:25:21.349606+0000","last_fullsized":"2023-10-06T03:25:21.349606+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:40.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357748+0000","last_change":"2023-10-06T03:25:21.354628+0000","last_active":"2023-10-06T03:25:21.357748+0000","last_peered":"2023-10-06T03:25:21.357748+0000","last_clean":"2023-10-06T03:25:21.357748+0000","last_became_active":"2023-10-06T03:25:21.354348+0000","last_became_peered":"2023-10-06T03:25:21.354348+0000","last_unstale":"2023-10-06T03:25:21.357748+0000","last_undegraded":"2023-10-06T03:25:21.357748+0000","last_fullsized":"2023-10-06T03:25:21.357748+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:07.236477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.355362+0000","last_change":"2023-10-06T03:25:21.352064+0000","last_active":"2023-10-06T03:25:21.355362+0000","last_peered":"2023-10-06T03:25:21.355362+0000","last_clean":"2023-10-06T03:25:21.355362+0000","last_became_active":"2023-10-06T03:25:21.351324+0000","last_became_peered":"2023-10-06T03:25:21.351324+0000","last_unstale":"2023-10-06T03:25:21.355362+0000","last_undegraded":"2023-10-06T03:25:21.355362+0000","last_fullsized":"2023-10-06T03:25:21.355362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:23.487295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.353912+0000","last_change":"2023-10-06T03:25:21.353912+0000","last_active":"2023-10-06T03:25:21.353912+0000","last_peered":"2023-10-06T03:25:21.353912+0000","last_clean":"2023-10-06T03:25:21.353912+0000","last_became_active":"2023-10-06T03:25:21.353549+0000","last_became_peered":"2023-10-06T03:25:21.353549+0000","last_unstale":"2023-10-06T03:25:21.353912+0000","last_undegraded":"2023-10-06T03:25:21.353912+0000","last_fullsized":"2023-10-06T03:25:21.353912+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:02.231550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.354872+0000","last_change":"2023-10-06T03:25:21.349666+0000","last_active":"2023-10-06T03:25:21.354872+0000","last_peered":"2023-10-06T03:25:21.354872+0000","last_clean":"2023-10-06T03:25:21.354872+0000","last_became_active":"2023-10-06T03:25:21.349437+0000","last_became_peered":"2023-10-06T03:25:21.349437+0000","last_unstale":"2023-10-06T03:25:21.354872+0000","last_undegraded":"2023-10-06T03:25:21.354872+0000","last_fullsized":"2023-10-06T03:25:21.354872+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:35.000783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.361332+0000","last_change":"2023-10-06T03:25:21.358703+0000","last_active":"2023-10-06T03:25:21.361332+0000","last_peered":"2023-10-06T03:25:21.361332+0000","last_clean":"2023-10-06T03:25:21.361332+0000","last_became_active":"2023-10-06T03:25:21.358447+0000","last_became_peered":"2023-10-06T03:25:21.358447+0000","last_unstale":"2023-10-06T03:25:21.361332+0000","last_undegraded":"2023-10-06T03:25:21.361332+0000","last_fullsized":"2023-10-06T03:25:21.361332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:35.334273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357754+0000","last_change":"2023-10-06T03:25:21.352533+0000","last_active":"2023-10-06T03:25:21.357754+0000","last_peered":"2023-10-06T03:25:21.357754+0000","last_clean":"2023-10-06T03:25:21.357754+0000","last_became_active":"2023-10-06T03:25:21.352296+0000","last_became_peered":"2023-10-06T03:25:21.352296+0000","last_unstale":"2023-10-06T03:25:21.357754+0000","last_undegraded":"2023-10-06T03:25:21.357754+0000","last_fullsized":"2023-10-06T03:25:21.357754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:53.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358012+0000","last_change":"2023-10-06T03:25:21.353941+0000","last_active":"2023-10-06T03:25:21.358012+0000","last_peered":"2023-10-06T03:25:21.358012+0000","last_clean":"2023-10-06T03:25:21.358012+0000","last_became_active":"2023-10-06T03:25:21.353617+0000","last_became_peered":"2023-10-06T03:25:21.353617+0000","last_unstale":"2023-10-06T03:25:21.358012+0000","last_undegraded":"2023-10-06T03:25:21.358012+0000","last_fullsized":"2023-10-06T03:25:21.358012+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:29.834173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358676+0000","last_change":"2023-10-06T03:25:21.354967+0000","last_active":"2023-10-06T03:25:21.358676+0000","last_peered":"2023-10-06T03:25:21.358676+0000","last_clean":"2023-10-06T03:25:21.358676+0000","last_became_active":"2023-10-06T03:25:21.354656+0000","last_became_peered":"2023-10-06T03:25:21.354656+0000","last_unstale":"2023-10-06T03:25:21.358676+0000","last_undegraded":"2023-10-06T03:25:21.358676+0000","last_fullsized":"2023-10-06T03:25:21.358676+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:44.482597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.355231+0000","last_change":"2023-10-06T03:25:21.355231+0000","last_active":"2023-10-06T03:25:21.355231+0000","last_peered":"2023-10-06T03:25:21.355231+0000","last_clean":"2023-10-06T03:25:21.355231+0000","last_became_active":"2023-10-06T03:25:21.354904+0000","last_became_peered":"2023-10-06T03:25:21.354904+0000","last_unstale":"2023-10-06T03:25:21.355231+0000","last_undegraded":"2023-10-06T03:25:21.355231+0000","last_fullsized":"2023-10-06T03:25:21.355231+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:39.557149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.362826+0000","last_change":"2023-10-06T03:25:21.362826+0000","last_active":"2023-10-06T03:25:21.362826+0000","last_peered":"2023-10-06T03:25:21.362826+0000","last_clean":"2023-10-06T03:25:21.362826+0000","last_became_active":"2023-10-06T03:25:21.362548+0000","last_became_peered":"2023-10-06T03:25:21.362548+0000","last_unstale":"2023-10-06T03:25:21.362826+0000","last_undegraded":"2023-10-06T03:25:21.362826+0000","last_fullsized":"2023-10-06T03:25:21.362826+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:29.292113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.349584+0000","last_change":"2023-10-06T03:25:21.349584+0000","last_active":"2023-10-06T03:25:21.349584+0000","last_peered":"2023-10-06T03:25:21.349584+0000","last_clean":"2023-10-06T03:25:21.349584+0000","last_became_active":"2023-10-06T03:25:21.349333+0000","last_became_peered":"2023-10-06T03:25:21.349333+0000","last_unstale":"2023-10-06T03:25:21.349584+0000","last_undegraded":"2023-10-06T03:25:21.349584+0000","last_fullsized":"2023-10-06T03:25:21.349584+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:35.000783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357602+0000","last_change":"2023-10-06T03:25:21.357602+0000","last_active":"2023-10-06T03:25:21.357602+0000","last_peered":"2023-10-06T03:25:21.357602+0000","last_clean":"2023-10-06T03:25:21.357602+0000","last_became_active":"2023-10-06T03:25:21.357343+0000","last_became_peered":"2023-10-06T03:25:21.357343+0000","last_unstale":"2023-10-06T03:25:21.357602+0000","last_undegraded":"2023-10-06T03:25:21.357602+0000","last_fullsized":"2023-10-06T03:25:21.357602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:45.905066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.360095+0000","last_change":"2023-10-06T03:25:21.359523+0000","last_active":"2023-10-06T03:25:21.360095+0000","last_peered":"2023-10-06T03:25:21.360095+0000","last_clean":"2023-10-06T03:25:21.360095+0000","last_became_active":"2023-10-06T03:25:21.359264+0000","last_became_peered":"2023-10-06T03:25:21.359264+0000","last_unstale":"2023-10-06T03:25:21.360095+0000","last_undegraded":"2023-10-06T03:25:21.360095+0000","last_fullsized":"2023-10-06T03:25:21.360095+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:19.910252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359158+0000","last_change":"2023-10-06T03:25:21.357238+0000","last_active":"2023-10-06T03:25:21.359158+0000","last_peered":"2023-10-06T03:25:21.359158+0000","last_clean":"2023-10-06T03:25:21.359158+0000","last_became_active":"2023-10-06T03:25:21.356957+0000","last_became_peered":"2023-10-06T03:25:21.356957+0000","last_unstale":"2023-10-06T03:25:21.359158+0000","last_undegraded":"2023-10-06T03:25:21.359158+0000","last_fullsized":"2023-10-06T03:25:21.359158+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:29.292113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.355300+0000","last_change":"2023-10-06T03:25:21.355300+0000","last_active":"2023-10-06T03:25:21.355300+0000","last_peered":"2023-10-06T03:25:21.355300+0000","last_clean":"2023-10-06T03:25:21.355300+0000","last_became_active":"2023-10-06T03:25:21.355021+0000","last_became_peered":"2023-10-06T03:25:21.355021+0000","last_unstale":"2023-10-06T03:25:21.355300+0000","last_undegraded":"2023-10-06T03:25:21.355300+0000","last_fullsized":"2023-10-06T03:25:21.355300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:15.985118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.351103+0000","last_change":"2023-10-06T03:25:21.351103+0000","last_active":"2023-10-06T03:25:21.351103+0000","last_peered":"2023-10-06T03:25:21.351103+0000","last_clean":"2023-10-06T03:25:21.351103+0000","last_became_active":"2023-10-06T03:25:21.350849+0000","last_became_peered":"2023-10-06T03:25:21.350849+0000","last_unstale":"2023-10-06T03:25:21.351103+0000","last_undegraded":"2023-10-06T03:25:21.351103+0000","last_fullsized":"2023-10-06T03:25:21.351103+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:16.145387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.348981+0000","last_change":"2023-10-06T03:25:21.348981+0000","last_active":"2023-10-06T03:25:21.348981+0000","last_peered":"2023-10-06T03:25:21.348981+0000","last_clean":"2023-10-06T03:25:21.348981+0000","last_became_active":"2023-10-06T03:25:21.348719+0000","last_became_peered":"2023-10-06T03:25:21.348719+0000","last_unstale":"2023-10-06T03:25:21.348981+0000","last_undegraded":"2023-10-06T03:25:21.348981+0000","last_fullsized":"2023-10-06T03:25:21.348981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:53.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.748919+0000","last_change":"2023-10-06T03:25:20.743230+0000","last_active":"2023-10-06T03:25:21.748919+0000","last_peered":"2023-10-06T03:25:21.748919+0000","last_clean":"2023-10-06T03:25:21.748919+0000","last_became_active":"2023-10-06T03:25:20.742982+0000","last_became_peered":"2023-10-06T03:25:20.742982+0000","last_unstale":"2023-10-06T03:25:21.748919+0000","last_undegraded":"2023-10-06T03:25:21.748919+0000","last_fullsized":"2023-10-06T03:25:21.748919+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:33.060095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.353051+0000","last_change":"2023-10-06T03:25:21.353051+0000","last_active":"2023-10-06T03:25:21.353051+0000","last_peered":"2023-10-06T03:25:21.353051+0000","last_clean":"2023-10-06T03:25:21.353051+0000","last_became_active":"2023-10-06T03:25:21.352527+0000","last_became_peered":"2023-10-06T03:25:21.352527+0000","last_unstale":"2023-10-06T03:25:21.353051+0000","last_undegraded":"2023-10-06T03:25:21.353051+0000","last_fullsized":"2023-10-06T03:25:21.353051+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:46.058709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.743560+0000","last_change":"2023-10-06T03:25:20.735679+0000","last_active":"2023-10-06T03:25:21.743560+0000","last_peered":"2023-10-06T03:25:21.743560+0000","last_clean":"2023-10-06T03:25:21.743560+0000","last_became_active":"2023-10-06T03:25:20.735445+0000","last_became_peered":"2023-10-06T03:25:20.735445+0000","last_unstale":"2023-10-06T03:25:21.743560+0000","last_undegraded":"2023-10-06T03:25:21.743560+0000","last_fullsized":"2023-10-06T03:25:21.743560+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:33.550055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.347880+0000","last_change":"2023-10-06T03:25:21.347880+0000","last_active":"2023-10-06T03:25:21.347880+0000","last_peered":"2023-10-06T03:25:21.347880+0000","last_clean":"2023-10-06T03:25:21.347880+0000","last_became_active":"2023-10-06T03:25:21.347647+0000","last_became_peered":"2023-10-06T03:25:21.347647+0000","last_unstale":"2023-10-06T03:25:21.347880+0000","last_undegraded":"2023-10-06T03:25:21.347880+0000","last_fullsized":"2023-10-06T03:25:21.347880+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:00.883246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744229+0000","last_change":"2023-10-06T03:25:20.736506+0000","last_active":"2023-10-06T03:25:21.744229+0000","last_peered":"2023-10-06T03:25:21.744229+0000","last_clean":"2023-10-06T03:25:21.744229+0000","last_became_active":"2023-10-06T03:25:20.736253+0000","last_became_peered":"2023-10-06T03:25:20.736253+0000","last_unstale":"2023-10-06T03:25:21.744229+0000","last_undegraded":"2023-10-06T03:25:21.744229+0000","last_fullsized":"2023-10-06T03:25:21.744229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:53.486571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358375+0000","last_change":"2023-10-06T03:25:21.358375+0000","last_active":"2023-10-06T03:25:21.358375+0000","last_peered":"2023-10-06T03:25:21.358375+0000","last_clean":"2023-10-06T03:25:21.358375+0000","last_became_active":"2023-10-06T03:25:21.357798+0000","last_became_peered":"2023-10-06T03:25:21.357798+0000","last_unstale":"2023-10-06T03:25:21.358375+0000","last_undegraded":"2023-10-06T03:25:21.358375+0000","last_fullsized":"2023-10-06T03:25:21.358375+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.020799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744523+0000","last_change":"2023-10-06T03:25:20.741939+0000","last_active":"2023-10-06T03:25:21.744523+0000","last_peered":"2023-10-06T03:25:21.744523+0000","last_clean":"2023-10-06T03:25:21.744523+0000","last_became_active":"2023-10-06T03:25:20.741684+0000","last_became_peered":"2023-10-06T03:25:20.741684+0000","last_unstale":"2023-10-06T03:25:21.744523+0000","last_undegraded":"2023-10-06T03:25:21.744523+0000","last_fullsized":"2023-10-06T03:25:21.744523+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:38.851515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.355930+0000","last_change":"2023-10-06T03:25:21.352202+0000","last_active":"2023-10-06T03:25:21.355930+0000","last_peered":"2023-10-06T03:25:21.355930+0000","last_clean":"2023-10-06T03:25:21.355930+0000","last_became_active":"2023-10-06T03:25:21.351965+0000","last_became_peered":"2023-10-06T03:25:21.351965+0000","last_unstale":"2023-10-06T03:25:21.355930+0000","last_undegraded":"2023-10-06T03:25:21.355930+0000","last_fullsized":"2023-10-06T03:25:21.355930+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.020799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744007+0000","last_change":"2023-10-06T03:25:20.738325+0000","last_active":"2023-10-06T03:25:21.744007+0000","last_peered":"2023-10-06T03:25:21.744007+0000","last_clean":"2023-10-06T03:25:21.744007+0000","last_became_active":"2023-10-06T03:25:20.738077+0000","last_became_peered":"2023-10-06T03:25:20.738077+0000","last_unstale":"2023-10-06T03:25:21.744007+0000","last_undegraded":"2023-10-06T03:25:21.744007+0000","last_fullsized":"2023-10-06T03:25:21.744007+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:54.011573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357688+0000","last_change":"2023-10-06T03:25:21.353232+0000","last_active":"2023-10-06T03:25:21.357688+0000","last_peered":"2023-10-06T03:25:21.357688+0000","last_clean":"2023-10-06T03:25:21.357688+0000","last_became_active":"2023-10-06T03:25:21.352954+0000","last_became_peered":"2023-10-06T03:25:21.352954+0000","last_unstale":"2023-10-06T03:25:21.357688+0000","last_undegraded":"2023-10-06T03:25:21.357688+0000","last_fullsized":"2023-10-06T03:25:21.357688+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:40.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.339435+0000","last_change":"2023-10-06T03:25:20.738130+0000","last_active":"2023-10-06T03:25:21.339435+0000","last_peered":"2023-10-06T03:25:21.339435+0000","last_clean":"2023-10-06T03:25:21.339435+0000","last_became_active":"2023-10-06T03:25:20.737896+0000","last_became_peered":"2023-10-06T03:25:20.737896+0000","last_unstale":"2023-10-06T03:25:21.339435+0000","last_undegraded":"2023-10-06T03:25:21.339435+0000","last_fullsized":"2023-10-06T03:25:21.339435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:10.559590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358653+0000","last_change":"2023-10-06T03:25:21.353699+0000","last_active":"2023-10-06T03:25:21.358653+0000","last_peered":"2023-10-06T03:25:21.358653+0000","last_clean":"2023-10-06T03:25:21.358653+0000","last_became_active":"2023-10-06T03:25:21.353423+0000","last_became_peered":"2023-10-06T03:25:21.353423+0000","last_unstale":"2023-10-06T03:25:21.358653+0000","last_undegraded":"2023-10-06T03:25:21.358653+0000","last_fullsized":"2023-10-06T03:25:21.358653+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:41.890988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.742403+0000","last_change":"2023-10-06T03:25:20.741344+0000","last_active":"2023-10-06T03:25:20.742403+0000","last_peered":"2023-10-06T03:25:20.742403+0000","last_clean":"2023-10-06T03:25:20.742403+0000","last_became_active":"2023-10-06T03:25:20.741075+0000","last_became_peered":"2023-10-06T03:25:20.741075+0000","last_unstale":"2023-10-06T03:25:20.742403+0000","last_undegraded":"2023-10-06T03:25:20.742403+0000","last_fullsized":"2023-10-06T03:25:20.742403+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:06.366935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359105+0000","last_change":"2023-10-06T03:25:21.357056+0000","last_active":"2023-10-06T03:25:21.359105+0000","last_peered":"2023-10-06T03:25:21.359105+0000","last_clean":"2023-10-06T03:25:21.359105+0000","last_became_active":"2023-10-06T03:25:21.356855+0000","last_became_peered":"2023-10-06T03:25:21.356855+0000","last_unstale":"2023-10-06T03:25:21.359105+0000","last_undegraded":"2023-10-06T03:25:21.359105+0000","last_fullsized":"2023-10-06T03:25:21.359105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:06.558071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.345345+0000","last_change":"2023-10-06T03:25:20.743465+0000","last_active":"2023-10-06T03:25:21.345345+0000","last_peered":"2023-10-06T03:25:21.345345+0000","last_clean":"2023-10-06T03:25:21.345345+0000","last_became_active":"2023-10-06T03:25:20.743217+0000","last_became_peered":"2023-10-06T03:25:20.743217+0000","last_unstale":"2023-10-06T03:25:21.345345+0000","last_undegraded":"2023-10-06T03:25:21.345345+0000","last_fullsized":"2023-10-06T03:25:21.345345+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:28.824297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.366230+0000","last_change":"2023-10-06T03:25:21.361870+0000","last_active":"2023-10-06T03:25:21.366230+0000","last_peered":"2023-10-06T03:25:21.366230+0000","last_clean":"2023-10-06T03:25:21.366230+0000","last_became_active":"2023-10-06T03:25:21.361628+0000","last_became_peered":"2023-10-06T03:25:21.361628+0000","last_unstale":"2023-10-06T03:25:21.366230+0000","last_undegraded":"2023-10-06T03:25:21.366230+0000","last_fullsized":"2023-10-06T03:25:21.366230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:29.486346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.342099+0000","last_change":"2023-10-06T03:25:20.743426+0000","last_active":"2023-10-06T03:25:21.342099+0000","last_peered":"2023-10-06T03:25:21.342099+0000","last_clean":"2023-10-06T03:25:21.342099+0000","last_became_active":"2023-10-06T03:25:20.742181+0000","last_became_peered":"2023-10-06T03:25:20.742181+0000","last_unstale":"2023-10-06T03:25:21.342099+0000","last_undegraded":"2023-10-06T03:25:21.342099+0000","last_fullsized":"2023-10-06T03:25:21.342099+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:49.191584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.355220+0000","last_change":"2023-10-06T03:25:21.352034+0000","last_active":"2023-10-06T03:25:21.355220+0000","last_peered":"2023-10-06T03:25:21.355220+0000","last_clean":"2023-10-06T03:25:21.355220+0000","last_became_active":"2023-10-06T03:25:21.351504+0000","last_became_peered":"2023-10-06T03:25:21.351504+0000","last_unstale":"2023-10-06T03:25:21.355220+0000","last_undegraded":"2023-10-06T03:25:21.355220+0000","last_fullsized":"2023-10-06T03:25:21.355220+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:11.569466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.348824+0000","last_change":"2023-10-06T03:25:20.738342+0000","last_active":"2023-10-06T03:25:21.348824+0000","last_peered":"2023-10-06T03:25:21.348824+0000","last_clean":"2023-10-06T03:25:21.348824+0000","last_became_active":"2023-10-06T03:25:20.737081+0000","last_became_peered":"2023-10-06T03:25:20.737081+0000","last_unstale":"2023-10-06T03:25:21.348824+0000","last_undegraded":"2023-10-06T03:25:21.348824+0000","last_fullsized":"2023-10-06T03:25:21.348824+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:54.011573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.361944+0000","last_change":"2023-10-06T03:25:21.361944+0000","last_active":"2023-10-06T03:25:21.361944+0000","last_peered":"2023-10-06T03:25:21.361944+0000","last_clean":"2023-10-06T03:25:21.361944+0000","last_became_active":"2023-10-06T03:25:21.361784+0000","last_became_peered":"2023-10-06T03:25:21.361784+0000","last_unstale":"2023-10-06T03:25:21.361944+0000","last_undegraded":"2023-10-06T03:25:21.361944+0000","last_fullsized":"2023-10-06T03:25:21.361944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:13.645325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744744+0000","last_change":"2023-10-06T03:25:20.736152+0000","last_active":"2023-10-06T03:25:21.744744+0000","last_peered":"2023-10-06T03:25:21.744744+0000","last_clean":"2023-10-06T03:25:21.744744+0000","last_became_active":"2023-10-06T03:25:20.735899+0000","last_became_peered":"2023-10-06T03:25:20.735899+0000","last_unstale":"2023-10-06T03:25:21.744744+0000","last_undegraded":"2023-10-06T03:25:21.744744+0000","last_fullsized":"2023-10-06T03:25:21.744744+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:49.292792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.352210+0000","last_change":"2023-10-06T03:25:21.347246+0000","last_active":"2023-10-06T03:25:21.352210+0000","last_peered":"2023-10-06T03:25:21.352210+0000","last_clean":"2023-10-06T03:25:21.352210+0000","last_became_active":"2023-10-06T03:25:21.346938+0000","last_became_peered":"2023-10-06T03:25:21.346938+0000","last_unstale":"2023-10-06T03:25:21.352210+0000","last_undegraded":"2023-10-06T03:25:21.352210+0000","last_fullsized":"2023-10-06T03:25:21.352210+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:15.669624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.756471+0000","last_change":"2023-10-06T03:25:20.743703+0000","last_active":"2023-10-06T03:25:21.756471+0000","last_peered":"2023-10-06T03:25:21.756471+0000","last_clean":"2023-10-06T03:25:21.756471+0000","last_became_active":"2023-10-06T03:25:20.743433+0000","last_became_peered":"2023-10-06T03:25:20.743433+0000","last_unstale":"2023-10-06T03:25:21.756471+0000","last_undegraded":"2023-10-06T03:25:21.756471+0000","last_fullsized":"2023-10-06T03:25:21.756471+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:53.486571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359224+0000","last_change":"2023-10-06T03:25:21.359224+0000","last_active":"2023-10-06T03:25:21.359224+0000","last_peered":"2023-10-06T03:25:21.359224+0000","last_clean":"2023-10-06T03:25:21.359224+0000","last_became_active":"2023-10-06T03:25:21.358929+0000","last_became_peered":"2023-10-06T03:25:21.358929+0000","last_unstale":"2023-10-06T03:25:21.359224+0000","last_undegraded":"2023-10-06T03:25:21.359224+0000","last_fullsized":"2023-10-06T03:25:21.359224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:34.069970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744843+0000","last_change":"2023-10-06T03:25:20.740651+0000","last_active":"2023-10-06T03:25:21.744843+0000","last_peered":"2023-10-06T03:25:21.744843+0000","last_clean":"2023-10-06T03:25:21.744843+0000","last_became_active":"2023-10-06T03:25:20.737032+0000","last_became_peered":"2023-10-06T03:25:20.737032+0000","last_unstale":"2023-10-06T03:25:21.744843+0000","last_undegraded":"2023-10-06T03:25:21.744843+0000","last_fullsized":"2023-10-06T03:25:21.744843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:10.559590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.351896+0000","last_change":"2023-10-06T03:25:21.349792+0000","last_active":"2023-10-06T03:25:21.351896+0000","last_peered":"2023-10-06T03:25:21.351896+0000","last_clean":"2023-10-06T03:25:21.351896+0000","last_became_active":"2023-10-06T03:25:21.349352+0000","last_became_peered":"2023-10-06T03:25:21.349352+0000","last_unstale":"2023-10-06T03:25:21.351896+0000","last_undegraded":"2023-10-06T03:25:21.351896+0000","last_fullsized":"2023-10-06T03:25:21.351896+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:10.994793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.346067+0000","last_change":"2023-10-06T03:25:20.734102+0000","last_active":"2023-10-06T03:25:21.346067+0000","last_peered":"2023-10-06T03:25:21.346067+0000","last_clean":"2023-10-06T03:25:21.346067+0000","last_became_active":"2023-10-06T03:25:20.733844+0000","last_became_peered":"2023-10-06T03:25:20.733844+0000","last_unstale":"2023-10-06T03:25:21.346067+0000","last_undegraded":"2023-10-06T03:25:21.346067+0000","last_fullsized":"2023-10-06T03:25:21.346067+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:01.221675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.363816+0000","last_change":"2023-10-06T03:25:21.354068+0000","last_active":"2023-10-06T03:25:21.363816+0000","last_peered":"2023-10-06T03:25:21.363816+0000","last_clean":"2023-10-06T03:25:21.363816+0000","last_became_active":"2023-10-06T03:25:21.353813+0000","last_became_peered":"2023-10-06T03:25:21.353813+0000","last_unstale":"2023-10-06T03:25:21.363816+0000","last_undegraded":"2023-10-06T03:25:21.363816+0000","last_fullsized":"2023-10-06T03:25:21.363816+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:16.414810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.741742+0000","last_change":"2023-10-06T03:25:20.735732+0000","last_active":"2023-10-06T03:25:20.741742+0000","last_peered":"2023-10-06T03:25:20.741742+0000","last_clean":"2023-10-06T03:25:20.741742+0000","last_became_active":"2023-10-06T03:25:20.735408+0000","last_became_peered":"2023-10-06T03:25:20.735408+0000","last_unstale":"2023-10-06T03:25:20.741742+0000","last_undegraded":"2023-10-06T03:25:20.741742+0000","last_fullsized":"2023-10-06T03:25:20.741742+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:51.770315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359109+0000","last_change":"2023-10-06T03:25:21.355609+0000","last_active":"2023-10-06T03:25:21.359109+0000","last_peered":"2023-10-06T03:25:21.359109+0000","last_clean":"2023-10-06T03:25:21.359109+0000","last_became_active":"2023-10-06T03:25:21.355186+0000","last_became_peered":"2023-10-06T03:25:21.355186+0000","last_unstale":"2023-10-06T03:25:21.359109+0000","last_undegraded":"2023-10-06T03:25:21.359109+0000","last_fullsized":"2023-10-06T03:25:21.359109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:34.069970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.745623+0000","last_change":"2023-10-06T03:25:20.741576+0000","last_active":"2023-10-06T03:25:21.745623+0000","last_peered":"2023-10-06T03:25:21.745623+0000","last_clean":"2023-10-06T03:25:21.745623+0000","last_became_active":"2023-10-06T03:25:20.741169+0000","last_became_peered":"2023-10-06T03:25:20.741169+0000","last_unstale":"2023-10-06T03:25:21.745623+0000","last_undegraded":"2023-10-06T03:25:21.745623+0000","last_fullsized":"2023-10-06T03:25:21.745623+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:48.519087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.356606+0000","last_change":"2023-10-06T03:25:21.356606+0000","last_active":"2023-10-06T03:25:21.356606+0000","last_peered":"2023-10-06T03:25:21.356606+0000","last_clean":"2023-10-06T03:25:21.356606+0000","last_became_active":"2023-10-06T03:25:21.356320+0000","last_became_peered":"2023-10-06T03:25:21.356320+0000","last_unstale":"2023-10-06T03:25:21.356606+0000","last_undegraded":"2023-10-06T03:25:21.356606+0000","last_fullsized":"2023-10-06T03:25:21.356606+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:15.669624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.748640+0000","last_change":"2023-10-06T03:25:20.734083+0000","last_active":"2023-10-06T03:25:21.748640+0000","last_peered":"2023-10-06T03:25:21.748640+0000","last_clean":"2023-10-06T03:25:21.748640+0000","last_became_active":"2023-10-06T03:25:20.733831+0000","last_became_peered":"2023-10-06T03:25:20.733831+0000","last_unstale":"2023-10-06T03:25:21.748640+0000","last_undegraded":"2023-10-06T03:25:21.748640+0000","last_fullsized":"2023-10-06T03:25:21.748640+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:36.284334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359994+0000","last_change":"2023-10-06T03:25:21.359994+0000","last_active":"2023-10-06T03:25:21.359994+0000","last_peered":"2023-10-06T03:25:21.359994+0000","last_clean":"2023-10-06T03:25:21.359994+0000","last_became_active":"2023-10-06T03:25:21.359611+0000","last_became_peered":"2023-10-06T03:25:21.359611+0000","last_unstale":"2023-10-06T03:25:21.359994+0000","last_undegraded":"2023-10-06T03:25:21.359994+0000","last_fullsized":"2023-10-06T03:25:21.359994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:29.834173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.744755+0000","last_change":"2023-10-06T03:25:20.737621+0000","last_active":"2023-10-06T03:25:20.744755+0000","last_peered":"2023-10-06T03:25:20.744755+0000","last_clean":"2023-10-06T03:25:20.744755+0000","last_became_active":"2023-10-06T03:25:20.737387+0000","last_became_peered":"2023-10-06T03:25:20.737387+0000","last_unstale":"2023-10-06T03:25:20.744755+0000","last_undegraded":"2023-10-06T03:25:20.744755+0000","last_fullsized":"2023-10-06T03:25:20.744755+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:54.011573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.362091+0000","last_change":"2023-10-06T03:25:21.362091+0000","last_active":"2023-10-06T03:25:21.362091+0000","last_peered":"2023-10-06T03:25:21.362091+0000","last_clean":"2023-10-06T03:25:21.362091+0000","last_became_active":"2023-10-06T03:25:21.361886+0000","last_became_peered":"2023-10-06T03:25:21.361886+0000","last_unstale":"2023-10-06T03:25:21.362091+0000","last_undegraded":"2023-10-06T03:25:21.362091+0000","last_fullsized":"2023-10-06T03:25:21.362091+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:50.201459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.344944+0000","last_change":"2023-10-06T03:25:20.732365+0000","last_active":"2023-10-06T03:25:21.344944+0000","last_peered":"2023-10-06T03:25:21.344944+0000","last_clean":"2023-10-06T03:25:21.344944+0000","last_became_active":"2023-10-06T03:25:20.732132+0000","last_became_peered":"2023-10-06T03:25:20.732132+0000","last_unstale":"2023-10-06T03:25:21.344944+0000","last_undegraded":"2023-10-06T03:25:21.344944+0000","last_fullsized":"2023-10-06T03:25:21.344944+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:38.547274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.358404+0000","last_change":"2023-10-06T03:25:21.358404+0000","last_active":"2023-10-06T03:25:21.358404+0000","last_peered":"2023-10-06T03:25:21.358404+0000","last_clean":"2023-10-06T03:25:21.358404+0000","last_became_active":"2023-10-06T03:25:21.358120+0000","last_became_peered":"2023-10-06T03:25:21.358120+0000","last_unstale":"2023-10-06T03:25:21.358404+0000","last_undegraded":"2023-10-06T03:25:21.358404+0000","last_fullsized":"2023-10-06T03:25:21.358404+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:48.207789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.742020+0000","last_change":"2023-10-06T03:25:20.740486+0000","last_active":"2023-10-06T03:25:20.742020+0000","last_peered":"2023-10-06T03:25:20.742020+0000","last_clean":"2023-10-06T03:25:20.742020+0000","last_became_active":"2023-10-06T03:25:20.740154+0000","last_became_peered":"2023-10-06T03:25:20.740154+0000","last_unstale":"2023-10-06T03:25:20.742020+0000","last_undegraded":"2023-10-06T03:25:20.742020+0000","last_fullsized":"2023-10-06T03:25:20.742020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:57.402843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357764+0000","last_change":"2023-10-06T03:25:21.353372+0000","last_active":"2023-10-06T03:25:21.357764+0000","last_peered":"2023-10-06T03:25:21.357764+0000","last_clean":"2023-10-06T03:25:21.357764+0000","last_became_active":"2023-10-06T03:25:21.353133+0000","last_became_peered":"2023-10-06T03:25:21.353133+0000","last_unstale":"2023-10-06T03:25:21.357764+0000","last_undegraded":"2023-10-06T03:25:21.357764+0000","last_fullsized":"2023-10-06T03:25:21.357764+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:43.998365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.747279+0000","last_change":"2023-10-06T03:25:20.739624+0000","last_active":"2023-10-06T03:25:20.747279+0000","last_peered":"2023-10-06T03:25:20.747279+0000","last_clean":"2023-10-06T03:25:20.747279+0000","last_became_active":"2023-10-06T03:25:20.739412+0000","last_became_peered":"2023-10-06T03:25:20.739412+0000","last_unstale":"2023-10-06T03:25:20.747279+0000","last_undegraded":"2023-10-06T03:25:20.747279+0000","last_fullsized":"2023-10-06T03:25:20.747279+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:01.502826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.356690+0000","last_change":"2023-10-06T03:25:21.354068+0000","last_active":"2023-10-06T03:25:21.356690+0000","last_peered":"2023-10-06T03:25:21.356690+0000","last_clean":"2023-10-06T03:25:21.356690+0000","last_became_active":"2023-10-06T03:25:21.353746+0000","last_became_peered":"2023-10-06T03:25:21.353746+0000","last_unstale":"2023-10-06T03:25:21.356690+0000","last_undegraded":"2023-10-06T03:25:21.356690+0000","last_fullsized":"2023-10-06T03:25:21.356690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:54.922795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.345699+0000","last_change":"2023-10-06T03:25:20.739540+0000","last_active":"2023-10-06T03:25:21.345699+0000","last_peered":"2023-10-06T03:25:21.345699+0000","last_clean":"2023-10-06T03:25:21.345699+0000","last_became_active":"2023-10-06T03:25:20.739187+0000","last_became_peered":"2023-10-06T03:25:20.739187+0000","last_unstale":"2023-10-06T03:25:21.345699+0000","last_undegraded":"2023-10-06T03:25:21.345699+0000","last_fullsized":"2023-10-06T03:25:21.345699+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:33.550055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.349739+0000","last_change":"2023-10-06T03:25:21.349739+0000","last_active":"2023-10-06T03:25:21.349739+0000","last_peered":"2023-10-06T03:25:21.349739+0000","last_clean":"2023-10-06T03:25:21.349739+0000","last_became_active":"2023-10-06T03:25:21.349503+0000","last_became_peered":"2023-10-06T03:25:21.349503+0000","last_unstale":"2023-10-06T03:25:21.349739+0000","last_undegraded":"2023-10-06T03:25:21.349739+0000","last_fullsized":"2023-10-06T03:25:21.349739+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:14.383583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.747321+0000","last_change":"2023-10-06T03:25:20.743100+0000","last_active":"2023-10-06T03:25:20.747321+0000","last_peered":"2023-10-06T03:25:20.747321+0000","last_clean":"2023-10-06T03:25:20.747321+0000","last_became_active":"2023-10-06T03:25:20.742839+0000","last_became_peered":"2023-10-06T03:25:20.742839+0000","last_unstale":"2023-10-06T03:25:20.747321+0000","last_undegraded":"2023-10-06T03:25:20.747321+0000","last_fullsized":"2023-10-06T03:25:20.747321+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:17.147666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359087+0000","last_change":"2023-10-06T03:25:21.357005+0000","last_active":"2023-10-06T03:25:21.359087+0000","last_peered":"2023-10-06T03:25:21.359087+0000","last_clean":"2023-10-06T03:25:21.359087+0000","last_became_active":"2023-10-06T03:25:21.356782+0000","last_became_peered":"2023-10-06T03:25:21.356782+0000","last_unstale":"2023-10-06T03:25:21.359087+0000","last_undegraded":"2023-10-06T03:25:21.359087+0000","last_fullsized":"2023-10-06T03:25:21.359087+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:33.031472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.348427+0000","last_change":"2023-10-06T03:25:20.742287+0000","last_active":"2023-10-06T03:25:21.348427+0000","last_peered":"2023-10-06T03:25:21.348427+0000","last_clean":"2023-10-06T03:25:21.348427+0000","last_became_active":"2023-10-06T03:25:20.742017+0000","last_became_peered":"2023-10-06T03:25:20.742017+0000","last_unstale":"2023-10-06T03:25:21.348427+0000","last_undegraded":"2023-10-06T03:25:21.348427+0000","last_fullsized":"2023-10-06T03:25:21.348427+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:14.659749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.356720+0000","last_change":"2023-10-06T03:25:21.353419+0000","last_active":"2023-10-06T03:25:21.356720+0000","last_peered":"2023-10-06T03:25:21.356720+0000","last_clean":"2023-10-06T03:25:21.356720+0000","last_became_active":"2023-10-06T03:25:21.353108+0000","last_became_peered":"2023-10-06T03:25:21.353108+0000","last_unstale":"2023-10-06T03:25:21.356720+0000","last_undegraded":"2023-10-06T03:25:21.356720+0000","last_fullsized":"2023-10-06T03:25:21.356720+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:55.021449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.747420+0000","last_change":"2023-10-06T03:25:20.742079+0000","last_active":"2023-10-06T03:25:20.747420+0000","last_peered":"2023-10-06T03:25:20.747420+0000","last_clean":"2023-10-06T03:25:20.747420+0000","last_became_active":"2023-10-06T03:25:20.741799+0000","last_became_peered":"2023-10-06T03:25:20.741799+0000","last_unstale":"2023-10-06T03:25:20.747420+0000","last_undegraded":"2023-10-06T03:25:20.747420+0000","last_fullsized":"2023-10-06T03:25:20.747420+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:33.550055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":41,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.346881+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:25:21.346881+0000","last_peered":"2023-10-06T03:25:21.346881+0000","last_clean":"2023-10-06T03:25:21.346881+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:25:21.346881+0000","last_undegraded":"2023-10-06T03:25:21.346881+0000","last_fullsized":"2023-10-06T03:25:21.346881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.368049+0000","last_change":"2023-10-06T03:25:21.362684+0000","last_active":"2023-10-06T03:25:21.368049+0000","last_peered":"2023-10-06T03:25:21.368049+0000","last_clean":"2023-10-06T03:25:21.368049+0000","last_became_active":"2023-10-06T03:25:21.362472+0000","last_became_peered":"2023-10-06T03:25:21.362472+0000","last_unstale":"2023-10-06T03:25:21.368049+0000","last_undegraded":"2023-10-06T03:25:21.368049+0000","last_fullsized":"2023-10-06T03:25:21.368049+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:52.441557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.351604+0000","last_change":"2023-10-06T03:25:20.735264+0000","last_active":"2023-10-06T03:25:21.351604+0000","last_peered":"2023-10-06T03:25:21.351604+0000","last_clean":"2023-10-06T03:25:21.351604+0000","last_became_active":"2023-10-06T03:25:20.734972+0000","last_became_peered":"2023-10-06T03:25:20.734972+0000","last_unstale":"2023-10-06T03:25:21.351604+0000","last_undegraded":"2023-10-06T03:25:21.351604+0000","last_fullsized":"2023-10-06T03:25:21.351604+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:11.604447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.348992+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:25:21.348992+0000","last_peered":"2023-10-06T03:25:21.348992+0000","last_clean":"2023-10-06T03:25:21.348992+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:25:21.348992+0000","last_undegraded":"2023-10-06T03:25:21.348992+0000","last_fullsized":"2023-10-06T03:25:21.348992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.349717+0000","last_change":"2023-10-06T03:25:21.349717+0000","last_active":"2023-10-06T03:25:21.349717+0000","last_peered":"2023-10-06T03:25:21.349717+0000","last_clean":"2023-10-06T03:25:21.349717+0000","last_became_active":"2023-10-06T03:25:21.349465+0000","last_became_peered":"2023-10-06T03:25:21.349465+0000","last_unstale":"2023-10-06T03:25:21.349717+0000","last_undegraded":"2023-10-06T03:25:21.349717+0000","last_fullsized":"2023-10-06T03:25:21.349717+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:45.999668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.731366+0000","last_change":"2023-10-06T03:25:20.725557+0000","last_active":"2023-10-06T03:25:20.731366+0000","last_peered":"2023-10-06T03:25:20.731366+0000","last_clean":"2023-10-06T03:25:20.731366+0000","last_became_active":"2023-10-06T03:25:20.725249+0000","last_became_peered":"2023-10-06T03:25:20.725249+0000","last_unstale":"2023-10-06T03:25:20.731366+0000","last_undegraded":"2023-10-06T03:25:20.731366+0000","last_fullsized":"2023-10-06T03:25:20.731366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:01.221675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.724030+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:25:20.724030+0000","last_peered":"2023-10-06T03:25:20.724030+0000","last_clean":"2023-10-06T03:25:20.724030+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:25:20.724030+0000","last_undegraded":"2023-10-06T03:25:20.724030+0000","last_fullsized":"2023-10-06T03:25:20.724030+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":193,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.341978+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:25:21.341978+0000","last_peered":"2023-10-06T03:25:21.341978+0000","last_clean":"2023-10-06T03:25:21.341978+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:25:21.341978+0000","last_undegraded":"2023-10-06T03:25:21.341978+0000","last_fullsized":"2023-10-06T03:25:21.341978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357870+0000","last_change":"2023-10-06T03:25:21.357870+0000","last_active":"2023-10-06T03:25:21.357870+0000","last_peered":"2023-10-06T03:25:21.357870+0000","last_clean":"2023-10-06T03:25:21.357870+0000","last_became_active":"2023-10-06T03:25:21.355018+0000","last_became_peered":"2023-10-06T03:25:21.355018+0000","last_unstale":"2023-10-06T03:25:21.357870+0000","last_undegraded":"2023-10-06T03:25:21.357870+0000","last_fullsized":"2023-10-06T03:25:21.357870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:54.922795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744820+0000","last_change":"2023-10-06T03:25:20.735197+0000","last_active":"2023-10-06T03:25:21.744820+0000","last_peered":"2023-10-06T03:25:21.744820+0000","last_clean":"2023-10-06T03:25:21.744820+0000","last_became_active":"2023-10-06T03:25:20.734965+0000","last_became_peered":"2023-10-06T03:25:20.734965+0000","last_unstale":"2023-10-06T03:25:21.744820+0000","last_undegraded":"2023-10-06T03:25:21.744820+0000","last_fullsized":"2023-10-06T03:25:21.744820+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:28.824297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.343546+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:25:21.343546+0000","last_peered":"2023-10-06T03:25:21.343546+0000","last_clean":"2023-10-06T03:25:21.343546+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:25:21.343546+0000","last_undegraded":"2023-10-06T03:25:21.343546+0000","last_fullsized":"2023-10-06T03:25:21.343546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.357731+0000","last_change":"2023-10-06T03:25:21.353221+0000","last_active":"2023-10-06T03:25:21.357731+0000","last_peered":"2023-10-06T03:25:21.357731+0000","last_clean":"2023-10-06T03:25:21.357731+0000","last_became_active":"2023-10-06T03:25:21.352965+0000","last_became_peered":"2023-10-06T03:25:21.352965+0000","last_unstale":"2023-10-06T03:25:21.357731+0000","last_undegraded":"2023-10-06T03:25:21.357731+0000","last_fullsized":"2023-10-06T03:25:21.357731+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:22.032998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.346025+0000","last_change":"2023-10-06T03:25:20.741561+0000","last_active":"2023-10-06T03:25:21.346025+0000","last_peered":"2023-10-06T03:25:21.346025+0000","last_clean":"2023-10-06T03:25:21.346025+0000","last_became_active":"2023-10-06T03:25:20.741296+0000","last_became_peered":"2023-10-06T03:25:20.741296+0000","last_unstale":"2023-10-06T03:25:21.346025+0000","last_undegraded":"2023-10-06T03:25:21.346025+0000","last_fullsized":"2023-10-06T03:25:21.346025+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:01.502826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.341399+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:25:21.341399+0000","last_peered":"2023-10-06T03:25:21.341399+0000","last_clean":"2023-10-06T03:25:21.341399+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:25:21.341399+0000","last_undegraded":"2023-10-06T03:25:21.341399+0000","last_fullsized":"2023-10-06T03:25:21.341399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.344762+0000","last_change":"2023-10-06T03:25:21.344762+0000","last_active":"2023-10-06T03:25:21.344762+0000","last_peered":"2023-10-06T03:25:21.344762+0000","last_clean":"2023-10-06T03:25:21.344762+0000","last_became_active":"2023-10-06T03:25:21.343976+0000","last_became_peered":"2023-10-06T03:25:21.343976+0000","last_unstale":"2023-10-06T03:25:21.344762+0000","last_undegraded":"2023-10-06T03:25:21.344762+0000","last_fullsized":"2023-10-06T03:25:21.344762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:01.237800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.747867+0000","last_change":"2023-10-06T03:25:20.743535+0000","last_active":"2023-10-06T03:25:20.747867+0000","last_peered":"2023-10-06T03:25:20.747867+0000","last_clean":"2023-10-06T03:25:20.747867+0000","last_became_active":"2023-10-06T03:25:20.743226+0000","last_became_peered":"2023-10-06T03:25:20.743226+0000","last_unstale":"2023-10-06T03:25:20.747867+0000","last_undegraded":"2023-10-06T03:25:20.747867+0000","last_fullsized":"2023-10-06T03:25:20.747867+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:15.802424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:25:20.734805+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:25:20.734805+0000","last_peered":"2023-10-06T03:25:20.734805+0000","last_clean":"2023-10-06T03:25:20.734805+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:25:20.734805+0000","last_undegraded":"2023-10-06T03:25:20.734805+0000","last_fullsized":"2023-10-06T03:25:20.734805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.368883+0000","last_change":"2023-10-06T03:25:21.363019+0000","last_active":"2023-10-06T03:25:21.368883+0000","last_peered":"2023-10-06T03:25:21.368883+0000","last_clean":"2023-10-06T03:25:21.368883+0000","last_became_active":"2023-10-06T03:25:21.362755+0000","last_became_peered":"2023-10-06T03:25:21.362755+0000","last_unstale":"2023-10-06T03:25:21.368883+0000","last_undegraded":"2023-10-06T03:25:21.368883+0000","last_fullsized":"2023-10-06T03:25:21.368883+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:54.496446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.748408+0000","last_change":"2023-10-06T03:25:20.737201+0000","last_active":"2023-10-06T03:25:21.748408+0000","last_peered":"2023-10-06T03:25:21.748408+0000","last_clean":"2023-10-06T03:25:21.748408+0000","last_became_active":"2023-10-06T03:25:20.736938+0000","last_became_peered":"2023-10-06T03:25:20.736938+0000","last_unstale":"2023-10-06T03:25:21.748408+0000","last_undegraded":"2023-10-06T03:25:21.748408+0000","last_fullsized":"2023-10-06T03:25:21.748408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:53.486571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.347426+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:25:21.347426+0000","last_peered":"2023-10-06T03:25:21.347426+0000","last_clean":"2023-10-06T03:25:21.347426+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:25:21.347426+0000","last_undegraded":"2023-10-06T03:25:21.347426+0000","last_fullsized":"2023-10-06T03:25:21.347426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.359190+0000","last_change":"2023-10-06T03:25:21.359190+0000","last_active":"2023-10-06T03:25:21.359190+0000","last_peered":"2023-10-06T03:25:21.359190+0000","last_clean":"2023-10-06T03:25:21.359190+0000","last_became_active":"2023-10-06T03:25:21.357780+0000","last_became_peered":"2023-10-06T03:25:21.357780+0000","last_unstale":"2023-10-06T03:25:21.359190+0000","last_undegraded":"2023-10-06T03:25:21.359190+0000","last_fullsized":"2023-10-06T03:25:21.359190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:20.717789+0000","last_clean_scrub_stamp":"2023-10-06T03:25:20.717789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:54.496446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.744290+0000","last_change":"2023-10-06T03:25:20.737149+0000","last_active":"2023-10-06T03:25:21.744290+0000","last_peered":"2023-10-06T03:25:21.744290+0000","last_clean":"2023-10-06T03:25:21.744290+0000","last_became_active":"2023-10-06T03:25:20.736895+0000","last_became_peered":"2023-10-06T03:25:20.736895+0000","last_unstale":"2023-10-06T03:25:21.744290+0000","last_undegraded":"2023-10-06T03:25:21.744290+0000","last_fullsized":"2023-10-06T03:25:21.744290+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:19.707914+0000","last_clean_scrub_stamp":"2023-10-06T03:25:19.707914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:28.824297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:25:21.346650+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:25:21.346650+0000","last_peered":"2023-10-06T03:25:21.346650+0000","last_clean":"2023-10-06T03:25:21.346650+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:25:21.346650+0000","last_undegraded":"2023-10-06T03:25:21.346650+0000","last_fullsized":"2023-10-06T03:25:21.346650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298444,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073396,"statfs":{"total":96636764160,"available":96331157504,"internally_reserved":0,"allocated":1183744,"data_stored":855934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.39500000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.377},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42999999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.503}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":272367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":6.3680000000000003,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.442},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.5039999999999996,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.4740000000000002,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":6.4359999999999999,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.748},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.504},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1179648,"data_stored":855864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.219},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.31}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.48099999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.434}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":266143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":12.19,"5min":12.19,"15min":12.19},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":8.3900000000000006,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.308},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.27600000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.437},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.38400000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.948,"5min":16.948,"15min":16.948},"last":0.39700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.505}]},{"osd":7,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":16.881,"5min":16.881,"15min":16.881},"last":0.41699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297864,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":589824,"data_stored":265462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.217},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.29399999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.247},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.307}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.36799999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.38100000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.439}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":602112,"data_stored":272423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.50700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":273903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.758,"5min":4.758,"15min":4.758},"last":0.375},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":9.7690000000000001,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297856,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":581632,"data_stored":265406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.748},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:25:26.165 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:25:26.165 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:25:26.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.316+0000 7f4bfd873700 1 Processor -- start 2023-10-06T03:25:26.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.316+0000 7f4bfd873700 1 -- start start 2023-10-06T03:25:26.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bfd873700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4bf80cd980 0x7f4bf8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bfd873700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4bf80b4a60 0x7f4bf80d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bfd873700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bf80b4eb0 0x7f4bf80d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bfd873700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf80b5f30 con 0x7f4bf80cd980 2023-10-06T03:25:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bfd873700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf80b3640 con 0x7f4bf80b4a60 2023-10-06T03:25:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bfd873700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80b63c0 con 0x7f4bf80b4eb0 2023-10-06T03:25:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf6ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4bf80cd980 0x7f4bf8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf6ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4bf80cd980 0x7f4bf8159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33378/0 (socket says 172.21.15.84:33378) 2023-10-06T03:25:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf6ffd700 1 -- 172.21.15.84:0/2611527375 learned_addr learned my addr 172.21.15.84:0/2611527375 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf67fc700 1 --2- 172.21.15.84:0/2611527375 >> v2:172.21.15.131:3300/0 conn(0x7f4bf80b4a60 0x7f4bf80d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf77fe700 1 --2- 172.21.15.84:0/2611527375 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bf80b4eb0 0x7f4bf80d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf6ffd700 1 -- 172.21.15.84:0/2611527375 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bf80b4eb0 msgr2=0x7f4bf80d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf6ffd700 1 --2- 172.21.15.84:0/2611527375 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bf80b4eb0 0x7f4bf80d0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf6ffd700 1 -- 172.21.15.84:0/2611527375 >> v2:172.21.15.131:3300/0 conn(0x7f4bf80b4a60 msgr2=0x7f4bf80d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf6ffd700 1 --2- 172.21.15.84:0/2611527375 >> v2:172.21.15.131:3300/0 conn(0x7f4bf80b4a60 0x7f4bf80d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf6ffd700 1 -- 172.21.15.84:0/2611527375 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80b5320 con 0x7f4bf80cd980 2023-10-06T03:25:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf67fc700 1 --2- 172.21.15.84:0/2611527375 >> v2:172.21.15.131:3300/0 conn(0x7f4bf80b4a60 0x7f4bf80d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf6ffd700 1 --2- 172.21.15.84:0/2611527375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 0x7f4bf8159c10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80af180 tx=0x7f4bf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786ef18015a812c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.317+0000 7f4bf5ffb700 1 -- 172.21.15.84:0/2611527375 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000b860 con 0x7f4bf80cd980 2023-10-06T03:25:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bf5ffb700 1 -- 172.21.15.84:0/2611527375 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf000b9c0 con 0x7f4bf80cd980 2023-10-06T03:25:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bf5ffb700 1 -- 172.21.15.84:0/2611527375 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000bd60 con 0x7f4bf80cd980 2023-10-06T03:25:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bfd873700 1 -- 172.21.15.84:0/2611527375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 msgr2=0x7f4bf8159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bfd873700 1 --2- 172.21.15.84:0/2611527375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 0x7f4bf8159c10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80af180 tx=0x7f4bf0009250 comp rx=0 tx=0).stop 2023-10-06T03:25:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bfd873700 1 -- 172.21.15.84:0/2611527375 shutdown_connections 2023-10-06T03:25:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bfd873700 1 --2- 172.21.15.84:0/2611527375 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bf80b4eb0 0x7f4bf80d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bfd873700 1 --2- 172.21.15.84:0/2611527375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 0x7f4bf8159c10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bfd873700 1 --2- 172.21.15.84:0/2611527375 >> v2:172.21.15.131:3300/0 conn(0x7f4bf80b4a60 0x7f4bf80d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bfd873700 1 -- 172.21.15.84:0/2611527375 >> 172.21.15.84:0/2611527375 conn(0x7f4bf806ed20 msgr2=0x7f4bf806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bfd873700 1 -- 172.21.15.84:0/2611527375 shutdown_connections 2023-10-06T03:25:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.318+0000 7f4bfd873700 1 -- 172.21.15.84:0/2611527375 wait complete. 2023-10-06T03:25:26.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.319+0000 7f4bfd873700 1 Processor -- start 2023-10-06T03:25:26.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.319+0000 7f4bfd873700 1 -- start start 2023-10-06T03:25:26.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bfd873700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf80b4a60 0x7f4bf8158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bfd873700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bf80b4eb0 0x7f4bf816a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bfd873700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 0x7f4bf815f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bfd873700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf814db10 con 0x7f4bf80cd980 2023-10-06T03:25:26.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bfd873700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80cdd50 con 0x7f4bf80b4a60 2023-10-06T03:25:26.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bfd873700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80ce8d0 con 0x7f4bf80b4eb0 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 0x7f4bf815f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 0x7f4bf815f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33390/0 (socket says 172.21.15.84:33390) 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bf77fe700 1 -- 172.21.15.84:0/2017495611 learned_addr learned my addr 172.21.15.84:0/2017495611 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bf6ffd700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf80b4a60 0x7f4bf8158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bf67fc700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bf80b4eb0 0x7f4bf816a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bf77fe700 1 -- 172.21.15.84:0/2017495611 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bf80b4eb0 msgr2=0x7f4bf816a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bf77fe700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bf80b4eb0 0x7f4bf816a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.320+0000 7f4bf77fe700 1 -- 172.21.15.84:0/2017495611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf80b4a60 msgr2=0x7f4bf8158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.321+0000 7f4bf77fe700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf80b4a60 0x7f4bf8158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.321+0000 7f4bf77fe700 1 -- 172.21.15.84:0/2017495611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf00094f0 con 0x7f4bf80cd980 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.321+0000 7f4bf77fe700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 0x7f4bf815f420 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009fa0 tx=0x7f4be8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.321+0000 7f4beeffd700 1 -- 172.21.15.84:0/2017495611 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be800ebc0 con 0x7f4bf80cd980 2023-10-06T03:25:26.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.321+0000 7f4beeffd700 1 -- 172.21.15.84:0/2017495611 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be800ed20 con 0x7f4bf80cd980 2023-10-06T03:25:26.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.321+0000 7f4bfd873700 1 -- 172.21.15.84:0/2017495611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf80cdfa0 con 0x7f4bf80cd980 2023-10-06T03:25:26.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.321+0000 7f4beeffd700 1 -- 172.21.15.84:0/2017495611 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8014670 con 0x7f4bf80cd980 2023-10-06T03:25:26.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.321+0000 7f4bfd873700 1 -- 172.21.15.84:0/2017495611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf80ce560 con 0x7f4bf80cd980 2023-10-06T03:25:26.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.322+0000 7f4bfd873700 1 -- 172.21.15.84:0/2017495611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf80cea80 con 0x7f4bf80cd980 2023-10-06T03:25:26.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.322+0000 7f4beeffd700 1 -- 172.21.15.84:0/2017495611 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4be8014a20 con 0x7f4bf80cd980 2023-10-06T03:25:26.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.322+0000 7f4beeffd700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bd8066f30 0x7f4bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.323+0000 7f4beeffd700 1 -- 172.21.15.84:0/2017495611 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4be8084d30 con 0x7f4bf80cd980 2023-10-06T03:25:26.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.323+0000 7f4bf6ffd700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bd8066f30 0x7f4bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.323+0000 7f4bf6ffd700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bd8066f30 0x7f4bd80693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80af180 tx=0x7f4bf0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.327+0000 7f4beeffd700 1 -- 172.21.15.84:0/2017495611 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bf80cea80 con 0x7f4bf80cd980 2023-10-06T03:25:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.586+0000 7f4bfd873700 1 -- 172.21.15.84:0/2017495611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4bf80cea40 con 0x7f4bf80cd980 2023-10-06T03:25:26.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.590+0000 7f4beeffd700 1 -- 172.21.15.84:0/2017495611 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4be8051d00 con 0x7f4bf80cd980 2023-10-06T03:25:26.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 -- 172.21.15.84:0/2017495611 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bd8066f30 msgr2=0x7f4bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bd8066f30 0x7f4bd80693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80af180 tx=0x7f4bf0017000 comp rx=0 tx=0).stop 2023-10-06T03:25:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 -- 172.21.15.84:0/2017495611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 msgr2=0x7f4bf815f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 0x7f4bf815f420 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009fa0 tx=0x7f4be8009900 comp rx=0 tx=0).stop 2023-10-06T03:25:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 -- 172.21.15.84:0/2017495611 shutdown_connections 2023-10-06T03:25:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4bd8066f30 0x7f4bd80693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf80b4a60 0x7f4bf8158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bf80cd980 0x7f4bf815f420 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 --2- 172.21.15.84:0/2017495611 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bf80b4eb0 0x7f4bf816a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 -- 172.21.15.84:0/2017495611 >> 172.21.15.84:0/2017495611 conn(0x7f4bf806ed20 msgr2=0x7f4bf815adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 -- 172.21.15.84:0/2017495611 shutdown_connections 2023-10-06T03:25:26.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.592+0000 7f4bfd873700 1 -- 172.21.15.84:0/2017495611 wait complete. 2023-10-06T03:25:26.596 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T03:25:26.605 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:26.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.718+0000 7f2023fff700 1 Processor -- start 2023-10-06T03:25:26.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.718+0000 7f2023fff700 1 -- start start 2023-10-06T03:25:26.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f2023fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2024159480 0x7f20240b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f2023fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f20240b2140 0x7f20240b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f2023fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20240cb7e0 con 0x7f20240b3610 2023-10-06T03:25:26.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f2023fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240b08a0 con 0x7f20240b2140 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f2023fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20240cb190 con 0x7f2024159480 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f20237fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f20240b2140 0x7f20240b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f201a7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f20240b3610 0x7f20240cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56592/0 (socket says 172.21.15.84:56592) 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f201a7fc700 1 -- 172.21.15.84:0/1783648997 learned_addr learned my addr 172.21.15.84:0/1783648997 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f2022ffd700 1 --2- 172.21.15.84:0/1783648997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2024159480 0x7f20240b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f20237fe700 1 -- 172.21.15.84:0/1783648997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2024159480 msgr2=0x7f20240b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f20237fe700 1 --2- 172.21.15.84:0/1783648997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2024159480 0x7f20240b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f20237fe700 1 -- 172.21.15.84:0/1783648997 >> v1:172.21.15.84:6789/0 conn(0x7f20240b3610 legacy=0x7f20240cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f20227fc700 1 -- 172.21.15.84:0/1783648997 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631343162 0 0) 0x7f20240cb7e0 con 0x7f20240b3610 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f20237fe700 1 -- 172.21.15.84:0/1783648997 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240cb470 con 0x7f20240b2140 2023-10-06T03:25:26.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.719+0000 7f2022ffd700 1 --2- 172.21.15.84:0/1783648997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2024159480 0x7f20240b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f20237fe700 1 --2- 172.21.15.84:0/1783648997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 0x7f20240b25c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f201c009e60 tx=0x7f201c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6641852f1654fdd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f20227fc700 1 -- 172.21.15.84:0/1783648997 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00e070 con 0x7f20240b2140 2023-10-06T03:25:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f20227fc700 1 -- 172.21.15.84:0/1783648997 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c00bc30 con 0x7f20240b2140 2023-10-06T03:25:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f20227fc700 1 -- 172.21.15.84:0/1783648997 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c012430 con 0x7f20240b2140 2023-10-06T03:25:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f2023fff700 1 -- 172.21.15.84:0/1783648997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 msgr2=0x7f20240b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f2023fff700 1 --2- 172.21.15.84:0/1783648997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 0x7f20240b25c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f201c009e60 tx=0x7f201c009780 comp rx=0 tx=0).stop 2023-10-06T03:25:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f2023fff700 1 -- 172.21.15.84:0/1783648997 shutdown_connections 2023-10-06T03:25:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f2023fff700 1 --2- 172.21.15.84:0/1783648997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 0x7f20240b25c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f2023fff700 1 --2- 172.21.15.84:0/1783648997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2024159480 0x7f20240b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f2023fff700 1 -- 172.21.15.84:0/1783648997 >> 172.21.15.84:0/1783648997 conn(0x7f202406ed20 msgr2=0x7f202406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f2023fff700 1 -- 172.21.15.84:0/1783648997 shutdown_connections 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.720+0000 7f2023fff700 1 -- 172.21.15.84:0/1783648997 wait complete. 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2023fff700 1 Processor -- start 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2023fff700 1 -- start start 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2023fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 0x7f20240c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2023fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20240b3610 0x7f20240c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2023fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2024159480 0x7f20241559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2023fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202416a5f0 con 0x7f20240b2140 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2023fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20240c97e0 con 0x7f2024159480 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2023fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20240c9ac0 con 0x7f20240b3610 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2022ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 0x7f20240c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2022ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 0x7f20240c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33408/0 (socket says 172.21.15.84:33408) 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.722+0000 7f2022ffd700 1 -- 172.21.15.84:0/1657418441 learned_addr learned my addr 172.21.15.84:0/1657418441 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f201a7fc700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20240b3610 0x7f20240c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f2022ffd700 1 -- 172.21.15.84:0/1657418441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20240b3610 msgr2=0x7f20240c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f2022ffd700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20240b3610 0x7f20240c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f2022ffd700 1 -- 172.21.15.84:0/1657418441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2024159480 msgr2=0x7f20241559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f20237fe700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2024159480 0x7f20241559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f2022ffd700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2024159480 0x7f20241559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f2022ffd700 1 -- 172.21.15.84:0/1657418441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c009a20 con 0x7f20240b2140 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f201a7fc700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20240b3610 0x7f20240c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f20237fe700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2024159480 0x7f20241559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f2022ffd700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 0x7f20240c61d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f201400c850 tx=0x7f2014008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f201b7fe700 1 -- 172.21.15.84:0/1657418441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014011600 con 0x7f20240b2140 2023-10-06T03:25:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f201b7fe700 1 -- 172.21.15.84:0/1657418441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2014011760 con 0x7f20240b2140 2023-10-06T03:25:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f2023fff700 1 -- 172.21.15.84:0/1657418441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20240c9da0 con 0x7f20240b2140 2023-10-06T03:25:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f201b7fe700 1 -- 172.21.15.84:0/1657418441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014011b00 con 0x7f20240b2140 2023-10-06T03:25:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.723+0000 7f2023fff700 1 -- 172.21.15.84:0/1657418441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20240c6710 con 0x7f20240b2140 2023-10-06T03:25:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.724+0000 7f2023fff700 1 -- 172.21.15.84:0/1657418441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202405f270 con 0x7f20240b2140 2023-10-06T03:25:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.724+0000 7f201b7fe700 1 -- 172.21.15.84:0/1657418441 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20140073b0 con 0x7f20240b2140 2023-10-06T03:25:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.725+0000 7f201b7fe700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2004066f30 0x7f20040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.725+0000 7f201b7fe700 1 -- 172.21.15.84:0/1657418441 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2014084750 con 0x7f20240b2140 2023-10-06T03:25:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.725+0000 7f201a7fc700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2004066f30 0x7f20040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.725+0000 7f201a7fc700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2004066f30 0x7f20040693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f202416c8f0 tx=0x7f200c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.729+0000 7f201b7fe700 1 -- 172.21.15.84:0/1657418441 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20140551b0 con 0x7f20240b2140 2023-10-06T03:25:26.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.952+0000 7f2023fff700 1 -- 172.21.15.84:0/1657418441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20240b2b00 con 0x7f20240b2140 2023-10-06T03:25:26.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.953+0000 7f201b7fe700 1 -- 172.21.15.84:0/1657418441 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f2014054d40 con 0x7f20240b2140 2023-10-06T03:25:26.954 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:26.954 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3103408955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3103408955},{"type":"v1","addr":"172.21.15.131:6834","nonce":3103408955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3982920665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3982920665},{"type":"v1","addr":"172.21.15.131:6835","nonce":3982920665}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1537563341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1537563341},{"type":"v1","addr":"172.21.15.84:6836","nonce":1537563341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:21.111306+0000","modified":"2023-10-06T03:25:24.747627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5526":{"gid":5526,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3473748806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3473748806},{"type":"v1","addr":"172.21.15.84:6837","nonce":3473748806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:25:26.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 -- 172.21.15.84:0/1657418441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2004066f30 msgr2=0x7f20040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2004066f30 0x7f20040693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f202416c8f0 tx=0x7f200c009040 comp rx=0 tx=0).stop 2023-10-06T03:25:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 -- 172.21.15.84:0/1657418441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 msgr2=0x7f20240c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 0x7f20240c61d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f201400c850 tx=0x7f2014008040 comp rx=0 tx=0).stop 2023-10-06T03:25:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 -- 172.21.15.84:0/1657418441 shutdown_connections 2023-10-06T03:25:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2004066f30 0x7f20040693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2024159480 0x7f20241559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20240b2140 0x7f20240c61d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 --2- 172.21.15.84:0/1657418441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20240b3610 0x7f20240c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 -- 172.21.15.84:0/1657418441 >> 172.21.15.84:0/1657418441 conn(0x7f202406ed20 msgr2=0x7f2024156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 -- 172.21.15.84:0/1657418441 shutdown_connections 2023-10-06T03:25:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:26.955+0000 7f2023fff700 1 -- 172.21.15.84:0/1657418441 wait complete. 2023-10-06T03:25:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2023-10-06T03:25:27.371 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:25:21.111306+0000', 'modified': '2023-10-06T03:25:24.747627+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5526': {'gid': 5526, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/3473748806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 3473748806}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 3473748806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:25:27.371 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:25:27.371 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:25:27.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.486+0000 7fcf8b545700 1 Processor -- start 2023-10-06T03:25:27.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.486+0000 7fcf8b545700 1 -- start start 2023-10-06T03:25:27.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf8b545700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf840b49e0 0x7fcf840aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf8b545700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf840b07a0 0x7fcf840b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf8b545700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf840b0ca0 con 0x7fcf841595a0 2023-10-06T03:25:27.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf8b545700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf840b0f80 con 0x7fcf840b07a0 2023-10-06T03:25:27.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf8b545700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840b1260 con 0x7fcf840b49e0 2023-10-06T03:25:27.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf89ae2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf840b07a0 0x7fcf840b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf89ae2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf840b07a0 0x7fcf840b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33420/0 (socket says 172.21.15.84:33420) 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf89ae2700 1 -- 172.21.15.84:0/898139505 learned_addr learned my addr 172.21.15.84:0/898139505 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf89ae2700 1 -- 172.21.15.84:0/898139505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf840b49e0 msgr2=0x7fcf840aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf89ae2700 1 --2- 172.21.15.84:0/898139505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf840b49e0 0x7fcf840aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf89ae2700 1 -- 172.21.15.84:0/898139505 >> v1:172.21.15.131:6789/0 conn(0x7fcf841595a0 legacy=0x7fcf840aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf89ae2700 1 -- 172.21.15.84:0/898139505 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf840b1540 con 0x7fcf840b07a0 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf89ae2700 1 --2- 172.21.15.84:0/898139505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 0x7fcf840b1c00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009f20 tx=0x7fcf7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446964cf350e5d9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf7bfff700 1 -- 172.21.15.84:0/898139505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00e070 con 0x7fcf840b07a0 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf7bfff700 1 -- 172.21.15.84:0/898139505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c00ba40 con 0x7fcf840b07a0 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.487+0000 7fcf7bfff700 1 -- 172.21.15.84:0/898139505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0092e0 con 0x7fcf840b07a0 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.488+0000 7fcf8b545700 1 -- 172.21.15.84:0/898139505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 msgr2=0x7fcf840b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.488+0000 7fcf8b545700 1 --2- 172.21.15.84:0/898139505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 0x7fcf840b1c00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009f20 tx=0x7fcf7c009840 comp rx=0 tx=0).stop 2023-10-06T03:25:27.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.488+0000 7fcf8b545700 1 -- 172.21.15.84:0/898139505 shutdown_connections 2023-10-06T03:25:27.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.488+0000 7fcf8b545700 1 --2- 172.21.15.84:0/898139505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 0x7fcf840b1c00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.488+0000 7fcf8b545700 1 --2- 172.21.15.84:0/898139505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf840b49e0 0x7fcf840aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.488+0000 7fcf8b545700 1 -- 172.21.15.84:0/898139505 >> 172.21.15.84:0/898139505 conn(0x7fcf84099830 msgr2=0x7fcf8406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.488+0000 7fcf8b545700 1 -- 172.21.15.84:0/898139505 shutdown_connections 2023-10-06T03:25:27.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.488+0000 7fcf8b545700 1 -- 172.21.15.84:0/898139505 wait complete. 2023-10-06T03:25:27.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.489+0000 7fcf8b545700 1 Processor -- start 2023-10-06T03:25:27.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.489+0000 7fcf8b545700 1 -- start start 2023-10-06T03:25:27.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf8b545700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 0x7fcf84157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf8b545700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf840b49e0 0x7fcf840acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf8b545700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf841595a0 0x7fcf8409d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf8b545700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8409d1b0 con 0x7fcf840b07a0 2023-10-06T03:25:27.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf8b545700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8409c5a0 con 0x7fcf840b49e0 2023-10-06T03:25:27.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf8b545700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8409c880 con 0x7fcf841595a0 2023-10-06T03:25:27.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf892e1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 0x7fcf84157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf892e1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 0x7fcf84157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33436/0 (socket says 172.21.15.84:33436) 2023-10-06T03:25:27.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf892e1700 1 -- 172.21.15.84:0/1016056441 learned_addr learned my addr 172.21.15.84:0/1016056441 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:27.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf89ae2700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf841595a0 0x7fcf8409d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.490+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf840b49e0 0x7fcf840acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf892e1700 1 -- 172.21.15.84:0/1016056441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf841595a0 msgr2=0x7fcf8409d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf892e1700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf841595a0 0x7fcf8409d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf892e1700 1 -- 172.21.15.84:0/1016056441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf840b49e0 msgr2=0x7fcf840acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf892e1700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf840b49e0 0x7fcf840acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf892e1700 1 -- 172.21.15.84:0/1016056441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c009ae0 con 0x7fcf840b07a0 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf892e1700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 0x7fcf84157a60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000b5e0 tx=0x7fcf800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf797fa700 1 -- 172.21.15.84:0/1016056441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000f510 con 0x7fcf840b07a0 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf797fa700 1 -- 172.21.15.84:0/1016056441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8000f690 con 0x7fcf840b07a0 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf8b545700 1 -- 172.21.15.84:0/1016056441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8409cb60 con 0x7fcf840b07a0 2023-10-06T03:25:27.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf797fa700 1 -- 172.21.15.84:0/1016056441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000fa50 con 0x7fcf840b07a0 2023-10-06T03:25:27.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.491+0000 7fcf8b545700 1 -- 172.21.15.84:0/1016056441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf84157fa0 con 0x7fcf840b07a0 2023-10-06T03:25:27.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.492+0000 7fcf797fa700 1 -- 172.21.15.84:0/1016056441 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf8001a400 con 0x7fcf840b07a0 2023-10-06T03:25:27.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.493+0000 7fcf797fa700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf68066f30 0x7fcf680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.493+0000 7fcf797fa700 1 -- 172.21.15.84:0/1016056441 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcf800840f0 con 0x7fcf840b07a0 2023-10-06T03:25:27.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.493+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf68066f30 0x7fcf680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.493+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf68066f30 0x7fcf680693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf840ab0f0 tx=0x7fcf740091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf9483db80 1 Processor -- start 2023-10-06T03:25:27.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf9483db80 1 -- start start 2023-10-06T03:25:27.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d5141c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d51916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d5192050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf9483db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d5098a70 con 0x55c9d5142cc0 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf9483db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d5096270 con 0x55c9d5191c00 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf9483db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d5092060 con 0x55c9d5141840 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf88ae0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d51916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf88ae0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d51916c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33446/0 (socket says 172.21.15.84:33446) 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.495+0000 7fcf88ae0700 1 -- 172.21.15.84:0/2014104124 learned_addr learned my addr 172.21.15.84:0/2014104124 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf892e1700 1 --2- 172.21.15.84:0/2014104124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d5141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf89ae2700 1 --2- 172.21.15.84:0/2014104124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d5192050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf88ae0700 1 -- 172.21.15.84:0/2014104124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 msgr2=0x55c9d5141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/2014104124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d5141c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf88ae0700 1 -- 172.21.15.84:0/2014104124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 msgr2=0x55c9d5192050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/2014104124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d5192050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf88ae0700 1 -- 172.21.15.84:0/2014104124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9d4f2c270 con 0x55c9d5142cc0 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/2014104124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d51916c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400eba0 tx=0x7fcf74014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1badbdb1e84e1bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf6e7fc700 1 -- 172.21.15.84:0/2014104124 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf740137e0 con 0x55c9d5142cc0 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf6e7fc700 1 -- 172.21.15.84:0/2014104124 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74013940 con 0x55c9d5142cc0 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf6e7fc700 1 -- 172.21.15.84:0/2014104124 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74013ce0 con 0x55c9d5142cc0 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf9483db80 1 -- 172.21.15.84:0/2014104124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 msgr2=0x55c9d51916c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.496+0000 7fcf9483db80 1 --2- 172.21.15.84:0/2014104124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d51916c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400eba0 tx=0x7fcf74014000 comp rx=0 tx=0).stop 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.497+0000 7fcf9483db80 1 -- 172.21.15.84:0/2014104124 shutdown_connections 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.497+0000 7fcf9483db80 1 --2- 172.21.15.84:0/2014104124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d5192050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.497+0000 7fcf9483db80 1 --2- 172.21.15.84:0/2014104124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d5141c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.497+0000 7fcf9483db80 1 --2- 172.21.15.84:0/2014104124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d51916c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.497+0000 7fcf9483db80 1 -- 172.21.15.84:0/2014104124 >> 172.21.15.84:0/2014104124 conn(0x55c9d5143160 msgr2=0x55c9d5143530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.497+0000 7fcf9483db80 1 -- 172.21.15.84:0/2014104124 shutdown_connections 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.497+0000 7fcf9483db80 1 -- 172.21.15.84:0/2014104124 wait complete. 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.497+0000 7fcf9483db80 1 -- start start 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.497+0000 7fcf9483db80 1 Processor -- start 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d5167420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5142cc0 0x55c9d519b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5191c00 0x55c9d519ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf9483db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d503d890 con 0x55c9d5191c00 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf9483db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d5058ea0 con 0x55c9d5142cc0 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf9483db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d4f14e30 con 0x55c9d5141840 2023-10-06T03:25:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf9483db80 10 client.0 _ll_register_callbacks cb 0x55c9d5104e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf89ae2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5191c00 0x55c9d519ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf89ae2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5191c00 0x55c9d519ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33454/0 (socket says 172.21.15.84:33454) 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf89ae2700 1 -- 172.21.15.84:0/33786842 learned_addr learned my addr 172.21.15.84:0/33786842 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5142cc0 0x55c9d519b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf892e1700 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d5167420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.498+0000 7fcf89ae2700 1 -- 172.21.15.84:0/33786842 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 msgr2=0x55c9d5167420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf89ae2700 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d5167420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf89ae2700 1 -- 172.21.15.84:0/33786842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5142cc0 msgr2=0x55c9d519b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf89ae2700 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5142cc0 0x55c9d519b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf89ae2700 1 -- 172.21.15.84:0/33786842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7400e730 con 0x55c9d5191c00 2023-10-06T03:25:27.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5142cc0 0x55c9d519b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf892e1700 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d5167420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf89ae2700 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5191c00 0x55c9d519ba10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c003000 tx=0x7fcf7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f38ac10c6a4cca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf637fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf637fe700 1 -- 172.21.15.84:0/33786842 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c012de0 con 0x55c9d5191c00 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf637fe700 1 -- 172.21.15.84:0/33786842 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcf7c029430 con 0x55c9d5191c00 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf9483db80 1 -- 172.21.15.84:0/33786842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9d5136940 con 0x55c9d5191c00 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf637fe700 1 -- 172.21.15.84:0/33786842 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf7c029800 con 0x55c9d5191c00 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf9483db80 10 client.5688 fetch_fsmap learned FSMap version 24 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf9483db80 1 -- 172.21.15.84:0/33786842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55c9d4ecefe0 con 0x55c9d5191c00 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf637fe700 1 -- 172.21.15.84:0/33786842 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9d5136940 con 0x55c9d5191c00 2023-10-06T03:25:27.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf637fe700 1 -- 172.21.15.84:0/33786842 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcf7c00b050 con 0x55c9d5191c00 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf9483db80 10 client.5688 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf9483db80 10 client.5688 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf9483db80 20 client.5688 populate_metadata read hostname 'smithi084' 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf9483db80 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.84:6835/3473748806,v1:172.21.15.84:6837/3473748806] conn(0x55c9d5180b90 0x55c9d51a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf9483db80 4 client.5688 mds_command: new command op to 5526 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf9483db80 1 -- 172.21.15.84:0/33786842 --> [v2:172.21.15.84:6835/3473748806,v1:172.21.15.84:6837/3473748806] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c9d5113870 con 0x55c9d5180b90 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.499+0000 7fcf892e1700 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.84:6835/3473748806,v1:172.21.15.84:6837/3473748806] conn(0x55c9d5180b90 0x55c9d51a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf637fe700 10 client.5688 ms_handle_connect on v2:172.21.15.84:6835/3473748806 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf892e1700 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.84:6835/3473748806,v1:172.21.15.84:6837/3473748806] conn(0x55c9d5180b90 0x55c9d51a56a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65fedde1e738388c server_cookie=f3bd9f56fd5d604d in_seq=0 out_seq=0 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf637fe700 1 -- 172.21.15.84:0/33786842 <== mds.0 v2:172.21.15.84:6835/3473748806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c9d5113870 con 0x55c9d5180b90 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf637fe700 10 client.5688 handle_command_reply: tid=0 2023-10-06T03:25:27.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 client.5688 shutdown 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 -- 172.21.15.84:0/33786842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5191c00 msgr2=0x55c9d519ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5191c00 0x55c9d519ba10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c003000 tx=0x7fcf7c017000 comp rx=0 tx=0).stop 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 -- 172.21.15.84:0/33786842 shutdown_connections 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.84:6835/3473748806,v1:172.21.15.84:6837/3473748806] conn(0x55c9d5180b90 0x55c9d51a56a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5191c00 0x55c9d519ba10 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf637fe700 0 client.5688 ms_handle_reset on v2:172.21.15.84:6835/3473748806 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d5167420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 --2- 172.21.15.84:0/33786842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5142cc0 0x55c9d519b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 -- 172.21.15.84:0/33786842 >> 172.21.15.84:0/33786842 conn(0x55c9d5143160 msgr2=0x55c9d51421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 -- 172.21.15.84:0/33786842 shutdown_connections 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.500+0000 7fcf9483db80 1 -- 172.21.15.84:0/33786842 wait complete. 2023-10-06T03:25:27.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.501+0000 7fcf9483db80 20 client.5688 trim_cache size 0 max 16384 2023-10-06T03:25:27.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.517+0000 7fcf9483db80 1 Processor -- start 2023-10-06T03:25:27.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.517+0000 7fcf9483db80 1 -- start start 2023-10-06T03:25:27.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5141840 0x55c9d513ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5142cc0 0x55c9d5187770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d518b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf9483db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d5186280 con 0x55c9d5141840 2023-10-06T03:25:27.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf9483db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d513c620 con 0x55c9d5191c00 2023-10-06T03:25:27.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf9483db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d519b010 con 0x55c9d5142cc0 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf892e1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5141840 0x55c9d513ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf892e1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5141840 0x55c9d513ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33468/0 (socket says 172.21.15.84:33468) 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf892e1700 1 -- 172.21.15.84:0/3988598844 learned_addr learned my addr 172.21.15.84:0/3988598844 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf892e1700 1 -- 172.21.15.84:0/3988598844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5142cc0 msgr2=0x55c9d5187770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf892e1700 1 --2- 172.21.15.84:0/3988598844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5142cc0 0x55c9d5187770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf892e1700 1 -- 172.21.15.84:0/3988598844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 msgr2=0x55c9d518b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf892e1700 1 --2- 172.21.15.84:0/3988598844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d518b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf892e1700 1 -- 172.21.15.84:0/3988598844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9d5060780 con 0x55c9d5141840 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf892e1700 1 --2- 172.21.15.84:0/3988598844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5141840 0x55c9d513ebe0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcf80051300 tx=0x7fcf80013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82deeb38e6d0399d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf6effd700 1 -- 172.21.15.84:0/3988598844 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8005bda0 con 0x55c9d5141840 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf6effd700 1 -- 172.21.15.84:0/3988598844 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8006b1d0 con 0x55c9d5141840 2023-10-06T03:25:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.518+0000 7fcf6effd700 1 -- 172.21.15.84:0/3988598844 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000fe40 con 0x55c9d5141840 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.519+0000 7fcf9483db80 1 -- 172.21.15.84:0/3988598844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5141840 msgr2=0x55c9d513ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.519+0000 7fcf9483db80 1 --2- 172.21.15.84:0/3988598844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5141840 0x55c9d513ebe0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcf80051300 tx=0x7fcf80013040 comp rx=0 tx=0).stop 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.519+0000 7fcf9483db80 1 -- 172.21.15.84:0/3988598844 shutdown_connections 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.519+0000 7fcf9483db80 1 --2- 172.21.15.84:0/3988598844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d518b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.519+0000 7fcf9483db80 1 --2- 172.21.15.84:0/3988598844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5141840 0x55c9d513ebe0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.519+0000 7fcf9483db80 1 --2- 172.21.15.84:0/3988598844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5142cc0 0x55c9d5187770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.519+0000 7fcf9483db80 1 -- 172.21.15.84:0/3988598844 >> 172.21.15.84:0/3988598844 conn(0x55c9d5143160 msgr2=0x55c9d51a96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.519+0000 7fcf9483db80 1 -- 172.21.15.84:0/3988598844 shutdown_connections 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.519+0000 7fcf9483db80 1 -- 172.21.15.84:0/3988598844 wait complete. 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.519+0000 7fcf9483db80 1 -- start start 2023-10-06T03:25:27.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.520+0000 7fcf9483db80 1 Processor -- start 2023-10-06T03:25:27.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.520+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d51eda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.520+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d5167420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.520+0000 7fcf9483db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d5167960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.520+0000 7fcf9483db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d518f3a0 con 0x55c9d5142cc0 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.520+0000 7fcf9483db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d5142590 con 0x55c9d5191c00 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.520+0000 7fcf9483db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d5168170 con 0x55c9d5141840 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.520+0000 7fcf9483db80 10 client.0 _ll_register_callbacks cb 0x55c9d5104e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.520+0000 7fcf88ae0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d5167420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.520+0000 7fcf88ae0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d5167420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33474/0 (socket says 172.21.15.84:33474) 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf88ae0700 1 -- 172.21.15.84:0/3264627640 learned_addr learned my addr 172.21.15.84:0/3264627640 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf892e1700 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d51eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf88ae0700 1 -- 172.21.15.84:0/3264627640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 msgr2=0x55c9d51eda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf89ae2700 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d5167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d51eda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf88ae0700 1 -- 172.21.15.84:0/3264627640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 msgr2=0x55c9d5167960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d5167960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf88ae0700 1 -- 172.21.15.84:0/3264627640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf84157fa0 con 0x55c9d5142cc0 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf88ae0700 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d5167420 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcf740095c0 tx=0x7fcf74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35f7edd77896dd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf637fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf637fe700 1 -- 172.21.15.84:0/3264627640 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7401f830 con 0x55c9d5142cc0 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf637fe700 1 -- 172.21.15.84:0/3264627640 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcf7401b040 con 0x55c9d5142cc0 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf9483db80 1 -- 172.21.15.84:0/3264627640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf74013940 con 0x55c9d5142cc0 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf637fe700 1 -- 172.21.15.84:0/3264627640 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf7401fba0 con 0x55c9d5142cc0 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf9483db80 10 client.5694 fetch_fsmap learned FSMap version 24 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf9483db80 1 -- 172.21.15.84:0/3264627640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55c9d5047470 con 0x55c9d5142cc0 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf637fe700 1 -- 172.21.15.84:0/3264627640 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74013940 con 0x55c9d5142cc0 2023-10-06T03:25:27.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf637fe700 1 -- 172.21.15.84:0/3264627640 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcf74031020 con 0x55c9d5142cc0 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf9483db80 10 client.5694 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf9483db80 10 client.5694 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf9483db80 20 client.5694 populate_metadata read hostname 'smithi084' 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf9483db80 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.84:6835/3473748806,v1:172.21.15.84:6837/3473748806] conn(0x55c9d517ec20 0x55c9d517eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf9483db80 4 client.5694 mds_command: new command op to 5526 tid=0[{"prefix": "status"}] 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.521+0000 7fcf9483db80 1 -- 172.21.15.84:0/3264627640 --> [v2:172.21.15.84:6835/3473748806,v1:172.21.15.84:6837/3473748806] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c9d5034e00 con 0x55c9d517ec20 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf892e1700 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.84:6835/3473748806,v1:172.21.15.84:6837/3473748806] conn(0x55c9d517ec20 0x55c9d517eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf637fe700 10 client.5694 ms_handle_connect on v2:172.21.15.84:6835/3473748806 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf892e1700 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.84:6835/3473748806,v1:172.21.15.84:6837/3473748806] conn(0x55c9d517ec20 0x55c9d517eff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffc8b1afa2f44562 server_cookie=1619b52c8b247caf in_seq=0 out_seq=0 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf637fe700 1 -- 172.21.15.84:0/3264627640 <== mds.0 v2:172.21.15.84:6835/3473748806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c9d5034e00 con 0x55c9d517ec20 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf637fe700 10 client.5694 handle_command_reply: tid=0 2023-10-06T03:25:27.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 client.5694 shutdown 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 -- 172.21.15.84:0/3264627640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 msgr2=0x55c9d5167420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d5167420 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcf740095c0 tx=0x7fcf74018000 comp rx=0 tx=0).stop 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 -- 172.21.15.84:0/3264627640 shutdown_connections 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c9d5191c00 0x55c9d5167960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.84:6835/3473748806,v1:172.21.15.84:6837/3473748806] conn(0x55c9d517ec20 0x55c9d517eff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c9d5141840 0x55c9d51eda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf637fe700 0 client.5694 ms_handle_reset on v2:172.21.15.84:6835/3473748806 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 --2- 172.21.15.84:0/3264627640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9d5142cc0 0x55c9d5167420 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 -- 172.21.15.84:0/3264627640 >> 172.21.15.84:0/3264627640 conn(0x55c9d5143160 msgr2=0x55c9d5144ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 -- 172.21.15.84:0/3264627640 shutdown_connections 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 1 -- 172.21.15.84:0/3264627640 wait complete. 2023-10-06T03:25:27.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.522+0000 7fcf9483db80 20 client.5694 trim_cache size 0 max 16384 2023-10-06T03:25:27.531 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:25:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:25:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:25:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5526, 2023-10-06T03:25:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:25:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:25:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:25:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 5.7879468809999999, 2023-10-06T03:25:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 24, 2023-10-06T03:25:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 50, 2023-10-06T03:25:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 50, 2023-10-06T03:25:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 11.920523819 2023-10-06T03:25:27.532 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:25:27.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 -- 172.21.15.84:0/1016056441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf68066f30 msgr2=0x7fcf680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf68066f30 0x7fcf680693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf840ab0f0 tx=0x7fcf740091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 -- 172.21.15.84:0/1016056441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 msgr2=0x7fcf84157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 0x7fcf84157a60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000b5e0 tx=0x7fcf800090f0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 -- 172.21.15.84:0/1016056441 shutdown_connections 2023-10-06T03:25:27.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf68066f30 0x7fcf680693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf841595a0 0x7fcf8409d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf840b07a0 0x7fcf84157a60 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 --2- 172.21.15.84:0/1016056441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf840b49e0 0x7fcf840acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 -- 172.21.15.84:0/1016056441 >> 172.21.15.84:0/1016056441 conn(0x7fcf84099830 msgr2=0x7fcf84158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 -- 172.21.15.84:0/1016056441 shutdown_connections 2023-10-06T03:25:27.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.523+0000 7fcf8b545700 1 -- 172.21.15.84:0/1016056441 wait complete. 2023-10-06T03:25:27.535 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:25:27.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.649+0000 7f8cb2751700 1 Processor -- start 2023-10-06T03:25:27.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.649+0000 7f8cb2751700 1 -- start start 2023-10-06T03:25:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cb2751700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8cac0adba0 0x7f8cac0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cb2751700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8cac0ce710 0x7f8cac15af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cb2751700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac157e20 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cb2751700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac0cbbd0 con 0x7f8cac0adba0 2023-10-06T03:25:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cb2751700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac0ceb50 con 0x7f8cac0ce710 2023-10-06T03:25:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cab7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8cac0adba0 0x7f8cac0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cabfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8cac0ca3b0 0x7f8cac1582b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56602/0 (socket says 172.21.15.84:56602) 2023-10-06T03:25:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cabfff700 1 -- 172.21.15.84:0/936409329 learned_addr learned my addr 172.21.15.84:0/936409329 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cab7fe700 1 -- 172.21.15.84:0/936409329 >> v2:172.21.15.131:3300/0 conn(0x7f8cac0ce710 msgr2=0x7f8cac15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cab7fe700 1 --2- 172.21.15.84:0/936409329 >> v2:172.21.15.131:3300/0 conn(0x7f8cac0ce710 0x7f8cac15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cab7fe700 1 -- 172.21.15.84:0/936409329 >> v1:172.21.15.84:6789/0 conn(0x7f8cac0ca3b0 legacy=0x7f8cac1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.650+0000 7f8cab7fe700 1 -- 172.21.15.84:0/936409329 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0cb610 con 0x7f8cac0adba0 2023-10-06T03:25:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8cab7fe700 1 --2- 172.21.15.84:0/936409329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0adba0 0x7f8cac0ce1d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8cac155500 tx=0x7f8c9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b88f36c8a294df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8caaffd700 1 -- 172.21.15.84:0/936409329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00b6b0 con 0x7f8cac0adba0 2023-10-06T03:25:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8caaffd700 1 -- 172.21.15.84:0/936409329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c00b810 con 0x7f8cac0adba0 2023-10-06T03:25:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8caaffd700 1 -- 172.21.15.84:0/936409329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00bbb0 con 0x7f8cac0adba0 2023-10-06T03:25:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8cb2751700 1 -- 172.21.15.84:0/936409329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0adba0 msgr2=0x7f8cac0ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8cb2751700 1 --2- 172.21.15.84:0/936409329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0adba0 0x7f8cac0ce1d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8cac155500 tx=0x7f8c9c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8cb2751700 1 -- 172.21.15.84:0/936409329 shutdown_connections 2023-10-06T03:25:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8cb2751700 1 --2- 172.21.15.84:0/936409329 >> v2:172.21.15.131:3300/0 conn(0x7f8cac0ce710 0x7f8cac15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8cb2751700 1 --2- 172.21.15.84:0/936409329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0adba0 0x7f8cac0ce1d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8cb2751700 1 -- 172.21.15.84:0/936409329 >> 172.21.15.84:0/936409329 conn(0x7f8cac070810 msgr2=0x7f8cac070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8cb2751700 1 -- 172.21.15.84:0/936409329 shutdown_connections 2023-10-06T03:25:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.651+0000 7f8cb2751700 1 -- 172.21.15.84:0/936409329 wait complete. 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.652+0000 7f8cb2751700 1 Processor -- start 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cb2751700 1 -- start start 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cb2751700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cac0adba0 0x7f8cac0c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cb2751700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0ca3b0 0x7f8cac0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cb2751700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ce710 0x7f8cac167610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cb2751700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0b1600 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cb2751700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0b18a0 con 0x7f8cac0ce710 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cb2751700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0b1b80 con 0x7f8cac0adba0 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0ca3b0 0x7f8cac0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0ca3b0 0x7f8cac0b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33486/0 (socket says 172.21.15.84:33486) 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cab7fe700 1 -- 172.21.15.84:0/2647371893 learned_addr learned my addr 172.21.15.84:0/2647371893 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cb0cee700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ce710 0x7f8cac167610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.653+0000 7f8cabfff700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cac0adba0 0x7f8cac0c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8cab7fe700 1 -- 172.21.15.84:0/2647371893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cac0adba0 msgr2=0x7f8cac0c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8cab7fe700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cac0adba0 0x7f8cac0c4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8cab7fe700 1 -- 172.21.15.84:0/2647371893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ce710 msgr2=0x7f8cac167610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8cab7fe700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ce710 0x7f8cac167610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8cab7fe700 1 -- 172.21.15.84:0/2647371893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c009420 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8cabfff700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cac0adba0 0x7f8cac0c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8cab7fe700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0ca3b0 0x7f8cac0b10c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c013000 tx=0x7f8c9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8c93fff700 1 -- 172.21.15.84:0/2647371893 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00bb90 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8c93fff700 1 -- 172.21.15.84:0/2647371893 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c011420 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8cb2751700 1 -- 172.21.15.84:0/2647371893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac0b1e60 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8c93fff700 1 -- 172.21.15.84:0/2647371893 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0117a0 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.654+0000 7f8cb2751700 1 -- 172.21.15.84:0/2647371893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac0b2420 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.655+0000 7f8cb2751700 1 -- 172.21.15.84:0/2647371893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac064ad0 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.655+0000 7f8c93fff700 1 -- 172.21.15.84:0/2647371893 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c9c011b10 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.656+0000 7f8c93fff700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8c98066f30 0x7f8c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.656+0000 7f8c93fff700 1 -- 172.21.15.84:0/2647371893 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8c9c086160 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.656+0000 7f8cabfff700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8c98066f30 0x7f8c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.656+0000 7f8cabfff700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8c98066f30 0x7f8c980693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0001820 tx=0x7f8ca0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.660+0000 7f8c93fff700 1 -- 172.21.15.84:0/2647371893 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c9c053130 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.883+0000 7f8cb2751700 1 -- 172.21.15.84:0/2647371893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8cac0cb8f0 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.883+0000 7f8c93fff700 1 -- 172.21.15.84:0/2647371893 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8c9c056750 con 0x7f8cac0ca3b0 2023-10-06T03:25:27.884 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:25:27.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.885+0000 7f8cb2751700 1 -- 172.21.15.84:0/2647371893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8c98066f30 msgr2=0x7f8c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.885+0000 7f8cb2751700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8c98066f30 0x7f8c980693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0001820 tx=0x7f8ca0009040 comp rx=0 tx=0).stop 2023-10-06T03:25:27.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.885+0000 7f8cb2751700 1 -- 172.21.15.84:0/2647371893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0ca3b0 msgr2=0x7f8cac0b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.885+0000 7f8cb2751700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0ca3b0 0x7f8cac0b10c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c013000 tx=0x7f8c9c017000 comp rx=0 tx=0).stop 2023-10-06T03:25:27.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.886+0000 7f8cb2751700 1 -- 172.21.15.84:0/2647371893 shutdown_connections 2023-10-06T03:25:27.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.886+0000 7f8cb2751700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8c98066f30 0x7f8c980693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.886+0000 7f8cb2751700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ce710 0x7f8cac167610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.886+0000 7f8cb2751700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cac0adba0 0x7f8cac0c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.886+0000 7f8cb2751700 1 --2- 172.21.15.84:0/2647371893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cac0ca3b0 0x7f8cac0b10c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.886+0000 7f8cb2751700 1 -- 172.21.15.84:0/2647371893 >> 172.21.15.84:0/2647371893 conn(0x7f8cac070810 msgr2=0x7f8cac0ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.886+0000 7f8cb2751700 1 -- 172.21.15.84:0/2647371893 shutdown_connections 2023-10-06T03:25:27.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:27.886+0000 7f8cb2751700 1 -- 172.21.15.84:0/2647371893 wait complete. 2023-10-06T03:25:27.898 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:25:27.898 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:25:27.898 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:25:27.899 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:25:27.899 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:27.899 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:25:27.899 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:25:27.899 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:25:27.899 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:27.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:27.899 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:25:27.915 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:25:27.916 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42427sec preferred_lft 42427sec 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9c01:bbff:fec1:72ce/64 scope link 2023-10-06T03:25:27.917 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:27.918 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:27.918 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:25:27.918 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::74a6:25ff:fe2a:c673/64 scope link 2023-10-06T03:25:27.918 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:27.918 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:27.918 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether de:34:c5:3f:21:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:25:27.918 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc34:c5ff:fe3f:21c3/64 scope link 2023-10-06T03:25:27.918 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:27.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:27.919 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:25:27.978 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:25:27.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:27.980 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:25:28.036 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:25:28.037 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:25:28.037 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:25:28.037 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:25:28.037 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:25:28.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:28.039 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:25:28.039 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:25:28.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:25:28.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:25:28.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:25:28.039 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:25:28.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:28.137 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:25:28.152 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:25:28.152 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:25:28.152 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:28.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:28.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:25:28.217 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:28.217 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:28.272 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:28.272 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:28.273 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:28.327 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:25:28.327 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:25:28.327 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:28.407 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:28.407 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:28.425 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:28.426 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:28.426 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:28.426 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:28.426 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:28.426 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:28.426 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:28.426 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:28.448 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:28.448 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:28.448 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:28.448 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:28.448 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:28.448 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:28.448 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:28.448 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:28.449 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:25:28.449 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:25:28.449 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:25:28.450 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:25:28.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:28.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:28.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:25:28.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.672+0000 7f5ca1a6a700 1 Processor -- start 2023-10-06T03:25:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.672+0000 7f5ca1a6a700 1 -- start start 2023-10-06T03:25:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca1a6a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 0x7f5c9c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca1a6a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5c9c0b2140 0x7f5c9c0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca1a6a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c0cb7e0 con 0x7f5c9c0b3610 2023-10-06T03:25:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca1a6a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c0b08a0 con 0x7f5c9c0b2140 2023-10-06T03:25:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca1a6a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0cb190 con 0x7f5c9c159480 2023-10-06T03:25:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca1269700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5c9c0b2140 0x7f5c9c0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5c9bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5c9c0b3610 0x7f5c9c0cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56618/0 (socket says 172.21.15.84:56618) 2023-10-06T03:25:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5c9bfff700 1 -- 172.21.15.84:0/1827584301 learned_addr learned my addr 172.21.15.84:0/1827584301 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca1269700 1 -- 172.21.15.84:0/1827584301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 msgr2=0x7f5c9c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:28.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca0a68700 1 --2- 172.21.15.84:0/1827584301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 0x7f5c9c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca1269700 1 --2- 172.21.15.84:0/1827584301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 0x7f5c9c0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5c9b7fe700 1 -- 172.21.15.84:0/1827584301 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994742966 0 0) 0x7f5c9c0cb7e0 con 0x7f5c9c0b3610 2023-10-06T03:25:28.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca1269700 1 -- 172.21.15.84:0/1827584301 >> v1:172.21.15.84:6789/0 conn(0x7f5c9c0b3610 legacy=0x7f5c9c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.673+0000 7f5ca1269700 1 -- 172.21.15.84:0/1827584301 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c0cb470 con 0x7f5c9c0b2140 2023-10-06T03:25:28.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5ca1269700 1 --2- 172.21.15.84:0/1827584301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b2140 0x7f5c9c0b25c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009e60 tx=0x7f5c94009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4de0aa1e7a2bf8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5c9b7fe700 1 -- 172.21.15.84:0/1827584301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400e070 con 0x7f5c9c0b2140 2023-10-06T03:25:28.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5c9b7fe700 1 -- 172.21.15.84:0/1827584301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9400bc30 con 0x7f5c9c0b2140 2023-10-06T03:25:28.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5c9b7fe700 1 -- 172.21.15.84:0/1827584301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94012430 con 0x7f5c9c0b2140 2023-10-06T03:25:28.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/1827584301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b2140 msgr2=0x7f5c9c0b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5ca1a6a700 1 --2- 172.21.15.84:0/1827584301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b2140 0x7f5c9c0b25c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009e60 tx=0x7f5c94009780 comp rx=0 tx=0).stop 2023-10-06T03:25:28.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/1827584301 shutdown_connections 2023-10-06T03:25:28.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5ca1a6a700 1 --2- 172.21.15.84:0/1827584301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b2140 0x7f5c9c0b25c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5ca1a6a700 1 --2- 172.21.15.84:0/1827584301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 0x7f5c9c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/1827584301 >> 172.21.15.84:0/1827584301 conn(0x7f5c9c06ed20 msgr2=0x7f5c9c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:28.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/1827584301 shutdown_connections 2023-10-06T03:25:28.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.674+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/1827584301 wait complete. 2023-10-06T03:25:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.675+0000 7f5ca1a6a700 1 Processor -- start 2023-10-06T03:25:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.676+0000 7f5ca1a6a700 1 -- start start 2023-10-06T03:25:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.676+0000 7f5ca1a6a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c9c0b2140 0x7f5c9c16a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.676+0000 7f5ca1a6a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b3610 0x7f5c9c151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.676+0000 7f5ca1a6a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 0x7f5c9c0d0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.676+0000 7f5ca1a6a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0c61e0 con 0x7f5c9c0b3610 2023-10-06T03:25:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.676+0000 7f5ca1a6a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0ce620 con 0x7f5c9c0b2140 2023-10-06T03:25:28.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.676+0000 7f5ca1a6a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0c5f00 con 0x7f5c9c159480 2023-10-06T03:25:28.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.676+0000 7f5c9bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b3610 0x7f5c9c151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.676+0000 7f5c9bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b3610 0x7f5c9c151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33498/0 (socket says 172.21.15.84:33498) 2023-10-06T03:25:28.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.676+0000 7f5c9bfff700 1 -- 172.21.15.84:0/133267796 learned_addr learned my addr 172.21.15.84:0/133267796 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:28.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5ca1269700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 0x7f5c9c0d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5ca0a68700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c9c0b2140 0x7f5c9c16a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5c9bfff700 1 -- 172.21.15.84:0/133267796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 msgr2=0x7f5c9c0d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5c9bfff700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 0x7f5c9c0d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5c9bfff700 1 -- 172.21.15.84:0/133267796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c9c0b2140 msgr2=0x7f5c9c16a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5c9bfff700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c9c0b2140 0x7f5c9c16a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5c9bfff700 1 -- 172.21.15.84:0/133267796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94009a20 con 0x7f5c9c0b3610 2023-10-06T03:25:28.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5ca1269700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 0x7f5c9c0d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:28.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5ca0a68700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c9c0b2140 0x7f5c9c16a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:28.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5c9bfff700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b3610 0x7f5c9c151950 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000c7e0 tx=0x7f5c90007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5c98ff9700 1 -- 172.21.15.84:0/133267796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90005b30 con 0x7f5c9c0b3610 2023-10-06T03:25:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5c98ff9700 1 -- 172.21.15.84:0/133267796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c90005c90 con 0x7f5c9c0b3610 2023-10-06T03:25:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/133267796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9c0cdfd0 con 0x7f5c9c0b3610 2023-10-06T03:25:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5c98ff9700 1 -- 172.21.15.84:0/133267796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90007300 con 0x7f5c9c0b3610 2023-10-06T03:25:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.677+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/133267796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9c151e90 con 0x7f5c9c0b3610 2023-10-06T03:25:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.678+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/133267796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9c0cde10 con 0x7f5c9c0b3610 2023-10-06T03:25:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.678+0000 7f5c98ff9700 1 -- 172.21.15.84:0/133267796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c9001b400 con 0x7f5c9c0b3610 2023-10-06T03:25:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.679+0000 7f5c98ff9700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5c88066f30 0x7f5c880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.679+0000 7f5c98ff9700 1 -- 172.21.15.84:0/133267796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5c90084350 con 0x7f5c9c0b3610 2023-10-06T03:25:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.679+0000 7f5ca0a68700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5c88066f30 0x7f5c880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.679+0000 7f5ca0a68700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5c88066f30 0x7f5c880693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c006fd0 tx=0x7f5c8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.683+0000 7f5c98ff9700 1 -- 172.21.15.84:0/133267796 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c90051300 con 0x7f5c9c0b3610 2023-10-06T03:25:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.910+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/133267796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5c9c05f270 con 0x7f5c9c0b3610 2023-10-06T03:25:28.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.910+0000 7f5c98ff9700 1 -- 172.21.15.84:0/133267796 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5c90054920 con 0x7f5c9c0b3610 2023-10-06T03:25:28.911 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:25:28.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/133267796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5c88066f30 msgr2=0x7f5c880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5c88066f30 0x7f5c880693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c006fd0 tx=0x7f5c8c008040 comp rx=0 tx=0).stop 2023-10-06T03:25:28.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/133267796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b3610 msgr2=0x7f5c9c151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b3610 0x7f5c9c151950 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000c7e0 tx=0x7f5c90007df0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/133267796 shutdown_connections 2023-10-06T03:25:28.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5c88066f30 0x7f5c880693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c9c0b2140 0x7f5c9c16a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9c159480 0x7f5c9c0d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 --2- 172.21.15.84:0/133267796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c9c0b3610 0x7f5c9c151950 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/133267796 >> 172.21.15.84:0/133267796 conn(0x7f5c9c06ed20 msgr2=0x7f5c9c1568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/133267796 shutdown_connections 2023-10-06T03:25:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:28.912+0000 7f5ca1a6a700 1 -- 172.21.15.84:0/133267796 wait complete. 2023-10-06T03:25:28.924 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:25:28.925 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:25:28.925 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T03:25:28.925 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:25:28.925 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:28.925 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:25:28.925 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:25:28.925 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:25:28.926 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:25:28.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:28.926 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T03:25:28.945 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:25:28.945 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:25:28.945 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:25:28.945 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:28.946 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:25:28.946 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:28.946 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:28.946 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:28.946 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T03:25:28.946 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:28.947 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:28.947 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T03:25:28.947 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:28.947 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:28.947 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:25:28.948 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:28.948 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:25:28.948 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42424sec preferred_lft 42424sec 2023-10-06T03:25:28.948 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T03:25:28.948 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:28.948 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:25:28.949 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:28.949 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:25:28.949 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:28.949 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::a0d2:65ff:fe0e:962d/64 scope link 2023-10-06T03:25:28.949 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:28.949 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:28.950 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether e6:c9:c5:59:18:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:25:28.950 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::e4c9:c5ff:fe59:18bb/64 scope link 2023-10-06T03:25:28.950 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:28.950 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:28.950 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:25:28.950 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4f1:c0ff:fe85:853d/64 scope link 2023-10-06T03:25:28.951 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:28.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:28.951 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:25:29.012 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T03:25:29.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:29.013 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T03:25:29.071 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T03:25:29.071 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:25:29.071 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:25:29.071 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:25:29.071 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:25:29.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:29.072 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:25:29.072 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:25:29.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:25:29.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:25:29.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:25:29.072 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:25:29.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:29.176 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:25:29.191 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:25:29.192 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:25:29.192 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:25:29.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:29.192 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-10-06T03:25:29.257 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:29.257 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:29.312 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:25:29.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:29.312 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:29.366 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T03:25:29.367 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:25:29.367 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:29.448 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:29.448 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:29.466 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:29.466 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:29.466 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:29.467 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:29.467 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:29.467 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:29.467 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:29.467 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:29.489 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:29.490 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:29.490 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:29.490 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:29.490 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:29.490 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:29.490 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:29.490 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:29.490 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:25:29.491 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:25:29.491 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:25:29.492 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:25:29.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:29.492 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:29.557 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:25:29.557 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:29.597 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:29.639 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:25:29.640 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:25:29.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:25:29.640 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:29.684 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:25:29.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:29.684 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:25:29.699 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:25:29.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:25:29.700 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:29.736 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:25:29.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:29.736 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:25:29.791 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:29.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.904+0000 7fbe9b59e700 1 Processor -- start 2023-10-06T03:25:29.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.904+0000 7fbe9b59e700 1 -- start start 2023-10-06T03:25:29.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe9b59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbe9c0b2850 0x7fbe9c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:29.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe9b59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c0cb7e0 con 0x7fbe9c159480 2023-10-06T03:25:29.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe9b59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c0b08a0 con 0x7fbe9c0cbc70 2023-10-06T03:25:29.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe9b59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c0cb190 con 0x7fbe9c0b2850 2023-10-06T03:25:29.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe9a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbe9c159480 0x7fbe9c0b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56634/0 (socket says 172.21.15.84:56634) 2023-10-06T03:25:29.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe9a59c700 1 -- 172.21.15.84:0/3025311655 learned_addr learned my addr 172.21.15.84:0/3025311655 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:29.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681061135 0 0) 0x7fbe9c0cb7e0 con 0x7fbe9c159480 2023-10-06T03:25:29.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe88003570 con 0x7fbe9c159480 2023-10-06T03:25:29.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe9ad9d700 1 --2- 172.21.15.84:0/3025311655 >> v2:172.21.15.131:3300/0 conn(0x7fbe9c0b2850 0x7fbe9c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:29.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 955461365 0 0) 0x7fbe88003570 con 0x7fbe9c159480 2023-10-06T03:25:29.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 >> v2:172.21.15.131:3300/0 conn(0x7fbe9c0b2850 msgr2=0x7fbe9c0cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:29.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 --2- 172.21.15.84:0/3025311655 >> v2:172.21.15.131:3300/0 conn(0x7fbe9c0b2850 0x7fbe9c0cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:29.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 >> v1:172.21.15.131:6789/0 conn(0x7fbe9c0cbc70 legacy=0x7fbe9c0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:29.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c0cb470 con 0x7fbe9c159480 2023-10-06T03:25:29.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fbe8c001470 con 0x7fbe9c159480 2023-10-06T03:25:29.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 >> v1:172.21.15.84:6789/0 conn(0x7fbe9c159480 legacy=0x7fbe9c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:29.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe88003a60 0x7fbe88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:29.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.905+0000 7fbe99d9b700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe88004810 0x7fbe88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:29.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe99d9b700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe880051c0 0x7fbe8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:29.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0cb190 con 0x7fbe88003a60 2023-10-06T03:25:29.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8800c0d0 con 0x7fbe880051c0 2023-10-06T03:25:29.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8800c290 con 0x7fbe88004810 2023-10-06T03:25:29.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe9a59c700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe88003a60 0x7fbe88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:29.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe9ad9d700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe880051c0 0x7fbe8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:29.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe91d9b700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe88004810 0x7fbe88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:29.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe9a59c700 1 -- 172.21.15.84:0/3025311655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe88004810 msgr2=0x7fbe88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:29.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe9a59c700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe88004810 0x7fbe88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe9a59c700 1 -- 172.21.15.84:0/3025311655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe880051c0 msgr2=0x7fbe8800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe9a59c700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe880051c0 0x7fbe8800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe9a59c700 1 -- 172.21.15.84:0/3025311655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88003570 con 0x7fbe88003a60 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe9ad9d700 1 -- 172.21.15.84:0/3025311655 reap_dead start 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe9a59c700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe88003a60 0x7fbe88003e70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00c3c0 tx=0x7fbe8c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a06e6190dc1001 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00cc50 con 0x7fbe88003a60 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c00cdb0 con 0x7fbe88003a60 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.906+0000 7fbe99d9b700 1 -- 172.21.15.84:0/3025311655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c005b50 con 0x7fbe88003a60 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.907+0000 7fbe9b59e700 1 -- 172.21.15.84:0/3025311655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe88003a60 msgr2=0x7fbe88003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.907+0000 7fbe9b59e700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe88003a60 0x7fbe88003e70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00c3c0 tx=0x7fbe8c001e50 comp rx=0 tx=0).stop 2023-10-06T03:25:29.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.907+0000 7fbe9b59e700 1 -- 172.21.15.84:0/3025311655 shutdown_connections 2023-10-06T03:25:29.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.907+0000 7fbe9b59e700 1 --2- 172.21.15.84:0/3025311655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe88003a60 0x7fbe88003e70 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:29.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.907+0000 7fbe9b59e700 1 -- 172.21.15.84:0/3025311655 >> 172.21.15.84:0/3025311655 conn(0x7fbe9c06ed20 msgr2=0x7fbe9c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:29.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.907+0000 7fbe9b59e700 1 -- 172.21.15.84:0/3025311655 shutdown_connections 2023-10-06T03:25:29.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.907+0000 7fbe9b59e700 1 -- 172.21.15.84:0/3025311655 wait complete. 2023-10-06T03:25:29.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.908+0000 7fbe9b59e700 1 Processor -- start 2023-10-06T03:25:29.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.908+0000 7fbe9b59e700 1 -- start start 2023-10-06T03:25:29.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe9b59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe88003a60 0x7fbe9c1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:29.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe9b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe9c15b490 0x7fbe9c15b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:29.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe9b59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9c0cef50 0x7fbe9c0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:29.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe9b59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0c8e40 con 0x7fbe9c15b490 2023-10-06T03:25:29.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe9b59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c15be40 con 0x7fbe88003a60 2023-10-06T03:25:29.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe9b59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0cde30 con 0x7fbe9c0cef50 2023-10-06T03:25:29.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe91d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe9c15b490 0x7fbe9c15b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:29.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe91d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe9c15b490 0x7fbe9c15b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33516/0 (socket says 172.21.15.84:33516) 2023-10-06T03:25:29.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe91d9b700 1 -- 172.21.15.84:0/33966579 learned_addr learned my addr 172.21.15.84:0/33966579 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:29.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe9a59c700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe88003a60 0x7fbe9c1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:29.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe9ad9d700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9c0cef50 0x7fbe9c0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe91d9b700 1 -- 172.21.15.84:0/33966579 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9c0cef50 msgr2=0x7fbe9c0cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe91d9b700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9c0cef50 0x7fbe9c0cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe91d9b700 1 -- 172.21.15.84:0/33966579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe88003a60 msgr2=0x7fbe9c1548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe91d9b700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe88003a60 0x7fbe9c1548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe91d9b700 1 -- 172.21.15.84:0/33966579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c0ce9b0 con 0x7fbe9c15b490 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe91d9b700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe9c15b490 0x7fbe9c15b900 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400e5b0 tx=0x7fbe84009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe92ffd700 1 -- 172.21.15.84:0/33966579 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400ee80 con 0x7fbe9c15b490 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe92ffd700 1 -- 172.21.15.84:0/33966579 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe840114f0 con 0x7fbe9c15b490 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe9b59e700 1 -- 172.21.15.84:0/33966579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c0cf900 con 0x7fbe9c15b490 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe92ffd700 1 -- 172.21.15.84:0/33966579 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84011890 con 0x7fbe9c15b490 2023-10-06T03:25:29.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.909+0000 7fbe9b59e700 1 -- 172.21.15.84:0/33966579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c0ce360 con 0x7fbe9c15b490 2023-10-06T03:25:29.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.910+0000 7fbe9b59e700 1 -- 172.21.15.84:0/33966579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9c0ceb40 con 0x7fbe9c15b490 2023-10-06T03:25:29.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.911+0000 7fbe92ffd700 1 -- 172.21.15.84:0/33966579 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe84011c00 con 0x7fbe9c15b490 2023-10-06T03:25:29.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.911+0000 7fbe92ffd700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbe7c066f30 0x7fbe7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:29.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.911+0000 7fbe92ffd700 1 -- 172.21.15.84:0/33966579 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbe84084380 con 0x7fbe9c15b490 2023-10-06T03:25:29.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.911+0000 7fbe9a59c700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbe7c066f30 0x7fbe7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:29.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.911+0000 7fbe9a59c700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbe7c066f30 0x7fbe7c0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c001ed0 tx=0x7fbe8c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:29.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:29.915+0000 7fbe92ffd700 1 -- 172.21.15.84:0/33966579 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe8404d5a0 con 0x7fbe9c15b490 2023-10-06T03:25:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.141+0000 7fbe9b59e700 1 -- 172.21.15.84:0/33966579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe9c05f270 con 0x7fbe9c15b490 2023-10-06T03:25:30.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.141+0000 7fbe92ffd700 1 -- 172.21.15.84:0/33966579 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fbe84051400 con 0x7fbe9c15b490 2023-10-06T03:25:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:30.142 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3103408955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3103408955},{"type":"v1","addr":"172.21.15.131:6834","nonce":3103408955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3982920665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3982920665},{"type":"v1","addr":"172.21.15.131:6835","nonce":3982920665}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1537563341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1537563341},{"type":"v1","addr":"172.21.15.84:6836","nonce":1537563341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:21.111306+0000","modified":"2023-10-06T03:25:24.747627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5526":{"gid":5526,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3473748806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3473748806},{"type":"v1","addr":"172.21.15.84:6837","nonce":3473748806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:25:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 -- 172.21.15.84:0/33966579 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbe7c066f30 msgr2=0x7fbe7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbe7c066f30 0x7fbe7c0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c001ed0 tx=0x7fbe8c015000 comp rx=0 tx=0).stop 2023-10-06T03:25:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 -- 172.21.15.84:0/33966579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe9c15b490 msgr2=0x7fbe9c15b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe9c15b490 0x7fbe9c15b900 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400e5b0 tx=0x7fbe84009040 comp rx=0 tx=0).stop 2023-10-06T03:25:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 -- 172.21.15.84:0/33966579 shutdown_connections 2023-10-06T03:25:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbe7c066f30 0x7fbe7c0693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe88003a60 0x7fbe9c1548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9c0cef50 0x7fbe9c0cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 --2- 172.21.15.84:0/33966579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe9c15b490 0x7fbe9c15b900 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 -- 172.21.15.84:0/33966579 >> 172.21.15.84:0/33966579 conn(0x7fbe9c06ed20 msgr2=0x7fbe9c0b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 -- 172.21.15.84:0/33966579 shutdown_connections 2023-10-06T03:25:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.143+0000 7fbe9b59e700 1 -- 172.21.15.84:0/33966579 wait complete. 2023-10-06T03:25:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2023-10-06T03:25:30.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:30.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.268+0000 7fa84a1d2700 1 Processor -- start 2023-10-06T03:25:30.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.268+0000 7fa84a1d2700 1 -- start start 2023-10-06T03:25:30.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.269+0000 7fa84a1d2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8440b49e0 0x7fa8440aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.269+0000 7fa84a1d2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8440b07a0 0x7fa8440b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.269+0000 7fa84a1d2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8440b0ca0 con 0x7fa8441595a0 2023-10-06T03:25:30.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.269+0000 7fa84a1d2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8440b0f80 con 0x7fa8440b07a0 2023-10-06T03:25:30.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.269+0000 7fa84a1d2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440b1260 con 0x7fa8440b49e0 2023-10-06T03:25:30.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.269+0000 7fa843fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8440b07a0 0x7fa8440b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.269+0000 7fa8437fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa8441595a0 0x7fa8440aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56650/0 (socket says 172.21.15.84:56650) 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.269+0000 7fa843fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8440b07a0 0x7fa8440b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33528/0 (socket says 172.21.15.84:33528) 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.269+0000 7fa8437fe700 1 -- 172.21.15.84:0/1527235265 learned_addr learned my addr 172.21.15.84:0/1527235265 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.269+0000 7fa842ffd700 1 --2- 172.21.15.84:0/1527235265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8440b49e0 0x7fa8440aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa843fff700 1 -- 172.21.15.84:0/1527235265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8440b49e0 msgr2=0x7fa8440aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa843fff700 1 --2- 172.21.15.84:0/1527235265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8440b49e0 0x7fa8440aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa843fff700 1 -- 172.21.15.84:0/1527235265 >> v1:172.21.15.84:6789/0 conn(0x7fa8441595a0 legacy=0x7fa8440aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa843fff700 1 -- 172.21.15.84:0/1527235265 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440b1540 con 0x7fa8440b07a0 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa8427fc700 1 -- 172.21.15.84:0/1527235265 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388969164 0 0) 0x7fa8440b0ca0 con 0x7fa8441595a0 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa842ffd700 1 --2- 172.21.15.84:0/1527235265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8440b49e0 0x7fa8440aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa843fff700 1 --2- 172.21.15.84:0/1527235265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b07a0 0x7fa8440b1c00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009e60 tx=0x7fa83c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd37f3e6f421f90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa8427fc700 1 -- 172.21.15.84:0/1527235265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00e070 con 0x7fa8440b07a0 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa8427fc700 1 -- 172.21.15.84:0/1527235265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c00bc30 con 0x7fa8440b07a0 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa8427fc700 1 -- 172.21.15.84:0/1527235265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c012430 con 0x7fa8440b07a0 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa84a1d2700 1 -- 172.21.15.84:0/1527235265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b07a0 msgr2=0x7fa8440b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa84a1d2700 1 --2- 172.21.15.84:0/1527235265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b07a0 0x7fa8440b1c00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009e60 tx=0x7fa83c009780 comp rx=0 tx=0).stop 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa84a1d2700 1 -- 172.21.15.84:0/1527235265 shutdown_connections 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa84a1d2700 1 --2- 172.21.15.84:0/1527235265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b07a0 0x7fa8440b1c00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa84a1d2700 1 --2- 172.21.15.84:0/1527235265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8440b49e0 0x7fa8440aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.270+0000 7fa84a1d2700 1 -- 172.21.15.84:0/1527235265 >> 172.21.15.84:0/1527235265 conn(0x7fa844099830 msgr2=0x7fa84406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.271+0000 7fa84a1d2700 1 -- 172.21.15.84:0/1527235265 shutdown_connections 2023-10-06T03:25:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.271+0000 7fa84a1d2700 1 -- 172.21.15.84:0/1527235265 wait complete. 2023-10-06T03:25:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.272+0000 7fa84a1d2700 1 Processor -- start 2023-10-06T03:25:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.272+0000 7fa84a1d2700 1 -- start start 2023-10-06T03:25:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.272+0000 7fa84a1d2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8440b07a0 0x7fa8440ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.272+0000 7fa84a1d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b49e0 0x7fa8440aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.272+0000 7fa84a1d2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8441595a0 0x7fa84409d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa84a1d2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415d0d0 con 0x7fa8440b49e0 2023-10-06T03:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa84a1d2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415a0f0 con 0x7fa8440b07a0 2023-10-06T03:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa84a1d2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415cdf0 con 0x7fa8441595a0 2023-10-06T03:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa842ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b49e0 0x7fa8440aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa842ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b49e0 0x7fa8440aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33538/0 (socket says 172.21.15.84:33538) 2023-10-06T03:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa842ffd700 1 -- 172.21.15.84:0/2076039678 learned_addr learned my addr 172.21.15.84:0/2076039678 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa843fff700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8441595a0 0x7fa84409d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa8437fe700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8440b07a0 0x7fa8440ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa842ffd700 1 -- 172.21.15.84:0/2076039678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8441595a0 msgr2=0x7fa84409d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa842ffd700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8441595a0 0x7fa84409d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa842ffd700 1 -- 172.21.15.84:0/2076039678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8440b07a0 msgr2=0x7fa8440ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa842ffd700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8440b07a0 0x7fa8440ab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa842ffd700 1 -- 172.21.15.84:0/2076039678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c009a20 con 0x7fa8440b49e0 2023-10-06T03:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa842ffd700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b49e0 0x7fa8440aea30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa83800e900 tx=0x7fa838008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa82b7fe700 1 -- 172.21.15.84:0/2076039678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800eea0 con 0x7fa8440b49e0 2023-10-06T03:25:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa82b7fe700 1 -- 172.21.15.84:0/2076039678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83800c5e0 con 0x7fa8440b49e0 2023-10-06T03:25:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa84a1d2700 1 -- 172.21.15.84:0/2076039678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa844159aa0 con 0x7fa8440b49e0 2023-10-06T03:25:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa82b7fe700 1 -- 172.21.15.84:0/2076039678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800c980 con 0x7fa8440b49e0 2023-10-06T03:25:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.273+0000 7fa84a1d2700 1 -- 172.21.15.84:0/2076039678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8440aef70 con 0x7fa8440b49e0 2023-10-06T03:25:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.274+0000 7fa84a1d2700 1 -- 172.21.15.84:0/2076039678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84415a280 con 0x7fa8440b49e0 2023-10-06T03:25:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.275+0000 7fa82b7fe700 1 -- 172.21.15.84:0/2076039678 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa83800cd30 con 0x7fa8440b49e0 2023-10-06T03:25:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.275+0000 7fa82b7fe700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa830066f30 0x7fa8300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.275+0000 7fa82b7fe700 1 -- 172.21.15.84:0/2076039678 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa838084570 con 0x7fa8440b49e0 2023-10-06T03:25:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.275+0000 7fa8437fe700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa830066f30 0x7fa8300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.275+0000 7fa8437fe700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa830066f30 0x7fa8300693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa84415fdd0 tx=0x7fa834009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:30.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.279+0000 7fa82b7fe700 1 -- 172.21.15.84:0/2076039678 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa838054fd0 con 0x7fa8440b49e0 2023-10-06T03:25:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.461+0000 7fa84a1d2700 1 -- 172.21.15.84:0/2076039678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa844064ad0 con 0x7fa8440b49e0 2023-10-06T03:25:30.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.462+0000 7fa82b7fe700 1 -- 172.21.15.84:0/2076039678 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fa838054b60 con 0x7fa8440b49e0 2023-10-06T03:25:30.463 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:30.464 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":50,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:22.337746+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:18.741959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:20.079553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 -- 172.21.15.84:0/2076039678 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa830066f30 msgr2=0x7fa8300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa830066f30 0x7fa8300693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa84415fdd0 tx=0x7fa834009040 comp rx=0 tx=0).stop 2023-10-06T03:25:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 -- 172.21.15.84:0/2076039678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b49e0 msgr2=0x7fa8440aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b49e0 0x7fa8440aea30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa83800e900 tx=0x7fa838008040 comp rx=0 tx=0).stop 2023-10-06T03:25:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 -- 172.21.15.84:0/2076039678 shutdown_connections 2023-10-06T03:25:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa830066f30 0x7fa8300693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8440b07a0 0x7fa8440ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8441595a0 0x7fa84409d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 --2- 172.21.15.84:0/2076039678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8440b49e0 0x7fa8440aea30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 -- 172.21.15.84:0/2076039678 >> 172.21.15.84:0/2076039678 conn(0x7fa844099830 msgr2=0x7fa8440691e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:30.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.464+0000 7fa84a1d2700 1 -- 172.21.15.84:0/2076039678 shutdown_connections 2023-10-06T03:25:30.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.465+0000 7fa84a1d2700 1 -- 172.21.15.84:0/2076039678 wait complete. 2023-10-06T03:25:30.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:25:18.741959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:25:20.079553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:25:30.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:25:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.594+0000 7f653db8c700 1 Processor -- start 2023-10-06T03:25:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.594+0000 7f653db8c700 1 -- start start 2023-10-06T03:25:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653db8c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65380b2660 0x7f65380cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653db8c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65380cf1f0 0x7f65380cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653db8c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65380cc9b0 con 0x7f65380b2a30 2023-10-06T03:25:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653db8c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65380cbda0 con 0x7f65380b2660 2023-10-06T03:25:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653db8c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65380cc080 con 0x7f65380cf1f0 2023-10-06T03:25:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653cb8a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65380b2660 0x7f65380cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653cb8a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65380b2660 0x7f65380cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44574/0 (socket says 172.21.15.84:44574) 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f6537fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f65380b2a30 0x7f65380ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52530/0 (socket says 172.21.15.84:52530) 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653cb8a700 1 -- 172.21.15.84:0/32768042 learned_addr learned my addr 172.21.15.84:0/32768042 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653d38b700 1 --2- 172.21.15.84:0/32768042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65380cf1f0 0x7f65380cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653cb8a700 1 -- 172.21.15.84:0/32768042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65380cf1f0 msgr2=0x7f65380cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653cb8a700 1 --2- 172.21.15.84:0/32768042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65380cf1f0 0x7f65380cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653cb8a700 1 -- 172.21.15.84:0/32768042 >> v1:172.21.15.84:6789/0 conn(0x7f65380b2a30 legacy=0x7f65380ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653cb8a700 1 -- 172.21.15.84:0/32768042 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65380cc360 con 0x7f65380b2660 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f65377fe700 1 -- 172.21.15.84:0/32768042 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245932333 0 0) 0x7f65380cc9b0 con 0x7f65380b2a30 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f653cb8a700 1 --2- 172.21.15.84:0/32768042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2660 0x7f65380cccf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f652c009990 tx=0x7f652c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9dc42194f80a1a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.595+0000 7f65377fe700 1 -- 172.21.15.84:0/32768042 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c009e80 con 0x7f65380b2660 2023-10-06T03:25:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.596+0000 7f65377fe700 1 -- 172.21.15.84:0/32768042 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c005c10 con 0x7f65380b2660 2023-10-06T03:25:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.596+0000 7f65377fe700 1 -- 172.21.15.84:0/32768042 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c00b650 con 0x7f65380b2660 2023-10-06T03:25:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.596+0000 7f653db8c700 1 -- 172.21.15.84:0/32768042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2660 msgr2=0x7f65380cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.596+0000 7f653db8c700 1 --2- 172.21.15.84:0/32768042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2660 0x7f65380cccf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f652c009990 tx=0x7f652c009220 comp rx=0 tx=0).stop 2023-10-06T03:25:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.596+0000 7f653db8c700 1 -- 172.21.15.84:0/32768042 shutdown_connections 2023-10-06T03:25:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.596+0000 7f653db8c700 1 --2- 172.21.15.84:0/32768042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65380cf1f0 0x7f65380cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.596+0000 7f653db8c700 1 --2- 172.21.15.84:0/32768042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2660 0x7f65380cccf0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.596+0000 7f653db8c700 1 -- 172.21.15.84:0/32768042 >> 172.21.15.84:0/32768042 conn(0x7f6538099560 msgr2=0x7f653806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.596+0000 7f653db8c700 1 -- 172.21.15.84:0/32768042 shutdown_connections 2023-10-06T03:25:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.596+0000 7f653db8c700 1 -- 172.21.15.84:0/32768042 wait complete. 2023-10-06T03:25:30.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.598+0000 7f653db8c700 1 Processor -- start 2023-10-06T03:25:30.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.598+0000 7f653db8c700 1 -- start start 2023-10-06T03:25:30.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f653db8c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65380b2660 0x7f6538149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f653db8c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2a30 0x7f65380c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f653db8c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65380cf1f0 0x7f65380c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f653db8c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65381469a0 con 0x7f65380b2a30 2023-10-06T03:25:30.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f653db8c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6538146b80 con 0x7f65380b2660 2023-10-06T03:25:30.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f653db8c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6538146e60 con 0x7f65380cf1f0 2023-10-06T03:25:30.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f6537fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2a30 0x7f65380c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f6537fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2a30 0x7f65380c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44588/0 (socket says 172.21.15.84:44588) 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f6537fff700 1 -- 172.21.15.84:0/2528672872 learned_addr learned my addr 172.21.15.84:0/2528672872 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f653cb8a700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65380b2660 0x7f6538149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f653d38b700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65380cf1f0 0x7f65380c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f6537fff700 1 -- 172.21.15.84:0/2528672872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65380cf1f0 msgr2=0x7f65380c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f6537fff700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65380cf1f0 0x7f65380c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f6537fff700 1 -- 172.21.15.84:0/2528672872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65380b2660 msgr2=0x7f6538149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f6537fff700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65380b2660 0x7f6538149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.599+0000 7f6537fff700 1 -- 172.21.15.84:0/2528672872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c009480 con 0x7f65380b2a30 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.600+0000 7f6537fff700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2a30 0x7f65380c9510 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f652400c7e0 tx=0x7f6524007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.600+0000 7f6534ff9700 1 -- 172.21.15.84:0/2528672872 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6524005a70 con 0x7f65380b2a30 2023-10-06T03:25:30.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.600+0000 7f6534ff9700 1 -- 172.21.15.84:0/2528672872 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6524005bd0 con 0x7f65380b2a30 2023-10-06T03:25:30.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.600+0000 7f653db8c700 1 -- 172.21.15.84:0/2528672872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6538147140 con 0x7f65380b2a30 2023-10-06T03:25:30.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.600+0000 7f6534ff9700 1 -- 172.21.15.84:0/2528672872 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65240070d0 con 0x7f65380b2a30 2023-10-06T03:25:30.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.600+0000 7f653db8c700 1 -- 172.21.15.84:0/2528672872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65381497d0 con 0x7f65380b2a30 2023-10-06T03:25:30.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.601+0000 7f653db8c700 1 -- 172.21.15.84:0/2528672872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653805f270 con 0x7f65380b2a30 2023-10-06T03:25:30.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.601+0000 7f6534ff9700 1 -- 172.21.15.84:0/2528672872 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65240074c0 con 0x7f65380b2a30 2023-10-06T03:25:30.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.601+0000 7f6534ff9700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f651c066f30 0x7f651c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.601+0000 7f6534ff9700 1 -- 172.21.15.84:0/2528672872 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6524083be0 con 0x7f65380b2a30 2023-10-06T03:25:30.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.601+0000 7f653cb8a700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f651c066f30 0x7f651c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.602+0000 7f653cb8a700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f651c066f30 0x7f651c0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f652c009260 tx=0x7f652c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:30.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.606+0000 7f6534ff9700 1 -- 172.21.15.84:0/2528672872 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6524050bb0 con 0x7f65380b2a30 2023-10-06T03:25:30.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.786+0000 7f653db8c700 1 -- 172.21.15.84:0/2528672872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65380cc640 con 0x7f65380b2a30 2023-10-06T03:25:30.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.787+0000 7f6534ff9700 1 -- 172.21.15.84:0/2528672872 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6524017070 con 0x7f65380b2a30 2023-10-06T03:25:30.788 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:25:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 -- 172.21.15.84:0/2528672872 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f651c066f30 msgr2=0x7f651c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f651c066f30 0x7f651c0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f652c009260 tx=0x7f652c016000 comp rx=0 tx=0).stop 2023-10-06T03:25:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 -- 172.21.15.84:0/2528672872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2a30 msgr2=0x7f65380c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2a30 0x7f65380c9510 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f652400c7e0 tx=0x7f6524007de0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 -- 172.21.15.84:0/2528672872 shutdown_connections 2023-10-06T03:25:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f651c066f30 0x7f651c0693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65380b2660 0x7f6538149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65380cf1f0 0x7f65380c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 --2- 172.21.15.84:0/2528672872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380b2a30 0x7f65380c9510 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 -- 172.21.15.84:0/2528672872 >> 172.21.15.84:0/2528672872 conn(0x7f6538099560 msgr2=0x7f6538069040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 -- 172.21.15.84:0/2528672872 shutdown_connections 2023-10-06T03:25:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.789+0000 7f653db8c700 1 -- 172.21.15.84:0/2528672872 wait complete. 2023-10-06T03:25:30.802 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:25:30.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.918+0000 7f025d0c7700 1 Processor -- start 2023-10-06T03:25:30.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.918+0000 7f025d0c7700 1 -- start start 2023-10-06T03:25:30.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f025d0c7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0258159510 0x7f02580cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f025d0c7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f02581598e0 0x7f02580cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f025d0c7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02580cf350 con 0x7f02580ce820 2023-10-06T03:25:30.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f025d0c7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02580cf610 con 0x7f02581598e0 2023-10-06T03:25:30.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f025d0c7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02580cf8f0 con 0x7f0258159510 2023-10-06T03:25:30.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f024e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f02581598e0 0x7f02580cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f024e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f02581598e0 0x7f02580cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44590/0 (socket says 172.21.15.84:44590) 2023-10-06T03:25:30.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f024e59c700 1 -- 172.21.15.84:0/585991181 learned_addr learned my addr 172.21.15.84:0/585991181 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:30.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f0256d9d700 1 --2- 172.21.15.84:0/585991181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0258159510 0x7f02580cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f024e59c700 1 -- 172.21.15.84:0/585991181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0258159510 msgr2=0x7f02580cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:30.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f024e59c700 1 --2- 172.21.15.84:0/585991181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0258159510 0x7f02580cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f024e59c700 1 -- 172.21.15.84:0/585991181 >> v1:172.21.15.131:6789/0 conn(0x7f02580ce820 legacy=0x7f02580cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.919+0000 7f024e59c700 1 -- 172.21.15.84:0/585991181 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02580cfbd0 con 0x7f02581598e0 2023-10-06T03:25:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f024e59c700 1 --2- 172.21.15.84:0/585991181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 0x7f02580cbae0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f02400099b0 tx=0x7f0240009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06ee1553d5e63bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025659c700 1 -- 172.21.15.84:0/585991181 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000b860 con 0x7f02581598e0 2023-10-06T03:25:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025659c700 1 -- 172.21.15.84:0/585991181 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024000b9c0 con 0x7f02581598e0 2023-10-06T03:25:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025659c700 1 -- 172.21.15.84:0/585991181 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000bd60 con 0x7f02581598e0 2023-10-06T03:25:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025d0c7700 1 -- 172.21.15.84:0/585991181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 msgr2=0x7f02580cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025d0c7700 1 --2- 172.21.15.84:0/585991181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 0x7f02580cbae0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f02400099b0 tx=0x7f0240009250 comp rx=0 tx=0).stop 2023-10-06T03:25:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025d0c7700 1 -- 172.21.15.84:0/585991181 shutdown_connections 2023-10-06T03:25:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025d0c7700 1 --2- 172.21.15.84:0/585991181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0258159510 0x7f02580cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025d0c7700 1 --2- 172.21.15.84:0/585991181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 0x7f02580cbae0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025d0c7700 1 -- 172.21.15.84:0/585991181 >> 172.21.15.84:0/585991181 conn(0x7f0258089e90 msgr2=0x7f02580997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025d0c7700 1 -- 172.21.15.84:0/585991181 shutdown_connections 2023-10-06T03:25:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.920+0000 7f025d0c7700 1 -- 172.21.15.84:0/585991181 wait complete. 2023-10-06T03:25:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025d0c7700 1 Processor -- start 2023-10-06T03:25:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025d0c7700 1 -- start start 2023-10-06T03:25:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025d0c7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02580ce820 0x7f0258149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025d0c7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0258159510 0x7f02580c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025d0c7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 0x7f02580c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025d0c7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0258153110 con 0x7f02581598e0 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025d0c7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02580c9850 con 0x7f02580ce820 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025d0c7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02580c9b30 con 0x7f0258159510 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 0x7f02580c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 0x7f02580c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44602/0 (socket says 172.21.15.84:44602) 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.922+0000 7f025759e700 1 -- 172.21.15.84:0/1742241663 learned_addr learned my addr 172.21.15.84:0/1742241663 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f024e59c700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0258159510 0x7f02580c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f0256d9d700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02580ce820 0x7f0258149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f025759e700 1 -- 172.21.15.84:0/1742241663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0258159510 msgr2=0x7f02580c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f025759e700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0258159510 0x7f02580c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f025759e700 1 -- 172.21.15.84:0/1742241663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02580ce820 msgr2=0x7f0258149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:30.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f025759e700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02580ce820 0x7f0258149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:30.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f025759e700 1 -- 172.21.15.84:0/1742241663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02400094f0 con 0x7f02581598e0 2023-10-06T03:25:30.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f025759e700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 0x7f02580c9220 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f025000c8e0 tx=0x7f0250001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:30.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f024f7fe700 1 -- 172.21.15.84:0/1742241663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000ce80 con 0x7f02581598e0 2023-10-06T03:25:30.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f024f7fe700 1 -- 172.21.15.84:0/1742241663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025000a7e0 con 0x7f02581598e0 2023-10-06T03:25:30.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f024f7fe700 1 -- 172.21.15.84:0/1742241663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000ab80 con 0x7f02581598e0 2023-10-06T03:25:30.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f025d0c7700 1 -- 172.21.15.84:0/1742241663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02580c9e10 con 0x7f02581598e0 2023-10-06T03:25:30.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.923+0000 7f025d0c7700 1 -- 172.21.15.84:0/1742241663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0258149a90 con 0x7f02581598e0 2023-10-06T03:25:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.924+0000 7f025d0c7700 1 -- 172.21.15.84:0/1742241663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0258064ad0 con 0x7f02581598e0 2023-10-06T03:25:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.924+0000 7f024f7fe700 1 -- 172.21.15.84:0/1742241663 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0250012420 con 0x7f02581598e0 2023-10-06T03:25:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.925+0000 7f024f7fe700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0238066f30 0x7f02380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.925+0000 7f024f7fe700 1 -- 172.21.15.84:0/1742241663 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0250084ac0 con 0x7f02581598e0 2023-10-06T03:25:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.925+0000 7f0256d9d700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0238066f30 0x7f02380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.925+0000 7f0256d9d700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0238066f30 0x7f02380693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0248006fd0 tx=0x7f0248008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:30.929+0000 7f024f7fe700 1 -- 172.21.15.84:0/1742241663 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0250051a90 con 0x7f02581598e0 2023-10-06T03:25:31.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.111+0000 7f025d0c7700 1 -- 172.21.15.84:0/1742241663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02580cfeb0 con 0x7f02581598e0 2023-10-06T03:25:31.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.112+0000 7f024f7fe700 1 -- 172.21.15.84:0/1742241663 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0250084e60 con 0x7f02581598e0 2023-10-06T03:25:31.113 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 -- 172.21.15.84:0/1742241663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0238066f30 msgr2=0x7f02380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0238066f30 0x7f02380693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0248006fd0 tx=0x7f0248008040 comp rx=0 tx=0).stop 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 -- 172.21.15.84:0/1742241663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 msgr2=0x7f02580c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 0x7f02580c9220 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f025000c8e0 tx=0x7f0250001710 comp rx=0 tx=0).stop 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 -- 172.21.15.84:0/1742241663 shutdown_connections 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0238066f30 0x7f02380693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02580ce820 0x7f0258149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02581598e0 0x7f02580c9220 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 --2- 172.21.15.84:0/1742241663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0258159510 0x7f02580c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 -- 172.21.15.84:0/1742241663 >> 172.21.15.84:0/1742241663 conn(0x7f0258089e90 msgr2=0x7f025815cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 -- 172.21.15.84:0/1742241663 shutdown_connections 2023-10-06T03:25:31.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.114+0000 7f025d0c7700 1 -- 172.21.15.84:0/1742241663 wait complete. 2023-10-06T03:25:31.126 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:25:31.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.243+0000 7f1a9c994700 1 Processor -- start 2023-10-06T03:25:31.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.243+0000 7f1a9c994700 1 -- start start 2023-10-06T03:25:31.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a9c994700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a981598e0 0x7f1a980ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a9c994700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a980cbcb0 0x7f1a980ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a9c994700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a980cf610 con 0x7f1a98159510 2023-10-06T03:25:31.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a9c994700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a980cf8f0 con 0x7f1a981598e0 2023-10-06T03:25:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a9c994700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980cfbd0 con 0x7f1a980cbcb0 2023-10-06T03:25:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a8dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a981598e0 0x7f1a980ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a8dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a981598e0 0x7f1a980ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44614/0 (socket says 172.21.15.84:44614) 2023-10-06T03:25:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a8dd9b700 1 -- 172.21.15.84:0/3403331590 learned_addr learned my addr 172.21.15.84:0/3403331590 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a8dd9b700 1 -- 172.21.15.84:0/3403331590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a980cbcb0 msgr2=0x7f1a980ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a96d9d700 1 --2- 172.21.15.84:0/3403331590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a980cbcb0 0x7f1a980ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a8dd9b700 1 --2- 172.21.15.84:0/3403331590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a980cbcb0 0x7f1a980ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a8dd9b700 1 -- 172.21.15.84:0/3403331590 >> v1:172.21.15.131:6789/0 conn(0x7f1a98159510 legacy=0x7f1a980cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a8dd9b700 1 -- 172.21.15.84:0/3403331590 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980cfeb0 con 0x7f1a981598e0 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.244+0000 7f1a96d9d700 1 --2- 172.21.15.84:0/3403331590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a980cbcb0 0x7f1a980ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a8dd9b700 1 --2- 172.21.15.84:0/3403331590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a981598e0 0x7f1a980ce820 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1a800099b0 tx=0x7f1a80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3ec70bc8047503 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a95d9b700 1 -- 172.21.15.84:0/3403331590 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8000b820 con 0x7f1a981598e0 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a95d9b700 1 -- 172.21.15.84:0/3403331590 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8000b980 con 0x7f1a981598e0 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a95d9b700 1 -- 172.21.15.84:0/3403331590 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8000bd20 con 0x7f1a981598e0 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a9c994700 1 -- 172.21.15.84:0/3403331590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a981598e0 msgr2=0x7f1a980ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a9c994700 1 --2- 172.21.15.84:0/3403331590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a981598e0 0x7f1a980ce820 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1a800099b0 tx=0x7f1a80009250 comp rx=0 tx=0).stop 2023-10-06T03:25:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a9c994700 1 -- 172.21.15.84:0/3403331590 shutdown_connections 2023-10-06T03:25:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a9c994700 1 --2- 172.21.15.84:0/3403331590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a980cbcb0 0x7f1a980ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a9c994700 1 --2- 172.21.15.84:0/3403331590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a981598e0 0x7f1a980ce820 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a9c994700 1 -- 172.21.15.84:0/3403331590 >> 172.21.15.84:0/3403331590 conn(0x7f1a98089e90 msgr2=0x7f1a980997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a9c994700 1 -- 172.21.15.84:0/3403331590 shutdown_connections 2023-10-06T03:25:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.245+0000 7f1a9c994700 1 -- 172.21.15.84:0/3403331590 wait complete. 2023-10-06T03:25:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.246+0000 7f1a9c994700 1 Processor -- start 2023-10-06T03:25:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.246+0000 7f1a9c994700 1 -- start start 2023-10-06T03:25:31.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a9c994700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a980cbcb0 0x7f1a9814a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a9c994700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a98159510 0x7f1a980c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a9c994700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a981598e0 0x7f1a9815b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a9c994700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a98159d00 con 0x7f1a980cbcb0 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a9c994700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a98159fe0 con 0x7f1a981598e0 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a9c994700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9814a5b0 con 0x7f1a98159510 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a9659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a980cbcb0 0x7f1a9814a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a9659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a980cbcb0 0x7f1a9814a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44616/0 (socket says 172.21.15.84:44616) 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a9659c700 1 -- 172.21.15.84:0/567805183 learned_addr learned my addr 172.21.15.84:0/567805183 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a96d9d700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a981598e0 0x7f1a9815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.247+0000 7f1a8dd9b700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a98159510 0x7f1a980c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a9659c700 1 -- 172.21.15.84:0/567805183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a98159510 msgr2=0x7f1a980c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a9659c700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a98159510 0x7f1a980c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a9659c700 1 -- 172.21.15.84:0/567805183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a981598e0 msgr2=0x7f1a9815b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a9659c700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a981598e0 0x7f1a9815b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a9659c700 1 -- 172.21.15.84:0/567805183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a800094f0 con 0x7f1a980cbcb0 2023-10-06T03:25:31.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a9659c700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a980cbcb0 0x7f1a9814a070 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c5d0 tx=0x7f1a88007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:31.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a8effd700 1 -- 172.21.15.84:0/567805183 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88011590 con 0x7f1a980cbcb0 2023-10-06T03:25:31.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a8effd700 1 -- 172.21.15.84:0/567805183 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a88011710 con 0x7f1a980cbcb0 2023-10-06T03:25:31.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a9c994700 1 -- 172.21.15.84:0/567805183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9815c2c0 con 0x7f1a980cbcb0 2023-10-06T03:25:31.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a8effd700 1 -- 172.21.15.84:0/567805183 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88011ad0 con 0x7f1a980cbcb0 2023-10-06T03:25:31.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.248+0000 7f1a9c994700 1 -- 172.21.15.84:0/567805183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9815c880 con 0x7f1a980cbcb0 2023-10-06T03:25:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.249+0000 7f1a9c994700 1 -- 172.21.15.84:0/567805183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a98064ad0 con 0x7f1a980cbcb0 2023-10-06T03:25:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.249+0000 7f1a8effd700 1 -- 172.21.15.84:0/567805183 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a8801c460 con 0x7f1a980cbcb0 2023-10-06T03:25:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.250+0000 7f1a8effd700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a78066f30 0x7f1a780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.250+0000 7f1a8dd9b700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a78066f30 0x7f1a780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.250+0000 7f1a8effd700 1 -- 172.21.15.84:0/567805183 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1a88084430 con 0x7f1a980cbcb0 2023-10-06T03:25:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.250+0000 7f1a8dd9b700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a78066f30 0x7f1a780693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1a9808a870 tx=0x7f1a80016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.254+0000 7f1a8effd700 1 -- 172.21.15.84:0/567805183 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a88051400 con 0x7f1a980cbcb0 2023-10-06T03:25:31.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.439+0000 7f1a9c994700 1 -- 172.21.15.84:0/567805183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a980cf2a0 con 0x7f1a980cbcb0 2023-10-06T03:25:31.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.439+0000 7f1a8effd700 1 -- 172.21.15.84:0/567805183 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a88054a20 con 0x7f1a980cbcb0 2023-10-06T03:25:31.440 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:25:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 -- 172.21.15.84:0/567805183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a78066f30 msgr2=0x7f1a780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a78066f30 0x7f1a780693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1a9808a870 tx=0x7f1a80016000 comp rx=0 tx=0).stop 2023-10-06T03:25:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 -- 172.21.15.84:0/567805183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a980cbcb0 msgr2=0x7f1a9814a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a980cbcb0 0x7f1a9814a070 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c5d0 tx=0x7f1a88007f60 comp rx=0 tx=0).stop 2023-10-06T03:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 -- 172.21.15.84:0/567805183 shutdown_connections 2023-10-06T03:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a78066f30 0x7f1a780693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a981598e0 0x7f1a9815b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a980cbcb0 0x7f1a9814a070 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 --2- 172.21.15.84:0/567805183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a98159510 0x7f1a980c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 -- 172.21.15.84:0/567805183 >> 172.21.15.84:0/567805183 conn(0x7f1a98089e90 msgr2=0x7f1a980c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 -- 172.21.15.84:0/567805183 shutdown_connections 2023-10-06T03:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.441+0000 7f1a9c994700 1 -- 172.21.15.84:0/567805183 wait complete. 2023-10-06T03:25:31.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:25:31.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.570+0000 7f6262671700 1 Processor -- start 2023-10-06T03:25:31.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.570+0000 7f6262671700 1 -- start start 2023-10-06T03:25:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f6262671700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f625c159510 0x7f625c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f6262671700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f625c1598e0 0x7f625c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f6262671700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c0cf370 con 0x7f625c0ce820 2023-10-06T03:25:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f6262671700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c0cf610 con 0x7f625c159510 2023-10-06T03:25:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f6262671700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c0cf8f0 con 0x7f625c1598e0 2023-10-06T03:25:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f625c159510 0x7f625c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f625c159510 0x7f625c0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44628/0 (socket says 172.21.15.84:44628) 2023-10-06T03:25:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625bfff700 1 -- 172.21.15.84:0/954554473 learned_addr learned my addr 172.21.15.84:0/954554473 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625b7fe700 1 --2- 172.21.15.84:0/954554473 >> v2:172.21.15.131:3300/0 conn(0x7f625c1598e0 0x7f625c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625bfff700 1 -- 172.21.15.84:0/954554473 >> v2:172.21.15.131:3300/0 conn(0x7f625c1598e0 msgr2=0x7f625c0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625bfff700 1 --2- 172.21.15.84:0/954554473 >> v2:172.21.15.131:3300/0 conn(0x7f625c1598e0 0x7f625c0cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625bfff700 1 -- 172.21.15.84:0/954554473 >> v1:172.21.15.131:6789/0 conn(0x7f625c0ce820 legacy=0x7f625c0cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625bfff700 1 -- 172.21.15.84:0/954554473 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c0cfbd0 con 0x7f625c159510 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625bfff700 1 --2- 172.21.15.84:0/954554473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 0x7f625c0cb5a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f625c0c73b0 tx=0x7f624c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5522fddf8443df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625affd700 1 -- 172.21.15.84:0/954554473 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c009e70 con 0x7f625c159510 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625affd700 1 -- 172.21.15.84:0/954554473 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c00b860 con 0x7f625c159510 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.571+0000 7f625affd700 1 -- 172.21.15.84:0/954554473 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c00bc00 con 0x7f625c159510 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.572+0000 7f6262671700 1 -- 172.21.15.84:0/954554473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 msgr2=0x7f625c0cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.572+0000 7f6262671700 1 --2- 172.21.15.84:0/954554473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 0x7f625c0cb5a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f625c0c73b0 tx=0x7f624c009250 comp rx=0 tx=0).stop 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.572+0000 7f6262671700 1 -- 172.21.15.84:0/954554473 shutdown_connections 2023-10-06T03:25:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.572+0000 7f6262671700 1 --2- 172.21.15.84:0/954554473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 0x7f625c0cb5a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.572+0000 7f6262671700 1 --2- 172.21.15.84:0/954554473 >> v2:172.21.15.131:3300/0 conn(0x7f625c1598e0 0x7f625c0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.572+0000 7f6262671700 1 -- 172.21.15.84:0/954554473 >> 172.21.15.84:0/954554473 conn(0x7f625c089e90 msgr2=0x7f625c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.572+0000 7f6262671700 1 -- 172.21.15.84:0/954554473 shutdown_connections 2023-10-06T03:25:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.572+0000 7f6262671700 1 -- 172.21.15.84:0/954554473 wait complete. 2023-10-06T03:25:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.573+0000 7f6262671700 1 Processor -- start 2023-10-06T03:25:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.573+0000 7f6262671700 1 -- start start 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f6262671700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f625c0ce820 0x7f625c14f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f6262671700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 0x7f625c09cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f6262671700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f625c1598e0 0x7f625c09d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f6262671700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c09e1c0 con 0x7f625c159510 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f6262671700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c09d640 con 0x7f625c1598e0 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f6262671700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c09d920 con 0x7f625c0ce820 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f625b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 0x7f625c09cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f625b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 0x7f625c09cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44640/0 (socket says 172.21.15.84:44640) 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f625b7fe700 1 -- 172.21.15.84:0/3318722594 learned_addr learned my addr 172.21.15.84:0/3318722594 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f6260c0e700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f625c1598e0 0x7f625c09d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f625bfff700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f625c0ce820 0x7f625c14f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f625b7fe700 1 -- 172.21.15.84:0/3318722594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f625c0ce820 msgr2=0x7f625c14f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f625b7fe700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f625c0ce820 0x7f625c14f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f625b7fe700 1 -- 172.21.15.84:0/3318722594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f625c1598e0 msgr2=0x7f625c09d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f625b7fe700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f625c1598e0 0x7f625c09d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f625b7fe700 1 -- 172.21.15.84:0/3318722594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0094f0 con 0x7f625c159510 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f6260c0e700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f625c1598e0 0x7f625c09d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.574+0000 7f625b7fe700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 0x7f625c09cae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6250009fd0 tx=0x7f62500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.575+0000 7f6243fff700 1 -- 172.21.15.84:0/3318722594 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625000c6a0 con 0x7f625c159510 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.575+0000 7f6243fff700 1 -- 172.21.15.84:0/3318722594 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625000c800 con 0x7f625c159510 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.575+0000 7f6262671700 1 -- 172.21.15.84:0/3318722594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c09dc00 con 0x7f625c159510 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.575+0000 7f6243fff700 1 -- 172.21.15.84:0/3318722594 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625000cba0 con 0x7f625c159510 2023-10-06T03:25:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.575+0000 7f6262671700 1 -- 172.21.15.84:0/3318722594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c14f6c0 con 0x7f625c159510 2023-10-06T03:25:31.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.575+0000 7f6262671700 1 -- 172.21.15.84:0/3318722594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c064ad0 con 0x7f625c159510 2023-10-06T03:25:31.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.576+0000 7f6243fff700 1 -- 172.21.15.84:0/3318722594 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6250013470 con 0x7f625c159510 2023-10-06T03:25:31.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.576+0000 7f6243fff700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6248066f30 0x7f62480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.576+0000 7f6243fff700 1 -- 172.21.15.84:0/3318722594 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f62500848f0 con 0x7f625c159510 2023-10-06T03:25:31.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.576+0000 7f625bfff700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6248066f30 0x7f62480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.577+0000 7f625bfff700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6248066f30 0x7f62480693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f625c0c73b0 tx=0x7f624c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.580+0000 7f6243fff700 1 -- 172.21.15.84:0/3318722594 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62500518c0 con 0x7f625c159510 2023-10-06T03:25:31.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.764+0000 7f6262671700 1 -- 172.21.15.84:0/3318722594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f625c0cfeb0 con 0x7f625c159510 2023-10-06T03:25:31.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.764+0000 7f6243fff700 1 -- 172.21.15.84:0/3318722594 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6250054ee0 con 0x7f625c159510 2023-10-06T03:25:31.765 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:25:31.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 -- 172.21.15.84:0/3318722594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6248066f30 msgr2=0x7f62480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6248066f30 0x7f62480693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f625c0c73b0 tx=0x7f624c017000 comp rx=0 tx=0).stop 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 -- 172.21.15.84:0/3318722594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 msgr2=0x7f625c09cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 0x7f625c09cae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6250009fd0 tx=0x7f62500091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 -- 172.21.15.84:0/3318722594 shutdown_connections 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6248066f30 0x7f62480693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f625c1598e0 0x7f625c09d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f625c0ce820 0x7f625c14f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 --2- 172.21.15.84:0/3318722594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f625c159510 0x7f625c09cae0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 -- 172.21.15.84:0/3318722594 >> 172.21.15.84:0/3318722594 conn(0x7f625c089e90 msgr2=0x7f625c0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 -- 172.21.15.84:0/3318722594 shutdown_connections 2023-10-06T03:25:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.766+0000 7f6262671700 1 -- 172.21.15.84:0/3318722594 wait complete. 2023-10-06T03:25:31.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.892+0000 7f9742aea700 1 Processor -- start 2023-10-06T03:25:31.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.892+0000 7f9742aea700 1 -- start start 2023-10-06T03:25:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.892+0000 7f9742aea700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f973c1595a0 0x7f973c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f9742aea700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0b0ca0 con 0x7f973c0b49e0 2023-10-06T03:25:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f9742aea700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0b0f80 con 0x7f973c0b07a0 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f9742aea700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c0b1260 con 0x7f973c1595a0 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f973c0b49e0 0x7f973c0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52538/0 (socket says 172.21.15.84:52538) 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973bfff700 1 -- 172.21.15.84:0/2410641956 learned_addr learned my addr 172.21.15.84:0/2410641956 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f9740886700 1 --2- 172.21.15.84:0/2410641956 >> v2:172.21.15.131:3300/0 conn(0x7f973c1595a0 0x7f973c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584776081 0 0) 0x7f973c0b0ca0 con 0x7f973c0b49e0 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f972c003570 con 0x7f973c0b49e0 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939342593 0 0) 0x7f972c003570 con 0x7f973c0b49e0 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 >> v2:172.21.15.131:3300/0 conn(0x7f973c1595a0 msgr2=0x7f973c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 --2- 172.21.15.84:0/2410641956 >> v2:172.21.15.131:3300/0 conn(0x7f973c1595a0 0x7f973c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 >> v1:172.21.15.131:6789/0 conn(0x7f973c0b07a0 legacy=0x7f973c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0b1540 con 0x7f973c0b49e0 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f9728001470 con 0x7f973c0b49e0 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 >> v1:172.21.15.84:6789/0 conn(0x7f973c0b49e0 legacy=0x7f973c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c003a60 0x7f972c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f972c004810 0x7f972c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972c0051c0 0x7f972c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0b1260 con 0x7f972c0051c0 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c00c0d0 con 0x7f972c004810 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c00c290 con 0x7f972c003a60 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.893+0000 7f9741087700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972c0051c0 0x7f972c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9740886700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c003a60 0x7f972c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f973bfff700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f972c004810 0x7f972c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9741087700 1 -- 172.21.15.84:0/2410641956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c003a60 msgr2=0x7f972c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9741087700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c003a60 0x7f972c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9741087700 1 -- 172.21.15.84:0/2410641956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f972c004810 msgr2=0x7f972c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9741087700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f972c004810 0x7f972c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9741087700 1 -- 172.21.15.84:0/2410641956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c003570 con 0x7f972c0051c0 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9740886700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c003a60 0x7f972c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f973bfff700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f972c004810 0x7f972c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9741087700 1 -- 172.21.15.84:0/2410641956 reap_dead start 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9741087700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972c0051c0 0x7f972c00ba60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9734001fc0 tx=0x7f9734001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee83e5c970ba4f8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734001950 con 0x7f972c0051c0 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973400c8b0 con 0x7f972c0051c0 2023-10-06T03:25:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f973b7fe700 1 -- 172.21.15.84:0/2410641956 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973400cc90 con 0x7f972c0051c0 2023-10-06T03:25:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9742aea700 1 -- 172.21.15.84:0/2410641956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972c0051c0 msgr2=0x7f972c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9742aea700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972c0051c0 0x7f972c00ba60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9734001fc0 tx=0x7f9734001640 comp rx=0 tx=0).stop 2023-10-06T03:25:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.894+0000 7f9742aea700 1 -- 172.21.15.84:0/2410641956 shutdown_connections 2023-10-06T03:25:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.895+0000 7f9742aea700 1 --2- 172.21.15.84:0/2410641956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972c0051c0 0x7f972c00ba60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.895+0000 7f9742aea700 1 -- 172.21.15.84:0/2410641956 >> 172.21.15.84:0/2410641956 conn(0x7f973c099830 msgr2=0x7f973c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.895+0000 7f9742aea700 1 -- 172.21.15.84:0/2410641956 shutdown_connections 2023-10-06T03:25:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.895+0000 7f9742aea700 1 -- 172.21.15.84:0/2410641956 wait complete. 2023-10-06T03:25:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.896+0000 7f9742aea700 1 Processor -- start 2023-10-06T03:25:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.896+0000 7f9742aea700 1 -- start start 2023-10-06T03:25:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.896+0000 7f9742aea700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c0051c0 0x7f973c16a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.896+0000 7f9742aea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f973c15c240 0x7f973c14a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.896+0000 7f9742aea700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c09af80 0x7f973c09c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.896+0000 7f9742aea700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c15ca50 con 0x7f973c15c240 2023-10-06T03:25:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.896+0000 7f9742aea700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c09a1c0 con 0x7f973c09af80 2023-10-06T03:25:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.896+0000 7f9742aea700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c09a4a0 con 0x7f972c0051c0 2023-10-06T03:25:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f973bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f973c15c240 0x7f973c14a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f973bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f973c15c240 0x7f973c14a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44658/0 (socket says 172.21.15.84:44658) 2023-10-06T03:25:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f973bfff700 1 -- 172.21.15.84:0/1274379396 learned_addr learned my addr 172.21.15.84:0/1274379396 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f973bfff700 1 -- 172.21.15.84:0/1274379396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c0051c0 msgr2=0x7f973c16a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f9741087700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c09af80 0x7f973c09c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f9740886700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c0051c0 0x7f973c16a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f973bfff700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c0051c0 0x7f973c16a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f973bfff700 1 -- 172.21.15.84:0/1274379396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c09af80 msgr2=0x7f973c09c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f973bfff700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c09af80 0x7f973c09c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f973bfff700 1 -- 172.21.15.84:0/1274379396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c09a780 con 0x7f973c15c240 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f9740886700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c0051c0 0x7f973c16a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f973bfff700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f973c15c240 0x7f973c14a770 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f972800e780 tx=0x7f9728000cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f9738ff9700 1 -- 172.21.15.84:0/1274379396 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728012500 con 0x7f973c15c240 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f9738ff9700 1 -- 172.21.15.84:0/1274379396 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728010040 con 0x7f973c15c240 2023-10-06T03:25:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f9742aea700 1 -- 172.21.15.84:0/1274379396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c09aa60 con 0x7f973c15c240 2023-10-06T03:25:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f9738ff9700 1 -- 172.21.15.84:0/1274379396 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728012870 con 0x7f973c15c240 2023-10-06T03:25:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.897+0000 7f9742aea700 1 -- 172.21.15.84:0/1274379396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c14acb0 con 0x7f973c15c240 2023-10-06T03:25:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.898+0000 7f9742aea700 1 -- 172.21.15.84:0/1274379396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c09aca0 con 0x7f973c15c240 2023-10-06T03:25:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.899+0000 7f9738ff9700 1 -- 172.21.15.84:0/1274379396 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9728012c60 con 0x7f973c15c240 2023-10-06T03:25:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.899+0000 7f9738ff9700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9720066f30 0x7f97200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.899+0000 7f9738ff9700 1 -- 172.21.15.84:0/1274379396 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9728083b30 con 0x7f973c15c240 2023-10-06T03:25:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.899+0000 7f9740886700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9720066f30 0x7f97200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.899+0000 7f9740886700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9720066f30 0x7f97200693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9730006ea0 tx=0x7f9730008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:31.903+0000 7f9738ff9700 1 -- 172.21.15.84:0/1274379396 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f972804d5a0 con 0x7f973c15c240 2023-10-06T03:25:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.128+0000 7f9742aea700 1 -- 172.21.15.84:0/1274379396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f973c064ad0 con 0x7f973c15c240 2023-10-06T03:25:32.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.128+0000 7f9738ff9700 1 -- 172.21.15.84:0/1274379396 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f9728019070 con 0x7f973c15c240 2023-10-06T03:25:32.129 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:32.129 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3103408955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3103408955},{"type":"v1","addr":"172.21.15.131:6834","nonce":3103408955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3982920665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3982920665},{"type":"v1","addr":"172.21.15.131:6835","nonce":3982920665}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1537563341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1537563341},{"type":"v1","addr":"172.21.15.84:6836","nonce":1537563341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:21.111306+0000","modified":"2023-10-06T03:25:24.747627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5526":{"gid":5526,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3473748806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3473748806},{"type":"v1","addr":"172.21.15.84:6837","nonce":3473748806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:25:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.130+0000 7f9742aea700 1 -- 172.21.15.84:0/1274379396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9720066f30 msgr2=0x7f97200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.130+0000 7f9742aea700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9720066f30 0x7f97200693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9730006ea0 tx=0x7f9730008040 comp rx=0 tx=0).stop 2023-10-06T03:25:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.130+0000 7f9742aea700 1 -- 172.21.15.84:0/1274379396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f973c15c240 msgr2=0x7f973c14a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.130+0000 7f9742aea700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f973c15c240 0x7f973c14a770 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f972800e780 tx=0x7f9728000cc0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.130+0000 7f9742aea700 1 -- 172.21.15.84:0/1274379396 shutdown_connections 2023-10-06T03:25:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.130+0000 7f9742aea700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9720066f30 0x7f97200693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.130+0000 7f9742aea700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c09af80 0x7f973c09c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.130+0000 7f9742aea700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f972c0051c0 0x7f973c16a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.130+0000 7f9742aea700 1 --2- 172.21.15.84:0/1274379396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f973c15c240 0x7f973c14a770 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.130+0000 7f9742aea700 1 -- 172.21.15.84:0/1274379396 >> 172.21.15.84:0/1274379396 conn(0x7f973c099830 msgr2=0x7f973c0cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.131+0000 7f9742aea700 1 -- 172.21.15.84:0/1274379396 shutdown_connections 2023-10-06T03:25:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.131+0000 7f9742aea700 1 -- 172.21.15.84:0/1274379396 wait complete. 2023-10-06T03:25:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2023-10-06T03:25:32.143 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.256+0000 7f232a979700 1 Processor -- start 2023-10-06T03:25:32.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.256+0000 7f232a979700 1 -- start start 2023-10-06T03:25:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f232a979700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f23240b07a0 0x7f23240ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f232a979700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240b0ca0 con 0x7f23240b49e0 2023-10-06T03:25:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f232a979700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240b0f80 con 0x7f23241595a0 2023-10-06T03:25:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f232a979700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23240ab390 con 0x7f23240b07a0 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f2328f16700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f23240b07a0 0x7f23240ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f23237fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f23240b49e0 0x7f23240aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52550/0 (socket says 172.21.15.84:52550) 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f23237fe700 1 -- 172.21.15.84:0/3794240661 learned_addr learned my addr 172.21.15.84:0/3794240661 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f2328f16700 1 -- 172.21.15.84:0/3794240661 >> v1:172.21.15.131:6789/0 conn(0x7f23241595a0 legacy=0x7f23240aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f2328f16700 1 -- 172.21.15.84:0/3794240661 >> v1:172.21.15.84:6789/0 conn(0x7f23240b49e0 legacy=0x7f23240aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f2328f16700 1 -- 172.21.15.84:0/3794240661 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240b1260 con 0x7f23240b07a0 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.257+0000 7f2322ffd700 1 -- 172.21.15.84:0/3794240661 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934796428 0 0) 0x7f23240b0ca0 con 0x7f23240b49e0 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f2328f16700 1 --2- 172.21.15.84:0/3794240661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 0x7f23240ccfd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f231c009e90 tx=0x7f231c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2fb7721cab0b86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f2322ffd700 1 -- 172.21.15.84:0/3794240661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00e070 con 0x7f23240b07a0 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f2322ffd700 1 -- 172.21.15.84:0/3794240661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00bbf0 con 0x7f23240b07a0 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f2322ffd700 1 -- 172.21.15.84:0/3794240661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c012430 con 0x7f23240b07a0 2023-10-06T03:25:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f232a979700 1 -- 172.21.15.84:0/3794240661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 msgr2=0x7f23240ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f232a979700 1 --2- 172.21.15.84:0/3794240661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 0x7f23240ccfd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f231c009e90 tx=0x7f231c009780 comp rx=0 tx=0).stop 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f232a979700 1 -- 172.21.15.84:0/3794240661 shutdown_connections 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f232a979700 1 --2- 172.21.15.84:0/3794240661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 0x7f23240ccfd0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f232a979700 1 -- 172.21.15.84:0/3794240661 >> 172.21.15.84:0/3794240661 conn(0x7f2324099830 msgr2=0x7f232406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f232a979700 1 -- 172.21.15.84:0/3794240661 shutdown_connections 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.258+0000 7f232a979700 1 -- 172.21.15.84:0/3794240661 wait complete. 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.259+0000 7f232a979700 1 Processor -- start 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.260+0000 7f232a979700 1 -- start start 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.260+0000 7f232a979700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 0x7f232414aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.260+0000 7f232a979700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23240b49e0 0x7f23240ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.260+0000 7f232a979700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23241595a0 0x7f23240aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.260+0000 7f232a979700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240ad3c0 con 0x7f23240b07a0 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.260+0000 7f232a979700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240ac630 con 0x7f23240b49e0 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.260+0000 7f232a979700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232409c530 con 0x7f23241595a0 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.260+0000 7f2323fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 0x7f232414aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.260+0000 7f2323fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 0x7f232414aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44678/0 (socket says 172.21.15.84:44678) 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.260+0000 7f2323fff700 1 -- 172.21.15.84:0/3402360622 learned_addr learned my addr 172.21.15.84:0/3402360622 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f2323fff700 1 -- 172.21.15.84:0/3402360622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23241595a0 msgr2=0x7f23240aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f2323fff700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23241595a0 0x7f23240aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f2323fff700 1 -- 172.21.15.84:0/3402360622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23240b49e0 msgr2=0x7f23240ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f23237fe700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23240b49e0 0x7f23240ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f2323fff700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23240b49e0 0x7f23240ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f2323fff700 1 -- 172.21.15.84:0/3402360622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c009a20 con 0x7f23240b07a0 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f2323fff700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 0x7f232414aab0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f231400c540 tx=0x7f2314001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f230bfff700 1 -- 172.21.15.84:0/3402360622 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314011590 con 0x7f23240b07a0 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f230bfff700 1 -- 172.21.15.84:0/3402360622 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23140116f0 con 0x7f23240b07a0 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f232a979700 1 -- 172.21.15.84:0/3402360622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2324158080 con 0x7f23240b07a0 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f230bfff700 1 -- 172.21.15.84:0/3402360622 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314011ab0 con 0x7f23240b07a0 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.261+0000 7f232a979700 1 -- 172.21.15.84:0/3402360622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23240ac350 con 0x7f23240b07a0 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.262+0000 7f232a979700 1 -- 172.21.15.84:0/3402360622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2324064ad0 con 0x7f23240b07a0 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.262+0000 7f230bfff700 1 -- 172.21.15.84:0/3402360622 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f231401b3b0 con 0x7f23240b07a0 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.263+0000 7f230bfff700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2310066f30 0x7f23100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.263+0000 7f230bfff700 1 -- 172.21.15.84:0/3402360622 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2314083be0 con 0x7f23240b07a0 2023-10-06T03:25:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.263+0000 7f23237fe700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2310066f30 0x7f23100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:32.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.263+0000 7f23237fe700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2310066f30 0x7f23100693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f232416e0a0 tx=0x7f2318009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:32.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.267+0000 7f230bfff700 1 -- 172.21.15.84:0/3402360622 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2314050c60 con 0x7f23240b07a0 2023-10-06T03:25:32.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.449+0000 7f232a979700 1 -- 172.21.15.84:0/3402360622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23240b1540 con 0x7f23240b07a0 2023-10-06T03:25:32.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.450+0000 7f230bfff700 1 -- 172.21.15.84:0/3402360622 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f2314017070 con 0x7f23240b07a0 2023-10-06T03:25:32.515 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:32.515 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":50,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:22.337746+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:18.741959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:20.079553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:32.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 -- 172.21.15.84:0/3402360622 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2310066f30 msgr2=0x7f23100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2310066f30 0x7f23100693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f232416e0a0 tx=0x7f2318009040 comp rx=0 tx=0).stop 2023-10-06T03:25:32.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 -- 172.21.15.84:0/3402360622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 msgr2=0x7f232414aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 0x7f232414aab0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f231400c540 tx=0x7f2314001070 comp rx=0 tx=0).stop 2023-10-06T03:25:32.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 -- 172.21.15.84:0/3402360622 shutdown_connections 2023-10-06T03:25:32.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2310066f30 0x7f23100693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23241595a0 0x7f23240aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23240b07a0 0x7f232414aab0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 --2- 172.21.15.84:0/3402360622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23240b49e0 0x7f23240ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 -- 172.21.15.84:0/3402360622 >> 172.21.15.84:0/3402360622 conn(0x7f2324099830 msgr2=0x7f2324069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:32.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 -- 172.21.15.84:0/3402360622 shutdown_connections 2023-10-06T03:25:32.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.452+0000 7f232a979700 1 -- 172.21.15.84:0/3402360622 wait complete. 2023-10-06T03:25:32.519 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:25:32.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:32.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.633+0000 7f143ffff700 1 Processor -- start 2023-10-06T03:25:32.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.633+0000 7f143ffff700 1 -- start start 2023-10-06T03:25:32.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1440159480 0x7f14400b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143ffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14400cb7e0 con 0x7f14400b2140 2023-10-06T03:25:32.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143ffff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14400b08a0 con 0x7f14400b3610 2023-10-06T03:25:32.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400cb190 con 0x7f1440159480 2023-10-06T03:25:32.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1440159480 0x7f14400b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:32.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f14400b2140 0x7f14400b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52566/0 (socket says 172.21.15.84:52566) 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143f7fe700 1 -- 172.21.15.84:0/2060391594 learned_addr learned my addr 172.21.15.84:0/2060391594 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143effd700 1 -- 172.21.15.84:0/2060391594 >> v1:172.21.15.131:6789/0 conn(0x7f14400b3610 legacy=0x7f14400cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143effd700 1 -- 172.21.15.84:0/2060391594 >> v1:172.21.15.84:6789/0 conn(0x7f14400b2140 legacy=0x7f14400b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143effd700 1 -- 172.21.15.84:0/2060391594 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400cb470 con 0x7f1440159480 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.634+0000 7f143e7fc700 1 -- 172.21.15.84:0/2060391594 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123839923 0 0) 0x7f14400cb7e0 con 0x7f14400b2140 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143effd700 1 --2- 172.21.15.84:0/2060391594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 0x7f14400b30d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f14300098e0 tx=0x7f14300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1cfa3d146dca4b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143e7fc700 1 -- 172.21.15.84:0/2060391594 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430009e80 con 0x7f1440159480 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143e7fc700 1 -- 172.21.15.84:0/2060391594 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000b860 con 0x7f1440159480 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143e7fc700 1 -- 172.21.15.84:0/2060391594 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000bbe0 con 0x7f1440159480 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143ffff700 1 -- 172.21.15.84:0/2060391594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 msgr2=0x7f14400b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143ffff700 1 --2- 172.21.15.84:0/2060391594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 0x7f14400b30d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f14300098e0 tx=0x7f14300091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143ffff700 1 -- 172.21.15.84:0/2060391594 shutdown_connections 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143ffff700 1 --2- 172.21.15.84:0/2060391594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 0x7f14400b30d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143ffff700 1 -- 172.21.15.84:0/2060391594 >> 172.21.15.84:0/2060391594 conn(0x7f144006ed20 msgr2=0x7f144006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143ffff700 1 -- 172.21.15.84:0/2060391594 shutdown_connections 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.635+0000 7f143ffff700 1 -- 172.21.15.84:0/2060391594 wait complete. 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143ffff700 1 Processor -- start 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143ffff700 1 -- start start 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b2140 0x7f14400c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14400b3610 0x7f1440153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 0x7f1440157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143ffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440159c40 con 0x7f1440159480 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143ffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440159f20 con 0x7f14400b3610 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144015a200 con 0x7f14400b2140 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 0x7f1440157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 0x7f1440157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44682/0 (socket says 172.21.15.84:44682) 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.637+0000 7f143f7fe700 1 -- 172.21.15.84:0/3647879279 learned_addr learned my addr 172.21.15.84:0/3647879279 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f143effd700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b2140 0x7f14400c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f14367fc700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14400b3610 0x7f1440153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f143f7fe700 1 -- 172.21.15.84:0/3647879279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b2140 msgr2=0x7f14400c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f143f7fe700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b2140 0x7f14400c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f143f7fe700 1 -- 172.21.15.84:0/3647879279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14400b3610 msgr2=0x7f1440153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f143f7fe700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14400b3610 0x7f1440153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f143f7fe700 1 -- 172.21.15.84:0/3647879279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009420 con 0x7f1440159480 2023-10-06T03:25:32.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f143f7fe700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 0x7f1440157750 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f143800cc90 tx=0x7f1438001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:32.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f14377fe700 1 -- 172.21.15.84:0/3647879279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800cea0 con 0x7f1440159480 2023-10-06T03:25:32.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f14377fe700 1 -- 172.21.15.84:0/3647879279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143800ab70 con 0x7f1440159480 2023-10-06T03:25:32.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f143ffff700 1 -- 172.21.15.84:0/3647879279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144015a4e0 con 0x7f1440159480 2023-10-06T03:25:32.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f14377fe700 1 -- 172.21.15.84:0/3647879279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380070f0 con 0x7f1440159480 2023-10-06T03:25:32.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.638+0000 7f143ffff700 1 -- 172.21.15.84:0/3647879279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14401536a0 con 0x7f1440159480 2023-10-06T03:25:32.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.639+0000 7f143ffff700 1 -- 172.21.15.84:0/3647879279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1440153920 con 0x7f1440159480 2023-10-06T03:25:32.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.639+0000 7f14377fe700 1 -- 172.21.15.84:0/3647879279 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14380074a0 con 0x7f1440159480 2023-10-06T03:25:32.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.640+0000 7f14377fe700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1420066f30 0x7f14200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.640+0000 7f14377fe700 1 -- 172.21.15.84:0/3647879279 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1438084c40 con 0x7f1440159480 2023-10-06T03:25:32.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.640+0000 7f143effd700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1420066f30 0x7f14200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:32.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.640+0000 7f143effd700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1420066f30 0x7f14200693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f14300098e0 tx=0x7f1430017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:32.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.644+0000 7f14377fe700 1 -- 172.21.15.84:0/3647879279 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1440153920 con 0x7f1440159480 2023-10-06T03:25:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.867+0000 7f143ffff700 1 -- 172.21.15.84:0/3647879279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1440153920 con 0x7f1440159480 2023-10-06T03:25:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.867+0000 7f14377fe700 1 -- 172.21.15.84:0/3647879279 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f1440153920 con 0x7f1440159480 2023-10-06T03:25:32.868 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:32.868 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3103408955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3103408955},{"type":"v1","addr":"172.21.15.131:6834","nonce":3103408955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3982920665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3982920665},{"type":"v1","addr":"172.21.15.131:6835","nonce":3982920665}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1537563341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1537563341},{"type":"v1","addr":"172.21.15.84:6836","nonce":1537563341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:21.111306+0000","modified":"2023-10-06T03:25:24.747627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5526":{"gid":5526,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3473748806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3473748806},{"type":"v1","addr":"172.21.15.84:6837","nonce":3473748806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:25:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 -- 172.21.15.84:0/3647879279 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1420066f30 msgr2=0x7f14200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1420066f30 0x7f14200693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f14300098e0 tx=0x7f1430017000 comp rx=0 tx=0).stop 2023-10-06T03:25:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 -- 172.21.15.84:0/3647879279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 msgr2=0x7f1440157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 0x7f1440157750 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f143800cc90 tx=0x7f1438001a80 comp rx=0 tx=0).stop 2023-10-06T03:25:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 -- 172.21.15.84:0/3647879279 shutdown_connections 2023-10-06T03:25:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1420066f30 0x7f14200693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1440159480 0x7f1440157750 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b2140 0x7f14400c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 --2- 172.21.15.84:0/3647879279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14400b3610 0x7f1440153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 -- 172.21.15.84:0/3647879279 >> 172.21.15.84:0/3647879279 conn(0x7f144006ed20 msgr2=0x7f14401549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 -- 172.21.15.84:0/3647879279 shutdown_connections 2023-10-06T03:25:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.869+0000 7f143ffff700 1 -- 172.21.15.84:0/3647879279 wait complete. 2023-10-06T03:25:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2023-10-06T03:25:32.882 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.995+0000 7f8651baa700 1 Processor -- start 2023-10-06T03:25:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.995+0000 7f8651baa700 1 -- start start 2023-10-06T03:25:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.996+0000 7f8651baa700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f864c1595a0 0x7f864c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.996+0000 7f8651baa700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f864c0b49e0 0x7f864c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.996+0000 7f8651baa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b07a0 0x7f864c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.996+0000 7f8651baa700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c0b0ca0 con 0x7f864c1595a0 2023-10-06T03:25:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.996+0000 7f8651baa700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c0b0f80 con 0x7f864c0b49e0 2023-10-06T03:25:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.996+0000 7f8651baa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0b1260 con 0x7f864c0b07a0 2023-10-06T03:25:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.996+0000 7f864b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f864c1595a0 0x7f864c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.996+0000 7f864b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f864c1595a0 0x7f864c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44686/0 (socket says 172.21.15.84:44686) 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.996+0000 7f864b7fe700 1 -- 172.21.15.84:0/3823742779 learned_addr learned my addr 172.21.15.84:0/3823742779 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.996+0000 7f864bfff700 1 --2- 172.21.15.84:0/3823742779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b07a0 0x7f864c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f864affd700 1 --2- 172.21.15.84:0/3823742779 >> v2:172.21.15.131:3300/0 conn(0x7f864c0b49e0 0x7f864c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f864b7fe700 1 -- 172.21.15.84:0/3823742779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b07a0 msgr2=0x7f864c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f864b7fe700 1 --2- 172.21.15.84:0/3823742779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b07a0 0x7f864c0b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f864b7fe700 1 -- 172.21.15.84:0/3823742779 >> v2:172.21.15.131:3300/0 conn(0x7f864c0b49e0 msgr2=0x7f864c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f864b7fe700 1 --2- 172.21.15.84:0/3823742779 >> v2:172.21.15.131:3300/0 conn(0x7f864c0b49e0 0x7f864c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f864b7fe700 1 -- 172.21.15.84:0/3823742779 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0b1540 con 0x7f864c1595a0 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f864b7fe700 1 --2- 172.21.15.84:0/3823742779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c1595a0 0x7f864c0aa570 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f863c009f70 tx=0x7f863c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa6002f98170d2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f864a7fc700 1 -- 172.21.15.84:0/3823742779 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00e070 con 0x7f864c1595a0 2023-10-06T03:25:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f864a7fc700 1 -- 172.21.15.84:0/3823742779 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c00ba90 con 0x7f864c1595a0 2023-10-06T03:25:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f864a7fc700 1 -- 172.21.15.84:0/3823742779 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0092e0 con 0x7f864c1595a0 2023-10-06T03:25:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f8651baa700 1 -- 172.21.15.84:0/3823742779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c1595a0 msgr2=0x7f864c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f8651baa700 1 --2- 172.21.15.84:0/3823742779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c1595a0 0x7f864c0aa570 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f863c009f70 tx=0x7f863c009840 comp rx=0 tx=0).stop 2023-10-06T03:25:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f8651baa700 1 -- 172.21.15.84:0/3823742779 shutdown_connections 2023-10-06T03:25:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f8651baa700 1 --2- 172.21.15.84:0/3823742779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b07a0 0x7f864c0b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f8651baa700 1 --2- 172.21.15.84:0/3823742779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c1595a0 0x7f864c0aa570 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f8651baa700 1 --2- 172.21.15.84:0/3823742779 >> v2:172.21.15.131:3300/0 conn(0x7f864c0b49e0 0x7f864c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f8651baa700 1 -- 172.21.15.84:0/3823742779 >> 172.21.15.84:0/3823742779 conn(0x7f864c099830 msgr2=0x7f864c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f8651baa700 1 -- 172.21.15.84:0/3823742779 shutdown_connections 2023-10-06T03:25:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.997+0000 7f8651baa700 1 -- 172.21.15.84:0/3823742779 wait complete. 2023-10-06T03:25:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.999+0000 7f8651baa700 1 Processor -- start 2023-10-06T03:25:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.999+0000 7f8651baa700 1 -- start start 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.999+0000 7f8651baa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c0b07a0 0x7f864c15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.999+0000 7f8651baa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b49e0 0x7f864c155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.999+0000 7f8651baa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f864c1595a0 0x7f864c16d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.999+0000 7f8651baa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c15bfc0 con 0x7f864c0b07a0 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.999+0000 7f8651baa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c15b7b0 con 0x7f864c1595a0 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:32.999+0000 7f8651baa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c16cf90 con 0x7f864c0b49e0 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c0b07a0 0x7f864c15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c0b07a0 0x7f864c15c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44696/0 (socket says 172.21.15.84:44696) 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864b7fe700 1 -- 172.21.15.84:0/3113771553 learned_addr learned my addr 172.21.15.84:0/3113771553 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864bfff700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f864c1595a0 0x7f864c16d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864affd700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b49e0 0x7f864c155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864b7fe700 1 -- 172.21.15.84:0/3113771553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b49e0 msgr2=0x7f864c155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864b7fe700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b49e0 0x7f864c155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864b7fe700 1 -- 172.21.15.84:0/3113771553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f864c1595a0 msgr2=0x7f864c16d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864b7fe700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f864c1595a0 0x7f864c16d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864b7fe700 1 -- 172.21.15.84:0/3113771553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c009ae0 con 0x7f864c0b07a0 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864bfff700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f864c1595a0 0x7f864c16d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864affd700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b49e0 0x7f864c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f864b7fe700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c0b07a0 0x7f864c15c780 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f863c009880 tx=0x7f863c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f86337fe700 1 -- 172.21.15.84:0/3113771553 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c008a60 con 0x7f864c0b07a0 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f86337fe700 1 -- 172.21.15.84:0/3113771553 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c008be0 con 0x7f864c0b07a0 2023-10-06T03:25:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f8651baa700 1 -- 172.21.15.84:0/3113771553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c156920 con 0x7f864c0b07a0 2023-10-06T03:25:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f86337fe700 1 -- 172.21.15.84:0/3113771553 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c025460 con 0x7f864c0b07a0 2023-10-06T03:25:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.000+0000 7f8651baa700 1 -- 172.21.15.84:0/3113771553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c15bce0 con 0x7f864c0b07a0 2023-10-06T03:25:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.001+0000 7f8651baa700 1 -- 172.21.15.84:0/3113771553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c16d270 con 0x7f864c0b07a0 2023-10-06T03:25:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.001+0000 7f86337fe700 1 -- 172.21.15.84:0/3113771553 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f863c003040 con 0x7f864c0b07a0 2023-10-06T03:25:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.002+0000 7f86337fe700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8638066f30 0x7f86380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.002+0000 7f864affd700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8638066f30 0x7f86380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.002+0000 7f86337fe700 1 -- 172.21.15.84:0/3113771553 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f863c086350 con 0x7f864c0b07a0 2023-10-06T03:25:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.002+0000 7f864affd700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8638066f30 0x7f86380693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f864c156c00 tx=0x7f8640008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:33.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.006+0000 7f86337fe700 1 -- 172.21.15.84:0/3113771553 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f863c053320 con 0x7f864c0b07a0 2023-10-06T03:25:33.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.231+0000 7f8651baa700 1 -- 172.21.15.84:0/3113771553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f864c064ad0 con 0x7f864c0b07a0 2023-10-06T03:25:33.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.232+0000 7f86337fe700 1 -- 172.21.15.84:0/3113771553 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f863c056940 con 0x7f864c0b07a0 2023-10-06T03:25:33.233 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:33.233 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3103408955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3103408955},{"type":"v1","addr":"172.21.15.131:6834","nonce":3103408955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3982920665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3982920665},{"type":"v1","addr":"172.21.15.131:6835","nonce":3982920665}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1537563341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1537563341},{"type":"v1","addr":"172.21.15.84:6836","nonce":1537563341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:21.111306+0000","modified":"2023-10-06T03:25:24.747627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5526":{"gid":5526,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3473748806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3473748806},{"type":"v1","addr":"172.21.15.84:6837","nonce":3473748806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:25:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 -- 172.21.15.84:0/3113771553 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8638066f30 msgr2=0x7f86380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8638066f30 0x7f86380693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f864c156c00 tx=0x7f8640008040 comp rx=0 tx=0).stop 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 -- 172.21.15.84:0/3113771553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c0b07a0 msgr2=0x7f864c15c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c0b07a0 0x7f864c15c780 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f863c009880 tx=0x7f863c018000 comp rx=0 tx=0).stop 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 -- 172.21.15.84:0/3113771553 shutdown_connections 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8638066f30 0x7f86380693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f864c1595a0 0x7f864c16d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f864c0b07a0 0x7f864c15c780 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 --2- 172.21.15.84:0/3113771553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f864c0b49e0 0x7f864c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 -- 172.21.15.84:0/3113771553 >> 172.21.15.84:0/3113771553 conn(0x7f864c099830 msgr2=0x7f864c069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 -- 172.21.15.84:0/3113771553 shutdown_connections 2023-10-06T03:25:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.234+0000 7f8651baa700 1 -- 172.21.15.84:0/3113771553 wait complete. 2023-10-06T03:25:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2023-10-06T03:25:33.247 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:33.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.362+0000 7f7da1a73700 1 Processor -- start 2023-10-06T03:25:33.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.362+0000 7f7da1a73700 1 -- start start 2023-10-06T03:25:33.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7da1a73700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0b49e0 0x7f7d9c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7da1a73700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c0b0ca0 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7da1a73700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c0b0f80 con 0x7f7d9c1595a0 2023-10-06T03:25:33.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7da1a73700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0b1260 con 0x7f7d9c0b49e0 2023-10-06T03:25:33.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7d9c0b07a0 0x7f7d9c0b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52574/0 (socket says 172.21.15.84:52574) 2023-10-06T03:25:33.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9bfff700 1 -- 172.21.15.84:0/91694199 learned_addr learned my addr 172.21.15.84:0/91694199 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:33.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9affd700 1 --2- 172.21.15.84:0/91694199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0b49e0 0x7f7d9c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9a7fc700 1 -- 172.21.15.84:0/91694199 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417098672 0 0) 0x7f7d9c0b0ca0 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9a7fc700 1 -- 172.21.15.84:0/91694199 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d88003570 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9a7fc700 1 -- 172.21.15.84:0/91694199 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420137051 0 0) 0x7f7d9c0b0f80 con 0x7f7d9c1595a0 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9a7fc700 1 -- 172.21.15.84:0/91694199 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d9c0b0ca0 con 0x7f7d9c1595a0 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9affd700 1 -- 172.21.15.84:0/91694199 >> v1:172.21.15.131:6789/0 conn(0x7f7d9c1595a0 legacy=0x7f7d9c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9a7fc700 1 -- 172.21.15.84:0/91694199 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1063291255 0 0) 0x7f7d88003570 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9affd700 1 -- 172.21.15.84:0/91694199 >> v1:172.21.15.84:6789/0 conn(0x7f7d9c0b07a0 legacy=0x7f7d9c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.363+0000 7f7d9affd700 1 -- 172.21.15.84:0/91694199 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0b1540 con 0x7f7d9c0b49e0 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7d9affd700 1 --2- 172.21.15.84:0/91694199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0b49e0 0x7f7d9c0aac80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009910 tx=0x7f7d840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd12da3b6d22ea8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7d9a7fc700 1 -- 172.21.15.84:0/91694199 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c001470 con 0x7f7d9c0b49e0 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7d9a7fc700 1 -- 172.21.15.84:0/91694199 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d84011420 con 0x7f7d9c0b49e0 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7d9a7fc700 1 -- 172.21.15.84:0/91694199 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840117c0 con 0x7f7d9c0b49e0 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7da1a73700 1 -- 172.21.15.84:0/91694199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0b49e0 msgr2=0x7f7d9c0aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7da1a73700 1 --2- 172.21.15.84:0/91694199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0b49e0 0x7f7d9c0aac80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009910 tx=0x7f7d840091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7da1a73700 1 -- 172.21.15.84:0/91694199 shutdown_connections 2023-10-06T03:25:33.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7da1a73700 1 --2- 172.21.15.84:0/91694199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0b49e0 0x7f7d9c0aac80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7da1a73700 1 -- 172.21.15.84:0/91694199 >> 172.21.15.84:0/91694199 conn(0x7f7d9c099830 msgr2=0x7f7d9c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7da1a73700 1 -- 172.21.15.84:0/91694199 shutdown_connections 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.364+0000 7f7da1a73700 1 -- 172.21.15.84:0/91694199 wait complete. 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.365+0000 7f7da1a73700 1 Processor -- start 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.366+0000 7f7da1a73700 1 -- start start 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.366+0000 7f7da1a73700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0b07a0 0x7f7d9c157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.366+0000 7f7da1a73700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c0b49e0 0x7f7d9c09bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.366+0000 7f7da1a73700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c1595a0 0x7f7d9c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.366+0000 7f7da1a73700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c1581c0 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.366+0000 7f7da1a73700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c09c820 con 0x7f7d9c0b49e0 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.366+0000 7f7da1a73700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c09cb00 con 0x7f7d9c1595a0 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.366+0000 7f7d9b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0b07a0 0x7f7d9c157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.366+0000 7f7d9b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0b07a0 0x7f7d9c157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44698/0 (socket says 172.21.15.84:44698) 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.366+0000 7f7d9b7fe700 1 -- 172.21.15.84:0/2052868335 learned_addr learned my addr 172.21.15.84:0/2052868335 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d9affd700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c0b49e0 0x7f7d9c09bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d9bfff700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c1595a0 0x7f7d9c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d9b7fe700 1 -- 172.21.15.84:0/2052868335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c1595a0 msgr2=0x7f7d9c0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d9b7fe700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c1595a0 0x7f7d9c0ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d9b7fe700 1 -- 172.21.15.84:0/2052868335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c0b49e0 msgr2=0x7f7d9c09bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d9b7fe700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c0b49e0 0x7f7d9c09bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d9b7fe700 1 -- 172.21.15.84:0/2052868335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84009420 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d9b7fe700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0b07a0 0x7f7d9c157c80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400cd30 tx=0x7f7d94002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d937fe700 1 -- 172.21.15.84:0/2052868335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9400ce90 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d937fe700 1 -- 172.21.15.84:0/2052868335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9400aac0 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7da1a73700 1 -- 172.21.15.84:0/2052868335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c09cde0 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7d937fe700 1 -- 172.21.15.84:0/2052868335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9400ae60 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.367+0000 7f7da1a73700 1 -- 172.21.15.84:0/2052868335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c09c460 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.368+0000 7f7da1a73700 1 -- 172.21.15.84:0/2052868335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9c09a450 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.368+0000 7f7d937fe700 1 -- 172.21.15.84:0/2052868335 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d94012630 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.369+0000 7f7d937fe700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7d7c066f30 0x7f7d7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.369+0000 7f7d9affd700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7d7c066f30 0x7f7d7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.369+0000 7f7d937fe700 1 -- 172.21.15.84:0/2052868335 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7d94084e20 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.369+0000 7f7d9affd700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7d7c066f30 0x7f7d7c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7d840030c0 tx=0x7f7d84016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:33.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.373+0000 7f7d937fe700 1 -- 172.21.15.84:0/2052868335 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d9c09a450 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.558+0000 7f7da1a73700 1 -- 172.21.15.84:0/2052868335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d9c09a450 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.559+0000 7f7d937fe700 1 -- 172.21.15.84:0/2052868335 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f7d9c09a450 con 0x7f7d9c0b07a0 2023-10-06T03:25:33.560 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:33.561 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":50,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:22.337746+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:18.741959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:20.079553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:33.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.561+0000 7f7da1a73700 1 -- 172.21.15.84:0/2052868335 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7d7c066f30 msgr2=0x7f7d7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.561+0000 7f7da1a73700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7d7c066f30 0x7f7d7c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7d840030c0 tx=0x7f7d84016000 comp rx=0 tx=0).stop 2023-10-06T03:25:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.562+0000 7f7da1a73700 1 -- 172.21.15.84:0/2052868335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0b07a0 msgr2=0x7f7d9c157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.562+0000 7f7da1a73700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0b07a0 0x7f7d9c157c80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400cd30 tx=0x7f7d94002b90 comp rx=0 tx=0).stop 2023-10-06T03:25:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.562+0000 7f7da1a73700 1 -- 172.21.15.84:0/2052868335 shutdown_connections 2023-10-06T03:25:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.562+0000 7f7da1a73700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7d7c066f30 0x7f7d7c0693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.562+0000 7f7da1a73700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c1595a0 0x7f7d9c0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.562+0000 7f7da1a73700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0b07a0 0x7f7d9c157c80 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.562+0000 7f7da1a73700 1 --2- 172.21.15.84:0/2052868335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c0b49e0 0x7f7d9c09bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.562+0000 7f7da1a73700 1 -- 172.21.15.84:0/2052868335 >> 172.21.15.84:0/2052868335 conn(0x7f7d9c099830 msgr2=0x7f7d9c0699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.562+0000 7f7da1a73700 1 -- 172.21.15.84:0/2052868335 shutdown_connections 2023-10-06T03:25:33.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.562+0000 7f7da1a73700 1 -- 172.21.15.84:0/2052868335 wait complete. 2023-10-06T03:25:33.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:25:33.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.692+0000 7f46f0f6e700 1 Processor -- start 2023-10-06T03:25:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.692+0000 7f46f0f6e700 1 -- start start 2023-10-06T03:25:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46f0f6e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f46ec1595a0 0x7f46ec0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46f0f6e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46ec0b07a0 0x7f46ec0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46f0f6e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec0b0ca0 con 0x7f46ec0b49e0 2023-10-06T03:25:33.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46f0f6e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec0b0f80 con 0x7f46ec1595a0 2023-10-06T03:25:33.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46f0f6e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec0b1260 con 0x7f46ec0b07a0 2023-10-06T03:25:33.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46ea59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f46ec1595a0 0x7f46ec0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46e9d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f46ec0b49e0 0x7f46ec0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52580/0 (socket says 172.21.15.84:52580) 2023-10-06T03:25:33.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46e9d9b700 1 -- 172.21.15.84:0/517189764 learned_addr learned my addr 172.21.15.84:0/517189764 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:33.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46ead9d700 1 --2- 172.21.15.84:0/517189764 >> v2:172.21.15.131:3300/0 conn(0x7f46ec0b07a0 0x7f46ec0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46ea59c700 1 -- 172.21.15.84:0/517189764 >> v2:172.21.15.131:3300/0 conn(0x7f46ec0b07a0 msgr2=0x7f46ec0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:33.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46ea59c700 1 --2- 172.21.15.84:0/517189764 >> v2:172.21.15.131:3300/0 conn(0x7f46ec0b07a0 0x7f46ec0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46ea59c700 1 -- 172.21.15.84:0/517189764 >> v1:172.21.15.84:6789/0 conn(0x7f46ec0b49e0 legacy=0x7f46ec0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46ea59c700 1 -- 172.21.15.84:0/517189764 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0b1540 con 0x7f46ec1595a0 2023-10-06T03:25:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46ead9d700 1 --2- 172.21.15.84:0/517189764 >> v2:172.21.15.131:3300/0 conn(0x7f46ec0b07a0 0x7f46ec0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46ea59c700 1 --2- 172.21.15.84:0/517189764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec1595a0 0x7f46ec0aa570 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009eb0 tx=0x7f46e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758df5281f7e1663 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46e959a700 1 -- 172.21.15.84:0/517189764 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400e070 con 0x7f46ec1595a0 2023-10-06T03:25:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46e959a700 1 -- 172.21.15.84:0/517189764 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e400bb30 con 0x7f46ec1595a0 2023-10-06T03:25:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.693+0000 7f46e959a700 1 -- 172.21.15.84:0/517189764 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400bed0 con 0x7f46ec1595a0 2023-10-06T03:25:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.694+0000 7f46f0f6e700 1 -- 172.21.15.84:0/517189764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec1595a0 msgr2=0x7f46ec0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.694+0000 7f46f0f6e700 1 --2- 172.21.15.84:0/517189764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec1595a0 0x7f46ec0aa570 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009eb0 tx=0x7f46e4009780 comp rx=0 tx=0).stop 2023-10-06T03:25:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.694+0000 7f46f0f6e700 1 -- 172.21.15.84:0/517189764 shutdown_connections 2023-10-06T03:25:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.694+0000 7f46f0f6e700 1 --2- 172.21.15.84:0/517189764 >> v2:172.21.15.131:3300/0 conn(0x7f46ec0b07a0 0x7f46ec0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.694+0000 7f46f0f6e700 1 --2- 172.21.15.84:0/517189764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec1595a0 0x7f46ec0aa570 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.694+0000 7f46f0f6e700 1 -- 172.21.15.84:0/517189764 >> 172.21.15.84:0/517189764 conn(0x7f46ec099830 msgr2=0x7f46ec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:33.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.694+0000 7f46f0f6e700 1 -- 172.21.15.84:0/517189764 shutdown_connections 2023-10-06T03:25:33.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.694+0000 7f46f0f6e700 1 -- 172.21.15.84:0/517189764 wait complete. 2023-10-06T03:25:33.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.695+0000 7f46f0f6e700 1 Processor -- start 2023-10-06T03:25:33.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.695+0000 7f46f0f6e700 1 -- start start 2023-10-06T03:25:33.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46f0f6e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec0b07a0 0x7f46ec157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46f0f6e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ec0b49e0 0x7f46ec0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46f0f6e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46ec1595a0 0x7f46ec0ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46f0f6e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0af3e0 con 0x7f46ec0b07a0 2023-10-06T03:25:33.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46f0f6e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0ae7d0 con 0x7f46ec0b49e0 2023-10-06T03:25:33.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46f0f6e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0aeab0 con 0x7f46ec1595a0 2023-10-06T03:25:33.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ea59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec0b07a0 0x7f46ec157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ea59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec0b07a0 0x7f46ec157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44724/0 (socket says 172.21.15.84:44724) 2023-10-06T03:25:33.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ea59c700 1 -- 172.21.15.84:0/1041887322 learned_addr learned my addr 172.21.15.84:0/1041887322 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:33.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ead9d700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46ec1595a0 0x7f46ec0ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46e9d9b700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ec0b49e0 0x7f46ec0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ea59c700 1 -- 172.21.15.84:0/1041887322 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46ec1595a0 msgr2=0x7f46ec0ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ea59c700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46ec1595a0 0x7f46ec0ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ea59c700 1 -- 172.21.15.84:0/1041887322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ec0b49e0 msgr2=0x7f46ec0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ea59c700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ec0b49e0 0x7f46ec0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ea59c700 1 -- 172.21.15.84:0/1041887322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4009a20 con 0x7f46ec0b07a0 2023-10-06T03:25:33.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46e9d9b700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ec0b49e0 0x7f46ec0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:33.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ead9d700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46ec1595a0 0x7f46ec0ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:33.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.696+0000 7f46ea59c700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec0b07a0 0x7f46ec157b00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f46ec067c60 tx=0x7f46e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:33.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.697+0000 7f46e27fc700 1 -- 172.21.15.84:0/1041887322 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e401e450 con 0x7f46ec0b07a0 2023-10-06T03:25:33.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.697+0000 7f46f0f6e700 1 -- 172.21.15.84:0/1041887322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec0aed90 con 0x7f46ec0b07a0 2023-10-06T03:25:33.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.697+0000 7f46e27fc700 1 -- 172.21.15.84:0/1041887322 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e401e5b0 con 0x7f46ec0b07a0 2023-10-06T03:25:33.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.697+0000 7f46e27fc700 1 -- 172.21.15.84:0/1041887322 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e401e970 con 0x7f46ec0b07a0 2023-10-06T03:25:33.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.697+0000 7f46f0f6e700 1 -- 172.21.15.84:0/1041887322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec158040 con 0x7f46ec0b07a0 2023-10-06T03:25:33.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.698+0000 7f46f0f6e700 1 -- 172.21.15.84:0/1041887322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec064ad0 con 0x7f46ec0b07a0 2023-10-06T03:25:33.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.698+0000 7f46e27fc700 1 -- 172.21.15.84:0/1041887322 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46e401c3e0 con 0x7f46ec0b07a0 2023-10-06T03:25:33.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.698+0000 7f46e27fc700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f46cc066f30 0x7f46cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:33.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.699+0000 7f46e27fc700 1 -- 172.21.15.84:0/1041887322 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f46e4086860 con 0x7f46ec0b07a0 2023-10-06T03:25:33.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.699+0000 7f46e9d9b700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f46cc066f30 0x7f46cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:33.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.699+0000 7f46e9d9b700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f46cc066f30 0x7f46cc0693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f46d40058d0 tx=0x7f46d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:33.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.703+0000 7f46e27fc700 1 -- 172.21.15.84:0/1041887322 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46e4053830 con 0x7f46ec0b07a0 2023-10-06T03:25:33.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.927+0000 7f46f0f6e700 1 -- 172.21.15.84:0/1041887322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f46ec0af770 con 0x7f46ec0b07a0 2023-10-06T03:25:33.928 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:25:33.927+0000 7f573ff98700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:25:33.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.931+0000 7f46e27fc700 1 -- 172.21.15.84:0/1041887322 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f46e4056e50 con 0x7f46ec0b07a0 2023-10-06T03:25:33.932 INFO:tasks.ceph.mds.a.smithi084.stderr: -571> 2023-10-06T03:25:26.019+0000 7f56ee6e6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:25:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.933+0000 7f46f0f6e700 1 -- 172.21.15.84:0/1041887322 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f46cc066f30 msgr2=0x7f46cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.933+0000 7f46f0f6e700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f46cc066f30 0x7f46cc0693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f46d40058d0 tx=0x7f46d4009040 comp rx=0 tx=0).stop 2023-10-06T03:25:33.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.933+0000 7f46f0f6e700 1 -- 172.21.15.84:0/1041887322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec0b07a0 msgr2=0x7f46ec157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:33.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.933+0000 7f46f0f6e700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec0b07a0 0x7f46ec157b00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f46ec067c60 tx=0x7f46e4015000 comp rx=0 tx=0).stop 2023-10-06T03:25:33.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.933+0000 7f46f0f6e700 1 -- 172.21.15.84:0/1041887322 shutdown_connections 2023-10-06T03:25:33.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.933+0000 7f46f0f6e700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f46cc066f30 0x7f46cc0693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.933+0000 7f46f0f6e700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46ec1595a0 0x7f46ec0ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.933+0000 7f46f0f6e700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46ec0b07a0 0x7f46ec157b00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.933+0000 7f46f0f6e700 1 --2- 172.21.15.84:0/1041887322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ec0b49e0 0x7f46ec0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:33.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.933+0000 7f46f0f6e700 1 -- 172.21.15.84:0/1041887322 >> 172.21.15.84:0/1041887322 conn(0x7f46ec099830 msgr2=0x7f46ec0b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:33.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.934+0000 7f46f0f6e700 1 -- 172.21.15.84:0/1041887322 shutdown_connections 2023-10-06T03:25:33.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:33.934+0000 7f46f0f6e700 1 -- 172.21.15.84:0/1041887322 wait complete. 2023-10-06T03:25:33.936 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:25:33.947 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:25:33.952 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:25:34.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.061+0000 7f1645c5d700 1 Processor -- start 2023-10-06T03:25:34.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.061+0000 7f1645c5d700 1 -- start start 2023-10-06T03:25:34.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f1645c5d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f164006d650 0x7f16400c6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:34.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f1645c5d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1640157c30 0x7f16400ad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:34.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f1645c5d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f164006da20 0x7f16400aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:34.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f1645c5d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400c7080 con 0x7f164006d650 2023-10-06T03:25:34.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f1645c5d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400c7360 con 0x7f164006da20 2023-10-06T03:25:34.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f1645c5d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400c7640 con 0x7f1640157c30 2023-10-06T03:25:34.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f163f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f164006d650 0x7f16400c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:34.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f163f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f164006d650 0x7f16400c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44744/0 (socket says 172.21.15.84:44744) 2023-10-06T03:25:34.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f163f7fe700 1 -- 172.21.15.84:0/2738049602 learned_addr learned my addr 172.21.15.84:0/2738049602 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:34.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f163ffff700 1 --2- 172.21.15.84:0/2738049602 >> v2:172.21.15.131:3300/0 conn(0x7f164006da20 0x7f16400aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:34.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.062+0000 7f163effd700 1 --2- 172.21.15.84:0/2738049602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1640157c30 0x7f16400ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:34.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.063+0000 7f163f7fe700 1 -- 172.21.15.84:0/2738049602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1640157c30 msgr2=0x7f16400ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:34.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.063+0000 7f163f7fe700 1 --2- 172.21.15.84:0/2738049602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1640157c30 0x7f16400ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.063+0000 7f163f7fe700 1 -- 172.21.15.84:0/2738049602 >> v2:172.21.15.131:3300/0 conn(0x7f164006da20 msgr2=0x7f16400aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:34.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.063+0000 7f163f7fe700 1 --2- 172.21.15.84:0/2738049602 >> v2:172.21.15.131:3300/0 conn(0x7f164006da20 0x7f16400aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.063+0000 7f163f7fe700 1 -- 172.21.15.84:0/2738049602 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400c7920 con 0x7f164006d650 2023-10-06T03:25:34.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.063+0000 7f163f7fe700 1 --2- 172.21.15.84:0/2738049602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f164006d650 0x7f16400c6710 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f16400cd1e0 tx=0x7f1630009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991229800a7ee78e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:34.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.063+0000 7f163e7fc700 1 -- 172.21.15.84:0/2738049602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163000b640 con 0x7f164006d650 2023-10-06T03:25:34.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.063+0000 7f163e7fc700 1 -- 172.21.15.84:0/2738049602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163000b7a0 con 0x7f164006d650 2023-10-06T03:25:34.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.063+0000 7f163e7fc700 1 -- 172.21.15.84:0/2738049602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163000bb60 con 0x7f164006d650 2023-10-06T03:25:34.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.064+0000 7f1645c5d700 1 -- 172.21.15.84:0/2738049602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f164006d650 msgr2=0x7f16400c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:34.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.064+0000 7f1645c5d700 1 --2- 172.21.15.84:0/2738049602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f164006d650 0x7f16400c6710 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f16400cd1e0 tx=0x7f1630009250 comp rx=0 tx=0).stop 2023-10-06T03:25:34.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.064+0000 7f1645c5d700 1 -- 172.21.15.84:0/2738049602 shutdown_connections 2023-10-06T03:25:34.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.064+0000 7f1645c5d700 1 --2- 172.21.15.84:0/2738049602 >> v2:172.21.15.131:3300/0 conn(0x7f164006da20 0x7f16400aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.064+0000 7f1645c5d700 1 --2- 172.21.15.84:0/2738049602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f164006d650 0x7f16400c6710 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.064+0000 7f1645c5d700 1 --2- 172.21.15.84:0/2738049602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1640157c30 0x7f16400ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.064+0000 7f1645c5d700 1 -- 172.21.15.84:0/2738049602 >> 172.21.15.84:0/2738049602 conn(0x7f16400cc0d0 msgr2=0x7f16400cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:34.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.064+0000 7f1645c5d700 1 -- 172.21.15.84:0/2738049602 shutdown_connections 2023-10-06T03:25:34.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.064+0000 7f1645c5d700 1 -- 172.21.15.84:0/2738049602 wait complete. 2023-10-06T03:25:34.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.065+0000 7f1645c5d700 1 Processor -- start 2023-10-06T03:25:34.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.065+0000 7f1645c5d700 1 -- start start 2023-10-06T03:25:34.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f1645c5d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f164006d650 0x7f16400aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:34.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f1645c5d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f164006da20 0x7f16400ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:34.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f1645c5d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1640157c30 0x7f16400c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:34.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f1645c5d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400ca980 con 0x7f1640157c30 2023-10-06T03:25:34.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f1645c5d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400c9d70 con 0x7f164006da20 2023-10-06T03:25:34.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f1645c5d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400ca050 con 0x7f164006d650 2023-10-06T03:25:34.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f163ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1640157c30 0x7f16400c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:34.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f163ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1640157c30 0x7f16400c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44746/0 (socket says 172.21.15.84:44746) 2023-10-06T03:25:34.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f163ffff700 1 -- 172.21.15.84:0/845107731 learned_addr learned my addr 172.21.15.84:0/845107731 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:34.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f163ffff700 1 -- 172.21.15.84:0/845107731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f164006d650 msgr2=0x7f16400aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:34.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f163effd700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f164006da20 0x7f16400ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:34.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f163ffff700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f164006d650 0x7f16400aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f163ffff700 1 -- 172.21.15.84:0/845107731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f164006da20 msgr2=0x7f16400ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:34.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f163ffff700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f164006da20 0x7f16400ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f163ffff700 1 -- 172.21.15.84:0/845107731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16300094f0 con 0x7f1640157c30 2023-10-06T03:25:34.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f163ffff700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1640157c30 0x7f16400c4320 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1638009e90 tx=0x7f163800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:34.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f16277fe700 1 -- 172.21.15.84:0/845107731 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163800cc20 con 0x7f1640157c30 2023-10-06T03:25:34.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f16277fe700 1 -- 172.21.15.84:0/845107731 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163800f040 con 0x7f1640157c30 2023-10-06T03:25:34.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f1645c5d700 1 -- 172.21.15.84:0/845107731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16400ca330 con 0x7f1640157c30 2023-10-06T03:25:34.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f16277fe700 1 -- 172.21.15.84:0/845107731 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638014480 con 0x7f1640157c30 2023-10-06T03:25:34.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.066+0000 7f1645c5d700 1 -- 172.21.15.84:0/845107731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16400ac5e0 con 0x7f1640157c30 2023-10-06T03:25:34.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.067+0000 7f1645c5d700 1 -- 172.21.15.84:0/845107731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164006f870 con 0x7f1640157c30 2023-10-06T03:25:34.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.068+0000 7f16277fe700 1 -- 172.21.15.84:0/845107731 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1638014830 con 0x7f1640157c30 2023-10-06T03:25:34.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.068+0000 7f16277fe700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f162c066f30 0x7f162c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:34.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.068+0000 7f16277fe700 1 -- 172.21.15.84:0/845107731 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f16380852b0 con 0x7f1640157c30 2023-10-06T03:25:34.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.068+0000 7f163f7fe700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f162c066f30 0x7f162c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:34.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.068+0000 7f163f7fe700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f162c066f30 0x7f162c0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f16400cd1e0 tx=0x7f1630017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:34.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.072+0000 7f16277fe700 1 -- 172.21.15.84:0/845107731 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1638055cc0 con 0x7f1640157c30 2023-10-06T03:25:34.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.299+0000 7f1645c5d700 1 -- 172.21.15.84:0/845107731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1640064ad0 con 0x7f1640157c30 2023-10-06T03:25:34.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.931+0000 7f16277fe700 1 -- 172.21.15.84:0/845107731 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1638055850 con 0x7f1640157c30 2023-10-06T03:25:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 -- 172.21.15.84:0/845107731 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f162c066f30 msgr2=0x7f162c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f162c066f30 0x7f162c0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f16400cd1e0 tx=0x7f1630017000 comp rx=0 tx=0).stop 2023-10-06T03:25:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 -- 172.21.15.84:0/845107731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1640157c30 msgr2=0x7f16400c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1640157c30 0x7f16400c4320 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1638009e90 tx=0x7f163800b040 comp rx=0 tx=0).stop 2023-10-06T03:25:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 -- 172.21.15.84:0/845107731 shutdown_connections 2023-10-06T03:25:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f162c066f30 0x7f162c0693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1640157c30 0x7f16400c4320 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f164006d650 0x7f16400aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 --2- 172.21.15.84:0/845107731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f164006da20 0x7f16400ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 -- 172.21.15.84:0/845107731 >> 172.21.15.84:0/845107731 conn(0x7f16400cc0d0 msgr2=0x7f164015a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 -- 172.21.15.84:0/845107731 shutdown_connections 2023-10-06T03:25:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:34.933+0000 7f1645c5d700 1 -- 172.21.15.84:0/845107731 wait complete. 2023-10-06T03:25:34.946 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:25:35.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.104+0000 7f86cffff700 1 Processor -- start 2023-10-06T03:25:35.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.104+0000 7f86cffff700 1 -- start start 2023-10-06T03:25:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.105+0000 7f86cffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86d0069980 0x7f86d015d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.105+0000 7f86cffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d015aaf0 con 0x7f86d0069d50 2023-10-06T03:25:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.105+0000 7f86cffff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d00cbb50 con 0x7f86d00cb2d0 2023-10-06T03:25:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.105+0000 7f86cffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d015de70 con 0x7f86d0069980 2023-10-06T03:25:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.105+0000 7f86ceffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86d0069980 0x7f86d015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.105+0000 7f86ceffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86d0069980 0x7f86d015d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44748/0 (socket says 172.21.15.84:44748) 2023-10-06T03:25:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.105+0000 7f86cf7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f86d0069d50 0x7f86d00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52598/0 (socket says 172.21.15.84:52598) 2023-10-06T03:25:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.105+0000 7f86ceffd700 1 -- 172.21.15.84:0/1114724317 learned_addr learned my addr 172.21.15.84:0/1114724317 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86ceffd700 1 -- 172.21.15.84:0/1114724317 >> v1:172.21.15.131:6789/0 conn(0x7f86d00cb2d0 legacy=0x7f86d00cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86ceffd700 1 -- 172.21.15.84:0/1114724317 >> v1:172.21.15.84:6789/0 conn(0x7f86d0069d50 legacy=0x7f86d00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86ceffd700 1 -- 172.21.15.84:0/1114724317 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d00cb870 con 0x7f86d0069980 2023-10-06T03:25:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86cdffb700 1 -- 172.21.15.84:0/1114724317 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289223164 0 0) 0x7f86d015aaf0 con 0x7f86d0069d50 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86ceffd700 1 --2- 172.21.15.84:0/1114724317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 0x7f86d015d930 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f86c00099b0 tx=0x7f86c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509077e2371ca690 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86cdffb700 1 -- 172.21.15.84:0/1114724317 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c000b860 con 0x7f86d0069980 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86cdffb700 1 -- 172.21.15.84:0/1114724317 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c000b9c0 con 0x7f86d0069980 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86cdffb700 1 -- 172.21.15.84:0/1114724317 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c000bd60 con 0x7f86d0069980 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86cffff700 1 -- 172.21.15.84:0/1114724317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 msgr2=0x7f86d015d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86cffff700 1 --2- 172.21.15.84:0/1114724317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 0x7f86d015d930 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f86c00099b0 tx=0x7f86c0009250 comp rx=0 tx=0).stop 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86cffff700 1 -- 172.21.15.84:0/1114724317 shutdown_connections 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86cffff700 1 --2- 172.21.15.84:0/1114724317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 0x7f86d015d930 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86cffff700 1 -- 172.21.15.84:0/1114724317 >> 172.21.15.84:0/1114724317 conn(0x7f86d0068a70 msgr2=0x7f86d00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.106+0000 7f86cffff700 1 -- 172.21.15.84:0/1114724317 shutdown_connections 2023-10-06T03:25:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.107+0000 7f86cffff700 1 -- 172.21.15.84:0/1114724317 wait complete. 2023-10-06T03:25:35.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.108+0000 7f86cffff700 1 Processor -- start 2023-10-06T03:25:35.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.108+0000 7f86cffff700 1 -- start start 2023-10-06T03:25:35.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.108+0000 7f86cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 0x7f86d015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:35.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.108+0000 7f86cffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86d0069d50 0x7f86d00cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.108+0000 7f86cffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d00cb2d0 0x7f86d00cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.108+0000 7f86cffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d015beb0 con 0x7f86d0069980 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86cffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00b3f20 con 0x7f86d00cb2d0 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86cffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00b4200 con 0x7f86d0069d50 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86ceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 0x7f86d015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86ceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 0x7f86d015b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44762/0 (socket says 172.21.15.84:44762) 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86ceffd700 1 -- 172.21.15.84:0/272620580 learned_addr learned my addr 172.21.15.84:0/272620580 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86cf7fe700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d00cb2d0 0x7f86d00cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86ce7fc700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86d0069d50 0x7f86d00cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86ceffd700 1 -- 172.21.15.84:0/272620580 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86d0069d50 msgr2=0x7f86d00cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:35.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86ceffd700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86d0069d50 0x7f86d00cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86ceffd700 1 -- 172.21.15.84:0/272620580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d00cb2d0 msgr2=0x7f86d00cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86ceffd700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d00cb2d0 0x7f86d00cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86ceffd700 1 -- 172.21.15.84:0/272620580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00094f0 con 0x7f86d0069980 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86ceffd700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 0x7f86d015b4e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f86c0006f50 tx=0x7f86c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86b6ffd700 1 -- 172.21.15.84:0/272620580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c001f070 con 0x7f86d0069980 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86b6ffd700 1 -- 172.21.15.84:0/272620580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c001a420 con 0x7f86d0069980 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86cffff700 1 -- 172.21.15.84:0/272620580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d00b44e0 con 0x7f86d0069980 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86b6ffd700 1 -- 172.21.15.84:0/272620580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c001a800 con 0x7f86d0069980 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.109+0000 7f86cffff700 1 -- 172.21.15.84:0/272620580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d015ba20 con 0x7f86d0069980 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.110+0000 7f86cffff700 1 -- 172.21.15.84:0/272620580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d005f270 con 0x7f86d0069980 2023-10-06T03:25:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.111+0000 7f86b6ffd700 1 -- 172.21.15.84:0/272620580 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86c001ab70 con 0x7f86d0069980 2023-10-06T03:25:35.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.111+0000 7f86b6ffd700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86bc066f30 0x7f86bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:35.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.111+0000 7f86b6ffd700 1 -- 172.21.15.84:0/272620580 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f86c0085c30 con 0x7f86d0069980 2023-10-06T03:25:35.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.111+0000 7f86ce7fc700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86bc066f30 0x7f86bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:35.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.111+0000 7f86ce7fc700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86bc066f30 0x7f86bc0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f86c40037c0 tx=0x7f86c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:35.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.115+0000 7f86b6ffd700 1 -- 172.21.15.84:0/272620580 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86c0052bb0 con 0x7f86d0069980 2023-10-06T03:25:35.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.297+0000 7f86cffff700 1 -- 172.21.15.84:0/272620580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f86d00cdff0 con 0x7f86d0069980 2023-10-06T03:25:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.940+0000 7f86b6ffd700 1 -- 172.21.15.84:0/272620580 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) v1 ==== 181+0+0 (secure 0 0 0) 0x7f86c00561d0 con 0x7f86d0069980 2023-10-06T03:25:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 -- 172.21.15.84:0/272620580 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86bc066f30 msgr2=0x7f86bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86bc066f30 0x7f86bc0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f86c40037c0 tx=0x7f86c4009040 comp rx=0 tx=0).stop 2023-10-06T03:25:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 -- 172.21.15.84:0/272620580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 msgr2=0x7f86d015b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 0x7f86d015b4e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f86c0006f50 tx=0x7f86c0017000 comp rx=0 tx=0).stop 2023-10-06T03:25:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 -- 172.21.15.84:0/272620580 shutdown_connections 2023-10-06T03:25:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f86bc066f30 0x7f86bc0693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d00cb2d0 0x7f86d00cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d0069980 0x7f86d015b4e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 --2- 172.21.15.84:0/272620580 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86d0069d50 0x7f86d00cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 -- 172.21.15.84:0/272620580 >> 172.21.15.84:0/272620580 conn(0x7f86d0068a70 msgr2=0x7f86d00caa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 -- 172.21.15.84:0/272620580 shutdown_connections 2023-10-06T03:25:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:35.943+0000 7f86cffff700 1 -- 172.21.15.84:0/272620580 wait complete. 2023-10-06T03:25:35.946 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:25:35.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:25:36.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.076+0000 7fcc86c25700 1 Processor -- start 2023-10-06T03:25:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.076+0000 7fcc86c25700 1 -- start start 2023-10-06T03:25:36.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.077+0000 7fcc86c25700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcc801539d0 0x7fcc8015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.077+0000 7fcc86c25700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 0x7fcc800d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.077+0000 7fcc86c25700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800d0c90 con 0x7fcc800d0830 2023-10-06T03:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.077+0000 7fcc86c25700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800cdc30 con 0x7fcc801539d0 2023-10-06T03:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.077+0000 7fcc86c25700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800cb500 con 0x7fcc800ccab0 2023-10-06T03:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.077+0000 7fcc85c23700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcc801539d0 0x7fcc8015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.077+0000 7fcc85422700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 0x7fcc800d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.077+0000 7fcc85422700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 0x7fcc800d02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:48088/0 (socket says 172.21.15.84:48088) 2023-10-06T03:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.077+0000 7fcc85422700 1 -- 172.21.15.84:0/2340253535 learned_addr learned my addr 172.21.15.84:0/2340253535 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.077+0000 7fcc85c23700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcc801539d0 0x7fcc8015a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:59880/0 (socket says 172.21.15.84:59880) 2023-10-06T03:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.078+0000 7fcc85422700 1 -- 172.21.15.84:0/2340253535 >> v2:172.21.15.131:3300/0 conn(0x7fcc801539d0 msgr2=0x7fcc8015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.078+0000 7fcc85422700 1 --2- 172.21.15.84:0/2340253535 >> v2:172.21.15.131:3300/0 conn(0x7fcc801539d0 0x7fcc8015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.078+0000 7fcc85422700 1 -- 172.21.15.84:0/2340253535 >> v1:172.21.15.131:6789/0 conn(0x7fcc800d0830 legacy=0x7fcc8015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.078+0000 7fcc85422700 1 -- 172.21.15.84:0/2340253535 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8015a8f0 con 0x7fcc800ccab0 2023-10-06T03:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.078+0000 7fcc85422700 1 --2- 172.21.15.84:0/2340253535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 0x7fcc800d02f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc700099b0 tx=0x7fcc70009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fec2af3943fa8ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.078+0000 7fcc84c21700 1 -- 172.21.15.84:0/2340253535 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70009ea0 con 0x7fcc800ccab0 2023-10-06T03:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.078+0000 7fcc84c21700 1 -- 172.21.15.84:0/2340253535 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7000b860 con 0x7fcc800ccab0 2023-10-06T03:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.078+0000 7fcc84c21700 1 -- 172.21.15.84:0/2340253535 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000bc00 con 0x7fcc800ccab0 2023-10-06T03:25:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.078+0000 7fcc86c25700 1 -- 172.21.15.84:0/2340253535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 msgr2=0x7fcc800d02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.078+0000 7fcc86c25700 1 --2- 172.21.15.84:0/2340253535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 0x7fcc800d02f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc700099b0 tx=0x7fcc70009250 comp rx=0 tx=0).stop 2023-10-06T03:25:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.079+0000 7fcc86c25700 1 -- 172.21.15.84:0/2340253535 shutdown_connections 2023-10-06T03:25:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.079+0000 7fcc86c25700 1 --2- 172.21.15.84:0/2340253535 >> v2:172.21.15.131:3300/0 conn(0x7fcc801539d0 0x7fcc8015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.079+0000 7fcc86c25700 1 --2- 172.21.15.84:0/2340253535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 0x7fcc800d02f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.079+0000 7fcc86c25700 1 -- 172.21.15.84:0/2340253535 >> 172.21.15.84:0/2340253535 conn(0x7fcc80068100 msgr2=0x7fcc800684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.079+0000 7fcc86c25700 1 -- 172.21.15.84:0/2340253535 shutdown_connections 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.079+0000 7fcc86c25700 1 -- 172.21.15.84:0/2340253535 wait complete. 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.080+0000 7fcc86c25700 1 Processor -- start 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.080+0000 7fcc86c25700 1 -- start start 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.080+0000 7fcc86c25700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 0x7fcc80153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.080+0000 7fcc86c25700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc800d0830 0x7fcc80151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.080+0000 7fcc86c25700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc801539d0 0x7fcc800c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.080+0000 7fcc86c25700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800b4f80 con 0x7fcc801539d0 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.080+0000 7fcc86c25700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800b4650 con 0x7fcc800d0830 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.080+0000 7fcc86c25700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800b4930 con 0x7fcc800ccab0 2023-10-06T03:25:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc86424700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc801539d0 0x7fcc800c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc86424700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc801539d0 0x7fcc800c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44776/0 (socket says 172.21.15.84:44776) 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc86424700 1 -- 172.21.15.84:0/139424309 learned_addr learned my addr 172.21.15.84:0/139424309 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc85422700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc800d0830 0x7fcc80151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc85c23700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 0x7fcc80153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc86424700 1 -- 172.21.15.84:0/139424309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 msgr2=0x7fcc80153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc86424700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 0x7fcc80153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc86424700 1 -- 172.21.15.84:0/139424309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc800d0830 msgr2=0x7fcc80151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc86424700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc800d0830 0x7fcc80151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc86424700 1 -- 172.21.15.84:0/139424309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc700094f0 con 0x7fcc801539d0 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc86424700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc801539d0 0x7fcc800c9e10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800c840 tx=0x7fcc78001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc75ffb700 1 -- 172.21.15.84:0/139424309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78012630 con 0x7fcc801539d0 2023-10-06T03:25:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc75ffb700 1 -- 172.21.15.84:0/139424309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc780127b0 con 0x7fcc801539d0 2023-10-06T03:25:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc86c25700 1 -- 172.21.15.84:0/139424309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc800b4c10 con 0x7fcc801539d0 2023-10-06T03:25:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.081+0000 7fcc75ffb700 1 -- 172.21.15.84:0/139424309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78012b70 con 0x7fcc801539d0 2023-10-06T03:25:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.082+0000 7fcc86c25700 1 -- 172.21.15.84:0/139424309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc800ca350 con 0x7fcc801539d0 2023-10-06T03:25:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.082+0000 7fcc86c25700 1 -- 172.21.15.84:0/139424309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc800b50f0 con 0x7fcc801539d0 2023-10-06T03:25:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.083+0000 7fcc75ffb700 1 -- 172.21.15.84:0/139424309 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc7801a3a0 con 0x7fcc801539d0 2023-10-06T03:25:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.083+0000 7fcc75ffb700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc64066f30 0x7fcc640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.083+0000 7fcc75ffb700 1 -- 172.21.15.84:0/139424309 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6026+0+0 (secure 0 0 0) 0x7fcc780845e0 con 0x7fcc801539d0 2023-10-06T03:25:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.083+0000 7fcc85c23700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc64066f30 0x7fcc640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.083+0000 7fcc85c23700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc64066f30 0x7fcc640693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009d10 tx=0x7fcc7c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.087+0000 7fcc75ffb700 1 -- 172.21.15.84:0/139424309 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc78051710 con 0x7fcc801539d0 2023-10-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.268+0000 7fcc86c25700 1 -- 172.21.15.84:0/139424309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc800d0c90 con 0x7fcc801539d0 2023-10-06T03:25:36.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.947+0000 7fcc75ffb700 1 -- 172.21.15.84:0/139424309 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcc800d0c90 con 0x7fcc801539d0 2023-10-06T03:25:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 -- 172.21.15.84:0/139424309 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc64066f30 msgr2=0x7fcc640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc64066f30 0x7fcc640693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009d10 tx=0x7fcc7c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 -- 172.21.15.84:0/139424309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc801539d0 msgr2=0x7fcc800c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc801539d0 0x7fcc800c9e10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800c840 tx=0x7fcc78001670 comp rx=0 tx=0).stop 2023-10-06T03:25:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 -- 172.21.15.84:0/139424309 shutdown_connections 2023-10-06T03:25:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcc64066f30 0x7fcc640693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc801539d0 0x7fcc800c9e10 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc800ccab0 0x7fcc80153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 --2- 172.21.15.84:0/139424309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc800d0830 0x7fcc80151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 -- 172.21.15.84:0/139424309 >> 172.21.15.84:0/139424309 conn(0x7fcc80068100 msgr2=0x7fcc80157600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 -- 172.21.15.84:0/139424309 shutdown_connections 2023-10-06T03:25:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:36.951+0000 7fcc86c25700 1 -- 172.21.15.84:0/139424309 wait complete. 2023-10-06T03:25:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T03:25:36.967 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:25:37.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.091+0000 7f2342e99700 1 Processor -- start 2023-10-06T03:25:37.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.091+0000 7f2342e99700 1 -- start start 2023-10-06T03:25:37.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.092+0000 7f2342e99700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c0c76b0 0x7f233c0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.092+0000 7f2342e99700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f233c0684b0 0x7f233c068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.092+0000 7f2342e99700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c069d50 con 0x7f233c1595f0 2023-10-06T03:25:37.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.092+0000 7f2342e99700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c067930 con 0x7f233c0684b0 2023-10-06T03:25:37.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.092+0000 7f2342e99700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c06a8d0 con 0x7f233c0c76b0 2023-10-06T03:25:37.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f2341436700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f233c0684b0 0x7f233c068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f233bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c0c76b0 0x7f233c0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f2341436700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f233c0684b0 0x7f233c068920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:59886/0 (socket says 172.21.15.84:59886) 2023-10-06T03:25:37.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f233bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c0c76b0 0x7f233c0af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:48108/0 (socket says 172.21.15.84:48108) 2023-10-06T03:25:37.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f2341436700 1 -- 172.21.15.84:0/1087080083 learned_addr learned my addr 172.21.15.84:0/1087080083 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:37.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f2341436700 1 -- 172.21.15.84:0/1087080083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c0c76b0 msgr2=0x7f233c0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:37.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f2341436700 1 --2- 172.21.15.84:0/1087080083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c0c76b0 0x7f233c0af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f2341436700 1 -- 172.21.15.84:0/1087080083 >> v1:172.21.15.131:6789/0 conn(0x7f233c1595f0 legacy=0x7f233c0c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f2341436700 1 -- 172.21.15.84:0/1087080083 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c068e60 con 0x7f233c0684b0 2023-10-06T03:25:37.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f233bfff700 1 --2- 172.21.15.84:0/1087080083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c0c76b0 0x7f233c0af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f2341436700 1 --2- 172.21.15.84:0/1087080083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f233c0684b0 0x7f233c068920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f232c0099b0 tx=0x7f232c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63c86a0be634386b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f233b7fe700 1 -- 172.21.15.84:0/1087080083 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c009ea0 con 0x7f233c0684b0 2023-10-06T03:25:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f233b7fe700 1 -- 172.21.15.84:0/1087080083 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c00b860 con 0x7f233c0684b0 2023-10-06T03:25:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.093+0000 7f233b7fe700 1 -- 172.21.15.84:0/1087080083 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c00bc00 con 0x7f233c0684b0 2023-10-06T03:25:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.094+0000 7f2342e99700 1 -- 172.21.15.84:0/1087080083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f233c0684b0 msgr2=0x7f233c068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.094+0000 7f2342e99700 1 --2- 172.21.15.84:0/1087080083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f233c0684b0 0x7f233c068920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f232c0099b0 tx=0x7f232c009250 comp rx=0 tx=0).stop 2023-10-06T03:25:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.094+0000 7f2342e99700 1 -- 172.21.15.84:0/1087080083 shutdown_connections 2023-10-06T03:25:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.094+0000 7f2342e99700 1 --2- 172.21.15.84:0/1087080083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f233c0684b0 0x7f233c068920 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.094+0000 7f2342e99700 1 --2- 172.21.15.84:0/1087080083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c0c76b0 0x7f233c0af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.094+0000 7f2342e99700 1 -- 172.21.15.84:0/1087080083 >> 172.21.15.84:0/1087080083 conn(0x7f233c0cd430 msgr2=0x7f233c0c93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:37.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.094+0000 7f2342e99700 1 -- 172.21.15.84:0/1087080083 shutdown_connections 2023-10-06T03:25:37.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.094+0000 7f2342e99700 1 -- 172.21.15.84:0/1087080083 wait complete. 2023-10-06T03:25:37.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.095+0000 7f2342e99700 1 Processor -- start 2023-10-06T03:25:37.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.095+0000 7f2342e99700 1 -- start start 2023-10-06T03:25:37.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f2342e99700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f233c0684b0 0x7f233c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f2342e99700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f233c0c76b0 0x7f233c0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f2342e99700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c1595f0 0x7f233c169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f2342e99700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0c6130 con 0x7f233c0c76b0 2023-10-06T03:25:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f2342e99700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0c63b0 con 0x7f233c0684b0 2023-10-06T03:25:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f2342e99700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c151940 con 0x7f233c1595f0 2023-10-06T03:25:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f233bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f233c0c76b0 0x7f233c0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f233bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f233c0c76b0 0x7f233c0c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44784/0 (socket says 172.21.15.84:44784) 2023-10-06T03:25:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f233bfff700 1 -- 172.21.15.84:0/3840868893 learned_addr learned my addr 172.21.15.84:0/3840868893 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f2340c35700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f233c0684b0 0x7f233c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.096+0000 7f2341436700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c1595f0 0x7f233c169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f233bfff700 1 -- 172.21.15.84:0/3840868893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c1595f0 msgr2=0x7f233c169cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f233bfff700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c1595f0 0x7f233c169cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f233bfff700 1 -- 172.21.15.84:0/3840868893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f233c0684b0 msgr2=0x7f233c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f233bfff700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f233c0684b0 0x7f233c1548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f233bfff700 1 -- 172.21.15.84:0/3840868893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330009420 con 0x7f233c0c76b0 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f233bfff700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f233c0c76b0 0x7f233c0c5bf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f233000ec80 tx=0x7f23300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f2338ff9700 1 -- 172.21.15.84:0/3840868893 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233000c850 con 0x7f233c0c76b0 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f2338ff9700 1 -- 172.21.15.84:0/3840868893 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233000c9b0 con 0x7f233c0c76b0 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f2342e99700 1 -- 172.21.15.84:0/3840868893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c0094f0 con 0x7f233c0c76b0 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f2338ff9700 1 -- 172.21.15.84:0/3840868893 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233000cd70 con 0x7f233c0c76b0 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.097+0000 7f2342e99700 1 -- 172.21.15.84:0/3840868893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c151f00 con 0x7f233c0c76b0 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.098+0000 7f2342e99700 1 -- 172.21.15.84:0/3840868893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c064ad0 con 0x7f233c0c76b0 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.098+0000 7f2338ff9700 1 -- 172.21.15.84:0/3840868893 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2330013680 con 0x7f233c0c76b0 2023-10-06T03:25:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.098+0000 7f2338ff9700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2328066f30 0x7f23280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.099+0000 7f2338ff9700 1 -- 172.21.15.84:0/3840868893 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f2330084b30 con 0x7f233c0c76b0 2023-10-06T03:25:37.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.099+0000 7f2340c35700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2328066f30 0x7f23280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.099+0000 7f2340c35700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2328066f30 0x7f23280693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2334007fd0 tx=0x7f23340016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:37.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.103+0000 7f2338ff9700 1 -- 172.21.15.84:0/3840868893 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2330051e00 con 0x7f233c0c76b0 2023-10-06T03:25:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.286+0000 7f2342e99700 1 -- 172.21.15.84:0/3840868893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f233c069fa0 con 0x7f233c0c76b0 2023-10-06T03:25:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.290+0000 7f2338ff9700 1 -- 172.21.15.84:0/3840868893 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2330055420 con 0x7f233c0c76b0 2023-10-06T03:25:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 -- 172.21.15.84:0/3840868893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2328066f30 msgr2=0x7f23280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2328066f30 0x7f23280693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2334007fd0 tx=0x7f23340016f0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 -- 172.21.15.84:0/3840868893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f233c0c76b0 msgr2=0x7f233c0c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f233c0c76b0 0x7f233c0c5bf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f233000ec80 tx=0x7f23300091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 -- 172.21.15.84:0/3840868893 shutdown_connections 2023-10-06T03:25:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2328066f30 0x7f23280693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f233c0684b0 0x7f233c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f233c1595f0 0x7f233c169cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 --2- 172.21.15.84:0/3840868893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f233c0c76b0 0x7f233c0c5bf0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 -- 172.21.15.84:0/3840868893 >> 172.21.15.84:0/3840868893 conn(0x7f233c0cd430 msgr2=0x7f233c0affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 -- 172.21.15.84:0/3840868893 shutdown_connections 2023-10-06T03:25:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.292+0000 7f2342e99700 1 -- 172.21.15.84:0/3840868893 wait complete. 2023-10-06T03:25:37.305 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2023-10-06T03:25:37.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.419+0000 7ff4214dc700 1 Processor -- start 2023-10-06T03:25:37.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.419+0000 7ff4214dc700 1 -- start start 2023-10-06T03:25:37.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.419+0000 7ff4214dc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c1595a0 0x7ff41c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.419+0000 7ff4214dc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff41c0b49e0 0x7ff41c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.419+0000 7ff4214dc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c0b0ca0 con 0x7ff41c0b07a0 2023-10-06T03:25:37.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.419+0000 7ff4214dc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c0b0f80 con 0x7ff41c0b49e0 2023-10-06T03:25:37.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.419+0000 7ff4214dc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0b1260 con 0x7ff41c1595a0 2023-10-06T03:25:37.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41a7fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff41c0b49e0 0x7ff41c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41affd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c1595a0 0x7ff41c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41a7fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff41c0b49e0 0x7ff41c0aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:59906/0 (socket says 172.21.15.84:59906) 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41affd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c1595a0 0x7ff41c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:48122/0 (socket says 172.21.15.84:48122) 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41a7fc700 1 -- 172.21.15.84:0/2483881395 learned_addr learned my addr 172.21.15.84:0/2483881395 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41b7fe700 1 --1- 172.21.15.84:0/2483881395 >> v1:172.21.15.131:6789/0 conn(0x7ff41c0b07a0 0x7ff41c0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:39074/0 (socket says 172.21.15.84:39074) 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41affd700 1 -- 172.21.15.84:0/2483881395 >> v2:172.21.15.131:3300/0 conn(0x7ff41c0b49e0 msgr2=0x7ff41c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41affd700 1 --2- 172.21.15.84:0/2483881395 >> v2:172.21.15.131:3300/0 conn(0x7ff41c0b49e0 0x7ff41c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41affd700 1 -- 172.21.15.84:0/2483881395 >> v1:172.21.15.131:6789/0 conn(0x7ff41c0b07a0 legacy=0x7ff41c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41affd700 1 -- 172.21.15.84:0/2483881395 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0b1540 con 0x7ff41c1595a0 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41a7fc700 1 --2- 172.21.15.84:0/2483881395 >> v2:172.21.15.131:3300/0 conn(0x7ff41c0b49e0 0x7ff41c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.420+0000 7ff41affd700 1 --2- 172.21.15.84:0/2483881395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c1595a0 0x7ff41c0aa570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0098d0 tx=0x7ff40c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c6d2238f0106478 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:37.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff419ffb700 1 -- 172.21.15.84:0/2483881395 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c005c10 con 0x7ff41c1595a0 2023-10-06T03:25:37.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff419ffb700 1 -- 172.21.15.84:0/2483881395 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c005d70 con 0x7ff41c1595a0 2023-10-06T03:25:37.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff419ffb700 1 -- 172.21.15.84:0/2483881395 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c006280 con 0x7ff41c1595a0 2023-10-06T03:25:37.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff4214dc700 1 -- 172.21.15.84:0/2483881395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c1595a0 msgr2=0x7ff41c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff4214dc700 1 --2- 172.21.15.84:0/2483881395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c1595a0 0x7ff41c0aa570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0098d0 tx=0x7ff40c009120 comp rx=0 tx=0).stop 2023-10-06T03:25:37.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff4214dc700 1 -- 172.21.15.84:0/2483881395 shutdown_connections 2023-10-06T03:25:37.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff4214dc700 1 --2- 172.21.15.84:0/2483881395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c1595a0 0x7ff41c0aa570 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff4214dc700 1 --2- 172.21.15.84:0/2483881395 >> v2:172.21.15.131:3300/0 conn(0x7ff41c0b49e0 0x7ff41c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff4214dc700 1 -- 172.21.15.84:0/2483881395 >> 172.21.15.84:0/2483881395 conn(0x7ff41c099830 msgr2=0x7ff41c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:37.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff4214dc700 1 -- 172.21.15.84:0/2483881395 shutdown_connections 2023-10-06T03:25:37.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.421+0000 7ff4214dc700 1 -- 172.21.15.84:0/2483881395 wait complete. 2023-10-06T03:25:37.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.422+0000 7ff4214dc700 1 Processor -- start 2023-10-06T03:25:37.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.423+0000 7ff4214dc700 1 -- start start 2023-10-06T03:25:37.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.423+0000 7ff4214dc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff41c0b07a0 0x7ff41c0c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.423+0000 7ff4214dc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c0b49e0 0x7ff41c157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.423+0000 7ff4214dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c1595a0 0x7ff41c169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.423+0000 7ff4214dc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c158020 con 0x7ff41c1595a0 2023-10-06T03:25:37.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.423+0000 7ff4214dc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c16d2c0 con 0x7ff41c0b07a0 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.423+0000 7ff4214dc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c16cf70 con 0x7ff41c0b49e0 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.423+0000 7ff41b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c1595a0 0x7ff41c169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.423+0000 7ff41b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c1595a0 0x7ff41c169970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44800/0 (socket says 172.21.15.84:44800) 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.423+0000 7ff41b7fe700 1 -- 172.21.15.84:0/396745642 learned_addr learned my addr 172.21.15.84:0/396745642 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff41a7fc700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c0b49e0 0x7ff41c157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff41affd700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff41c0b07a0 0x7ff41c0c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff41b7fe700 1 -- 172.21.15.84:0/396745642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c0b49e0 msgr2=0x7ff41c157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff41b7fe700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c0b49e0 0x7ff41c157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff41b7fe700 1 -- 172.21.15.84:0/396745642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff41c0b07a0 msgr2=0x7ff41c0c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff41b7fe700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff41c0b07a0 0x7ff41c0c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff41b7fe700 1 -- 172.21.15.84:0/396745642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100094f0 con 0x7ff41c1595a0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff41b7fe700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c1595a0 0x7ff41c169970 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff41400cd00 tx=0x7ff414001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff402ffd700 1 -- 172.21.15.84:0/396745642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400ce60 con 0x7ff41c1595a0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff402ffd700 1 -- 172.21.15.84:0/396745642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff414005df0 con 0x7ff41c1595a0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff4214dc700 1 -- 172.21.15.84:0/396745642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c0093c0 con 0x7ff41c1595a0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff402ffd700 1 -- 172.21.15.84:0/396745642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400ab00 con 0x7ff41c1595a0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.424+0000 7ff4214dc700 1 -- 172.21.15.84:0/396745642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c16a4a0 con 0x7ff41c1595a0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.425+0000 7ff4214dc700 1 -- 172.21.15.84:0/396745642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c064ad0 con 0x7ff41c1595a0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.425+0000 7ff402ffd700 1 -- 172.21.15.84:0/396745642 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4140070f0 con 0x7ff41c1595a0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.426+0000 7ff402ffd700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff408066f30 0x7ff4080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.426+0000 7ff402ffd700 1 -- 172.21.15.84:0/396745642 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ff4140844c0 con 0x7ff41c1595a0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.426+0000 7ff41affd700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff408066f30 0x7ff4080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.426+0000 7ff41affd700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff408066f30 0x7ff4080693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0d1150 tx=0x7ff40c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:37.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.430+0000 7ff402ffd700 1 -- 172.21.15.84:0/396745642 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff414051810 con 0x7ff41c1595a0 2023-10-06T03:25:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.684+0000 7ff4214dc700 1 -- 172.21.15.84:0/396745642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) v1 -- 0x7ff41c0b1820 con 0x7ff41c1595a0 2023-10-06T03:25:37.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.948+0000 7ff402ffd700 1 -- 172.21.15.84:0/396745642 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v120) v1 ==== 153+0+0 (secure 0 0 0) 0x7ff414082e60 con 0x7ff41c1595a0 2023-10-06T03:25:37.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 -- 172.21.15.84:0/396745642 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff408066f30 msgr2=0x7ff4080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff408066f30 0x7ff4080693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0d1150 tx=0x7ff40c016000 comp rx=0 tx=0).stop 2023-10-06T03:25:37.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 -- 172.21.15.84:0/396745642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c1595a0 msgr2=0x7ff41c169970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:37.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c1595a0 0x7ff41c169970 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff41400cd00 tx=0x7ff414001b10 comp rx=0 tx=0).stop 2023-10-06T03:25:37.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 -- 172.21.15.84:0/396745642 shutdown_connections 2023-10-06T03:25:37.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff408066f30 0x7ff4080693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff41c0b07a0 0x7ff41c0c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c1595a0 0x7ff41c169970 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 --2- 172.21.15.84:0/396745642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff41c0b49e0 0x7ff41c157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:37.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 -- 172.21.15.84:0/396745642 >> 172.21.15.84:0/396745642 conn(0x7ff41c099830 msgr2=0x7ff41c0cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:37.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 -- 172.21.15.84:0/396745642 shutdown_connections 2023-10-06T03:25:37.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:37.950+0000 7ff4214dc700 1 -- 172.21.15.84:0/396745642 wait complete. 2023-10-06T03:25:37.963 INFO:tasks.cephfs_test_runner:Check that mds evicts blocklisted client ... skipped 'Requires FUSE client to use mds_cluster.is_addr_blocklisted()' 2023-10-06T03:25:37.963 INFO:tasks.cephfs_test_runner:Starting test: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T03:25:37.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2023-10-06T03:25:38.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.077+0000 7f7ae140a700 1 Processor -- start 2023-10-06T03:25:38.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.077+0000 7f7ae140a700 1 -- start start 2023-10-06T03:25:38.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.078+0000 7f7ae140a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7adc0cd370 0x7f7adc0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:38.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.078+0000 7f7ae140a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc0cc840 con 0x7f7adc0c6260 2023-10-06T03:25:38.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.078+0000 7f7ae140a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc0cbc70 con 0x7f7adc1594b0 2023-10-06T03:25:38.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.078+0000 7f7ae140a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc0cbf10 con 0x7f7adc0cd370 2023-10-06T03:25:38.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.078+0000 7f7adb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7adc0cd370 0x7f7adc0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:38.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.078+0000 7f7ae0c09700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7adc0c6260 0x7f7adc0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52614/0 (socket says 172.21.15.84:52614) 2023-10-06T03:25:38.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.078+0000 7f7ae0c09700 1 -- 172.21.15.84:0/3940124961 learned_addr learned my addr 172.21.15.84:0/3940124961 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:38.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7adb7fe700 1 -- 172.21.15.84:0/3940124961 >> v1:172.21.15.131:6789/0 conn(0x7f7adc1594b0 legacy=0x7f7adc0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:38.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7adb7fe700 1 -- 172.21.15.84:0/3940124961 >> v1:172.21.15.84:6789/0 conn(0x7f7adc0c6260 legacy=0x7f7adc0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:38.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7adb7fe700 1 -- 172.21.15.84:0/3940124961 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc0cc1f0 con 0x7f7adc0cd370 2023-10-06T03:25:38.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7adaffd700 1 -- 172.21.15.84:0/3940124961 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438478577 0 0) 0x7f7adc0cc840 con 0x7f7adc0c6260 2023-10-06T03:25:38.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7adb7fe700 1 --2- 172.21.15.84:0/3940124961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0cd370 0x7f7adc0ce9c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00098d0 tx=0x7f7ad0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09b3b83bc56a36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:38.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7adaffd700 1 -- 172.21.15.84:0/3940124961 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0009e70 con 0x7f7adc0cd370 2023-10-06T03:25:38.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7adaffd700 1 -- 172.21.15.84:0/3940124961 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0005c10 con 0x7f7adc0cd370 2023-10-06T03:25:38.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7adaffd700 1 -- 172.21.15.84:0/3940124961 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad000b610 con 0x7f7adc0cd370 2023-10-06T03:25:38.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7ae140a700 1 -- 172.21.15.84:0/3940124961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0cd370 msgr2=0x7f7adc0ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:38.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7ae140a700 1 --2- 172.21.15.84:0/3940124961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0cd370 0x7f7adc0ce9c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00098d0 tx=0x7f7ad0009120 comp rx=0 tx=0).stop 2023-10-06T03:25:38.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7ae140a700 1 -- 172.21.15.84:0/3940124961 shutdown_connections 2023-10-06T03:25:38.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7ae140a700 1 --2- 172.21.15.84:0/3940124961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0cd370 0x7f7adc0ce9c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:38.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7ae140a700 1 -- 172.21.15.84:0/3940124961 >> 172.21.15.84:0/3940124961 conn(0x7f7adc099600 msgr2=0x7f7adc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:38.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7ae140a700 1 -- 172.21.15.84:0/3940124961 shutdown_connections 2023-10-06T03:25:38.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.079+0000 7f7ae140a700 1 -- 172.21.15.84:0/3940124961 wait complete. 2023-10-06T03:25:38.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.080+0000 7f7ae140a700 1 Processor -- start 2023-10-06T03:25:38.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.081+0000 7f7ae140a700 1 -- start start 2023-10-06T03:25:38.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.081+0000 7f7ae140a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0c6260 0x7f7adc16a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:38.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.081+0000 7f7ae140a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7adc0cd370 0x7f7adc0b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:38.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.081+0000 7f7ae140a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7adc1594b0 0x7f7adc0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:38.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.081+0000 7f7ae140a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0c9820 con 0x7f7adc0c6260 2023-10-06T03:25:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.081+0000 7f7ae140a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc16a9b0 con 0x7f7adc0cd370 2023-10-06T03:25:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.081+0000 7f7ae140a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0c8c10 con 0x7f7adc1594b0 2023-10-06T03:25:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.081+0000 7f7adbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0c6260 0x7f7adc16a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.081+0000 7f7adbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0c6260 0x7f7adc16a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44824/0 (socket says 172.21.15.84:44824) 2023-10-06T03:25:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.081+0000 7f7adbfff700 1 -- 172.21.15.84:0/2815389507 learned_addr learned my addr 172.21.15.84:0/2815389507 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7adbfff700 1 -- 172.21.15.84:0/2815389507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7adc1594b0 msgr2=0x7f7adc0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7adbfff700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7adc1594b0 0x7f7adc0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7adbfff700 1 -- 172.21.15.84:0/2815389507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7adc0cd370 msgr2=0x7f7adc0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7adb7fe700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7adc0cd370 0x7f7adc0b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7adbfff700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7adc0cd370 0x7f7adc0b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7adbfff700 1 -- 172.21.15.84:0/2815389507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00093c0 con 0x7f7adc0c6260 2023-10-06T03:25:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7adbfff700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0c6260 0x7f7adc16a470 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00b5e0 tx=0x7f7acc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7ac3fff700 1 -- 172.21.15.84:0/2815389507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00f510 con 0x7f7adc0c6260 2023-10-06T03:25:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7ac3fff700 1 -- 172.21.15.84:0/2815389507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc00f690 con 0x7f7adc0c6260 2023-10-06T03:25:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7ae140a700 1 -- 172.21.15.84:0/2815389507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc0c8ef0 con 0x7f7adc0c6260 2023-10-06T03:25:38.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7ac3fff700 1 -- 172.21.15.84:0/2815389507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00fa50 con 0x7f7adc0c6260 2023-10-06T03:25:38.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.082+0000 7f7ae140a700 1 -- 172.21.15.84:0/2815389507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc0c94b0 con 0x7f7adc0c6260 2023-10-06T03:25:38.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.083+0000 7f7ae140a700 1 -- 172.21.15.84:0/2815389507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc0ca750 con 0x7f7adc0c6260 2023-10-06T03:25:38.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.083+0000 7f7ac3fff700 1 -- 172.21.15.84:0/2815389507 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7acc01a400 con 0x7f7adc0c6260 2023-10-06T03:25:38.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.084+0000 7f7ac3fff700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ac8066f30 0x7f7ac80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:38.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.084+0000 7f7ac3fff700 1 -- 172.21.15.84:0/2815389507 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f7acc084040 con 0x7f7adc0c6260 2023-10-06T03:25:38.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.084+0000 7f7adb7fe700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ac8066f30 0x7f7ac80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:38.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.084+0000 7f7adb7fe700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ac8066f30 0x7f7ac80693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009390 tx=0x7f7ad0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:38.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.088+0000 7f7ac3fff700 1 -- 172.21.15.84:0/2815389507 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7acc051310 con 0x7f7adc0c6260 2023-10-06T03:25:38.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.344+0000 7f7ae140a700 1 -- 172.21.15.84:0/2815389507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) v1 -- 0x7f7adc05f270 con 0x7f7adc0c6260 2023-10-06T03:25:38.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.950+0000 7f7ac3fff700 1 -- 172.21.15.84:0/2815389507 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v121) v1 ==== 145+0+0 (secure 0 0 0) 0x7f7acc054930 con 0x7f7adc0c6260 2023-10-06T03:25:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 -- 172.21.15.84:0/2815389507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ac8066f30 msgr2=0x7f7ac80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ac8066f30 0x7f7ac80693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009390 tx=0x7f7ad0015000 comp rx=0 tx=0).stop 2023-10-06T03:25:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 -- 172.21.15.84:0/2815389507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0c6260 msgr2=0x7f7adc16a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0c6260 0x7f7adc16a470 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00b5e0 tx=0x7f7acc0090f0 comp rx=0 tx=0).stop 2023-10-06T03:25:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 -- 172.21.15.84:0/2815389507 shutdown_connections 2023-10-06T03:25:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ac8066f30 0x7f7ac80693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7adc1594b0 0x7f7adc0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7adc0c6260 0x7f7adc16a470 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 --2- 172.21.15.84:0/2815389507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7adc0cd370 0x7f7adc0b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 -- 172.21.15.84:0/2815389507 >> 172.21.15.84:0/2815389507 conn(0x7f7adc099600 msgr2=0x7f7adc158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 -- 172.21.15.84:0/2815389507 shutdown_connections 2023-10-06T03:25:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:38.952+0000 7f7ae140a700 1 -- 172.21.15.84:0/2815389507 wait complete. 2023-10-06T03:25:38.965 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:25:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.081+0000 7f9b686d3700 1 Processor -- start 2023-10-06T03:25:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.081+0000 7f9b686d3700 1 -- start start 2023-10-06T03:25:39.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.082+0000 7f9b686d3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b60159570 0x7f9b60069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.082+0000 7f9b686d3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9b6006a330 0x7f9b60155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.082+0000 7f9b686d3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6006a770 con 0x7f9b601558e0 2023-10-06T03:25:39.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.082+0000 7f9b686d3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6006f080 con 0x7f9b60159570 2023-10-06T03:25:39.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.082+0000 7f9b686d3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b60159ae0 con 0x7f9b6006a330 2023-10-06T03:25:39.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.082+0000 7f9b65c6e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b60159570 0x7f9b60069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.082+0000 7f9b65c6e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b60159570 0x7f9b60069df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44830/0 (socket says 172.21.15.84:44830) 2023-10-06T03:25:39.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.082+0000 7f9b65c6e700 1 -- 172.21.15.84:0/2895723802 learned_addr learned my addr 172.21.15.84:0/2895723802 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:39.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.083+0000 7f9b66c70700 1 --2- 172.21.15.84:0/2895723802 >> v2:172.21.15.131:3300/0 conn(0x7f9b6006a330 0x7f9b60155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.083+0000 7f9b65c6e700 1 -- 172.21.15.84:0/2895723802 >> v2:172.21.15.131:3300/0 conn(0x7f9b6006a330 msgr2=0x7f9b60155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:39.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.083+0000 7f9b65c6e700 1 --2- 172.21.15.84:0/2895723802 >> v2:172.21.15.131:3300/0 conn(0x7f9b6006a330 0x7f9b60155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.083+0000 7f9b65c6e700 1 -- 172.21.15.84:0/2895723802 >> v1:172.21.15.131:6789/0 conn(0x7f9b601558e0 legacy=0x7f9b6006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.083+0000 7f9b65c6e700 1 -- 172.21.15.84:0/2895723802 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b60159dc0 con 0x7f9b60159570 2023-10-06T03:25:39.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.083+0000 7f9b65c6e700 1 --2- 172.21.15.84:0/2895723802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 0x7f9b60069df0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9b600cc090 tx=0x7f9b5000a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4df34b4c081462a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:39.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.083+0000 7f9b6546d700 1 -- 172.21.15.84:0/2895723802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000ca40 con 0x7f9b60159570 2023-10-06T03:25:39.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.083+0000 7f9b6546d700 1 -- 172.21.15.84:0/2895723802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5000cba0 con 0x7f9b60159570 2023-10-06T03:25:39.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.083+0000 7f9b6546d700 1 -- 172.21.15.84:0/2895723802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50018400 con 0x7f9b60159570 2023-10-06T03:25:39.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.084+0000 7f9b686d3700 1 -- 172.21.15.84:0/2895723802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 msgr2=0x7f9b60069df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.084+0000 7f9b686d3700 1 --2- 172.21.15.84:0/2895723802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 0x7f9b60069df0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9b600cc090 tx=0x7f9b5000a3f0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.084+0000 7f9b686d3700 1 -- 172.21.15.84:0/2895723802 shutdown_connections 2023-10-06T03:25:39.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.084+0000 7f9b686d3700 1 --2- 172.21.15.84:0/2895723802 >> v2:172.21.15.131:3300/0 conn(0x7f9b6006a330 0x7f9b60155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.084+0000 7f9b686d3700 1 --2- 172.21.15.84:0/2895723802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 0x7f9b60069df0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.084+0000 7f9b686d3700 1 -- 172.21.15.84:0/2895723802 >> 172.21.15.84:0/2895723802 conn(0x7f9b600cc0e0 msgr2=0x7f9b600cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:39.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.084+0000 7f9b686d3700 1 -- 172.21.15.84:0/2895723802 shutdown_connections 2023-10-06T03:25:39.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.084+0000 7f9b686d3700 1 -- 172.21.15.84:0/2895723802 wait complete. 2023-10-06T03:25:39.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.085+0000 7f9b686d3700 1 Processor -- start 2023-10-06T03:25:39.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.085+0000 7f9b686d3700 1 -- start start 2023-10-06T03:25:39.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b686d3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b6006a330 0x7f9b60152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b686d3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b601558e0 0x7f9b60150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b686d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 0x7f9b60148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b686d3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b60151380 con 0x7f9b60159570 2023-10-06T03:25:39.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b686d3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b60151650 con 0x7f9b601558e0 2023-10-06T03:25:39.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b686d3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b60151930 con 0x7f9b6006a330 2023-10-06T03:25:39.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b66c70700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 0x7f9b60148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b66c70700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 0x7f9b60148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44842/0 (socket says 172.21.15.84:44842) 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b66c70700 1 -- 172.21.15.84:0/1972144117 learned_addr learned my addr 172.21.15.84:0/1972144117 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b65c6e700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b601558e0 0x7f9b60150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b6646f700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b6006a330 0x7f9b60152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b66c70700 1 -- 172.21.15.84:0/1972144117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b6006a330 msgr2=0x7f9b60152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b66c70700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b6006a330 0x7f9b60152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b66c70700 1 -- 172.21.15.84:0/1972144117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b601558e0 msgr2=0x7f9b60150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b66c70700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b601558e0 0x7f9b60150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b66c70700 1 -- 172.21.15.84:0/1972144117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5000a690 con 0x7f9b60159570 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b66c70700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 0x7f9b60148cb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009e90 tx=0x7f9b5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b567fc700 1 -- 172.21.15.84:0/1972144117 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800cc20 con 0x7f9b60159570 2023-10-06T03:25:39.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b567fc700 1 -- 172.21.15.84:0/1972144117 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5800f040 con 0x7f9b60159570 2023-10-06T03:25:39.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b686d3700 1 -- 172.21.15.84:0/1972144117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b60151c10 con 0x7f9b60159570 2023-10-06T03:25:39.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b567fc700 1 -- 172.21.15.84:0/1972144117 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58014480 con 0x7f9b60159570 2023-10-06T03:25:39.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.086+0000 7f9b686d3700 1 -- 172.21.15.84:0/1972144117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b601491f0 con 0x7f9b60159570 2023-10-06T03:25:39.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.087+0000 7f9b686d3700 1 -- 172.21.15.84:0/1972144117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b60064ad0 con 0x7f9b60159570 2023-10-06T03:25:39.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.088+0000 7f9b567fc700 1 -- 172.21.15.84:0/1972144117 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b58014830 con 0x7f9b60159570 2023-10-06T03:25:39.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.088+0000 7f9b567fc700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9b44066f30 0x7f9b440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.088+0000 7f9b567fc700 1 -- 172.21.15.84:0/1972144117 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f9b58084ea0 con 0x7f9b60159570 2023-10-06T03:25:39.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.088+0000 7f9b6646f700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9b44066f30 0x7f9b440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.088+0000 7f9b6646f700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9b44066f30 0x7f9b440693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0037c0 tx=0x7f9b5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:39.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.092+0000 7f9b567fc700 1 -- 172.21.15.84:0/1972144117 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b58055c00 con 0x7f9b60159570 2023-10-06T03:25:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.274+0000 7f9b686d3700 1 -- 172.21.15.84:0/1972144117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9b6015a0a0 con 0x7f9b60159570 2023-10-06T03:25:39.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.277+0000 7f9b567fc700 1 -- 172.21.15.84:0/1972144117 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9b58055790 con 0x7f9b60159570 2023-10-06T03:25:39.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.279+0000 7f9b686d3700 1 -- 172.21.15.84:0/1972144117 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9b44066f30 msgr2=0x7f9b440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.279+0000 7f9b686d3700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9b44066f30 0x7f9b440693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0037c0 tx=0x7f9b5c009040 comp rx=0 tx=0).stop 2023-10-06T03:25:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.279+0000 7f9b686d3700 1 -- 172.21.15.84:0/1972144117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 msgr2=0x7f9b60148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.279+0000 7f9b686d3700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 0x7f9b60148cb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009e90 tx=0x7f9b5800b040 comp rx=0 tx=0).stop 2023-10-06T03:25:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.279+0000 7f9b686d3700 1 -- 172.21.15.84:0/1972144117 shutdown_connections 2023-10-06T03:25:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.279+0000 7f9b686d3700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9b44066f30 0x7f9b440693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.280+0000 7f9b686d3700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b60159570 0x7f9b60148cb0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.280+0000 7f9b686d3700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b6006a330 0x7f9b60152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.280+0000 7f9b686d3700 1 --2- 172.21.15.84:0/1972144117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b601558e0 0x7f9b60150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.280+0000 7f9b686d3700 1 -- 172.21.15.84:0/1972144117 >> 172.21.15.84:0/1972144117 conn(0x7f9b600cc0e0 msgr2=0x7f9b60069560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.280+0000 7f9b686d3700 1 -- 172.21.15.84:0/1972144117 shutdown_connections 2023-10-06T03:25:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.280+0000 7f9b686d3700 1 -- 172.21.15.84:0/1972144117 wait complete. 2023-10-06T03:25:39.292 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:25:39.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:39.330 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:39.371 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:25:39.372 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:25:39.372 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:39.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.485+0000 7fc007fff700 1 Processor -- start 2023-10-06T03:25:39.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.485+0000 7fc007fff700 1 -- start start 2023-10-06T03:25:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fc007fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc008159950 0x7fc0080ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fc007fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080c6060 0x7fc0080ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fc007fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080ae250 con 0x7fc008159580 2023-10-06T03:25:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fc007fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080ad640 con 0x7fc008159950 2023-10-06T03:25:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fc007fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080ad920 con 0x7fc0080c6060 2023-10-06T03:25:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fc006ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc008159580 0x7fc0080ace60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52622/0 (socket says 172.21.15.84:52622) 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fc006ffd700 1 -- 172.21.15.84:0/3426527644 learned_addr learned my addr 172.21.15.84:0/3426527644 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fc0077fe700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080c6060 0x7fc0080ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fbffe7fc700 1 --2- 172.21.15.84:0/3426527644 >> v2:172.21.15.131:3300/0 conn(0x7fc008159950 0x7fc0080ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947261446 0 0) 0x7fc0080ae250 con 0x7fc008159580 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.486+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff4003570 con 0x7fc008159580 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1787600843 0 0) 0x7fbff4003570 con 0x7fc008159580 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080c6060 msgr2=0x7fc0080ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080c6060 0x7fc0080ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 >> v2:172.21.15.131:3300/0 conn(0x7fc008159950 msgr2=0x7fc0080ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 --2- 172.21.15.84:0/3426527644 >> v2:172.21.15.131:3300/0 conn(0x7fc008159950 0x7fc0080ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080adc00 con 0x7fc008159580 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fbff8001470 con 0x7fc008159580 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 >> v1:172.21.15.84:6789/0 conn(0x7fc008159580 legacy=0x7fc0080ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 0x7fbff4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080c6060 0x7fbff4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbff4004d50 0x7fbff40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080ad640 con 0x7fbff4003a60 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080ad920 con 0x7fbff4004d50 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff400ba60 con 0x7fc0080c6060 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc006ffd700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 0x7fbff4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fbffe7fc700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080c6060 0x7fbff4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0077fe700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbff4004d50 0x7fbff40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc006ffd700 1 -- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080c6060 msgr2=0x7fbff4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc006ffd700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080c6060 0x7fbff4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc006ffd700 1 -- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbff4004d50 msgr2=0x7fbff40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc006ffd700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbff4004d50 0x7fbff40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc006ffd700 1 -- 172.21.15.84:0/3426527644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff4003570 con 0x7fbff4003a60 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc006ffd700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 0x7fbff4003e70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbff800c3c0 tx=0x7fbff8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2383448c715713 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800cc30 con 0x7fbff4003a60 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff800cdb0 con 0x7fbff4003a60 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.487+0000 7fc0067fc700 1 -- 172.21.15.84:0/3426527644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8005b70 con 0x7fbff4003a60 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.488+0000 7fc007fff700 1 -- 172.21.15.84:0/3426527644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 msgr2=0x7fbff4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.488+0000 7fc007fff700 1 --2- 172.21.15.84:0/3426527644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 0x7fbff4003e70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbff800c3c0 tx=0x7fbff8001e90 comp rx=0 tx=0).stop 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.488+0000 7fc0077fe700 1 -- 172.21.15.84:0/3426527644 reap_dead start 2023-10-06T03:25:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.488+0000 7fc007fff700 1 -- 172.21.15.84:0/3426527644 shutdown_connections 2023-10-06T03:25:39.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.488+0000 7fc007fff700 1 -- 172.21.15.84:0/3426527644 >> 172.21.15.84:0/3426527644 conn(0x7fc008099560 msgr2=0x7fc00806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:39.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.488+0000 7fc007fff700 1 -- 172.21.15.84:0/3426527644 shutdown_connections 2023-10-06T03:25:39.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.488+0000 7fc007fff700 1 -- 172.21.15.84:0/3426527644 wait complete. 2023-10-06T03:25:39.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.489+0000 7fc007fff700 1 Processor -- start 2023-10-06T03:25:39.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.489+0000 7fc007fff700 1 -- start start 2023-10-06T03:25:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc007fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 0x7fc008154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc007fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080b0980 0x7fc008155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc007fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0080b0df0 0x7fc008155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc007fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080b0090 con 0x7fbff4003a60 2023-10-06T03:25:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc007fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080b0370 con 0x7fc0080b0df0 2023-10-06T03:25:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc007fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080b0650 con 0x7fc0080b0980 2023-10-06T03:25:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc006ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 0x7fc008154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc006ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 0x7fc008154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44866/0 (socket says 172.21.15.84:44866) 2023-10-06T03:25:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc006ffd700 1 -- 172.21.15.84:0/355560718 learned_addr learned my addr 172.21.15.84:0/355560718 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc0077fe700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0080b0df0 0x7fc008155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fbffe7fc700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080b0980 0x7fc008155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc006ffd700 1 -- 172.21.15.84:0/355560718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080b0980 msgr2=0x7fc008155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc006ffd700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080b0980 0x7fc008155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc006ffd700 1 -- 172.21.15.84:0/355560718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0080b0df0 msgr2=0x7fc008155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc006ffd700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0080b0df0 0x7fc008155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc006ffd700 1 -- 172.21.15.84:0/355560718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc008159d20 con 0x7fbff4003a60 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc0077fe700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0080b0df0 0x7fc008155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.490+0000 7fc006ffd700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 0x7fc008154ef0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbff8001ed0 tx=0x7fbff8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.491+0000 7fbfff7fe700 1 -- 172.21.15.84:0/355560718 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800c9e0 con 0x7fbff4003a60 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.491+0000 7fbfff7fe700 1 -- 172.21.15.84:0/355560718 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8000f50 con 0x7fbff4003a60 2023-10-06T03:25:39.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.491+0000 7fc007fff700 1 -- 172.21.15.84:0/355560718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00815a000 con 0x7fbff4003a60 2023-10-06T03:25:39.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.491+0000 7fbfff7fe700 1 -- 172.21.15.84:0/355560718 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8004a80 con 0x7fbff4003a60 2023-10-06T03:25:39.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.491+0000 7fc007fff700 1 -- 172.21.15.84:0/355560718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0080aeca0 con 0x7fbff4003a60 2023-10-06T03:25:39.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.491+0000 7fc007fff700 1 -- 172.21.15.84:0/355560718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00805f270 con 0x7fbff4003a60 2023-10-06T03:25:39.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.492+0000 7fbfff7fe700 1 -- 172.21.15.84:0/355560718 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbff8019030 con 0x7fbff4003a60 2023-10-06T03:25:39.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.492+0000 7fbfff7fe700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 0x7fbfe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.492+0000 7fbfff7fe700 1 -- 172.21.15.84:0/355560718 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fbff80859b0 con 0x7fbff4003a60 2023-10-06T03:25:39.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.492+0000 7fbffe7fc700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 0x7fbfe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.493+0000 7fbffe7fc700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 0x7fbfe80693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0080b1ca0 tx=0x7fbff0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:39.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.496+0000 7fbfff7fe700 1 -- 172.21.15.84:0/355560718 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbff8052c80 con 0x7fbff4003a60 2023-10-06T03:25:39.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.721+0000 7fc007fff700 1 -- 172.21.15.84:0/355560718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0080ad000 con 0x7fbff4003a60 2023-10-06T03:25:39.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.721+0000 7fbfff7fe700 1 -- 172.21.15.84:0/355560718 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fbff8017de0 con 0x7fbff4003a60 2023-10-06T03:25:39.722 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:39.722 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3103408955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3103408955},{"type":"v1","addr":"172.21.15.131:6834","nonce":3103408955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3982920665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3982920665},{"type":"v1","addr":"172.21.15.131:6835","nonce":3982920665}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1537563341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1537563341},{"type":"v1","addr":"172.21.15.84:6836","nonce":1537563341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1846045789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1846045789},{"type":"v1","addr":"172.21.15.84:6837","nonce":1846045789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-10-06T03:25:39.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.723+0000 7fc007fff700 1 -- 172.21.15.84:0/355560718 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 msgr2=0x7fbfe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.723+0000 7fc007fff700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 0x7fbfe80693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0080b1ca0 tx=0x7fbff0008040 comp rx=0 tx=0).stop 2023-10-06T03:25:39.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.723+0000 7fc007fff700 1 -- 172.21.15.84:0/355560718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 msgr2=0x7fc008154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.723+0000 7fc007fff700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 0x7fc008154ef0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbff8001ed0 tx=0x7fbff8015000 comp rx=0 tx=0).stop 2023-10-06T03:25:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.723+0000 7fc007fff700 1 -- 172.21.15.84:0/355560718 shutdown_connections 2023-10-06T03:25:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.723+0000 7fc007fff700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbfe8066f30 0x7fbfe80693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.723+0000 7fc007fff700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0080b0df0 0x7fc008155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.723+0000 7fc007fff700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff4003a60 0x7fc008154ef0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.723+0000 7fc007fff700 1 --2- 172.21.15.84:0/355560718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0080b0980 0x7fc008155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.723+0000 7fc007fff700 1 -- 172.21.15.84:0/355560718 >> 172.21.15.84:0/355560718 conn(0x7fc008099560 msgr2=0x7fc0080d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.724+0000 7fc007fff700 1 -- 172.21.15.84:0/355560718 shutdown_connections 2023-10-06T03:25:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.724+0000 7fc007fff700 1 -- 172.21.15.84:0/355560718 wait complete. 2023-10-06T03:25:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 26 2023-10-06T03:25:39.736 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:25:39.736 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:25:39.737 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:25:39.737 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:39.737 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:25:39.737 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:25:39.737 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:25:39.737 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:39.737 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:25:39.738 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:25:39.738 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:25:39.738 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:39.739 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:25:39.739 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:25:39.741 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:25:39.741 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:39.746 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:25:39.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:25:39.747 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:25:39.747 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:25:39.749 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:25:39.749 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:25:39.752 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:25:39.752 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:25:39.789 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:25:39.789 DEBUG:teuthology.parallel:result is None 2023-10-06T03:25:39.789 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:25:39.789 DEBUG:teuthology.parallel:result is None 2023-10-06T03:25:39.794 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:25:39.794 DEBUG:teuthology.parallel:result is None 2023-10-06T03:25:39.795 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:25:39.795 DEBUG:teuthology.parallel:result is None 2023-10-06T03:25:39.796 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:25:39.861 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:25:39.862 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:25:39.876 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:25:39.876 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:25:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.916+0000 7f74ca012700 1 Processor -- start 2023-10-06T03:25:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.916+0000 7f74ca012700 1 -- start start 2023-10-06T03:25:39.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.917+0000 7f74ca012700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f74c40ab930 0x7f74c41573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.917+0000 7f74ca012700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ca610 0x7f74c4068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.917+0000 7f74ca012700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c415aff0 con 0x7f74c4157010 2023-10-06T03:25:39.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.917+0000 7f74ca012700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c415bc70 con 0x7f74c40ab930 2023-10-06T03:25:39.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.917+0000 7f74ca012700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40cc830 con 0x7f74c40ca610 2023-10-06T03:25:39.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c37fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f74c4157010 0x7f74c40cc120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:39114/0 (socket says 172.21.15.84:39114) 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c37fe700 1 -- 172.21.15.84:0/2203082466 learned_addr learned my addr 172.21.15.84:0/2203082466 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c2ffd700 1 --2- 172.21.15.84:0/2203082466 >> v2:172.21.15.131:3300/0 conn(0x7f74c40ab930 0x7f74c41573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c3fff700 1 --2- 172.21.15.84:0/2203082466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ca610 0x7f74c4068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c27fc700 1 -- 172.21.15.84:0/2203082466 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627136616 0 0) 0x7f74c415aff0 con 0x7f74c4157010 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c27fc700 1 -- 172.21.15.84:0/2203082466 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74ac003570 con 0x7f74c4157010 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c2ffd700 1 -- 172.21.15.84:0/2203082466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ca610 msgr2=0x7f74c4068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c2ffd700 1 --2- 172.21.15.84:0/2203082466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ca610 0x7f74c4068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c2ffd700 1 -- 172.21.15.84:0/2203082466 >> v1:172.21.15.131:6789/0 conn(0x7f74c4157010 legacy=0x7f74c40cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c2ffd700 1 -- 172.21.15.84:0/2203082466 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c415b2d0 con 0x7f74c40ab930 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c3fff700 1 --2- 172.21.15.84:0/2203082466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ca610 0x7f74c4068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c2ffd700 1 --2- 172.21.15.84:0/2203082466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c40ab930 0x7f74c41573e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f74b80098e0 tx=0x7f74b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a06cd4e41074303 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c27fc700 1 -- 172.21.15.84:0/2203082466 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8011630 con 0x7f74c40ab930 2023-10-06T03:25:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c27fc700 1 -- 172.21.15.84:0/2203082466 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b8011790 con 0x7f74c40ab930 2023-10-06T03:25:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.918+0000 7f74c27fc700 1 -- 172.21.15.84:0/2203082466 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8011b30 con 0x7f74c40ab930 2023-10-06T03:25:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.919+0000 7f74ca012700 1 -- 172.21.15.84:0/2203082466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c40ab930 msgr2=0x7f74c41573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.919+0000 7f74ca012700 1 --2- 172.21.15.84:0/2203082466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c40ab930 0x7f74c41573e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f74b80098e0 tx=0x7f74b80091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.919+0000 7f74ca012700 1 -- 172.21.15.84:0/2203082466 shutdown_connections 2023-10-06T03:25:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.919+0000 7f74ca012700 1 --2- 172.21.15.84:0/2203082466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ca610 0x7f74c4068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.919+0000 7f74ca012700 1 --2- 172.21.15.84:0/2203082466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c40ab930 0x7f74c41573e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.919+0000 7f74ca012700 1 -- 172.21.15.84:0/2203082466 >> 172.21.15.84:0/2203082466 conn(0x7f74c406dd10 msgr2=0x7f74c406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.919+0000 7f74ca012700 1 -- 172.21.15.84:0/2203082466 shutdown_connections 2023-10-06T03:25:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.919+0000 7f74ca012700 1 -- 172.21.15.84:0/2203082466 wait complete. 2023-10-06T03:25:39.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.920+0000 7f74ca012700 1 Processor -- start 2023-10-06T03:25:39.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.920+0000 7f74ca012700 1 -- start start 2023-10-06T03:25:39.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74ca012700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ab930 0x7f74c4157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74ca012700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74c40ca610 0x7f74c41410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74ca012700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c4157010 0x7f74c4141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74ca012700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4144fd0 con 0x7f74c40ca610 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74ca012700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4144b40 con 0x7f74c4157010 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74ca012700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4143f30 con 0x7f74c40ab930 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74c40ca610 0x7f74c41410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74c40ca610 0x7f74c41410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44912/0 (socket says 172.21.15.84:44912) 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c2ffd700 1 -- 172.21.15.84:0/733515161 learned_addr learned my addr 172.21.15.84:0/733515161 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c3fff700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c4157010 0x7f74c4141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c37fe700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ab930 0x7f74c4157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c2ffd700 1 -- 172.21.15.84:0/733515161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ab930 msgr2=0x7f74c4157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c2ffd700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ab930 0x7f74c4157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c2ffd700 1 -- 172.21.15.84:0/733515161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c4157010 msgr2=0x7f74c4141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c2ffd700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c4157010 0x7f74c4141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c2ffd700 1 -- 172.21.15.84:0/733515161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc009a20 con 0x7f74c40ca610 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c3fff700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c4157010 0x7f74c4141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.921+0000 7f74c2ffd700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74c40ca610 0x7f74c41410e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009ed0 tx=0x7f74b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.922+0000 7f74ab7fe700 1 -- 172.21.15.84:0/733515161 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8011b10 con 0x7f74c40ca610 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.922+0000 7f74ab7fe700 1 -- 172.21.15.84:0/733515161 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80233f0 con 0x7f74c40ca610 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.922+0000 7f74ab7fe700 1 -- 172.21.15.84:0/733515161 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8023770 con 0x7f74c40ca610 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.922+0000 7f74ca012700 1 -- 172.21.15.84:0/733515161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b8009420 con 0x7f74c40ca610 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.922+0000 7f74ca012700 1 -- 172.21.15.84:0/733515161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c41444f0 con 0x7f74c40ca610 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.923+0000 7f74ca012700 1 -- 172.21.15.84:0/733515161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c4064ad0 con 0x7f74c40ca610 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.923+0000 7f74ab7fe700 1 -- 172.21.15.84:0/733515161 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74b802c3b0 con 0x7f74c40ca610 2023-10-06T03:25:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.923+0000 7f74ab7fe700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f74b0066f30 0x7f74b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:39.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.923+0000 7f74ab7fe700 1 -- 172.21.15.84:0/733515161 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f74b8085930 con 0x7f74c40ca610 2023-10-06T03:25:39.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.923+0000 7f74c37fe700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f74b0066f30 0x7f74b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:39.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.924+0000 7f74c37fe700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f74b0066f30 0x7f74b00693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f74b40058d0 tx=0x7f74b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:39.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:39.928+0000 7f74ab7fe700 1 -- 172.21.15.84:0/733515161 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74b8052c80 con 0x7f74c40ca610 2023-10-06T03:25:40.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.135+0000 7f74ca012700 1 -- 172.21.15.84:0/733515161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f74c4144c80 con 0x7f74c40ca610 2023-10-06T03:25:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.974+0000 7f74ab7fe700 1 -- 172.21.15.84:0/733515161 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7f74b8028080 con 0x7f74c40ca610 2023-10-06T03:25:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 -- 172.21.15.84:0/733515161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f74b0066f30 msgr2=0x7f74b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f74b0066f30 0x7f74b00693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f74b40058d0 tx=0x7f74b4009040 comp rx=0 tx=0).stop 2023-10-06T03:25:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 -- 172.21.15.84:0/733515161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74c40ca610 msgr2=0x7f74c41410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74c40ca610 0x7f74c41410e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009ed0 tx=0x7f74b8017000 comp rx=0 tx=0).stop 2023-10-06T03:25:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 -- 172.21.15.84:0/733515161 shutdown_connections 2023-10-06T03:25:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f74b0066f30 0x7f74b00693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c4157010 0x7f74c4141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c40ab930 0x7f74c4157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 --2- 172.21.15.84:0/733515161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74c40ca610 0x7f74c41410e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 -- 172.21.15.84:0/733515161 >> 172.21.15.84:0/733515161 conn(0x7f74c406dd10 msgr2=0x7f74c4069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 -- 172.21.15.84:0/733515161 shutdown_connections 2023-10-06T03:25:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:40.977+0000 7f74ca012700 1 -- 172.21.15.84:0/733515161 wait complete. 2023-10-06T03:25:40.980 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T03:25:40.992 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:25:41.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.107+0000 7f0069e34700 1 Processor -- start 2023-10-06T03:25:41.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.107+0000 7f0069e34700 1 -- start start 2023-10-06T03:25:41.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f0069e34700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0064159480 0x7f00640b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f0069e34700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00640b3610 0x7f00640cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f0069e34700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00640cb7e0 con 0x7f00640cc1b0 2023-10-06T03:25:41.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f0069e34700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640b08a0 con 0x7f00640b3610 2023-10-06T03:25:41.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f0069e34700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640cb190 con 0x7f0064159480 2023-10-06T03:25:41.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f005bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00640b3610 0x7f00640cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f0069633700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f00640cc1b0 0x7f00640b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49204/0 (socket says 172.21.15.84:49204) 2023-10-06T03:25:41.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f0069633700 1 -- 172.21.15.84:0/2634838409 learned_addr learned my addr 172.21.15.84:0/2634838409 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:41.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f0068e32700 1 --2- 172.21.15.84:0/2634838409 >> v2:172.21.15.131:3300/0 conn(0x7f0064159480 0x7f00640b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f005bfff700 1 -- 172.21.15.84:0/2634838409 >> v2:172.21.15.131:3300/0 conn(0x7f0064159480 msgr2=0x7f00640b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f005bfff700 1 --2- 172.21.15.84:0/2634838409 >> v2:172.21.15.131:3300/0 conn(0x7f0064159480 0x7f00640b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f005bfff700 1 -- 172.21.15.84:0/2634838409 >> v1:172.21.15.84:6789/0 conn(0x7f00640cc1b0 legacy=0x7f00640b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f005bfff700 1 -- 172.21.15.84:0/2634838409 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640cb470 con 0x7f00640b3610 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.108+0000 7f005b7fe700 1 -- 172.21.15.84:0/2634838409 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254470988 0 0) 0x7f00640cb7e0 con 0x7f00640cc1b0 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f005bfff700 1 --2- 172.21.15.84:0/2634838409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00640b3610 0x7f00640cbc70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f006406fa30 tx=0x7f00540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223b29feab98057a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f005b7fe700 1 -- 172.21.15.84:0/2634838409 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400b6b0 con 0x7f00640b3610 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f005b7fe700 1 -- 172.21.15.84:0/2634838409 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005400b810 con 0x7f00640b3610 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f005b7fe700 1 -- 172.21.15.84:0/2634838409 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400bbb0 con 0x7f00640b3610 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f0069e34700 1 -- 172.21.15.84:0/2634838409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00640b3610 msgr2=0x7f00640cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f0069e34700 1 --2- 172.21.15.84:0/2634838409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00640b3610 0x7f00640cbc70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f006406fa30 tx=0x7f00540091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f0069e34700 1 -- 172.21.15.84:0/2634838409 shutdown_connections 2023-10-06T03:25:41.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f0069e34700 1 --2- 172.21.15.84:0/2634838409 >> v2:172.21.15.131:3300/0 conn(0x7f0064159480 0x7f00640b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f0069e34700 1 --2- 172.21.15.84:0/2634838409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00640b3610 0x7f00640cbc70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f0069e34700 1 -- 172.21.15.84:0/2634838409 >> 172.21.15.84:0/2634838409 conn(0x7f006406ed20 msgr2=0x7f006406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:41.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f0069e34700 1 -- 172.21.15.84:0/2634838409 shutdown_connections 2023-10-06T03:25:41.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.109+0000 7f0069e34700 1 -- 172.21.15.84:0/2634838409 wait complete. 2023-10-06T03:25:41.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.110+0000 7f0069e34700 1 Processor -- start 2023-10-06T03:25:41.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.111+0000 7f0069e34700 1 -- start start 2023-10-06T03:25:41.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.111+0000 7f0069e34700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00640b3610 0x7f0064169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.111+0000 7f0069e34700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00640cc1b0 0x7f00640cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.111+0000 7f0069e34700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064159480 0x7f00640cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.111+0000 7f0069e34700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006416a640 con 0x7f0064159480 2023-10-06T03:25:41.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.111+0000 7f0069e34700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006416a940 con 0x7f00640b3610 2023-10-06T03:25:41.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.111+0000 7f0069e34700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006415b750 con 0x7f00640cc1b0 2023-10-06T03:25:41.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.111+0000 7f0069633700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064159480 0x7f00640cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.111+0000 7f0069633700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064159480 0x7f00640cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55512/0 (socket says 172.21.15.84:55512) 2023-10-06T03:25:41.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.111+0000 7f0069633700 1 -- 172.21.15.84:0/828540490 learned_addr learned my addr 172.21.15.84:0/828540490 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:41.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0068e32700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00640b3610 0x7f0064169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f005bfff700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00640cc1b0 0x7f00640cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0069633700 1 -- 172.21.15.84:0/828540490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00640cc1b0 msgr2=0x7f00640cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0069633700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00640cc1b0 0x7f00640cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0069633700 1 -- 172.21.15.84:0/828540490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00640b3610 msgr2=0x7f0064169a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0069633700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00640b3610 0x7f0064169a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0069633700 1 -- 172.21.15.84:0/828540490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054009420 con 0x7f0064159480 2023-10-06T03:25:41.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0069633700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064159480 0x7f00640cf1a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c7e0 tx=0x7f005c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0058ff9700 1 -- 172.21.15.84:0/828540490 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c005c00 con 0x7f0064159480 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0058ff9700 1 -- 172.21.15.84:0/828540490 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c005d60 con 0x7f0064159480 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0058ff9700 1 -- 172.21.15.84:0/828540490 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c004a80 con 0x7f0064159480 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0069e34700 1 -- 172.21.15.84:0/828540490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006415b160 con 0x7f0064159480 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.112+0000 7f0069e34700 1 -- 172.21.15.84:0/828540490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00640cfb10 con 0x7f0064159480 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.113+0000 7f0069e34700 1 -- 172.21.15.84:0/828540490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00640b60c0 con 0x7f0064159480 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.113+0000 7f0058ff9700 1 -- 172.21.15.84:0/828540490 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f005c005030 con 0x7f0064159480 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.114+0000 7f0058ff9700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0050066f30 0x7f00500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.114+0000 7f0058ff9700 1 -- 172.21.15.84:0/828540490 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f005c083910 con 0x7f0064159480 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.114+0000 7f0068e32700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0050066f30 0x7f00500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.114+0000 7f0068e32700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0050066f30 0x7f00500693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f00600074f0 tx=0x7f0060009700 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:41.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.118+0000 7f0058ff9700 1 -- 172.21.15.84:0/828540490 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f005c04b5a0 con 0x7f0064159480 2023-10-06T03:25:41.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.374+0000 7f0069e34700 1 -- 172.21.15.84:0/828540490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f006405f270 con 0x7f0064159480 2023-10-06T03:25:41.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.374+0000 7f0058ff9700 1 -- 172.21.15.84:0/828540490 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f005c050c30 con 0x7f0064159480 2023-10-06T03:25:41.376 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:41.376 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:25:41.376 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T03:25:41.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.376 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T03:25:41.376 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lA8KvDxAA2irSaBc/QiMm9oI5GEK1PA==", 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lq2TnGhAAOzV6kE1Ji9yvQGuouda9GQ==", 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.377 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9l4w54FhAASOElKyXlWzXB7pDJV5TzVQ==", 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lh/61IRAANVLLVFSkTIhlvAyQkmkbqQ==", 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:25:41.379 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCVfR9lPd++MRAAikRAaM5HcwQgYYfszDoMzQ==", 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCYfR9l3ovfLxAAkuD96aBKGZX1SQvItQjbmA==", 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCbfR9lsbQpMBAApjEhKZ3RZXIXNFPmGrp3Rg==", 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCefR9lOhnPMRAAinzeYJrHzI3Laz+kRo7U9w==", 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:41.382 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCkfR9liYL2MhAAVzzPBy1+K4n9a324eCqKSg==", 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCnfR9lEe8GMBAAgXFWAPLix5BkHtrqQazDqA==", 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCqfR9lcprFMBAA4/ksqag9gsivr9htt3UDBg==", 2023-10-06T03:25:41.384 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCtfR9leIi9MBAAaco3XMawt8uFNMNRbPQAQQ==", 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:25:41.385 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.386 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.386 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T03:25:41.386 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lGQaGJRAALZ28ylNKJSf4AhF9KcsrBg==", 2023-10-06T03:25:41.386 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.386 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:41.386 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-10-06T03:25:41.386 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T03:25:41.387 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.387 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.387 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T03:25:41.387 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ls6nPLRAA/94kuDcXCPlYoYcCuqwN2A==", 2023-10-06T03:25:41.387 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.387 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:41.387 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:25:41.387 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:25:41.389 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:25:41.389 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.389 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.389 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T03:25:41.389 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lY17ZKhAAyLFVSlBM5vWr4LSl+wwWZw==", 2023-10-06T03:25:41.389 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.389 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:41.389 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lPWYyMxAAmgd5iQq7RQp80iK1oBfUww==", 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:25:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRfR9loncpLhAA2cZSGjrup5zj13Xtt9k6Xw==", 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ltUixDBAAQN/x3iVJcTKF7hTMehPYgQ==", 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T03:25:41.392 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lFqqSBhAA1km5fSJT2+QAdMBBxBWrXQ==", 2023-10-06T03:25:41.393 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:25:41.393 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:25:41.393 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:25:41.393 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:25:41.393 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.393 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:41.393 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T03:25:41.393 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:25:41.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 -- 172.21.15.84:0/828540490 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0050066f30 msgr2=0x7f00500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0050066f30 0x7f00500693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f00600074f0 tx=0x7f0060009700 comp rx=0 tx=0).stop 2023-10-06T03:25:41.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 -- 172.21.15.84:0/828540490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064159480 msgr2=0x7f00640cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064159480 0x7f00640cf1a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c7e0 tx=0x7f005c007d90 comp rx=0 tx=0).stop 2023-10-06T03:25:41.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 -- 172.21.15.84:0/828540490 shutdown_connections 2023-10-06T03:25:41.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0050066f30 0x7f00500693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00640b3610 0x7f0064169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064159480 0x7f00640cf1a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 --2- 172.21.15.84:0/828540490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00640cc1b0 0x7f00640cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 -- 172.21.15.84:0/828540490 >> 172.21.15.84:0/828540490 conn(0x7f006406ed20 msgr2=0x7f0064156870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:41.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 -- 172.21.15.84:0/828540490 shutdown_connections 2023-10-06T03:25:41.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.376+0000 7f0069e34700 1 -- 172.21.15.84:0/828540490 wait complete. 2023-10-06T03:25:41.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:41.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.507+0000 7fc42a7f1700 1 Processor -- start 2023-10-06T03:25:41.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.507+0000 7fc42a7f1700 1 -- start start 2023-10-06T03:25:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.508+0000 7fc42a7f1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4241595a0 0x7fc4240aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.508+0000 7fc42a7f1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4240b49e0 0x7fc4240aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.508+0000 7fc42a7f1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4240b0ca0 con 0x7fc4240b07a0 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.508+0000 7fc42a7f1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4240b0f80 con 0x7fc4241595a0 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.508+0000 7fc42a7f1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4240b1260 con 0x7fc4240b49e0 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.508+0000 7fc423fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4241595a0 0x7fc4240aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.508+0000 7fc428d8e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc4240b07a0 0x7fc4240b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49206/0 (socket says 172.21.15.84:49206) 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.508+0000 7fc428d8e700 1 -- 172.21.15.84:0/373025685 learned_addr learned my addr 172.21.15.84:0/373025685 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc4237fe700 1 --2- 172.21.15.84:0/373025685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4240b49e0 0x7fc4240aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc423fff700 1 -- 172.21.15.84:0/373025685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4240b49e0 msgr2=0x7fc4240aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc423fff700 1 --2- 172.21.15.84:0/373025685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4240b49e0 0x7fc4240aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc423fff700 1 -- 172.21.15.84:0/373025685 >> v1:172.21.15.84:6789/0 conn(0x7fc4240b07a0 legacy=0x7fc4240b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc422ffd700 1 -- 172.21.15.84:0/373025685 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411732890 0 0) 0x7fc4240b0ca0 con 0x7fc4240b07a0 2023-10-06T03:25:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc423fff700 1 -- 172.21.15.84:0/373025685 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4240b1540 con 0x7fc4241595a0 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc4237fe700 1 --2- 172.21.15.84:0/373025685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4240b49e0 0x7fc4240aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc423fff700 1 --2- 172.21.15.84:0/373025685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4241595a0 0x7fc4240aa570 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc4140098d0 tx=0x7fc414009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a3e3299ea15220 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc422ffd700 1 -- 172.21.15.84:0/373025685 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414009e70 con 0x7fc4241595a0 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc422ffd700 1 -- 172.21.15.84:0/373025685 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414005c10 con 0x7fc4241595a0 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc422ffd700 1 -- 172.21.15.84:0/373025685 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400b650 con 0x7fc4241595a0 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc42a7f1700 1 -- 172.21.15.84:0/373025685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4241595a0 msgr2=0x7fc4240aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc42a7f1700 1 --2- 172.21.15.84:0/373025685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4241595a0 0x7fc4240aa570 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc4140098d0 tx=0x7fc414009120 comp rx=0 tx=0).stop 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc42a7f1700 1 -- 172.21.15.84:0/373025685 shutdown_connections 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc42a7f1700 1 --2- 172.21.15.84:0/373025685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4241595a0 0x7fc4240aa570 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc42a7f1700 1 --2- 172.21.15.84:0/373025685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4240b49e0 0x7fc4240aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc42a7f1700 1 -- 172.21.15.84:0/373025685 >> 172.21.15.84:0/373025685 conn(0x7fc424099830 msgr2=0x7fc42406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc42a7f1700 1 -- 172.21.15.84:0/373025685 shutdown_connections 2023-10-06T03:25:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.509+0000 7fc42a7f1700 1 -- 172.21.15.84:0/373025685 wait complete. 2023-10-06T03:25:41.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.510+0000 7fc42a7f1700 1 Processor -- start 2023-10-06T03:25:41.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.511+0000 7fc42a7f1700 1 -- start start 2023-10-06T03:25:41.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.511+0000 7fc42a7f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4240b07a0 0x7fc42414aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.511+0000 7fc42a7f1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4240b49e0 0x7fc42415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.511+0000 7fc42a7f1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4241595a0 0x7fc42415c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.511+0000 7fc42a7f1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42415a7d0 con 0x7fc4240b07a0 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.511+0000 7fc42a7f1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42409ddd0 con 0x7fc4240b49e0 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.511+0000 7fc42a7f1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42415a340 con 0x7fc4241595a0 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.511+0000 7fc423fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4240b07a0 0x7fc42414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.511+0000 7fc423fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4240b07a0 0x7fc42414aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55530/0 (socket says 172.21.15.84:55530) 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.511+0000 7fc423fff700 1 -- 172.21.15.84:0/265045362 learned_addr learned my addr 172.21.15.84:0/265045362 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc4237fe700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4240b49e0 0x7fc42415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc428d8e700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4241595a0 0x7fc42415c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc423fff700 1 -- 172.21.15.84:0/265045362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4241595a0 msgr2=0x7fc42415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc423fff700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4241595a0 0x7fc42415c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc423fff700 1 -- 172.21.15.84:0/265045362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4240b49e0 msgr2=0x7fc42415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc423fff700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4240b49e0 0x7fc42415bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc423fff700 1 -- 172.21.15.84:0/265045362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4140093c0 con 0x7fc4240b07a0 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc423fff700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4240b07a0 0x7fc42414aac0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc414009fd0 tx=0x7fc414016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc40bfff700 1 -- 172.21.15.84:0/265045362 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414006460 con 0x7fc4240b07a0 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc40bfff700 1 -- 172.21.15.84:0/265045362 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4140065e0 con 0x7fc4240b07a0 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc42a7f1700 1 -- 172.21.15.84:0/265045362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42415c700 con 0x7fc4240b07a0 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc40bfff700 1 -- 172.21.15.84:0/265045362 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414026430 con 0x7fc4240b07a0 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.512+0000 7fc42a7f1700 1 -- 172.21.15.84:0/265045362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc424159cf0 con 0x7fc4240b07a0 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.513+0000 7fc42a7f1700 1 -- 172.21.15.84:0/265045362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc424064ad0 con 0x7fc4240b07a0 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.513+0000 7fc40bfff700 1 -- 172.21.15.84:0/265045362 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc41401a420 con 0x7fc4240b07a0 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.514+0000 7fc40bfff700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc410066f30 0x7fc4100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.514+0000 7fc40bfff700 1 -- 172.21.15.84:0/265045362 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc414085e70 con 0x7fc4240b07a0 2023-10-06T03:25:41.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.514+0000 7fc4237fe700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc410066f30 0x7fc4100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.514+0000 7fc4237fe700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc410066f30 0x7fc4100693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc4240b2e60 tx=0x7fc418006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:41.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.518+0000 7fc40bfff700 1 -- 172.21.15.84:0/265045362 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc414053190 con 0x7fc4240b07a0 2023-10-06T03:25:41.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.700+0000 7fc42a7f1700 1 -- 172.21.15.84:0/265045362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc42415a620 con 0x7fc4240b07a0 2023-10-06T03:25:41.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.701+0000 7fc40bfff700 1 -- 172.21.15.84:0/265045362 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+13855 (secure 0 0 0) 0x7fc41402b090 con 0x7fc4240b07a0 2023-10-06T03:25:41.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:40.970652+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 -- 172.21.15.84:0/265045362 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc410066f30 msgr2=0x7fc4100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc410066f30 0x7fc4100693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc4240b2e60 tx=0x7fc418006f90 comp rx=0 tx=0).stop 2023-10-06T03:25:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 -- 172.21.15.84:0/265045362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4240b07a0 msgr2=0x7fc42414aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4240b07a0 0x7fc42414aac0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc414009fd0 tx=0x7fc414016000 comp rx=0 tx=0).stop 2023-10-06T03:25:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 -- 172.21.15.84:0/265045362 shutdown_connections 2023-10-06T03:25:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc410066f30 0x7fc4100693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4241595a0 0x7fc42415c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4240b07a0 0x7fc42414aac0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 --2- 172.21.15.84:0/265045362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4240b49e0 0x7fc42415bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 -- 172.21.15.84:0/265045362 >> 172.21.15.84:0/265045362 conn(0x7fc424099830 msgr2=0x7fc4240d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 -- 172.21.15.84:0/265045362 shutdown_connections 2023-10-06T03:25:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.703+0000 7fc42a7f1700 1 -- 172.21.15.84:0/265045362 wait complete. 2023-10-06T03:25:41.717 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:25:41.717 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:25:41.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.833+0000 7f59fa447700 1 Processor -- start 2023-10-06T03:25:41.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.833+0000 7f59fa447700 1 -- start start 2023-10-06T03:25:41.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.834+0000 7f59fa447700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59f4159710 0x7f59f40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.834+0000 7f59fa447700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f59f40cba70 0x7f59f40c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.834+0000 7f59fa447700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f40afbe0 con 0x7f59f4159340 2023-10-06T03:25:41.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.834+0000 7f59fa447700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f40cbed0 con 0x7f59f4159710 2023-10-06T03:25:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.834+0000 7f59fa447700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f40cf820 con 0x7f59f40cba70 2023-10-06T03:25:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.834+0000 7f59f37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59f4159710 0x7f59f40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.834+0000 7f59f37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59f4159710 0x7f59f40cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55536/0 (socket says 172.21.15.84:55536) 2023-10-06T03:25:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.834+0000 7f59f37fe700 1 -- 172.21.15.84:0/2216682412 learned_addr learned my addr 172.21.15.84:0/2216682412 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.834+0000 7f59f89e4700 1 --2- 172.21.15.84:0/2216682412 >> v2:172.21.15.131:3300/0 conn(0x7f59f40cba70 0x7f59f40c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59f37fe700 1 -- 172.21.15.84:0/2216682412 >> v2:172.21.15.131:3300/0 conn(0x7f59f40cba70 msgr2=0x7f59f40c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59f37fe700 1 --2- 172.21.15.84:0/2216682412 >> v2:172.21.15.131:3300/0 conn(0x7f59f40cba70 0x7f59f40c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59f37fe700 1 -- 172.21.15.84:0/2216682412 >> v1:172.21.15.131:6789/0 conn(0x7f59f4159340 legacy=0x7f59f40af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59f37fe700 1 -- 172.21.15.84:0/2216682412 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f40cfb00 con 0x7f59f4159710 2023-10-06T03:25:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59f37fe700 1 --2- 172.21.15.84:0/2216682412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f4159710 0x7f59f40cb530 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f59f40ccd20 tx=0x7f59e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffbb9796eaf28db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59f2ffd700 1 -- 172.21.15.84:0/2216682412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800b820 con 0x7f59f4159710 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59f2ffd700 1 -- 172.21.15.84:0/2216682412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e800b980 con 0x7f59f4159710 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59f2ffd700 1 -- 172.21.15.84:0/2216682412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800bd40 con 0x7f59f4159710 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59fa447700 1 -- 172.21.15.84:0/2216682412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f4159710 msgr2=0x7f59f40cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59fa447700 1 --2- 172.21.15.84:0/2216682412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f4159710 0x7f59f40cb530 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f59f40ccd20 tx=0x7f59e8009250 comp rx=0 tx=0).stop 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59fa447700 1 -- 172.21.15.84:0/2216682412 shutdown_connections 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59fa447700 1 --2- 172.21.15.84:0/2216682412 >> v2:172.21.15.131:3300/0 conn(0x7f59f40cba70 0x7f59f40c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59fa447700 1 --2- 172.21.15.84:0/2216682412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f4159710 0x7f59f40cb530 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59fa447700 1 -- 172.21.15.84:0/2216682412 >> 172.21.15.84:0/2216682412 conn(0x7f59f4099720 msgr2=0x7f59f406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.835+0000 7f59fa447700 1 -- 172.21.15.84:0/2216682412 shutdown_connections 2023-10-06T03:25:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.836+0000 7f59fa447700 1 -- 172.21.15.84:0/2216682412 wait complete. 2023-10-06T03:25:41.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.837+0000 7f59fa447700 1 Processor -- start 2023-10-06T03:25:41.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.837+0000 7f59fa447700 1 -- start start 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.837+0000 7f59fa447700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f40cba70 0x7f59f416a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.837+0000 7f59fa447700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59f4159340 0x7f59f4152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.837+0000 7f59fa447700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59f4159710 0x7f59f416d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.837+0000 7f59fa447700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f40c8e60 con 0x7f59f40cba70 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.837+0000 7f59fa447700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f416a730 con 0x7f59f4159710 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.837+0000 7f59fa447700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f416cf40 con 0x7f59f4159340 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f40cba70 0x7f59f416a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f40cba70 0x7f59f416a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55550/0 (socket says 172.21.15.84:55550) 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f3fff700 1 -- 172.21.15.84:0/1694887644 learned_addr learned my addr 172.21.15.84:0/1694887644 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f89e4700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59f4159710 0x7f59f416d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f37fe700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59f4159340 0x7f59f4152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f3fff700 1 -- 172.21.15.84:0/1694887644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59f4159340 msgr2=0x7f59f4152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f3fff700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59f4159340 0x7f59f4152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f3fff700 1 -- 172.21.15.84:0/1694887644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59f4159710 msgr2=0x7f59f416d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f3fff700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59f4159710 0x7f59f416d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f3fff700 1 -- 172.21.15.84:0/1694887644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e80094f0 con 0x7f59f40cba70 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f37fe700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59f4159340 0x7f59f4152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59f3fff700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f40cba70 0x7f59f416a1f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c5b0 tx=0x7f59e40020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59dbfff700 1 -- 172.21.15.84:0/1694887644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4011590 con 0x7f59f40cba70 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59dbfff700 1 -- 172.21.15.84:0/1694887644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e40116f0 con 0x7f59f40cba70 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59fa447700 1 -- 172.21.15.84:0/1694887644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f40c7cf0 con 0x7f59f40cba70 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59dbfff700 1 -- 172.21.15.84:0/1694887644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4011a90 con 0x7f59f40cba70 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.838+0000 7f59fa447700 1 -- 172.21.15.84:0/1694887644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f40c7a10 con 0x7f59f40cba70 2023-10-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.839+0000 7f59fa447700 1 -- 172.21.15.84:0/1694887644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f416d220 con 0x7f59f40cba70 2023-10-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.839+0000 7f59dbfff700 1 -- 172.21.15.84:0/1694887644 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59e401c460 con 0x7f59f40cba70 2023-10-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.840+0000 7f59dbfff700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f59e0066f30 0x7f59e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.840+0000 7f59dbfff700 1 -- 172.21.15.84:0/1694887644 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f59e4084140 con 0x7f59f40cba70 2023-10-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.840+0000 7f59f37fe700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f59e0066f30 0x7f59e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.840+0000 7f59f37fe700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f59e0066f30 0x7f59e00693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f59f40ccd20 tx=0x7f59e8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:41.844+0000 7f59dbfff700 1 -- 172.21.15.84:0/1694887644 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59e4051460 con 0x7f59f40cba70 2023-10-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.028+0000 7f59fa447700 1 -- 172.21.15.84:0/1694887644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59f4064ad0 con 0x7f59f40cba70 2023-10-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.029+0000 7f59dbfff700 1 -- 172.21.15.84:0/1694887644 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59e4054a80 con 0x7f59f40cba70 2023-10-06T03:25:42.031 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:25:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 -- 172.21.15.84:0/1694887644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f59e0066f30 msgr2=0x7f59e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f59e0066f30 0x7f59e00693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f59f40ccd20 tx=0x7f59e8016000 comp rx=0 tx=0).stop 2023-10-06T03:25:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 -- 172.21.15.84:0/1694887644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f40cba70 msgr2=0x7f59f416a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f40cba70 0x7f59f416a1f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c5b0 tx=0x7f59e40020e0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 -- 172.21.15.84:0/1694887644 shutdown_connections 2023-10-06T03:25:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f59e0066f30 0x7f59e00693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59f4159710 0x7f59f416d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59f40cba70 0x7f59f416a1f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 --2- 172.21.15.84:0/1694887644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59f4159340 0x7f59f4152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 -- 172.21.15.84:0/1694887644 >> 172.21.15.84:0/1694887644 conn(0x7f59f4099720 msgr2=0x7f59f40c5660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 -- 172.21.15.84:0/1694887644 shutdown_connections 2023-10-06T03:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.031+0000 7f59fa447700 1 -- 172.21.15.84:0/1694887644 wait complete. 2023-10-06T03:25:42.044 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:25:42.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.159+0000 7f5870c47700 1 Processor -- start 2023-10-06T03:25:42.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.159+0000 7f5870c47700 1 -- start start 2023-10-06T03:25:42.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5870c47700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f586c159510 0x7f586c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5870c47700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f586c1598e0 0x7f586c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5870c47700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586c0cf370 con 0x7f586c0ce820 2023-10-06T03:25:42.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5870c47700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586c0cf610 con 0x7f586c1598e0 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5870c47700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586c0cf8f0 con 0x7f586c159510 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5861d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f586c1598e0 0x7f586c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5861d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f586c1598e0 0x7f586c0cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55562/0 (socket says 172.21.15.84:55562) 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5861d9b700 1 -- 172.21.15.84:0/4231611784 learned_addr learned my addr 172.21.15.84:0/4231611784 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f586a59c700 1 --2- 172.21.15.84:0/4231611784 >> v2:172.21.15.131:3300/0 conn(0x7f586c159510 0x7f586c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5861d9b700 1 -- 172.21.15.84:0/4231611784 >> v2:172.21.15.131:3300/0 conn(0x7f586c159510 msgr2=0x7f586c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5861d9b700 1 --2- 172.21.15.84:0/4231611784 >> v2:172.21.15.131:3300/0 conn(0x7f586c159510 0x7f586c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5861d9b700 1 -- 172.21.15.84:0/4231611784 >> v1:172.21.15.131:6789/0 conn(0x7f586c0ce820 legacy=0x7f586c0cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.160+0000 7f5861d9b700 1 -- 172.21.15.84:0/4231611784 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c0cfbd0 con 0x7f586c1598e0 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5861d9b700 1 --2- 172.21.15.84:0/4231611784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c1598e0 0x7f586c0cbae0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f586c088fb0 tx=0x7f5854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f1f83b09fb4d96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:42.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5869d9b700 1 -- 172.21.15.84:0/4231611784 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400b860 con 0x7f586c1598e0 2023-10-06T03:25:42.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5869d9b700 1 -- 172.21.15.84:0/4231611784 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585400b9c0 con 0x7f586c1598e0 2023-10-06T03:25:42.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5869d9b700 1 -- 172.21.15.84:0/4231611784 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400bd60 con 0x7f586c1598e0 2023-10-06T03:25:42.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5870c47700 1 -- 172.21.15.84:0/4231611784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c1598e0 msgr2=0x7f586c0cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5870c47700 1 --2- 172.21.15.84:0/4231611784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c1598e0 0x7f586c0cbae0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f586c088fb0 tx=0x7f5854009250 comp rx=0 tx=0).stop 2023-10-06T03:25:42.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5870c47700 1 -- 172.21.15.84:0/4231611784 shutdown_connections 2023-10-06T03:25:42.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5870c47700 1 --2- 172.21.15.84:0/4231611784 >> v2:172.21.15.131:3300/0 conn(0x7f586c159510 0x7f586c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5870c47700 1 --2- 172.21.15.84:0/4231611784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c1598e0 0x7f586c0cbae0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5870c47700 1 -- 172.21.15.84:0/4231611784 >> 172.21.15.84:0/4231611784 conn(0x7f586c089e90 msgr2=0x7f586c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:42.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5870c47700 1 -- 172.21.15.84:0/4231611784 shutdown_connections 2023-10-06T03:25:42.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.161+0000 7f5870c47700 1 -- 172.21.15.84:0/4231611784 wait complete. 2023-10-06T03:25:42.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.162+0000 7f5870c47700 1 Processor -- start 2023-10-06T03:25:42.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.163+0000 7f5870c47700 1 -- start start 2023-10-06T03:25:42.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.163+0000 7f5870c47700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c0ce820 0x7f586c167f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.163+0000 7f5870c47700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f586c159510 0x7f586c16ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.163+0000 7f5870c47700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f586c1598e0 0x7f586c0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.163+0000 7f5870c47700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c153250 con 0x7f586c0ce820 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.163+0000 7f5870c47700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c16c610 con 0x7f586c159510 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.163+0000 7f5870c47700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c1684b0 con 0x7f586c1598e0 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.163+0000 7f586a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c0ce820 0x7f586c167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.163+0000 7f586a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c0ce820 0x7f586c167f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55564/0 (socket says 172.21.15.84:55564) 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.163+0000 7f586a59c700 1 -- 172.21.15.84:0/2404192816 learned_addr learned my addr 172.21.15.84:0/2404192816 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f5861d9b700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f586c159510 0x7f586c16ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f586a59c700 1 -- 172.21.15.84:0/2404192816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f586c1598e0 msgr2=0x7f586c0c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f586a59c700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f586c1598e0 0x7f586c0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f586a59c700 1 -- 172.21.15.84:0/2404192816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f586c159510 msgr2=0x7f586c16ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f586a59c700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f586c159510 0x7f586c16ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f586a59c700 1 -- 172.21.15.84:0/2404192816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58540094f0 con 0x7f586c0ce820 2023-10-06T03:25:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f5861d9b700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f586c159510 0x7f586c16ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:42.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f586a59c700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c0ce820 0x7f586c167f70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f585c00d8c0 tx=0x7f585c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:42.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f5862ffd700 1 -- 172.21.15.84:0/2404192816 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00de60 con 0x7f586c0ce820 2023-10-06T03:25:42.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f5862ffd700 1 -- 172.21.15.84:0/2404192816 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c00b780 con 0x7f586c0ce820 2023-10-06T03:25:42.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f5870c47700 1 -- 172.21.15.84:0/2404192816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586c16b2c0 con 0x7f586c0ce820 2023-10-06T03:25:42.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f5862ffd700 1 -- 172.21.15.84:0/2404192816 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00bb20 con 0x7f586c0ce820 2023-10-06T03:25:42.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.164+0000 7f5870c47700 1 -- 172.21.15.84:0/2404192816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586c16bfc0 con 0x7f586c0ce820 2023-10-06T03:25:42.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.165+0000 7f5870c47700 1 -- 172.21.15.84:0/2404192816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586c16c8f0 con 0x7f586c0ce820 2023-10-06T03:25:42.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.165+0000 7f5862ffd700 1 -- 172.21.15.84:0/2404192816 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f585c01e460 con 0x7f586c0ce820 2023-10-06T03:25:42.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.165+0000 7f5862ffd700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f584c066f30 0x7f584c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.166+0000 7f5862ffd700 1 -- 172.21.15.84:0/2404192816 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f585c084bb0 con 0x7f586c0ce820 2023-10-06T03:25:42.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.166+0000 7f5861d9b700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f584c066f30 0x7f584c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.166+0000 7f5861d9b700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f584c066f30 0x7f584c0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f586c08a870 tx=0x7f5854017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:42.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.170+0000 7f5862ffd700 1 -- 172.21.15.84:0/2404192816 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f585c051e30 con 0x7f586c0ce820 2023-10-06T03:25:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.350+0000 7f5870c47700 1 -- 172.21.15.84:0/2404192816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f586c0c53d0 con 0x7f586c0ce820 2023-10-06T03:25:42.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.351+0000 7f5862ffd700 1 -- 172.21.15.84:0/2404192816 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f585c055450 con 0x7f586c0ce820 2023-10-06T03:25:42.353 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:25:42.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 -- 172.21.15.84:0/2404192816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f584c066f30 msgr2=0x7f584c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f584c066f30 0x7f584c0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f586c08a870 tx=0x7f5854017000 comp rx=0 tx=0).stop 2023-10-06T03:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 -- 172.21.15.84:0/2404192816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c0ce820 msgr2=0x7f586c167f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c0ce820 0x7f586c167f70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f585c00d8c0 tx=0x7f585c008040 comp rx=0 tx=0).stop 2023-10-06T03:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 -- 172.21.15.84:0/2404192816 shutdown_connections 2023-10-06T03:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f584c066f30 0x7f584c0693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f586c1598e0 0x7f586c0c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f586c0ce820 0x7f586c167f70 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 --2- 172.21.15.84:0/2404192816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f586c159510 0x7f586c16ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 -- 172.21.15.84:0/2404192816 >> 172.21.15.84:0/2404192816 conn(0x7f586c089e90 msgr2=0x7f586c14c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 -- 172.21.15.84:0/2404192816 shutdown_connections 2023-10-06T03:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.353+0000 7f5870c47700 1 -- 172.21.15.84:0/2404192816 wait complete. 2023-10-06T03:25:42.367 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:25:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.479+0000 7f77558f0700 1 Processor -- start 2023-10-06T03:25:42.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.480+0000 7f77558f0700 1 -- start start 2023-10-06T03:25:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.480+0000 7f77558f0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77500b49e0 0x7f77500aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.480+0000 7f77558f0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500b07a0 0x7f77500b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.480+0000 7f77558f0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77500b0ca0 con 0x7f77501595a0 2023-10-06T03:25:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.480+0000 7f77558f0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77500b0f80 con 0x7f77500b49e0 2023-10-06T03:25:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.480+0000 7f77558f0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77500b1260 con 0x7f77500b07a0 2023-10-06T03:25:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.480+0000 7f77467fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77500b49e0 0x7f77500aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f77467fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77500b49e0 0x7f77500aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55568/0 (socket says 172.21.15.84:55568) 2023-10-06T03:25:42.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f77467fc700 1 -- 172.21.15.84:0/3914868651 learned_addr learned my addr 172.21.15.84:0/3914868651 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:42.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f774f7fe700 1 --2- 172.21.15.84:0/3914868651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500b07a0 0x7f77500b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f77467fc700 1 -- 172.21.15.84:0/3914868651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500b07a0 msgr2=0x7f77500b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:42.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f77467fc700 1 --2- 172.21.15.84:0/3914868651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500b07a0 0x7f77500b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f77467fc700 1 -- 172.21.15.84:0/3914868651 >> v1:172.21.15.131:6789/0 conn(0x7f77501595a0 legacy=0x7f77500aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f77467fc700 1 -- 172.21.15.84:0/3914868651 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77500b1540 con 0x7f77500b49e0 2023-10-06T03:25:42.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f774f7fe700 1 --2- 172.21.15.84:0/3914868651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500b07a0 0x7f77500b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:42.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f77467fc700 1 --2- 172.21.15.84:0/3914868651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 0x7f77500aac80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f77380099e0 tx=0x7f7738009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc639eaf6f05d12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:42.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f774e7fc700 1 -- 172.21.15.84:0/3914868651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800b820 con 0x7f77500b49e0 2023-10-06T03:25:42.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f774e7fc700 1 -- 172.21.15.84:0/3914868651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773800b980 con 0x7f77500b49e0 2023-10-06T03:25:42.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.481+0000 7f774e7fc700 1 -- 172.21.15.84:0/3914868651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800bd20 con 0x7f77500b49e0 2023-10-06T03:25:42.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.482+0000 7f77558f0700 1 -- 172.21.15.84:0/3914868651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 msgr2=0x7f77500aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.482+0000 7f77558f0700 1 --2- 172.21.15.84:0/3914868651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 0x7f77500aac80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f77380099e0 tx=0x7f7738009250 comp rx=0 tx=0).stop 2023-10-06T03:25:42.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.482+0000 7f77558f0700 1 -- 172.21.15.84:0/3914868651 shutdown_connections 2023-10-06T03:25:42.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.482+0000 7f77558f0700 1 --2- 172.21.15.84:0/3914868651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500b07a0 0x7f77500b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.482+0000 7f77558f0700 1 --2- 172.21.15.84:0/3914868651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 0x7f77500aac80 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.482+0000 7f77558f0700 1 -- 172.21.15.84:0/3914868651 >> 172.21.15.84:0/3914868651 conn(0x7f7750099830 msgr2=0x7f775006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:42.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.482+0000 7f77558f0700 1 -- 172.21.15.84:0/3914868651 shutdown_connections 2023-10-06T03:25:42.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.482+0000 7f77558f0700 1 -- 172.21.15.84:0/3914868651 wait complete. 2023-10-06T03:25:42.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.483+0000 7f77558f0700 1 Processor -- start 2023-10-06T03:25:42.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.483+0000 7f77558f0700 1 -- start start 2023-10-06T03:25:42.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77558f0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500b07a0 0x7f775009aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77558f0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 0x7f775015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77558f0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77501595a0 0x7f77501567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77558f0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775009c420 con 0x7f77500b49e0 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77558f0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775009b3a0 con 0x7f77501595a0 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77558f0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775009b680 con 0x7f77500b07a0 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77467fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 0x7f775015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77467fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 0x7f775015bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55570/0 (socket says 172.21.15.84:55570) 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77467fc700 1 -- 172.21.15.84:0/2315914113 learned_addr learned my addr 172.21.15.84:0/2315914113 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f774f7fe700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77501595a0 0x7f77501567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77467fc700 1 -- 172.21.15.84:0/2315914113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500b07a0 msgr2=0x7f775009aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77467fc700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500b07a0 0x7f775009aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77467fc700 1 -- 172.21.15.84:0/2315914113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77501595a0 msgr2=0x7f77501567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77467fc700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77501595a0 0x7f77501567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77467fc700 1 -- 172.21.15.84:0/2315914113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77380094f0 con 0x7f77500b49e0 2023-10-06T03:25:42.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77467fc700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 0x7f775015bb40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f77380090b0 tx=0x7f7738017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:42.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77477fe700 1 -- 172.21.15.84:0/2315914113 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738011e90 con 0x7f77500b49e0 2023-10-06T03:25:42.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77477fe700 1 -- 172.21.15.84:0/2315914113 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773801f070 con 0x7f77500b49e0 2023-10-06T03:25:42.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77477fe700 1 -- 172.21.15.84:0/2315914113 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77380266d0 con 0x7f77500b49e0 2023-10-06T03:25:42.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77558f0700 1 -- 172.21.15.84:0/2315914113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775009b960 con 0x7f77500b49e0 2023-10-06T03:25:42.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.484+0000 7f77558f0700 1 -- 172.21.15.84:0/2315914113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775009bf20 con 0x7f77500b49e0 2023-10-06T03:25:42.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.485+0000 7f77558f0700 1 -- 172.21.15.84:0/2315914113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7750064ad0 con 0x7f77500b49e0 2023-10-06T03:25:42.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.486+0000 7f77477fe700 1 -- 172.21.15.84:0/2315914113 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7738026ac0 con 0x7f77500b49e0 2023-10-06T03:25:42.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.486+0000 7f77477fe700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7730066f30 0x7f77300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.486+0000 7f77477fe700 1 -- 172.21.15.84:0/2315914113 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7738021070 con 0x7f77500b49e0 2023-10-06T03:25:42.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.486+0000 7f774effd700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7730066f30 0x7f77300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.486+0000 7f774effd700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7730066f30 0x7f77300693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7740001640 tx=0x7f7740007b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:42.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.490+0000 7f77477fe700 1 -- 172.21.15.84:0/2315914113 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7738053680 con 0x7f77500b49e0 2023-10-06T03:25:42.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.675+0000 7f77558f0700 1 -- 172.21.15.84:0/2315914113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f77500b1820 con 0x7f77500b49e0 2023-10-06T03:25:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.675+0000 7f77477fe700 1 -- 172.21.15.84:0/2315914113 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7738056ca0 con 0x7f77500b49e0 2023-10-06T03:25:42.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:42.677 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T03:25:42.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:42.677 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T03:25:42.677 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T03:25:42.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:25:42.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:25:42.678 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T03:25:42.678 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T03:25:42.678 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:25:42.678 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T03:25:42.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 -- 172.21.15.84:0/2315914113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7730066f30 msgr2=0x7f77300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7730066f30 0x7f77300693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7740001640 tx=0x7f7740007b90 comp rx=0 tx=0).stop 2023-10-06T03:25:42.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 -- 172.21.15.84:0/2315914113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 msgr2=0x7f775015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 0x7f775015bb40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f77380090b0 tx=0x7f7738017000 comp rx=0 tx=0).stop 2023-10-06T03:25:42.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 -- 172.21.15.84:0/2315914113 shutdown_connections 2023-10-06T03:25:42.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7730066f30 0x7f77300693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77501595a0 0x7f77501567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500b07a0 0x7f775009aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 --2- 172.21.15.84:0/2315914113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500b49e0 0x7f775015bb40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 -- 172.21.15.84:0/2315914113 >> 172.21.15.84:0/2315914113 conn(0x7f7750099830 msgr2=0x7f77500694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:42.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 -- 172.21.15.84:0/2315914113 shutdown_connections 2023-10-06T03:25:42.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.677+0000 7f77558f0700 1 -- 172.21.15.84:0/2315914113 wait complete. 2023-10-06T03:25:42.691 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:25:42.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:25:42.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.807+0000 7f6d3bac3700 1 Processor -- start 2023-10-06T03:25:42.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.807+0000 7f6d3bac3700 1 -- start start 2023-10-06T03:25:42.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.808+0000 7f6d3bac3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6d3406ed20 0x7f6d340b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.808+0000 7f6d3bac3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d340aee20 0x7f6d340af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.808+0000 7f6d3bac3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d340b2d20 con 0x7f6d3406f0f0 2023-10-06T03:25:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.808+0000 7f6d3bac3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3406fb80 con 0x7f6d3406ed20 2023-10-06T03:25:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.808+0000 7f6d3bac3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d340b0450 con 0x7f6d340aee20 2023-10-06T03:25:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.808+0000 7f6d3905e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6d3406f0f0 0x7f6d340b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49216/0 (socket says 172.21.15.84:49216) 2023-10-06T03:25:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.808+0000 7f6d3905e700 1 -- 172.21.15.84:0/1942065595 learned_addr learned my addr 172.21.15.84:0/1942065595 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.808+0000 7f6d3a060700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d340aee20 0x7f6d340af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.808+0000 7f6d3985f700 1 --2- 172.21.15.84:0/1942065595 >> v2:172.21.15.131:3300/0 conn(0x7f6d3406ed20 0x7f6d340b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.808+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027723369 0 0) 0x7f6d340b2d20 con 0x7f6d3406f0f0 2023-10-06T03:25:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d20003570 con 0x7f6d3406f0f0 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3401867789 0 0) 0x7f6d20003570 con 0x7f6d3406f0f0 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d340aee20 msgr2=0x7f6d340af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d340aee20 0x7f6d340af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 >> v2:172.21.15.131:3300/0 conn(0x7f6d3406ed20 msgr2=0x7f6d340b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 --2- 172.21.15.84:0/1942065595 >> v2:172.21.15.131:3300/0 conn(0x7f6d3406ed20 0x7f6d340b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d340af7c0 con 0x7f6d3406f0f0 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f6d24001470 con 0x7f6d3406f0f0 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 >> v1:172.21.15.84:6789/0 conn(0x7f6d3406f0f0 legacy=0x7f6d340b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d340aee20 0x7f6d20003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d20003fe0 0x7f6d20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d20004d50 0x7f6d200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d340b0450 con 0x7f6d20003fe0 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2000ba60 con 0x7f6d20004d50 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2000bbd0 con 0x7f6d340aee20 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3905e700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d20003fe0 0x7f6d20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3985f700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d340aee20 0x7f6d20003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3a060700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d20004d50 0x7f6d200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3905e700 1 -- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d340aee20 msgr2=0x7f6d20003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3905e700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d340aee20 0x7f6d20003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3905e700 1 -- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d20004d50 msgr2=0x7f6d200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3905e700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d20004d50 0x7f6d200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3905e700 1 -- 172.21.15.84:0/1942065595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20003570 con 0x7f6d20003fe0 2023-10-06T03:25:42.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3905e700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d20003fe0 0x7f6d20004810 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400c3c0 tx=0x7f6d24001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8809e85664f91a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:42.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.809+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2400cc30 con 0x7f6d20003fe0 2023-10-06T03:25:42.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.810+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2400cdb0 con 0x7f6d20003fe0 2023-10-06T03:25:42.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.810+0000 7f6d3885d700 1 -- 172.21.15.84:0/1942065595 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24005b70 con 0x7f6d20003fe0 2023-10-06T03:25:42.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.810+0000 7f6d3bac3700 1 -- 172.21.15.84:0/1942065595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d20003fe0 msgr2=0x7f6d20004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.810+0000 7f6d3bac3700 1 --2- 172.21.15.84:0/1942065595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d20003fe0 0x7f6d20004810 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400c3c0 tx=0x7f6d24001e90 comp rx=0 tx=0).stop 2023-10-06T03:25:42.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.810+0000 7f6d3a060700 1 -- 172.21.15.84:0/1942065595 reap_dead start 2023-10-06T03:25:42.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.810+0000 7f6d3bac3700 1 -- 172.21.15.84:0/1942065595 shutdown_connections 2023-10-06T03:25:42.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.810+0000 7f6d3bac3700 1 -- 172.21.15.84:0/1942065595 >> 172.21.15.84:0/1942065595 conn(0x7f6d34068330 msgr2=0x7f6d34068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:42.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.810+0000 7f6d3bac3700 1 -- 172.21.15.84:0/1942065595 shutdown_connections 2023-10-06T03:25:42.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.810+0000 7f6d3bac3700 1 -- 172.21.15.84:0/1942065595 wait complete. 2023-10-06T03:25:42.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.811+0000 7f6d3bac3700 1 Processor -- start 2023-10-06T03:25:42.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.811+0000 7f6d3bac3700 1 -- start start 2023-10-06T03:25:42.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3bac3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d20003fe0 0x7f6d3416a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3bac3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d3415a140 0x7f6d340c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3bac3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d340c7a20 0x7f6d340c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3bac3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3415b210 con 0x7f6d3415a140 2023-10-06T03:25:42.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3bac3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3415a600 con 0x7f6d340c7a20 2023-10-06T03:25:42.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3bac3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3415a8e0 con 0x7f6d20003fe0 2023-10-06T03:25:42.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3905e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d3415a140 0x7f6d340c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3905e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d3415a140 0x7f6d340c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55582/0 (socket says 172.21.15.84:55582) 2023-10-06T03:25:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3905e700 1 -- 172.21.15.84:0/2278332130 learned_addr learned my addr 172.21.15.84:0/2278332130 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3985f700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d20003fe0 0x7f6d3416a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3a060700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d340c7a20 0x7f6d340c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3905e700 1 -- 172.21.15.84:0/2278332130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d20003fe0 msgr2=0x7f6d3416a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3905e700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d20003fe0 0x7f6d3416a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3905e700 1 -- 172.21.15.84:0/2278332130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d340c7a20 msgr2=0x7f6d340c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3905e700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d340c7a20 0x7f6d340c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.812+0000 7f6d3905e700 1 -- 172.21.15.84:0/2278332130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3415abc0 con 0x7f6d3415a140 2023-10-06T03:25:42.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.813+0000 7f6d3905e700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d3415a140 0x7f6d340c74e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6d24000c00 tx=0x7f6d24015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:42.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.813+0000 7f6d29ffb700 1 -- 172.21.15.84:0/2278332130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2400cc30 con 0x7f6d3415a140 2023-10-06T03:25:42.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.813+0000 7f6d29ffb700 1 -- 172.21.15.84:0/2278332130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d24001430 con 0x7f6d3415a140 2023-10-06T03:25:42.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.813+0000 7f6d3bac3700 1 -- 172.21.15.84:0/2278332130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3415aea0 con 0x7f6d3415a140 2023-10-06T03:25:42.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.813+0000 7f6d29ffb700 1 -- 172.21.15.84:0/2278332130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2401e400 con 0x7f6d3415a140 2023-10-06T03:25:42.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.813+0000 7f6d3bac3700 1 -- 172.21.15.84:0/2278332130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3415b6a0 con 0x7f6d3415a140 2023-10-06T03:25:42.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.814+0000 7f6d3bac3700 1 -- 172.21.15.84:0/2278332130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d340c83d0 con 0x7f6d3415a140 2023-10-06T03:25:42.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.814+0000 7f6d29ffb700 1 -- 172.21.15.84:0/2278332130 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d24019030 con 0x7f6d3415a140 2023-10-06T03:25:42.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.814+0000 7f6d29ffb700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6d18066f60 0x7f6d18069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:42.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.815+0000 7f6d29ffb700 1 -- 172.21.15.84:0/2278332130 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6d240854a0 con 0x7f6d3415a140 2023-10-06T03:25:42.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.815+0000 7f6d3985f700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6d18066f60 0x7f6d18069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:42.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.815+0000 7f6d3985f700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6d18066f60 0x7f6d18069410 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006f00 tx=0x7f6d300091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:42.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:42.819+0000 7f6d29ffb700 1 -- 172.21.15.84:0/2278332130 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d240527c0 con 0x7f6d3415a140 2023-10-06T03:25:43.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.003+0000 7f6d3bac3700 1 -- 172.21.15.84:0/2278332130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6d34064ad0 con 0x7f6d3415a140 2023-10-06T03:25:43.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.984+0000 7f6d29ffb700 1 -- 172.21.15.84:0/2278332130 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6d24055de0 con 0x7f6d3415a140 2023-10-06T03:25:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.988+0000 7f6d3bac3700 1 -- 172.21.15.84:0/2278332130 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6d18066f60 msgr2=0x7f6d18069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.988+0000 7f6d3bac3700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6d18066f60 0x7f6d18069410 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006f00 tx=0x7f6d300091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.988+0000 7f6d3bac3700 1 -- 172.21.15.84:0/2278332130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d3415a140 msgr2=0x7f6d340c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.988+0000 7f6d3bac3700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d3415a140 0x7f6d340c74e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6d24000c00 tx=0x7f6d24015000 comp rx=0 tx=0).stop 2023-10-06T03:25:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.989+0000 7f6d3bac3700 1 -- 172.21.15.84:0/2278332130 shutdown_connections 2023-10-06T03:25:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.989+0000 7f6d3bac3700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6d18066f60 0x7f6d18069410 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.989+0000 7f6d3bac3700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d340c7a20 0x7f6d340c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.989+0000 7f6d3bac3700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d20003fe0 0x7f6d3416a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:43.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.989+0000 7f6d3bac3700 1 --2- 172.21.15.84:0/2278332130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d3415a140 0x7f6d340c74e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:43.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.989+0000 7f6d3bac3700 1 -- 172.21.15.84:0/2278332130 >> 172.21.15.84:0/2278332130 conn(0x7f6d34068330 msgr2=0x7f6d34156880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:43.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.989+0000 7f6d3bac3700 1 -- 172.21.15.84:0/2278332130 shutdown_connections 2023-10-06T03:25:43.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:43.989+0000 7f6d3bac3700 1 -- 172.21.15.84:0/2278332130 wait complete. 2023-10-06T03:25:43.992 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T03:25:44.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:25:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.126+0000 7f4052c32700 1 Processor -- start 2023-10-06T03:25:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.126+0000 7f4052c32700 1 -- start start 2023-10-06T03:25:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f4052c32700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f404c159510 0x7f404c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f4052c32700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f404c1598e0 0x7f404c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f4052c32700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f404c0ce820 0x7f404c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f4052c32700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c0cf610 con 0x7f404c0ce820 2023-10-06T03:25:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f4052c32700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c0cf8f0 con 0x7f404c1598e0 2023-10-06T03:25:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f4052c32700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0cfbd0 con 0x7f404c159510 2023-10-06T03:25:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f40511cf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f404c0ce820 0x7f404c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f40511cf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f404c0ce820 0x7f404c0cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55588/0 (socket says 172.21.15.84:55588) 2023-10-06T03:25:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f40511cf700 1 -- 172.21.15.84:0/1890466722 learned_addr learned my addr 172.21.15.84:0/1890466722 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f40509ce700 1 --2- 172.21.15.84:0/1890466722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f404c159510 0x7f404c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f404bfff700 1 --2- 172.21.15.84:0/1890466722 >> v2:172.21.15.131:3300/0 conn(0x7f404c1598e0 0x7f404c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f40511cf700 1 -- 172.21.15.84:0/1890466722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f404c159510 msgr2=0x7f404c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f40511cf700 1 --2- 172.21.15.84:0/1890466722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f404c159510 0x7f404c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f40511cf700 1 -- 172.21.15.84:0/1890466722 >> v2:172.21.15.131:3300/0 conn(0x7f404c1598e0 msgr2=0x7f404c0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f40511cf700 1 --2- 172.21.15.84:0/1890466722 >> v2:172.21.15.131:3300/0 conn(0x7f404c1598e0 0x7f404c0cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.127+0000 7f40511cf700 1 -- 172.21.15.84:0/1890466722 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0cfeb0 con 0x7f404c0ce820 2023-10-06T03:25:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f40511cf700 1 --2- 172.21.15.84:0/1890466722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 0x7f404c0cec40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f404c089360 tx=0x7f4044009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6025f2a13656c26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f404b7fe700 1 -- 172.21.15.84:0/1890466722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404400e070 con 0x7f404c0ce820 2023-10-06T03:25:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f404b7fe700 1 -- 172.21.15.84:0/1890466722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404400ba50 con 0x7f404c0ce820 2023-10-06T03:25:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f404b7fe700 1 -- 172.21.15.84:0/1890466722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440092e0 con 0x7f404c0ce820 2023-10-06T03:25:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f4052c32700 1 -- 172.21.15.84:0/1890466722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 msgr2=0x7f404c0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f4052c32700 1 --2- 172.21.15.84:0/1890466722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 0x7f404c0cec40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f404c089360 tx=0x7f4044009840 comp rx=0 tx=0).stop 2023-10-06T03:25:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f4052c32700 1 -- 172.21.15.84:0/1890466722 shutdown_connections 2023-10-06T03:25:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f4052c32700 1 --2- 172.21.15.84:0/1890466722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 0x7f404c0cec40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f4052c32700 1 --2- 172.21.15.84:0/1890466722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f404c159510 0x7f404c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f4052c32700 1 --2- 172.21.15.84:0/1890466722 >> v2:172.21.15.131:3300/0 conn(0x7f404c1598e0 0x7f404c0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f4052c32700 1 -- 172.21.15.84:0/1890466722 >> 172.21.15.84:0/1890466722 conn(0x7f404c089e90 msgr2=0x7f404c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f4052c32700 1 -- 172.21.15.84:0/1890466722 shutdown_connections 2023-10-06T03:25:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.128+0000 7f4052c32700 1 -- 172.21.15.84:0/1890466722 wait complete. 2023-10-06T03:25:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.129+0000 7f4052c32700 1 Processor -- start 2023-10-06T03:25:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f4052c32700 1 -- start start 2023-10-06T03:25:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f4052c32700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 0x7f404c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f4052c32700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f404c159510 0x7f404c0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f4052c32700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f404c1598e0 0x7f404c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f4052c32700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0b37f0 con 0x7f404c0ce820 2023-10-06T03:25:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f4052c32700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0b3a60 con 0x7f404c1598e0 2023-10-06T03:25:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f4052c32700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0b3d40 con 0x7f404c159510 2023-10-06T03:25:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f40509ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 0x7f404c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f40509ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 0x7f404c0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55602/0 (socket says 172.21.15.84:55602) 2023-10-06T03:25:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f40509ce700 1 -- 172.21.15.84:0/4289220212 learned_addr learned my addr 172.21.15.84:0/4289220212 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f40511cf700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f404c1598e0 0x7f404c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.130+0000 7f404bfff700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f404c159510 0x7f404c0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f40509ce700 1 -- 172.21.15.84:0/4289220212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f404c159510 msgr2=0x7f404c0c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f40509ce700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f404c159510 0x7f404c0c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f40509ce700 1 -- 172.21.15.84:0/4289220212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f404c1598e0 msgr2=0x7f404c0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f40509ce700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f404c1598e0 0x7f404c0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f40509ce700 1 -- 172.21.15.84:0/4289220212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044009ae0 con 0x7f404c0ce820 2023-10-06T03:25:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f40509ce700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 0x7f404c0c9650 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f404000d890 tx=0x7f4040008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f4048ff9700 1 -- 172.21.15.84:0/4289220212 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400125f0 con 0x7f404c0ce820 2023-10-06T03:25:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f4048ff9700 1 -- 172.21.15.84:0/4289220212 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4040012750 con 0x7f404c0ce820 2023-10-06T03:25:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f4048ff9700 1 -- 172.21.15.84:0/4289220212 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040012af0 con 0x7f404c0ce820 2023-10-06T03:25:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f4052c32700 1 -- 172.21.15.84:0/4289220212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c0b4020 con 0x7f404c0ce820 2023-10-06T03:25:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.131+0000 7f4052c32700 1 -- 172.21.15.84:0/4289220212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c148430 con 0x7f404c0ce820 2023-10-06T03:25:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.132+0000 7f4052c32700 1 -- 172.21.15.84:0/4289220212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c064ad0 con 0x7f404c0ce820 2023-10-06T03:25:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.132+0000 7f4048ff9700 1 -- 172.21.15.84:0/4289220212 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f404001e460 con 0x7f404c0ce820 2023-10-06T03:25:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.133+0000 7f4048ff9700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4030066f30 0x7f40300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.133+0000 7f4048ff9700 1 -- 172.21.15.84:0/4289220212 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f4040084b60 con 0x7f404c0ce820 2023-10-06T03:25:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.133+0000 7f404bfff700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4030066f30 0x7f40300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.133+0000 7f404bfff700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4030066f30 0x7f40300693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f404c153110 tx=0x7f4038008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.137+0000 7f4048ff9700 1 -- 172.21.15.84:0/4289220212 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4040051d10 con 0x7f404c0ce820 2023-10-06T03:25:44.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.321+0000 7f4052c32700 1 -- 172.21.15.84:0/4289220212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f404c0cf180 con 0x7f404c0ce820 2023-10-06T03:25:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.987+0000 7f4048ff9700 1 -- 172.21.15.84:0/4289220212 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4040055330 con 0x7f404c0ce820 2023-10-06T03:25:44.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.992+0000 7f4052c32700 1 -- 172.21.15.84:0/4289220212 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4030066f30 msgr2=0x7f40300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.992+0000 7f4052c32700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4030066f30 0x7f40300693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f404c153110 tx=0x7f4038008040 comp rx=0 tx=0).stop 2023-10-06T03:25:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.992+0000 7f4052c32700 1 -- 172.21.15.84:0/4289220212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 msgr2=0x7f404c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.992+0000 7f4052c32700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 0x7f404c0c9650 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f404000d890 tx=0x7f4040008040 comp rx=0 tx=0).stop 2023-10-06T03:25:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.993+0000 7f4052c32700 1 -- 172.21.15.84:0/4289220212 shutdown_connections 2023-10-06T03:25:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.993+0000 7f4052c32700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4030066f30 0x7f40300693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.993+0000 7f4052c32700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f404c1598e0 0x7f404c0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:44.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.993+0000 7f4052c32700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f404c0ce820 0x7f404c0c9650 secure :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f404000d890 tx=0x7f4040008040 comp rx=0 tx=0).stop 2023-10-06T03:25:44.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.993+0000 7f4052c32700 1 --2- 172.21.15.84:0/4289220212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f404c159510 0x7f404c0c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:44.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.993+0000 7f4052c32700 1 -- 172.21.15.84:0/4289220212 >> 172.21.15.84:0/4289220212 conn(0x7f404c089e90 msgr2=0x7f404c14b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:44.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.994+0000 7f4052c32700 1 -- 172.21.15.84:0/4289220212 shutdown_connections 2023-10-06T03:25:44.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:44.996+0000 7f4052c32700 1 -- 172.21.15.84:0/4289220212 wait complete. 2023-10-06T03:25:45.000 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T03:25:45.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:25:45.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.132+0000 7fb338a00700 1 Processor -- start 2023-10-06T03:25:45.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.132+0000 7fb338a00700 1 -- start start 2023-10-06T03:25:45.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb338a00700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb3340b2660 0x7fb3340cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:45.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb338a00700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb3340cf1f0 0x7fb3340cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:45.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb338a00700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3340cc9b0 con 0x7fb3340b2a30 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb338a00700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3340cbda0 con 0x7fb3340cf1f0 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb338a00700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3340cc080 con 0x7fb3340b2660 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb333fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb3340cf1f0 0x7fb3340cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb332ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb3340b2a30 0x7fb3340ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49228/0 (socket says 172.21.15.84:49228) 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb332ffd700 1 -- 172.21.15.84:0/1018980215 learned_addr learned my addr 172.21.15.84:0/1018980215 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb3337fe700 1 --2- 172.21.15.84:0/1018980215 >> v2:172.21.15.131:3300/0 conn(0x7fb3340b2660 0x7fb3340cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb333fff700 1 -- 172.21.15.84:0/1018980215 >> v2:172.21.15.131:3300/0 conn(0x7fb3340b2660 msgr2=0x7fb3340cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb333fff700 1 --2- 172.21.15.84:0/1018980215 >> v2:172.21.15.131:3300/0 conn(0x7fb3340b2660 0x7fb3340cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb333fff700 1 -- 172.21.15.84:0/1018980215 >> v1:172.21.15.84:6789/0 conn(0x7fb3340b2a30 legacy=0x7fb3340ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb333fff700 1 -- 172.21.15.84:0/1018980215 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3340cc360 con 0x7fb3340cf1f0 2023-10-06T03:25:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.133+0000 7fb3327fc700 1 -- 172.21.15.84:0/1018980215 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063934516 0 0) 0x7fb3340cc9b0 con 0x7fb3340b2a30 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb333fff700 1 --2- 172.21.15.84:0/1018980215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340cf1f0 0x7fb3340cd230 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb334089500 tx=0x7fb32c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d631b06ad7a72c21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb3327fc700 1 -- 172.21.15.84:0/1018980215 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c00b6b0 con 0x7fb3340cf1f0 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb3327fc700 1 -- 172.21.15.84:0/1018980215 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c00b810 con 0x7fb3340cf1f0 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb3327fc700 1 -- 172.21.15.84:0/1018980215 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c00bbb0 con 0x7fb3340cf1f0 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb338a00700 1 -- 172.21.15.84:0/1018980215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340cf1f0 msgr2=0x7fb3340cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb338a00700 1 --2- 172.21.15.84:0/1018980215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340cf1f0 0x7fb3340cd230 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb334089500 tx=0x7fb32c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb338a00700 1 -- 172.21.15.84:0/1018980215 shutdown_connections 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb338a00700 1 --2- 172.21.15.84:0/1018980215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340cf1f0 0x7fb3340cd230 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb338a00700 1 --2- 172.21.15.84:0/1018980215 >> v2:172.21.15.131:3300/0 conn(0x7fb3340b2660 0x7fb3340cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb338a00700 1 -- 172.21.15.84:0/1018980215 >> 172.21.15.84:0/1018980215 conn(0x7fb334099560 msgr2=0x7fb33406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb338a00700 1 -- 172.21.15.84:0/1018980215 shutdown_connections 2023-10-06T03:25:45.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.134+0000 7fb338a00700 1 -- 172.21.15.84:0/1018980215 wait complete. 2023-10-06T03:25:45.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb338a00700 1 Processor -- start 2023-10-06T03:25:45.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb338a00700 1 -- start start 2023-10-06T03:25:45.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb338a00700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3340b2660 0x7fb3340b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:45.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb338a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340b2a30 0x7fb3340c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:45.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb338a00700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3340cf1f0 0x7fb33414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb338a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340b5600 con 0x7fb3340b2a30 2023-10-06T03:25:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb338a00700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340c7460 con 0x7fb3340b2660 2023-10-06T03:25:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb338a00700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340c7740 con 0x7fb3340cf1f0 2023-10-06T03:25:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb332ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340b2a30 0x7fb3340c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb332ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340b2a30 0x7fb3340c6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55618/0 (socket says 172.21.15.84:55618) 2023-10-06T03:25:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.136+0000 7fb332ffd700 1 -- 172.21.15.84:0/2907221899 learned_addr learned my addr 172.21.15.84:0/2907221899 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb3337fe700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3340b2660 0x7fb3340b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb333fff700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3340cf1f0 0x7fb33414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb332ffd700 1 -- 172.21.15.84:0/2907221899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3340cf1f0 msgr2=0x7fb33414bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb332ffd700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3340cf1f0 0x7fb33414bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb332ffd700 1 -- 172.21.15.84:0/2907221899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3340b2660 msgr2=0x7fb3340b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb332ffd700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3340b2660 0x7fb3340b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb332ffd700 1 -- 172.21.15.84:0/2907221899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c009420 con 0x7fb3340b2a30 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb3337fe700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3340b2660 0x7fb3340b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb332ffd700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340b2a30 0x7fb3340c6660 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb32800c810 tx=0x7fb328007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb31b7fe700 1 -- 172.21.15.84:0/2907221899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb328005c00 con 0x7fb3340b2a30 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb31b7fe700 1 -- 172.21.15.84:0/2907221899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb328005d60 con 0x7fb3340b2a30 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb338a00700 1 -- 172.21.15.84:0/2907221899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3340c7a20 con 0x7fb3340b2a30 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb31b7fe700 1 -- 172.21.15.84:0/2907221899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb328007320 con 0x7fb3340b2a30 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.137+0000 7fb338a00700 1 -- 172.21.15.84:0/2907221899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3340b5f00 con 0x7fb3340b2a30 2023-10-06T03:25:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.138+0000 7fb338a00700 1 -- 172.21.15.84:0/2907221899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33405f270 con 0x7fb3340b2a30 2023-10-06T03:25:45.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.139+0000 7fb31b7fe700 1 -- 172.21.15.84:0/2907221899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb32801b400 con 0x7fb3340b2a30 2023-10-06T03:25:45.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.139+0000 7fb31b7fe700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb320066f30 0x7fb3200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:45.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.139+0000 7fb3337fe700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb320066f30 0x7fb3200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:45.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.139+0000 7fb31b7fe700 1 -- 172.21.15.84:0/2907221899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fb328084320 con 0x7fb3340b2a30 2023-10-06T03:25:45.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.140+0000 7fb3337fe700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb320066f30 0x7fb3200693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb324007540 tx=0x7fb32400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:45.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.144+0000 7fb31b7fe700 1 -- 172.21.15.84:0/2907221899 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3280513d0 con 0x7fb3340b2a30 2023-10-06T03:25:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:45.370+0000 7fb338a00700 1 -- 172.21.15.84:0/2907221899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb3340cc640 con 0x7fb3340b2a30 2023-10-06T03:25:46.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.000+0000 7fb31b7fe700 1 -- 172.21.15.84:0/2907221899 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v28) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb3280549f0 con 0x7fb3340b2a30 2023-10-06T03:25:46.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.004+0000 7fb338a00700 1 -- 172.21.15.84:0/2907221899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb320066f30 msgr2=0x7fb3200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.004+0000 7fb338a00700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb320066f30 0x7fb3200693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb324007540 tx=0x7fb32400b040 comp rx=0 tx=0).stop 2023-10-06T03:25:46.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.004+0000 7fb338a00700 1 -- 172.21.15.84:0/2907221899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340b2a30 msgr2=0x7fb3340c6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.004+0000 7fb338a00700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340b2a30 0x7fb3340c6660 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb32800c810 tx=0x7fb328007db0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.005+0000 7fb338a00700 1 -- 172.21.15.84:0/2907221899 shutdown_connections 2023-10-06T03:25:46.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.005+0000 7fb338a00700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb320066f30 0x7fb3200693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.005+0000 7fb338a00700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3340b2660 0x7fb3340b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.005+0000 7fb338a00700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3340cf1f0 0x7fb33414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.005+0000 7fb338a00700 1 --2- 172.21.15.84:0/2907221899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3340b2a30 0x7fb3340c6660 secure :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb32800c810 tx=0x7fb328007db0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.005+0000 7fb338a00700 1 -- 172.21.15.84:0/2907221899 >> 172.21.15.84:0/2907221899 conn(0x7fb334099560 msgr2=0x7fb3340cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:46.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.010+0000 7fb338a00700 1 -- 172.21.15.84:0/2907221899 shutdown_connections 2023-10-06T03:25:46.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.010+0000 7fb338a00700 1 -- 172.21.15.84:0/2907221899 wait complete. 2023-10-06T03:25:46.020 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 10 and data pool 11 2023-10-06T03:25:46.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:46.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.149+0000 7efd854a5700 1 Processor -- start 2023-10-06T03:25:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.149+0000 7efd854a5700 1 -- start start 2023-10-06T03:25:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.149+0000 7efd854a5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015a8b0 0x7efd800ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.149+0000 7efd854a5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efd8015ac80 0x7efd800c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd854a5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efd800cef00 0x7efd800c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd854a5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800cdb80 con 0x7efd8015ac80 2023-10-06T03:25:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd854a5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800ccf70 con 0x7efd800cef00 2023-10-06T03:25:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd854a5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd800cd250 con 0x7efd8015a8b0 2023-10-06T03:25:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7e7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efd8015ac80 0x7efd800c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7e7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efd8015ac80 0x7efd800c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55620/0 (socket says 172.21.15.84:55620) 2023-10-06T03:25:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7e7fc700 1 -- 172.21.15.84:0/4248232084 learned_addr learned my addr 172.21.15.84:0/4248232084 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:46.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7f7fe700 1 --2- 172.21.15.84:0/4248232084 >> v2:172.21.15.131:3300/0 conn(0x7efd800cef00 0x7efd800c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7e7fc700 1 -- 172.21.15.84:0/4248232084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015a8b0 msgr2=0x7efd800ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7effd700 1 --2- 172.21.15.84:0/4248232084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015a8b0 0x7efd800ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7e7fc700 1 --2- 172.21.15.84:0/4248232084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015a8b0 0x7efd800ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7e7fc700 1 -- 172.21.15.84:0/4248232084 >> v2:172.21.15.131:3300/0 conn(0x7efd800cef00 msgr2=0x7efd800c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7e7fc700 1 --2- 172.21.15.84:0/4248232084 >> v2:172.21.15.131:3300/0 conn(0x7efd800cef00 0x7efd800c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7e7fc700 1 -- 172.21.15.84:0/4248232084 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd800cd530 con 0x7efd8015ac80 2023-10-06T03:25:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7f7fe700 1 --2- 172.21.15.84:0/4248232084 >> v2:172.21.15.131:3300/0 conn(0x7efd800cef00 0x7efd800c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7effd700 1 --2- 172.21.15.84:0/4248232084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015a8b0 0x7efd800ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7e7fc700 1 --2- 172.21.15.84:0/4248232084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015ac80 0x7efd800c8850 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7efd80070420 tx=0x7efd74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3285468ad06923 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7dffb700 1 -- 172.21.15.84:0/4248232084 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400b860 con 0x7efd8015ac80 2023-10-06T03:25:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7dffb700 1 -- 172.21.15.84:0/4248232084 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7400b9c0 con 0x7efd8015ac80 2023-10-06T03:25:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.150+0000 7efd7dffb700 1 -- 172.21.15.84:0/4248232084 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400bd60 con 0x7efd8015ac80 2023-10-06T03:25:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.151+0000 7efd854a5700 1 -- 172.21.15.84:0/4248232084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015ac80 msgr2=0x7efd800c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.151+0000 7efd854a5700 1 --2- 172.21.15.84:0/4248232084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015ac80 0x7efd800c8850 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7efd80070420 tx=0x7efd74009250 comp rx=0 tx=0).stop 2023-10-06T03:25:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.151+0000 7efd854a5700 1 -- 172.21.15.84:0/4248232084 shutdown_connections 2023-10-06T03:25:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.151+0000 7efd854a5700 1 --2- 172.21.15.84:0/4248232084 >> v2:172.21.15.131:3300/0 conn(0x7efd800cef00 0x7efd800c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.151+0000 7efd854a5700 1 --2- 172.21.15.84:0/4248232084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015a8b0 0x7efd800ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.151+0000 7efd854a5700 1 --2- 172.21.15.84:0/4248232084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015ac80 0x7efd800c8850 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.151+0000 7efd854a5700 1 -- 172.21.15.84:0/4248232084 >> 172.21.15.84:0/4248232084 conn(0x7efd80067dd0 msgr2=0x7efd800ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:46.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.151+0000 7efd854a5700 1 -- 172.21.15.84:0/4248232084 shutdown_connections 2023-10-06T03:25:46.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.151+0000 7efd854a5700 1 -- 172.21.15.84:0/4248232084 wait complete. 2023-10-06T03:25:46.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.152+0000 7efd854a5700 1 Processor -- start 2023-10-06T03:25:46.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.152+0000 7efd854a5700 1 -- start start 2023-10-06T03:25:46.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd854a5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd800cef00 0x7efd800c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd854a5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015a8b0 0x7efd800c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd854a5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015ac80 0x7efd80151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd854a5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd800c5ba0 con 0x7efd8015a8b0 2023-10-06T03:25:46.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd854a5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd800c5e80 con 0x7efd800cef00 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd854a5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd800c6160 con 0x7efd8015ac80 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015a8b0 0x7efd800c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015a8b0 0x7efd800c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55622/0 (socket says 172.21.15.84:55622) 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7e7fc700 1 -- 172.21.15.84:0/1122776597 learned_addr learned my addr 172.21.15.84:0/1122776597 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7effd700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd800cef00 0x7efd800c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7f7fe700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015ac80 0x7efd80151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7e7fc700 1 -- 172.21.15.84:0/1122776597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015ac80 msgr2=0x7efd80151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7e7fc700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015ac80 0x7efd80151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7e7fc700 1 -- 172.21.15.84:0/1122776597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd800cef00 msgr2=0x7efd800c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7e7fc700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd800cef00 0x7efd800c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7e7fc700 1 -- 172.21.15.84:0/1122776597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd740094f0 con 0x7efd8015a8b0 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7f7fe700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015ac80 0x7efd80151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7effd700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd800cef00 0x7efd800c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd7e7fc700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015a8b0 0x7efd800c7850 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7efd800704c0 tx=0x7efd74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd66ffd700 1 -- 172.21.15.84:0/1122776597 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7401a450 con 0x7efd8015a8b0 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd66ffd700 1 -- 172.21.15.84:0/1122776597 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7401a5b0 con 0x7efd8015a8b0 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd854a5700 1 -- 172.21.15.84:0/1122776597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd800c6440 con 0x7efd8015a8b0 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.153+0000 7efd66ffd700 1 -- 172.21.15.84:0/1122776597 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7401a970 con 0x7efd8015a8b0 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.154+0000 7efd854a5700 1 -- 172.21.15.84:0/1122776597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd800c6c20 con 0x7efd8015a8b0 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.154+0000 7efd854a5700 1 -- 172.21.15.84:0/1122776597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd80064ad0 con 0x7efd8015a8b0 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.155+0000 7efd66ffd700 1 -- 172.21.15.84:0/1122776597 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd7401ad20 con 0x7efd8015a8b0 2023-10-06T03:25:46.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.155+0000 7efd66ffd700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efd6c066f30 0x7efd6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.155+0000 7efd66ffd700 1 -- 172.21.15.84:0/1122776597 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6378+0+0 (secure 0 0 0) 0x7efd74086430 con 0x7efd8015a8b0 2023-10-06T03:25:46.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.155+0000 7efd7effd700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efd6c066f30 0x7efd6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.156+0000 7efd7effd700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efd6c066f30 0x7efd6c0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efd70008b00 tx=0x7efd70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:46.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.160+0000 7efd66ffd700 1 -- 172.21.15.84:0/1122776597 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd74053400 con 0x7efd8015a8b0 2023-10-06T03:25:46.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.344+0000 7efd854a5700 1 -- 172.21.15.84:0/1122776597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd800cd810 con 0x7efd8015a8b0 2023-10-06T03:25:46.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.345+0000 7efd66ffd700 1 -- 172.21.15.84:0/1122776597 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17087 (secure 0 0 0) 0x7efd74056a20 con 0x7efd8015a8b0 2023-10-06T03:25:46.347 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:46.347 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":61,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:45.372109+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:43.021239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:44.339383+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:46.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 -- 172.21.15.84:0/1122776597 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efd6c066f30 msgr2=0x7efd6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efd6c066f30 0x7efd6c0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efd70008b00 tx=0x7efd70008040 comp rx=0 tx=0).stop 2023-10-06T03:25:46.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 -- 172.21.15.84:0/1122776597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015a8b0 msgr2=0x7efd800c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015a8b0 0x7efd800c7850 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7efd800704c0 tx=0x7efd74017000 comp rx=0 tx=0).stop 2023-10-06T03:25:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 -- 172.21.15.84:0/1122776597 shutdown_connections 2023-10-06T03:25:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efd6c066f30 0x7efd6c0693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd800cef00 0x7efd800c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd8015ac80 0x7efd80151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 --2- 172.21.15.84:0/1122776597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd8015a8b0 0x7efd800c7850 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 -- 172.21.15.84:0/1122776597 >> 172.21.15.84:0/1122776597 conn(0x7efd80067dd0 msgr2=0x7efd800acb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:46.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 -- 172.21.15.84:0/1122776597 shutdown_connections 2023-10-06T03:25:46.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.347+0000 7efd854a5700 1 -- 172.21.15.84:0/1122776597 wait complete. 2023-10-06T03:25:46.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.473+0000 7f56e9954700 1 Processor -- start 2023-10-06T03:25:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.473+0000 7f56e9954700 1 -- start start 2023-10-06T03:25:46.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.474+0000 7f56e9954700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f56e41595a0 0x7f56e40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.474+0000 7f56e9954700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56e40b49e0 0x7f56e40aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.474+0000 7f56e9954700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e40b0ca0 con 0x7f56e40b07a0 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.474+0000 7f56e9954700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e40b0f80 con 0x7f56e40b49e0 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.474+0000 7f56e9954700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e40b1260 con 0x7f56e41595a0 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.474+0000 7f56dbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56e40b49e0 0x7f56e40aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.474+0000 7f56dbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56e40b49e0 0x7f56e40aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55624/0 (socket says 172.21.15.84:55624) 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.474+0000 7f56dbfff700 1 -- 172.21.15.84:0/2645783496 learned_addr learned my addr 172.21.15.84:0/2645783496 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.474+0000 7f56e2ffd700 1 --2- 172.21.15.84:0/2645783496 >> v2:172.21.15.131:3300/0 conn(0x7f56e41595a0 0x7f56e40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56dbfff700 1 -- 172.21.15.84:0/2645783496 >> v2:172.21.15.131:3300/0 conn(0x7f56e41595a0 msgr2=0x7f56e40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56dbfff700 1 --2- 172.21.15.84:0/2645783496 >> v2:172.21.15.131:3300/0 conn(0x7f56e41595a0 0x7f56e40aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56dbfff700 1 -- 172.21.15.84:0/2645783496 >> v1:172.21.15.131:6789/0 conn(0x7f56e40b07a0 legacy=0x7f56e40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56dbfff700 1 -- 172.21.15.84:0/2645783496 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e40b1540 con 0x7f56e40b49e0 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56dbfff700 1 --2- 172.21.15.84:0/2645783496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b49e0 0x7f56e40aaab0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0099b0 tx=0x7f56cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd71fa1e95fbf33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56e27fc700 1 -- 172.21.15.84:0/2645783496 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00b7e0 con 0x7f56e40b49e0 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56e27fc700 1 -- 172.21.15.84:0/2645783496 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc00b940 con 0x7f56e40b49e0 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56e27fc700 1 -- 172.21.15.84:0/2645783496 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00bce0 con 0x7f56e40b49e0 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56e9954700 1 -- 172.21.15.84:0/2645783496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b49e0 msgr2=0x7f56e40aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56e9954700 1 --2- 172.21.15.84:0/2645783496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b49e0 0x7f56e40aaab0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0099b0 tx=0x7f56cc009250 comp rx=0 tx=0).stop 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56e9954700 1 -- 172.21.15.84:0/2645783496 shutdown_connections 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56e9954700 1 --2- 172.21.15.84:0/2645783496 >> v2:172.21.15.131:3300/0 conn(0x7f56e41595a0 0x7f56e40aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56e9954700 1 --2- 172.21.15.84:0/2645783496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b49e0 0x7f56e40aaab0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.475+0000 7f56e9954700 1 -- 172.21.15.84:0/2645783496 >> 172.21.15.84:0/2645783496 conn(0x7f56e4099830 msgr2=0x7f56e406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.476+0000 7f56e9954700 1 -- 172.21.15.84:0/2645783496 shutdown_connections 2023-10-06T03:25:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.476+0000 7f56e9954700 1 -- 172.21.15.84:0/2645783496 wait complete. 2023-10-06T03:25:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e9954700 1 Processor -- start 2023-10-06T03:25:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e9954700 1 -- start start 2023-10-06T03:25:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e9954700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b07a0 0x7f56e414a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e9954700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e40b49e0 0x7f56e409d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e9954700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e41595a0 0x7f56e409b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e9954700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e409a130 con 0x7f56e40b07a0 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e9954700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e409a410 con 0x7f56e40b49e0 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e9954700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e409a6f0 con 0x7f56e41595a0 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b07a0 0x7f56e414a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b07a0 0x7f56e414a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55638/0 (socket says 172.21.15.84:55638) 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.477+0000 7f56e2ffd700 1 -- 172.21.15.84:0/2952590083 learned_addr learned my addr 172.21.15.84:0/2952590083 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56dbfff700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e40b49e0 0x7f56e409d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56e37fe700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e41595a0 0x7f56e409b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56e2ffd700 1 -- 172.21.15.84:0/2952590083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e41595a0 msgr2=0x7f56e409b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56e2ffd700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e41595a0 0x7f56e409b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56e2ffd700 1 -- 172.21.15.84:0/2952590083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e40b49e0 msgr2=0x7f56e409d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56e2ffd700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e40b49e0 0x7f56e409d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56e2ffd700 1 -- 172.21.15.84:0/2952590083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0094f0 con 0x7f56e40b07a0 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56e2ffd700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b07a0 0x7f56e414a8a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f56d400d840 tx=0x7f56d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56daffd700 1 -- 172.21.15.84:0/2952590083 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4014620 con 0x7f56e40b07a0 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56e9954700 1 -- 172.21.15.84:0/2952590083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e409a9d0 con 0x7f56e40b07a0 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56e9954700 1 -- 172.21.15.84:0/2952590083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e414ade0 con 0x7f56e40b07a0 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56daffd700 1 -- 172.21.15.84:0/2952590083 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d4014990 con 0x7f56e40b07a0 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.478+0000 7f56daffd700 1 -- 172.21.15.84:0/2952590083 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4014b00 con 0x7f56e40b07a0 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.479+0000 7f56e9954700 1 -- 172.21.15.84:0/2952590083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c80052b0 con 0x7f56e40b07a0 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.479+0000 7f56daffd700 1 -- 172.21.15.84:0/2952590083 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56d401d400 con 0x7f56e40b07a0 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.480+0000 7f56daffd700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f56c4066f30 0x7f56c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.480+0000 7f56daffd700 1 -- 172.21.15.84:0/2952590083 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f56d4085030 con 0x7f56e40b07a0 2023-10-06T03:25:46.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.480+0000 7f56dbfff700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f56c4066f30 0x7f56c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.480+0000 7f56dbfff700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f56c4066f30 0x7f56c40693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f56e4088e20 tx=0x7f56cc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:46.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.484+0000 7f56daffd700 1 -- 172.21.15.84:0/2952590083 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56d4052000 con 0x7f56e40b07a0 2023-10-06T03:25:46.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.670+0000 7f56e9954700 1 -- 172.21.15.84:0/2952590083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56c8005830 con 0x7f56e40b07a0 2023-10-06T03:25:46.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.671+0000 7f56daffd700 1 -- 172.21.15.84:0/2952590083 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f56d4055620 con 0x7f56e40b07a0 2023-10-06T03:25:46.673 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:46.674 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":61,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:45.372109+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:43.021239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:44.339383+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:46.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 -- 172.21.15.84:0/2952590083 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f56c4066f30 msgr2=0x7f56c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f56c4066f30 0x7f56c40693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f56e4088e20 tx=0x7f56cc016000 comp rx=0 tx=0).stop 2023-10-06T03:25:46.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 -- 172.21.15.84:0/2952590083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b07a0 msgr2=0x7f56e414a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b07a0 0x7f56e414a8a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f56d400d840 tx=0x7f56d4008040 comp rx=0 tx=0).stop 2023-10-06T03:25:46.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 -- 172.21.15.84:0/2952590083 shutdown_connections 2023-10-06T03:25:46.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f56c4066f30 0x7f56c40693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e41595a0 0x7f56e409b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e40b07a0 0x7f56e414a8a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 --2- 172.21.15.84:0/2952590083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e40b49e0 0x7f56e409d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 -- 172.21.15.84:0/2952590083 >> 172.21.15.84:0/2952590083 conn(0x7f56e4099830 msgr2=0x7f56e4158920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:46.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 -- 172.21.15.84:0/2952590083 shutdown_connections 2023-10-06T03:25:46.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.673+0000 7f56e9954700 1 -- 172.21.15.84:0/2952590083 wait complete. 2023-10-06T03:25:46.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:25:46.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.802+0000 7fe6c1696700 1 Processor -- start 2023-10-06T03:25:46.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.802+0000 7fe6c1696700 1 -- start start 2023-10-06T03:25:46.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c1696700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 0x7fe6bc0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c1696700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe6bc0b2a30 0x7fe6bc0cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c1696700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6bc0cc9b0 con 0x7fe6bc0b2660 2023-10-06T03:25:46.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c1696700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc0cf560 con 0x7fe6bc0b2a30 2023-10-06T03:25:46.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c1696700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0cbda0 con 0x7fe6bc0cd400 2023-10-06T03:25:46.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c0e95700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe6bc0b2a30 0x7fe6bc0cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6bbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe6bc0b2660 0x7fe6bc0cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49242/0 (socket says 172.21.15.84:49242) 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6bbfff700 1 -- 172.21.15.84:0/624851397 learned_addr learned my addr 172.21.15.84:0/624851397 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6bb7fe700 1 --2- 172.21.15.84:0/624851397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 0x7fe6bc0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c0e95700 1 -- 172.21.15.84:0/624851397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 msgr2=0x7fe6bc0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c0e95700 1 --2- 172.21.15.84:0/624851397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 0x7fe6bc0ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c0e95700 1 -- 172.21.15.84:0/624851397 >> v1:172.21.15.84:6789/0 conn(0x7fe6bc0b2660 legacy=0x7fe6bc0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c0e95700 1 -- 172.21.15.84:0/624851397 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc0cc080 con 0x7fe6bc0b2a30 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6baffd700 1 -- 172.21.15.84:0/624851397 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231509412 0 0) 0x7fe6bc0cc9b0 con 0x7fe6bc0b2660 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.803+0000 7fe6c0e95700 1 --2- 172.21.15.84:0/624851397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2a30 0x7fe6bc0cf020 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009e60 tx=0x7fe6b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273be0427b118644 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6baffd700 1 -- 172.21.15.84:0/624851397 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400e070 con 0x7fe6bc0b2a30 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6baffd700 1 -- 172.21.15.84:0/624851397 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b400bb60 con 0x7fe6bc0b2a30 2023-10-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6baffd700 1 -- 172.21.15.84:0/624851397 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4012430 con 0x7fe6bc0b2a30 2023-10-06T03:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6c1696700 1 -- 172.21.15.84:0/624851397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2a30 msgr2=0x7fe6bc0cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6c1696700 1 --2- 172.21.15.84:0/624851397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2a30 0x7fe6bc0cf020 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009e60 tx=0x7fe6b4009780 comp rx=0 tx=0).stop 2023-10-06T03:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6c1696700 1 -- 172.21.15.84:0/624851397 shutdown_connections 2023-10-06T03:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6c1696700 1 --2- 172.21.15.84:0/624851397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2a30 0x7fe6bc0cf020 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6c1696700 1 --2- 172.21.15.84:0/624851397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 0x7fe6bc0ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6c1696700 1 -- 172.21.15.84:0/624851397 >> 172.21.15.84:0/624851397 conn(0x7fe6bc099560 msgr2=0x7fe6bc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6c1696700 1 -- 172.21.15.84:0/624851397 shutdown_connections 2023-10-06T03:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.804+0000 7fe6c1696700 1 -- 172.21.15.84:0/624851397 wait complete. 2023-10-06T03:25:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.805+0000 7fe6c1696700 1 Processor -- start 2023-10-06T03:25:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.805+0000 7fe6c1696700 1 -- start start 2023-10-06T03:25:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6c1696700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2660 0x7fe6bc09d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6c1696700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6bc0b2a30 0x7fe6bc0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6c1696700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 0x7fe6bc0c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6c1696700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0b41a0 con 0x7fe6bc0b2660 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6c1696700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0c9d40 con 0x7fe6bc0b2a30 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6c1696700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0ca020 con 0x7fe6bc0cd400 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6bbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2660 0x7fe6bc09d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6bbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2660 0x7fe6bc09d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55646/0 (socket says 172.21.15.84:55646) 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6bbfff700 1 -- 172.21.15.84:0/1284513915 learned_addr learned my addr 172.21.15.84:0/1284513915 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6bb7fe700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6bc0b2a30 0x7fe6bc0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6c0e95700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 0x7fe6bc0c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6bbfff700 1 -- 172.21.15.84:0/1284513915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 msgr2=0x7fe6bc0c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6bbfff700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 0x7fe6bc0c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6bbfff700 1 -- 172.21.15.84:0/1284513915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6bc0b2a30 msgr2=0x7fe6bc0c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6bbfff700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6bc0b2a30 0x7fe6bc0c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.806+0000 7fe6bbfff700 1 -- 172.21.15.84:0/1284513915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4009a20 con 0x7fe6bc0b2660 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.807+0000 7fe6c0e95700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 0x7fe6bc0c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.807+0000 7fe6bb7fe700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6bc0b2a30 0x7fe6bc0c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.807+0000 7fe6bbfff700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2660 0x7fe6bc09d5b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00c590 tx=0x7fe6ac007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.807+0000 7fe6a3fff700 1 -- 172.21.15.84:0/1284513915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0072e0 con 0x7fe6bc0b2660 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.807+0000 7fe6a3fff700 1 -- 172.21.15.84:0/1284513915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac007480 con 0x7fe6bc0b2660 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.807+0000 7fe6c1696700 1 -- 172.21.15.84:0/1284513915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc0ca300 con 0x7fe6bc0b2660 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.807+0000 7fe6a3fff700 1 -- 172.21.15.84:0/1284513915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0057f0 con 0x7fe6bc0b2660 2023-10-06T03:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.807+0000 7fe6c1696700 1 -- 172.21.15.84:0/1284513915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc09daf0 con 0x7fe6bc0b2660 2023-10-06T03:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.808+0000 7fe6c1696700 1 -- 172.21.15.84:0/1284513915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc05f270 con 0x7fe6bc0b2660 2023-10-06T03:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.808+0000 7fe6a3fff700 1 -- 172.21.15.84:0/1284513915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6ac005ba0 con 0x7fe6bc0b2660 2023-10-06T03:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.808+0000 7fe6a3fff700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe6a8066f30 0x7fe6a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.809+0000 7fe6a3fff700 1 -- 172.21.15.84:0/1284513915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe6ac083bc0 con 0x7fe6bc0b2660 2023-10-06T03:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.809+0000 7fe6bb7fe700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe6a8066f30 0x7fe6a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.809+0000 7fe6bb7fe700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe6a8066f30 0x7fe6a80693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0c6d40 tx=0x7fe6b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:46.813+0000 7fe6a3fff700 1 -- 172.21.15.84:0/1284513915 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6ac04b5a0 con 0x7fe6bc0b2660 2023-10-06T03:25:47.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:47.040+0000 7fe6c1696700 1 -- 172.21.15.84:0/1284513915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe6bc0cf7b0 con 0x7fe6bc0b2660 2023-10-06T03:25:48.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.023+0000 7fe6a3fff700 1 -- 172.21.15.84:0/1284513915 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe6ac050c20 con 0x7fe6bc0b2660 2023-10-06T03:25:48.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 -- 172.21.15.84:0/1284513915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe6a8066f30 msgr2=0x7fe6a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:48.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe6a8066f30 0x7fe6a80693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0c6d40 tx=0x7fe6b0008040 comp rx=0 tx=0).stop 2023-10-06T03:25:48.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 -- 172.21.15.84:0/1284513915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2660 msgr2=0x7fe6bc09d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:48.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2660 0x7fe6bc09d5b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00c590 tx=0x7fe6ac007e80 comp rx=0 tx=0).stop 2023-10-06T03:25:48.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 -- 172.21.15.84:0/1284513915 shutdown_connections 2023-10-06T03:25:48.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe6a8066f30 0x7fe6a80693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:48.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6bc0cd400 0x7fe6bc0c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:48.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6bc0b2660 0x7fe6bc09d5b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:48.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 --2- 172.21.15.84:0/1284513915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6bc0b2a30 0x7fe6bc0c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:48.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 -- 172.21.15.84:0/1284513915 >> 172.21.15.84:0/1284513915 conn(0x7fe6bc099560 msgr2=0x7fe6bc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:48.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 -- 172.21.15.84:0/1284513915 shutdown_connections 2023-10-06T03:25:48.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.025+0000 7fe6c1696700 1 -- 172.21.15.84:0/1284513915 wait complete. 2023-10-06T03:25:48.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:25:48.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.156+0000 7ff36e952700 1 Processor -- start 2023-10-06T03:25:48.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.156+0000 7ff36e952700 1 -- start start 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.157+0000 7ff36e952700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff368159510 0x7ff3680cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.157+0000 7ff36e952700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff3680cbae0 0x7ff3680cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.157+0000 7ff36e952700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3680cbf20 con 0x7ff3681598e0 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.157+0000 7ff36e952700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3680cf610 con 0x7ff368159510 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.157+0000 7ff36e952700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3680cf8f0 con 0x7ff3680cbae0 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.157+0000 7ff367fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff368159510 0x7ff3680cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.157+0000 7ff3677fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff3681598e0 0x7ff3680ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49246/0 (socket says 172.21.15.84:49246) 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.157+0000 7ff367fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff368159510 0x7ff3680cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55654/0 (socket says 172.21.15.84:55654) 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.157+0000 7ff3677fe700 1 -- 172.21.15.84:0/3858588893 learned_addr learned my addr 172.21.15.84:0/3858588893 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.157+0000 7ff36ceef700 1 --2- 172.21.15.84:0/3858588893 >> v2:172.21.15.131:3300/0 conn(0x7ff3680cbae0 0x7ff3680cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:48.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff367fff700 1 -- 172.21.15.84:0/3858588893 >> v2:172.21.15.131:3300/0 conn(0x7ff3680cbae0 msgr2=0x7ff3680cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff367fff700 1 --2- 172.21.15.84:0/3858588893 >> v2:172.21.15.131:3300/0 conn(0x7ff3680cbae0 0x7ff3680cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff367fff700 1 -- 172.21.15.84:0/3858588893 >> v1:172.21.15.84:6789/0 conn(0x7ff3681598e0 legacy=0x7ff3680ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff367fff700 1 -- 172.21.15.84:0/3858588893 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3680cfbd0 con 0x7ff368159510 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff366ffd700 1 -- 172.21.15.84:0/3858588893 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681325305 0 0) 0x7ff3680cbf20 con 0x7ff3681598e0 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff367fff700 1 --2- 172.21.15.84:0/3858588893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 0x7ff3680cb5a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff36806f990 tx=0x7ff3580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caebf6e5e790711f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff366ffd700 1 -- 172.21.15.84:0/3858588893 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800b6b0 con 0x7ff368159510 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff366ffd700 1 -- 172.21.15.84:0/3858588893 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35800b810 con 0x7ff368159510 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff366ffd700 1 -- 172.21.15.84:0/3858588893 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800bbb0 con 0x7ff368159510 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff36e952700 1 -- 172.21.15.84:0/3858588893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 msgr2=0x7ff3680cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff36e952700 1 --2- 172.21.15.84:0/3858588893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 0x7ff3680cb5a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff36806f990 tx=0x7ff3580091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:48.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff36e952700 1 -- 172.21.15.84:0/3858588893 shutdown_connections 2023-10-06T03:25:48.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff36e952700 1 --2- 172.21.15.84:0/3858588893 >> v2:172.21.15.131:3300/0 conn(0x7ff3680cbae0 0x7ff3680cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:48.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff36e952700 1 --2- 172.21.15.84:0/3858588893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 0x7ff3680cb5a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:48.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff36e952700 1 -- 172.21.15.84:0/3858588893 >> 172.21.15.84:0/3858588893 conn(0x7ff368089e90 msgr2=0x7ff3680997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:48.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff36e952700 1 -- 172.21.15.84:0/3858588893 shutdown_connections 2023-10-06T03:25:48.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.158+0000 7ff36e952700 1 -- 172.21.15.84:0/3858588893 wait complete. 2023-10-06T03:25:48.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.159+0000 7ff36e952700 1 Processor -- start 2023-10-06T03:25:48.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.160+0000 7ff36e952700 1 -- start start 2023-10-06T03:25:48.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.160+0000 7ff36e952700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3680cbae0 0x7ff36814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.160+0000 7ff36e952700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 0x7ff3680b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.160+0000 7ff36e952700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3681598e0 0x7ff368069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.160+0000 7ff36e952700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b3fe0 con 0x7ff368159510 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.160+0000 7ff36e952700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b42c0 con 0x7ff3681598e0 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.160+0000 7ff36e952700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b45a0 con 0x7ff3680cbae0 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff3677fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 0x7ff3680b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff3677fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 0x7ff3680b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55662/0 (socket says 172.21.15.84:55662) 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff3677fe700 1 -- 172.21.15.84:0/3631438448 learned_addr learned my addr 172.21.15.84:0/3631438448 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff367fff700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3680cbae0 0x7ff36814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff36ceef700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3681598e0 0x7ff368069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:48.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff3677fe700 1 -- 172.21.15.84:0/3631438448 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3680cbae0 msgr2=0x7ff36814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff3677fe700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3680cbae0 0x7ff36814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff3677fe700 1 -- 172.21.15.84:0/3631438448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3681598e0 msgr2=0x7ff368069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff3677fe700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3681598e0 0x7ff368069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff3677fe700 1 -- 172.21.15.84:0/3631438448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358009420 con 0x7ff368159510 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff3677fe700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 0x7ff3680b3590 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00c510 tx=0x7ff35c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff34ffff700 1 -- 172.21.15.84:0/3631438448 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c005b30 con 0x7ff368159510 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff34ffff700 1 -- 172.21.15.84:0/3631438448 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c005c90 con 0x7ff368159510 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff36e952700 1 -- 172.21.15.84:0/3631438448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3680b4880 con 0x7ff368159510 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff34ffff700 1 -- 172.21.15.84:0/3631438448 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c007300 con 0x7ff368159510 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.161+0000 7ff36e952700 1 -- 172.21.15.84:0/3631438448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36809a300 con 0x7ff368159510 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.162+0000 7ff36e952700 1 -- 172.21.15.84:0/3631438448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36809ba80 con 0x7ff368159510 2023-10-06T03:25:48.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.162+0000 7ff34ffff700 1 -- 172.21.15.84:0/3631438448 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff35c01b3b0 con 0x7ff368159510 2023-10-06T03:25:48.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.163+0000 7ff34ffff700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff354066f30 0x7ff3540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:48.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.163+0000 7ff34ffff700 1 -- 172.21.15.84:0/3631438448 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff35c083d00 con 0x7ff368159510 2023-10-06T03:25:48.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.163+0000 7ff367fff700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff354066f30 0x7ff3540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:48.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.163+0000 7ff367fff700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff354066f30 0x7ff3540693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff3580091e0 tx=0x7ff358017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:48.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.167+0000 7ff34ffff700 1 -- 172.21.15.84:0/3631438448 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff35c050cd0 con 0x7ff368159510 2023-10-06T03:25:48.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:48.394+0000 7ff36e952700 1 -- 172.21.15.84:0/3631438448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff368064ad0 con 0x7ff368159510 2023-10-06T03:25:49.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.024+0000 7ff34ffff700 1 -- 172.21.15.84:0/3631438448 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff35c017020 con 0x7ff368159510 2023-10-06T03:25:49.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 -- 172.21.15.84:0/3631438448 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff354066f30 msgr2=0x7ff3540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff354066f30 0x7ff3540693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff3580091e0 tx=0x7ff358017000 comp rx=0 tx=0).stop 2023-10-06T03:25:49.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 -- 172.21.15.84:0/3631438448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 msgr2=0x7ff3680b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 0x7ff3680b3590 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00c510 tx=0x7ff35c00c8d0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 -- 172.21.15.84:0/3631438448 shutdown_connections 2023-10-06T03:25:49.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff354066f30 0x7ff3540693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3681598e0 0x7ff368069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3680cbae0 0x7ff36814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 --2- 172.21.15.84:0/3631438448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff368159510 0x7ff3680b3590 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 -- 172.21.15.84:0/3631438448 >> 172.21.15.84:0/3631438448 conn(0x7ff368089e90 msgr2=0x7ff3680c6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 -- 172.21.15.84:0/3631438448 shutdown_connections 2023-10-06T03:25:49.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.026+0000 7ff36e952700 1 -- 172.21.15.84:0/3631438448 wait complete. 2023-10-06T03:25:49.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:49.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.152+0000 7eff563ed700 1 Processor -- start 2023-10-06T03:25:49.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.152+0000 7eff563ed700 1 -- start start 2023-10-06T03:25:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.153+0000 7eff563ed700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7eff500b07a0 0x7eff500ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.153+0000 7eff563ed700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff500b0ca0 con 0x7eff501595a0 2023-10-06T03:25:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.153+0000 7eff563ed700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff500b0f80 con 0x7eff500b49e0 2023-10-06T03:25:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.153+0000 7eff563ed700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff500ab390 con 0x7eff500b07a0 2023-10-06T03:25:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.153+0000 7eff4ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7eff501595a0 0x7eff500aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49260/0 (socket says 172.21.15.84:49260) 2023-10-06T03:25:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.153+0000 7eff4ffff700 1 -- 172.21.15.84:0/4123005841 learned_addr learned my addr 172.21.15.84:0/4123005841 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.153+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564179078 0 0) 0x7eff500b0ca0 con 0x7eff501595a0 2023-10-06T03:25:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.153+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff38003570 con 0x7eff501595a0 2023-10-06T03:25:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.153+0000 7eff5498a700 1 --2- 172.21.15.84:0/4123005841 >> v2:172.21.15.131:3300/0 conn(0x7eff500b07a0 0x7eff500ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1369785716 0 0) 0x7eff38003570 con 0x7eff501595a0 2023-10-06T03:25:49.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 >> v2:172.21.15.131:3300/0 conn(0x7eff500b07a0 msgr2=0x7eff500ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:49.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 --2- 172.21.15.84:0/4123005841 >> v2:172.21.15.131:3300/0 conn(0x7eff500b07a0 0x7eff500ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 >> v1:172.21.15.131:6789/0 conn(0x7eff500b49e0 legacy=0x7eff500aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500b1260 con 0x7eff501595a0 2023-10-06T03:25:49.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7eff400015f0 con 0x7eff501595a0 2023-10-06T03:25:49.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 >> v1:172.21.15.84:6789/0 conn(0x7eff501595a0 legacy=0x7eff500aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff38003a60 0x7eff38003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff38004810 0x7eff38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff380052e0 0x7eff3800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500ab390 con 0x7eff380052e0 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3800c190 con 0x7eff38003a60 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3800c350 con 0x7eff38004810 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff5498a700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff380052e0 0x7eff3800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4ffff700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff38003a60 0x7eff38003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4f7fe700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff38004810 0x7eff38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff5498a700 1 -- 172.21.15.84:0/4123005841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff38004810 msgr2=0x7eff38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff5498a700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff38004810 0x7eff38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff5498a700 1 -- 172.21.15.84:0/4123005841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff38003a60 msgr2=0x7eff38003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff5498a700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff38003a60 0x7eff38003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff5498a700 1 -- 172.21.15.84:0/4123005841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff38003570 con 0x7eff380052e0 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4f7fe700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff38004810 0x7eff38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff5498a700 1 -- 172.21.15.84:0/4123005841 reap_dead start 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff5498a700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff380052e0 0x7eff3800ba60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7eff48007440 tx=0x7eff48009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b40ac6e591acc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48009a40 con 0x7eff380052e0 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.154+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff48007cf0 con 0x7eff380052e0 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.155+0000 7eff4effd700 1 -- 172.21.15.84:0/4123005841 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48014650 con 0x7eff380052e0 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.155+0000 7eff563ed700 1 -- 172.21.15.84:0/4123005841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff380052e0 msgr2=0x7eff3800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.155+0000 7eff563ed700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff380052e0 0x7eff3800ba60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7eff48007440 tx=0x7eff48009710 comp rx=0 tx=0).stop 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.155+0000 7eff563ed700 1 -- 172.21.15.84:0/4123005841 shutdown_connections 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.155+0000 7eff563ed700 1 --2- 172.21.15.84:0/4123005841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff380052e0 0x7eff3800ba60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.155+0000 7eff563ed700 1 -- 172.21.15.84:0/4123005841 >> 172.21.15.84:0/4123005841 conn(0x7eff50099830 msgr2=0x7eff5006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.155+0000 7eff563ed700 1 -- 172.21.15.84:0/4123005841 shutdown_connections 2023-10-06T03:25:49.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.155+0000 7eff563ed700 1 -- 172.21.15.84:0/4123005841 wait complete. 2023-10-06T03:25:49.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.156+0000 7eff563ed700 1 Processor -- start 2023-10-06T03:25:49.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.156+0000 7eff563ed700 1 -- start start 2023-10-06T03:25:49.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff563ed700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff380052e0 0x7eff500aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff563ed700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff5009dd60 0x7eff5016ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff563ed700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5014d4f0 0x7eff500b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff563ed700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5016b5a0 con 0x7eff5014d4f0 2023-10-06T03:25:49.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff563ed700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5016b340 con 0x7eff5009dd60 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff563ed700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5016b7f0 con 0x7eff380052e0 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff5498a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5014d4f0 0x7eff500b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff5498a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5014d4f0 0x7eff500b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55682/0 (socket says 172.21.15.84:55682) 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff5498a700 1 -- 172.21.15.84:0/752909005 learned_addr learned my addr 172.21.15.84:0/752909005 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff4f7fe700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff5009dd60 0x7eff5016ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff4ffff700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff380052e0 0x7eff500aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff5498a700 1 -- 172.21.15.84:0/752909005 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff380052e0 msgr2=0x7eff500aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff5498a700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff380052e0 0x7eff500aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff5498a700 1 -- 172.21.15.84:0/752909005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff5009dd60 msgr2=0x7eff5016ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff5498a700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff5009dd60 0x7eff5016ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff5498a700 1 -- 172.21.15.84:0/752909005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5016bad0 con 0x7eff5014d4f0 2023-10-06T03:25:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.157+0000 7eff4ffff700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff380052e0 0x7eff500aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.158+0000 7eff5498a700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5014d4f0 0x7eff500b3830 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7eff48007440 tx=0x7eff48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.158+0000 7eff37fff700 1 -- 172.21.15.84:0/752909005 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48009a40 con 0x7eff5014d4f0 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.158+0000 7eff37fff700 1 -- 172.21.15.84:0/752909005 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff48014e40 con 0x7eff5014d4f0 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.158+0000 7eff37fff700 1 -- 172.21.15.84:0/752909005 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48013db0 con 0x7eff5014d4f0 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.158+0000 7eff563ed700 1 -- 172.21.15.84:0/752909005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5016bdb0 con 0x7eff5014d4f0 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.158+0000 7eff563ed700 1 -- 172.21.15.84:0/752909005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5016c370 con 0x7eff5014d4f0 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.159+0000 7eff563ed700 1 -- 172.21.15.84:0/752909005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5016c560 con 0x7eff5014d4f0 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.159+0000 7eff37fff700 1 -- 172.21.15.84:0/752909005 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff4801b050 con 0x7eff5014d4f0 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.159+0000 7eff37fff700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff3c066f30 0x7eff3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.160+0000 7eff37fff700 1 -- 172.21.15.84:0/752909005 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7eff480861f0 con 0x7eff5014d4f0 2023-10-06T03:25:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.160+0000 7eff4ffff700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff3c066f30 0x7eff3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.160+0000 7eff4ffff700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff3c066f30 0x7eff3c0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7eff400079b0 tx=0x7eff40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.164+0000 7eff37fff700 1 -- 172.21.15.84:0/752909005 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff480531c0 con 0x7eff5014d4f0 2023-10-06T03:25:49.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.390+0000 7eff563ed700 1 -- 172.21.15.84:0/752909005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff50064ad0 con 0x7eff5014d4f0 2023-10-06T03:25:49.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.390+0000 7eff37fff700 1 -- 172.21.15.84:0/752909005 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4602 (secure 0 0 0) 0x7eff480567e0 con 0x7eff5014d4f0 2023-10-06T03:25:49.393 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:49.393 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1896877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1896877693},{"type":"v1","addr":"172.21.15.131:6834","nonce":1896877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/236530865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":236530865},{"type":"v1","addr":"172.21.15.131:6835","nonce":236530865}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2675057738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2675057738},{"type":"v1","addr":"172.21.15.84:6836","nonce":2675057738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:45.372432+0000","modified":"2023-10-06T03:25:49.023019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5871":{"gid":5871,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1162609428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1162609428},{"type":"v1","addr":"172.21.15.84:6837","nonce":1162609428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:25:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 -- 172.21.15.84:0/752909005 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff3c066f30 msgr2=0x7eff3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff3c066f30 0x7eff3c0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7eff400079b0 tx=0x7eff40009040 comp rx=0 tx=0).stop 2023-10-06T03:25:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 -- 172.21.15.84:0/752909005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5014d4f0 msgr2=0x7eff500b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5014d4f0 0x7eff500b3830 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7eff48007440 tx=0x7eff48017000 comp rx=0 tx=0).stop 2023-10-06T03:25:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 -- 172.21.15.84:0/752909005 shutdown_connections 2023-10-06T03:25:49.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff3c066f30 0x7eff3c0693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff5014d4f0 0x7eff500b3830 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff380052e0 0x7eff500aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 --2- 172.21.15.84:0/752909005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff5009dd60 0x7eff5016ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 -- 172.21.15.84:0/752909005 >> 172.21.15.84:0/752909005 conn(0x7eff50099830 msgr2=0x7eff500ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 -- 172.21.15.84:0/752909005 shutdown_connections 2023-10-06T03:25:49.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.392+0000 7eff563ed700 1 -- 172.21.15.84:0/752909005 wait complete. 2023-10-06T03:25:49.397 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 31 2023-10-06T03:25:49.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.518+0000 7fd1bac45700 1 Processor -- start 2023-10-06T03:25:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.518+0000 7fd1bac45700 1 -- start start 2023-10-06T03:25:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.519+0000 7fd1bac45700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b41595a0 0x7fd1b40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.519+0000 7fd1bac45700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd1b40b49e0 0x7fd1b40aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.519+0000 7fd1bac45700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b40b0ca0 con 0x7fd1b40b07a0 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.519+0000 7fd1bac45700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b40b0f80 con 0x7fd1b40b49e0 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.519+0000 7fd1bac45700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40b1260 con 0x7fd1b41595a0 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.519+0000 7fd1abfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd1b40b49e0 0x7fd1b40aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.519+0000 7fd1b91e2700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd1b40b07a0 0x7fd1b40b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49270/0 (socket says 172.21.15.84:49270) 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.519+0000 7fd1b91e2700 1 -- 172.21.15.84:0/4002434824 learned_addr learned my addr 172.21.15.84:0/4002434824 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.519+0000 7fd1abfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd1b40b49e0 0x7fd1b40aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55698/0 (socket says 172.21.15.84:55698) 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1b89e1700 1 --2- 172.21.15.84:0/4002434824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b41595a0 0x7fd1b40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1abfff700 1 -- 172.21.15.84:0/4002434824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b41595a0 msgr2=0x7fd1b40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1abfff700 1 --2- 172.21.15.84:0/4002434824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b41595a0 0x7fd1b40aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1abfff700 1 -- 172.21.15.84:0/4002434824 >> v1:172.21.15.84:6789/0 conn(0x7fd1b40b07a0 legacy=0x7fd1b40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1ab7fe700 1 -- 172.21.15.84:0/4002434824 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095218701 0 0) 0x7fd1b40b0ca0 con 0x7fd1b40b07a0 2023-10-06T03:25:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1abfff700 1 -- 172.21.15.84:0/4002434824 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40b1540 con 0x7fd1b40b49e0 2023-10-06T03:25:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1abfff700 1 --2- 172.21.15.84:0/4002434824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b40b49e0 0x7fd1b40aaab0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40098e0 tx=0x7fd1a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928af7d8f9021196 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1ab7fe700 1 -- 172.21.15.84:0/4002434824 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4009e80 con 0x7fd1b40b49e0 2023-10-06T03:25:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1ab7fe700 1 -- 172.21.15.84:0/4002434824 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a400b860 con 0x7fd1b40b49e0 2023-10-06T03:25:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1ab7fe700 1 -- 172.21.15.84:0/4002434824 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400bbe0 con 0x7fd1b40b49e0 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1bac45700 1 -- 172.21.15.84:0/4002434824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b40b49e0 msgr2=0x7fd1b40aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.520+0000 7fd1bac45700 1 --2- 172.21.15.84:0/4002434824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b40b49e0 0x7fd1b40aaab0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40098e0 tx=0x7fd1a40091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.521+0000 7fd1bac45700 1 -- 172.21.15.84:0/4002434824 shutdown_connections 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.521+0000 7fd1bac45700 1 --2- 172.21.15.84:0/4002434824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b41595a0 0x7fd1b40aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.521+0000 7fd1bac45700 1 --2- 172.21.15.84:0/4002434824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b40b49e0 0x7fd1b40aaab0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.521+0000 7fd1bac45700 1 -- 172.21.15.84:0/4002434824 >> 172.21.15.84:0/4002434824 conn(0x7fd1b4099830 msgr2=0x7fd1b406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.521+0000 7fd1bac45700 1 -- 172.21.15.84:0/4002434824 shutdown_connections 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.521+0000 7fd1bac45700 1 -- 172.21.15.84:0/4002434824 wait complete. 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.522+0000 7fd1bac45700 1 Processor -- start 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.522+0000 7fd1bac45700 1 -- start start 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.522+0000 7fd1bac45700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1b40b07a0 0x7fd1b4099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.522+0000 7fd1bac45700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b40b49e0 0x7fd1b416a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1bac45700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b41595a0 0x7fd1b415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1bac45700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b409dac0 con 0x7fd1b41595a0 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1bac45700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b409cf30 con 0x7fd1b40b07a0 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1bac45700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b409d190 con 0x7fd1b40b49e0 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1b91e2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b41595a0 0x7fd1b415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1b91e2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b41595a0 0x7fd1b415aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55708/0 (socket says 172.21.15.84:55708) 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1b91e2700 1 -- 172.21.15.84:0/2390650032 learned_addr learned my addr 172.21.15.84:0/2390650032 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1b89e1700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1b40b07a0 0x7fd1b4099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1abfff700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b40b49e0 0x7fd1b416a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1b91e2700 1 -- 172.21.15.84:0/2390650032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b40b49e0 msgr2=0x7fd1b416a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1b91e2700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b40b49e0 0x7fd1b416a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1b91e2700 1 -- 172.21.15.84:0/2390650032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1b40b07a0 msgr2=0x7fd1b4099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1b91e2700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1b40b07a0 0x7fd1b4099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1b91e2700 1 -- 172.21.15.84:0/2390650032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4009420 con 0x7fd1b41595a0 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1b91e2700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b41595a0 0x7fd1b415aca0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00cc90 tx=0x7fd1ac001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1a8ff9700 1 -- 172.21.15.84:0/2390650032 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00cea0 con 0x7fd1b41595a0 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1a8ff9700 1 -- 172.21.15.84:0/2390650032 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00ab70 con 0x7fd1b41595a0 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1bac45700 1 -- 172.21.15.84:0/2390650032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b409d470 con 0x7fd1b41595a0 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1a8ff9700 1 -- 172.21.15.84:0/2390650032 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0070f0 con 0x7fd1b41595a0 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.523+0000 7fd1bac45700 1 -- 172.21.15.84:0/2390650032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b409df50 con 0x7fd1b41595a0 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.524+0000 7fd1bac45700 1 -- 172.21.15.84:0/2390650032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b409dc70 con 0x7fd1b41595a0 2023-10-06T03:25:49.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.525+0000 7fd1a8ff9700 1 -- 172.21.15.84:0/2390650032 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1ac0074e0 con 0x7fd1b41595a0 2023-10-06T03:25:49.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.525+0000 7fd1a8ff9700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1a0066f30 0x7fd1a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.525+0000 7fd1a8ff9700 1 -- 172.21.15.84:0/2390650032 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd1ac084c20 con 0x7fd1b41595a0 2023-10-06T03:25:49.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.525+0000 7fd1b89e1700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1a0066f30 0x7fd1a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.525+0000 7fd1b89e1700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1a0066f30 0x7fd1a00693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0006520 tx=0x7fd1b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.529+0000 7fd1a8ff9700 1 -- 172.21.15.84:0/2390650032 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1b409dc70 con 0x7fd1b41595a0 2023-10-06T03:25:49.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.712+0000 7fd1bac45700 1 -- 172.21.15.84:0/2390650032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1b409dc70 con 0x7fd1b41595a0 2023-10-06T03:25:49.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.712+0000 7fd1a8ff9700 1 -- 172.21.15.84:0/2390650032 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fd1b409dc70 con 0x7fd1b41595a0 2023-10-06T03:25:49.714 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:49.715 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":62,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:46.997828+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:43.021239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:44.339383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:49.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 -- 172.21.15.84:0/2390650032 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1a0066f30 msgr2=0x7fd1a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1a0066f30 0x7fd1a00693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0006520 tx=0x7fd1b0008040 comp rx=0 tx=0).stop 2023-10-06T03:25:49.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 -- 172.21.15.84:0/2390650032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b41595a0 msgr2=0x7fd1b415aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b41595a0 0x7fd1b415aca0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00cc90 tx=0x7fd1ac001a80 comp rx=0 tx=0).stop 2023-10-06T03:25:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 -- 172.21.15.84:0/2390650032 shutdown_connections 2023-10-06T03:25:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1a0066f30 0x7fd1a00693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1b40b07a0 0x7fd1b4099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b41595a0 0x7fd1b415aca0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 --2- 172.21.15.84:0/2390650032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1b40b49e0 0x7fd1b416a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 -- 172.21.15.84:0/2390650032 >> 172.21.15.84:0/2390650032 conn(0x7fd1b4099830 msgr2=0x7fd1b41589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 -- 172.21.15.84:0/2390650032 shutdown_connections 2023-10-06T03:25:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.714+0000 7fd1bac45700 1 -- 172.21.15.84:0/2390650032 wait complete. 2023-10-06T03:25:49.728 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:25:49.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:25:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.841+0000 7f4d22791700 1 Processor -- start 2023-10-06T03:25:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.841+0000 7f4d22791700 1 -- start start 2023-10-06T03:25:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d22791700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 0x7f4d1c0691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d22791700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4d1c069720 0x7f4d1c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d22791700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c068d50 con 0x7f4d1c15a050 2023-10-06T03:25:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d22791700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c154060 con 0x7f4d1c069720 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d22791700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c15a490 con 0x7f4d1c0cb630 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d1b7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4d1c069720 0x7f4d1c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d1bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 0x7f4d1c0691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d1bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 0x7f4d1c0691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55286/0 (socket says 172.21.15.84:55286) 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d1b7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4d1c069720 0x7f4d1c159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:48400/0 (socket says 172.21.15.84:48400) 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d20d2e700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f4d1c15a050 0x7f4d1c0ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:42636/0 (socket says 172.21.15.84:42636) 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d1bfff700 1 -- 172.21.15.84:0/1081620805 learned_addr learned my addr 172.21.15.84:0/1081620805 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d1bfff700 1 -- 172.21.15.84:0/1081620805 >> v2:172.21.15.131:3300/0 conn(0x7f4d1c069720 msgr2=0x7f4d1c159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d1bfff700 1 --2- 172.21.15.84:0/1081620805 >> v2:172.21.15.131:3300/0 conn(0x7f4d1c069720 0x7f4d1c159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d1bfff700 1 -- 172.21.15.84:0/1081620805 >> v1:172.21.15.131:6789/0 conn(0x7f4d1c15a050 legacy=0x7f4d1c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.842+0000 7f4d1bfff700 1 -- 172.21.15.84:0/1081620805 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c15a6b0 con 0x7f4d1c0cb630 2023-10-06T03:25:49.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d1bfff700 1 --2- 172.21.15.84:0/1081620805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 0x7f4d1c0691e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0099b0 tx=0x7f4d0c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=135ede99a5553a64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d1affd700 1 -- 172.21.15.84:0/1081620805 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c009ea0 con 0x7f4d1c0cb630 2023-10-06T03:25:49.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d1affd700 1 -- 172.21.15.84:0/1081620805 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c00b860 con 0x7f4d1c0cb630 2023-10-06T03:25:49.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d1affd700 1 -- 172.21.15.84:0/1081620805 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00bc00 con 0x7f4d1c0cb630 2023-10-06T03:25:49.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d22791700 1 -- 172.21.15.84:0/1081620805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 msgr2=0x7f4d1c0691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d22791700 1 --2- 172.21.15.84:0/1081620805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 0x7f4d1c0691e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0099b0 tx=0x7f4d0c009250 comp rx=0 tx=0).stop 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d22791700 1 -- 172.21.15.84:0/1081620805 shutdown_connections 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d22791700 1 --2- 172.21.15.84:0/1081620805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 0x7f4d1c0691e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d22791700 1 --2- 172.21.15.84:0/1081620805 >> v2:172.21.15.131:3300/0 conn(0x7f4d1c069720 0x7f4d1c159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d22791700 1 -- 172.21.15.84:0/1081620805 >> 172.21.15.84:0/1081620805 conn(0x7f4d1c070810 msgr2=0x7f4d1c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d22791700 1 -- 172.21.15.84:0/1081620805 shutdown_connections 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.843+0000 7f4d22791700 1 -- 172.21.15.84:0/1081620805 wait complete. 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.844+0000 7f4d22791700 1 Processor -- start 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.845+0000 7f4d22791700 1 -- start start 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.845+0000 7f4d22791700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d1c069720 0x7f4d1c16d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.845+0000 7f4d22791700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 0x7f4d1c16dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.845+0000 7f4d22791700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d1c15a050 0x7f4d1c155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.845+0000 7f4d22791700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c169f90 con 0x7f4d1c069720 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.845+0000 7f4d22791700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c1d70 con 0x7f4d1c15a050 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.845+0000 7f4d22791700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c156960 con 0x7f4d1c0cb630 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.845+0000 7f4d1bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d1c069720 0x7f4d1c16d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.845+0000 7f4d1bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d1c069720 0x7f4d1c16d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55718/0 (socket says 172.21.15.84:55718) 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.845+0000 7f4d1bfff700 1 -- 172.21.15.84:0/641717485 learned_addr learned my addr 172.21.15.84:0/641717485 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d1b7fe700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 0x7f4d1c16dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d20d2e700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d1c15a050 0x7f4d1c155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d1bfff700 1 -- 172.21.15.84:0/641717485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 msgr2=0x7f4d1c16dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d1bfff700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 0x7f4d1c16dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d1bfff700 1 -- 172.21.15.84:0/641717485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d1c15a050 msgr2=0x7f4d1c155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d1bfff700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d1c15a050 0x7f4d1c155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d1bfff700 1 -- 172.21.15.84:0/641717485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0094f0 con 0x7f4d1c069720 2023-10-06T03:25:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d1bfff700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d1c069720 0x7f4d1c16d670 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c06c0f0 tx=0x7f4d0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d03fff700 1 -- 172.21.15.84:0/641717485 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00bbe0 con 0x7f4d1c069720 2023-10-06T03:25:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d03fff700 1 -- 172.21.15.84:0/641717485 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c011420 con 0x7f4d1c069720 2023-10-06T03:25:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d03fff700 1 -- 172.21.15.84:0/641717485 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0117c0 con 0x7f4d1c069720 2023-10-06T03:25:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d22791700 1 -- 172.21.15.84:0/641717485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c0c1fc0 con 0x7f4d1c069720 2023-10-06T03:25:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.846+0000 7f4d22791700 1 -- 172.21.15.84:0/641717485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c0c2580 con 0x7f4d1c069720 2023-10-06T03:25:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.847+0000 7f4d22791700 1 -- 172.21.15.84:0/641717485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c064ad0 con 0x7f4d1c069720 2023-10-06T03:25:49.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.847+0000 7f4d03fff700 1 -- 172.21.15.84:0/641717485 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d0c011bf0 con 0x7f4d1c069720 2023-10-06T03:25:49.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.848+0000 7f4d03fff700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4d08066f30 0x7f4d080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.848+0000 7f4d03fff700 1 -- 172.21.15.84:0/641717485 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4d0c086180 con 0x7f4d1c069720 2023-10-06T03:25:49.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.848+0000 7f4d1b7fe700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4d08066f30 0x7f4d080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.848+0000 7f4d1b7fe700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4d08066f30 0x7f4d080693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c15c310 tx=0x7f4d10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:49.852+0000 7f4d03fff700 1 -- 172.21.15.84:0/641717485 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d0c053150 con 0x7f4d1c069720 2023-10-06T03:25:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.032+0000 7f4d22791700 1 -- 172.21.15.84:0/641717485 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d1c04bb80 con 0x7f4d08066f30 2023-10-06T03:25:50.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.040+0000 7f4d03fff700 1 -- 172.21.15.84:0/641717485 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311777 (secure 0 0 0) 0x7f4d1c04bb80 con 0x7f4d08066f30 2023-10-06T03:25:50.045 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 -- 172.21.15.84:0/641717485 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4d08066f30 msgr2=0x7f4d080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4d08066f30 0x7f4d080693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c15c310 tx=0x7f4d10008040 comp rx=0 tx=0).stop 2023-10-06T03:25:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 -- 172.21.15.84:0/641717485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d1c069720 msgr2=0x7f4d1c16d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d1c069720 0x7f4d1c16d670 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c06c0f0 tx=0x7f4d0c017000 comp rx=0 tx=0).stop 2023-10-06T03:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 -- 172.21.15.84:0/641717485 shutdown_connections 2023-10-06T03:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4d08066f30 0x7f4d080693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d1c15a050 0x7f4d1c155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d1c069720 0x7f4d1c16d670 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 --2- 172.21.15.84:0/641717485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4d1c0cb630 0x7f4d1c16dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 -- 172.21.15.84:0/641717485 >> 172.21.15.84:0/641717485 conn(0x7f4d1c070810 msgr2=0x7f4d1c0cbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 -- 172.21.15.84:0/641717485 shutdown_connections 2023-10-06T03:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.044+0000 7f4d22791700 1 -- 172.21.15.84:0/641717485 wait complete. 2023-10-06T03:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:25:50.057 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-10-06T03:25:49.064986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385308,"kb_used_data":7004,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589412,"statfs":{"total":773094113280,"available":770651557888,"internally_reserved":0,"allocated":7172096,"data_stored":3932741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.081269"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023055+0000","last_change":"2023-10-06T03:25:46.014635+0000","last_active":"2023-10-06T03:25:46.023055+0000","last_peered":"2023-10-06T03:25:46.023055+0000","last_clean":"2023-10-06T03:25:46.023055+0000","last_became_active":"2023-10-06T03:25:46.014321+0000","last_became_peered":"2023-10-06T03:25:46.014321+0000","last_unstale":"2023-10-06T03:25:46.023055+0000","last_undegraded":"2023-10-06T03:25:46.023055+0000","last_fullsized":"2023-10-06T03:25:46.023055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:48.579247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.026982+0000","last_change":"2023-10-06T03:25:46.026982+0000","last_active":"2023-10-06T03:25:46.026982+0000","last_peered":"2023-10-06T03:25:46.026982+0000","last_clean":"2023-10-06T03:25:46.026982+0000","last_became_active":"2023-10-06T03:25:46.026248+0000","last_became_peered":"2023-10-06T03:25:46.026248+0000","last_unstale":"2023-10-06T03:25:46.026982+0000","last_undegraded":"2023-10-06T03:25:46.026982+0000","last_fullsized":"2023-10-06T03:25:46.026982+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.538375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.015987+0000","last_change":"2023-10-06T03:25:46.015987+0000","last_active":"2023-10-06T03:25:46.015987+0000","last_peered":"2023-10-06T03:25:46.015987+0000","last_clean":"2023-10-06T03:25:46.015987+0000","last_became_active":"2023-10-06T03:25:46.015750+0000","last_became_peered":"2023-10-06T03:25:46.015750+0000","last_unstale":"2023-10-06T03:25:46.015987+0000","last_undegraded":"2023-10-06T03:25:46.015987+0000","last_fullsized":"2023-10-06T03:25:46.015987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.749479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.024653+0000","last_change":"2023-10-06T03:25:46.024653+0000","last_active":"2023-10-06T03:25:46.024653+0000","last_peered":"2023-10-06T03:25:46.024653+0000","last_clean":"2023-10-06T03:25:46.024653+0000","last_became_active":"2023-10-06T03:25:46.024380+0000","last_became_peered":"2023-10-06T03:25:46.024380+0000","last_unstale":"2023-10-06T03:25:46.024653+0000","last_undegraded":"2023-10-06T03:25:46.024653+0000","last_fullsized":"2023-10-06T03:25:46.024653+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:17.380384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018494+0000","last_change":"2023-10-06T03:25:46.013133+0000","last_active":"2023-10-06T03:25:46.018494+0000","last_peered":"2023-10-06T03:25:46.018494+0000","last_clean":"2023-10-06T03:25:46.018494+0000","last_became_active":"2023-10-06T03:25:46.012880+0000","last_became_peered":"2023-10-06T03:25:46.012880+0000","last_unstale":"2023-10-06T03:25:46.018494+0000","last_undegraded":"2023-10-06T03:25:46.018494+0000","last_fullsized":"2023-10-06T03:25:46.018494+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:25.148902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.025648+0000","last_change":"2023-10-06T03:25:46.025648+0000","last_active":"2023-10-06T03:25:46.025648+0000","last_peered":"2023-10-06T03:25:46.025648+0000","last_clean":"2023-10-06T03:25:46.025648+0000","last_became_active":"2023-10-06T03:25:46.025340+0000","last_became_peered":"2023-10-06T03:25:46.025340+0000","last_unstale":"2023-10-06T03:25:46.025648+0000","last_undegraded":"2023-10-06T03:25:46.025648+0000","last_fullsized":"2023-10-06T03:25:46.025648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:12.906400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.021120+0000","last_change":"2023-10-06T03:25:46.021120+0000","last_active":"2023-10-06T03:25:46.021120+0000","last_peered":"2023-10-06T03:25:46.021120+0000","last_clean":"2023-10-06T03:25:46.021120+0000","last_became_active":"2023-10-06T03:25:46.020839+0000","last_became_peered":"2023-10-06T03:25:46.020839+0000","last_unstale":"2023-10-06T03:25:46.021120+0000","last_undegraded":"2023-10-06T03:25:46.021120+0000","last_fullsized":"2023-10-06T03:25:46.021120+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:34.762514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023149+0000","last_change":"2023-10-06T03:25:46.023149+0000","last_active":"2023-10-06T03:25:46.023149+0000","last_peered":"2023-10-06T03:25:46.023149+0000","last_clean":"2023-10-06T03:25:46.023149+0000","last_became_active":"2023-10-06T03:25:46.022894+0000","last_became_peered":"2023-10-06T03:25:46.022894+0000","last_unstale":"2023-10-06T03:25:46.023149+0000","last_undegraded":"2023-10-06T03:25:46.023149+0000","last_fullsized":"2023-10-06T03:25:46.023149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:11.372886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023198+0000","last_change":"2023-10-06T03:25:46.017695+0000","last_active":"2023-10-06T03:25:46.023198+0000","last_peered":"2023-10-06T03:25:46.023198+0000","last_clean":"2023-10-06T03:25:46.023198+0000","last_became_active":"2023-10-06T03:25:46.017152+0000","last_became_peered":"2023-10-06T03:25:46.017152+0000","last_unstale":"2023-10-06T03:25:46.023198+0000","last_undegraded":"2023-10-06T03:25:46.023198+0000","last_fullsized":"2023-10-06T03:25:46.023198+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.175908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023240+0000","last_change":"2023-10-06T03:25:46.017308+0000","last_active":"2023-10-06T03:25:46.023240+0000","last_peered":"2023-10-06T03:25:46.023240+0000","last_clean":"2023-10-06T03:25:46.023240+0000","last_became_active":"2023-10-06T03:25:46.016915+0000","last_became_peered":"2023-10-06T03:25:46.016915+0000","last_unstale":"2023-10-06T03:25:46.023240+0000","last_undegraded":"2023-10-06T03:25:46.023240+0000","last_fullsized":"2023-10-06T03:25:46.023240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:11:09.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028754+0000","last_change":"2023-10-06T03:25:46.023833+0000","last_active":"2023-10-06T03:25:46.028754+0000","last_peered":"2023-10-06T03:25:46.028754+0000","last_clean":"2023-10-06T03:25:46.028754+0000","last_became_active":"2023-10-06T03:25:46.023550+0000","last_became_peered":"2023-10-06T03:25:46.023550+0000","last_unstale":"2023-10-06T03:25:46.028754+0000","last_undegraded":"2023-10-06T03:25:46.028754+0000","last_fullsized":"2023-10-06T03:25:46.028754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:24.437271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.013517+0000","last_change":"2023-10-06T03:25:46.013517+0000","last_active":"2023-10-06T03:25:46.013517+0000","last_peered":"2023-10-06T03:25:46.013517+0000","last_clean":"2023-10-06T03:25:46.013517+0000","last_became_active":"2023-10-06T03:25:46.013131+0000","last_became_peered":"2023-10-06T03:25:46.013131+0000","last_unstale":"2023-10-06T03:25:46.013517+0000","last_undegraded":"2023-10-06T03:25:46.013517+0000","last_fullsized":"2023-10-06T03:25:46.013517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:45.344254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.024472+0000","last_change":"2023-10-06T03:25:46.024472+0000","last_active":"2023-10-06T03:25:46.024472+0000","last_peered":"2023-10-06T03:25:46.024472+0000","last_clean":"2023-10-06T03:25:46.024472+0000","last_became_active":"2023-10-06T03:25:46.024178+0000","last_became_peered":"2023-10-06T03:25:46.024178+0000","last_unstale":"2023-10-06T03:25:46.024472+0000","last_undegraded":"2023-10-06T03:25:46.024472+0000","last_fullsized":"2023-10-06T03:25:46.024472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:40.194570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.015762+0000","last_change":"2023-10-06T03:25:46.010112+0000","last_active":"2023-10-06T03:25:46.015762+0000","last_peered":"2023-10-06T03:25:46.015762+0000","last_clean":"2023-10-06T03:25:46.015762+0000","last_became_active":"2023-10-06T03:25:46.009850+0000","last_became_peered":"2023-10-06T03:25:46.009850+0000","last_unstale":"2023-10-06T03:25:46.015762+0000","last_undegraded":"2023-10-06T03:25:46.015762+0000","last_fullsized":"2023-10-06T03:25:46.015762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:17.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018448+0000","last_change":"2023-10-06T03:25:46.018448+0000","last_active":"2023-10-06T03:25:46.018448+0000","last_peered":"2023-10-06T03:25:46.018448+0000","last_clean":"2023-10-06T03:25:46.018448+0000","last_became_active":"2023-10-06T03:25:46.018165+0000","last_became_peered":"2023-10-06T03:25:46.018165+0000","last_unstale":"2023-10-06T03:25:46.018448+0000","last_undegraded":"2023-10-06T03:25:46.018448+0000","last_fullsized":"2023-10-06T03:25:46.018448+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:56.023764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.032766+0000","last_change":"2023-10-06T03:25:46.029105+0000","last_active":"2023-10-06T03:25:46.032766+0000","last_peered":"2023-10-06T03:25:46.032766+0000","last_clean":"2023-10-06T03:25:46.032766+0000","last_became_active":"2023-10-06T03:25:46.028834+0000","last_became_peered":"2023-10-06T03:25:46.028834+0000","last_unstale":"2023-10-06T03:25:46.032766+0000","last_undegraded":"2023-10-06T03:25:46.032766+0000","last_fullsized":"2023-10-06T03:25:46.032766+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:48.579247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023230+0000","last_change":"2023-10-06T03:25:46.017856+0000","last_active":"2023-10-06T03:25:46.023230+0000","last_peered":"2023-10-06T03:25:46.023230+0000","last_clean":"2023-10-06T03:25:46.023230+0000","last_became_active":"2023-10-06T03:25:46.017441+0000","last_became_peered":"2023-10-06T03:25:46.017441+0000","last_unstale":"2023-10-06T03:25:46.023230+0000","last_undegraded":"2023-10-06T03:25:46.023230+0000","last_fullsized":"2023-10-06T03:25:46.023230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:30.823727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.026615+0000","last_change":"2023-10-06T03:25:46.026615+0000","last_active":"2023-10-06T03:25:46.026615+0000","last_peered":"2023-10-06T03:25:46.026615+0000","last_clean":"2023-10-06T03:25:46.026615+0000","last_became_active":"2023-10-06T03:25:46.026370+0000","last_became_peered":"2023-10-06T03:25:46.026370+0000","last_unstale":"2023-10-06T03:25:46.026615+0000","last_undegraded":"2023-10-06T03:25:46.026615+0000","last_fullsized":"2023-10-06T03:25:46.026615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.175908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.025797+0000","last_change":"2023-10-06T03:25:46.025797+0000","last_active":"2023-10-06T03:25:46.025797+0000","last_peered":"2023-10-06T03:25:46.025797+0000","last_clean":"2023-10-06T03:25:46.025797+0000","last_became_active":"2023-10-06T03:25:46.025554+0000","last_became_peered":"2023-10-06T03:25:46.025554+0000","last_unstale":"2023-10-06T03:25:46.025797+0000","last_undegraded":"2023-10-06T03:25:46.025797+0000","last_fullsized":"2023-10-06T03:25:46.025797+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:36.654765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.011825+0000","last_change":"2023-10-06T03:25:46.011825+0000","last_active":"2023-10-06T03:25:46.011825+0000","last_peered":"2023-10-06T03:25:46.011825+0000","last_clean":"2023-10-06T03:25:46.011825+0000","last_became_active":"2023-10-06T03:25:46.011559+0000","last_became_peered":"2023-10-06T03:25:46.011559+0000","last_unstale":"2023-10-06T03:25:46.011825+0000","last_undegraded":"2023-10-06T03:25:46.011825+0000","last_fullsized":"2023-10-06T03:25:46.011825+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:59.169291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.022914+0000","last_change":"2023-10-06T03:25:46.010380+0000","last_active":"2023-10-06T03:25:46.022914+0000","last_peered":"2023-10-06T03:25:46.022914+0000","last_clean":"2023-10-06T03:25:46.022914+0000","last_became_active":"2023-10-06T03:25:46.010069+0000","last_became_peered":"2023-10-06T03:25:46.010069+0000","last_unstale":"2023-10-06T03:25:46.022914+0000","last_undegraded":"2023-10-06T03:25:46.022914+0000","last_fullsized":"2023-10-06T03:25:46.022914+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:25.331324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.031024+0000","last_change":"2023-10-06T03:25:46.018883+0000","last_active":"2023-10-06T03:25:46.031024+0000","last_peered":"2023-10-06T03:25:46.031024+0000","last_clean":"2023-10-06T03:25:46.031024+0000","last_became_active":"2023-10-06T03:25:46.017535+0000","last_became_peered":"2023-10-06T03:25:46.017535+0000","last_unstale":"2023-10-06T03:25:46.031024+0000","last_undegraded":"2023-10-06T03:25:46.031024+0000","last_fullsized":"2023-10-06T03:25:46.031024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:56.023764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023290+0000","last_change":"2023-10-06T03:25:46.020302+0000","last_active":"2023-10-06T03:25:46.023290+0000","last_peered":"2023-10-06T03:25:46.023290+0000","last_clean":"2023-10-06T03:25:46.023290+0000","last_became_active":"2023-10-06T03:25:46.020008+0000","last_became_peered":"2023-10-06T03:25:46.020008+0000","last_unstale":"2023-10-06T03:25:46.023290+0000","last_undegraded":"2023-10-06T03:25:46.023290+0000","last_fullsized":"2023-10-06T03:25:46.023290+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:25.244808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.031463+0000","last_change":"2023-10-06T03:25:46.025757+0000","last_active":"2023-10-06T03:25:46.031463+0000","last_peered":"2023-10-06T03:25:46.031463+0000","last_clean":"2023-10-06T03:25:46.031463+0000","last_became_active":"2023-10-06T03:25:46.025503+0000","last_became_peered":"2023-10-06T03:25:46.025503+0000","last_unstale":"2023-10-06T03:25:46.031463+0000","last_undegraded":"2023-10-06T03:25:46.031463+0000","last_fullsized":"2023-10-06T03:25:46.031463+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:34.762514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023181+0000","last_change":"2023-10-06T03:25:46.018691+0000","last_active":"2023-10-06T03:25:46.023181+0000","last_peered":"2023-10-06T03:25:46.023181+0000","last_clean":"2023-10-06T03:25:46.023181+0000","last_became_active":"2023-10-06T03:25:46.017586+0000","last_became_peered":"2023-10-06T03:25:46.017586+0000","last_unstale":"2023-10-06T03:25:46.023181+0000","last_undegraded":"2023-10-06T03:25:46.023181+0000","last_fullsized":"2023-10-06T03:25:46.023181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:22.413185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028052+0000","last_change":"2023-10-06T03:25:46.028052+0000","last_active":"2023-10-06T03:25:46.028052+0000","last_peered":"2023-10-06T03:25:46.028052+0000","last_clean":"2023-10-06T03:25:46.028052+0000","last_became_active":"2023-10-06T03:25:46.027553+0000","last_became_peered":"2023-10-06T03:25:46.027553+0000","last_unstale":"2023-10-06T03:25:46.028052+0000","last_undegraded":"2023-10-06T03:25:46.028052+0000","last_fullsized":"2023-10-06T03:25:46.028052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:57.005974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.016419+0000","last_change":"2023-10-06T03:25:46.016419+0000","last_active":"2023-10-06T03:25:46.016419+0000","last_peered":"2023-10-06T03:25:46.016419+0000","last_clean":"2023-10-06T03:25:46.016419+0000","last_became_active":"2023-10-06T03:25:46.016206+0000","last_became_peered":"2023-10-06T03:25:46.016206+0000","last_unstale":"2023-10-06T03:25:46.016419+0000","last_undegraded":"2023-10-06T03:25:46.016419+0000","last_fullsized":"2023-10-06T03:25:46.016419+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:57.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.031057+0000","last_change":"2023-10-06T03:25:46.020489+0000","last_active":"2023-10-06T03:25:46.031057+0000","last_peered":"2023-10-06T03:25:46.031057+0000","last_clean":"2023-10-06T03:25:46.031057+0000","last_became_active":"2023-10-06T03:25:46.020250+0000","last_became_peered":"2023-10-06T03:25:46.020250+0000","last_unstale":"2023-10-06T03:25:46.031057+0000","last_undegraded":"2023-10-06T03:25:46.031057+0000","last_fullsized":"2023-10-06T03:25:46.031057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:40.194570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.029366+0000","last_change":"2023-10-06T03:25:46.029366+0000","last_active":"2023-10-06T03:25:46.029366+0000","last_peered":"2023-10-06T03:25:46.029366+0000","last_clean":"2023-10-06T03:25:46.029366+0000","last_became_active":"2023-10-06T03:25:46.029119+0000","last_became_peered":"2023-10-06T03:25:46.029119+0000","last_unstale":"2023-10-06T03:25:46.029366+0000","last_undegraded":"2023-10-06T03:25:46.029366+0000","last_fullsized":"2023-10-06T03:25:46.029366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:42.204514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.025790+0000","last_change":"2023-10-06T03:25:46.025790+0000","last_active":"2023-10-06T03:25:46.025790+0000","last_peered":"2023-10-06T03:25:46.025790+0000","last_clean":"2023-10-06T03:25:46.025790+0000","last_became_active":"2023-10-06T03:25:46.025546+0000","last_became_peered":"2023-10-06T03:25:46.025546+0000","last_unstale":"2023-10-06T03:25:46.025790+0000","last_undegraded":"2023-10-06T03:25:46.025790+0000","last_fullsized":"2023-10-06T03:25:46.025790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:58.173623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.016787+0000","last_change":"2023-10-06T03:25:46.016787+0000","last_active":"2023-10-06T03:25:46.016787+0000","last_peered":"2023-10-06T03:25:46.016787+0000","last_clean":"2023-10-06T03:25:46.016787+0000","last_became_active":"2023-10-06T03:25:46.016514+0000","last_became_peered":"2023-10-06T03:25:46.016514+0000","last_unstale":"2023-10-06T03:25:46.016787+0000","last_undegraded":"2023-10-06T03:25:46.016787+0000","last_fullsized":"2023-10-06T03:25:46.016787+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:58.043109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.024478+0000","last_change":"2023-10-06T03:25:46.024478+0000","last_active":"2023-10-06T03:25:46.024478+0000","last_peered":"2023-10-06T03:25:46.024478+0000","last_clean":"2023-10-06T03:25:46.024478+0000","last_became_active":"2023-10-06T03:25:46.024183+0000","last_became_peered":"2023-10-06T03:25:46.024183+0000","last_unstale":"2023-10-06T03:25:46.024478+0000","last_undegraded":"2023-10-06T03:25:46.024478+0000","last_fullsized":"2023-10-06T03:25:46.024478+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:36.195931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.031365+0000","last_change":"2023-10-06T03:25:46.028022+0000","last_active":"2023-10-06T03:25:46.031365+0000","last_peered":"2023-10-06T03:25:46.031365+0000","last_clean":"2023-10-06T03:25:46.031365+0000","last_became_active":"2023-10-06T03:25:46.027750+0000","last_became_peered":"2023-10-06T03:25:46.027750+0000","last_unstale":"2023-10-06T03:25:46.031365+0000","last_undegraded":"2023-10-06T03:25:46.031365+0000","last_fullsized":"2023-10-06T03:25:46.031365+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:57.366762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.021604+0000","last_change":"2023-10-06T03:25:45.004469+0000","last_active":"2023-10-06T03:25:46.021604+0000","last_peered":"2023-10-06T03:25:46.021604+0000","last_clean":"2023-10-06T03:25:46.021604+0000","last_became_active":"2023-10-06T03:25:45.004279+0000","last_became_peered":"2023-10-06T03:25:45.004279+0000","last_unstale":"2023-10-06T03:25:46.021604+0000","last_undegraded":"2023-10-06T03:25:46.021604+0000","last_fullsized":"2023-10-06T03:25:46.021604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:10.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.026329+0000","last_change":"2023-10-06T03:25:46.021543+0000","last_active":"2023-10-06T03:25:46.026329+0000","last_peered":"2023-10-06T03:25:46.026329+0000","last_clean":"2023-10-06T03:25:46.026329+0000","last_became_active":"2023-10-06T03:25:46.021308+0000","last_became_peered":"2023-10-06T03:25:46.021308+0000","last_unstale":"2023-10-06T03:25:46.026329+0000","last_undegraded":"2023-10-06T03:25:46.026329+0000","last_fullsized":"2023-10-06T03:25:46.026329+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:57.297128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.007353+0000","last_change":"2023-10-06T03:25:45.002601+0000","last_active":"2023-10-06T03:25:46.007353+0000","last_peered":"2023-10-06T03:25:46.007353+0000","last_clean":"2023-10-06T03:25:46.007353+0000","last_became_active":"2023-10-06T03:25:45.002246+0000","last_became_peered":"2023-10-06T03:25:45.002246+0000","last_unstale":"2023-10-06T03:25:46.007353+0000","last_undegraded":"2023-10-06T03:25:46.007353+0000","last_fullsized":"2023-10-06T03:25:46.007353+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:29.436003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028579+0000","last_change":"2023-10-06T03:25:46.028579+0000","last_active":"2023-10-06T03:25:46.028579+0000","last_peered":"2023-10-06T03:25:46.028579+0000","last_clean":"2023-10-06T03:25:46.028579+0000","last_became_active":"2023-10-06T03:25:46.028326+0000","last_became_peered":"2023-10-06T03:25:46.028326+0000","last_unstale":"2023-10-06T03:25:46.028579+0000","last_undegraded":"2023-10-06T03:25:46.028579+0000","last_fullsized":"2023-10-06T03:25:46.028579+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:43.640888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028793+0000","last_change":"2023-10-06T03:25:45.008376+0000","last_active":"2023-10-06T03:25:46.028793+0000","last_peered":"2023-10-06T03:25:46.028793+0000","last_clean":"2023-10-06T03:25:46.028793+0000","last_became_active":"2023-10-06T03:25:45.008068+0000","last_became_peered":"2023-10-06T03:25:45.008068+0000","last_unstale":"2023-10-06T03:25:46.028793+0000","last_undegraded":"2023-10-06T03:25:46.028793+0000","last_fullsized":"2023-10-06T03:25:46.028793+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:33.758470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023536+0000","last_change":"2023-10-06T03:25:46.015508+0000","last_active":"2023-10-06T03:25:46.023536+0000","last_peered":"2023-10-06T03:25:46.023536+0000","last_clean":"2023-10-06T03:25:46.023536+0000","last_became_active":"2023-10-06T03:25:46.015064+0000","last_became_peered":"2023-10-06T03:25:46.015064+0000","last_unstale":"2023-10-06T03:25:46.023536+0000","last_undegraded":"2023-10-06T03:25:46.023536+0000","last_fullsized":"2023-10-06T03:25:46.023536+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:57.005974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.027399+0000","last_change":"2023-10-06T03:25:45.007195+0000","last_active":"2023-10-06T03:25:46.027399+0000","last_peered":"2023-10-06T03:25:46.027399+0000","last_clean":"2023-10-06T03:25:46.027399+0000","last_became_active":"2023-10-06T03:25:45.006921+0000","last_became_peered":"2023-10-06T03:25:45.006921+0000","last_unstale":"2023-10-06T03:25:46.027399+0000","last_undegraded":"2023-10-06T03:25:46.027399+0000","last_fullsized":"2023-10-06T03:25:46.027399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:03.601860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.022509+0000","last_change":"2023-10-06T03:25:46.022509+0000","last_active":"2023-10-06T03:25:46.022509+0000","last_peered":"2023-10-06T03:25:46.022509+0000","last_clean":"2023-10-06T03:25:46.022509+0000","last_became_active":"2023-10-06T03:25:46.022263+0000","last_became_peered":"2023-10-06T03:25:46.022263+0000","last_unstale":"2023-10-06T03:25:46.022509+0000","last_undegraded":"2023-10-06T03:25:46.022509+0000","last_fullsized":"2023-10-06T03:25:46.022509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:25.121533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.005080+0000","last_change":"2023-10-06T03:25:44.998993+0000","last_active":"2023-10-06T03:25:46.005080+0000","last_peered":"2023-10-06T03:25:46.005080+0000","last_clean":"2023-10-06T03:25:46.005080+0000","last_became_active":"2023-10-06T03:25:44.998698+0000","last_became_peered":"2023-10-06T03:25:44.998698+0000","last_unstale":"2023-10-06T03:25:46.005080+0000","last_undegraded":"2023-10-06T03:25:46.005080+0000","last_fullsized":"2023-10-06T03:25:46.005080+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:36.136601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023208+0000","last_change":"2023-10-06T03:25:46.017479+0000","last_active":"2023-10-06T03:25:46.023208+0000","last_peered":"2023-10-06T03:25:46.023208+0000","last_clean":"2023-10-06T03:25:46.023208+0000","last_became_active":"2023-10-06T03:25:46.017195+0000","last_became_peered":"2023-10-06T03:25:46.017195+0000","last_unstale":"2023-10-06T03:25:46.023208+0000","last_undegraded":"2023-10-06T03:25:46.023208+0000","last_fullsized":"2023-10-06T03:25:46.023208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:52.415547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.017851+0000","last_change":"2023-10-06T03:25:45.002487+0000","last_active":"2023-10-06T03:25:46.017851+0000","last_peered":"2023-10-06T03:25:46.017851+0000","last_clean":"2023-10-06T03:25:46.017851+0000","last_became_active":"2023-10-06T03:25:45.002062+0000","last_became_peered":"2023-10-06T03:25:45.002062+0000","last_unstale":"2023-10-06T03:25:46.017851+0000","last_undegraded":"2023-10-06T03:25:46.017851+0000","last_fullsized":"2023-10-06T03:25:46.017851+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:29.819683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018537+0000","last_change":"2023-10-06T03:25:46.011762+0000","last_active":"2023-10-06T03:25:46.018537+0000","last_peered":"2023-10-06T03:25:46.018537+0000","last_clean":"2023-10-06T03:25:46.018537+0000","last_became_active":"2023-10-06T03:25:46.011524+0000","last_became_peered":"2023-10-06T03:25:46.011524+0000","last_unstale":"2023-10-06T03:25:46.018537+0000","last_undegraded":"2023-10-06T03:25:46.018537+0000","last_fullsized":"2023-10-06T03:25:46.018537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:08.264021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.007764+0000","last_change":"2023-10-06T03:25:45.004149+0000","last_active":"2023-10-06T03:25:45.007764+0000","last_peered":"2023-10-06T03:25:45.007764+0000","last_clean":"2023-10-06T03:25:45.007764+0000","last_became_active":"2023-10-06T03:25:45.003892+0000","last_became_peered":"2023-10-06T03:25:45.003892+0000","last_unstale":"2023-10-06T03:25:45.007764+0000","last_undegraded":"2023-10-06T03:25:45.007764+0000","last_fullsized":"2023-10-06T03:25:45.007764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:11.469401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.016790+0000","last_change":"2023-10-06T03:25:46.016790+0000","last_active":"2023-10-06T03:25:46.016790+0000","last_peered":"2023-10-06T03:25:46.016790+0000","last_clean":"2023-10-06T03:25:46.016790+0000","last_became_active":"2023-10-06T03:25:46.016616+0000","last_became_peered":"2023-10-06T03:25:46.016616+0000","last_unstale":"2023-10-06T03:25:46.016790+0000","last_undegraded":"2023-10-06T03:25:46.016790+0000","last_fullsized":"2023-10-06T03:25:46.016790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.749479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.000384+0000","last_change":"2023-10-06T03:25:45.000132+0000","last_active":"2023-10-06T03:25:46.000384+0000","last_peered":"2023-10-06T03:25:46.000384+0000","last_clean":"2023-10-06T03:25:46.000384+0000","last_became_active":"2023-10-06T03:25:44.999889+0000","last_became_peered":"2023-10-06T03:25:44.999889+0000","last_unstale":"2023-10-06T03:25:46.000384+0000","last_undegraded":"2023-10-06T03:25:46.000384+0000","last_fullsized":"2023-10-06T03:25:46.000384+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:58.595885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.022104+0000","last_change":"2023-10-06T03:25:46.022104+0000","last_active":"2023-10-06T03:25:46.022104+0000","last_peered":"2023-10-06T03:25:46.022104+0000","last_clean":"2023-10-06T03:25:46.022104+0000","last_became_active":"2023-10-06T03:25:46.018400+0000","last_became_peered":"2023-10-06T03:25:46.018400+0000","last_unstale":"2023-10-06T03:25:46.022104+0000","last_undegraded":"2023-10-06T03:25:46.022104+0000","last_fullsized":"2023-10-06T03:25:46.022104+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:10.487286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.006129+0000","last_change":"2023-10-06T03:25:44.996760+0000","last_active":"2023-10-06T03:25:46.006129+0000","last_peered":"2023-10-06T03:25:46.006129+0000","last_clean":"2023-10-06T03:25:46.006129+0000","last_became_active":"2023-10-06T03:25:44.996445+0000","last_became_peered":"2023-10-06T03:25:44.996445+0000","last_unstale":"2023-10-06T03:25:46.006129+0000","last_undegraded":"2023-10-06T03:25:46.006129+0000","last_fullsized":"2023-10-06T03:25:46.006129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:57.169579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.032144+0000","last_change":"2023-10-06T03:25:46.029249+0000","last_active":"2023-10-06T03:25:46.032144+0000","last_peered":"2023-10-06T03:25:46.032144+0000","last_clean":"2023-10-06T03:25:46.032144+0000","last_became_active":"2023-10-06T03:25:46.028989+0000","last_became_peered":"2023-10-06T03:25:46.028989+0000","last_unstale":"2023-10-06T03:25:46.032144+0000","last_undegraded":"2023-10-06T03:25:46.032144+0000","last_fullsized":"2023-10-06T03:25:46.032144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:30.440047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.009156+0000","last_change":"2023-10-06T03:25:45.007625+0000","last_active":"2023-10-06T03:25:45.009156+0000","last_peered":"2023-10-06T03:25:45.009156+0000","last_clean":"2023-10-06T03:25:45.009156+0000","last_became_active":"2023-10-06T03:25:45.007304+0000","last_became_peered":"2023-10-06T03:25:45.007304+0000","last_unstale":"2023-10-06T03:25:45.009156+0000","last_undegraded":"2023-10-06T03:25:45.009156+0000","last_fullsized":"2023-10-06T03:25:45.009156+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:11.469401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.024458+0000","last_change":"2023-10-06T03:25:46.024458+0000","last_active":"2023-10-06T03:25:46.024458+0000","last_peered":"2023-10-06T03:25:46.024458+0000","last_clean":"2023-10-06T03:25:46.024458+0000","last_became_active":"2023-10-06T03:25:46.024198+0000","last_became_peered":"2023-10-06T03:25:46.024198+0000","last_unstale":"2023-10-06T03:25:46.024458+0000","last_undegraded":"2023-10-06T03:25:46.024458+0000","last_fullsized":"2023-10-06T03:25:46.024458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.222212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.029191+0000","last_change":"2023-10-06T03:25:45.000833+0000","last_active":"2023-10-06T03:25:46.029191+0000","last_peered":"2023-10-06T03:25:46.029191+0000","last_clean":"2023-10-06T03:25:46.029191+0000","last_became_active":"2023-10-06T03:25:45.000484+0000","last_became_peered":"2023-10-06T03:25:45.000484+0000","last_unstale":"2023-10-06T03:25:46.029191+0000","last_undegraded":"2023-10-06T03:25:46.029191+0000","last_fullsized":"2023-10-06T03:25:46.029191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:47.575204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018595+0000","last_change":"2023-10-06T03:25:46.012760+0000","last_active":"2023-10-06T03:25:46.018595+0000","last_peered":"2023-10-06T03:25:46.018595+0000","last_clean":"2023-10-06T03:25:46.018595+0000","last_became_active":"2023-10-06T03:25:46.012378+0000","last_became_peered":"2023-10-06T03:25:46.012378+0000","last_unstale":"2023-10-06T03:25:46.018595+0000","last_undegraded":"2023-10-06T03:25:46.018595+0000","last_fullsized":"2023-10-06T03:25:46.018595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:44.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"61'6","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.021379+0000","last_change":"2023-10-06T03:25:45.005692+0000","last_active":"2023-10-06T03:25:46.021379+0000","last_peered":"2023-10-06T03:25:46.021379+0000","last_clean":"2023-10-06T03:25:46.021379+0000","last_became_active":"2023-10-06T03:25:45.005425+0000","last_became_peered":"2023-10-06T03:25:45.005425+0000","last_unstale":"2023-10-06T03:25:46.021379+0000","last_undegraded":"2023-10-06T03:25:46.021379+0000","last_fullsized":"2023-10-06T03:25:46.021379+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:24.499412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018756+0000","last_change":"2023-10-06T03:25:46.013034+0000","last_active":"2023-10-06T03:25:46.018756+0000","last_peered":"2023-10-06T03:25:46.018756+0000","last_clean":"2023-10-06T03:25:46.018756+0000","last_became_active":"2023-10-06T03:25:46.012759+0000","last_became_peered":"2023-10-06T03:25:46.012759+0000","last_unstale":"2023-10-06T03:25:46.018756+0000","last_undegraded":"2023-10-06T03:25:46.018756+0000","last_fullsized":"2023-10-06T03:25:46.018756+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:37.140645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.016352+0000","last_change":"2023-10-06T03:25:45.004241+0000","last_active":"2023-10-06T03:25:46.016352+0000","last_peered":"2023-10-06T03:25:46.016352+0000","last_clean":"2023-10-06T03:25:46.016352+0000","last_became_active":"2023-10-06T03:25:45.003985+0000","last_became_peered":"2023-10-06T03:25:45.003985+0000","last_unstale":"2023-10-06T03:25:46.016352+0000","last_undegraded":"2023-10-06T03:25:46.016352+0000","last_fullsized":"2023-10-06T03:25:46.016352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:05.355791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.009576+0000","last_change":"2023-10-06T03:25:46.009576+0000","last_active":"2023-10-06T03:25:46.009576+0000","last_peered":"2023-10-06T03:25:46.009576+0000","last_clean":"2023-10-06T03:25:46.009576+0000","last_became_active":"2023-10-06T03:25:46.009224+0000","last_became_peered":"2023-10-06T03:25:46.009224+0000","last_unstale":"2023-10-06T03:25:46.009576+0000","last_undegraded":"2023-10-06T03:25:46.009576+0000","last_fullsized":"2023-10-06T03:25:46.009576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:25.244808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.007779+0000","last_change":"2023-10-06T03:25:45.003034+0000","last_active":"2023-10-06T03:25:45.007779+0000","last_peered":"2023-10-06T03:25:45.007779+0000","last_clean":"2023-10-06T03:25:45.007779+0000","last_became_active":"2023-10-06T03:25:45.002737+0000","last_became_peered":"2023-10-06T03:25:45.002737+0000","last_unstale":"2023-10-06T03:25:45.007779+0000","last_undegraded":"2023-10-06T03:25:45.007779+0000","last_fullsized":"2023-10-06T03:25:45.007779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:16.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028182+0000","last_change":"2023-10-06T03:25:46.028182+0000","last_active":"2023-10-06T03:25:46.028182+0000","last_peered":"2023-10-06T03:25:46.028182+0000","last_clean":"2023-10-06T03:25:46.028182+0000","last_became_active":"2023-10-06T03:25:46.027949+0000","last_became_peered":"2023-10-06T03:25:46.027949+0000","last_unstale":"2023-10-06T03:25:46.028182+0000","last_undegraded":"2023-10-06T03:25:46.028182+0000","last_fullsized":"2023-10-06T03:25:46.028182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:22.413185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.003401+0000","last_change":"2023-10-06T03:25:45.001825+0000","last_active":"2023-10-06T03:25:45.003401+0000","last_peered":"2023-10-06T03:25:45.003401+0000","last_clean":"2023-10-06T03:25:45.003401+0000","last_became_active":"2023-10-06T03:25:45.001555+0000","last_became_peered":"2023-10-06T03:25:45.001555+0000","last_unstale":"2023-10-06T03:25:45.003401+0000","last_undegraded":"2023-10-06T03:25:45.003401+0000","last_fullsized":"2023-10-06T03:25:45.003401+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:33.218168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018619+0000","last_change":"2023-10-06T03:25:46.014091+0000","last_active":"2023-10-06T03:25:46.018619+0000","last_peered":"2023-10-06T03:25:46.018619+0000","last_clean":"2023-10-06T03:25:46.018619+0000","last_became_active":"2023-10-06T03:25:46.013871+0000","last_became_peered":"2023-10-06T03:25:46.013871+0000","last_unstale":"2023-10-06T03:25:46.018619+0000","last_undegraded":"2023-10-06T03:25:46.018619+0000","last_fullsized":"2023-10-06T03:25:46.018619+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:25.503456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.031764+0000","last_change":"2023-10-06T03:25:45.001991+0000","last_active":"2023-10-06T03:25:46.031764+0000","last_peered":"2023-10-06T03:25:46.031764+0000","last_clean":"2023-10-06T03:25:46.031764+0000","last_became_active":"2023-10-06T03:25:45.001035+0000","last_became_peered":"2023-10-06T03:25:45.001035+0000","last_unstale":"2023-10-06T03:25:46.031764+0000","last_undegraded":"2023-10-06T03:25:46.031764+0000","last_fullsized":"2023-10-06T03:25:46.031764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:24.117489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.017911+0000","last_change":"2023-10-06T03:25:46.017911+0000","last_active":"2023-10-06T03:25:46.017911+0000","last_peered":"2023-10-06T03:25:46.017911+0000","last_clean":"2023-10-06T03:25:46.017911+0000","last_became_active":"2023-10-06T03:25:46.017611+0000","last_became_peered":"2023-10-06T03:25:46.017611+0000","last_unstale":"2023-10-06T03:25:46.017911+0000","last_undegraded":"2023-10-06T03:25:46.017911+0000","last_fullsized":"2023-10-06T03:25:46.017911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:11:09.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.029935+0000","last_change":"2023-10-06T03:25:45.009289+0000","last_active":"2023-10-06T03:25:46.029935+0000","last_peered":"2023-10-06T03:25:46.029935+0000","last_clean":"2023-10-06T03:25:46.029935+0000","last_became_active":"2023-10-06T03:25:45.009041+0000","last_became_peered":"2023-10-06T03:25:45.009041+0000","last_unstale":"2023-10-06T03:25:46.029935+0000","last_undegraded":"2023-10-06T03:25:46.029935+0000","last_fullsized":"2023-10-06T03:25:46.029935+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:45.294610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018792+0000","last_change":"2023-10-06T03:25:46.018792+0000","last_active":"2023-10-06T03:25:46.018792+0000","last_peered":"2023-10-06T03:25:46.018792+0000","last_clean":"2023-10-06T03:25:46.018792+0000","last_became_active":"2023-10-06T03:25:46.018272+0000","last_became_peered":"2023-10-06T03:25:46.018272+0000","last_unstale":"2023-10-06T03:25:46.018792+0000","last_undegraded":"2023-10-06T03:25:46.018792+0000","last_fullsized":"2023-10-06T03:25:46.018792+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:39.404526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.002943+0000","last_change":"2023-10-06T03:25:45.001792+0000","last_active":"2023-10-06T03:25:45.002943+0000","last_peered":"2023-10-06T03:25:45.002943+0000","last_clean":"2023-10-06T03:25:45.002943+0000","last_became_active":"2023-10-06T03:25:45.001535+0000","last_became_peered":"2023-10-06T03:25:45.001535+0000","last_unstale":"2023-10-06T03:25:45.002943+0000","last_undegraded":"2023-10-06T03:25:45.002943+0000","last_fullsized":"2023-10-06T03:25:45.002943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:29.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028935+0000","last_change":"2023-10-06T03:25:46.025518+0000","last_active":"2023-10-06T03:25:46.028935+0000","last_peered":"2023-10-06T03:25:46.028935+0000","last_clean":"2023-10-06T03:25:46.028935+0000","last_became_active":"2023-10-06T03:25:46.025240+0000","last_became_peered":"2023-10-06T03:25:46.025240+0000","last_unstale":"2023-10-06T03:25:46.028935+0000","last_undegraded":"2023-10-06T03:25:46.028935+0000","last_fullsized":"2023-10-06T03:25:46.028935+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:57.408390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.000748+0000","last_change":"2023-10-06T03:25:45.002464+0000","last_active":"2023-10-06T03:25:46.000748+0000","last_peered":"2023-10-06T03:25:46.000748+0000","last_clean":"2023-10-06T03:25:46.000748+0000","last_became_active":"2023-10-06T03:25:45.002224+0000","last_became_peered":"2023-10-06T03:25:45.002224+0000","last_unstale":"2023-10-06T03:25:46.000748+0000","last_undegraded":"2023-10-06T03:25:46.000748+0000","last_fullsized":"2023-10-06T03:25:46.000748+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:46.748907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023556+0000","last_change":"2023-10-06T03:25:46.020156+0000","last_active":"2023-10-06T03:25:46.023556+0000","last_peered":"2023-10-06T03:25:46.023556+0000","last_clean":"2023-10-06T03:25:46.023556+0000","last_became_active":"2023-10-06T03:25:46.019866+0000","last_became_peered":"2023-10-06T03:25:46.019866+0000","last_unstale":"2023-10-06T03:25:46.023556+0000","last_undegraded":"2023-10-06T03:25:46.023556+0000","last_fullsized":"2023-10-06T03:25:46.023556+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:58.043109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.010565+0000","last_change":"2023-10-06T03:25:45.003334+0000","last_active":"2023-10-06T03:25:45.010565+0000","last_peered":"2023-10-06T03:25:45.010565+0000","last_clean":"2023-10-06T03:25:45.010565+0000","last_became_active":"2023-10-06T03:25:45.002956+0000","last_became_peered":"2023-10-06T03:25:45.002956+0000","last_unstale":"2023-10-06T03:25:45.010565+0000","last_undegraded":"2023-10-06T03:25:45.010565+0000","last_fullsized":"2023-10-06T03:25:45.010565+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:56.001930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.020433+0000","last_change":"2023-10-06T03:25:46.015622+0000","last_active":"2023-10-06T03:25:46.020433+0000","last_peered":"2023-10-06T03:25:46.020433+0000","last_clean":"2023-10-06T03:25:46.020433+0000","last_became_active":"2023-10-06T03:25:46.015377+0000","last_became_peered":"2023-10-06T03:25:46.015377+0000","last_unstale":"2023-10-06T03:25:46.020433+0000","last_undegraded":"2023-10-06T03:25:46.020433+0000","last_fullsized":"2023-10-06T03:25:46.020433+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:59.266439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.000552+0000","last_change":"2023-10-06T03:25:45.003147+0000","last_active":"2023-10-06T03:25:46.000552+0000","last_peered":"2023-10-06T03:25:46.000552+0000","last_clean":"2023-10-06T03:25:46.000552+0000","last_became_active":"2023-10-06T03:25:45.002885+0000","last_became_peered":"2023-10-06T03:25:45.002885+0000","last_unstale":"2023-10-06T03:25:46.000552+0000","last_undegraded":"2023-10-06T03:25:46.000552+0000","last_fullsized":"2023-10-06T03:25:46.000552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:46.219499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.027539+0000","last_change":"2023-10-06T03:25:46.027539+0000","last_active":"2023-10-06T03:25:46.027539+0000","last_peered":"2023-10-06T03:25:46.027539+0000","last_clean":"2023-10-06T03:25:46.027539+0000","last_became_active":"2023-10-06T03:25:46.027220+0000","last_became_peered":"2023-10-06T03:25:46.027220+0000","last_unstale":"2023-10-06T03:25:46.027539+0000","last_undegraded":"2023-10-06T03:25:46.027539+0000","last_fullsized":"2023-10-06T03:25:46.027539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:30.769799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.003998+0000","last_change":"2023-10-06T03:25:45.001804+0000","last_active":"2023-10-06T03:25:45.003998+0000","last_peered":"2023-10-06T03:25:45.003998+0000","last_clean":"2023-10-06T03:25:45.003998+0000","last_became_active":"2023-10-06T03:25:45.001629+0000","last_became_peered":"2023-10-06T03:25:45.001629+0000","last_unstale":"2023-10-06T03:25:45.003998+0000","last_undegraded":"2023-10-06T03:25:45.003998+0000","last_fullsized":"2023-10-06T03:25:45.003998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:45.294610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.020229+0000","last_change":"2023-10-06T03:25:46.020229+0000","last_active":"2023-10-06T03:25:46.020229+0000","last_peered":"2023-10-06T03:25:46.020229+0000","last_clean":"2023-10-06T03:25:46.020229+0000","last_became_active":"2023-10-06T03:25:46.019990+0000","last_became_peered":"2023-10-06T03:25:46.019990+0000","last_unstale":"2023-10-06T03:25:46.020229+0000","last_undegraded":"2023-10-06T03:25:46.020229+0000","last_fullsized":"2023-10-06T03:25:46.020229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:08.264021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.004654+0000","last_change":"2023-10-06T03:25:45.002910+0000","last_active":"2023-10-06T03:25:46.004654+0000","last_peered":"2023-10-06T03:25:46.004654+0000","last_clean":"2023-10-06T03:25:46.004654+0000","last_became_active":"2023-10-06T03:25:45.000864+0000","last_became_peered":"2023-10-06T03:25:45.000864+0000","last_unstale":"2023-10-06T03:25:46.004654+0000","last_undegraded":"2023-10-06T03:25:46.004654+0000","last_fullsized":"2023-10-06T03:25:46.004654+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:00.754898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.027395+0000","last_change":"2023-10-06T03:25:46.027395+0000","last_active":"2023-10-06T03:25:46.027395+0000","last_peered":"2023-10-06T03:25:46.027395+0000","last_clean":"2023-10-06T03:25:46.027395+0000","last_became_active":"2023-10-06T03:25:46.026716+0000","last_became_peered":"2023-10-06T03:25:46.026716+0000","last_unstale":"2023-10-06T03:25:46.027395+0000","last_undegraded":"2023-10-06T03:25:46.027395+0000","last_fullsized":"2023-10-06T03:25:46.027395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:17.954565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.007713+0000","last_change":"2023-10-06T03:25:45.002549+0000","last_active":"2023-10-06T03:25:45.007713+0000","last_peered":"2023-10-06T03:25:45.007713+0000","last_clean":"2023-10-06T03:25:45.007713+0000","last_became_active":"2023-10-06T03:25:45.002270+0000","last_became_peered":"2023-10-06T03:25:45.002270+0000","last_unstale":"2023-10-06T03:25:45.007713+0000","last_undegraded":"2023-10-06T03:25:45.007713+0000","last_fullsized":"2023-10-06T03:25:45.007713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:24.499412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023032+0000","last_change":"2023-10-06T03:25:46.013852+0000","last_active":"2023-10-06T03:25:46.023032+0000","last_peered":"2023-10-06T03:25:46.023032+0000","last_clean":"2023-10-06T03:25:46.023032+0000","last_became_active":"2023-10-06T03:25:46.013493+0000","last_became_peered":"2023-10-06T03:25:46.013493+0000","last_unstale":"2023-10-06T03:25:46.023032+0000","last_undegraded":"2023-10-06T03:25:46.023032+0000","last_fullsized":"2023-10-06T03:25:46.023032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:10.487286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.027316+0000","last_change":"2023-10-06T03:25:45.008442+0000","last_active":"2023-10-06T03:25:46.027316+0000","last_peered":"2023-10-06T03:25:46.027316+0000","last_clean":"2023-10-06T03:25:46.027316+0000","last_became_active":"2023-10-06T03:25:45.008169+0000","last_became_peered":"2023-10-06T03:25:45.008169+0000","last_unstale":"2023-10-06T03:25:46.027316+0000","last_undegraded":"2023-10-06T03:25:46.027316+0000","last_fullsized":"2023-10-06T03:25:46.027316+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:38.400482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":50,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.005950+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:25:46.005950+0000","last_peered":"2023-10-06T03:25:46.005950+0000","last_clean":"2023-10-06T03:25:46.005950+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:25:46.005950+0000","last_undegraded":"2023-10-06T03:25:46.005950+0000","last_fullsized":"2023-10-06T03:25:46.005950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.022817+0000","last_change":"2023-10-06T03:25:46.010245+0000","last_active":"2023-10-06T03:25:46.022817+0000","last_peered":"2023-10-06T03:25:46.022817+0000","last_clean":"2023-10-06T03:25:46.022817+0000","last_became_active":"2023-10-06T03:25:46.009965+0000","last_became_peered":"2023-10-06T03:25:46.009965+0000","last_unstale":"2023-10-06T03:25:46.022817+0000","last_undegraded":"2023-10-06T03:25:46.022817+0000","last_fullsized":"2023-10-06T03:25:46.022817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:54.408217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.017896+0000","last_change":"2023-10-06T03:25:45.009560+0000","last_active":"2023-10-06T03:25:46.017896+0000","last_peered":"2023-10-06T03:25:46.017896+0000","last_clean":"2023-10-06T03:25:46.017896+0000","last_became_active":"2023-10-06T03:25:45.009078+0000","last_became_peered":"2023-10-06T03:25:45.009078+0000","last_unstale":"2023-10-06T03:25:46.017896+0000","last_undegraded":"2023-10-06T03:25:46.017896+0000","last_fullsized":"2023-10-06T03:25:46.017896+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:24.144858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:44.987005+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:25:44.987005+0000","last_peered":"2023-10-06T03:25:44.987005+0000","last_clean":"2023-10-06T03:25:44.987005+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:25:44.987005+0000","last_undegraded":"2023-10-06T03:25:44.987005+0000","last_fullsized":"2023-10-06T03:25:44.987005+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.026954+0000","last_change":"2023-10-06T03:25:46.026954+0000","last_active":"2023-10-06T03:25:46.026954+0000","last_peered":"2023-10-06T03:25:46.026954+0000","last_clean":"2023-10-06T03:25:46.026954+0000","last_became_active":"2023-10-06T03:25:46.026648+0000","last_became_peered":"2023-10-06T03:25:46.026648+0000","last_unstale":"2023-10-06T03:25:46.026954+0000","last_undegraded":"2023-10-06T03:25:46.026954+0000","last_fullsized":"2023-10-06T03:25:46.026954+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:14.084505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.010443+0000","last_change":"2023-10-06T03:25:45.002010+0000","last_active":"2023-10-06T03:25:45.010443+0000","last_peered":"2023-10-06T03:25:45.010443+0000","last_clean":"2023-10-06T03:25:45.010443+0000","last_became_active":"2023-10-06T03:25:45.001690+0000","last_became_peered":"2023-10-06T03:25:45.001690+0000","last_unstale":"2023-10-06T03:25:45.010443+0000","last_undegraded":"2023-10-06T03:25:45.010443+0000","last_fullsized":"2023-10-06T03:25:45.010443+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:23.433227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:44.997677+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:25:44.997677+0000","last_peered":"2023-10-06T03:25:44.997677+0000","last_clean":"2023-10-06T03:25:44.997677+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:25:44.997677+0000","last_undegraded":"2023-10-06T03:25:44.997677+0000","last_fullsized":"2023-10-06T03:25:44.997677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":205,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.003805+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:25:46.003805+0000","last_peered":"2023-10-06T03:25:46.003805+0000","last_clean":"2023-10-06T03:25:46.003805+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:25:46.003805+0000","last_undegraded":"2023-10-06T03:25:46.003805+0000","last_fullsized":"2023-10-06T03:25:46.003805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.025163+0000","last_change":"2023-10-06T03:25:46.025163+0000","last_active":"2023-10-06T03:25:46.025163+0000","last_peered":"2023-10-06T03:25:46.025163+0000","last_clean":"2023-10-06T03:25:46.025163+0000","last_became_active":"2023-10-06T03:25:46.024998+0000","last_became_peered":"2023-10-06T03:25:46.024998+0000","last_unstale":"2023-10-06T03:25:46.025163+0000","last_undegraded":"2023-10-06T03:25:46.025163+0000","last_fullsized":"2023-10-06T03:25:46.025163+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:57.826713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.007321+0000","last_change":"2023-10-06T03:25:45.006006+0000","last_active":"2023-10-06T03:25:45.007321+0000","last_peered":"2023-10-06T03:25:45.007321+0000","last_clean":"2023-10-06T03:25:45.007321+0000","last_became_active":"2023-10-06T03:25:45.005717+0000","last_became_peered":"2023-10-06T03:25:45.005717+0000","last_unstale":"2023-10-06T03:25:45.007321+0000","last_undegraded":"2023-10-06T03:25:45.007321+0000","last_fullsized":"2023-10-06T03:25:45.007321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:10.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":55,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.003086+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:25:46.003086+0000","last_peered":"2023-10-06T03:25:46.003086+0000","last_clean":"2023-10-06T03:25:46.003086+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:25:46.003086+0000","last_undegraded":"2023-10-06T03:25:46.003086+0000","last_fullsized":"2023-10-06T03:25:46.003086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.026084+0000","last_change":"2023-10-06T03:25:46.026084+0000","last_active":"2023-10-06T03:25:46.026084+0000","last_peered":"2023-10-06T03:25:46.026084+0000","last_clean":"2023-10-06T03:25:46.026084+0000","last_became_active":"2023-10-06T03:25:46.025854+0000","last_became_peered":"2023-10-06T03:25:46.025854+0000","last_unstale":"2023-10-06T03:25:46.026084+0000","last_undegraded":"2023-10-06T03:25:46.026084+0000","last_fullsized":"2023-10-06T03:25:46.026084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:24.732007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.029664+0000","last_change":"2023-10-06T03:25:45.005104+0000","last_active":"2023-10-06T03:25:46.029664+0000","last_peered":"2023-10-06T03:25:46.029664+0000","last_clean":"2023-10-06T03:25:46.029664+0000","last_became_active":"2023-10-06T03:25:45.002854+0000","last_became_peered":"2023-10-06T03:25:45.002854+0000","last_unstale":"2023-10-06T03:25:46.029664+0000","last_undegraded":"2023-10-06T03:25:46.029664+0000","last_fullsized":"2023-10-06T03:25:46.029664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:56.293084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":55,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.003922+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:25:46.003922+0000","last_peered":"2023-10-06T03:25:46.003922+0000","last_clean":"2023-10-06T03:25:46.003922+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:25:46.003922+0000","last_undegraded":"2023-10-06T03:25:46.003922+0000","last_fullsized":"2023-10-06T03:25:46.003922+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.014061+0000","last_change":"2023-10-06T03:25:46.014061+0000","last_active":"2023-10-06T03:25:46.014061+0000","last_peered":"2023-10-06T03:25:46.014061+0000","last_clean":"2023-10-06T03:25:46.014061+0000","last_became_active":"2023-10-06T03:25:46.013542+0000","last_became_peered":"2023-10-06T03:25:46.013542+0000","last_unstale":"2023-10-06T03:25:46.014061+0000","last_undegraded":"2023-10-06T03:25:46.014061+0000","last_fullsized":"2023-10-06T03:25:46.014061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:27.132234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.007746+0000","last_change":"2023-10-06T03:25:45.002312+0000","last_active":"2023-10-06T03:25:45.007746+0000","last_peered":"2023-10-06T03:25:45.007746+0000","last_clean":"2023-10-06T03:25:45.007746+0000","last_became_active":"2023-10-06T03:25:45.001774+0000","last_became_peered":"2023-10-06T03:25:45.001774+0000","last_unstale":"2023-10-06T03:25:45.007746+0000","last_undegraded":"2023-10-06T03:25:45.007746+0000","last_fullsized":"2023-10-06T03:25:45.007746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:58.262395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:44.993209+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:25:44.993209+0000","last_peered":"2023-10-06T03:25:44.993209+0000","last_clean":"2023-10-06T03:25:44.993209+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:25:44.993209+0000","last_undegraded":"2023-10-06T03:25:44.993209+0000","last_fullsized":"2023-10-06T03:25:44.993209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.013353+0000","last_change":"2023-10-06T03:25:46.013353+0000","last_active":"2023-10-06T03:25:46.013353+0000","last_peered":"2023-10-06T03:25:46.013353+0000","last_clean":"2023-10-06T03:25:46.013353+0000","last_became_active":"2023-10-06T03:25:46.012850+0000","last_became_peered":"2023-10-06T03:25:46.012850+0000","last_unstale":"2023-10-06T03:25:46.013353+0000","last_undegraded":"2023-10-06T03:25:46.013353+0000","last_fullsized":"2023-10-06T03:25:46.013353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:31.502133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018163+0000","last_change":"2023-10-06T03:25:45.007408+0000","last_active":"2023-10-06T03:25:46.018163+0000","last_peered":"2023-10-06T03:25:46.018163+0000","last_clean":"2023-10-06T03:25:46.018163+0000","last_became_active":"2023-10-06T03:25:45.007140+0000","last_became_peered":"2023-10-06T03:25:45.007140+0000","last_unstale":"2023-10-06T03:25:46.018163+0000","last_undegraded":"2023-10-06T03:25:46.018163+0000","last_fullsized":"2023-10-06T03:25:46.018163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:43.282411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.000629+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:25:45.000629+0000","last_peered":"2023-10-06T03:25:45.000629+0000","last_clean":"2023-10-06T03:25:45.000629+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:25:45.000629+0000","last_undegraded":"2023-10-06T03:25:45.000629+0000","last_fullsized":"2023-10-06T03:25:45.000629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018577+0000","last_change":"2023-10-06T03:25:46.012612+0000","last_active":"2023-10-06T03:25:46.018577+0000","last_peered":"2023-10-06T03:25:46.018577+0000","last_clean":"2023-10-06T03:25:46.018577+0000","last_became_active":"2023-10-06T03:25:46.012049+0000","last_became_peered":"2023-10-06T03:25:46.012049+0000","last_unstale":"2023-10-06T03:25:46.018577+0000","last_undegraded":"2023-10-06T03:25:46.018577+0000","last_fullsized":"2023-10-06T03:25:46.018577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:31.502133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.003452+0000","last_change":"2023-10-06T03:25:45.005918+0000","last_active":"2023-10-06T03:25:46.003452+0000","last_peered":"2023-10-06T03:25:46.003452+0000","last_clean":"2023-10-06T03:25:46.003452+0000","last_became_active":"2023-10-06T03:25:45.005643+0000","last_became_peered":"2023-10-06T03:25:45.005643+0000","last_unstale":"2023-10-06T03:25:46.003452+0000","last_undegraded":"2023-10-06T03:25:46.003452+0000","last_fullsized":"2023-10-06T03:25:46.003452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:33.218168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.000370+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:25:45.000370+0000","last_peered":"2023-10-06T03:25:45.000370+0000","last_clean":"2023-10-06T03:25:45.000370+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:25:45.000370+0000","last_undegraded":"2023-10-06T03:25:45.000370+0000","last_fullsized":"2023-10-06T03:25:45.000370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298596,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073244,"statfs":{"total":96636764160,"available":96331001856,"internally_reserved":0,"allocated":1339392,"data_stored":932809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.504}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.439},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":745472,"data_stored":341945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.343,"15min":1.343},"last":0.502}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.329,"15min":1.329},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.76400000000000001,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.436},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80400000000000005,"15min":0.83999999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.371}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.042,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.80600000000000005,"15min":0.84199999999999997},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.626,"15min":0.625},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298608,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073232,"statfs":{"total":96636764160,"available":96330989568,"internally_reserved":0,"allocated":1351680,"data_stored":934345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.38700000000000001,"15min":0.40300000000000002},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.38500000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.247},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.41199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.40600000000000003,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.29099999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.44800000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.44600000000000001,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.41699999999999998,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.32600000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.745,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80100000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.70899999999999996,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298004,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073836,"statfs":{"total":96636764160,"available":96331608064,"internally_reserved":0,"allocated":733184,"data_stored":340500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":12.19,"5min":12.19,"15min":12.19},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":8.3900000000000006,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.32500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.313},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.253}]},{"osd":3,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.948,"5min":16.948,"15min":16.948},"last":0.42899999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":16.881,"5min":16.881,"15min":16.881},"last":0.52700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":350350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33800000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.51500000000000001,"5min":0.62,"15min":0.62},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.48599999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.42799999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.252},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52100000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55700000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.875,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":745472,"data_stored":341965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32400000000000001,"15min":0.32600000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42699999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.254},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49199999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.312}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77100000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75700000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.436}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":348884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2709999999999999,"5min":4.758,"15min":4.758},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.88900000000000001,"15min":0.95299999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.5},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.437}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84399999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":341943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.623}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:25:50.065 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:25:50.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.210+0000 7f13e642c700 1 Processor -- start 2023-10-06T03:25:50.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.210+0000 7f13e642c700 1 -- start start 2023-10-06T03:25:50.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13e642c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f13e01595a0 0x7f13e00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13e642c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e00b0ca0 con 0x7f13e00b07a0 2023-10-06T03:25:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13e642c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e00b0f80 con 0x7f13e00b49e0 2023-10-06T03:25:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13e642c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e00b1260 con 0x7f13e01595a0 2023-10-06T03:25:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13dffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f13e01595a0 0x7f13e00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13e49c9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f13e00b07a0 0x7f13e00b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49274/0 (socket says 172.21.15.84:49274) 2023-10-06T03:25:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13dffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f13e01595a0 0x7f13e00aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55732/0 (socket says 172.21.15.84:55732) 2023-10-06T03:25:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13e49c9700 1 -- 172.21.15.84:0/2839777837 learned_addr learned my addr 172.21.15.84:0/2839777837 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13dffff700 1 -- 172.21.15.84:0/2839777837 >> v1:172.21.15.131:6789/0 conn(0x7f13e00b49e0 legacy=0x7f13e00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13dffff700 1 -- 172.21.15.84:0/2839777837 >> v1:172.21.15.84:6789/0 conn(0x7f13e00b07a0 legacy=0x7f13e00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13dffff700 1 -- 172.21.15.84:0/2839777837 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00b1540 con 0x7f13e01595a0 2023-10-06T03:25:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13deffd700 1 -- 172.21.15.84:0/2839777837 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138149981 0 0) 0x7f13e00b0ca0 con 0x7f13e00b07a0 2023-10-06T03:25:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13dffff700 1 --2- 172.21.15.84:0/2839777837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 0x7f13e00aa570 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009900 tx=0x7f13d0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2476d1eb57f7e16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.211+0000 7f13deffd700 1 -- 172.21.15.84:0/2839777837 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0009ea0 con 0x7f13e01595a0 2023-10-06T03:25:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.212+0000 7f13deffd700 1 -- 172.21.15.84:0/2839777837 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d0005c10 con 0x7f13e01595a0 2023-10-06T03:25:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.212+0000 7f13deffd700 1 -- 172.21.15.84:0/2839777837 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000b610 con 0x7f13e01595a0 2023-10-06T03:25:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.212+0000 7f13e642c700 1 -- 172.21.15.84:0/2839777837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 msgr2=0x7f13e00aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.212+0000 7f13e642c700 1 --2- 172.21.15.84:0/2839777837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 0x7f13e00aa570 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009900 tx=0x7f13d0009120 comp rx=0 tx=0).stop 2023-10-06T03:25:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.212+0000 7f13e642c700 1 -- 172.21.15.84:0/2839777837 shutdown_connections 2023-10-06T03:25:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.212+0000 7f13e642c700 1 --2- 172.21.15.84:0/2839777837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 0x7f13e00aa570 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.212+0000 7f13e642c700 1 -- 172.21.15.84:0/2839777837 >> 172.21.15.84:0/2839777837 conn(0x7f13e0099830 msgr2=0x7f13e006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.212+0000 7f13e642c700 1 -- 172.21.15.84:0/2839777837 shutdown_connections 2023-10-06T03:25:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.212+0000 7f13e642c700 1 -- 172.21.15.84:0/2839777837 wait complete. 2023-10-06T03:25:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.213+0000 7f13e642c700 1 Processor -- start 2023-10-06T03:25:50.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.213+0000 7f13e642c700 1 -- start start 2023-10-06T03:25:50.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e642c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13e00b07a0 0x7f13e00acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e642c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13e00b49e0 0x7f13e0157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e642c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 0x7f13e009a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e642c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00ab2d0 con 0x7f13e01595a0 2023-10-06T03:25:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e642c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00abb70 con 0x7f13e00b49e0 2023-10-06T03:25:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e642c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e009ddc0 con 0x7f13e00b07a0 2023-10-06T03:25:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e49c9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 0x7f13e009a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e49c9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 0x7f13e009a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55746/0 (socket says 172.21.15.84:55746) 2023-10-06T03:25:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e49c9700 1 -- 172.21.15.84:0/2099141442 learned_addr learned my addr 172.21.15.84:0/2099141442 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13dffff700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13e00b07a0 0x7f13e00acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13df7fe700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13e00b49e0 0x7f13e0157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e49c9700 1 -- 172.21.15.84:0/2099141442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13e00b07a0 msgr2=0x7f13e00acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.214+0000 7f13e49c9700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13e00b07a0 0x7f13e00acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.215+0000 7f13e49c9700 1 -- 172.21.15.84:0/2099141442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13e00b49e0 msgr2=0x7f13e0157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.215+0000 7f13e49c9700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13e00b49e0 0x7f13e0157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.215+0000 7f13e49c9700 1 -- 172.21.15.84:0/2099141442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d00093c0 con 0x7f13e01595a0 2023-10-06T03:25:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.215+0000 7f13e49c9700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 0x7f13e009a2a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f13d800cc90 tx=0x7f13d8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.215+0000 7f13c7fff700 1 -- 172.21.15.84:0/2099141442 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800a8b0 con 0x7f13e01595a0 2023-10-06T03:25:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.215+0000 7f13c7fff700 1 -- 172.21.15.84:0/2099141442 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d800aa10 con 0x7f13e01595a0 2023-10-06T03:25:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.215+0000 7f13c7fff700 1 -- 172.21.15.84:0/2099141442 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800add0 con 0x7f13e01595a0 2023-10-06T03:25:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.215+0000 7f13e642c700 1 -- 172.21.15.84:0/2099141442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e00ab520 con 0x7f13e01595a0 2023-10-06T03:25:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.215+0000 7f13e642c700 1 -- 172.21.15.84:0/2099141442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e0158020 con 0x7f13e01595a0 2023-10-06T03:25:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.216+0000 7f13e642c700 1 -- 172.21.15.84:0/2099141442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e00abd20 con 0x7f13e01595a0 2023-10-06T03:25:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.216+0000 7f13c7fff700 1 -- 172.21.15.84:0/2099141442 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13d8007300 con 0x7f13e01595a0 2023-10-06T03:25:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.216+0000 7f13c7fff700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f13cc066f30 0x7f13cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.217+0000 7f13c7fff700 1 -- 172.21.15.84:0/2099141442 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f13d8084ab0 con 0x7f13e01595a0 2023-10-06T03:25:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.217+0000 7f13dffff700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f13cc066f30 0x7f13cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.217+0000 7f13dffff700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f13cc066f30 0x7f13cc0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009390 tx=0x7f13d0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.221+0000 7f13c7fff700 1 -- 172.21.15.84:0/2099141442 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13e00abd20 con 0x7f13e01595a0 2023-10-06T03:25:50.283 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T03:25:50.282+0000 7f20b6469700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:25:50.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.401+0000 7f13e642c700 1 -- 172.21.15.84:0/2099141442 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13e00abce0 con 0x7f13cc066f30 2023-10-06T03:25:50.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.409+0000 7f13c7fff700 1 -- 172.21.15.84:0/2099141442 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311777 (secure 0 0 0) 0x7f13e00abce0 con 0x7f13cc066f30 2023-10-06T03:25:50.415 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:50.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 -- 172.21.15.84:0/2099141442 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f13cc066f30 msgr2=0x7f13cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f13cc066f30 0x7f13cc0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009390 tx=0x7f13d0016000 comp rx=0 tx=0).stop 2023-10-06T03:25:50.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 -- 172.21.15.84:0/2099141442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 msgr2=0x7f13e009a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 0x7f13e009a2a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f13d800cc90 tx=0x7f13d8001a80 comp rx=0 tx=0).stop 2023-10-06T03:25:50.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 -- 172.21.15.84:0/2099141442 shutdown_connections 2023-10-06T03:25:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f13cc066f30 0x7f13cc0693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e01595a0 0x7f13e009a2a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13e00b07a0 0x7f13e00acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 --2- 172.21.15.84:0/2099141442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13e00b49e0 0x7f13e0157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 -- 172.21.15.84:0/2099141442 >> 172.21.15.84:0/2099141442 conn(0x7f13e0099830 msgr2=0x7f13e01589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:50.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 -- 172.21.15.84:0/2099141442 shutdown_connections 2023-10-06T03:25:50.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.413+0000 7f13e642c700 1 -- 172.21.15.84:0/2099141442 wait complete. 2023-10-06T03:25:50.421 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:25:50.427 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-10-06T03:25:49.064986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385308,"kb_used_data":7004,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589412,"statfs":{"total":773094113280,"available":770651557888,"internally_reserved":0,"allocated":7172096,"data_stored":3932741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.081269"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023055+0000","last_change":"2023-10-06T03:25:46.014635+0000","last_active":"2023-10-06T03:25:46.023055+0000","last_peered":"2023-10-06T03:25:46.023055+0000","last_clean":"2023-10-06T03:25:46.023055+0000","last_became_active":"2023-10-06T03:25:46.014321+0000","last_became_peered":"2023-10-06T03:25:46.014321+0000","last_unstale":"2023-10-06T03:25:46.023055+0000","last_undegraded":"2023-10-06T03:25:46.023055+0000","last_fullsized":"2023-10-06T03:25:46.023055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:48.579247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.026982+0000","last_change":"2023-10-06T03:25:46.026982+0000","last_active":"2023-10-06T03:25:46.026982+0000","last_peered":"2023-10-06T03:25:46.026982+0000","last_clean":"2023-10-06T03:25:46.026982+0000","last_became_active":"2023-10-06T03:25:46.026248+0000","last_became_peered":"2023-10-06T03:25:46.026248+0000","last_unstale":"2023-10-06T03:25:46.026982+0000","last_undegraded":"2023-10-06T03:25:46.026982+0000","last_fullsized":"2023-10-06T03:25:46.026982+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.538375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.015987+0000","last_change":"2023-10-06T03:25:46.015987+0000","last_active":"2023-10-06T03:25:46.015987+0000","last_peered":"2023-10-06T03:25:46.015987+0000","last_clean":"2023-10-06T03:25:46.015987+0000","last_became_active":"2023-10-06T03:25:46.015750+0000","last_became_peered":"2023-10-06T03:25:46.015750+0000","last_unstale":"2023-10-06T03:25:46.015987+0000","last_undegraded":"2023-10-06T03:25:46.015987+0000","last_fullsized":"2023-10-06T03:25:46.015987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.749479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.024653+0000","last_change":"2023-10-06T03:25:46.024653+0000","last_active":"2023-10-06T03:25:46.024653+0000","last_peered":"2023-10-06T03:25:46.024653+0000","last_clean":"2023-10-06T03:25:46.024653+0000","last_became_active":"2023-10-06T03:25:46.024380+0000","last_became_peered":"2023-10-06T03:25:46.024380+0000","last_unstale":"2023-10-06T03:25:46.024653+0000","last_undegraded":"2023-10-06T03:25:46.024653+0000","last_fullsized":"2023-10-06T03:25:46.024653+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:17.380384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018494+0000","last_change":"2023-10-06T03:25:46.013133+0000","last_active":"2023-10-06T03:25:46.018494+0000","last_peered":"2023-10-06T03:25:46.018494+0000","last_clean":"2023-10-06T03:25:46.018494+0000","last_became_active":"2023-10-06T03:25:46.012880+0000","last_became_peered":"2023-10-06T03:25:46.012880+0000","last_unstale":"2023-10-06T03:25:46.018494+0000","last_undegraded":"2023-10-06T03:25:46.018494+0000","last_fullsized":"2023-10-06T03:25:46.018494+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:25.148902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.025648+0000","last_change":"2023-10-06T03:25:46.025648+0000","last_active":"2023-10-06T03:25:46.025648+0000","last_peered":"2023-10-06T03:25:46.025648+0000","last_clean":"2023-10-06T03:25:46.025648+0000","last_became_active":"2023-10-06T03:25:46.025340+0000","last_became_peered":"2023-10-06T03:25:46.025340+0000","last_unstale":"2023-10-06T03:25:46.025648+0000","last_undegraded":"2023-10-06T03:25:46.025648+0000","last_fullsized":"2023-10-06T03:25:46.025648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:12.906400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.021120+0000","last_change":"2023-10-06T03:25:46.021120+0000","last_active":"2023-10-06T03:25:46.021120+0000","last_peered":"2023-10-06T03:25:46.021120+0000","last_clean":"2023-10-06T03:25:46.021120+0000","last_became_active":"2023-10-06T03:25:46.020839+0000","last_became_peered":"2023-10-06T03:25:46.020839+0000","last_unstale":"2023-10-06T03:25:46.021120+0000","last_undegraded":"2023-10-06T03:25:46.021120+0000","last_fullsized":"2023-10-06T03:25:46.021120+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:34.762514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023149+0000","last_change":"2023-10-06T03:25:46.023149+0000","last_active":"2023-10-06T03:25:46.023149+0000","last_peered":"2023-10-06T03:25:46.023149+0000","last_clean":"2023-10-06T03:25:46.023149+0000","last_became_active":"2023-10-06T03:25:46.022894+0000","last_became_peered":"2023-10-06T03:25:46.022894+0000","last_unstale":"2023-10-06T03:25:46.023149+0000","last_undegraded":"2023-10-06T03:25:46.023149+0000","last_fullsized":"2023-10-06T03:25:46.023149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:11.372886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023198+0000","last_change":"2023-10-06T03:25:46.017695+0000","last_active":"2023-10-06T03:25:46.023198+0000","last_peered":"2023-10-06T03:25:46.023198+0000","last_clean":"2023-10-06T03:25:46.023198+0000","last_became_active":"2023-10-06T03:25:46.017152+0000","last_became_peered":"2023-10-06T03:25:46.017152+0000","last_unstale":"2023-10-06T03:25:46.023198+0000","last_undegraded":"2023-10-06T03:25:46.023198+0000","last_fullsized":"2023-10-06T03:25:46.023198+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.175908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023240+0000","last_change":"2023-10-06T03:25:46.017308+0000","last_active":"2023-10-06T03:25:46.023240+0000","last_peered":"2023-10-06T03:25:46.023240+0000","last_clean":"2023-10-06T03:25:46.023240+0000","last_became_active":"2023-10-06T03:25:46.016915+0000","last_became_peered":"2023-10-06T03:25:46.016915+0000","last_unstale":"2023-10-06T03:25:46.023240+0000","last_undegraded":"2023-10-06T03:25:46.023240+0000","last_fullsized":"2023-10-06T03:25:46.023240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:11:09.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028754+0000","last_change":"2023-10-06T03:25:46.023833+0000","last_active":"2023-10-06T03:25:46.028754+0000","last_peered":"2023-10-06T03:25:46.028754+0000","last_clean":"2023-10-06T03:25:46.028754+0000","last_became_active":"2023-10-06T03:25:46.023550+0000","last_became_peered":"2023-10-06T03:25:46.023550+0000","last_unstale":"2023-10-06T03:25:46.028754+0000","last_undegraded":"2023-10-06T03:25:46.028754+0000","last_fullsized":"2023-10-06T03:25:46.028754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:24.437271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.013517+0000","last_change":"2023-10-06T03:25:46.013517+0000","last_active":"2023-10-06T03:25:46.013517+0000","last_peered":"2023-10-06T03:25:46.013517+0000","last_clean":"2023-10-06T03:25:46.013517+0000","last_became_active":"2023-10-06T03:25:46.013131+0000","last_became_peered":"2023-10-06T03:25:46.013131+0000","last_unstale":"2023-10-06T03:25:46.013517+0000","last_undegraded":"2023-10-06T03:25:46.013517+0000","last_fullsized":"2023-10-06T03:25:46.013517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:45.344254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.024472+0000","last_change":"2023-10-06T03:25:46.024472+0000","last_active":"2023-10-06T03:25:46.024472+0000","last_peered":"2023-10-06T03:25:46.024472+0000","last_clean":"2023-10-06T03:25:46.024472+0000","last_became_active":"2023-10-06T03:25:46.024178+0000","last_became_peered":"2023-10-06T03:25:46.024178+0000","last_unstale":"2023-10-06T03:25:46.024472+0000","last_undegraded":"2023-10-06T03:25:46.024472+0000","last_fullsized":"2023-10-06T03:25:46.024472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:40.194570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.015762+0000","last_change":"2023-10-06T03:25:46.010112+0000","last_active":"2023-10-06T03:25:46.015762+0000","last_peered":"2023-10-06T03:25:46.015762+0000","last_clean":"2023-10-06T03:25:46.015762+0000","last_became_active":"2023-10-06T03:25:46.009850+0000","last_became_peered":"2023-10-06T03:25:46.009850+0000","last_unstale":"2023-10-06T03:25:46.015762+0000","last_undegraded":"2023-10-06T03:25:46.015762+0000","last_fullsized":"2023-10-06T03:25:46.015762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:17.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018448+0000","last_change":"2023-10-06T03:25:46.018448+0000","last_active":"2023-10-06T03:25:46.018448+0000","last_peered":"2023-10-06T03:25:46.018448+0000","last_clean":"2023-10-06T03:25:46.018448+0000","last_became_active":"2023-10-06T03:25:46.018165+0000","last_became_peered":"2023-10-06T03:25:46.018165+0000","last_unstale":"2023-10-06T03:25:46.018448+0000","last_undegraded":"2023-10-06T03:25:46.018448+0000","last_fullsized":"2023-10-06T03:25:46.018448+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:56.023764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.032766+0000","last_change":"2023-10-06T03:25:46.029105+0000","last_active":"2023-10-06T03:25:46.032766+0000","last_peered":"2023-10-06T03:25:46.032766+0000","last_clean":"2023-10-06T03:25:46.032766+0000","last_became_active":"2023-10-06T03:25:46.028834+0000","last_became_peered":"2023-10-06T03:25:46.028834+0000","last_unstale":"2023-10-06T03:25:46.032766+0000","last_undegraded":"2023-10-06T03:25:46.032766+0000","last_fullsized":"2023-10-06T03:25:46.032766+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:48.579247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023230+0000","last_change":"2023-10-06T03:25:46.017856+0000","last_active":"2023-10-06T03:25:46.023230+0000","last_peered":"2023-10-06T03:25:46.023230+0000","last_clean":"2023-10-06T03:25:46.023230+0000","last_became_active":"2023-10-06T03:25:46.017441+0000","last_became_peered":"2023-10-06T03:25:46.017441+0000","last_unstale":"2023-10-06T03:25:46.023230+0000","last_undegraded":"2023-10-06T03:25:46.023230+0000","last_fullsized":"2023-10-06T03:25:46.023230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:30.823727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.026615+0000","last_change":"2023-10-06T03:25:46.026615+0000","last_active":"2023-10-06T03:25:46.026615+0000","last_peered":"2023-10-06T03:25:46.026615+0000","last_clean":"2023-10-06T03:25:46.026615+0000","last_became_active":"2023-10-06T03:25:46.026370+0000","last_became_peered":"2023-10-06T03:25:46.026370+0000","last_unstale":"2023-10-06T03:25:46.026615+0000","last_undegraded":"2023-10-06T03:25:46.026615+0000","last_fullsized":"2023-10-06T03:25:46.026615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.175908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.025797+0000","last_change":"2023-10-06T03:25:46.025797+0000","last_active":"2023-10-06T03:25:46.025797+0000","last_peered":"2023-10-06T03:25:46.025797+0000","last_clean":"2023-10-06T03:25:46.025797+0000","last_became_active":"2023-10-06T03:25:46.025554+0000","last_became_peered":"2023-10-06T03:25:46.025554+0000","last_unstale":"2023-10-06T03:25:46.025797+0000","last_undegraded":"2023-10-06T03:25:46.025797+0000","last_fullsized":"2023-10-06T03:25:46.025797+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:36.654765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.011825+0000","last_change":"2023-10-06T03:25:46.011825+0000","last_active":"2023-10-06T03:25:46.011825+0000","last_peered":"2023-10-06T03:25:46.011825+0000","last_clean":"2023-10-06T03:25:46.011825+0000","last_became_active":"2023-10-06T03:25:46.011559+0000","last_became_peered":"2023-10-06T03:25:46.011559+0000","last_unstale":"2023-10-06T03:25:46.011825+0000","last_undegraded":"2023-10-06T03:25:46.011825+0000","last_fullsized":"2023-10-06T03:25:46.011825+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:59.169291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.022914+0000","last_change":"2023-10-06T03:25:46.010380+0000","last_active":"2023-10-06T03:25:46.022914+0000","last_peered":"2023-10-06T03:25:46.022914+0000","last_clean":"2023-10-06T03:25:46.022914+0000","last_became_active":"2023-10-06T03:25:46.010069+0000","last_became_peered":"2023-10-06T03:25:46.010069+0000","last_unstale":"2023-10-06T03:25:46.022914+0000","last_undegraded":"2023-10-06T03:25:46.022914+0000","last_fullsized":"2023-10-06T03:25:46.022914+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:25.331324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.031024+0000","last_change":"2023-10-06T03:25:46.018883+0000","last_active":"2023-10-06T03:25:46.031024+0000","last_peered":"2023-10-06T03:25:46.031024+0000","last_clean":"2023-10-06T03:25:46.031024+0000","last_became_active":"2023-10-06T03:25:46.017535+0000","last_became_peered":"2023-10-06T03:25:46.017535+0000","last_unstale":"2023-10-06T03:25:46.031024+0000","last_undegraded":"2023-10-06T03:25:46.031024+0000","last_fullsized":"2023-10-06T03:25:46.031024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:56.023764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023290+0000","last_change":"2023-10-06T03:25:46.020302+0000","last_active":"2023-10-06T03:25:46.023290+0000","last_peered":"2023-10-06T03:25:46.023290+0000","last_clean":"2023-10-06T03:25:46.023290+0000","last_became_active":"2023-10-06T03:25:46.020008+0000","last_became_peered":"2023-10-06T03:25:46.020008+0000","last_unstale":"2023-10-06T03:25:46.023290+0000","last_undegraded":"2023-10-06T03:25:46.023290+0000","last_fullsized":"2023-10-06T03:25:46.023290+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:25.244808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.031463+0000","last_change":"2023-10-06T03:25:46.025757+0000","last_active":"2023-10-06T03:25:46.031463+0000","last_peered":"2023-10-06T03:25:46.031463+0000","last_clean":"2023-10-06T03:25:46.031463+0000","last_became_active":"2023-10-06T03:25:46.025503+0000","last_became_peered":"2023-10-06T03:25:46.025503+0000","last_unstale":"2023-10-06T03:25:46.031463+0000","last_undegraded":"2023-10-06T03:25:46.031463+0000","last_fullsized":"2023-10-06T03:25:46.031463+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:34.762514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023181+0000","last_change":"2023-10-06T03:25:46.018691+0000","last_active":"2023-10-06T03:25:46.023181+0000","last_peered":"2023-10-06T03:25:46.023181+0000","last_clean":"2023-10-06T03:25:46.023181+0000","last_became_active":"2023-10-06T03:25:46.017586+0000","last_became_peered":"2023-10-06T03:25:46.017586+0000","last_unstale":"2023-10-06T03:25:46.023181+0000","last_undegraded":"2023-10-06T03:25:46.023181+0000","last_fullsized":"2023-10-06T03:25:46.023181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:22.413185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028052+0000","last_change":"2023-10-06T03:25:46.028052+0000","last_active":"2023-10-06T03:25:46.028052+0000","last_peered":"2023-10-06T03:25:46.028052+0000","last_clean":"2023-10-06T03:25:46.028052+0000","last_became_active":"2023-10-06T03:25:46.027553+0000","last_became_peered":"2023-10-06T03:25:46.027553+0000","last_unstale":"2023-10-06T03:25:46.028052+0000","last_undegraded":"2023-10-06T03:25:46.028052+0000","last_fullsized":"2023-10-06T03:25:46.028052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:57.005974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.016419+0000","last_change":"2023-10-06T03:25:46.016419+0000","last_active":"2023-10-06T03:25:46.016419+0000","last_peered":"2023-10-06T03:25:46.016419+0000","last_clean":"2023-10-06T03:25:46.016419+0000","last_became_active":"2023-10-06T03:25:46.016206+0000","last_became_peered":"2023-10-06T03:25:46.016206+0000","last_unstale":"2023-10-06T03:25:46.016419+0000","last_undegraded":"2023-10-06T03:25:46.016419+0000","last_fullsized":"2023-10-06T03:25:46.016419+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:57.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.031057+0000","last_change":"2023-10-06T03:25:46.020489+0000","last_active":"2023-10-06T03:25:46.031057+0000","last_peered":"2023-10-06T03:25:46.031057+0000","last_clean":"2023-10-06T03:25:46.031057+0000","last_became_active":"2023-10-06T03:25:46.020250+0000","last_became_peered":"2023-10-06T03:25:46.020250+0000","last_unstale":"2023-10-06T03:25:46.031057+0000","last_undegraded":"2023-10-06T03:25:46.031057+0000","last_fullsized":"2023-10-06T03:25:46.031057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:40.194570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.029366+0000","last_change":"2023-10-06T03:25:46.029366+0000","last_active":"2023-10-06T03:25:46.029366+0000","last_peered":"2023-10-06T03:25:46.029366+0000","last_clean":"2023-10-06T03:25:46.029366+0000","last_became_active":"2023-10-06T03:25:46.029119+0000","last_became_peered":"2023-10-06T03:25:46.029119+0000","last_unstale":"2023-10-06T03:25:46.029366+0000","last_undegraded":"2023-10-06T03:25:46.029366+0000","last_fullsized":"2023-10-06T03:25:46.029366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:42.204514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.025790+0000","last_change":"2023-10-06T03:25:46.025790+0000","last_active":"2023-10-06T03:25:46.025790+0000","last_peered":"2023-10-06T03:25:46.025790+0000","last_clean":"2023-10-06T03:25:46.025790+0000","last_became_active":"2023-10-06T03:25:46.025546+0000","last_became_peered":"2023-10-06T03:25:46.025546+0000","last_unstale":"2023-10-06T03:25:46.025790+0000","last_undegraded":"2023-10-06T03:25:46.025790+0000","last_fullsized":"2023-10-06T03:25:46.025790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:58.173623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.016787+0000","last_change":"2023-10-06T03:25:46.016787+0000","last_active":"2023-10-06T03:25:46.016787+0000","last_peered":"2023-10-06T03:25:46.016787+0000","last_clean":"2023-10-06T03:25:46.016787+0000","last_became_active":"2023-10-06T03:25:46.016514+0000","last_became_peered":"2023-10-06T03:25:46.016514+0000","last_unstale":"2023-10-06T03:25:46.016787+0000","last_undegraded":"2023-10-06T03:25:46.016787+0000","last_fullsized":"2023-10-06T03:25:46.016787+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:58.043109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.024478+0000","last_change":"2023-10-06T03:25:46.024478+0000","last_active":"2023-10-06T03:25:46.024478+0000","last_peered":"2023-10-06T03:25:46.024478+0000","last_clean":"2023-10-06T03:25:46.024478+0000","last_became_active":"2023-10-06T03:25:46.024183+0000","last_became_peered":"2023-10-06T03:25:46.024183+0000","last_unstale":"2023-10-06T03:25:46.024478+0000","last_undegraded":"2023-10-06T03:25:46.024478+0000","last_fullsized":"2023-10-06T03:25:46.024478+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:36.195931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.031365+0000","last_change":"2023-10-06T03:25:46.028022+0000","last_active":"2023-10-06T03:25:46.031365+0000","last_peered":"2023-10-06T03:25:46.031365+0000","last_clean":"2023-10-06T03:25:46.031365+0000","last_became_active":"2023-10-06T03:25:46.027750+0000","last_became_peered":"2023-10-06T03:25:46.027750+0000","last_unstale":"2023-10-06T03:25:46.031365+0000","last_undegraded":"2023-10-06T03:25:46.031365+0000","last_fullsized":"2023-10-06T03:25:46.031365+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:57.366762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.021604+0000","last_change":"2023-10-06T03:25:45.004469+0000","last_active":"2023-10-06T03:25:46.021604+0000","last_peered":"2023-10-06T03:25:46.021604+0000","last_clean":"2023-10-06T03:25:46.021604+0000","last_became_active":"2023-10-06T03:25:45.004279+0000","last_became_peered":"2023-10-06T03:25:45.004279+0000","last_unstale":"2023-10-06T03:25:46.021604+0000","last_undegraded":"2023-10-06T03:25:46.021604+0000","last_fullsized":"2023-10-06T03:25:46.021604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:10.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.026329+0000","last_change":"2023-10-06T03:25:46.021543+0000","last_active":"2023-10-06T03:25:46.026329+0000","last_peered":"2023-10-06T03:25:46.026329+0000","last_clean":"2023-10-06T03:25:46.026329+0000","last_became_active":"2023-10-06T03:25:46.021308+0000","last_became_peered":"2023-10-06T03:25:46.021308+0000","last_unstale":"2023-10-06T03:25:46.026329+0000","last_undegraded":"2023-10-06T03:25:46.026329+0000","last_fullsized":"2023-10-06T03:25:46.026329+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:57.297128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.007353+0000","last_change":"2023-10-06T03:25:45.002601+0000","last_active":"2023-10-06T03:25:46.007353+0000","last_peered":"2023-10-06T03:25:46.007353+0000","last_clean":"2023-10-06T03:25:46.007353+0000","last_became_active":"2023-10-06T03:25:45.002246+0000","last_became_peered":"2023-10-06T03:25:45.002246+0000","last_unstale":"2023-10-06T03:25:46.007353+0000","last_undegraded":"2023-10-06T03:25:46.007353+0000","last_fullsized":"2023-10-06T03:25:46.007353+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:29.436003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028579+0000","last_change":"2023-10-06T03:25:46.028579+0000","last_active":"2023-10-06T03:25:46.028579+0000","last_peered":"2023-10-06T03:25:46.028579+0000","last_clean":"2023-10-06T03:25:46.028579+0000","last_became_active":"2023-10-06T03:25:46.028326+0000","last_became_peered":"2023-10-06T03:25:46.028326+0000","last_unstale":"2023-10-06T03:25:46.028579+0000","last_undegraded":"2023-10-06T03:25:46.028579+0000","last_fullsized":"2023-10-06T03:25:46.028579+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:43.640888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028793+0000","last_change":"2023-10-06T03:25:45.008376+0000","last_active":"2023-10-06T03:25:46.028793+0000","last_peered":"2023-10-06T03:25:46.028793+0000","last_clean":"2023-10-06T03:25:46.028793+0000","last_became_active":"2023-10-06T03:25:45.008068+0000","last_became_peered":"2023-10-06T03:25:45.008068+0000","last_unstale":"2023-10-06T03:25:46.028793+0000","last_undegraded":"2023-10-06T03:25:46.028793+0000","last_fullsized":"2023-10-06T03:25:46.028793+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:33.758470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023536+0000","last_change":"2023-10-06T03:25:46.015508+0000","last_active":"2023-10-06T03:25:46.023536+0000","last_peered":"2023-10-06T03:25:46.023536+0000","last_clean":"2023-10-06T03:25:46.023536+0000","last_became_active":"2023-10-06T03:25:46.015064+0000","last_became_peered":"2023-10-06T03:25:46.015064+0000","last_unstale":"2023-10-06T03:25:46.023536+0000","last_undegraded":"2023-10-06T03:25:46.023536+0000","last_fullsized":"2023-10-06T03:25:46.023536+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:57.005974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.027399+0000","last_change":"2023-10-06T03:25:45.007195+0000","last_active":"2023-10-06T03:25:46.027399+0000","last_peered":"2023-10-06T03:25:46.027399+0000","last_clean":"2023-10-06T03:25:46.027399+0000","last_became_active":"2023-10-06T03:25:45.006921+0000","last_became_peered":"2023-10-06T03:25:45.006921+0000","last_unstale":"2023-10-06T03:25:46.027399+0000","last_undegraded":"2023-10-06T03:25:46.027399+0000","last_fullsized":"2023-10-06T03:25:46.027399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:03.601860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.022509+0000","last_change":"2023-10-06T03:25:46.022509+0000","last_active":"2023-10-06T03:25:46.022509+0000","last_peered":"2023-10-06T03:25:46.022509+0000","last_clean":"2023-10-06T03:25:46.022509+0000","last_became_active":"2023-10-06T03:25:46.022263+0000","last_became_peered":"2023-10-06T03:25:46.022263+0000","last_unstale":"2023-10-06T03:25:46.022509+0000","last_undegraded":"2023-10-06T03:25:46.022509+0000","last_fullsized":"2023-10-06T03:25:46.022509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:25.121533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.005080+0000","last_change":"2023-10-06T03:25:44.998993+0000","last_active":"2023-10-06T03:25:46.005080+0000","last_peered":"2023-10-06T03:25:46.005080+0000","last_clean":"2023-10-06T03:25:46.005080+0000","last_became_active":"2023-10-06T03:25:44.998698+0000","last_became_peered":"2023-10-06T03:25:44.998698+0000","last_unstale":"2023-10-06T03:25:46.005080+0000","last_undegraded":"2023-10-06T03:25:46.005080+0000","last_fullsized":"2023-10-06T03:25:46.005080+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:36.136601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023208+0000","last_change":"2023-10-06T03:25:46.017479+0000","last_active":"2023-10-06T03:25:46.023208+0000","last_peered":"2023-10-06T03:25:46.023208+0000","last_clean":"2023-10-06T03:25:46.023208+0000","last_became_active":"2023-10-06T03:25:46.017195+0000","last_became_peered":"2023-10-06T03:25:46.017195+0000","last_unstale":"2023-10-06T03:25:46.023208+0000","last_undegraded":"2023-10-06T03:25:46.023208+0000","last_fullsized":"2023-10-06T03:25:46.023208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:52.415547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.017851+0000","last_change":"2023-10-06T03:25:45.002487+0000","last_active":"2023-10-06T03:25:46.017851+0000","last_peered":"2023-10-06T03:25:46.017851+0000","last_clean":"2023-10-06T03:25:46.017851+0000","last_became_active":"2023-10-06T03:25:45.002062+0000","last_became_peered":"2023-10-06T03:25:45.002062+0000","last_unstale":"2023-10-06T03:25:46.017851+0000","last_undegraded":"2023-10-06T03:25:46.017851+0000","last_fullsized":"2023-10-06T03:25:46.017851+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:29.819683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018537+0000","last_change":"2023-10-06T03:25:46.011762+0000","last_active":"2023-10-06T03:25:46.018537+0000","last_peered":"2023-10-06T03:25:46.018537+0000","last_clean":"2023-10-06T03:25:46.018537+0000","last_became_active":"2023-10-06T03:25:46.011524+0000","last_became_peered":"2023-10-06T03:25:46.011524+0000","last_unstale":"2023-10-06T03:25:46.018537+0000","last_undegraded":"2023-10-06T03:25:46.018537+0000","last_fullsized":"2023-10-06T03:25:46.018537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:08.264021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.007764+0000","last_change":"2023-10-06T03:25:45.004149+0000","last_active":"2023-10-06T03:25:45.007764+0000","last_peered":"2023-10-06T03:25:45.007764+0000","last_clean":"2023-10-06T03:25:45.007764+0000","last_became_active":"2023-10-06T03:25:45.003892+0000","last_became_peered":"2023-10-06T03:25:45.003892+0000","last_unstale":"2023-10-06T03:25:45.007764+0000","last_undegraded":"2023-10-06T03:25:45.007764+0000","last_fullsized":"2023-10-06T03:25:45.007764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:11.469401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.016790+0000","last_change":"2023-10-06T03:25:46.016790+0000","last_active":"2023-10-06T03:25:46.016790+0000","last_peered":"2023-10-06T03:25:46.016790+0000","last_clean":"2023-10-06T03:25:46.016790+0000","last_became_active":"2023-10-06T03:25:46.016616+0000","last_became_peered":"2023-10-06T03:25:46.016616+0000","last_unstale":"2023-10-06T03:25:46.016790+0000","last_undegraded":"2023-10-06T03:25:46.016790+0000","last_fullsized":"2023-10-06T03:25:46.016790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.749479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.000384+0000","last_change":"2023-10-06T03:25:45.000132+0000","last_active":"2023-10-06T03:25:46.000384+0000","last_peered":"2023-10-06T03:25:46.000384+0000","last_clean":"2023-10-06T03:25:46.000384+0000","last_became_active":"2023-10-06T03:25:44.999889+0000","last_became_peered":"2023-10-06T03:25:44.999889+0000","last_unstale":"2023-10-06T03:25:46.000384+0000","last_undegraded":"2023-10-06T03:25:46.000384+0000","last_fullsized":"2023-10-06T03:25:46.000384+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:58.595885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.022104+0000","last_change":"2023-10-06T03:25:46.022104+0000","last_active":"2023-10-06T03:25:46.022104+0000","last_peered":"2023-10-06T03:25:46.022104+0000","last_clean":"2023-10-06T03:25:46.022104+0000","last_became_active":"2023-10-06T03:25:46.018400+0000","last_became_peered":"2023-10-06T03:25:46.018400+0000","last_unstale":"2023-10-06T03:25:46.022104+0000","last_undegraded":"2023-10-06T03:25:46.022104+0000","last_fullsized":"2023-10-06T03:25:46.022104+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:10.487286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.006129+0000","last_change":"2023-10-06T03:25:44.996760+0000","last_active":"2023-10-06T03:25:46.006129+0000","last_peered":"2023-10-06T03:25:46.006129+0000","last_clean":"2023-10-06T03:25:46.006129+0000","last_became_active":"2023-10-06T03:25:44.996445+0000","last_became_peered":"2023-10-06T03:25:44.996445+0000","last_unstale":"2023-10-06T03:25:46.006129+0000","last_undegraded":"2023-10-06T03:25:46.006129+0000","last_fullsized":"2023-10-06T03:25:46.006129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:57.169579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.032144+0000","last_change":"2023-10-06T03:25:46.029249+0000","last_active":"2023-10-06T03:25:46.032144+0000","last_peered":"2023-10-06T03:25:46.032144+0000","last_clean":"2023-10-06T03:25:46.032144+0000","last_became_active":"2023-10-06T03:25:46.028989+0000","last_became_peered":"2023-10-06T03:25:46.028989+0000","last_unstale":"2023-10-06T03:25:46.032144+0000","last_undegraded":"2023-10-06T03:25:46.032144+0000","last_fullsized":"2023-10-06T03:25:46.032144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:30.440047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.009156+0000","last_change":"2023-10-06T03:25:45.007625+0000","last_active":"2023-10-06T03:25:45.009156+0000","last_peered":"2023-10-06T03:25:45.009156+0000","last_clean":"2023-10-06T03:25:45.009156+0000","last_became_active":"2023-10-06T03:25:45.007304+0000","last_became_peered":"2023-10-06T03:25:45.007304+0000","last_unstale":"2023-10-06T03:25:45.009156+0000","last_undegraded":"2023-10-06T03:25:45.009156+0000","last_fullsized":"2023-10-06T03:25:45.009156+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:11.469401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.024458+0000","last_change":"2023-10-06T03:25:46.024458+0000","last_active":"2023-10-06T03:25:46.024458+0000","last_peered":"2023-10-06T03:25:46.024458+0000","last_clean":"2023-10-06T03:25:46.024458+0000","last_became_active":"2023-10-06T03:25:46.024198+0000","last_became_peered":"2023-10-06T03:25:46.024198+0000","last_unstale":"2023-10-06T03:25:46.024458+0000","last_undegraded":"2023-10-06T03:25:46.024458+0000","last_fullsized":"2023-10-06T03:25:46.024458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.222212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.029191+0000","last_change":"2023-10-06T03:25:45.000833+0000","last_active":"2023-10-06T03:25:46.029191+0000","last_peered":"2023-10-06T03:25:46.029191+0000","last_clean":"2023-10-06T03:25:46.029191+0000","last_became_active":"2023-10-06T03:25:45.000484+0000","last_became_peered":"2023-10-06T03:25:45.000484+0000","last_unstale":"2023-10-06T03:25:46.029191+0000","last_undegraded":"2023-10-06T03:25:46.029191+0000","last_fullsized":"2023-10-06T03:25:46.029191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:47.575204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018595+0000","last_change":"2023-10-06T03:25:46.012760+0000","last_active":"2023-10-06T03:25:46.018595+0000","last_peered":"2023-10-06T03:25:46.018595+0000","last_clean":"2023-10-06T03:25:46.018595+0000","last_became_active":"2023-10-06T03:25:46.012378+0000","last_became_peered":"2023-10-06T03:25:46.012378+0000","last_unstale":"2023-10-06T03:25:46.018595+0000","last_undegraded":"2023-10-06T03:25:46.018595+0000","last_fullsized":"2023-10-06T03:25:46.018595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:44.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"61'6","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.021379+0000","last_change":"2023-10-06T03:25:45.005692+0000","last_active":"2023-10-06T03:25:46.021379+0000","last_peered":"2023-10-06T03:25:46.021379+0000","last_clean":"2023-10-06T03:25:46.021379+0000","last_became_active":"2023-10-06T03:25:45.005425+0000","last_became_peered":"2023-10-06T03:25:45.005425+0000","last_unstale":"2023-10-06T03:25:46.021379+0000","last_undegraded":"2023-10-06T03:25:46.021379+0000","last_fullsized":"2023-10-06T03:25:46.021379+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:24.499412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018756+0000","last_change":"2023-10-06T03:25:46.013034+0000","last_active":"2023-10-06T03:25:46.018756+0000","last_peered":"2023-10-06T03:25:46.018756+0000","last_clean":"2023-10-06T03:25:46.018756+0000","last_became_active":"2023-10-06T03:25:46.012759+0000","last_became_peered":"2023-10-06T03:25:46.012759+0000","last_unstale":"2023-10-06T03:25:46.018756+0000","last_undegraded":"2023-10-06T03:25:46.018756+0000","last_fullsized":"2023-10-06T03:25:46.018756+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:37.140645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.016352+0000","last_change":"2023-10-06T03:25:45.004241+0000","last_active":"2023-10-06T03:25:46.016352+0000","last_peered":"2023-10-06T03:25:46.016352+0000","last_clean":"2023-10-06T03:25:46.016352+0000","last_became_active":"2023-10-06T03:25:45.003985+0000","last_became_peered":"2023-10-06T03:25:45.003985+0000","last_unstale":"2023-10-06T03:25:46.016352+0000","last_undegraded":"2023-10-06T03:25:46.016352+0000","last_fullsized":"2023-10-06T03:25:46.016352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:05.355791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.009576+0000","last_change":"2023-10-06T03:25:46.009576+0000","last_active":"2023-10-06T03:25:46.009576+0000","last_peered":"2023-10-06T03:25:46.009576+0000","last_clean":"2023-10-06T03:25:46.009576+0000","last_became_active":"2023-10-06T03:25:46.009224+0000","last_became_peered":"2023-10-06T03:25:46.009224+0000","last_unstale":"2023-10-06T03:25:46.009576+0000","last_undegraded":"2023-10-06T03:25:46.009576+0000","last_fullsized":"2023-10-06T03:25:46.009576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:25.244808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.007779+0000","last_change":"2023-10-06T03:25:45.003034+0000","last_active":"2023-10-06T03:25:45.007779+0000","last_peered":"2023-10-06T03:25:45.007779+0000","last_clean":"2023-10-06T03:25:45.007779+0000","last_became_active":"2023-10-06T03:25:45.002737+0000","last_became_peered":"2023-10-06T03:25:45.002737+0000","last_unstale":"2023-10-06T03:25:45.007779+0000","last_undegraded":"2023-10-06T03:25:45.007779+0000","last_fullsized":"2023-10-06T03:25:45.007779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:16.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028182+0000","last_change":"2023-10-06T03:25:46.028182+0000","last_active":"2023-10-06T03:25:46.028182+0000","last_peered":"2023-10-06T03:25:46.028182+0000","last_clean":"2023-10-06T03:25:46.028182+0000","last_became_active":"2023-10-06T03:25:46.027949+0000","last_became_peered":"2023-10-06T03:25:46.027949+0000","last_unstale":"2023-10-06T03:25:46.028182+0000","last_undegraded":"2023-10-06T03:25:46.028182+0000","last_fullsized":"2023-10-06T03:25:46.028182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:22.413185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.003401+0000","last_change":"2023-10-06T03:25:45.001825+0000","last_active":"2023-10-06T03:25:45.003401+0000","last_peered":"2023-10-06T03:25:45.003401+0000","last_clean":"2023-10-06T03:25:45.003401+0000","last_became_active":"2023-10-06T03:25:45.001555+0000","last_became_peered":"2023-10-06T03:25:45.001555+0000","last_unstale":"2023-10-06T03:25:45.003401+0000","last_undegraded":"2023-10-06T03:25:45.003401+0000","last_fullsized":"2023-10-06T03:25:45.003401+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:33.218168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018619+0000","last_change":"2023-10-06T03:25:46.014091+0000","last_active":"2023-10-06T03:25:46.018619+0000","last_peered":"2023-10-06T03:25:46.018619+0000","last_clean":"2023-10-06T03:25:46.018619+0000","last_became_active":"2023-10-06T03:25:46.013871+0000","last_became_peered":"2023-10-06T03:25:46.013871+0000","last_unstale":"2023-10-06T03:25:46.018619+0000","last_undegraded":"2023-10-06T03:25:46.018619+0000","last_fullsized":"2023-10-06T03:25:46.018619+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:25.503456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.031764+0000","last_change":"2023-10-06T03:25:45.001991+0000","last_active":"2023-10-06T03:25:46.031764+0000","last_peered":"2023-10-06T03:25:46.031764+0000","last_clean":"2023-10-06T03:25:46.031764+0000","last_became_active":"2023-10-06T03:25:45.001035+0000","last_became_peered":"2023-10-06T03:25:45.001035+0000","last_unstale":"2023-10-06T03:25:46.031764+0000","last_undegraded":"2023-10-06T03:25:46.031764+0000","last_fullsized":"2023-10-06T03:25:46.031764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:24.117489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.017911+0000","last_change":"2023-10-06T03:25:46.017911+0000","last_active":"2023-10-06T03:25:46.017911+0000","last_peered":"2023-10-06T03:25:46.017911+0000","last_clean":"2023-10-06T03:25:46.017911+0000","last_became_active":"2023-10-06T03:25:46.017611+0000","last_became_peered":"2023-10-06T03:25:46.017611+0000","last_unstale":"2023-10-06T03:25:46.017911+0000","last_undegraded":"2023-10-06T03:25:46.017911+0000","last_fullsized":"2023-10-06T03:25:46.017911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:11:09.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.029935+0000","last_change":"2023-10-06T03:25:45.009289+0000","last_active":"2023-10-06T03:25:46.029935+0000","last_peered":"2023-10-06T03:25:46.029935+0000","last_clean":"2023-10-06T03:25:46.029935+0000","last_became_active":"2023-10-06T03:25:45.009041+0000","last_became_peered":"2023-10-06T03:25:45.009041+0000","last_unstale":"2023-10-06T03:25:46.029935+0000","last_undegraded":"2023-10-06T03:25:46.029935+0000","last_fullsized":"2023-10-06T03:25:46.029935+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:45.294610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018792+0000","last_change":"2023-10-06T03:25:46.018792+0000","last_active":"2023-10-06T03:25:46.018792+0000","last_peered":"2023-10-06T03:25:46.018792+0000","last_clean":"2023-10-06T03:25:46.018792+0000","last_became_active":"2023-10-06T03:25:46.018272+0000","last_became_peered":"2023-10-06T03:25:46.018272+0000","last_unstale":"2023-10-06T03:25:46.018792+0000","last_undegraded":"2023-10-06T03:25:46.018792+0000","last_fullsized":"2023-10-06T03:25:46.018792+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:39.404526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.002943+0000","last_change":"2023-10-06T03:25:45.001792+0000","last_active":"2023-10-06T03:25:45.002943+0000","last_peered":"2023-10-06T03:25:45.002943+0000","last_clean":"2023-10-06T03:25:45.002943+0000","last_became_active":"2023-10-06T03:25:45.001535+0000","last_became_peered":"2023-10-06T03:25:45.001535+0000","last_unstale":"2023-10-06T03:25:45.002943+0000","last_undegraded":"2023-10-06T03:25:45.002943+0000","last_fullsized":"2023-10-06T03:25:45.002943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:29.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.028935+0000","last_change":"2023-10-06T03:25:46.025518+0000","last_active":"2023-10-06T03:25:46.028935+0000","last_peered":"2023-10-06T03:25:46.028935+0000","last_clean":"2023-10-06T03:25:46.028935+0000","last_became_active":"2023-10-06T03:25:46.025240+0000","last_became_peered":"2023-10-06T03:25:46.025240+0000","last_unstale":"2023-10-06T03:25:46.028935+0000","last_undegraded":"2023-10-06T03:25:46.028935+0000","last_fullsized":"2023-10-06T03:25:46.028935+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:57.408390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.000748+0000","last_change":"2023-10-06T03:25:45.002464+0000","last_active":"2023-10-06T03:25:46.000748+0000","last_peered":"2023-10-06T03:25:46.000748+0000","last_clean":"2023-10-06T03:25:46.000748+0000","last_became_active":"2023-10-06T03:25:45.002224+0000","last_became_peered":"2023-10-06T03:25:45.002224+0000","last_unstale":"2023-10-06T03:25:46.000748+0000","last_undegraded":"2023-10-06T03:25:46.000748+0000","last_fullsized":"2023-10-06T03:25:46.000748+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:46.748907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023556+0000","last_change":"2023-10-06T03:25:46.020156+0000","last_active":"2023-10-06T03:25:46.023556+0000","last_peered":"2023-10-06T03:25:46.023556+0000","last_clean":"2023-10-06T03:25:46.023556+0000","last_became_active":"2023-10-06T03:25:46.019866+0000","last_became_peered":"2023-10-06T03:25:46.019866+0000","last_unstale":"2023-10-06T03:25:46.023556+0000","last_undegraded":"2023-10-06T03:25:46.023556+0000","last_fullsized":"2023-10-06T03:25:46.023556+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:58.043109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.010565+0000","last_change":"2023-10-06T03:25:45.003334+0000","last_active":"2023-10-06T03:25:45.010565+0000","last_peered":"2023-10-06T03:25:45.010565+0000","last_clean":"2023-10-06T03:25:45.010565+0000","last_became_active":"2023-10-06T03:25:45.002956+0000","last_became_peered":"2023-10-06T03:25:45.002956+0000","last_unstale":"2023-10-06T03:25:45.010565+0000","last_undegraded":"2023-10-06T03:25:45.010565+0000","last_fullsized":"2023-10-06T03:25:45.010565+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:56.001930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.020433+0000","last_change":"2023-10-06T03:25:46.015622+0000","last_active":"2023-10-06T03:25:46.020433+0000","last_peered":"2023-10-06T03:25:46.020433+0000","last_clean":"2023-10-06T03:25:46.020433+0000","last_became_active":"2023-10-06T03:25:46.015377+0000","last_became_peered":"2023-10-06T03:25:46.015377+0000","last_unstale":"2023-10-06T03:25:46.020433+0000","last_undegraded":"2023-10-06T03:25:46.020433+0000","last_fullsized":"2023-10-06T03:25:46.020433+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:59.266439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.000552+0000","last_change":"2023-10-06T03:25:45.003147+0000","last_active":"2023-10-06T03:25:46.000552+0000","last_peered":"2023-10-06T03:25:46.000552+0000","last_clean":"2023-10-06T03:25:46.000552+0000","last_became_active":"2023-10-06T03:25:45.002885+0000","last_became_peered":"2023-10-06T03:25:45.002885+0000","last_unstale":"2023-10-06T03:25:46.000552+0000","last_undegraded":"2023-10-06T03:25:46.000552+0000","last_fullsized":"2023-10-06T03:25:46.000552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:46.219499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.027539+0000","last_change":"2023-10-06T03:25:46.027539+0000","last_active":"2023-10-06T03:25:46.027539+0000","last_peered":"2023-10-06T03:25:46.027539+0000","last_clean":"2023-10-06T03:25:46.027539+0000","last_became_active":"2023-10-06T03:25:46.027220+0000","last_became_peered":"2023-10-06T03:25:46.027220+0000","last_unstale":"2023-10-06T03:25:46.027539+0000","last_undegraded":"2023-10-06T03:25:46.027539+0000","last_fullsized":"2023-10-06T03:25:46.027539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:30.769799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.003998+0000","last_change":"2023-10-06T03:25:45.001804+0000","last_active":"2023-10-06T03:25:45.003998+0000","last_peered":"2023-10-06T03:25:45.003998+0000","last_clean":"2023-10-06T03:25:45.003998+0000","last_became_active":"2023-10-06T03:25:45.001629+0000","last_became_peered":"2023-10-06T03:25:45.001629+0000","last_unstale":"2023-10-06T03:25:45.003998+0000","last_undegraded":"2023-10-06T03:25:45.003998+0000","last_fullsized":"2023-10-06T03:25:45.003998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:45.294610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.020229+0000","last_change":"2023-10-06T03:25:46.020229+0000","last_active":"2023-10-06T03:25:46.020229+0000","last_peered":"2023-10-06T03:25:46.020229+0000","last_clean":"2023-10-06T03:25:46.020229+0000","last_became_active":"2023-10-06T03:25:46.019990+0000","last_became_peered":"2023-10-06T03:25:46.019990+0000","last_unstale":"2023-10-06T03:25:46.020229+0000","last_undegraded":"2023-10-06T03:25:46.020229+0000","last_fullsized":"2023-10-06T03:25:46.020229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:08.264021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.004654+0000","last_change":"2023-10-06T03:25:45.002910+0000","last_active":"2023-10-06T03:25:46.004654+0000","last_peered":"2023-10-06T03:25:46.004654+0000","last_clean":"2023-10-06T03:25:46.004654+0000","last_became_active":"2023-10-06T03:25:45.000864+0000","last_became_peered":"2023-10-06T03:25:45.000864+0000","last_unstale":"2023-10-06T03:25:46.004654+0000","last_undegraded":"2023-10-06T03:25:46.004654+0000","last_fullsized":"2023-10-06T03:25:46.004654+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:00.754898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.027395+0000","last_change":"2023-10-06T03:25:46.027395+0000","last_active":"2023-10-06T03:25:46.027395+0000","last_peered":"2023-10-06T03:25:46.027395+0000","last_clean":"2023-10-06T03:25:46.027395+0000","last_became_active":"2023-10-06T03:25:46.026716+0000","last_became_peered":"2023-10-06T03:25:46.026716+0000","last_unstale":"2023-10-06T03:25:46.027395+0000","last_undegraded":"2023-10-06T03:25:46.027395+0000","last_fullsized":"2023-10-06T03:25:46.027395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:17.954565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.007713+0000","last_change":"2023-10-06T03:25:45.002549+0000","last_active":"2023-10-06T03:25:45.007713+0000","last_peered":"2023-10-06T03:25:45.007713+0000","last_clean":"2023-10-06T03:25:45.007713+0000","last_became_active":"2023-10-06T03:25:45.002270+0000","last_became_peered":"2023-10-06T03:25:45.002270+0000","last_unstale":"2023-10-06T03:25:45.007713+0000","last_undegraded":"2023-10-06T03:25:45.007713+0000","last_fullsized":"2023-10-06T03:25:45.007713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:24.499412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.023032+0000","last_change":"2023-10-06T03:25:46.013852+0000","last_active":"2023-10-06T03:25:46.023032+0000","last_peered":"2023-10-06T03:25:46.023032+0000","last_clean":"2023-10-06T03:25:46.023032+0000","last_became_active":"2023-10-06T03:25:46.013493+0000","last_became_peered":"2023-10-06T03:25:46.013493+0000","last_unstale":"2023-10-06T03:25:46.023032+0000","last_undegraded":"2023-10-06T03:25:46.023032+0000","last_fullsized":"2023-10-06T03:25:46.023032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:10.487286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.027316+0000","last_change":"2023-10-06T03:25:45.008442+0000","last_active":"2023-10-06T03:25:46.027316+0000","last_peered":"2023-10-06T03:25:46.027316+0000","last_clean":"2023-10-06T03:25:46.027316+0000","last_became_active":"2023-10-06T03:25:45.008169+0000","last_became_peered":"2023-10-06T03:25:45.008169+0000","last_unstale":"2023-10-06T03:25:46.027316+0000","last_undegraded":"2023-10-06T03:25:46.027316+0000","last_fullsized":"2023-10-06T03:25:46.027316+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:38.400482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":50,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.005950+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:25:46.005950+0000","last_peered":"2023-10-06T03:25:46.005950+0000","last_clean":"2023-10-06T03:25:46.005950+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:25:46.005950+0000","last_undegraded":"2023-10-06T03:25:46.005950+0000","last_fullsized":"2023-10-06T03:25:46.005950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.022817+0000","last_change":"2023-10-06T03:25:46.010245+0000","last_active":"2023-10-06T03:25:46.022817+0000","last_peered":"2023-10-06T03:25:46.022817+0000","last_clean":"2023-10-06T03:25:46.022817+0000","last_became_active":"2023-10-06T03:25:46.009965+0000","last_became_peered":"2023-10-06T03:25:46.009965+0000","last_unstale":"2023-10-06T03:25:46.022817+0000","last_undegraded":"2023-10-06T03:25:46.022817+0000","last_fullsized":"2023-10-06T03:25:46.022817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:54.408217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.017896+0000","last_change":"2023-10-06T03:25:45.009560+0000","last_active":"2023-10-06T03:25:46.017896+0000","last_peered":"2023-10-06T03:25:46.017896+0000","last_clean":"2023-10-06T03:25:46.017896+0000","last_became_active":"2023-10-06T03:25:45.009078+0000","last_became_peered":"2023-10-06T03:25:45.009078+0000","last_unstale":"2023-10-06T03:25:46.017896+0000","last_undegraded":"2023-10-06T03:25:46.017896+0000","last_fullsized":"2023-10-06T03:25:46.017896+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:24.144858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:44.987005+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:25:44.987005+0000","last_peered":"2023-10-06T03:25:44.987005+0000","last_clean":"2023-10-06T03:25:44.987005+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:25:44.987005+0000","last_undegraded":"2023-10-06T03:25:44.987005+0000","last_fullsized":"2023-10-06T03:25:44.987005+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.026954+0000","last_change":"2023-10-06T03:25:46.026954+0000","last_active":"2023-10-06T03:25:46.026954+0000","last_peered":"2023-10-06T03:25:46.026954+0000","last_clean":"2023-10-06T03:25:46.026954+0000","last_became_active":"2023-10-06T03:25:46.026648+0000","last_became_peered":"2023-10-06T03:25:46.026648+0000","last_unstale":"2023-10-06T03:25:46.026954+0000","last_undegraded":"2023-10-06T03:25:46.026954+0000","last_fullsized":"2023-10-06T03:25:46.026954+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:14.084505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.010443+0000","last_change":"2023-10-06T03:25:45.002010+0000","last_active":"2023-10-06T03:25:45.010443+0000","last_peered":"2023-10-06T03:25:45.010443+0000","last_clean":"2023-10-06T03:25:45.010443+0000","last_became_active":"2023-10-06T03:25:45.001690+0000","last_became_peered":"2023-10-06T03:25:45.001690+0000","last_unstale":"2023-10-06T03:25:45.010443+0000","last_undegraded":"2023-10-06T03:25:45.010443+0000","last_fullsized":"2023-10-06T03:25:45.010443+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:23.433227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:44.997677+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:25:44.997677+0000","last_peered":"2023-10-06T03:25:44.997677+0000","last_clean":"2023-10-06T03:25:44.997677+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:25:44.997677+0000","last_undegraded":"2023-10-06T03:25:44.997677+0000","last_fullsized":"2023-10-06T03:25:44.997677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":205,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.003805+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:25:46.003805+0000","last_peered":"2023-10-06T03:25:46.003805+0000","last_clean":"2023-10-06T03:25:46.003805+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:25:46.003805+0000","last_undegraded":"2023-10-06T03:25:46.003805+0000","last_fullsized":"2023-10-06T03:25:46.003805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.025163+0000","last_change":"2023-10-06T03:25:46.025163+0000","last_active":"2023-10-06T03:25:46.025163+0000","last_peered":"2023-10-06T03:25:46.025163+0000","last_clean":"2023-10-06T03:25:46.025163+0000","last_became_active":"2023-10-06T03:25:46.024998+0000","last_became_peered":"2023-10-06T03:25:46.024998+0000","last_unstale":"2023-10-06T03:25:46.025163+0000","last_undegraded":"2023-10-06T03:25:46.025163+0000","last_fullsized":"2023-10-06T03:25:46.025163+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:57.826713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.007321+0000","last_change":"2023-10-06T03:25:45.006006+0000","last_active":"2023-10-06T03:25:45.007321+0000","last_peered":"2023-10-06T03:25:45.007321+0000","last_clean":"2023-10-06T03:25:45.007321+0000","last_became_active":"2023-10-06T03:25:45.005717+0000","last_became_peered":"2023-10-06T03:25:45.005717+0000","last_unstale":"2023-10-06T03:25:45.007321+0000","last_undegraded":"2023-10-06T03:25:45.007321+0000","last_fullsized":"2023-10-06T03:25:45.007321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:10.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":55,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.003086+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:25:46.003086+0000","last_peered":"2023-10-06T03:25:46.003086+0000","last_clean":"2023-10-06T03:25:46.003086+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:25:46.003086+0000","last_undegraded":"2023-10-06T03:25:46.003086+0000","last_fullsized":"2023-10-06T03:25:46.003086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.026084+0000","last_change":"2023-10-06T03:25:46.026084+0000","last_active":"2023-10-06T03:25:46.026084+0000","last_peered":"2023-10-06T03:25:46.026084+0000","last_clean":"2023-10-06T03:25:46.026084+0000","last_became_active":"2023-10-06T03:25:46.025854+0000","last_became_peered":"2023-10-06T03:25:46.025854+0000","last_unstale":"2023-10-06T03:25:46.026084+0000","last_undegraded":"2023-10-06T03:25:46.026084+0000","last_fullsized":"2023-10-06T03:25:46.026084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:24.732007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.029664+0000","last_change":"2023-10-06T03:25:45.005104+0000","last_active":"2023-10-06T03:25:46.029664+0000","last_peered":"2023-10-06T03:25:46.029664+0000","last_clean":"2023-10-06T03:25:46.029664+0000","last_became_active":"2023-10-06T03:25:45.002854+0000","last_became_peered":"2023-10-06T03:25:45.002854+0000","last_unstale":"2023-10-06T03:25:46.029664+0000","last_undegraded":"2023-10-06T03:25:46.029664+0000","last_fullsized":"2023-10-06T03:25:46.029664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:56.293084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":55,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.003922+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:25:46.003922+0000","last_peered":"2023-10-06T03:25:46.003922+0000","last_clean":"2023-10-06T03:25:46.003922+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:25:46.003922+0000","last_undegraded":"2023-10-06T03:25:46.003922+0000","last_fullsized":"2023-10-06T03:25:46.003922+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.014061+0000","last_change":"2023-10-06T03:25:46.014061+0000","last_active":"2023-10-06T03:25:46.014061+0000","last_peered":"2023-10-06T03:25:46.014061+0000","last_clean":"2023-10-06T03:25:46.014061+0000","last_became_active":"2023-10-06T03:25:46.013542+0000","last_became_peered":"2023-10-06T03:25:46.013542+0000","last_unstale":"2023-10-06T03:25:46.014061+0000","last_undegraded":"2023-10-06T03:25:46.014061+0000","last_fullsized":"2023-10-06T03:25:46.014061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:27.132234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.007746+0000","last_change":"2023-10-06T03:25:45.002312+0000","last_active":"2023-10-06T03:25:45.007746+0000","last_peered":"2023-10-06T03:25:45.007746+0000","last_clean":"2023-10-06T03:25:45.007746+0000","last_became_active":"2023-10-06T03:25:45.001774+0000","last_became_peered":"2023-10-06T03:25:45.001774+0000","last_unstale":"2023-10-06T03:25:45.007746+0000","last_undegraded":"2023-10-06T03:25:45.007746+0000","last_fullsized":"2023-10-06T03:25:45.007746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:58.262395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:44.993209+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:25:44.993209+0000","last_peered":"2023-10-06T03:25:44.993209+0000","last_clean":"2023-10-06T03:25:44.993209+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:25:44.993209+0000","last_undegraded":"2023-10-06T03:25:44.993209+0000","last_fullsized":"2023-10-06T03:25:44.993209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.013353+0000","last_change":"2023-10-06T03:25:46.013353+0000","last_active":"2023-10-06T03:25:46.013353+0000","last_peered":"2023-10-06T03:25:46.013353+0000","last_clean":"2023-10-06T03:25:46.013353+0000","last_became_active":"2023-10-06T03:25:46.012850+0000","last_became_peered":"2023-10-06T03:25:46.012850+0000","last_unstale":"2023-10-06T03:25:46.013353+0000","last_undegraded":"2023-10-06T03:25:46.013353+0000","last_fullsized":"2023-10-06T03:25:46.013353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:31.502133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018163+0000","last_change":"2023-10-06T03:25:45.007408+0000","last_active":"2023-10-06T03:25:46.018163+0000","last_peered":"2023-10-06T03:25:46.018163+0000","last_clean":"2023-10-06T03:25:46.018163+0000","last_became_active":"2023-10-06T03:25:45.007140+0000","last_became_peered":"2023-10-06T03:25:45.007140+0000","last_unstale":"2023-10-06T03:25:46.018163+0000","last_undegraded":"2023-10-06T03:25:46.018163+0000","last_fullsized":"2023-10-06T03:25:46.018163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:43.282411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.000629+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:25:45.000629+0000","last_peered":"2023-10-06T03:25:45.000629+0000","last_clean":"2023-10-06T03:25:45.000629+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:25:45.000629+0000","last_undegraded":"2023-10-06T03:25:45.000629+0000","last_fullsized":"2023-10-06T03:25:45.000629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.018577+0000","last_change":"2023-10-06T03:25:46.012612+0000","last_active":"2023-10-06T03:25:46.018577+0000","last_peered":"2023-10-06T03:25:46.018577+0000","last_clean":"2023-10-06T03:25:46.018577+0000","last_became_active":"2023-10-06T03:25:46.012049+0000","last_became_peered":"2023-10-06T03:25:46.012049+0000","last_unstale":"2023-10-06T03:25:46.018577+0000","last_undegraded":"2023-10-06T03:25:46.018577+0000","last_fullsized":"2023-10-06T03:25:46.018577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:44.983445+0000","last_clean_scrub_stamp":"2023-10-06T03:25:44.983445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:31.502133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T03:25:46.003452+0000","last_change":"2023-10-06T03:25:45.005918+0000","last_active":"2023-10-06T03:25:46.003452+0000","last_peered":"2023-10-06T03:25:46.003452+0000","last_clean":"2023-10-06T03:25:46.003452+0000","last_became_active":"2023-10-06T03:25:45.005643+0000","last_became_peered":"2023-10-06T03:25:45.005643+0000","last_unstale":"2023-10-06T03:25:46.003452+0000","last_undegraded":"2023-10-06T03:25:46.003452+0000","last_fullsized":"2023-10-06T03:25:46.003452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:43.979402+0000","last_clean_scrub_stamp":"2023-10-06T03:25:43.979402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:33.218168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:25:45.000370+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:25:45.000370+0000","last_peered":"2023-10-06T03:25:45.000370+0000","last_clean":"2023-10-06T03:25:45.000370+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:25:45.000370+0000","last_undegraded":"2023-10-06T03:25:45.000370+0000","last_fullsized":"2023-10-06T03:25:45.000370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298596,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073244,"statfs":{"total":96636764160,"available":96331001856,"internally_reserved":0,"allocated":1339392,"data_stored":932809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.504}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.439},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":745472,"data_stored":341945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.343,"15min":1.343},"last":0.502}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.329,"15min":1.329},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.76400000000000001,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.436},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80400000000000005,"15min":0.83999999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.371}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.042,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.80600000000000005,"15min":0.84199999999999997},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.626,"15min":0.625},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298608,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073232,"statfs":{"total":96636764160,"available":96330989568,"internally_reserved":0,"allocated":1351680,"data_stored":934345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.38700000000000001,"15min":0.40300000000000002},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.38500000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.247},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.41199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.40600000000000003,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.29099999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.44800000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.44600000000000001,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.41699999999999998,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.32600000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.745,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80100000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.70899999999999996,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298004,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073836,"statfs":{"total":96636764160,"available":96331608064,"internally_reserved":0,"allocated":733184,"data_stored":340500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":12.19,"5min":12.19,"15min":12.19},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":8.3900000000000006,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.32500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.313},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.253}]},{"osd":3,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.948,"5min":16.948,"15min":16.948},"last":0.42899999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":16.881,"5min":16.881,"15min":16.881},"last":0.52700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":350350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33800000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.51500000000000001,"5min":0.62,"15min":0.62},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.48599999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.42799999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.252},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52100000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55700000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.875,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":745472,"data_stored":341965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32400000000000001,"15min":0.32600000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42699999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.254},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49199999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.312}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77100000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75700000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.436}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":753664,"data_stored":348884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2709999999999999,"5min":4.758,"15min":4.758},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.88900000000000001,"15min":0.95299999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.5},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.437}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84399999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":341943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.623}]},{"osd":6,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:25:50.435 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:25:50.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:25:50.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.586+0000 7f431d50e700 1 Processor -- start 2023-10-06T03:25:50.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.586+0000 7f431d50e700 1 -- start start 2023-10-06T03:25:50.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.586+0000 7f431d50e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f43180b0a50 0x7f43180cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.586+0000 7f431d50e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43180c5400 con 0x7f43180cc460 2023-10-06T03:25:50.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.586+0000 7f431d50e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43180ccd40 con 0x7f43180b0680 2023-10-06T03:25:50.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.586+0000 7f431d50e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43180ca7d0 con 0x7f43180b0a50 2023-10-06T03:25:50.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43067fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f43180b0a50 0x7f43180cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43177fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f43180cc460 0x7f43180c9090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49278/0 (socket says 172.21.15.84:49278) 2023-10-06T03:25:50.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43177fe700 1 -- 172.21.15.84:0/785525045 learned_addr learned my addr 172.21.15.84:0/785525045 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:50.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43067fc700 1 -- 172.21.15.84:0/785525045 >> v1:172.21.15.131:6789/0 conn(0x7f43180b0680 legacy=0x7f43180ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:50.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43067fc700 1 -- 172.21.15.84:0/785525045 >> v1:172.21.15.84:6789/0 conn(0x7f43180cc460 legacy=0x7f43180c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43167fc700 1 -- 172.21.15.84:0/785525045 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024806756 0 0) 0x7f43180c5400 con 0x7f43180cc460 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43067fc700 1 -- 172.21.15.84:0/785525045 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43180cd020 con 0x7f43180b0a50 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43067fc700 1 --2- 172.21.15.84:0/785525045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 0x7f43180cbf20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f43000098e0 tx=0x7f43000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce35a04a0c899766 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43167fc700 1 -- 172.21.15.84:0/785525045 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300009e80 con 0x7f43180b0a50 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43167fc700 1 -- 172.21.15.84:0/785525045 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000b860 con 0x7f43180b0a50 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.587+0000 7f43167fc700 1 -- 172.21.15.84:0/785525045 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000bbe0 con 0x7f43180b0a50 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.588+0000 7f431d50e700 1 -- 172.21.15.84:0/785525045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 msgr2=0x7f43180cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.588+0000 7f431d50e700 1 --2- 172.21.15.84:0/785525045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 0x7f43180cbf20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f43000098e0 tx=0x7f43000091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.588+0000 7f431d50e700 1 -- 172.21.15.84:0/785525045 shutdown_connections 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.588+0000 7f431d50e700 1 --2- 172.21.15.84:0/785525045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 0x7f43180cbf20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.588+0000 7f431d50e700 1 -- 172.21.15.84:0/785525045 >> 172.21.15.84:0/785525045 conn(0x7f4318088000 msgr2=0x7f43180ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.588+0000 7f431d50e700 1 -- 172.21.15.84:0/785525045 shutdown_connections 2023-10-06T03:25:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.588+0000 7f431d50e700 1 -- 172.21.15.84:0/785525045 wait complete. 2023-10-06T03:25:50.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.589+0000 7f431d50e700 1 Processor -- start 2023-10-06T03:25:50.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.589+0000 7f431d50e700 1 -- start start 2023-10-06T03:25:50.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f431d50e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43180b0680 0x7f431809a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f431d50e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 0x7f431809a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f431d50e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43180cc460 0x7f43180c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f431d50e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431809bfb0 con 0x7f43180b0a50 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f431d50e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431809bb20 con 0x7f43180cc460 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f431d50e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43180ab160 con 0x7f43180b0680 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43067fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 0x7f431809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43067fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 0x7f431809a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56052/0 (socket says 172.21.15.84:56052) 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43067fc700 1 -- 172.21.15.84:0/2450318507 learned_addr learned my addr 172.21.15.84:0/2450318507 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43177fe700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43180cc460 0x7f43180c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f4316ffd700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43180b0680 0x7f431809a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43067fc700 1 -- 172.21.15.84:0/2450318507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43180b0680 msgr2=0x7f431809a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43067fc700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43180b0680 0x7f431809a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43067fc700 1 -- 172.21.15.84:0/2450318507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43180cc460 msgr2=0x7f43180c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43067fc700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43180cc460 0x7f43180c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43067fc700 1 -- 172.21.15.84:0/2450318507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300009420 con 0x7f43180b0a50 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43177fe700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43180cc460 0x7f43180c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f43067fc700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 0x7f431809a8e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f430000b3c0 tx=0x7f4300017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f430f7fe700 1 -- 172.21.15.84:0/2450318507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430001f070 con 0x7f43180b0a50 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f430f7fe700 1 -- 172.21.15.84:0/2450318507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000b9d0 con 0x7f43180b0a50 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f431d50e700 1 -- 172.21.15.84:0/2450318507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431809af10 con 0x7f43180b0a50 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.590+0000 7f430f7fe700 1 -- 172.21.15.84:0/2450318507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300025650 con 0x7f43180b0a50 2023-10-06T03:25:50.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.591+0000 7f431d50e700 1 -- 172.21.15.84:0/2450318507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431809b4d0 con 0x7f43180b0a50 2023-10-06T03:25:50.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.591+0000 7f431d50e700 1 -- 172.21.15.84:0/2450318507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4318064ad0 con 0x7f43180b0a50 2023-10-06T03:25:50.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.592+0000 7f430f7fe700 1 -- 172.21.15.84:0/2450318507 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4300023070 con 0x7f43180b0a50 2023-10-06T03:25:50.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.592+0000 7f430f7fe700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f42fc066f30 0x7f42fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.592+0000 7f430f7fe700 1 -- 172.21.15.84:0/2450318507 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4300085d40 con 0x7f43180b0a50 2023-10-06T03:25:50.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.592+0000 7f4316ffd700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f42fc066f30 0x7f42fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.593+0000 7f4316ffd700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f42fc066f30 0x7f42fc0693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f430800e160 tx=0x7f4308009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:50.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.596+0000 7f430f7fe700 1 -- 172.21.15.84:0/2450318507 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4300052d10 con 0x7f43180b0a50 2023-10-06T03:25:50.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.852+0000 7f431d50e700 1 -- 172.21.15.84:0/2450318507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f43180ca3f0 con 0x7f43180b0a50 2023-10-06T03:25:50.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.856+0000 7f430f7fe700 1 -- 172.21.15.84:0/2450318507 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f430002a0e0 con 0x7f43180b0a50 2023-10-06T03:25:50.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 -- 172.21.15.84:0/2450318507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f42fc066f30 msgr2=0x7f42fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f42fc066f30 0x7f42fc0693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f430800e160 tx=0x7f4308009040 comp rx=0 tx=0).stop 2023-10-06T03:25:50.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 -- 172.21.15.84:0/2450318507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 msgr2=0x7f431809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 0x7f431809a8e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f430000b3c0 tx=0x7f4300017000 comp rx=0 tx=0).stop 2023-10-06T03:25:50.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 -- 172.21.15.84:0/2450318507 shutdown_connections 2023-10-06T03:25:50.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f42fc066f30 0x7f42fc0693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43180cc460 0x7f43180c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43180b0680 0x7f431809a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 --2- 172.21.15.84:0/2450318507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43180b0a50 0x7f431809a8e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 -- 172.21.15.84:0/2450318507 >> 172.21.15.84:0/2450318507 conn(0x7f4318088000 msgr2=0x7f431806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:50.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 -- 172.21.15.84:0/2450318507 shutdown_connections 2023-10-06T03:25:50.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.858+0000 7f431d50e700 1 -- 172.21.15.84:0/2450318507 wait complete. 2023-10-06T03:25:50.862 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T03:25:50.872 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.984+0000 7fb67355a700 1 Processor -- start 2023-10-06T03:25:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.984+0000 7fb67355a700 1 -- start start 2023-10-06T03:25:50.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb67355a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb66c0696d0 0x7fb66c069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb67355a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb66c15a430 0x7fb66c06cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb67355a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c159fa0 con 0x7fb66c06d160 2023-10-06T03:25:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb67355a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c1599c0 con 0x7fb66c15a430 2023-10-06T03:25:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb67355a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c06d650 con 0x7fb66c0696d0 2023-10-06T03:25:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb671d57700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb66c15a430 0x7fb66c06cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb672d59700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb66c06d160 0x7fb66c0b1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49348/0 (socket says 172.21.15.84:49348) 2023-10-06T03:25:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb672d59700 1 -- 172.21.15.84:0/2190703291 learned_addr learned my addr 172.21.15.84:0/2190703291 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb671d57700 1 -- 172.21.15.84:0/2190703291 >> v2:172.21.15.131:3300/0 conn(0x7fb66c0696d0 msgr2=0x7fb66c069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb672558700 1 --2- 172.21.15.84:0/2190703291 >> v2:172.21.15.131:3300/0 conn(0x7fb66c0696d0 0x7fb66c069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb671d57700 1 --2- 172.21.15.84:0/2190703291 >> v2:172.21.15.131:3300/0 conn(0x7fb66c0696d0 0x7fb66c069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb671d57700 1 -- 172.21.15.84:0/2190703291 >> v1:172.21.15.84:6789/0 conn(0x7fb66c06d160 legacy=0x7fb66c0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb671d57700 1 -- 172.21.15.84:0/2190703291 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c06d930 con 0x7fb66c15a430 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb671556700 1 -- 172.21.15.84:0/2190703291 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11472163 0 0) 0x7fb66c159fa0 con 0x7fb66c06d160 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.985+0000 7fb672558700 1 --2- 172.21.15.84:0/2190703291 >> v2:172.21.15.131:3300/0 conn(0x7fb66c0696d0 0x7fb66c069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb671d57700 1 --2- 172.21.15.84:0/2190703291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c15a430 0x7fb66c06cc20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb66c06c590 tx=0x7fb65c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e899a511dc06c2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb671556700 1 -- 172.21.15.84:0/2190703291 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c00b6b0 con 0x7fb66c15a430 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb671556700 1 -- 172.21.15.84:0/2190703291 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c00b810 con 0x7fb66c15a430 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb671556700 1 -- 172.21.15.84:0/2190703291 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c00bbb0 con 0x7fb66c15a430 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb67355a700 1 -- 172.21.15.84:0/2190703291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c15a430 msgr2=0x7fb66c06cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb67355a700 1 --2- 172.21.15.84:0/2190703291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c15a430 0x7fb66c06cc20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb66c06c590 tx=0x7fb65c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb67355a700 1 -- 172.21.15.84:0/2190703291 shutdown_connections 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb67355a700 1 --2- 172.21.15.84:0/2190703291 >> v2:172.21.15.131:3300/0 conn(0x7fb66c0696d0 0x7fb66c069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb67355a700 1 --2- 172.21.15.84:0/2190703291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c15a430 0x7fb66c06cc20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb67355a700 1 -- 172.21.15.84:0/2190703291 >> 172.21.15.84:0/2190703291 conn(0x7fb66c06b540 msgr2=0x7fb66c06b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb67355a700 1 -- 172.21.15.84:0/2190703291 shutdown_connections 2023-10-06T03:25:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.986+0000 7fb67355a700 1 -- 172.21.15.84:0/2190703291 wait complete. 2023-10-06T03:25:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.987+0000 7fb67355a700 1 Processor -- start 2023-10-06T03:25:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.987+0000 7fb67355a700 1 -- start start 2023-10-06T03:25:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb67355a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb66c0696d0 0x7fb66c16d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb67355a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c06d160 0x7fb66c16a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb67355a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c15a430 0x7fb66c15c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb67355a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c169c00 con 0x7fb66c06d160 2023-10-06T03:25:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb67355a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c16d9f0 con 0x7fb66c15a430 2023-10-06T03:25:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb67355a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c16dcd0 con 0x7fb66c0696d0 2023-10-06T03:25:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb671d57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c06d160 0x7fb66c16a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb671d57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c06d160 0x7fb66c16a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56064/0 (socket says 172.21.15.84:56064) 2023-10-06T03:25:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb671d57700 1 -- 172.21.15.84:0/3116643287 learned_addr learned my addr 172.21.15.84:0/3116643287 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb672d59700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c15a430 0x7fb66c15c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.988+0000 7fb672558700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb66c0696d0 0x7fb66c16d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb671d57700 1 -- 172.21.15.84:0/3116643287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb66c0696d0 msgr2=0x7fb66c16d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb671d57700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb66c0696d0 0x7fb66c16d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb671d57700 1 -- 172.21.15.84:0/3116643287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c15a430 msgr2=0x7fb66c15c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb671d57700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c15a430 0x7fb66c15c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb671d57700 1 -- 172.21.15.84:0/3116643287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c009420 con 0x7fb66c06d160 2023-10-06T03:25:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb672d59700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c15a430 0x7fb66c15c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb671d57700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c06d160 0x7fb66c16a3c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb66c06fd40 tx=0x7fb65c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb6627fc700 1 -- 172.21.15.84:0/3116643287 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011420 con 0x7fb66c06d160 2023-10-06T03:25:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb6627fc700 1 -- 172.21.15.84:0/3116643287 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c011580 con 0x7fb66c06d160 2023-10-06T03:25:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb6627fc700 1 -- 172.21.15.84:0/3116643287 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011920 con 0x7fb66c06d160 2023-10-06T03:25:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb67355a700 1 -- 172.21.15.84:0/3116643287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c169ea0 con 0x7fb66c06d160 2023-10-06T03:25:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.989+0000 7fb67355a700 1 -- 172.21.15.84:0/3116643287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c16d630 con 0x7fb66c06d160 2023-10-06T03:25:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.990+0000 7fb67355a700 1 -- 172.21.15.84:0/3116643287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c0affe0 con 0x7fb66c06d160 2023-10-06T03:25:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.990+0000 7fb6627fc700 1 -- 172.21.15.84:0/3116643287 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb65c011d10 con 0x7fb66c06d160 2023-10-06T03:25:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.991+0000 7fb6627fc700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb650066f30 0x7fb6500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.991+0000 7fb6627fc700 1 -- 172.21.15.84:0/3116643287 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb65c086420 con 0x7fb66c06d160 2023-10-06T03:25:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.991+0000 7fb672558700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb650066f30 0x7fb6500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.991+0000 7fb672558700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb650066f30 0x7fb6500693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb668006fd0 tx=0x7fb668008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:50.995+0000 7fb6627fc700 1 -- 172.21.15.84:0/3116643287 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb65c053470 con 0x7fb66c06d160 2023-10-06T03:25:51.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.221+0000 7fb67355a700 1 -- 172.21.15.84:0/3116643287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb66c16a090 con 0x7fb66c06d160 2023-10-06T03:25:51.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.222+0000 7fb6627fc700 1 -- 172.21.15.84:0/3116643287 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fb65c056a90 con 0x7fb66c06d160 2023-10-06T03:25:51.224 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:51.224 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1896877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1896877693},{"type":"v1","addr":"172.21.15.131:6834","nonce":1896877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/236530865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":236530865},{"type":"v1","addr":"172.21.15.131:6835","nonce":236530865}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2675057738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2675057738},{"type":"v1","addr":"172.21.15.84:6836","nonce":2675057738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:45.372432+0000","modified":"2023-10-06T03:25:49.023019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5871":{"gid":5871,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1162609428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1162609428},{"type":"v1","addr":"172.21.15.84:6837","nonce":1162609428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:25:51.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.223+0000 7fb67355a700 1 -- 172.21.15.84:0/3116643287 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb650066f30 msgr2=0x7fb6500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.223+0000 7fb67355a700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb650066f30 0x7fb6500693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb668006fd0 tx=0x7fb668008040 comp rx=0 tx=0).stop 2023-10-06T03:25:51.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.223+0000 7fb67355a700 1 -- 172.21.15.84:0/3116643287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c06d160 msgr2=0x7fb66c16a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.223+0000 7fb67355a700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c06d160 0x7fb66c16a3c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb66c06fd40 tx=0x7fb65c017000 comp rx=0 tx=0).stop 2023-10-06T03:25:51.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.224+0000 7fb67355a700 1 -- 172.21.15.84:0/3116643287 shutdown_connections 2023-10-06T03:25:51.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.224+0000 7fb67355a700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb650066f30 0x7fb6500693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.224+0000 7fb67355a700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c15a430 0x7fb66c15c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.224+0000 7fb67355a700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb66c0696d0 0x7fb66c16d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.224+0000 7fb67355a700 1 --2- 172.21.15.84:0/3116643287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb66c06d160 0x7fb66c16a3c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.224+0000 7fb67355a700 1 -- 172.21.15.84:0/3116643287 >> 172.21.15.84:0/3116643287 conn(0x7fb66c06b540 msgr2=0x7fb66c0b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:51.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.224+0000 7fb67355a700 1 -- 172.21.15.84:0/3116643287 shutdown_connections 2023-10-06T03:25:51.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.224+0000 7fb67355a700 1 -- 172.21.15.84:0/3116643287 wait complete. 2023-10-06T03:25:51.227 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 31 2023-10-06T03:25:51.640 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:25:45.372432+0000', 'modified': '2023-10-06T03:25:49.023019+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5871}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5871': {'gid': 5871, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/1162609428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 1162609428}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 1162609428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:25:51.640 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:25:51.641 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:25:51.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.756+0000 7f630c6d0700 1 Processor -- start 2023-10-06T03:25:51.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.756+0000 7f630c6d0700 1 -- start start 2023-10-06T03:25:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.757+0000 7f630c6d0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f63040cb630 0x7f63040691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.757+0000 7f630c6d0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6304068d50 con 0x7f6304069720 2023-10-06T03:25:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.757+0000 7f630c6d0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630415a6b0 con 0x7f630415a220 2023-10-06T03:25:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.757+0000 7f630c6d0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6304154060 con 0x7f63040cb630 2023-10-06T03:25:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.757+0000 7f6309c6b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6304069720 0x7f6304159b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49352/0 (socket says 172.21.15.84:49352) 2023-10-06T03:25:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.757+0000 7f6309c6b700 1 -- 172.21.15.84:0/2507482435 learned_addr learned my addr 172.21.15.84:0/2507482435 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630a46c700 1 --2- 172.21.15.84:0/2507482435 >> v2:172.21.15.131:3300/0 conn(0x7f63040cb630 0x7f63040691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303242735 0 0) 0x7f6304068d50 con 0x7f6304069720 2023-10-06T03:25:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f0003570 con 0x7f6304069720 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3909246856 0 0) 0x7f62f0003570 con 0x7f6304069720 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 >> v2:172.21.15.131:3300/0 conn(0x7f63040cb630 msgr2=0x7f63040691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 --2- 172.21.15.84:0/2507482435 >> v2:172.21.15.131:3300/0 conn(0x7f63040cb630 0x7f63040691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 >> v1:172.21.15.131:6789/0 conn(0x7f630415a220 legacy=0x7f63040ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630415a990 con 0x7f6304069720 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f62f4001470 con 0x7f6304069720 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 >> v1:172.21.15.84:6789/0 conn(0x7f6304069720 legacy=0x7f6304159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f62f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f0004810 0x7f62f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62f00051c0 0x7f62f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6304154060 con 0x7f62f0003a60 2023-10-06T03:25:51.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f000c0d0 con 0x7f62f0004810 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f000c290 con 0x7f62f00051c0 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630a46c700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f62f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f6309c6b700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f0004810 0x7f62f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630ac6d700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62f00051c0 0x7f62f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630a46c700 1 -- 172.21.15.84:0/2507482435 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62f00051c0 msgr2=0x7f62f000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630a46c700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62f00051c0 0x7f62f000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630a46c700 1 -- 172.21.15.84:0/2507482435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f0004810 msgr2=0x7f62f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630a46c700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f0004810 0x7f62f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630a46c700 1 -- 172.21.15.84:0/2507482435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0003570 con 0x7f62f0003a60 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.758+0000 7f630ac6d700 1 -- 172.21.15.84:0/2507482435 reap_dead start 2023-10-06T03:25:51.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630a46c700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f62f0003e70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6300009c00 tx=0x7f63000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355a2b8390559889 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:51.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630000e710 con 0x7f62f0003a60 2023-10-06T03:25:51.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630000e870 con 0x7f62f0003a60 2023-10-06T03:25:51.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630946a700 1 -- 172.21.15.84:0/2507482435 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630000ec30 con 0x7f62f0003a60 2023-10-06T03:25:51.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630c6d0700 1 -- 172.21.15.84:0/2507482435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 msgr2=0x7f62f0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630c6d0700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f62f0003e70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6300009c00 tx=0x7f63000091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630c6d0700 1 -- 172.21.15.84:0/2507482435 shutdown_connections 2023-10-06T03:25:51.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630c6d0700 1 --2- 172.21.15.84:0/2507482435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f62f0003e70 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630c6d0700 1 -- 172.21.15.84:0/2507482435 >> 172.21.15.84:0/2507482435 conn(0x7f6304070810 msgr2=0x7f6304070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:51.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630c6d0700 1 -- 172.21.15.84:0/2507482435 shutdown_connections 2023-10-06T03:25:51.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.759+0000 7f630c6d0700 1 -- 172.21.15.84:0/2507482435 wait complete. 2023-10-06T03:25:51.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.760+0000 7f630c6d0700 1 Processor -- start 2023-10-06T03:25:51.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630c6d0700 1 -- start start 2023-10-06T03:25:51.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630c6d0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f630416a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630c6d0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63040c4540 0x7f63040b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630c6d0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63040c49b0 0x7f630415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630c6d0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630416a1e0 con 0x7f62f0003a60 2023-10-06T03:25:51.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630c6d0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63040b1bc0 con 0x7f63040c4540 2023-10-06T03:25:51.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630c6d0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6304169b90 con 0x7f63040c49b0 2023-10-06T03:25:51.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630a46c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f630416a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630a46c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f630416a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56092/0 (socket says 172.21.15.84:56092) 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630a46c700 1 -- 172.21.15.84:0/53941600 learned_addr learned my addr 172.21.15.84:0/53941600 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f6309c6b700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63040c4540 0x7f63040b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.761+0000 7f630ac6d700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63040c49b0 0x7f630415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f630a46c700 1 -- 172.21.15.84:0/53941600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63040c49b0 msgr2=0x7f630415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f630a46c700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63040c49b0 0x7f630415bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f630a46c700 1 -- 172.21.15.84:0/53941600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63040c4540 msgr2=0x7f63040b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f630a46c700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63040c4540 0x7f63040b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f630a46c700 1 -- 172.21.15.84:0/53941600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304169e70 con 0x7f62f0003a60 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f630a46c700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f630416a670 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f62f000c0a0 tx=0x7f630001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f62fa7fc700 1 -- 172.21.15.84:0/53941600 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300022070 con 0x7f62f0003a60 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f62fa7fc700 1 -- 172.21.15.84:0/53941600 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630000e9e0 con 0x7f62f0003a60 2023-10-06T03:25:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f630c6d0700 1 -- 172.21.15.84:0/53941600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63040b1ea0 con 0x7f62f0003a60 2023-10-06T03:25:51.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f62fa7fc700 1 -- 172.21.15.84:0/53941600 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630000e710 con 0x7f62f0003a60 2023-10-06T03:25:51.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.762+0000 7f630c6d0700 1 -- 172.21.15.84:0/53941600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63040b1600 con 0x7f62f0003a60 2023-10-06T03:25:51.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.763+0000 7f62fa7fc700 1 -- 172.21.15.84:0/53941600 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f630001c660 con 0x7f62f0003a60 2023-10-06T03:25:51.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.764+0000 7f62fa7fc700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e8066f30 0x7f62e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.764+0000 7f62fa7fc700 1 -- 172.21.15.84:0/53941600 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6300085ce0 con 0x7f62f0003a60 2023-10-06T03:25:51.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.764+0000 7f6309c6b700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e8066f30 0x7f62e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.764+0000 7f6309c6b700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e8066f30 0x7f62e80693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f630415bf40 tx=0x7f630415a880 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:51.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f63159c8b80 1 Processor -- start 2023-10-06T03:25:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f63159c8b80 1 -- start start 2023-10-06T03:25:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f1840 0x56503a5f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f2cc0 0x56503a6416c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a642050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f63159c8b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56503a548a70 con 0x56503a641c00 2023-10-06T03:25:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f63159c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56503a546270 con 0x56503a5f1840 2023-10-06T03:25:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f63159c8b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56503a542060 con 0x56503a5f2cc0 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f630ac6d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a642050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f630ac6d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a642050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56102/0 (socket says 172.21.15.84:56102) 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.766+0000 7f630ac6d700 1 -- 172.21.15.84:0/3822124974 learned_addr learned my addr 172.21.15.84:0/3822124974 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.767+0000 7f630ac6d700 1 -- 172.21.15.84:0/3822124974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f2cc0 msgr2=0x56503a6416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.767+0000 7f630ac6d700 1 --2- 172.21.15.84:0/3822124974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f2cc0 0x56503a6416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.767+0000 7f630ac6d700 1 -- 172.21.15.84:0/3822124974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f1840 msgr2=0x56503a5f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.767+0000 7f630ac6d700 1 --2- 172.21.15.84:0/3822124974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f1840 0x56503a5f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.767+0000 7f630ac6d700 1 -- 172.21.15.84:0/3822124974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56503a3dc270 con 0x56503a641c00 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.767+0000 7f630ac6d700 1 --2- 172.21.15.84:0/3822124974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a642050 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f63040c8840 tx=0x7f62fc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bf4b2838c4ed4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.767+0000 7f62e77fe700 1 -- 172.21.15.84:0/3822124974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0032e0 con 0x56503a641c00 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.767+0000 7f62e77fe700 1 -- 172.21.15.84:0/3822124974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc001580 con 0x56503a641c00 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.767+0000 7f62e77fe700 1 -- 172.21.15.84:0/3822124974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc003440 con 0x56503a641c00 2023-10-06T03:25:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 -- 172.21.15.84:0/3822124974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 msgr2=0x56503a642050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 --2- 172.21.15.84:0/3822124974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a642050 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f63040c8840 tx=0x7f62fc009040 comp rx=0 tx=0).stop 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 -- 172.21.15.84:0/3822124974 shutdown_connections 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 --2- 172.21.15.84:0/3822124974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f1840 0x56503a5f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 --2- 172.21.15.84:0/3822124974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a642050 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 --2- 172.21.15.84:0/3822124974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f2cc0 0x56503a6416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 -- 172.21.15.84:0/3822124974 >> 172.21.15.84:0/3822124974 conn(0x56503a5f3160 msgr2=0x56503a5f3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 -- 172.21.15.84:0/3822124974 shutdown_connections 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 -- 172.21.15.84:0/3822124974 wait complete. 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 -- start start 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.768+0000 7f63159c8b80 1 Processor -- start 2023-10-06T03:25:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a635270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f2cc0 0x56503a617300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a641c00 0x56503a63ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f63159c8b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56503a4ed890 con 0x56503a5f1840 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f63159c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56503a508ea0 con 0x56503a641c00 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f63159c8b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56503a3c4e30 con 0x56503a5f2cc0 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f630a46c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a635270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f63159c8b80 10 client.0 _ll_register_callbacks cb 0x56503a5b4e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f630a46c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a635270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56106/0 (socket says 172.21.15.84:56106) 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f630a46c700 1 -- 172.21.15.84:0/3015304175 learned_addr learned my addr 172.21.15.84:0/3015304175 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f6309c6b700 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f2cc0 0x56503a617300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.769+0000 7f630ac6d700 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a641c00 0x56503a63ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f630a46c700 1 -- 172.21.15.84:0/3015304175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f2cc0 msgr2=0x56503a617300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f630a46c700 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f2cc0 0x56503a617300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f630a46c700 1 -- 172.21.15.84:0/3015304175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a641c00 msgr2=0x56503a63ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f630a46c700 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a641c00 0x56503a63ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f630a46c700 1 -- 172.21.15.84:0/3015304175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62fc00f040 con 0x56503a5f1840 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f630a46c700 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a635270 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6300052f20 tx=0x7f6300083ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9a2944d3b21023 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f62e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f62e4ff9700 1 -- 172.21.15.84:0/3015304175 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300056a20 con 0x56503a5f1840 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f62e4ff9700 1 -- 172.21.15.84:0/3015304175 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6300059bc0 con 0x56503a5f1840 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f63159c8b80 1 -- 172.21.15.84:0/3015304175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56503a5e6940 con 0x56503a5f1840 2023-10-06T03:25:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f62e4ff9700 1 -- 172.21.15.84:0/3015304175 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f630005d910 con 0x56503a5f1840 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f63159c8b80 10 client.6030 fetch_fsmap learned FSMap version 31 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f63159c8b80 1 -- 172.21.15.84:0/3015304175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x56503a37efe0 con 0x56503a5f1840 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f62e4ff9700 1 -- 172.21.15.84:0/3015304175 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300082080 con 0x56503a5f1840 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f62e4ff9700 1 -- 172.21.15.84:0/3015304175 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f630006c060 con 0x56503a5f1840 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f63159c8b80 10 client.6030 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f63159c8b80 10 client.6030 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f63159c8b80 20 client.6030 populate_metadata read hostname 'smithi084' 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f63159c8b80 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.84:6835/1162609428,v1:172.21.15.84:6837/1162609428] conn(0x56503a63c3e0 0x56503a63c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f63159c8b80 4 client.6030 mds_command: new command op to 5871 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f63159c8b80 1 -- 172.21.15.84:0/3015304175 --> [v2:172.21.15.84:6835/1162609428,v1:172.21.15.84:6837/1162609428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56503a5c3870 con 0x56503a63c3e0 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.770+0000 7f6309c6b700 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.84:6835/1162609428,v1:172.21.15.84:6837/1162609428] conn(0x56503a63c3e0 0x56503a63c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f62e4ff9700 10 client.6030 ms_handle_connect on v2:172.21.15.84:6835/1162609428 2023-10-06T03:25:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f6309c6b700 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.84:6835/1162609428,v1:172.21.15.84:6837/1162609428] conn(0x56503a63c3e0 0x56503a63c7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a30d151ed39c3cf server_cookie=91adc25486adcae6 in_seq=0 out_seq=0 2023-10-06T03:25:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f62e4ff9700 1 -- 172.21.15.84:0/3015304175 <== mds.0 v2:172.21.15.84:6835/1162609428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56503a5c3870 con 0x56503a63c3e0 2023-10-06T03:25:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f62e4ff9700 10 client.6030 handle_command_reply: tid=0 2023-10-06T03:25:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f63159c8b80 1 client.6030 shutdown 2023-10-06T03:25:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f63159c8b80 1 -- 172.21.15.84:0/3015304175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 msgr2=0x56503a635270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f63159c8b80 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a635270 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6300052f20 tx=0x7f6300083ec0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f63159c8b80 1 -- 172.21.15.84:0/3015304175 shutdown_connections 2023-10-06T03:25:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f63159c8b80 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.84:6835/1162609428,v1:172.21.15.84:6837/1162609428] conn(0x56503a63c3e0 0x56503a63c7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f63159c8b80 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a641c00 0x56503a63ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f63159c8b80 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a635270 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f62e4ff9700 0 client.6030 ms_handle_reset on v2:172.21.15.84:6835/1162609428 2023-10-06T03:25:51.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f63159c8b80 1 --2- 172.21.15.84:0/3015304175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f2cc0 0x56503a617300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.771+0000 7f63159c8b80 1 -- 172.21.15.84:0/3015304175 >> 172.21.15.84:0/3015304175 conn(0x56503a5f3160 msgr2=0x56503a61aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:51.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.772+0000 7f63159c8b80 1 -- 172.21.15.84:0/3015304175 shutdown_connections 2023-10-06T03:25:51.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.772+0000 7f63159c8b80 1 -- 172.21.15.84:0/3015304175 wait complete. 2023-10-06T03:25:51.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.772+0000 7f63159c8b80 20 client.6030 trim_cache size 0 max 16384 2023-10-06T03:25:51.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.788+0000 7f63159c8b80 1 Processor -- start 2023-10-06T03:25:51.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.788+0000 7f63159c8b80 1 -- start start 2023-10-06T03:25:51.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a61aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f2cc0 0x56503a637630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a641c00 0x56503a61d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f63159c8b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56503a636fb0 con 0x56503a5f1840 2023-10-06T03:25:51.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f63159c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56503a61e810 con 0x56503a5f2cc0 2023-10-06T03:25:51.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f63159c8b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56503a641590 con 0x56503a641c00 2023-10-06T03:25:51.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f630a46c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a61aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f630a46c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a61aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56110/0 (socket says 172.21.15.84:56110) 2023-10-06T03:25:51.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f630a46c700 1 -- 172.21.15.84:0/1287717075 learned_addr learned my addr 172.21.15.84:0/1287717075 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:51.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f630a46c700 1 -- 172.21.15.84:0/1287717075 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a641c00 msgr2=0x56503a61d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f630a46c700 1 --2- 172.21.15.84:0/1287717075 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a641c00 0x56503a61d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f630a46c700 1 -- 172.21.15.84:0/1287717075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f2cc0 msgr2=0x56503a637630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f630a46c700 1 --2- 172.21.15.84:0/1287717075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f2cc0 0x56503a637630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f630a46c700 1 -- 172.21.15.84:0/1287717075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56503a510780 con 0x56503a5f1840 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f630a46c700 1 --2- 172.21.15.84:0/1287717075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a61aa70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6300013fd0 tx=0x7f6300059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e437d7c58b922bd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f62e7fff700 1 -- 172.21.15.84:0/1287717075 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630005d910 con 0x56503a5f1840 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f62e7fff700 1 -- 172.21.15.84:0/1287717075 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300082020 con 0x56503a5f1840 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.789+0000 7f62e7fff700 1 -- 172.21.15.84:0/1287717075 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300059bc0 con 0x56503a5f1840 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 -- 172.21.15.84:0/1287717075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 msgr2=0x56503a61aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 --2- 172.21.15.84:0/1287717075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a61aa70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6300013fd0 tx=0x7f6300059000 comp rx=0 tx=0).stop 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 -- 172.21.15.84:0/1287717075 shutdown_connections 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 --2- 172.21.15.84:0/1287717075 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a641c00 0x56503a61d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 --2- 172.21.15.84:0/1287717075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a5f1840 0x56503a61aa70 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 --2- 172.21.15.84:0/1287717075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f2cc0 0x56503a637630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 -- 172.21.15.84:0/1287717075 >> 172.21.15.84:0/1287717075 conn(0x56503a5f3160 msgr2=0x56503a5f21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 -- 172.21.15.84:0/1287717075 shutdown_connections 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 -- 172.21.15.84:0/1287717075 wait complete. 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 -- start start 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.790+0000 7f63159c8b80 1 Processor -- start 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.791+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f1840 0x56503a617280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.791+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f2cc0 0x56503a6177c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.791+0000 7f63159c8b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a63ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.791+0000 7f63159c8b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56503a61c6f0 con 0x56503a641c00 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.791+0000 7f63159c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56503a61dbc0 con 0x56503a5f2cc0 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.791+0000 7f63159c8b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56503a636040 con 0x56503a5f1840 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.791+0000 7f63159c8b80 10 client.0 _ll_register_callbacks cb 0x56503a5b4e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.791+0000 7f630ac6d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a63ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.791+0000 7f630ac6d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a63ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56112/0 (socket says 172.21.15.84:56112) 2023-10-06T03:25:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.791+0000 7f630ac6d700 1 -- 172.21.15.84:0/133538085 learned_addr learned my addr 172.21.15.84:0/133538085 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f630a46c700 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f1840 0x56503a617280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f6309c6b700 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f2cc0 0x56503a6177c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f630ac6d700 1 -- 172.21.15.84:0/133538085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f1840 msgr2=0x56503a617280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f630ac6d700 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f1840 0x56503a617280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f630ac6d700 1 -- 172.21.15.84:0/133538085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f2cc0 msgr2=0x56503a6177c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f630ac6d700 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f2cc0 0x56503a6177c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f630ac6d700 1 -- 172.21.15.84:0/133538085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56503a37efe0 con 0x56503a641c00 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f6309c6b700 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f2cc0 0x56503a6177c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f630ac6d700 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a63ad80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f62fc004290 tx=0x7f62fc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4266853927cff82f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f62e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:25:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f62e4ff9700 1 -- 172.21.15.84:0/133538085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc025030 con 0x56503a641c00 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f62e4ff9700 1 -- 172.21.15.84:0/133538085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f62fc026070 con 0x56503a641c00 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f63159c8b80 1 -- 172.21.15.84:0/133538085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f62fc001580 con 0x56503a641c00 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f62e4ff9700 1 -- 172.21.15.84:0/133538085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62fc006db0 con 0x56503a641c00 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f63159c8b80 10 client.6036 fetch_fsmap learned FSMap version 31 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f63159c8b80 1 -- 172.21.15.84:0/133538085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x56503a4f7470 con 0x56503a641c00 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f62e4ff9700 1 -- 172.21.15.84:0/133538085 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc001580 con 0x56503a641c00 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f62e4ff9700 1 -- 172.21.15.84:0/133538085 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f62fc029360 con 0x56503a641c00 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f63159c8b80 10 client.6036 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f63159c8b80 10 client.6036 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f63159c8b80 20 client.6036 populate_metadata read hostname 'smithi084' 2023-10-06T03:25:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f63159c8b80 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.84:6835/1162609428,v1:172.21.15.84:6837/1162609428] conn(0x56503a63b450 0x56503a63b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f63159c8b80 4 client.6036 mds_command: new command op to 5871 tid=0[{"prefix": "status"}] 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.792+0000 7f63159c8b80 1 -- 172.21.15.84:0/133538085 --> [v2:172.21.15.84:6835/1162609428,v1:172.21.15.84:6837/1162609428] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56503a4e4e00 con 0x56503a63b450 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f630a46c700 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.84:6835/1162609428,v1:172.21.15.84:6837/1162609428] conn(0x56503a63b450 0x56503a63b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f62e4ff9700 10 client.6036 ms_handle_connect on v2:172.21.15.84:6835/1162609428 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f630a46c700 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.84:6835/1162609428,v1:172.21.15.84:6837/1162609428] conn(0x56503a63b450 0x56503a63b820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1de47de090d68e server_cookie=15d8397e75ecb220 in_seq=0 out_seq=0 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f62e4ff9700 1 -- 172.21.15.84:0/133538085 <== mds.0 v2:172.21.15.84:6835/1162609428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56503a4e4e00 con 0x56503a63b450 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f62e4ff9700 10 client.6036 handle_command_reply: tid=0 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 client.6036 shutdown 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 -- 172.21.15.84:0/133538085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 msgr2=0x56503a63ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a63ad80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f62fc004290 tx=0x7f62fc01c000 comp rx=0 tx=0).stop 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 -- 172.21.15.84:0/133538085 shutdown_connections 2023-10-06T03:25:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.84:6835/1162609428,v1:172.21.15.84:6837/1162609428] conn(0x56503a63b450 0x56503a63b820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56503a641c00 0x56503a63ad80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56503a5f1840 0x56503a617280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f62e4ff9700 0 client.6036 ms_handle_reset on v2:172.21.15.84:6835/1162609428 2023-10-06T03:25:51.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 --2- 172.21.15.84:0/133538085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56503a5f2cc0 0x56503a6177c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 -- 172.21.15.84:0/133538085 >> 172.21.15.84:0/133538085 conn(0x56503a5f3160 msgr2=0x56503a637630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:51.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 -- 172.21.15.84:0/133538085 shutdown_connections 2023-10-06T03:25:51.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 1 -- 172.21.15.84:0/133538085 wait complete. 2023-10-06T03:25:51.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.793+0000 7f63159c8b80 20 client.6036 trim_cache size 0 max 16384 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5871, 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 5.7965207359999997, 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 31, 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 62, 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 62, 2023-10-06T03:25:51.805 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 11.931214540999999 2023-10-06T03:25:51.806 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:25:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 -- 172.21.15.84:0/53941600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e8066f30 msgr2=0x7f62e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e8066f30 0x7f62e80693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f630415bf40 tx=0x7f630415a880 comp rx=0 tx=0).stop 2023-10-06T03:25:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 -- 172.21.15.84:0/53941600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 msgr2=0x7f630416a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f630416a670 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f62f000c0a0 tx=0x7f630001a000 comp rx=0 tx=0).stop 2023-10-06T03:25:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 -- 172.21.15.84:0/53941600 shutdown_connections 2023-10-06T03:25:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62e8066f30 0x7f62e80693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63040c49b0 0x7f630415bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62f0003a60 0x7f630416a670 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 --2- 172.21.15.84:0/53941600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63040c4540 0x7f63040b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 -- 172.21.15.84:0/53941600 >> 172.21.15.84:0/53941600 conn(0x7f6304070810 msgr2=0x7f6304159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 -- 172.21.15.84:0/53941600 shutdown_connections 2023-10-06T03:25:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.794+0000 7f630c6d0700 1 -- 172.21.15.84:0/53941600 wait complete. 2023-10-06T03:25:51.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:25:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.921+0000 7f24bb46d700 1 Processor -- start 2023-10-06T03:25:51.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.921+0000 7f24bb46d700 1 -- start start 2023-10-06T03:25:51.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24bb46d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24b40cbc70 0x7f24b40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24bb46d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f24b40b2140 0x7f24b40b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24bb46d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b40cb7e0 con 0x7f24b4159480 2023-10-06T03:25:51.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24bb46d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b40b08a0 con 0x7f24b40b2140 2023-10-06T03:25:51.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24bb46d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40cb190 con 0x7f24b40cbc70 2023-10-06T03:25:51.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24ba46b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f24b4159480 0x7f24b40b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49358/0 (socket says 172.21.15.84:49358) 2023-10-06T03:25:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24ba46b700 1 -- 172.21.15.84:0/3770622932 learned_addr learned my addr 172.21.15.84:0/3770622932 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892058573 0 0) 0x7f24b40cb7e0 con 0x7f24b4159480 2023-10-06T03:25:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24bac6c700 1 --2- 172.21.15.84:0/3770622932 >> v2:172.21.15.131:3300/0 conn(0x7f24b40b2140 0x7f24b40b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24b9c6a700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24b40cbc70 0x7f24b40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a0003570 con 0x7f24b4159480 2023-10-06T03:25:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 598558291 0 0) 0x7f24a0003570 con 0x7f24b4159480 2023-10-06T03:25:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24b40cbc70 msgr2=0x7f24b40cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24b9469700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24b40cbc70 0x7f24b40cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 >> v2:172.21.15.131:3300/0 conn(0x7f24b40b2140 msgr2=0x7f24b40b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24b9469700 1 --2- 172.21.15.84:0/3770622932 >> v2:172.21.15.131:3300/0 conn(0x7f24b40b2140 0x7f24b40b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b40cb470 con 0x7f24b4159480 2023-10-06T03:25:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.922+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f24b0001470 con 0x7f24b4159480 2023-10-06T03:25:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 >> v1:172.21.15.84:6789/0 conn(0x7f24b4159480 legacy=0x7f24b40b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9469700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a0003a60 0x7f24a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9469700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24b40cbc70 0x7f24a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9469700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a0004d50 0x7f24a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40b08a0 con 0x7f24a0004d50 2023-10-06T03:25:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40cb190 con 0x7f24a0003a60 2023-10-06T03:25:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a000bb90 con 0x7f24b40cbc70 2023-10-06T03:25:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24bac6c700 1 --2- 172.21.15.84:0/3770622932 >> v2:172.21.15.131:3300/0 conn(0x7f24b40b2140 0x7f24b40b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24bac6c700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a0004d50 0x7f24a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24ba46b700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a0003a60 0x7f24a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9c6a700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24b40cbc70 0x7f24a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24bac6c700 1 -- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24b40cbc70 msgr2=0x7f24a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24bac6c700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24b40cbc70 0x7f24a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24bac6c700 1 -- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a0003a60 msgr2=0x7f24a0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24bac6c700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a0003a60 0x7f24a0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24bac6c700 1 -- 172.21.15.84:0/3770622932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0003570 con 0x7f24a0004d50 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24bac6c700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a0004d50 0x7f24a00051c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f24ac007580 tx=0x7f24ac0097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474b7e46bd71e39b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac009ad0 con 0x7f24a0004d50 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac007dd0 con 0x7f24a0004d50 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.923+0000 7f24b9469700 1 -- 172.21.15.84:0/3770622932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac014610 con 0x7f24a0004d50 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.924+0000 7f24bb46d700 1 -- 172.21.15.84:0/3770622932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a0004d50 msgr2=0x7f24a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.924+0000 7f24bb46d700 1 --2- 172.21.15.84:0/3770622932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a0004d50 0x7f24a00051c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f24ac007580 tx=0x7f24ac0097a0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.924+0000 7f24bac6c700 1 -- 172.21.15.84:0/3770622932 reap_dead start 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.924+0000 7f24bb46d700 1 -- 172.21.15.84:0/3770622932 shutdown_connections 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.924+0000 7f24bb46d700 1 -- 172.21.15.84:0/3770622932 >> 172.21.15.84:0/3770622932 conn(0x7f24b406ed20 msgr2=0x7f24b406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.924+0000 7f24bb46d700 1 -- 172.21.15.84:0/3770622932 shutdown_connections 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.924+0000 7f24bb46d700 1 -- 172.21.15.84:0/3770622932 wait complete. 2023-10-06T03:25:51.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.925+0000 7f24bb46d700 1 Processor -- start 2023-10-06T03:25:51.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.925+0000 7f24bb46d700 1 -- start start 2023-10-06T03:25:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bb46d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a0004d50 0x7f24b416c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bb46d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b40ce840 0x7f24b40c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bb46d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b40c6190 0x7f24b40c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bb46d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4154360 con 0x7f24b40c6190 2023-10-06T03:25:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bb46d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40c6610 con 0x7f24b40ce840 2023-10-06T03:25:51.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bb46d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40cf280 con 0x7f24a0004d50 2023-10-06T03:25:51.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bac6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b40c6190 0x7f24b40c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bac6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b40c6190 0x7f24b40c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56122/0 (socket says 172.21.15.84:56122) 2023-10-06T03:25:51.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bac6c700 1 -- 172.21.15.84:0/3893613430 learned_addr learned my addr 172.21.15.84:0/3893613430 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:51.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24ba46b700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a0004d50 0x7f24b416c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24b9c6a700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b40ce840 0x7f24b40c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bac6c700 1 -- 172.21.15.84:0/3893613430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a0004d50 msgr2=0x7f24b416c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bac6c700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a0004d50 0x7f24b416c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bac6c700 1 -- 172.21.15.84:0/3893613430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b40ce840 msgr2=0x7f24b40c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:51.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bac6c700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b40ce840 0x7f24b40c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:51.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bac6c700 1 -- 172.21.15.84:0/3893613430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b40d00e0 con 0x7f24b40c6190 2023-10-06T03:25:51.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bac6c700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b40c6190 0x7f24b40c82e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f24ac014000 tx=0x7f24ac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:51.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24aa7fc700 1 -- 172.21.15.84:0/3893613430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac014610 con 0x7f24b40c6190 2023-10-06T03:25:51.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24aa7fc700 1 -- 172.21.15.84:0/3893613430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac01f420 con 0x7f24b40c6190 2023-10-06T03:25:51.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24bb46d700 1 -- 172.21.15.84:0/3893613430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b416cb60 con 0x7f24b40c6190 2023-10-06T03:25:51.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.926+0000 7f24aa7fc700 1 -- 172.21.15.84:0/3893613430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac01f7e0 con 0x7f24b40c6190 2023-10-06T03:25:51.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.927+0000 7f24bb46d700 1 -- 172.21.15.84:0/3893613430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b40cf7b0 con 0x7f24b40c6190 2023-10-06T03:25:51.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.927+0000 7f24bb46d700 1 -- 172.21.15.84:0/3893613430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b40d0270 con 0x7f24b40c6190 2023-10-06T03:25:51.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.928+0000 7f24aa7fc700 1 -- 172.21.15.84:0/3893613430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24ac01fc10 con 0x7f24b40c6190 2023-10-06T03:25:51.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.928+0000 7f24aa7fc700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2498066f30 0x7f24980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:51.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.928+0000 7f24aa7fc700 1 -- 172.21.15.84:0/3893613430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f24ac085950 con 0x7f24b40c6190 2023-10-06T03:25:51.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.928+0000 7f24ba46b700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2498066f30 0x7f24980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:51.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.928+0000 7f24ba46b700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2498066f30 0x7f24980693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f24b0000e50 tx=0x7f24b0001e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:51.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:51.932+0000 7f24aa7fc700 1 -- 172.21.15.84:0/3893613430 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24ac052920 con 0x7f24b40c6190 2023-10-06T03:25:52.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.159+0000 7f24bb46d700 1 -- 172.21.15.84:0/3893613430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f24b405f270 con 0x7f24b40c6190 2023-10-06T03:25:52.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.160+0000 7f24aa7fc700 1 -- 172.21.15.84:0/3893613430 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f24ac055f40 con 0x7f24b40c6190 2023-10-06T03:25:52.161 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:25:52.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 -- 172.21.15.84:0/3893613430 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2498066f30 msgr2=0x7f24980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:52.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2498066f30 0x7f24980693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f24b0000e50 tx=0x7f24b0001e90 comp rx=0 tx=0).stop 2023-10-06T03:25:52.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 -- 172.21.15.84:0/3893613430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b40c6190 msgr2=0x7f24b40c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:52.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b40c6190 0x7f24b40c82e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f24ac014000 tx=0x7f24ac018000 comp rx=0 tx=0).stop 2023-10-06T03:25:52.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 -- 172.21.15.84:0/3893613430 shutdown_connections 2023-10-06T03:25:52.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2498066f30 0x7f24980693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:52.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b40c6190 0x7f24b40c82e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:52.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a0004d50 0x7f24b416c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:52.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 --2- 172.21.15.84:0/3893613430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b40ce840 0x7f24b40c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:52.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 -- 172.21.15.84:0/3893613430 >> 172.21.15.84:0/3893613430 conn(0x7f24b406ed20 msgr2=0x7f24b4155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:52.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 -- 172.21.15.84:0/3893613430 shutdown_connections 2023-10-06T03:25:52.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.162+0000 7f24bb46d700 1 -- 172.21.15.84:0/3893613430 wait complete. 2023-10-06T03:25:52.175 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:25:52.175 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:25:52.176 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:25:52.176 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:25:52.176 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:52.176 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:25:52.176 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:25:52.176 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:25:52.176 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:52.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:52.177 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:25:52.191 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:52.192 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42402sec preferred_lft 42402sec 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:25:52.193 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:52.194 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9c01:bbff:fec1:72ce/64 scope link 2023-10-06T03:25:52.194 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:52.194 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:52.194 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:25:52.194 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::74a6:25ff:fe2a:c673/64 scope link 2023-10-06T03:25:52.194 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:52.194 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:52.194 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether de:34:c5:3f:21:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:25:52.194 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc34:c5ff:fe3f:21c3/64 scope link 2023-10-06T03:25:52.194 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:52.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:52.195 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:25:52.255 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:25:52.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:52.256 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:25:52.312 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:25:52.312 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:25:52.312 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:25:52.312 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:25:52.313 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:25:52.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:52.313 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:25:52.313 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:25:52.313 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:25:52.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:25:52.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:25:52.314 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:25:52.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:52.412 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:25:52.426 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:25:52.426 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:25:52.427 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:52.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:52.428 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:25:52.491 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:52.491 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:52.546 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:52.546 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:52.546 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:52.601 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:25:52.601 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:25:52.601 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:52.681 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:52.681 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:52.699 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:52.700 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:52.700 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:52.700 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:52.700 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:52.700 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:52.700 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:52.700 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:52.721 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:52.721 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:52.721 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:52.721 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:52.721 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:52.721 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:52.721 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:52.722 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:52.722 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:25:52.722 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:25:52.722 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:25:52.723 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:25:52.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:52.723 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:52.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:25:52.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.940+0000 7f393f6e8700 1 Processor -- start 2023-10-06T03:25:52.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.941+0000 7f393f6e8700 1 -- start start 2023-10-06T03:25:52.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.941+0000 7f393f6e8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39380caad0 0x7f393806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:52.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.941+0000 7f393f6e8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 0x7f39380679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:52.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.941+0000 7f393f6e8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393806ed10 con 0x7f393815caf0 2023-10-06T03:25:52.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.941+0000 7f393f6e8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3938067f20 con 0x7f39380caad0 2023-10-06T03:25:52.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.941+0000 7f393f6e8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380cb8b0 con 0x7f39380675f0 2023-10-06T03:25:52.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f393d484700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f393815caf0 0x7f39380caff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49372/0 (socket says 172.21.15.84:49372) 2023-10-06T03:25:52.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f393d484700 1 -- 172.21.15.84:0/1239609379 learned_addr learned my addr 172.21.15.84:0/1239609379 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:52.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f393cc83700 1 --2- 172.21.15.84:0/1239609379 >> v2:172.21.15.84:3300/0 conn(0x7f39380caad0 0x7f393806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:52.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f392ffff700 1 -- 172.21.15.84:0/1239609379 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971138240 0 0) 0x7f393806ed10 con 0x7f393815caf0 2023-10-06T03:25:52.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f392ffff700 1 -- 172.21.15.84:0/1239609379 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3924003570 con 0x7f393815caf0 2023-10-06T03:25:52.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f393dc85700 1 --2- 172.21.15.84:0/1239609379 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 0x7f39380679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:52.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f393cc83700 1 -- 172.21.15.84:0/1239609379 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 msgr2=0x7f39380679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:52.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f393cc83700 1 --2- 172.21.15.84:0/1239609379 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 0x7f39380679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:52.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f393cc83700 1 -- 172.21.15.84:0/1239609379 >> v1:172.21.15.84:6789/0 conn(0x7f393815caf0 legacy=0x7f39380caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f393cc83700 1 -- 172.21.15.84:0/1239609379 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380cbb90 con 0x7f39380caad0 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f393cc83700 1 --2- 172.21.15.84:0/1239609379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39380caad0 0x7f393806f1a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f39280098e0 tx=0x7f39280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6f014fb1c62425 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f392ffff700 1 -- 172.21.15.84:0/1239609379 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392800b640 con 0x7f39380caad0 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f392ffff700 1 -- 172.21.15.84:0/1239609379 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392800b7a0 con 0x7f39380caad0 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.942+0000 7f392ffff700 1 -- 172.21.15.84:0/1239609379 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392800bb40 con 0x7f39380caad0 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.943+0000 7f393f6e8700 1 -- 172.21.15.84:0/1239609379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39380caad0 msgr2=0x7f393806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.943+0000 7f393f6e8700 1 --2- 172.21.15.84:0/1239609379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39380caad0 0x7f393806f1a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f39280098e0 tx=0x7f39280091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.943+0000 7f393f6e8700 1 -- 172.21.15.84:0/1239609379 shutdown_connections 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.943+0000 7f393f6e8700 1 --2- 172.21.15.84:0/1239609379 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 0x7f39380679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.943+0000 7f393f6e8700 1 --2- 172.21.15.84:0/1239609379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39380caad0 0x7f393806f1a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.943+0000 7f393f6e8700 1 -- 172.21.15.84:0/1239609379 >> 172.21.15.84:0/1239609379 conn(0x7f39380cdef0 msgr2=0x7f39380c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:52.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.943+0000 7f393f6e8700 1 -- 172.21.15.84:0/1239609379 shutdown_connections 2023-10-06T03:25:52.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.943+0000 7f393f6e8700 1 -- 172.21.15.84:0/1239609379 wait complete. 2023-10-06T03:25:52.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.944+0000 7f393f6e8700 1 Processor -- start 2023-10-06T03:25:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.944+0000 7f393f6e8700 1 -- start start 2023-10-06T03:25:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393f6e8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 0x7f393814a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393f6e8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39380caad0 0x7f39380ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393f6e8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f393815caf0 0x7f393815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393f6e8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3938158860 con 0x7f393815caf0 2023-10-06T03:25:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393f6e8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380ade30 con 0x7f39380caad0 2023-10-06T03:25:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393f6e8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380ae110 con 0x7f39380675f0 2023-10-06T03:25:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393dc85700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f393815caf0 0x7f393815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393dc85700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f393815caf0 0x7f393815a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56150/0 (socket says 172.21.15.84:56150) 2023-10-06T03:25:52.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393dc85700 1 -- 172.21.15.84:0/3038328929 learned_addr learned my addr 172.21.15.84:0/3038328929 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:52.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393cc83700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39380caad0 0x7f39380ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:52.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393d484700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 0x7f393814a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:52.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393dc85700 1 -- 172.21.15.84:0/3038328929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 msgr2=0x7f393814a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:52.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393dc85700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 0x7f393814a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:52.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393dc85700 1 -- 172.21.15.84:0/3038328929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39380caad0 msgr2=0x7f39380ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:52.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393dc85700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39380caad0 0x7f39380ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:52.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393dc85700 1 -- 172.21.15.84:0/3038328929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928009420 con 0x7f393815caf0 2023-10-06T03:25:52.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393cc83700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39380caad0 0x7f39380ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:52.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393d484700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 0x7f393814a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:52.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393dc85700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f393815caf0 0x7f393815a7a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f393000cdb0 tx=0x7f39300077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:52.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f392d7fa700 1 -- 172.21.15.84:0/3038328929 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000aa80 con 0x7f393815caf0 2023-10-06T03:25:52.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f392d7fa700 1 -- 172.21.15.84:0/3038328929 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393000abe0 con 0x7f393815caf0 2023-10-06T03:25:52.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.945+0000 7f393f6e8700 1 -- 172.21.15.84:0/3038328929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3938158b00 con 0x7f393815caf0 2023-10-06T03:25:52.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.946+0000 7f392d7fa700 1 -- 172.21.15.84:0/3038328929 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930017430 con 0x7f393815caf0 2023-10-06T03:25:52.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.946+0000 7f393f6e8700 1 -- 172.21.15.84:0/3038328929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39380ada20 con 0x7f393815caf0 2023-10-06T03:25:52.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.946+0000 7f393f6e8700 1 -- 172.21.15.84:0/3038328929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3938158d40 con 0x7f393815caf0 2023-10-06T03:25:52.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.947+0000 7f392d7fa700 1 -- 172.21.15.84:0/3038328929 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3930003020 con 0x7f393815caf0 2023-10-06T03:25:52.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.947+0000 7f392d7fa700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f391c066f30 0x7f391c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:52.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.947+0000 7f392d7fa700 1 -- 172.21.15.84:0/3038328929 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3930013070 con 0x7f393815caf0 2023-10-06T03:25:52.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.947+0000 7f393d484700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f391c066f30 0x7f391c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:52.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.948+0000 7f393d484700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f391c066f30 0x7f391c0693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3934007fd0 tx=0x7f3934009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:52.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:52.952+0000 7f392d7fa700 1 -- 172.21.15.84:0/3038328929 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3938158d40 con 0x7f393815caf0 2023-10-06T03:25:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.180+0000 7f393f6e8700 1 -- 172.21.15.84:0/3038328929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3938158d40 con 0x7f393815caf0 2023-10-06T03:25:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.180+0000 7f392d7fa700 1 -- 172.21.15.84:0/3038328929 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3938158d40 con 0x7f393815caf0 2023-10-06T03:25:53.182 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:25:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 -- 172.21.15.84:0/3038328929 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f391c066f30 msgr2=0x7f391c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f391c066f30 0x7f391c0693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3934007fd0 tx=0x7f3934009040 comp rx=0 tx=0).stop 2023-10-06T03:25:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 -- 172.21.15.84:0/3038328929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f393815caf0 msgr2=0x7f393815a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f393815caf0 0x7f393815a7a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f393000cdb0 tx=0x7f39300077d0 comp rx=0 tx=0).stop 2023-10-06T03:25:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 -- 172.21.15.84:0/3038328929 shutdown_connections 2023-10-06T03:25:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f391c066f30 0x7f391c0693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f393815caf0 0x7f393815a7a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39380675f0 0x7f393814a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 --2- 172.21.15.84:0/3038328929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39380caad0 0x7f39380ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 -- 172.21.15.84:0/3038328929 >> 172.21.15.84:0/3038328929 conn(0x7f39380cdef0 msgr2=0x7f39380c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 -- 172.21.15.84:0/3038328929 shutdown_connections 2023-10-06T03:25:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:53.182+0000 7f393f6e8700 1 -- 172.21.15.84:0/3038328929 wait complete. 2023-10-06T03:25:53.196 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:25:53.196 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:25:53.196 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T03:25:53.196 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:25:53.196 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:53.196 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:25:53.196 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:25:53.196 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:25:53.196 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:25:53.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:53.197 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T03:25:53.218 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:25:53.218 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:25:53.218 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:25:53.219 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:53.219 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:25:53.219 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:53.219 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:53.219 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:53.220 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T03:25:53.220 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:53.220 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:53.220 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T03:25:53.220 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:25:53.220 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:53.221 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:25:53.221 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:53.221 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:25:53.221 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42400sec preferred_lft 42400sec 2023-10-06T03:25:53.221 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T03:25:53.221 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:53.221 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:25:53.221 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::a0d2:65ff:fe0e:962d/64 scope link 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether e6:c9:c5:59:18:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::e4c9:c5ff:fe59:18bb/64 scope link 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:25:53.222 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4f1:c0ff:fe85:853d/64 scope link 2023-10-06T03:25:53.223 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:25:53.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:53.223 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:25:53.285 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T03:25:53.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:53.287 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T03:25:53.347 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T03:25:53.347 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:25:53.347 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:25:53.347 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:25:53.347 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:25:53.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:53.348 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:25:53.348 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:25:53.348 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:25:53.348 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:25:53.348 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:25:53.348 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:25:53.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:53.454 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:25:53.469 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:25:53.469 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:25:53.469 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:25:53.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:53.470 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-10-06T03:25:53.535 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:53.535 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:53.590 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:25:53.590 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:53.590 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:53.644 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T03:25:53.644 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:25:53.645 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:53.724 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:53.724 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:53.743 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:53.743 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:53.743 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:53.743 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:53.743 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:53.743 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:53.743 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:53.744 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:25:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:25:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:25:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:25:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:25:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:25:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:25:53.766 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:25:53.766 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:25:53.767 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:25:53.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:53.767 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:53.831 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:25:53.831 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:53.873 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:53.912 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:25:53.912 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:25:53.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:25:53.912 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:53.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:25:53.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:53.953 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:25:54.009 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:25:54.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:25:54.009 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:25:54.054 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:25:54.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:54.055 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:25:54.069 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:54.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.182+0000 7fc070f2c700 1 Processor -- start 2023-10-06T03:25:54.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.182+0000 7fc070f2c700 1 -- start start 2023-10-06T03:25:54.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc070f2c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc06c1595a0 0x7fc06c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc070f2c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc06c0b49e0 0x7fc06c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc070f2c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc06c0b07a0 0x7fc06c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc070f2c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06c0b0ca0 con 0x7fc06c0b07a0 2023-10-06T03:25:54.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc070f2c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06c0b0f80 con 0x7fc06c0b49e0 2023-10-06T03:25:54.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc070f2c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0b1260 con 0x7fc06c1595a0 2023-10-06T03:25:54.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc06ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc06c0b07a0 0x7fc06c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc06ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc06c0b07a0 0x7fc06c0b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56166/0 (socket says 172.21.15.84:56166) 2023-10-06T03:25:54.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc06ad9d700 1 -- 172.21.15.84:0/4122048709 learned_addr learned my addr 172.21.15.84:0/4122048709 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:54.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc061d9b700 1 --2- 172.21.15.84:0/4122048709 >> v2:172.21.15.131:3300/0 conn(0x7fc06c0b49e0 0x7fc06c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc06a59c700 1 --2- 172.21.15.84:0/4122048709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc06c1595a0 0x7fc06c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc06ad9d700 1 -- 172.21.15.84:0/4122048709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc06c1595a0 msgr2=0x7fc06c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc06ad9d700 1 --2- 172.21.15.84:0/4122048709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc06c1595a0 0x7fc06c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc06ad9d700 1 -- 172.21.15.84:0/4122048709 >> v2:172.21.15.131:3300/0 conn(0x7fc06c0b49e0 msgr2=0x7fc06c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc06ad9d700 1 --2- 172.21.15.84:0/4122048709 >> v2:172.21.15.131:3300/0 conn(0x7fc06c0b49e0 0x7fc06c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.183+0000 7fc06ad9d700 1 -- 172.21.15.84:0/4122048709 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c0b1540 con 0x7fc06c0b07a0 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc06ad9d700 1 --2- 172.21.15.84:0/4122048709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c0b07a0 0x7fc06c0b38d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc06c089060 tx=0x7fc064009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08825c592b1ad72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc069d9b700 1 -- 172.21.15.84:0/4122048709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06400e070 con 0x7fc06c0b07a0 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc069d9b700 1 -- 172.21.15.84:0/4122048709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06400ba50 con 0x7fc06c0b07a0 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc069d9b700 1 -- 172.21.15.84:0/4122048709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640092e0 con 0x7fc06c0b07a0 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc070f2c700 1 -- 172.21.15.84:0/4122048709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c0b07a0 msgr2=0x7fc06c0b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc070f2c700 1 --2- 172.21.15.84:0/4122048709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c0b07a0 0x7fc06c0b38d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc06c089060 tx=0x7fc064009840 comp rx=0 tx=0).stop 2023-10-06T03:25:54.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc070f2c700 1 -- 172.21.15.84:0/4122048709 shutdown_connections 2023-10-06T03:25:54.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc070f2c700 1 --2- 172.21.15.84:0/4122048709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c0b07a0 0x7fc06c0b38d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc070f2c700 1 --2- 172.21.15.84:0/4122048709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc06c1595a0 0x7fc06c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc070f2c700 1 --2- 172.21.15.84:0/4122048709 >> v2:172.21.15.131:3300/0 conn(0x7fc06c0b49e0 0x7fc06c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc070f2c700 1 -- 172.21.15.84:0/4122048709 >> 172.21.15.84:0/4122048709 conn(0x7fc06c099830 msgr2=0x7fc06c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:54.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc070f2c700 1 -- 172.21.15.84:0/4122048709 shutdown_connections 2023-10-06T03:25:54.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.184+0000 7fc070f2c700 1 -- 172.21.15.84:0/4122048709 wait complete. 2023-10-06T03:25:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.186+0000 7fc070f2c700 1 Processor -- start 2023-10-06T03:25:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.186+0000 7fc070f2c700 1 -- start start 2023-10-06T03:25:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.186+0000 7fc070f2c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc06c0b07a0 0x7fc06c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.186+0000 7fc070f2c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc06c0b49e0 0x7fc06c0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.186+0000 7fc070f2c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c1595a0 0x7fc06c0c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.186+0000 7fc070f2c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0c7260 con 0x7fc06c1595a0 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.186+0000 7fc070f2c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c1580c0 con 0x7fc06c0b07a0 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.186+0000 7fc070f2c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0c5b70 con 0x7fc06c0b49e0 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.186+0000 7fc06ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c1595a0 0x7fc06c0c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.186+0000 7fc06ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c1595a0 0x7fc06c0c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56170/0 (socket says 172.21.15.84:56170) 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc06ad9d700 1 -- 172.21.15.84:0/3389434657 learned_addr learned my addr 172.21.15.84:0/3389434657 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc06a59c700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc06c0b07a0 0x7fc06c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc061d9b700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc06c0b49e0 0x7fc06c0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc06ad9d700 1 -- 172.21.15.84:0/3389434657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc06c0b49e0 msgr2=0x7fc06c0c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc06ad9d700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc06c0b49e0 0x7fc06c0c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc06ad9d700 1 -- 172.21.15.84:0/3389434657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc06c0b07a0 msgr2=0x7fc06c157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc06ad9d700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc06c0b07a0 0x7fc06c157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc06ad9d700 1 -- 172.21.15.84:0/3389434657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064009ae0 con 0x7fc06c1595a0 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc06ad9d700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c1595a0 0x7fc06c0c76f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc06c067c60 tx=0x7fc064018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc062ffd700 1 -- 172.21.15.84:0/3389434657 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640032f0 con 0x7fc06c1595a0 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc062ffd700 1 -- 172.21.15.84:0/3389434657 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064008d20 con 0x7fc06c1595a0 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc070f2c700 1 -- 172.21.15.84:0/3389434657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c0c5e50 con 0x7fc06c1595a0 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc062ffd700 1 -- 172.21.15.84:0/3389434657 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640266b0 con 0x7fc06c1595a0 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.187+0000 7fc070f2c700 1 -- 172.21.15.84:0/3389434657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c0c6ef0 con 0x7fc06c1595a0 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.188+0000 7fc070f2c700 1 -- 172.21.15.84:0/3389434657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c0c7410 con 0x7fc06c1595a0 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.188+0000 7fc062ffd700 1 -- 172.21.15.84:0/3389434657 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc064003040 con 0x7fc06c1595a0 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.189+0000 7fc062ffd700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc04c066f30 0x7fc04c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.189+0000 7fc062ffd700 1 -- 172.21.15.84:0/3389434657 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc0640867e0 con 0x7fc06c1595a0 2023-10-06T03:25:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.189+0000 7fc06a59c700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc04c066f30 0x7fc04c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.189+0000 7fc06a59c700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc04c066f30 0x7fc04c0693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0061f0 tx=0x7fc05c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:54.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.193+0000 7fc062ffd700 1 -- 172.21.15.84:0/3389434657 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc06c0c7410 con 0x7fc06c1595a0 2023-10-06T03:25:54.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.418+0000 7fc070f2c700 1 -- 172.21.15.84:0/3389434657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc06c064ad0 con 0x7fc06c1595a0 2023-10-06T03:25:54.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.419+0000 7fc062ffd700 1 -- 172.21.15.84:0/3389434657 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fc064053860 con 0x7fc06c1595a0 2023-10-06T03:25:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:54.421 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1896877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1896877693},{"type":"v1","addr":"172.21.15.131:6834","nonce":1896877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/236530865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":236530865},{"type":"v1","addr":"172.21.15.131:6835","nonce":236530865}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2675057738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2675057738},{"type":"v1","addr":"172.21.15.84:6836","nonce":2675057738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:45.372432+0000","modified":"2023-10-06T03:25:49.023019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5871":{"gid":5871,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1162609428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1162609428},{"type":"v1","addr":"172.21.15.84:6837","nonce":1162609428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:25:54.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 -- 172.21.15.84:0/3389434657 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc04c066f30 msgr2=0x7fc04c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc04c066f30 0x7fc04c0693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0061f0 tx=0x7fc05c008040 comp rx=0 tx=0).stop 2023-10-06T03:25:54.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 -- 172.21.15.84:0/3389434657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c1595a0 msgr2=0x7fc06c0c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c1595a0 0x7fc06c0c76f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc06c067c60 tx=0x7fc064018000 comp rx=0 tx=0).stop 2023-10-06T03:25:54.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 -- 172.21.15.84:0/3389434657 shutdown_connections 2023-10-06T03:25:54.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc04c066f30 0x7fc04c0693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc06c0b07a0 0x7fc06c157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc06c1595a0 0x7fc06c0c76f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 --2- 172.21.15.84:0/3389434657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc06c0b49e0 0x7fc06c0c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 -- 172.21.15.84:0/3389434657 >> 172.21.15.84:0/3389434657 conn(0x7fc06c099830 msgr2=0x7fc06c069610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:54.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 -- 172.21.15.84:0/3389434657 shutdown_connections 2023-10-06T03:25:54.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.421+0000 7fc070f2c700 1 -- 172.21.15.84:0/3389434657 wait complete. 2023-10-06T03:25:54.424 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 31 2023-10-06T03:25:54.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:54.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.548+0000 7fb58942c700 1 Processor -- start 2023-10-06T03:25:54.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.548+0000 7fb58942c700 1 -- start start 2023-10-06T03:25:54.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb58942c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb5840b2620 0x7fb5840b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb58942c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5840b29f0 0x7fb584159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb58942c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb5841596a0 0x7fb584068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb58942c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5840cbfe0 con 0x7fb5841596a0 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb58942c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5840cb3d0 con 0x7fb5840b2620 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb58942c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840cb6b0 con 0x7fb5840b29f0 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb5837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb5841596a0 0x7fb584068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb5837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb5841596a0 0x7fb584068580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56172/0 (socket says 172.21.15.84:56172) 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb5837fe700 1 -- 172.21.15.84:0/2147312645 learned_addr learned my addr 172.21.15.84:0/2147312645 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb5827fc700 1 --2- 172.21.15.84:0/2147312645 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5840b29f0 0x7fb584159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.549+0000 7fb582ffd700 1 --2- 172.21.15.84:0/2147312645 >> v2:172.21.15.131:3300/0 conn(0x7fb5840b2620 0x7fb5840b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb5837fe700 1 -- 172.21.15.84:0/2147312645 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5840b29f0 msgr2=0x7fb584159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb5837fe700 1 --2- 172.21.15.84:0/2147312645 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5840b29f0 0x7fb584159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb5837fe700 1 -- 172.21.15.84:0/2147312645 >> v2:172.21.15.131:3300/0 conn(0x7fb5840b2620 msgr2=0x7fb5840b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb5837fe700 1 --2- 172.21.15.84:0/2147312645 >> v2:172.21.15.131:3300/0 conn(0x7fb5840b2620 0x7fb5840b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb5837fe700 1 -- 172.21.15.84:0/2147312645 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5840cb990 con 0x7fb5841596a0 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb5837fe700 1 --2- 172.21.15.84:0/2147312645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 0x7fb584068580 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb5840d0460 tx=0x7fb57c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2980414aa0b13ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb581ffb700 1 -- 172.21.15.84:0/2147312645 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00b640 con 0x7fb5841596a0 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb581ffb700 1 -- 172.21.15.84:0/2147312645 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c00b7a0 con 0x7fb5841596a0 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb581ffb700 1 -- 172.21.15.84:0/2147312645 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00bb60 con 0x7fb5841596a0 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb58942c700 1 -- 172.21.15.84:0/2147312645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 msgr2=0x7fb584068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb58942c700 1 --2- 172.21.15.84:0/2147312645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 0x7fb584068580 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb5840d0460 tx=0x7fb57c009250 comp rx=0 tx=0).stop 2023-10-06T03:25:54.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb58942c700 1 -- 172.21.15.84:0/2147312645 shutdown_connections 2023-10-06T03:25:54.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb58942c700 1 --2- 172.21.15.84:0/2147312645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 0x7fb584068580 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb58942c700 1 --2- 172.21.15.84:0/2147312645 >> v2:172.21.15.131:3300/0 conn(0x7fb5840b2620 0x7fb5840b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb58942c700 1 --2- 172.21.15.84:0/2147312645 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5840b29f0 0x7fb584159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.550+0000 7fb58942c700 1 -- 172.21.15.84:0/2147312645 >> 172.21.15.84:0/2147312645 conn(0x7fb58406ed20 msgr2=0x7fb58406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:54.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.551+0000 7fb58942c700 1 -- 172.21.15.84:0/2147312645 shutdown_connections 2023-10-06T03:25:54.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.551+0000 7fb58942c700 1 -- 172.21.15.84:0/2147312645 wait complete. 2023-10-06T03:25:54.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.552+0000 7fb58942c700 1 Processor -- start 2023-10-06T03:25:54.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.552+0000 7fb58942c700 1 -- start start 2023-10-06T03:25:54.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb58942c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5840b2620 0x7fb58415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb58942c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5840b29f0 0x7fb5840c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb58942c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 0x7fb5840cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb58942c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c9020 con 0x7fb5841596a0 2023-10-06T03:25:54.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb58942c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c7f40 con 0x7fb5840b2620 2023-10-06T03:25:54.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb58942c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c8220 con 0x7fb5840b29f0 2023-10-06T03:25:54.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb5837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 0x7fb5840cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb5837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 0x7fb5840cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56176/0 (socket says 172.21.15.84:56176) 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb5837fe700 1 -- 172.21.15.84:0/1432447746 learned_addr learned my addr 172.21.15.84:0/1432447746 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb582ffd700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5840b2620 0x7fb58415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb5827fc700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5840b29f0 0x7fb5840c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb5837fe700 1 -- 172.21.15.84:0/1432447746 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5840b29f0 msgr2=0x7fb5840c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb5837fe700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5840b29f0 0x7fb5840c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb5837fe700 1 -- 172.21.15.84:0/1432447746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5840b2620 msgr2=0x7fb58415e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb5837fe700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5840b2620 0x7fb58415e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb5837fe700 1 -- 172.21.15.84:0/1432447746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0094f0 con 0x7fb5841596a0 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb5837fe700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 0x7fb5840cf1b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0094c0 tx=0x7fb57c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb56affd700 1 -- 172.21.15.84:0/1432447746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00bb20 con 0x7fb5841596a0 2023-10-06T03:25:54.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb56affd700 1 -- 172.21.15.84:0/1432447746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c011420 con 0x7fb5841596a0 2023-10-06T03:25:54.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb58942c700 1 -- 172.21.15.84:0/1432447746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5840c8500 con 0x7fb5841596a0 2023-10-06T03:25:54.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.553+0000 7fb56affd700 1 -- 172.21.15.84:0/1432447746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0117e0 con 0x7fb5841596a0 2023-10-06T03:25:54.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.554+0000 7fb58942c700 1 -- 172.21.15.84:0/1432447746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb584153ab0 con 0x7fb5841596a0 2023-10-06T03:25:54.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.554+0000 7fb58942c700 1 -- 172.21.15.84:0/1432447746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb584064ad0 con 0x7fb5841596a0 2023-10-06T03:25:54.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.555+0000 7fb56affd700 1 -- 172.21.15.84:0/1432447746 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb57c011b50 con 0x7fb5841596a0 2023-10-06T03:25:54.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.555+0000 7fb56affd700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb570066f30 0x7fb5700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.555+0000 7fb56affd700 1 -- 172.21.15.84:0/1432447746 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb57c085fb0 con 0x7fb5841596a0 2023-10-06T03:25:54.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.555+0000 7fb582ffd700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb570066f30 0x7fb5700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.556+0000 7fb582ffd700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb570066f30 0x7fb5700693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb57400f5b0 tx=0x7fb57400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:54.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.559+0000 7fb56affd700 1 -- 172.21.15.84:0/1432447746 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb57c0b75a0 con 0x7fb5841596a0 2023-10-06T03:25:54.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.743+0000 7fb58942c700 1 -- 172.21.15.84:0/1432447746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5840cbc70 con 0x7fb5841596a0 2023-10-06T03:25:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.744+0000 7fb56affd700 1 -- 172.21.15.84:0/1432447746 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fb57c053000 con 0x7fb5841596a0 2023-10-06T03:25:54.746 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:54.746 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":62,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:46.997828+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:43.021239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:44.339383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 -- 172.21.15.84:0/1432447746 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb570066f30 msgr2=0x7fb5700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb570066f30 0x7fb5700693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb57400f5b0 tx=0x7fb57400b040 comp rx=0 tx=0).stop 2023-10-06T03:25:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 -- 172.21.15.84:0/1432447746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 msgr2=0x7fb5840cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 0x7fb5840cf1b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0094c0 tx=0x7fb57c017000 comp rx=0 tx=0).stop 2023-10-06T03:25:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 -- 172.21.15.84:0/1432447746 shutdown_connections 2023-10-06T03:25:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb570066f30 0x7fb5700693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5840b2620 0x7fb58415e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5841596a0 0x7fb5840cf1b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 --2- 172.21.15.84:0/1432447746 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5840b29f0 0x7fb5840c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 -- 172.21.15.84:0/1432447746 >> 172.21.15.84:0/1432447746 conn(0x7fb58406ed20 msgr2=0x7fb584157780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 -- 172.21.15.84:0/1432447746 shutdown_connections 2023-10-06T03:25:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.746+0000 7fb58942c700 1 -- 172.21.15.84:0/1432447746 wait complete. 2023-10-06T03:25:54.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:25:43.021239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:25:44.339383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:25:54.761 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:25:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.876+0000 7f2190f50700 1 Processor -- start 2023-10-06T03:25:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.876+0000 7f2190f50700 1 -- start start 2023-10-06T03:25:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.877+0000 7f2190f50700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f218c157530 0x7f218c06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.877+0000 7f2190f50700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f218c06ea00 0x7f218c0ab160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.877+0000 7f2190f50700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218c0c7d10 con 0x7f218c150820 2023-10-06T03:25:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.877+0000 7f2190f50700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c06bbc0 con 0x7f218c06ea00 2023-10-06T03:25:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.877+0000 7f2190f50700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c06ee40 con 0x7f218c157530 2023-10-06T03:25:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.877+0000 7f218ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f218c06ea00 0x7f218c0ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.877+0000 7f218a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f218c150820 0x7f218c06b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49380/0 (socket says 172.21.15.84:49380) 2023-10-06T03:25:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.877+0000 7f218a59c700 1 -- 172.21.15.84:0/759066936 learned_addr learned my addr 172.21.15.84:0/759066936 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.877+0000 7f2181d9b700 1 --2- 172.21.15.84:0/759066936 >> v2:172.21.15.131:3300/0 conn(0x7f218c157530 0x7f218c06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f218ad9d700 1 -- 172.21.15.84:0/759066936 >> v2:172.21.15.131:3300/0 conn(0x7f218c157530 msgr2=0x7f218c06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f218ad9d700 1 --2- 172.21.15.84:0/759066936 >> v2:172.21.15.131:3300/0 conn(0x7f218c157530 0x7f218c06e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f218ad9d700 1 -- 172.21.15.84:0/759066936 >> v1:172.21.15.84:6789/0 conn(0x7f218c150820 legacy=0x7f218c06b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f218ad9d700 1 -- 172.21.15.84:0/759066936 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c0c91b0 con 0x7f218c06ea00 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2189d9b700 1 -- 172.21.15.84:0/759066936 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015275683 0 0) 0x7f218c0c7d10 con 0x7f218c150820 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2181d9b700 1 --2- 172.21.15.84:0/759066936 >> v2:172.21.15.131:3300/0 conn(0x7f218c157530 0x7f218c06e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f218ad9d700 1 --2- 172.21.15.84:0/759066936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c06ea00 0x7f218c0ab160 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f218c0696e0 tx=0x7f2184009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397d15f3a064f2cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2189d9b700 1 -- 172.21.15.84:0/759066936 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218400e070 con 0x7f218c06ea00 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2189d9b700 1 -- 172.21.15.84:0/759066936 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218400bb60 con 0x7f218c06ea00 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2189d9b700 1 -- 172.21.15.84:0/759066936 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184012430 con 0x7f218c06ea00 2023-10-06T03:25:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2190f50700 1 -- 172.21.15.84:0/759066936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c06ea00 msgr2=0x7f218c0ab160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2190f50700 1 --2- 172.21.15.84:0/759066936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c06ea00 0x7f218c0ab160 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f218c0696e0 tx=0x7f2184009780 comp rx=0 tx=0).stop 2023-10-06T03:25:54.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2190f50700 1 -- 172.21.15.84:0/759066936 shutdown_connections 2023-10-06T03:25:54.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2190f50700 1 --2- 172.21.15.84:0/759066936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c06ea00 0x7f218c0ab160 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2190f50700 1 --2- 172.21.15.84:0/759066936 >> v2:172.21.15.131:3300/0 conn(0x7f218c157530 0x7f218c06e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2190f50700 1 -- 172.21.15.84:0/759066936 >> 172.21.15.84:0/759066936 conn(0x7f218c0691d0 msgr2=0x7f218c0cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:54.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2190f50700 1 -- 172.21.15.84:0/759066936 shutdown_connections 2023-10-06T03:25:54.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.878+0000 7f2190f50700 1 -- 172.21.15.84:0/759066936 wait complete. 2023-10-06T03:25:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.880+0000 7f2190f50700 1 Processor -- start 2023-10-06T03:25:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.880+0000 7f2190f50700 1 -- start start 2023-10-06T03:25:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.880+0000 7f2190f50700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c06ea00 0x7f218c154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.880+0000 7f2190f50700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f218c150820 0x7f218c142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.880+0000 7f2190f50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c157530 0x7f218c142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.880+0000 7f2190f50700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c0c4e60 con 0x7f218c157530 2023-10-06T03:25:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.880+0000 7f2190f50700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c16d7d0 con 0x7f218c06ea00 2023-10-06T03:25:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.880+0000 7f2190f50700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c0c70e0 con 0x7f218c150820 2023-10-06T03:25:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f218ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c157530 0x7f218c142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f218ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c157530 0x7f218c142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56186/0 (socket says 172.21.15.84:56186) 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f218ad9d700 1 -- 172.21.15.84:0/1662730454 learned_addr learned my addr 172.21.15.84:0/1662730454 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f218a59c700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c06ea00 0x7f218c154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f2181d9b700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f218c150820 0x7f218c142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f218ad9d700 1 -- 172.21.15.84:0/1662730454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f218c150820 msgr2=0x7f218c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f218ad9d700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f218c150820 0x7f218c142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f218ad9d700 1 -- 172.21.15.84:0/1662730454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c06ea00 msgr2=0x7f218c154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f218ad9d700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c06ea00 0x7f218c154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f218ad9d700 1 -- 172.21.15.84:0/1662730454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174009420 con 0x7f218c157530 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f218ad9d700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c157530 0x7f218c142ac0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f218400b6c0 tx=0x7f2184019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f2182ffd700 1 -- 172.21.15.84:0/1662730454 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184027470 con 0x7f218c157530 2023-10-06T03:25:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f2182ffd700 1 -- 172.21.15.84:0/1662730454 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21840275d0 con 0x7f218c157530 2023-10-06T03:25:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f2190f50700 1 -- 172.21.15.84:0/1662730454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2184009a20 con 0x7f218c157530 2023-10-06T03:25:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f2182ffd700 1 -- 172.21.15.84:0/1662730454 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184027990 con 0x7f218c157530 2023-10-06T03:25:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.881+0000 7f2190f50700 1 -- 172.21.15.84:0/1662730454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218c16d180 con 0x7f218c157530 2023-10-06T03:25:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.882+0000 7f2190f50700 1 -- 172.21.15.84:0/1662730454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c064ad0 con 0x7f218c157530 2023-10-06T03:25:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.883+0000 7f2182ffd700 1 -- 172.21.15.84:0/1662730454 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2184024070 con 0x7f218c157530 2023-10-06T03:25:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.883+0000 7f2182ffd700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f216c066f30 0x7f216c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.883+0000 7f2182ffd700 1 -- 172.21.15.84:0/1662730454 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2184087210 con 0x7f218c157530 2023-10-06T03:25:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.883+0000 7f218a59c700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f216c066f30 0x7f216c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.883+0000 7f218a59c700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f216c066f30 0x7f216c0693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f217c007fd0 tx=0x7f217c007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:54.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:54.887+0000 7f2182ffd700 1 -- 172.21.15.84:0/1662730454 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21840541e0 con 0x7f218c157530 2023-10-06T03:25:55.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.070+0000 7f2190f50700 1 -- 172.21.15.84:0/1662730454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f218c06bda0 con 0x7f218c157530 2023-10-06T03:25:55.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.070+0000 7f2182ffd700 1 -- 172.21.15.84:0/1662730454 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2184057800 con 0x7f218c157530 2023-10-06T03:25:55.072 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:25:55.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 -- 172.21.15.84:0/1662730454 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f216c066f30 msgr2=0x7f216c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f216c066f30 0x7f216c0693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f217c007fd0 tx=0x7f217c007d30 comp rx=0 tx=0).stop 2023-10-06T03:25:55.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 -- 172.21.15.84:0/1662730454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c157530 msgr2=0x7f218c142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c157530 0x7f218c142ac0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f218400b6c0 tx=0x7f2184019000 comp rx=0 tx=0).stop 2023-10-06T03:25:55.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 -- 172.21.15.84:0/1662730454 shutdown_connections 2023-10-06T03:25:55.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f216c066f30 0x7f216c0693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c06ea00 0x7f218c154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f218c157530 0x7f218c142ac0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 --2- 172.21.15.84:0/1662730454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f218c150820 0x7f218c142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 -- 172.21.15.84:0/1662730454 >> 172.21.15.84:0/1662730454 conn(0x7f218c0691d0 msgr2=0x7f218c155af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:55.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 -- 172.21.15.84:0/1662730454 shutdown_connections 2023-10-06T03:25:55.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.072+0000 7f2190f50700 1 -- 172.21.15.84:0/1662730454 wait complete. 2023-10-06T03:25:55.086 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:25:55.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.201+0000 7ff1a8918700 1 Processor -- start 2023-10-06T03:25:55.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.201+0000 7ff1a8918700 1 -- start start 2023-10-06T03:25:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.202+0000 7ff1a8918700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff1a4067c10 0x7ff1a40cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.202+0000 7ff1a8918700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a415d8a0 con 0x7ff1a415dd30 2023-10-06T03:25:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.202+0000 7ff1a8918700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a415a830 con 0x7ff1a415a230 2023-10-06T03:25:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.202+0000 7ff1a8918700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a415ab10 con 0x7ff1a4067c10 2023-10-06T03:25:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.202+0000 7ff199d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff1a415dd30 0x7ff1a4159b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49394/0 (socket says 172.21.15.84:49394) 2023-10-06T03:25:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.202+0000 7ff199d9b700 1 -- 172.21.15.84:0/2956804828 learned_addr learned my addr 172.21.15.84:0/2956804828 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.202+0000 7ff1a259c700 1 --2- 172.21.15.84:0/2956804828 >> v2:172.21.15.131:3300/0 conn(0x7ff1a4067c10 0x7ff1a40cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.202+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734915142 0 0) 0x7ff1a415d8a0 con 0x7ff1a415dd30 2023-10-06T03:25:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff190003570 con 0x7ff1a415dd30 2023-10-06T03:25:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552604144 0 0) 0x7ff1a415a830 con 0x7ff1a415a230 2023-10-06T03:25:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a415d8a0 con 0x7ff1a415a230 2023-10-06T03:25:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3900775028 0 0) 0x7ff190003570 con 0x7ff1a415dd30 2023-10-06T03:25:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 >> v2:172.21.15.131:3300/0 conn(0x7ff1a4067c10 msgr2=0x7ff1a40cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 --2- 172.21.15.84:0/2956804828 >> v2:172.21.15.131:3300/0 conn(0x7ff1a4067c10 0x7ff1a40cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 >> v1:172.21.15.131:6789/0 conn(0x7ff1a415a230 legacy=0x7ff1a406a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a415d250 con 0x7ff1a415dd30 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7ff18c001470 con 0x7ff1a415dd30 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 >> v1:172.21.15.84:6789/0 conn(0x7ff1a415dd30 legacy=0x7ff1a4159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 0x7ff190003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff190004810 0x7ff190004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1900051c0 0x7ff19000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a415ab10 con 0x7ff1900051c0 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19000c160 con 0x7ff190003bf0 2023-10-06T03:25:55.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19000c320 con 0x7ff190004810 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a259c700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 0x7ff190003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a2d9d700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1900051c0 0x7ff19000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff199d9b700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff190004810 0x7ff190004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a259c700 1 -- 172.21.15.84:0/2956804828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff190004810 msgr2=0x7ff190004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a259c700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff190004810 0x7ff190004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a259c700 1 -- 172.21.15.84:0/2956804828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1900051c0 msgr2=0x7ff19000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a259c700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1900051c0 0x7ff19000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a259c700 1 -- 172.21.15.84:0/2956804828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190003570 con 0x7ff190003bf0 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a2d9d700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1900051c0 0x7ff19000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a2d9d700 1 -- 172.21.15.84:0/2956804828 reap_dead start 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.203+0000 7ff1a259c700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 0x7ff190003fe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff194006f00 tx=0x7ff1940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e20e8175447404d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.204+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19400e710 con 0x7ff190003bf0 2023-10-06T03:25:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.204+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19400e870 con 0x7ff190003bf0 2023-10-06T03:25:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.204+0000 7ff1a1d9b700 1 -- 172.21.15.84:0/2956804828 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19400ec30 con 0x7ff190003bf0 2023-10-06T03:25:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.204+0000 7ff1a8918700 1 -- 172.21.15.84:0/2956804828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 msgr2=0x7ff190003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.204+0000 7ff1a8918700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 0x7ff190003fe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff194006f00 tx=0x7ff1940091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.204+0000 7ff1a8918700 1 -- 172.21.15.84:0/2956804828 shutdown_connections 2023-10-06T03:25:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.204+0000 7ff1a8918700 1 --2- 172.21.15.84:0/2956804828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 0x7ff190003fe0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.204+0000 7ff1a8918700 1 -- 172.21.15.84:0/2956804828 >> 172.21.15.84:0/2956804828 conn(0x7ff1a40cd1e0 msgr2=0x7ff1a40cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.204+0000 7ff1a8918700 1 -- 172.21.15.84:0/2956804828 shutdown_connections 2023-10-06T03:25:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.204+0000 7ff1a8918700 1 -- 172.21.15.84:0/2956804828 wait complete. 2023-10-06T03:25:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.205+0000 7ff1a8918700 1 Processor -- start 2023-10-06T03:25:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.205+0000 7ff1a8918700 1 -- start start 2023-10-06T03:25:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a8918700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 0x7ff1a40c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a8918700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1a40c9190 0x7ff1a40b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a8918700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1a414e140 0x7ff1a415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a8918700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40b12c0 con 0x7ff1a414e140 2023-10-06T03:25:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a8918700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40c80f0 con 0x7ff190003bf0 2023-10-06T03:25:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a8918700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40c83d0 con 0x7ff1a40c9190 2023-10-06T03:25:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1a414e140 0x7ff1a415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1a414e140 0x7ff1a415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56196/0 (socket says 172.21.15.84:56196) 2023-10-06T03:25:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a2d9d700 1 -- 172.21.15.84:0/2470240341 learned_addr learned my addr 172.21.15.84:0/2470240341 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff199d9b700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1a40c9190 0x7ff1a40b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a259c700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 0x7ff1a40c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.206+0000 7ff1a2d9d700 1 -- 172.21.15.84:0/2470240341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1a40c9190 msgr2=0x7ff1a40b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff1a2d9d700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1a40c9190 0x7ff1a40b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff1a2d9d700 1 -- 172.21.15.84:0/2470240341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 msgr2=0x7ff1a40c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff1a2d9d700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 0x7ff1a40c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff1a2d9d700 1 -- 172.21.15.84:0/2470240341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40c86b0 con 0x7ff1a414e140 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff1a259c700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 0x7ff1a40c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff1a2d9d700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1a414e140 0x7ff1a415acd0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff1a415d810 tx=0x7ff19c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff19affd700 1 -- 172.21.15.84:0/2470240341 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00cc10 con 0x7ff1a414e140 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff19affd700 1 -- 172.21.15.84:0/2470240341 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c00cd90 con 0x7ff1a414e140 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff19affd700 1 -- 172.21.15.84:0/2470240341 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c006df0 con 0x7ff1a414e140 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff1a8918700 1 -- 172.21.15.84:0/2470240341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a40c8990 con 0x7ff1a414e140 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.207+0000 7ff1a8918700 1 -- 172.21.15.84:0/2470240341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a414e5c0 con 0x7ff1a414e140 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.208+0000 7ff1a8918700 1 -- 172.21.15.84:0/2470240341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a40c8eb0 con 0x7ff1a414e140 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.208+0000 7ff19affd700 1 -- 172.21.15.84:0/2470240341 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff19c014690 con 0x7ff1a414e140 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.208+0000 7ff19affd700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff184066f30 0x7ff1840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.209+0000 7ff19affd700 1 -- 172.21.15.84:0/2470240341 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff19c084580 con 0x7ff1a414e140 2023-10-06T03:25:55.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.209+0000 7ff1a259c700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff184066f30 0x7ff1840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.209+0000 7ff1a259c700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff184066f30 0x7ff1840693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff1940091e0 tx=0x7ff19401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:55.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.213+0000 7ff19affd700 1 -- 172.21.15.84:0/2470240341 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1a40c8eb0 con 0x7ff1a414e140 2023-10-06T03:25:55.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.396+0000 7ff1a8918700 1 -- 172.21.15.84:0/2470240341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1a40c8eb0 con 0x7ff1a414e140 2023-10-06T03:25:55.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.396+0000 7ff19affd700 1 -- 172.21.15.84:0/2470240341 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1a40c8eb0 con 0x7ff1a414e140 2023-10-06T03:25:55.398 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:25:55.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 -- 172.21.15.84:0/2470240341 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff184066f30 msgr2=0x7ff1840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff184066f30 0x7ff1840693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff1940091e0 tx=0x7ff19401a000 comp rx=0 tx=0).stop 2023-10-06T03:25:55.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 -- 172.21.15.84:0/2470240341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1a414e140 msgr2=0x7ff1a415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1a414e140 0x7ff1a415acd0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff1a415d810 tx=0x7ff19c0017a0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 -- 172.21.15.84:0/2470240341 shutdown_connections 2023-10-06T03:25:55.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff184066f30 0x7ff1840693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff190003bf0 0x7ff1a40c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1a414e140 0x7ff1a415acd0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 --2- 172.21.15.84:0/2470240341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1a40c9190 0x7ff1a40b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 -- 172.21.15.84:0/2470240341 >> 172.21.15.84:0/2470240341 conn(0x7ff1a40cd1e0 msgr2=0x7ff1a415c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:55.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 -- 172.21.15.84:0/2470240341 shutdown_connections 2023-10-06T03:25:55.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.398+0000 7ff1a8918700 1 -- 172.21.15.84:0/2470240341 wait complete. 2023-10-06T03:25:55.411 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:25:55.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.526+0000 7f5639b49700 1 Processor -- start 2023-10-06T03:25:55.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.526+0000 7f5639b49700 1 -- start start 2023-10-06T03:25:55.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.527+0000 7f5639b49700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56341598e0 0x7f56340ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.527+0000 7f5639b49700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340cf610 con 0x7f56340cbcb0 2023-10-06T03:25:55.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.527+0000 7f5639b49700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340cf8f0 con 0x7f5634159510 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.527+0000 7f5639b49700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56340cfbd0 con 0x7f56341598e0 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.527+0000 7f5632ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56341598e0 0x7f56340ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.527+0000 7f5633fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f56340cbcb0 0x7f56340ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49400/0 (socket says 172.21.15.84:49400) 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.527+0000 7f5633fff700 1 -- 172.21.15.84:0/1395738756 learned_addr learned my addr 172.21.15.84:0/1395738756 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.527+0000 7f5632ffd700 1 -- 172.21.15.84:0/1395738756 >> v1:172.21.15.131:6789/0 conn(0x7f5634159510 legacy=0x7f56340cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.527+0000 7f5632ffd700 1 -- 172.21.15.84:0/1395738756 >> v1:172.21.15.84:6789/0 conn(0x7f56340cbcb0 legacy=0x7f56340ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f5632ffd700 1 -- 172.21.15.84:0/1395738756 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56340cfeb0 con 0x7f56341598e0 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.527+0000 7f56327fc700 1 -- 172.21.15.84:0/1395738756 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935249981 0 0) 0x7f56340cf610 con 0x7f56340cbcb0 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f5632ffd700 1 --2- 172.21.15.84:0/1395738756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56341598e0 0x7f56340ce820 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f56280098e0 tx=0x7f56280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4356f15d74a5e933 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f56327fc700 1 -- 172.21.15.84:0/1395738756 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628009e80 con 0x7f56341598e0 2023-10-06T03:25:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f56327fc700 1 -- 172.21.15.84:0/1395738756 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562800b860 con 0x7f56341598e0 2023-10-06T03:25:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f56327fc700 1 -- 172.21.15.84:0/1395738756 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562800bbe0 con 0x7f56341598e0 2023-10-06T03:25:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f5639b49700 1 -- 172.21.15.84:0/1395738756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56341598e0 msgr2=0x7f56340ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f5639b49700 1 --2- 172.21.15.84:0/1395738756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56341598e0 0x7f56340ce820 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f56280098e0 tx=0x7f56280091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f5639b49700 1 -- 172.21.15.84:0/1395738756 shutdown_connections 2023-10-06T03:25:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f5639b49700 1 --2- 172.21.15.84:0/1395738756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56341598e0 0x7f56340ce820 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f5639b49700 1 -- 172.21.15.84:0/1395738756 >> 172.21.15.84:0/1395738756 conn(0x7f5634089e90 msgr2=0x7f56340997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f5639b49700 1 -- 172.21.15.84:0/1395738756 shutdown_connections 2023-10-06T03:25:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.528+0000 7f5639b49700 1 -- 172.21.15.84:0/1395738756 wait complete. 2023-10-06T03:25:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f5639b49700 1 Processor -- start 2023-10-06T03:25:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f5639b49700 1 -- start start 2023-10-06T03:25:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f5639b49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340cbcb0 0x7f563415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f5639b49700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5634159510 0x7f56340b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f5639b49700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56341598e0 0x7f5634169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f5639b49700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563416af60 con 0x7f56340cbcb0 2023-10-06T03:25:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f5639b49700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563415b1c0 con 0x7f5634159510 2023-10-06T03:25:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f5639b49700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563415bb90 con 0x7f56341598e0 2023-10-06T03:25:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f56337fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340cbcb0 0x7f563415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f56337fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340cbcb0 0x7f563415b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56206/0 (socket says 172.21.15.84:56206) 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.530+0000 7f56337fe700 1 -- 172.21.15.84:0/3542163157 learned_addr learned my addr 172.21.15.84:0/3542163157 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f5632ffd700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5634159510 0x7f56340b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f56337fe700 1 -- 172.21.15.84:0/3542163157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56341598e0 msgr2=0x7f5634169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f56337fe700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56341598e0 0x7f5634169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f56337fe700 1 -- 172.21.15.84:0/3542163157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5634159510 msgr2=0x7f56340b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f56337fe700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5634159510 0x7f56340b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f56337fe700 1 -- 172.21.15.84:0/3542163157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628009420 con 0x7f56340cbcb0 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f56337fe700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340cbcb0 0x7f563415b650 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f562400cb10 tx=0x7f56240017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f561b7fe700 1 -- 172.21.15.84:0/3542163157 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562400a760 con 0x7f56340cbcb0 2023-10-06T03:25:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f561b7fe700 1 -- 172.21.15.84:0/3542163157 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562400a8e0 con 0x7f56340cbcb0 2023-10-06T03:25:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f5639b49700 1 -- 172.21.15.84:0/3542163157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563416a9a0 con 0x7f56340cbcb0 2023-10-06T03:25:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f561b7fe700 1 -- 172.21.15.84:0/3542163157 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562400aca0 con 0x7f56340cbcb0 2023-10-06T03:25:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.531+0000 7f5639b49700 1 -- 172.21.15.84:0/3542163157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563415ae50 con 0x7f56340cbcb0 2023-10-06T03:25:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.532+0000 7f5639b49700 1 -- 172.21.15.84:0/3542163157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5634064ad0 con 0x7f56340cbcb0 2023-10-06T03:25:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.532+0000 7f561b7fe700 1 -- 172.21.15.84:0/3542163157 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5624003030 con 0x7f56340cbcb0 2023-10-06T03:25:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.533+0000 7f561b7fe700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5620066f30 0x7f56200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.533+0000 7f561b7fe700 1 -- 172.21.15.84:0/3542163157 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5624084900 con 0x7f56340cbcb0 2023-10-06T03:25:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.533+0000 7f5632ffd700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5620066f30 0x7f56200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.533+0000 7f5632ffd700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5620066f30 0x7f56200693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f56280098e0 tx=0x7f5628017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:55.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.537+0000 7f561b7fe700 1 -- 172.21.15.84:0/3542163157 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5624051980 con 0x7f56340cbcb0 2023-10-06T03:25:55.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.719+0000 7f5639b49700 1 -- 172.21.15.84:0/3542163157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56340c66e0 con 0x7f56340cbcb0 2023-10-06T03:25:55.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.719+0000 7f561b7fe700 1 -- 172.21.15.84:0/3542163157 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v62) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5624054fa0 con 0x7f56340cbcb0 2023-10-06T03:25:55.721 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:25:55.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.721+0000 7f5639b49700 1 -- 172.21.15.84:0/3542163157 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5620066f30 msgr2=0x7f56200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.721+0000 7f5639b49700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5620066f30 0x7f56200693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f56280098e0 tx=0x7f5628017000 comp rx=0 tx=0).stop 2023-10-06T03:25:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.721+0000 7f5639b49700 1 -- 172.21.15.84:0/3542163157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340cbcb0 msgr2=0x7f563415b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.721+0000 7f5639b49700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340cbcb0 0x7f563415b650 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f562400cb10 tx=0x7f56240017b0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.721+0000 7f5639b49700 1 -- 172.21.15.84:0/3542163157 shutdown_connections 2023-10-06T03:25:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.721+0000 7f5639b49700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5620066f30 0x7f56200693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.721+0000 7f5639b49700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56341598e0 0x7f5634169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.721+0000 7f5639b49700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340cbcb0 0x7f563415b650 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.721+0000 7f5639b49700 1 --2- 172.21.15.84:0/3542163157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5634159510 0x7f56340b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.721+0000 7f5639b49700 1 -- 172.21.15.84:0/3542163157 >> 172.21.15.84:0/3542163157 conn(0x7f5634089e90 msgr2=0x7f56340997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.722+0000 7f5639b49700 1 -- 172.21.15.84:0/3542163157 shutdown_connections 2023-10-06T03:25:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.722+0000 7f5639b49700 1 -- 172.21.15.84:0/3542163157 wait complete. 2023-10-06T03:25:55.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:25:55.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.850+0000 7f96f6616700 1 Processor -- start 2023-10-06T03:25:55.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.851+0000 7f96f6616700 1 -- start start 2023-10-06T03:25:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.851+0000 7f96f6616700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f96f00c93e0 0x7f96f0069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.851+0000 7f96f6616700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96f00c97b0 0x7f96f0157960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.851+0000 7f96f6616700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f006f0d0 con 0x7f96f015bc00 2023-10-06T03:25:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.851+0000 7f96f6616700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f006e4c0 con 0x7f96f00c97b0 2023-10-06T03:25:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.851+0000 7f96f6616700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f006e7a0 con 0x7f96f00c93e0 2023-10-06T03:25:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96f4bb3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96f00c97b0 0x7f96f0157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96f4bb3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96f00c97b0 0x7f96f0157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56218/0 (socket says 172.21.15.84:56218) 2023-10-06T03:25:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96f4bb3700 1 -- 172.21.15.84:0/1462445243 learned_addr learned my addr 172.21.15.84:0/1462445243 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96effff700 1 --2- 172.21.15.84:0/1462445243 >> v2:172.21.15.131:3300/0 conn(0x7f96f00c93e0 0x7f96f0069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96f4bb3700 1 -- 172.21.15.84:0/1462445243 >> v2:172.21.15.131:3300/0 conn(0x7f96f00c93e0 msgr2=0x7f96f0069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96f4bb3700 1 --2- 172.21.15.84:0/1462445243 >> v2:172.21.15.131:3300/0 conn(0x7f96f00c93e0 0x7f96f0069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96f4bb3700 1 -- 172.21.15.84:0/1462445243 >> v1:172.21.15.131:6789/0 conn(0x7f96f015bc00 legacy=0x7f96f00675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96f4bb3700 1 -- 172.21.15.84:0/1462445243 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f006ea80 con 0x7f96f00c97b0 2023-10-06T03:25:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96f4bb3700 1 --2- 172.21.15.84:0/1462445243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c97b0 0x7f96f0157960 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f96f0069640 tx=0x7f96e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d4c6357af00bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96eeffd700 1 -- 172.21.15.84:0/1462445243 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800e070 con 0x7f96f00c97b0 2023-10-06T03:25:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96eeffd700 1 -- 172.21.15.84:0/1462445243 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800ba20 con 0x7f96f00c97b0 2023-10-06T03:25:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.852+0000 7f96eeffd700 1 -- 172.21.15.84:0/1462445243 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e80092e0 con 0x7f96f00c97b0 2023-10-06T03:25:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.853+0000 7f96f6616700 1 -- 172.21.15.84:0/1462445243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c97b0 msgr2=0x7f96f0157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.853+0000 7f96f6616700 1 --2- 172.21.15.84:0/1462445243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c97b0 0x7f96f0157960 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f96f0069640 tx=0x7f96e8009840 comp rx=0 tx=0).stop 2023-10-06T03:25:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.853+0000 7f96f6616700 1 -- 172.21.15.84:0/1462445243 shutdown_connections 2023-10-06T03:25:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.853+0000 7f96f6616700 1 --2- 172.21.15.84:0/1462445243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c97b0 0x7f96f0157960 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.853+0000 7f96f6616700 1 --2- 172.21.15.84:0/1462445243 >> v2:172.21.15.131:3300/0 conn(0x7f96f00c93e0 0x7f96f0069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.853+0000 7f96f6616700 1 -- 172.21.15.84:0/1462445243 >> 172.21.15.84:0/1462445243 conn(0x7f96f00691d0 msgr2=0x7f96f00cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.853+0000 7f96f6616700 1 -- 172.21.15.84:0/1462445243 shutdown_connections 2023-10-06T03:25:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.853+0000 7f96f6616700 1 -- 172.21.15.84:0/1462445243 wait complete. 2023-10-06T03:25:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.854+0000 7f96f6616700 1 Processor -- start 2023-10-06T03:25:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.854+0000 7f96f6616700 1 -- start start 2023-10-06T03:25:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96f6616700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c93e0 0x7f96f0159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96f6616700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f00c97b0 0x7f96f00aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96f6616700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f015bc00 0x7f96f00b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96f6616700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00abdc0 con 0x7f96f00c93e0 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96f6616700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00ab800 con 0x7f96f00c97b0 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96f6616700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00abae0 con 0x7f96f015bc00 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96effff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c93e0 0x7f96f0159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96effff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c93e0 0x7f96f0159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56232/0 (socket says 172.21.15.84:56232) 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96effff700 1 -- 172.21.15.84:0/1113251278 learned_addr learned my addr 172.21.15.84:0/1113251278 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96ef7fe700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f00c97b0 0x7f96f00aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96f4bb3700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f015bc00 0x7f96f00b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96effff700 1 -- 172.21.15.84:0/1113251278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f015bc00 msgr2=0x7f96f00b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96effff700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f015bc00 0x7f96f00b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96effff700 1 -- 172.21.15.84:0/1113251278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f00c97b0 msgr2=0x7f96f00aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96effff700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f00c97b0 0x7f96f00aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96effff700 1 -- 172.21.15.84:0/1113251278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009ae0 con 0x7f96f00c93e0 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96effff700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c93e0 0x7f96f0159f60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f96e000ec80 tx=0x7f96e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96d7fff700 1 -- 172.21.15.84:0/1113251278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e000c9d0 con 0x7f96f00c93e0 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96d7fff700 1 -- 172.21.15.84:0/1113251278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e000cb30 con 0x7f96f00c93e0 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96f6616700 1 -- 172.21.15.84:0/1113251278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f00c43a0 con 0x7f96f00c93e0 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96d7fff700 1 -- 172.21.15.84:0/1113251278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0013470 con 0x7f96f00c93e0 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.855+0000 7f96f6616700 1 -- 172.21.15.84:0/1113251278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f01582b0 con 0x7f96f00c93e0 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.856+0000 7f96f6616700 1 -- 172.21.15.84:0/1113251278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f0064ad0 con 0x7f96f00c93e0 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.857+0000 7f96d7fff700 1 -- 172.21.15.84:0/1113251278 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96e0013820 con 0x7f96f00c93e0 2023-10-06T03:25:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.857+0000 7f96d7fff700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96dc066f30 0x7f96dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.857+0000 7f96d7fff700 1 -- 172.21.15.84:0/1113251278 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f96e0084af0 con 0x7f96f00c93e0 2023-10-06T03:25:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.857+0000 7f96ef7fe700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96dc066f30 0x7f96dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.858+0000 7f96ef7fe700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96dc066f30 0x7f96dc0693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f96f0068290 tx=0x7f96e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:55.861+0000 7f96d7fff700 1 -- 172.21.15.84:0/1113251278 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96e0051ac0 con 0x7f96f00c93e0 2023-10-06T03:25:56.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.044+0000 7f96f6616700 1 -- 172.21.15.84:0/1113251278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96f006ed60 con 0x7f96f00c93e0 2023-10-06T03:25:56.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.045+0000 7f96d7fff700 1 -- 172.21.15.84:0/1113251278 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v62) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96e00550e0 con 0x7f96f00c93e0 2023-10-06T03:25:56.046 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:25:56.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 -- 172.21.15.84:0/1113251278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96dc066f30 msgr2=0x7f96dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96dc066f30 0x7f96dc0693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f96f0068290 tx=0x7f96e4009040 comp rx=0 tx=0).stop 2023-10-06T03:25:56.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 -- 172.21.15.84:0/1113251278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c93e0 msgr2=0x7f96f0159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c93e0 0x7f96f0159f60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f96e000ec80 tx=0x7f96e00091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 -- 172.21.15.84:0/1113251278 shutdown_connections 2023-10-06T03:25:56.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96dc066f30 0x7f96dc0693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f015bc00 0x7f96f00b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96f00c93e0 0x7f96f0159f60 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 --2- 172.21.15.84:0/1113251278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f00c97b0 0x7f96f00aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 -- 172.21.15.84:0/1113251278 >> 172.21.15.84:0/1113251278 conn(0x7f96f00691d0 msgr2=0x7f96f015b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:56.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 -- 172.21.15.84:0/1113251278 shutdown_connections 2023-10-06T03:25:56.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.047+0000 7f96f6616700 1 -- 172.21.15.84:0/1113251278 wait complete. 2023-10-06T03:25:56.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:56.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:56.121 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:56.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.177+0000 7fcb8614f700 1 Processor -- start 2023-10-06T03:25:56.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.177+0000 7fcb8614f700 1 -- start start 2023-10-06T03:25:56.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.177+0000 7fcb8614f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcb80156390 0x7fcb800cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.177+0000 7fcb8614f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb800cc750 0x7fcb8006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.177+0000 7fcb8614f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb800ccba0 con 0x7fcb8006c1a0 2023-10-06T03:25:56.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.177+0000 7fcb8614f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8006c9e0 con 0x7fcb80156390 2023-10-06T03:25:56.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.177+0000 7fcb8614f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb80156b60 con 0x7fcb800cc750 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcb8006c1a0 0x7fcb800caff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49412/0 (socket says 172.21.15.84:49412) 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7ffff700 1 -- 172.21.15.84:0/2072474056 learned_addr learned my addr 172.21.15.84:0/2072474056 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7effd700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb800cc750 0x7fcb8006bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7f7fe700 1 --2- 172.21.15.84:0/2072474056 >> v2:172.21.15.131:3300/0 conn(0x7fcb80156390 0x7fcb800cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121633075 0 0) 0x7fcb800ccba0 con 0x7fcb8006c1a0 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb6c003570 con 0x7fcb8006c1a0 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287754431 0 0) 0x7fcb6c003570 con 0x7fcb8006c1a0 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb800cc750 msgr2=0x7fcb8006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb800cc750 0x7fcb8006bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 >> v2:172.21.15.131:3300/0 conn(0x7fcb80156390 msgr2=0x7fcb800cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 --2- 172.21.15.84:0/2072474056 >> v2:172.21.15.131:3300/0 conn(0x7fcb80156390 0x7fcb800cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80156e40 con 0x7fcb8006c1a0 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fcb78001470 con 0x7fcb8006c1a0 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 >> v1:172.21.15.84:6789/0 conn(0x7fcb8006c1a0 legacy=0x7fcb800caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb6c003a60 0x7fcb6c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb800cc750 0x7fcb6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c004d50 0x7fcb6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8006c9e0 con 0x7fcb6c003a60 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb80156b60 con 0x7fcb6c004d50 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c00ba60 con 0x7fcb800cc750 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7f7fe700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb6c003a60 0x7fcb6c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7ffff700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c004d50 0x7fcb6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.178+0000 7fcb7effd700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb800cc750 0x7fcb6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb7f7fe700 1 -- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb800cc750 msgr2=0x7fcb6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb7f7fe700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb800cc750 0x7fcb6c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb7f7fe700 1 -- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c004d50 msgr2=0x7fcb6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb7f7fe700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c004d50 0x7fcb6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb7f7fe700 1 -- 172.21.15.84:0/2072474056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c003570 con 0x7fcb6c003a60 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb7f7fe700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb6c003a60 0x7fcb6c003e70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000e210 tx=0x7fcb7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c99cda5b8b32c0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000ea60 con 0x7fcb6c003a60 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7000f040 con 0x7fcb6c003a60 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb7e7fc700 1 -- 172.21.15.84:0/2072474056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000ee10 con 0x7fcb6c003a60 2023-10-06T03:25:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb8614f700 1 -- 172.21.15.84:0/2072474056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb6c003a60 msgr2=0x7fcb6c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb8614f700 1 --2- 172.21.15.84:0/2072474056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb6c003a60 0x7fcb6c003e70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000e210 tx=0x7fcb7000b040 comp rx=0 tx=0).stop 2023-10-06T03:25:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb7ffff700 1 -- 172.21.15.84:0/2072474056 reap_dead start 2023-10-06T03:25:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb8614f700 1 -- 172.21.15.84:0/2072474056 shutdown_connections 2023-10-06T03:25:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb8614f700 1 -- 172.21.15.84:0/2072474056 >> 172.21.15.84:0/2072474056 conn(0x7fcb800cdef0 msgr2=0x7fcb800c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb8614f700 1 -- 172.21.15.84:0/2072474056 shutdown_connections 2023-10-06T03:25:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.179+0000 7fcb8614f700 1 -- 172.21.15.84:0/2072474056 wait complete. 2023-10-06T03:25:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.181+0000 7fcb8614f700 1 Processor -- start 2023-10-06T03:25:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.181+0000 7fcb8614f700 1 -- start start 2023-10-06T03:25:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.181+0000 7fcb8614f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c003a60 0x7fcb80165980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.181+0000 7fcb8614f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb80148bd0 0x7fcb800a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.181+0000 7fcb8614f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb80149040 0x7fcb80168f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.181+0000 7fcb8614f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800c5640 con 0x7fcb80149040 2023-10-06T03:25:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.181+0000 7fcb8614f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800c4a30 con 0x7fcb6c003a60 2023-10-06T03:25:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.181+0000 7fcb8614f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800c4d10 con 0x7fcb80148bd0 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb80149040 0x7fcb80168f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb80149040 0x7fcb80168f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56242/0 (socket says 172.21.15.84:56242) 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7ffff700 1 -- 172.21.15.84:0/3297439853 learned_addr learned my addr 172.21.15.84:0/3297439853 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7effd700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb80148bd0 0x7fcb800a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7f7fe700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c003a60 0x7fcb80165980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7ffff700 1 -- 172.21.15.84:0/3297439853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb80148bd0 msgr2=0x7fcb800a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7ffff700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb80148bd0 0x7fcb800a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7ffff700 1 -- 172.21.15.84:0/3297439853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c003a60 msgr2=0x7fcb80165980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7ffff700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c003a60 0x7fcb80165980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7ffff700 1 -- 172.21.15.84:0/3297439853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800c4ff0 con 0x7fcb80149040 2023-10-06T03:25:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb7ffff700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb80149040 0x7fcb80168f80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcb80069ab0 tx=0x7fcb78001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb777fe700 1 -- 172.21.15.84:0/3297439853 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7800f8a0 con 0x7fcb80149040 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb777fe700 1 -- 172.21.15.84:0/3297439853 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7800fa20 con 0x7fcb80149040 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb8614f700 1 -- 172.21.15.84:0/3297439853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb800c52d0 con 0x7fcb80149040 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb777fe700 1 -- 172.21.15.84:0/3297439853 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7800fde0 con 0x7fcb80149040 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.182+0000 7fcb8614f700 1 -- 172.21.15.84:0/3297439853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb80169c80 con 0x7fcb80149040 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.183+0000 7fcb8614f700 1 -- 172.21.15.84:0/3297439853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb800c57b0 con 0x7fcb80149040 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.184+0000 7fcb777fe700 1 -- 172.21.15.84:0/3297439853 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb78013600 con 0x7fcb80149040 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.184+0000 7fcb777fe700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcb60066f30 0x7fcb600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.184+0000 7fcb777fe700 1 -- 172.21.15.84:0/3297439853 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcb780846c0 con 0x7fcb80149040 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.184+0000 7fcb7f7fe700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcb60066f30 0x7fcb600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.184+0000 7fcb7f7fe700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcb60066f30 0x7fcb600693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000afd0 tx=0x7fcb7001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.188+0000 7fcb777fe700 1 -- 172.21.15.84:0/3297439853 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb78051690 con 0x7fcb80149040 2023-10-06T03:25:56.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.413+0000 7fcb8614f700 1 -- 172.21.15.84:0/3297439853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb80064ad0 con 0x7fcb80149040 2023-10-06T03:25:56.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.413+0000 7fcb777fe700 1 -- 172.21.15.84:0/3297439853 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fcb78054cb0 con 0x7fcb80149040 2023-10-06T03:25:56.416 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:56.416 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1896877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1896877693},{"type":"v1","addr":"172.21.15.131:6834","nonce":1896877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/236530865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":236530865},{"type":"v1","addr":"172.21.15.131:6835","nonce":236530865}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2675057738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2675057738},{"type":"v1","addr":"172.21.15.84:6836","nonce":2675057738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:45.372432+0000","modified":"2023-10-06T03:25:49.023019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5871":{"gid":5871,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1162609428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1162609428},{"type":"v1","addr":"172.21.15.84:6837","nonce":1162609428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:25:56.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.415+0000 7fcb8614f700 1 -- 172.21.15.84:0/3297439853 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcb60066f30 msgr2=0x7fcb600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.415+0000 7fcb8614f700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcb60066f30 0x7fcb600693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000afd0 tx=0x7fcb7001a000 comp rx=0 tx=0).stop 2023-10-06T03:25:56.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.415+0000 7fcb8614f700 1 -- 172.21.15.84:0/3297439853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb80149040 msgr2=0x7fcb80168f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.415+0000 7fcb8614f700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb80149040 0x7fcb80168f80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcb80069ab0 tx=0x7fcb78001e90 comp rx=0 tx=0).stop 2023-10-06T03:25:56.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.416+0000 7fcb8614f700 1 -- 172.21.15.84:0/3297439853 shutdown_connections 2023-10-06T03:25:56.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.416+0000 7fcb8614f700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcb60066f30 0x7fcb600693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.416+0000 7fcb8614f700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c003a60 0x7fcb80165980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.416+0000 7fcb8614f700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb80149040 0x7fcb80168f80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.416+0000 7fcb8614f700 1 --2- 172.21.15.84:0/3297439853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb80148bd0 0x7fcb800a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.416+0000 7fcb8614f700 1 -- 172.21.15.84:0/3297439853 >> 172.21.15.84:0/3297439853 conn(0x7fcb800cdef0 msgr2=0x7fcb80155030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:56.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.416+0000 7fcb8614f700 1 -- 172.21.15.84:0/3297439853 shutdown_connections 2023-10-06T03:25:56.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.416+0000 7fcb8614f700 1 -- 172.21.15.84:0/3297439853 wait complete. 2023-10-06T03:25:56.421 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 31 2023-10-06T03:25:56.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.582+0000 7fa4d89f6700 1 Processor -- start 2023-10-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.582+0000 7fa4d89f6700 1 -- start start 2023-10-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4d89f6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4d415db50 0x7fa4d40cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4d89f6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa4d40ad620 0x7fa4d40ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4d89f6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d40ca640 con 0x7fa4d40ad250 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4d89f6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d40ced30 con 0x7fa4d415db50 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4d89f6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d40cf010 con 0x7fa4d40ad620 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4c9d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4d415db50 0x7fa4d40cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4d259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa4d40ad250 0x7fa4d415d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49428/0 (socket says 172.21.15.84:49428) 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4d259c700 1 -- 172.21.15.84:0/3247016910 learned_addr learned my addr 172.21.15.84:0/3247016910 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4c9d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4d415db50 0x7fa4d40cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56256/0 (socket says 172.21.15.84:56256) 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4d2d9d700 1 --2- 172.21.15.84:0/3247016910 >> v2:172.21.15.131:3300/0 conn(0x7fa4d40ad620 0x7fa4d40ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4c9d9b700 1 -- 172.21.15.84:0/3247016910 >> v2:172.21.15.131:3300/0 conn(0x7fa4d40ad620 msgr2=0x7fa4d40ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4c9d9b700 1 --2- 172.21.15.84:0/3247016910 >> v2:172.21.15.131:3300/0 conn(0x7fa4d40ad620 0x7fa4d40ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4c9d9b700 1 -- 172.21.15.84:0/3247016910 >> v1:172.21.15.84:6789/0 conn(0x7fa4d40ad250 legacy=0x7fa4d415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4c9d9b700 1 -- 172.21.15.84:0/3247016910 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40ccad0 con 0x7fa4d415db50 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4d2d9d700 1 --2- 172.21.15.84:0/3247016910 >> v2:172.21.15.131:3300/0 conn(0x7fa4d40ad620 0x7fa4d40ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.583+0000 7fa4c9d9b700 1 --2- 172.21.15.84:0/3247016910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d415db50 0x7fa4d40cd2d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa4d406a3e0 tx=0x7fa4bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8520d4e9c8735c18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d1d9b700 1 -- 172.21.15.84:0/3247016910 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00b6b0 con 0x7fa4d415db50 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d1d9b700 1 -- 172.21.15.84:0/3247016910 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc00b810 con 0x7fa4d415db50 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d1d9b700 1 -- 172.21.15.84:0/3247016910 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00bbb0 con 0x7fa4d415db50 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d89f6700 1 -- 172.21.15.84:0/3247016910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d415db50 msgr2=0x7fa4d40cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d89f6700 1 --2- 172.21.15.84:0/3247016910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d415db50 0x7fa4d40cd2d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa4d406a3e0 tx=0x7fa4bc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d89f6700 1 -- 172.21.15.84:0/3247016910 shutdown_connections 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d89f6700 1 --2- 172.21.15.84:0/3247016910 >> v2:172.21.15.131:3300/0 conn(0x7fa4d40ad620 0x7fa4d40ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d89f6700 1 --2- 172.21.15.84:0/3247016910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d415db50 0x7fa4d40cd2d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d89f6700 1 -- 172.21.15.84:0/3247016910 >> 172.21.15.84:0/3247016910 conn(0x7fa4d4067dd0 msgr2=0x7fa4d40ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d89f6700 1 -- 172.21.15.84:0/3247016910 shutdown_connections 2023-10-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.584+0000 7fa4d89f6700 1 -- 172.21.15.84:0/3247016910 wait complete. 2023-10-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.585+0000 7fa4d89f6700 1 Processor -- start 2023-10-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.585+0000 7fa4d89f6700 1 -- start start 2023-10-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4d89f6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d40ad250 0x7fa4d40adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4d89f6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d40ad620 0x7fa4d40c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4d89f6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4d415db50 0x7fa4d4148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4d89f6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40aecd0 con 0x7fa4d40ad620 2023-10-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4d89f6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40c4c30 con 0x7fa4d40ad250 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4d89f6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4149330 con 0x7fa4d415db50 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4c9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d40ad620 0x7fa4d40c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4c9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d40ad620 0x7fa4d40c46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56268/0 (socket says 172.21.15.84:56268) 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4c9d9b700 1 -- 172.21.15.84:0/2104082020 learned_addr learned my addr 172.21.15.84:0/2104082020 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4d259c700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d40ad250 0x7fa4d40adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.586+0000 7fa4d2d9d700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4d415db50 0x7fa4d4148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4c9d9b700 1 -- 172.21.15.84:0/2104082020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4d415db50 msgr2=0x7fa4d4148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4c9d9b700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4d415db50 0x7fa4d4148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4c9d9b700 1 -- 172.21.15.84:0/2104082020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d40ad250 msgr2=0x7fa4d40adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4c9d9b700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d40ad250 0x7fa4d40adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4c9d9b700 1 -- 172.21.15.84:0/2104082020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc009420 con 0x7fa4d40ad620 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4d259c700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d40ad250 0x7fa4d40adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4c9d9b700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d40ad620 0x7fa4d40c46f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40704c0 tx=0x7fa4bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4caffd700 1 -- 172.21.15.84:0/2104082020 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc011420 con 0x7fa4d40ad620 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4caffd700 1 -- 172.21.15.84:0/2104082020 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc011580 con 0x7fa4d40ad620 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4d89f6700 1 -- 172.21.15.84:0/2104082020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d40ae0c0 con 0x7fa4d40ad620 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4caffd700 1 -- 172.21.15.84:0/2104082020 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc011920 con 0x7fa4d40ad620 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.587+0000 7fa4d89f6700 1 -- 172.21.15.84:0/2104082020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d40ae680 con 0x7fa4d40ad620 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.588+0000 7fa4d89f6700 1 -- 172.21.15.84:0/2104082020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d40aee80 con 0x7fa4d40ad620 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.588+0000 7fa4caffd700 1 -- 172.21.15.84:0/2104082020 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4bc011d10 con 0x7fa4d40ad620 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.589+0000 7fa4caffd700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4b4066f30 0x7fa4b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.589+0000 7fa4d259c700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4b4066f30 0x7fa4b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.589+0000 7fa4caffd700 1 -- 172.21.15.84:0/2104082020 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa4bc0861f0 con 0x7fa4d40ad620 2023-10-06T03:25:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.589+0000 7fa4d259c700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4b4066f30 0x7fa4b40693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40010e0 tx=0x7fa4c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:56.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.593+0000 7fa4caffd700 1 -- 172.21.15.84:0/2104082020 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4d40aee80 con 0x7fa4d40ad620 2023-10-06T03:25:56.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.777+0000 7fa4d89f6700 1 -- 172.21.15.84:0/2104082020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4d40aee80 con 0x7fa4d40ad620 2023-10-06T03:25:56.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.777+0000 7fa4caffd700 1 -- 172.21.15.84:0/2104082020 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fa4d40aee80 con 0x7fa4d40ad620 2023-10-06T03:25:56.780 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:56.780 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":62,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:46.997828+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:43.021239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:44.339383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 -- 172.21.15.84:0/2104082020 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4b4066f30 msgr2=0x7fa4b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4b4066f30 0x7fa4b40693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40010e0 tx=0x7fa4c4009040 comp rx=0 tx=0).stop 2023-10-06T03:25:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 -- 172.21.15.84:0/2104082020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d40ad620 msgr2=0x7fa4d40c46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d40ad620 0x7fa4d40c46f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40704c0 tx=0x7fa4bc017000 comp rx=0 tx=0).stop 2023-10-06T03:25:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 -- 172.21.15.84:0/2104082020 shutdown_connections 2023-10-06T03:25:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa4b4066f30 0x7fa4b40693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d40ad250 0x7fa4d40adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4d415db50 0x7fa4d4148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 --2- 172.21.15.84:0/2104082020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d40ad620 0x7fa4d40c46f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 -- 172.21.15.84:0/2104082020 >> 172.21.15.84:0/2104082020 conn(0x7fa4d4067dd0 msgr2=0x7fa4d40cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:56.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 -- 172.21.15.84:0/2104082020 shutdown_connections 2023-10-06T03:25:56.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.780+0000 7fa4d89f6700 1 -- 172.21.15.84:0/2104082020 wait complete. 2023-10-06T03:25:56.794 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:25:56.794 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:56.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.906+0000 7ff53ac6f700 1 Processor -- start 2023-10-06T03:25:56.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.906+0000 7ff53ac6f700 1 -- start start 2023-10-06T03:25:56.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff53ac6f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff534159480 0x7ff5340b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff53ac6f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff5340b2140 0x7ff5340b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff53ac6f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340cb7e0 con 0x7ff5340b3610 2023-10-06T03:25:56.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff53ac6f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5340b08a0 con 0x7ff534159480 2023-10-06T03:25:56.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff53ac6f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5340cb190 con 0x7ff5340b2140 2023-10-06T03:25:56.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff539c6d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff534159480 0x7ff5340b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff53946c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff5340b3610 0x7ff5340cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49438/0 (socket says 172.21.15.84:49438) 2023-10-06T03:25:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff53946c700 1 -- 172.21.15.84:0/1755151465 learned_addr learned my addr 172.21.15.84:0/1755151465 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff539c6d700 1 -- 172.21.15.84:0/1755151465 >> v2:172.21.15.131:3300/0 conn(0x7ff5340b2140 msgr2=0x7ff5340b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff53a46e700 1 --2- 172.21.15.84:0/1755151465 >> v2:172.21.15.131:3300/0 conn(0x7ff5340b2140 0x7ff5340b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff539c6d700 1 --2- 172.21.15.84:0/1755151465 >> v2:172.21.15.131:3300/0 conn(0x7ff5340b2140 0x7ff5340b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff538c6b700 1 -- 172.21.15.84:0/1755151465 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380243898 0 0) 0x7ff5340cb7e0 con 0x7ff5340b3610 2023-10-06T03:25:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.907+0000 7ff539c6d700 1 -- 172.21.15.84:0/1755151465 >> v1:172.21.15.84:6789/0 conn(0x7ff5340b3610 legacy=0x7ff5340cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff539c6d700 1 -- 172.21.15.84:0/1755151465 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340cb470 con 0x7ff534159480 2023-10-06T03:25:56.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff539c6d700 1 --2- 172.21.15.84:0/1755151465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff534159480 0x7ff5340b30d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff5340ca830 tx=0x7ff5300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aaa6ed44bfcdf0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:56.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff538c6b700 1 -- 172.21.15.84:0/1755151465 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53000b6b0 con 0x7ff534159480 2023-10-06T03:25:56.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff538c6b700 1 -- 172.21.15.84:0/1755151465 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53000b810 con 0x7ff534159480 2023-10-06T03:25:56.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff538c6b700 1 -- 172.21.15.84:0/1755151465 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53000bbb0 con 0x7ff534159480 2023-10-06T03:25:56.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1755151465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff534159480 msgr2=0x7ff5340b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff53ac6f700 1 --2- 172.21.15.84:0/1755151465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff534159480 0x7ff5340b30d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff5340ca830 tx=0x7ff5300091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1755151465 shutdown_connections 2023-10-06T03:25:56.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff53ac6f700 1 --2- 172.21.15.84:0/1755151465 >> v2:172.21.15.131:3300/0 conn(0x7ff5340b2140 0x7ff5340b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff53ac6f700 1 --2- 172.21.15.84:0/1755151465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff534159480 0x7ff5340b30d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1755151465 >> 172.21.15.84:0/1755151465 conn(0x7ff53406ed20 msgr2=0x7ff53406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:56.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1755151465 shutdown_connections 2023-10-06T03:25:56.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.908+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1755151465 wait complete. 2023-10-06T03:25:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.909+0000 7ff53ac6f700 1 Processor -- start 2023-10-06T03:25:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.909+0000 7ff53ac6f700 1 -- start start 2023-10-06T03:25:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff53ac6f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340b2140 0x7ff53415e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff53ac6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5340b3610 0x7ff53415ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff53ac6f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff534159480 0x7ff5340c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff53ac6f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340c76c0 con 0x7ff5340b3610 2023-10-06T03:25:56.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff53ac6f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53415fb00 con 0x7ff5340b2140 2023-10-06T03:25:56.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff53ac6f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53415a3a0 con 0x7ff534159480 2023-10-06T03:25:56.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff53946c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5340b3610 0x7ff53415ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff53946c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5340b3610 0x7ff53415ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56284/0 (socket says 172.21.15.84:56284) 2023-10-06T03:25:56.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff53946c700 1 -- 172.21.15.84:0/1648926584 learned_addr learned my addr 172.21.15.84:0/1648926584 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:56.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff539c6d700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340b2140 0x7ff53415e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.910+0000 7ff53a46e700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff534159480 0x7ff5340c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff53946c700 1 -- 172.21.15.84:0/1648926584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff534159480 msgr2=0x7ff5340c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff53946c700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff534159480 0x7ff5340c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff53946c700 1 -- 172.21.15.84:0/1648926584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340b2140 msgr2=0x7ff53415e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:56.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff53946c700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340b2140 0x7ff53415e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:56.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff53946c700 1 -- 172.21.15.84:0/1648926584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff530009420 con 0x7ff5340b3610 2023-10-06T03:25:56.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff53946c700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5340b3610 0x7ff53415ee70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff52400c7e0 tx=0x7ff524007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:56.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff529ffb700 1 -- 172.21.15.84:0/1648926584 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524005b30 con 0x7ff5340b3610 2023-10-06T03:25:56.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff529ffb700 1 -- 172.21.15.84:0/1648926584 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff524005c90 con 0x7ff5340b3610 2023-10-06T03:25:56.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1648926584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff534168ff0 con 0x7ff5340b3610 2023-10-06T03:25:56.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff529ffb700 1 -- 172.21.15.84:0/1648926584 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524007300 con 0x7ff5340b3610 2023-10-06T03:25:56.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.911+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1648926584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53415a030 con 0x7ff5340b3610 2023-10-06T03:25:56.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.912+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1648926584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53415a550 con 0x7ff5340b3610 2023-10-06T03:25:56.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.912+0000 7ff529ffb700 1 -- 172.21.15.84:0/1648926584 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff52401b3b0 con 0x7ff5340b3610 2023-10-06T03:25:56.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.913+0000 7ff529ffb700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff518066f30 0x7ff5180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:56.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.913+0000 7ff529ffb700 1 -- 172.21.15.84:0/1648926584 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff524083d90 con 0x7ff5340b3610 2023-10-06T03:25:56.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.913+0000 7ff539c6d700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff518066f30 0x7ff5180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:56.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.913+0000 7ff539c6d700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff518066f30 0x7ff5180693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff5300093f0 tx=0x7ff530017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:56.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:56.917+0000 7ff529ffb700 1 -- 172.21.15.84:0/1648926584 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff53415a550 con 0x7ff5340b3610 2023-10-06T03:25:57.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.140+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1648926584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff53415a510 con 0x7ff5340b3610 2023-10-06T03:25:57.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.141+0000 7ff529ffb700 1 -- 172.21.15.84:0/1648926584 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4602 (secure 0 0 0) 0x7ff524017020 con 0x7ff5340b3610 2023-10-06T03:25:57.143 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:57.143 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1896877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1896877693},{"type":"v1","addr":"172.21.15.131:6834","nonce":1896877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/236530865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":236530865},{"type":"v1","addr":"172.21.15.131:6835","nonce":236530865}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2675057738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2675057738},{"type":"v1","addr":"172.21.15.84:6836","nonce":2675057738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:45.372432+0000","modified":"2023-10-06T03:25:49.023019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5871":{"gid":5871,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1162609428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1162609428},{"type":"v1","addr":"172.21.15.84:6837","nonce":1162609428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:25:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1648926584 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff518066f30 msgr2=0x7ff5180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff518066f30 0x7ff5180693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff5300093f0 tx=0x7ff530017000 comp rx=0 tx=0).stop 2023-10-06T03:25:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1648926584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5340b3610 msgr2=0x7ff53415ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5340b3610 0x7ff53415ee70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff52400c7e0 tx=0x7ff524007df0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1648926584 shutdown_connections 2023-10-06T03:25:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff518066f30 0x7ff5180693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340b2140 0x7ff53415e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff534159480 0x7ff5340c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 --2- 172.21.15.84:0/1648926584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5340b3610 0x7ff53415ee70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1648926584 >> 172.21.15.84:0/1648926584 conn(0x7ff53406ed20 msgr2=0x7ff5341569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:57.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1648926584 shutdown_connections 2023-10-06T03:25:57.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.143+0000 7ff53ac6f700 1 -- 172.21.15.84:0/1648926584 wait complete. 2023-10-06T03:25:57.147 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 31 2023-10-06T03:25:57.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:57.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.267+0000 7fac83972700 1 Processor -- start 2023-10-06T03:25:57.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.267+0000 7fac83972700 1 -- start start 2023-10-06T03:25:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.268+0000 7fac83972700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac7c1595a0 0x7fac7c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.268+0000 7fac83972700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c0b0ca0 con 0x7fac7c0b49e0 2023-10-06T03:25:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.268+0000 7fac83972700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c0b0f80 con 0x7fac7c0b07a0 2023-10-06T03:25:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.268+0000 7fac83972700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0b1260 con 0x7fac7c1595a0 2023-10-06T03:25:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.268+0000 7fac80f0d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fac7c0b49e0 0x7fac7c0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49444/0 (socket says 172.21.15.84:49444) 2023-10-06T03:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.268+0000 7fac80f0d700 1 -- 172.21.15.84:0/3498301498 learned_addr learned my addr 172.21.15.84:0/3498301498 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.268+0000 7fac8170e700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac7c1595a0 0x7fac7c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.268+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781573905 0 0) 0x7fac7c0b0ca0 con 0x7fac7c0b49e0 2023-10-06T03:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.268+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac68003570 con 0x7fac7c0b49e0 2023-10-06T03:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 40093299 0 0) 0x7fac68003570 con 0x7fac7c0b49e0 2023-10-06T03:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac7c1595a0 msgr2=0x7fac7c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac7c1595a0 0x7fac7c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 >> v1:172.21.15.131:6789/0 conn(0x7fac7c0b07a0 legacy=0x7fac7c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c0b1540 con 0x7fac7c0b49e0 2023-10-06T03:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fac6c001470 con 0x7fac7c0b49e0 2023-10-06T03:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 >> v1:172.21.15.84:6789/0 conn(0x7fac7c0b49e0 legacy=0x7fac7c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac7c1595a0 0x7fac68003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac68003fd0 0x7fac68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68004d50 0x7fac680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0b1260 con 0x7fac68003fd0 2023-10-06T03:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6800bb40 con 0x7fac68004d50 2023-10-06T03:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6800bd00 con 0x7fac7c1595a0 2023-10-06T03:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac80f0d700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac68003fd0 0x7fac68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac8170e700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac7c1595a0 0x7fac68003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac81f0f700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68004d50 0x7fac680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac80f0d700 1 -- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac7c1595a0 msgr2=0x7fac68003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:57.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac80f0d700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac7c1595a0 0x7fac68003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac80f0d700 1 -- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68004d50 msgr2=0x7fac680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:57.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac80f0d700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68004d50 0x7fac680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac80f0d700 1 -- 172.21.15.84:0/3498301498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68003570 con 0x7fac68003fd0 2023-10-06T03:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac81f0f700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68004d50 0x7fac680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac80f0d700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac68003fd0 0x7fac68004810 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00c390 tx=0x7fac6c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745232382f772d65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c00cc60 con 0x7fac68003fd0 2023-10-06T03:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c00cdc0 con 0x7fac68003fd0 2023-10-06T03:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.269+0000 7fac73fff700 1 -- 172.21.15.84:0/3498301498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c005b70 con 0x7fac68003fd0 2023-10-06T03:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.270+0000 7fac83972700 1 -- 172.21.15.84:0/3498301498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac68003fd0 msgr2=0x7fac68004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.270+0000 7fac83972700 1 --2- 172.21.15.84:0/3498301498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac68003fd0 0x7fac68004810 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00c390 tx=0x7fac6c001e70 comp rx=0 tx=0).stop 2023-10-06T03:25:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.270+0000 7fac81f0f700 1 -- 172.21.15.84:0/3498301498 reap_dead start 2023-10-06T03:25:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.270+0000 7fac83972700 1 -- 172.21.15.84:0/3498301498 shutdown_connections 2023-10-06T03:25:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.270+0000 7fac83972700 1 -- 172.21.15.84:0/3498301498 >> 172.21.15.84:0/3498301498 conn(0x7fac7c099830 msgr2=0x7fac7c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.270+0000 7fac83972700 1 -- 172.21.15.84:0/3498301498 shutdown_connections 2023-10-06T03:25:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.270+0000 7fac83972700 1 -- 172.21.15.84:0/3498301498 wait complete. 2023-10-06T03:25:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.271+0000 7fac83972700 1 Processor -- start 2023-10-06T03:25:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.271+0000 7fac83972700 1 -- start start 2023-10-06T03:25:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac83972700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac68003fd0 0x7fac7c169ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac83972700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac7c0cc3c0 0x7fac7c15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac83972700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac7c16a000 0x7fac7c15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac83972700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c159d70 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac83972700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c15a050 con 0x7fac7c16a000 2023-10-06T03:25:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac83972700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c15a330 con 0x7fac68003fd0 2023-10-06T03:25:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac80f0d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac7c0cc3c0 0x7fac7c15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac80f0d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac7c0cc3c0 0x7fac7c15ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56298/0 (socket says 172.21.15.84:56298) 2023-10-06T03:25:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac80f0d700 1 -- 172.21.15.84:0/3192910504 learned_addr learned my addr 172.21.15.84:0/3192910504 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac8170e700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac68003fd0 0x7fac7c169ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac81f0f700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac7c16a000 0x7fac7c15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac80f0d700 1 -- 172.21.15.84:0/3192910504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac68003fd0 msgr2=0x7fac7c169ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac80f0d700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac68003fd0 0x7fac7c169ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac80f0d700 1 -- 172.21.15.84:0/3192910504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac7c16a000 msgr2=0x7fac7c15b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac80f0d700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac7c16a000 0x7fac7c15b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac80f0d700 1 -- 172.21.15.84:0/3192910504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c15a610 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac8170e700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac68003fd0 0x7fac7c169ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:57.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac81f0f700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac7c16a000 0x7fac7c15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:57.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.272+0000 7fac80f0d700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac7c0cc3c0 0x7fac7c15ae10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fac6800bb10 tx=0x7fac6c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.273+0000 7fac717fa700 1 -- 172.21.15.84:0/3192910504 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c00cc60 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.273+0000 7fac717fa700 1 -- 172.21.15.84:0/3192910504 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c000fe0 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.273+0000 7fac83972700 1 -- 172.21.15.84:0/3192910504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7c15a8f0 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.273+0000 7fac717fa700 1 -- 172.21.15.84:0/3192910504 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c007510 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.273+0000 7fac83972700 1 -- 172.21.15.84:0/3192910504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7c09ca20 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.273+0000 7fac83972700 1 -- 172.21.15.84:0/3192910504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7c064ad0 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.274+0000 7fac717fa700 1 -- 172.21.15.84:0/3192910504 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac6c019030 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.274+0000 7fac717fa700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac60066f30 0x7fac600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.274+0000 7fac717fa700 1 -- 172.21.15.84:0/3192910504 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fac6c085820 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.274+0000 7fac8170e700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac60066f30 0x7fac600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.275+0000 7fac8170e700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac60066f30 0x7fac600693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fac780099f0 tx=0x7fac7800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:57.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.278+0000 7fac717fa700 1 -- 172.21.15.84:0/3192910504 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac6c052800 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.505+0000 7fac83972700 1 -- 172.21.15.84:0/3192910504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac7c15aa80 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.505+0000 7fac717fa700 1 -- 172.21.15.84:0/3192910504 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fac6c055e20 con 0x7fac7c0cc3c0 2023-10-06T03:25:57.507 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:57.507 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1896877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1896877693},{"type":"v1","addr":"172.21.15.131:6834","nonce":1896877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/236530865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":236530865},{"type":"v1","addr":"172.21.15.131:6835","nonce":236530865}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2675057738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2675057738},{"type":"v1","addr":"172.21.15.84:6836","nonce":2675057738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:45.372432+0000","modified":"2023-10-06T03:25:49.023019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5871":{"gid":5871,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1162609428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1162609428},{"type":"v1","addr":"172.21.15.84:6837","nonce":1162609428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:25:57.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.507+0000 7fac83972700 1 -- 172.21.15.84:0/3192910504 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac60066f30 msgr2=0x7fac600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.507+0000 7fac83972700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac60066f30 0x7fac600693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fac780099f0 tx=0x7fac7800b040 comp rx=0 tx=0).stop 2023-10-06T03:25:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.508+0000 7fac83972700 1 -- 172.21.15.84:0/3192910504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac7c0cc3c0 msgr2=0x7fac7c15ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.508+0000 7fac83972700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac7c0cc3c0 0x7fac7c15ae10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fac6800bb10 tx=0x7fac6c015000 comp rx=0 tx=0).stop 2023-10-06T03:25:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.508+0000 7fac83972700 1 -- 172.21.15.84:0/3192910504 shutdown_connections 2023-10-06T03:25:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.508+0000 7fac83972700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fac60066f30 0x7fac600693e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.508+0000 7fac83972700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac7c16a000 0x7fac7c15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.508+0000 7fac83972700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac68003fd0 0x7fac7c169ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.508+0000 7fac83972700 1 --2- 172.21.15.84:0/3192910504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac7c0cc3c0 0x7fac7c15ae10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.508+0000 7fac83972700 1 -- 172.21.15.84:0/3192910504 >> 172.21.15.84:0/3192910504 conn(0x7fac7c099830 msgr2=0x7fac7c0cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:57.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.508+0000 7fac83972700 1 -- 172.21.15.84:0/3192910504 shutdown_connections 2023-10-06T03:25:57.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.508+0000 7fac83972700 1 -- 172.21.15.84:0/3192910504 wait complete. 2023-10-06T03:25:57.511 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 31 2023-10-06T03:25:57.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.633+0000 7f515cafc700 1 Processor -- start 2023-10-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.633+0000 7f515cafc700 1 -- start start 2023-10-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515cafc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51581595a0 0x7f51580aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515cafc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f51580b49e0 0x7f51580aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515cafc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51580b0ca0 con 0x7f51580b07a0 2023-10-06T03:25:57.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515cafc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51580b0f80 con 0x7f51581595a0 2023-10-06T03:25:57.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515cafc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51580b1260 con 0x7f51580b49e0 2023-10-06T03:25:57.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51581595a0 0x7f51580aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51581595a0 0x7f51580aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56308/0 (socket says 172.21.15.84:56308) 2023-10-06T03:25:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515659c700 1 -- 172.21.15.84:0/3964336303 learned_addr learned my addr 172.21.15.84:0/3964336303 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515659c700 1 -- 172.21.15.84:0/3964336303 >> v2:172.21.15.131:3300/0 conn(0x7f51580b49e0 msgr2=0x7f51580aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515659c700 1 --2- 172.21.15.84:0/3964336303 >> v2:172.21.15.131:3300/0 conn(0x7f51580b49e0 0x7f51580aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515659c700 1 -- 172.21.15.84:0/3964336303 >> v1:172.21.15.131:6789/0 conn(0x7f51580b07a0 legacy=0x7f51580b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:57.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515659c700 1 -- 172.21.15.84:0/3964336303 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580b1540 con 0x7f51581595a0 2023-10-06T03:25:57.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.634+0000 7f515659c700 1 --2- 172.21.15.84:0/3964336303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 0x7f51580aa570 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5148009990 tx=0x7f5148009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92b5d1d3732d4c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:57.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f5155d9b700 1 -- 172.21.15.84:0/3964336303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148005c10 con 0x7f51581595a0 2023-10-06T03:25:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f5155d9b700 1 -- 172.21.15.84:0/3964336303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148005d70 con 0x7f51581595a0 2023-10-06T03:25:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f5155d9b700 1 -- 172.21.15.84:0/3964336303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800b800 con 0x7f51581595a0 2023-10-06T03:25:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f515cafc700 1 -- 172.21.15.84:0/3964336303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 msgr2=0x7f51580aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f515cafc700 1 --2- 172.21.15.84:0/3964336303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 0x7f51580aa570 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5148009990 tx=0x7f5148009220 comp rx=0 tx=0).stop 2023-10-06T03:25:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f515cafc700 1 -- 172.21.15.84:0/3964336303 shutdown_connections 2023-10-06T03:25:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f515cafc700 1 --2- 172.21.15.84:0/3964336303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 0x7f51580aa570 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f515cafc700 1 --2- 172.21.15.84:0/3964336303 >> v2:172.21.15.131:3300/0 conn(0x7f51580b49e0 0x7f51580aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f515cafc700 1 -- 172.21.15.84:0/3964336303 >> 172.21.15.84:0/3964336303 conn(0x7f5158099830 msgr2=0x7f515806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f515cafc700 1 -- 172.21.15.84:0/3964336303 shutdown_connections 2023-10-06T03:25:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.635+0000 7f515cafc700 1 -- 172.21.15.84:0/3964336303 wait complete. 2023-10-06T03:25:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.636+0000 7f515cafc700 1 Processor -- start 2023-10-06T03:25:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.636+0000 7f515cafc700 1 -- start start 2023-10-06T03:25:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f515cafc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51580b07a0 0x7f5158156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f515cafc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51580b49e0 0x7f5158158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f515cafc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 0x7f5158158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f515cafc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515809dda0 con 0x7f51581595a0 2023-10-06T03:25:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f515cafc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515815afa0 con 0x7f51580b49e0 2023-10-06T03:25:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f515cafc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515815a4c0 con 0x7f51580b07a0 2023-10-06T03:25:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f5156d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 0x7f5158158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f5156d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 0x7f5158158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56324/0 (socket says 172.21.15.84:56324) 2023-10-06T03:25:57.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f5156d9d700 1 -- 172.21.15.84:0/2161595247 learned_addr learned my addr 172.21.15.84:0/2161595247 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:57.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f5156d9d700 1 -- 172.21.15.84:0/2161595247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51580b07a0 msgr2=0x7f5158156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f5156d9d700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51580b07a0 0x7f5158156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f5156d9d700 1 -- 172.21.15.84:0/2161595247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51580b49e0 msgr2=0x7f5158158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f514dd9b700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51580b49e0 0x7f5158158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f5156d9d700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51580b49e0 0x7f5158158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.637+0000 7f5156d9d700 1 -- 172.21.15.84:0/2161595247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5148009480 con 0x7f51581595a0 2023-10-06T03:25:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.638+0000 7f5156d9d700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 0x7f5158158bc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f515000bbe0 tx=0x7f5150009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:57.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.638+0000 7f514effd700 1 -- 172.21.15.84:0/2161595247 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500092e0 con 0x7f51581595a0 2023-10-06T03:25:57.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.638+0000 7f514effd700 1 -- 172.21.15.84:0/2161595247 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515000c7a0 con 0x7f51581595a0 2023-10-06T03:25:57.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.638+0000 7f514effd700 1 -- 172.21.15.84:0/2161595247 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515000cb60 con 0x7f51581595a0 2023-10-06T03:25:57.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.638+0000 7f515cafc700 1 -- 172.21.15.84:0/2161595247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5158159b90 con 0x7f51581595a0 2023-10-06T03:25:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.638+0000 7f515cafc700 1 -- 172.21.15.84:0/2161595247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515815a150 con 0x7f51581595a0 2023-10-06T03:25:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.639+0000 7f515cafc700 1 -- 172.21.15.84:0/2161595247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515815a7a0 con 0x7f51581595a0 2023-10-06T03:25:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.639+0000 7f514effd700 1 -- 172.21.15.84:0/2161595247 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5150012070 con 0x7f51581595a0 2023-10-06T03:25:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.639+0000 7f514effd700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5138066f30 0x7f51380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.640+0000 7f514effd700 1 -- 172.21.15.84:0/2161595247 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f51500844a0 con 0x7f51581595a0 2023-10-06T03:25:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.640+0000 7f515659c700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5138066f30 0x7f51380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.640+0000 7f515659c700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5138066f30 0x7f51380693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5148009fd0 tx=0x7f5148015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.644+0000 7f514effd700 1 -- 172.21.15.84:0/2161595247 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5150051470 con 0x7f51581595a0 2023-10-06T03:25:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.828+0000 7f515cafc700 1 -- 172.21.15.84:0/2161595247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f515815a600 con 0x7f51581595a0 2023-10-06T03:25:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.829+0000 7f514effd700 1 -- 172.21.15.84:0/2161595247 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f515815a600 con 0x7f51581595a0 2023-10-06T03:25:57.831 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:25:57.831 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":62,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:25:46.997828+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:25:43.021239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T03:25:44.339383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 -- 172.21.15.84:0/2161595247 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5138066f30 msgr2=0x7f51380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5138066f30 0x7f51380693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5148009fd0 tx=0x7f5148015000 comp rx=0 tx=0).stop 2023-10-06T03:25:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 -- 172.21.15.84:0/2161595247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 msgr2=0x7f5158158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 0x7f5158158bc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f515000bbe0 tx=0x7f5150009840 comp rx=0 tx=0).stop 2023-10-06T03:25:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 -- 172.21.15.84:0/2161595247 shutdown_connections 2023-10-06T03:25:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5138066f30 0x7f51380693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51581595a0 0x7f5158158bc0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51580b07a0 0x7f5158156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 --2- 172.21.15.84:0/2161595247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51580b49e0 0x7f5158158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 -- 172.21.15.84:0/2161595247 >> 172.21.15.84:0/2161595247 conn(0x7f5158099830 msgr2=0x7f5158069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 -- 172.21.15.84:0/2161595247 shutdown_connections 2023-10-06T03:25:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.831+0000 7f515cafc700 1 -- 172.21.15.84:0/2161595247 wait complete. 2023-10-06T03:25:57.845 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:25:57.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.959+0000 7f1446fe6700 1 Processor -- start 2023-10-06T03:25:57.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.959+0000 7f1446fe6700 1 -- start start 2023-10-06T03:25:57.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.959+0000 7f1446fe6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b49e0 0x7f14400aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1446fe6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f14400b07a0 0x7f14400b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1446fe6700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14400b0ca0 con 0x7f14401595a0 2023-10-06T03:25:57.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1446fe6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400b0f80 con 0x7f14400b07a0 2023-10-06T03:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1446fe6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400b1260 con 0x7f14400b49e0 2023-10-06T03:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1437fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b49e0 0x7f14400aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1445583700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f14400b07a0 0x7f14400b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1437fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b49e0 0x7f14400aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55270/0 (socket says 172.21.15.84:55270) 2023-10-06T03:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1437fff700 1 -- 172.21.15.84:0/3593039385 learned_addr learned my addr 172.21.15.84:0/3593039385 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1437fff700 1 -- 172.21.15.84:0/3593039385 >> v2:172.21.15.131:3300/0 conn(0x7f14400b07a0 msgr2=0x7f14400b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1437fff700 1 --2- 172.21.15.84:0/3593039385 >> v2:172.21.15.131:3300/0 conn(0x7f14400b07a0 0x7f14400b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1437fff700 1 -- 172.21.15.84:0/3593039385 >> v1:172.21.15.131:6789/0 conn(0x7f14401595a0 legacy=0x7f14400aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.960+0000 7f1437fff700 1 -- 172.21.15.84:0/3593039385 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400b1540 con 0x7f14400b49e0 2023-10-06T03:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f1437fff700 1 --2- 172.21.15.84:0/3593039385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b49e0 0x7f14400aac80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14300099b0 tx=0x7f1430009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddc5aa4a414acd02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:57.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f14377fe700 1 -- 172.21.15.84:0/3593039385 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430009ea0 con 0x7f14400b49e0 2023-10-06T03:25:57.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f14377fe700 1 -- 172.21.15.84:0/3593039385 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000b860 con 0x7f14400b49e0 2023-10-06T03:25:57.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f14377fe700 1 -- 172.21.15.84:0/3593039385 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000bc00 con 0x7f14400b49e0 2023-10-06T03:25:57.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f1446fe6700 1 -- 172.21.15.84:0/3593039385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b49e0 msgr2=0x7f14400aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f1446fe6700 1 --2- 172.21.15.84:0/3593039385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b49e0 0x7f14400aac80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14300099b0 tx=0x7f1430009250 comp rx=0 tx=0).stop 2023-10-06T03:25:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f1446fe6700 1 -- 172.21.15.84:0/3593039385 shutdown_connections 2023-10-06T03:25:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f1446fe6700 1 --2- 172.21.15.84:0/3593039385 >> v2:172.21.15.131:3300/0 conn(0x7f14400b07a0 0x7f14400b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f1446fe6700 1 --2- 172.21.15.84:0/3593039385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b49e0 0x7f14400aac80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f1446fe6700 1 -- 172.21.15.84:0/3593039385 >> 172.21.15.84:0/3593039385 conn(0x7f1440099830 msgr2=0x7f144006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f1446fe6700 1 -- 172.21.15.84:0/3593039385 shutdown_connections 2023-10-06T03:25:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.961+0000 7f1446fe6700 1 -- 172.21.15.84:0/3593039385 wait complete. 2023-10-06T03:25:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.962+0000 7f1446fe6700 1 Processor -- start 2023-10-06T03:25:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.963+0000 7f1446fe6700 1 -- start start 2023-10-06T03:25:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.963+0000 7f1446fe6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b07a0 0x7f14400ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.963+0000 7f1446fe6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14400b49e0 0x7f14400ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.963+0000 7f1446fe6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14401595a0 0x7f1440169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.963+0000 7f1446fe6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400af640 con 0x7f14400b49e0 2023-10-06T03:25:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.963+0000 7f1446fe6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400ace40 con 0x7f14401595a0 2023-10-06T03:25:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.963+0000 7f1446fe6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400aeac0 con 0x7f14400b07a0 2023-10-06T03:25:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.963+0000 7f1437fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14400b49e0 0x7f14400ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.963+0000 7f1437fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14400b49e0 0x7f14400ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56326/0 (socket says 172.21.15.84:56326) 2023-10-06T03:25:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.963+0000 7f1437fff700 1 -- 172.21.15.84:0/4070669227 learned_addr learned my addr 172.21.15.84:0/4070669227 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1445583700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14401595a0 0x7f1440169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1444d82700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b07a0 0x7f14400ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1437fff700 1 -- 172.21.15.84:0/4070669227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b07a0 msgr2=0x7f14400ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1437fff700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b07a0 0x7f14400ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1437fff700 1 -- 172.21.15.84:0/4070669227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14401595a0 msgr2=0x7f1440169fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1437fff700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14401595a0 0x7f1440169fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1437fff700 1 -- 172.21.15.84:0/4070669227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300094f0 con 0x7f14400b49e0 2023-10-06T03:25:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1437fff700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14400b49e0 0x7f14400ae200 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f14400b13a0 tx=0x7f1430017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1434ff9700 1 -- 172.21.15.84:0/4070669227 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430000d10 con 0x7f14400b49e0 2023-10-06T03:25:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1434ff9700 1 -- 172.21.15.84:0/4070669227 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000bbe0 con 0x7f14400b49e0 2023-10-06T03:25:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1446fe6700 1 -- 172.21.15.84:0/4070669227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14400aeda0 con 0x7f14400b49e0 2023-10-06T03:25:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1434ff9700 1 -- 172.21.15.84:0/4070669227 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430011670 con 0x7f14400b49e0 2023-10-06T03:25:57.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.964+0000 7f1446fe6700 1 -- 172.21.15.84:0/4070669227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14400af130 con 0x7f14400b49e0 2023-10-06T03:25:57.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.965+0000 7f1446fe6700 1 -- 172.21.15.84:0/4070669227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144009c7c0 con 0x7f14400b49e0 2023-10-06T03:25:57.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.965+0000 7f1434ff9700 1 -- 172.21.15.84:0/4070669227 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1430011aa0 con 0x7f14400b49e0 2023-10-06T03:25:57.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.966+0000 7f1434ff9700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f142c066f30 0x7f142c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:57.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.966+0000 7f1444d82700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f142c066f30 0x7f142c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:57.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.966+0000 7f1434ff9700 1 -- 172.21.15.84:0/4070669227 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1430085fe0 con 0x7f14400b49e0 2023-10-06T03:25:57.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.966+0000 7f1444d82700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f142c066f30 0x7f142c0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c580 tx=0x7f143c001a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:57.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:57.970+0000 7f1434ff9700 1 -- 172.21.15.84:0/4070669227 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1430052fb0 con 0x7f14400b49e0 2023-10-06T03:25:58.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.197+0000 7f1446fe6700 1 -- 172.21.15.84:0/4070669227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1440064ad0 con 0x7f14400b49e0 2023-10-06T03:25:58.199 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:25:58.198+0000 7f573ff98700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:25:58.203 INFO:tasks.ceph.mds.c.smithi084.stderr: -568> 2023-10-06T03:25:50.282+0000 7f20b6469700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:25:58.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.205+0000 7f1434ff9700 1 -- 172.21.15.84:0/4070669227 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f14300565d0 con 0x7f14400b49e0 2023-10-06T03:25:58.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 -- 172.21.15.84:0/4070669227 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f142c066f30 msgr2=0x7f142c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:58.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f142c066f30 0x7f142c0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c580 tx=0x7f143c001a80 comp rx=0 tx=0).stop 2023-10-06T03:25:58.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 -- 172.21.15.84:0/4070669227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14400b49e0 msgr2=0x7f14400ae200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:58.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14400b49e0 0x7f14400ae200 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f14400b13a0 tx=0x7f1430017000 comp rx=0 tx=0).stop 2023-10-06T03:25:58.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 -- 172.21.15.84:0/4070669227 shutdown_connections 2023-10-06T03:25:58.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f142c066f30 0x7f142c0693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:58.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14401595a0 0x7f1440169fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:58.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14400b07a0 0x7f14400ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:58.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 --2- 172.21.15.84:0/4070669227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14400b49e0 0x7f14400ae200 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:58.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 -- 172.21.15.84:0/4070669227 >> 172.21.15.84:0/4070669227 conn(0x7f1440099830 msgr2=0x7f1440069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:58.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 -- 172.21.15.84:0/4070669227 shutdown_connections 2023-10-06T03:25:58.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.207+0000 7f1446fe6700 1 -- 172.21.15.84:0/4070669227 wait complete. 2023-10-06T03:25:58.211 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:25:58.221 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:25:58.224 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:25:58.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.335+0000 7f1c40c20700 1 Processor -- start 2023-10-06T03:25:58.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.335+0000 7f1c40c20700 1 -- start start 2023-10-06T03:25:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c40c20700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1c3c069d50 0x7f1c3c0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c40c20700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3c06ae00 con 0x7f1c3c157240 2023-10-06T03:25:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c40c20700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3c0c9e00 con 0x7f1c3c0afd30 2023-10-06T03:25:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c40c20700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3c0b0120 con 0x7f1c3c069d50 2023-10-06T03:25:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c39d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1c3c069d50 0x7f1c3c0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c3a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1c3c157240 0x7f1c3c0b2280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49470/0 (socket says 172.21.15.84:49470) 2023-10-06T03:25:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c3a59c700 1 -- 172.21.15.84:0/475715491 learned_addr learned my addr 172.21.15.84:0/475715491 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:25:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c39d9b700 1 -- 172.21.15.84:0/475715491 >> v1:172.21.15.131:6789/0 conn(0x7f1c3c0afd30 legacy=0x7f1c3c0677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c39d9b700 1 -- 172.21.15.84:0/475715491 >> v1:172.21.15.84:6789/0 conn(0x7f1c3c157240 legacy=0x7f1c3c0b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c39d9b700 1 -- 172.21.15.84:0/475715491 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c06a1f0 con 0x7f1c3c069d50 2023-10-06T03:25:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c3959a700 1 -- 172.21.15.84:0/475715491 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952789307 0 0) 0x7f1c3c06ae00 con 0x7f1c3c157240 2023-10-06T03:25:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c39d9b700 1 --2- 172.21.15.84:0/475715491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c069d50 0x7f1c3c0af7f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1c300098e0 tx=0x7f1c300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41215364e18d1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.336+0000 7f1c3959a700 1 -- 172.21.15.84:0/475715491 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30009e80 con 0x7f1c3c069d50 2023-10-06T03:25:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.337+0000 7f1c3959a700 1 -- 172.21.15.84:0/475715491 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3000b820 con 0x7f1c3c069d50 2023-10-06T03:25:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.337+0000 7f1c3959a700 1 -- 172.21.15.84:0/475715491 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000bba0 con 0x7f1c3c069d50 2023-10-06T03:25:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.337+0000 7f1c40c20700 1 -- 172.21.15.84:0/475715491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c069d50 msgr2=0x7f1c3c0af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.337+0000 7f1c40c20700 1 --2- 172.21.15.84:0/475715491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c069d50 0x7f1c3c0af7f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1c300098e0 tx=0x7f1c300091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.337+0000 7f1c40c20700 1 -- 172.21.15.84:0/475715491 shutdown_connections 2023-10-06T03:25:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.337+0000 7f1c40c20700 1 --2- 172.21.15.84:0/475715491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c069d50 0x7f1c3c0af7f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.337+0000 7f1c40c20700 1 -- 172.21.15.84:0/475715491 >> 172.21.15.84:0/475715491 conn(0x7f1c3c0cd430 msgr2=0x7f1c3c0c93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.337+0000 7f1c40c20700 1 -- 172.21.15.84:0/475715491 shutdown_connections 2023-10-06T03:25:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.337+0000 7f1c40c20700 1 -- 172.21.15.84:0/475715491 wait complete. 2023-10-06T03:25:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.338+0000 7f1c40c20700 1 Processor -- start 2023-10-06T03:25:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.338+0000 7f1c40c20700 1 -- start start 2023-10-06T03:25:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c40c20700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c3c069d50 0x7f1c3c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c40c20700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c3c0afd30 0x7f1c3c0c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c40c20700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c157240 0x7f1c3c0c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c40c20700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c153360 con 0x7f1c3c157240 2023-10-06T03:25:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c40c20700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0c3640 con 0x7f1c3c0afd30 2023-10-06T03:25:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c40c20700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0c4850 con 0x7f1c3c069d50 2023-10-06T03:25:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c3ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c157240 0x7f1c3c0c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c3ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c157240 0x7f1c3c0c20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56364/0 (socket says 172.21.15.84:56364) 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c3ad9d700 1 -- 172.21.15.84:0/580695607 learned_addr learned my addr 172.21.15.84:0/580695607 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c3ad9d700 1 -- 172.21.15.84:0/580695607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c3c069d50 msgr2=0x7f1c3c150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c3ad9d700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c3c069d50 0x7f1c3c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c3ad9d700 1 -- 172.21.15.84:0/580695607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c3c0afd30 msgr2=0x7f1c3c0c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c3ad9d700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c3c0afd30 0x7f1c3c0c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c3ad9d700 1 -- 172.21.15.84:0/580695607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c30009420 con 0x7f1c3c157240 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.339+0000 7f1c3ad9d700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c157240 0x7f1c3c0c20d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400c960 tx=0x7f1c340026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.340+0000 7f1c2a7fc700 1 -- 172.21.15.84:0/580695607 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400cea0 con 0x7f1c3c157240 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.340+0000 7f1c2a7fc700 1 -- 172.21.15.84:0/580695607 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3400a7a0 con 0x7f1c3c157240 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.340+0000 7f1c40c20700 1 -- 172.21.15.84:0/580695607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c152da0 con 0x7f1c3c157240 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.340+0000 7f1c2a7fc700 1 -- 172.21.15.84:0/580695607 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400ab40 con 0x7f1c3c157240 2023-10-06T03:25:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.340+0000 7f1c40c20700 1 -- 172.21.15.84:0/580695607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c0c44e0 con 0x7f1c3c157240 2023-10-06T03:25:58.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.340+0000 7f1c40c20700 1 -- 172.21.15.84:0/580695607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c064ad0 con 0x7f1c3c157240 2023-10-06T03:25:58.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.341+0000 7f1c2a7fc700 1 -- 172.21.15.84:0/580695607 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c34012420 con 0x7f1c3c157240 2023-10-06T03:25:58.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.341+0000 7f1c2a7fc700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1c1c066f30 0x7f1c1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:58.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.341+0000 7f1c2a7fc700 1 -- 172.21.15.84:0/580695607 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f1c34084c40 con 0x7f1c3c157240 2023-10-06T03:25:58.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.341+0000 7f1c3a59c700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1c1c066f30 0x7f1c1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:58.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.342+0000 7f1c3a59c700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1c1c066f30 0x7f1c1c0693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c001660 tx=0x7f1c2c007bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:58.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.345+0000 7f1c2a7fc700 1 -- 172.21.15.84:0/580695607 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c34051bc0 con 0x7f1c3c157240 2023-10-06T03:25:58.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:58.571+0000 7f1c40c20700 1 -- 172.21.15.84:0/580695607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1c3c0c4990 con 0x7f1c3c157240 2023-10-06T03:25:59.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.204+0000 7f1c2a7fc700 1 -- 172.21.15.84:0/580695607 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1c340551e0 con 0x7f1c3c157240 2023-10-06T03:25:59.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 -- 172.21.15.84:0/580695607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1c1c066f30 msgr2=0x7f1c1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:59.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1c1c066f30 0x7f1c1c0693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c001660 tx=0x7f1c2c007bd0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 -- 172.21.15.84:0/580695607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c157240 msgr2=0x7f1c3c0c20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:59.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c157240 0x7f1c3c0c20d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400c960 tx=0x7f1c340026e0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 -- 172.21.15.84:0/580695607 shutdown_connections 2023-10-06T03:25:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1c1c066f30 0x7f1c1c0693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c3c157240 0x7f1c3c0c20d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c3c069d50 0x7f1c3c150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 --2- 172.21.15.84:0/580695607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c3c0afd30 0x7f1c3c0c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 -- 172.21.15.84:0/580695607 >> 172.21.15.84:0/580695607 conn(0x7f1c3c0cd430 msgr2=0x7f1c3c0cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 -- 172.21.15.84:0/580695607 shutdown_connections 2023-10-06T03:25:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.207+0000 7f1c40c20700 1 -- 172.21.15.84:0/580695607 wait complete. 2023-10-06T03:25:59.221 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.378+0000 7f7ee26ab700 1 Processor -- start 2023-10-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.378+0000 7f7ee26ab700 1 -- start start 2023-10-06T03:25:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.378+0000 7f7ee26ab700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7edc0cd3d0 0x7f7edc0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.378+0000 7f7ee26ab700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7edc0cba70 0x7f7edc0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.378+0000 7f7ee26ab700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc0d01b0 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.378+0000 7f7ee26ab700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc0cbeb0 con 0x7f7edc0cba70 2023-10-06T03:25:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.378+0000 7f7ee26ab700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0cf5a0 con 0x7f7edc0cd3d0 2023-10-06T03:25:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7ee0c48700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7edc0cba70 0x7f7edc0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7ee0c48700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7edc0cba70 0x7f7edc0ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56366/0 (socket says 172.21.15.84:56366) 2023-10-06T03:25:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7ee0c48700 1 -- 172.21.15.84:0/2475454063 learned_addr learned my addr 172.21.15.84:0/2475454063 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7ee0c48700 1 -- 172.21.15.84:0/2475454063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7edc0cd3d0 msgr2=0x7f7edc0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7ee0c48700 1 --2- 172.21.15.84:0/2475454063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7edc0cd3d0 0x7f7edc0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7ee0c48700 1 -- 172.21.15.84:0/2475454063 >> v1:172.21.15.131:6789/0 conn(0x7f7edc0cd7a0 legacy=0x7f7edc0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7ee0c48700 1 -- 172.21.15.84:0/2475454063 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0cf880 con 0x7f7edc0cba70 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7ee0c48700 1 --2- 172.21.15.84:0/2475454063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cba70 0x7f7edc0ceec0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009f20 tx=0x7f7ed4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74711dcd8b310aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7edaffd700 1 -- 172.21.15.84:0/2475454063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400e070 con 0x7f7edc0cba70 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7edaffd700 1 -- 172.21.15.84:0/2475454063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed400ba40 con 0x7f7edc0cba70 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.379+0000 7f7edaffd700 1 -- 172.21.15.84:0/2475454063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40092e0 con 0x7f7edc0cba70 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.380+0000 7f7ee26ab700 1 -- 172.21.15.84:0/2475454063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cba70 msgr2=0x7f7edc0ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.380+0000 7f7ee26ab700 1 --2- 172.21.15.84:0/2475454063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cba70 0x7f7edc0ceec0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009f20 tx=0x7f7ed4009840 comp rx=0 tx=0).stop 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.380+0000 7f7ee26ab700 1 -- 172.21.15.84:0/2475454063 shutdown_connections 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.380+0000 7f7ee26ab700 1 --2- 172.21.15.84:0/2475454063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cba70 0x7f7edc0ceec0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.380+0000 7f7ee26ab700 1 --2- 172.21.15.84:0/2475454063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7edc0cd3d0 0x7f7edc0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.380+0000 7f7ee26ab700 1 -- 172.21.15.84:0/2475454063 >> 172.21.15.84:0/2475454063 conn(0x7f7edc089e90 msgr2=0x7f7edc0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:59.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.380+0000 7f7ee26ab700 1 -- 172.21.15.84:0/2475454063 shutdown_connections 2023-10-06T03:25:59.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.380+0000 7f7ee26ab700 1 -- 172.21.15.84:0/2475454063 wait complete. 2023-10-06T03:25:59.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.381+0000 7f7ee26ab700 1 Processor -- start 2023-10-06T03:25:59.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.381+0000 7f7ee26ab700 1 -- start start 2023-10-06T03:25:59.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee26ab700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7edc0cba70 0x7f7edc0af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee26ab700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7edc0cd3d0 0x7f7edc1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee26ab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cd7a0 0x7f7edc169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee26ab700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0b3280 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee26ab700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc154710 con 0x7f7edc0cd3d0 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee26ab700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc1549b0 con 0x7f7edc0cba70 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee0c48700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cd7a0 0x7f7edc169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee0c48700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cd7a0 0x7f7edc169d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56372/0 (socket says 172.21.15.84:56372) 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee0c48700 1 -- 172.21.15.84:0/1160630179 learned_addr learned my addr 172.21.15.84:0/1160630179 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7edbfff700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7edc0cba70 0x7f7edc0af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7edb7fe700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7edc0cd3d0 0x7f7edc1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee0c48700 1 -- 172.21.15.84:0/1160630179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7edc0cba70 msgr2=0x7f7edc0af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee0c48700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7edc0cba70 0x7f7edc0af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee0c48700 1 -- 172.21.15.84:0/1160630179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7edc0cd3d0 msgr2=0x7f7edc1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee0c48700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7edc0cd3d0 0x7f7edc1541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee0c48700 1 -- 172.21.15.84:0/1160630179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009ae0 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7edb7fe700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7edc0cd3d0 0x7f7edc1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee0c48700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cd7a0 0x7f7edc169d70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7edc067fd0 tx=0x7f7ed4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ec3fff700 1 -- 172.21.15.84:0/1160630179 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40092e0 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ec3fff700 1 -- 172.21.15.84:0/1160630179 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4012db0 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee26ab700 1 -- 172.21.15.84:0/1160630179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc154c90 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ec3fff700 1 -- 172.21.15.84:0/1160630179 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed401d650 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.382+0000 7f7ee26ab700 1 -- 172.21.15.84:0/1160630179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc155020 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.383+0000 7f7ee26ab700 1 -- 172.21.15.84:0/1160630179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc158540 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.384+0000 7f7ec3fff700 1 -- 172.21.15.84:0/1160630179 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ed401d9c0 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.384+0000 7f7ec3fff700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ec8066f30 0x7f7ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.385+0000 7f7ec3fff700 1 -- 172.21.15.84:0/1160630179 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7ed40864e0 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.385+0000 7f7edbfff700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ec8066f30 0x7f7ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.385+0000 7f7edbfff700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ec8066f30 0x7f7ec80693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009b40 tx=0x7f7ecc0090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.388+0000 7f7ec3fff700 1 -- 172.21.15.84:0/1160630179 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ed4053460 con 0x7f7edc0cd7a0 2023-10-06T03:25:59.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:25:59.571+0000 7f7ee26ab700 1 -- 172.21.15.84:0/1160630179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7edc05f270 con 0x7f7edc0cd7a0 2023-10-06T03:26:00.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.208+0000 7f7ec3fff700 1 -- 172.21.15.84:0/1160630179 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v64) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7ed4056a80 con 0x7f7edc0cd7a0 2023-10-06T03:26:00.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 -- 172.21.15.84:0/1160630179 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ec8066f30 msgr2=0x7f7ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:00.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ec8066f30 0x7f7ec80693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009b40 tx=0x7f7ecc0090f0 comp rx=0 tx=0).stop 2023-10-06T03:26:00.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 -- 172.21.15.84:0/1160630179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cd7a0 msgr2=0x7f7edc169d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:00.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cd7a0 0x7f7edc169d70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7edc067fd0 tx=0x7f7ed4017000 comp rx=0 tx=0).stop 2023-10-06T03:26:00.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 -- 172.21.15.84:0/1160630179 shutdown_connections 2023-10-06T03:26:00.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7ec8066f30 0x7f7ec80693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:00.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7edc0cd7a0 0x7f7edc169d70 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:00.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7edc0cba70 0x7f7edc0af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:00.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 --2- 172.21.15.84:0/1160630179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7edc0cd3d0 0x7f7edc1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:00.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 -- 172.21.15.84:0/1160630179 >> 172.21.15.84:0/1160630179 conn(0x7f7edc089e90 msgr2=0x7f7edc069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:00.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 -- 172.21.15.84:0/1160630179 shutdown_connections 2023-10-06T03:26:00.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.212+0000 7f7ee26ab700 1 -- 172.21.15.84:0/1160630179 wait complete. 2023-10-06T03:26:00.216 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:26:00.228 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:26:00.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.348+0000 7fa2ac2d6700 1 Processor -- start 2023-10-06T03:26:00.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.348+0000 7fa2ac2d6700 1 -- start start 2023-10-06T03:26:00.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2ac2d6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 0x7fa2a40b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:00.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2ac2d6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2a40aee20 0x7fa2a40af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:00.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2ac2d6700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a40b2810 con 0x7fa2a406ed20 2023-10-06T03:26:00.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2ac2d6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a406fb80 con 0x7fa2a40aee20 2023-10-06T03:26:00.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2ac2d6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40b2d20 con 0x7fa2a40b23a0 2023-10-06T03:26:00.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2aa873700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2a40aee20 0x7fa2a40af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2aa873700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2a40aee20 0x7fa2a40af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56382/0 (socket says 172.21.15.84:56382) 2023-10-06T03:26:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2aa873700 1 -- 172.21.15.84:0/2226718518 learned_addr learned my addr 172.21.15.84:0/2226718518 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2a9871700 1 --2- 172.21.15.84:0/2226718518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 0x7fa2a40b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2aa873700 1 -- 172.21.15.84:0/2226718518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 msgr2=0x7fa2a40b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2aa873700 1 --2- 172.21.15.84:0/2226718518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 0x7fa2a40b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.349+0000 7fa2aa873700 1 -- 172.21.15.84:0/2226718518 >> v1:172.21.15.131:6789/0 conn(0x7fa2a406ed20 legacy=0x7fa2a406f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2aa873700 1 -- 172.21.15.84:0/2226718518 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a40b0450 con 0x7fa2a40aee20 2023-10-06T03:26:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2a9871700 1 --2- 172.21.15.84:0/2226718518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 0x7fa2a40b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2aa873700 1 --2- 172.21.15.84:0/2226718518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 0x7fa2a40af280 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009f20 tx=0x7fa29c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a727749d821706ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2a9070700 1 -- 172.21.15.84:0/2226718518 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00e070 con 0x7fa2a40aee20 2023-10-06T03:26:00.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2a9070700 1 -- 172.21.15.84:0/2226718518 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c00ba40 con 0x7fa2a40aee20 2023-10-06T03:26:00.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2a9070700 1 -- 172.21.15.84:0/2226718518 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0092e0 con 0x7fa2a40aee20 2023-10-06T03:26:00.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/2226718518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 msgr2=0x7fa2a40af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:00.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2ac2d6700 1 --2- 172.21.15.84:0/2226718518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 0x7fa2a40af280 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009f20 tx=0x7fa29c009840 comp rx=0 tx=0).stop 2023-10-06T03:26:00.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/2226718518 shutdown_connections 2023-10-06T03:26:00.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2ac2d6700 1 --2- 172.21.15.84:0/2226718518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 0x7fa2a40af280 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:00.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2ac2d6700 1 --2- 172.21.15.84:0/2226718518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 0x7fa2a40b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:00.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/2226718518 >> 172.21.15.84:0/2226718518 conn(0x7fa2a4068330 msgr2=0x7fa2a4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:00.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.350+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/2226718518 shutdown_connections 2023-10-06T03:26:00.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.351+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/2226718518 wait complete. 2023-10-06T03:26:00.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2ac2d6700 1 Processor -- start 2023-10-06T03:26:00.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2ac2d6700 1 -- start start 2023-10-06T03:26:00.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2ac2d6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2a406ed20 0x7fa2a41557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:00.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2ac2d6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 0x7fa2a40c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:00.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2ac2d6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 0x7fa2a40c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:00.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2ac2d6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a41594d0 con 0x7fa2a40aee20 2023-10-06T03:26:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2ac2d6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a415bf30 con 0x7fa2a406ed20 2023-10-06T03:26:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2ac2d6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a415c210 con 0x7fa2a40b23a0 2023-10-06T03:26:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2a9871700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 0x7fa2a40c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2a9871700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 0x7fa2a40c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56392/0 (socket says 172.21.15.84:56392) 2023-10-06T03:26:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.352+0000 7fa2a9871700 1 -- 172.21.15.84:0/725572549 learned_addr learned my addr 172.21.15.84:0/725572549 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2aa072700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2a406ed20 0x7fa2a41557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2aa873700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 0x7fa2a40c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2a9871700 1 -- 172.21.15.84:0/725572549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 msgr2=0x7fa2a40c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2a9871700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 0x7fa2a40c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2a9871700 1 -- 172.21.15.84:0/725572549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2a406ed20 msgr2=0x7fa2a41557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2a9871700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2a406ed20 0x7fa2a41557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2a9871700 1 -- 172.21.15.84:0/725572549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c009ae0 con 0x7fa2a40aee20 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2aa072700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2a406ed20 0x7fa2a41557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2a9871700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 0x7fa2a40c9630 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c830 tx=0x7fa294008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa29a7fc700 1 -- 172.21.15.84:0/725572549 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294011600 con 0x7fa2a40aee20 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa29a7fc700 1 -- 172.21.15.84:0/725572549 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294011760 con 0x7fa2a40aee20 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa29a7fc700 1 -- 172.21.15.84:0/725572549 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294011b20 con 0x7fa2a40aee20 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/725572549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a415c4f0 con 0x7fa2a40aee20 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.353+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/725572549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a416ad70 con 0x7fa2a40aee20 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.354+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/725572549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a4064ad0 con 0x7fa2a40aee20 2023-10-06T03:26:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.354+0000 7fa29a7fc700 1 -- 172.21.15.84:0/725572549 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa29400a3e0 con 0x7fa2a40aee20 2023-10-06T03:26:00.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.355+0000 7fa29a7fc700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa288066f30 0x7fa2880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:00.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.355+0000 7fa2aa072700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa288066f30 0x7fa2880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:00.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.355+0000 7fa29a7fc700 1 -- 172.21.15.84:0/725572549 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6026+0+0 (secure 0 0 0) 0x7fa294084b80 con 0x7fa2a40aee20 2023-10-06T03:26:00.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.355+0000 7fa2aa072700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa288066f30 0x7fa2880693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0006fd0 tx=0x7fa2a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:00.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.359+0000 7fa29a7fc700 1 -- 172.21.15.84:0/725572549 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa294051cb0 con 0x7fa2a40aee20 2023-10-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:00.540+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/725572549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa2a4159610 con 0x7fa2a40aee20 2023-10-06T03:26:01.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.215+0000 7fa29a7fc700 1 -- 172.21.15.84:0/725572549 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v65) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa2940150d0 con 0x7fa2a40aee20 2023-10-06T03:26:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/725572549 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa288066f30 msgr2=0x7fa2880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa288066f30 0x7fa2880693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0006fd0 tx=0x7fa2a0008040 comp rx=0 tx=0).stop 2023-10-06T03:26:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/725572549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 msgr2=0x7fa2a40c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 0x7fa2a40c9630 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c830 tx=0x7fa294008040 comp rx=0 tx=0).stop 2023-10-06T03:26:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/725572549 shutdown_connections 2023-10-06T03:26:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa288066f30 0x7fa2880693e0 secure :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0006fd0 tx=0x7fa2a0008040 comp rx=0 tx=0).stop 2023-10-06T03:26:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2a406ed20 0x7fa2a41557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2a40b23a0 0x7fa2a40c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 --2- 172.21.15.84:0/725572549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a40aee20 0x7fa2a40c9630 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/725572549 >> 172.21.15.84:0/725572549 conn(0x7fa2a4068330 msgr2=0x7fa2a40d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/725572549 shutdown_connections 2023-10-06T03:26:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.219+0000 7fa2ac2d6700 1 -- 172.21.15.84:0/725572549 wait complete. 2023-10-06T03:26:01.223 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T03:26:01.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:26:01.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.350+0000 7f9e3f015700 1 Processor -- start 2023-10-06T03:26:01.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.350+0000 7f9e3f015700 1 -- start start 2023-10-06T03:26:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e3f015700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9e380b2a90 0x7f9e380cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e3f015700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e380cb980 0x7f9e380ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e3f015700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380cbdf0 con 0x7f9e380ced90 2023-10-06T03:26:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e3f015700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e380b2e60 con 0x7f9e380b2a90 2023-10-06T03:26:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e3f015700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380cf5d0 con 0x7f9e380cb980 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e3d5b2700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9e380ced90 0x7f9e380c5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55178/0 (socket says 172.21.15.84:55178) 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e3d5b2700 1 -- 172.21.15.84:0/1848690393 learned_addr learned my addr 172.21.15.84:0/1848690393 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268619874 0 0) 0x7f9e380cbdf0 con 0x7f9e380ced90 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e3cdb1700 1 --2- 172.21.15.84:0/1848690393 >> v2:172.21.15.131:3300/0 conn(0x7f9e380b2a90 0x7f9e380cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e37fff700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e380cb980 0x7f9e380ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.351+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e28003570 con 0x7f9e380ced90 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308364625 0 0) 0x7f9e28003570 con 0x7f9e380ced90 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e380cb980 msgr2=0x7f9e380ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e380cb980 0x7f9e380ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 >> v2:172.21.15.131:3300/0 conn(0x7f9e380b2a90 msgr2=0x7f9e380cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 --2- 172.21.15.84:0/1848690393 >> v2:172.21.15.131:3300/0 conn(0x7f9e380b2a90 0x7f9e380cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380cf8b0 con 0x7f9e380ced90 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f9e300017f0 con 0x7f9e380ced90 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 >> v1:172.21.15.84:6789/0 conn(0x7f9e380ced90 legacy=0x7f9e380c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 0x7f9e28003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e380cb980 0x7f9e28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e28004d50 0x7f9e280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380b2e60 con 0x7f9e28003a60 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380cf5d0 con 0x7f9e28004d50 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2800ba60 con 0x7f9e380cb980 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e3cdb1700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 0x7f9e28003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e3d5b2700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e28004d50 0x7f9e280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e37fff700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e380cb980 0x7f9e28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e3cdb1700 1 -- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e380cb980 msgr2=0x7f9e28004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e3cdb1700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e380cb980 0x7f9e28004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e3cdb1700 1 -- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e28004d50 msgr2=0x7f9e280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e3cdb1700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e28004d50 0x7f9e280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e3cdb1700 1 -- 172.21.15.84:0/1848690393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28003570 con 0x7f9e28003a60 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e3d5b2700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e28004d50 0x7f9e280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e3cdb1700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 0x7f9e28003e70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009bf0 tx=0x7f9e2c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b250d2e0e761fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c005a00 con 0x7f9e28003a60 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c005b60 con 0x7f9e28003a60 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.352+0000 7f9e377fe700 1 -- 172.21.15.84:0/1848690393 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00e6b0 con 0x7f9e28003a60 2023-10-06T03:26:01.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.353+0000 7f9e3f015700 1 -- 172.21.15.84:0/1848690393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 msgr2=0x7f9e28003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.353+0000 7f9e3f015700 1 --2- 172.21.15.84:0/1848690393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 0x7f9e28003e70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009bf0 tx=0x7f9e2c009120 comp rx=0 tx=0).stop 2023-10-06T03:26:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.353+0000 7f9e3d5b2700 1 -- 172.21.15.84:0/1848690393 reap_dead start 2023-10-06T03:26:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.353+0000 7f9e3f015700 1 -- 172.21.15.84:0/1848690393 shutdown_connections 2023-10-06T03:26:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.353+0000 7f9e3f015700 1 -- 172.21.15.84:0/1848690393 >> 172.21.15.84:0/1848690393 conn(0x7f9e38099740 msgr2=0x7f9e3806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.353+0000 7f9e3f015700 1 -- 172.21.15.84:0/1848690393 shutdown_connections 2023-10-06T03:26:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.353+0000 7f9e3f015700 1 -- 172.21.15.84:0/1848690393 wait complete. 2023-10-06T03:26:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.354+0000 7f9e3f015700 1 Processor -- start 2023-10-06T03:26:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.354+0000 7f9e3f015700 1 -- start start 2023-10-06T03:26:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3f015700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 0x7f9e38150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3f015700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380cae50 0x7f9e38169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3f015700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e38169eb0 0x7f9e3816a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3f015700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38158f20 con 0x7f9e28003a60 2023-10-06T03:26:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3f015700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38150ec0 con 0x7f9e380cae50 2023-10-06T03:26:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3f015700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3816a890 con 0x7f9e38169eb0 2023-10-06T03:26:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3cdb1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 0x7f9e38150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3cdb1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 0x7f9e38150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50440/0 (socket says 172.21.15.84:50440) 2023-10-06T03:26:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3cdb1700 1 -- 172.21.15.84:0/3811378961 learned_addr learned my addr 172.21.15.84:0/3811378961 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3d5b2700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e38169eb0 0x7f9e3816a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e37fff700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380cae50 0x7f9e38169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3cdb1700 1 -- 172.21.15.84:0/3811378961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e38169eb0 msgr2=0x7f9e3816a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3cdb1700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e38169eb0 0x7f9e3816a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3cdb1700 1 -- 172.21.15.84:0/3811378961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380cae50 msgr2=0x7f9e38169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3cdb1700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380cae50 0x7f9e38169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.355+0000 7f9e3cdb1700 1 -- 172.21.15.84:0/3811378961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e381582a0 con 0x7f9e28003a60 2023-10-06T03:26:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.356+0000 7f9e3cdb1700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 0x7f9e38150980 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00e4b0 tx=0x7f9e2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.356+0000 7f9e34ff9700 1 -- 172.21.15.84:0/3811378961 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c006240 con 0x7f9e28003a60 2023-10-06T03:26:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.356+0000 7f9e34ff9700 1 -- 172.21.15.84:0/3811378961 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c0063a0 con 0x7f9e28003a60 2023-10-06T03:26:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.356+0000 7f9e34ff9700 1 -- 172.21.15.84:0/3811378961 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c006760 con 0x7f9e28003a60 2023-10-06T03:26:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.356+0000 7f9e3f015700 1 -- 172.21.15.84:0/3811378961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e38158580 con 0x7f9e28003a60 2023-10-06T03:26:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.356+0000 7f9e3f015700 1 -- 172.21.15.84:0/3811378961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e38158b40 con 0x7f9e28003a60 2023-10-06T03:26:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.357+0000 7f9e3f015700 1 -- 172.21.15.84:0/3811378961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e38159060 con 0x7f9e28003a60 2023-10-06T03:26:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.357+0000 7f9e34ff9700 1 -- 172.21.15.84:0/3811378961 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e2c013680 con 0x7f9e28003a60 2023-10-06T03:26:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.358+0000 7f9e34ff9700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.358+0000 7f9e34ff9700 1 -- 172.21.15.84:0/3811378961 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f9e2c0858a0 con 0x7f9e28003a60 2023-10-06T03:26:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.358+0000 7f9e37fff700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.358+0000 7f9e37fff700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9e381592c0 tx=0x7f9e24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.362+0000 7f9e34ff9700 1 -- 172.21.15.84:0/3811378961 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e38159060 con 0x7f9e28003a60 2023-10-06T03:26:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.545+0000 7f9e3f015700 1 -- 172.21.15.84:0/3811378961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9e38159060 con 0x7f9e28003a60 2023-10-06T03:26:01.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.548+0000 7f9e34ff9700 1 -- 172.21.15.84:0/3811378961 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9e38159060 con 0x7f9e28003a60 2023-10-06T03:26:01.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 -- 172.21.15.84:0/3811378961 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9e1c066f30 msgr2=0x7f9e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9e381592c0 tx=0x7f9e24008040 comp rx=0 tx=0).stop 2023-10-06T03:26:01.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 -- 172.21.15.84:0/3811378961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 msgr2=0x7f9e38150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 0x7f9e38150980 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00e4b0 tx=0x7f9e2c019000 comp rx=0 tx=0).stop 2023-10-06T03:26:01.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 -- 172.21.15.84:0/3811378961 shutdown_connections 2023-10-06T03:26:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e38169eb0 0x7f9e3816a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003a60 0x7f9e38150980 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 --2- 172.21.15.84:0/3811378961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380cae50 0x7f9e38169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 -- 172.21.15.84:0/3811378961 >> 172.21.15.84:0/3811378961 conn(0x7f9e38099740 msgr2=0x7f9e38151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 -- 172.21.15.84:0/3811378961 shutdown_connections 2023-10-06T03:26:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.551+0000 7f9e3f015700 1 -- 172.21.15.84:0/3811378961 wait complete. 2023-10-06T03:26:01.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2023-10-06T03:26:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.677+0000 7fed8fd1e700 1 Processor -- start 2023-10-06T03:26:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.677+0000 7fed8fd1e700 1 -- start start 2023-10-06T03:26:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.678+0000 7fed8fd1e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed880cb630 0x7fed880691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.678+0000 7fed8fd1e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed88069720 0x7fed88159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.678+0000 7fed8fd1e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed88068d50 con 0x7fed8815a050 2023-10-06T03:26:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.678+0000 7fed8fd1e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed88069b70 con 0x7fed880cb630 2023-10-06T03:26:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.678+0000 7fed8fd1e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed88154060 con 0x7fed88069720 2023-10-06T03:26:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.678+0000 7fed8e2bb700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fed8815a050 0x7fed880ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55184/0 (socket says 172.21.15.84:55184) 2023-10-06T03:26:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.678+0000 7fed8e2bb700 1 -- 172.21.15.84:0/3205410395 learned_addr learned my addr 172.21.15.84:0/3205410395 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8daba700 1 --2- 172.21.15.84:0/3205410395 >> v2:172.21.15.131:3300/0 conn(0x7fed880cb630 0x7fed880691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8d2b9700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed88069720 0x7fed88159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228658841 0 0) 0x7fed88068d50 con 0x7fed8815a050 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed74003570 con 0x7fed8815a050 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4113245507 0 0) 0x7fed74003570 con 0x7fed8815a050 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed88069720 msgr2=0x7fed88159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed88069720 0x7fed88159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 >> v2:172.21.15.131:3300/0 conn(0x7fed880cb630 msgr2=0x7fed880691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 --2- 172.21.15.84:0/3205410395 >> v2:172.21.15.131:3300/0 conn(0x7fed880cb630 0x7fed880691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8815a6b0 con 0x7fed8815a050 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fed80001470 con 0x7fed8815a050 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 >> v1:172.21.15.84:6789/0 conn(0x7fed8815a050 legacy=0x7fed880ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed74003a60 0x7fed74003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed74004810 0x7fed74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed88069720 0x7fed740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed88069b70 con 0x7fed74003a60 2023-10-06T03:26:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed88154060 con 0x7fed74004810 2023-10-06T03:26:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7400ba60 con 0x7fed88069720 2023-10-06T03:26:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8daba700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed74003a60 0x7fed74003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8d2b9700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed74004810 0x7fed74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8e2bb700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed88069720 0x7fed740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8daba700 1 -- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed88069720 msgr2=0x7fed740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8daba700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed88069720 0x7fed740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8daba700 1 -- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed74004810 msgr2=0x7fed74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8daba700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed74004810 0x7fed74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8daba700 1 -- 172.21.15.84:0/3205410395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74003570 con 0x7fed74003a60 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8e2bb700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed88069720 0x7fed740051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.679+0000 7fed8daba700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed74003a60 0x7fed74003e70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fed8400e240 tx=0x7fed8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c871433be627fe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.680+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8400eaf0 con 0x7fed74003a60 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.680+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8400f040 con 0x7fed74003a60 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.680+0000 7fed8cab8700 1 -- 172.21.15.84:0/3205410395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8400eea0 con 0x7fed74003a60 2023-10-06T03:26:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.680+0000 7fed8fd1e700 1 -- 172.21.15.84:0/3205410395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed74003a60 msgr2=0x7fed74003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.680+0000 7fed8fd1e700 1 --2- 172.21.15.84:0/3205410395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed74003a60 0x7fed74003e70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fed8400e240 tx=0x7fed8400b040 comp rx=0 tx=0).stop 2023-10-06T03:26:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.680+0000 7fed8e2bb700 1 -- 172.21.15.84:0/3205410395 reap_dead start 2023-10-06T03:26:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.680+0000 7fed8fd1e700 1 -- 172.21.15.84:0/3205410395 shutdown_connections 2023-10-06T03:26:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.680+0000 7fed8fd1e700 1 -- 172.21.15.84:0/3205410395 >> 172.21.15.84:0/3205410395 conn(0x7fed88070810 msgr2=0x7fed88070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.680+0000 7fed8fd1e700 1 -- 172.21.15.84:0/3205410395 shutdown_connections 2023-10-06T03:26:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.680+0000 7fed8fd1e700 1 -- 172.21.15.84:0/3205410395 wait complete. 2023-10-06T03:26:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.681+0000 7fed8fd1e700 1 Processor -- start 2023-10-06T03:26:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.681+0000 7fed8fd1e700 1 -- start start 2023-10-06T03:26:01.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8fd1e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed74003a60 0x7fed881507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8fd1e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed881525e0 0x7fed88152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8fd1e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed880c6970 0x7fed880c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8fd1e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed88152f90 con 0x7fed881525e0 2023-10-06T03:26:01.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8fd1e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed880c76d0 con 0x7fed74003a60 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8fd1e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed880c79b0 con 0x7fed880c6970 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8d2b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed881525e0 0x7fed88152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8d2b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed881525e0 0x7fed88152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50454/0 (socket says 172.21.15.84:50454) 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8d2b9700 1 -- 172.21.15.84:0/2703386508 learned_addr learned my addr 172.21.15.84:0/2703386508 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8daba700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed74003a60 0x7fed881507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8e2bb700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed880c6970 0x7fed880c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8d2b9700 1 -- 172.21.15.84:0/2703386508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed880c6970 msgr2=0x7fed880c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8d2b9700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed880c6970 0x7fed880c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8d2b9700 1 -- 172.21.15.84:0/2703386508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed74003a60 msgr2=0x7fed881507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8d2b9700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed74003a60 0x7fed881507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8d2b9700 1 -- 172.21.15.84:0/2703386508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed880c7c90 con 0x7fed881525e0 2023-10-06T03:26:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.682+0000 7fed8e2bb700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed880c6970 0x7fed880c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.683+0000 7fed8d2b9700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed881525e0 0x7fed88152a50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fed78011d40 tx=0x7fed780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.683+0000 7fed7dffb700 1 -- 172.21.15.84:0/2703386508 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7800fac0 con 0x7fed881525e0 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.683+0000 7fed7dffb700 1 -- 172.21.15.84:0/2703386508 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7800fc20 con 0x7fed881525e0 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.683+0000 7fed8fd1e700 1 -- 172.21.15.84:0/2703386508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed880c7f70 con 0x7fed881525e0 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.683+0000 7fed7dffb700 1 -- 172.21.15.84:0/2703386508 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed78014440 con 0x7fed881525e0 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.683+0000 7fed8fd1e700 1 -- 172.21.15.84:0/2703386508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed88150d10 con 0x7fed881525e0 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.684+0000 7fed8fd1e700 1 -- 172.21.15.84:0/2703386508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed88064ad0 con 0x7fed881525e0 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.684+0000 7fed7dffb700 1 -- 172.21.15.84:0/2703386508 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed78014870 con 0x7fed881525e0 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.685+0000 7fed7dffb700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fed6c066f30 0x7fed6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.685+0000 7fed7dffb700 1 -- 172.21.15.84:0/2703386508 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fed78018030 con 0x7fed881525e0 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.685+0000 7fed8daba700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fed6c066f30 0x7fed6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.685+0000 7fed8daba700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fed6c066f30 0x7fed6c0693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fed84009c30 tx=0x7fed8401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.689+0000 7fed7dffb700 1 -- 172.21.15.84:0/2703386508 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed78052190 con 0x7fed881525e0 2023-10-06T03:26:01.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:01.950+0000 7fed8fd1e700 1 -- 172.21.15.84:0/2703386508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) v1 -- 0x7fed881571d0 con 0x7fed881525e0 2023-10-06T03:26:02.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.215+0000 7fed7dffb700 1 -- 172.21.15.84:0/2703386508 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v144) v1 ==== 142+0+0 (secure 0 0 0) 0x7fed780557b0 con 0x7fed881525e0 2023-10-06T03:26:02.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 -- 172.21.15.84:0/2703386508 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fed6c066f30 msgr2=0x7fed6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:02.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fed6c066f30 0x7fed6c0693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fed84009c30 tx=0x7fed8401a000 comp rx=0 tx=0).stop 2023-10-06T03:26:02.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 -- 172.21.15.84:0/2703386508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed881525e0 msgr2=0x7fed88152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:02.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed881525e0 0x7fed88152a50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fed78011d40 tx=0x7fed780091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 -- 172.21.15.84:0/2703386508 shutdown_connections 2023-10-06T03:26:02.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fed6c066f30 0x7fed6c0693e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed74003a60 0x7fed881507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed880c6970 0x7fed880c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 --2- 172.21.15.84:0/2703386508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed881525e0 0x7fed88152a50 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 -- 172.21.15.84:0/2703386508 >> 172.21.15.84:0/2703386508 conn(0x7fed88070810 msgr2=0x7fed880cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:02.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 -- 172.21.15.84:0/2703386508 shutdown_connections 2023-10-06T03:26:02.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.217+0000 7fed8fd1e700 1 -- 172.21.15.84:0/2703386508 wait complete. 2023-10-06T03:26:02.231 INFO:tasks.cephfs_test_runner:test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) ... skipped 'Requires FUSE client to inject client metadata' 2023-10-06T03:26:02.231 INFO:tasks.cephfs_test_runner:Starting test: test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2023-10-06T03:26:02.231 INFO:tasks.cephfs_test_runner:test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T03:26:02.231 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2023-10-06T03:26:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.343+0000 7fa80e39a700 1 Processor -- start 2023-10-06T03:26:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.343+0000 7fa80e39a700 1 -- start start 2023-10-06T03:26:02.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.344+0000 7fa80e39a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa808159480 0x7fa8080b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:02.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.344+0000 7fa80e39a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8080cb7e0 con 0x7fa8080b2140 2023-10-06T03:26:02.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.344+0000 7fa80e39a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8080b08a0 con 0x7fa8080b3610 2023-10-06T03:26:02.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.344+0000 7fa80e39a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8080cb190 con 0x7fa808159480 2023-10-06T03:26:02.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.344+0000 7fa80db99700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa8080b2140 0x7fa8080b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55188/0 (socket says 172.21.15.84:55188) 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.344+0000 7fa80db99700 1 -- 172.21.15.84:0/771709455 learned_addr learned my addr 172.21.15.84:0/771709455 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80d398700 1 --2- 172.21.15.84:0/771709455 >> v2:172.21.15.131:3300/0 conn(0x7fa808159480 0x7fa8080b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439505827 0 0) 0x7fa8080cb7e0 con 0x7fa8080b2140 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f4003570 con 0x7fa8080b2140 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3608060814 0 0) 0x7fa7f4003570 con 0x7fa8080b2140 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 >> v2:172.21.15.131:3300/0 conn(0x7fa808159480 msgr2=0x7fa8080b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 --2- 172.21.15.84:0/771709455 >> v2:172.21.15.131:3300/0 conn(0x7fa808159480 0x7fa8080b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 >> v1:172.21.15.131:6789/0 conn(0x7fa8080b3610 legacy=0x7fa8080cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080cb470 con 0x7fa8080b2140 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fa8000017f0 con 0x7fa8080b2140 2023-10-06T03:26:02.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 >> v1:172.21.15.84:6789/0 conn(0x7fa8080b2140 legacy=0x7fa8080b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7f4003a60 0x7fa7f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa7f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7f40051c0 0x7fa7f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080cb190 con 0x7fa7f4004810 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f400c160 con 0x7fa7f4003a60 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f400c320 con 0x7fa7f40051c0 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80cb97700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa7f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80d398700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7f4003a60 0x7fa7f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80db99700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7f40051c0 0x7fa7f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80cb97700 1 -- 172.21.15.84:0/771709455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7f40051c0 msgr2=0x7fa7f400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80cb97700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7f40051c0 0x7fa7f400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80cb97700 1 -- 172.21.15.84:0/771709455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7f4003a60 msgr2=0x7fa7f4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80cb97700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7f4003a60 0x7fa7f4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80cb97700 1 -- 172.21.15.84:0/771709455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4003570 con 0x7fa7f4004810 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80db99700 1 -- 172.21.15.84:0/771709455 reap_dead start 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.345+0000 7fa80cb97700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa7f4004c80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80018e0 tx=0x7fa7f8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2a5c2adb6a6e10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.346+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8012420 con 0x7fa7f4004810 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.346+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f80125a0 con 0x7fa7f4004810 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.346+0000 7fa7fffff700 1 -- 172.21.15.84:0/771709455 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8012960 con 0x7fa7f4004810 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.346+0000 7fa80e39a700 1 -- 172.21.15.84:0/771709455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 msgr2=0x7fa7f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.346+0000 7fa80e39a700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa7f4004c80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80018e0 tx=0x7fa7f8007d30 comp rx=0 tx=0).stop 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.346+0000 7fa80e39a700 1 -- 172.21.15.84:0/771709455 shutdown_connections 2023-10-06T03:26:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.346+0000 7fa80e39a700 1 --2- 172.21.15.84:0/771709455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa7f4004c80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.346+0000 7fa80e39a700 1 -- 172.21.15.84:0/771709455 >> 172.21.15.84:0/771709455 conn(0x7fa80806ed20 msgr2=0x7fa80806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:02.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.346+0000 7fa80e39a700 1 -- 172.21.15.84:0/771709455 shutdown_connections 2023-10-06T03:26:02.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.346+0000 7fa80e39a700 1 -- 172.21.15.84:0/771709455 wait complete. 2023-10-06T03:26:02.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.347+0000 7fa80e39a700 1 Processor -- start 2023-10-06T03:26:02.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.347+0000 7fa80e39a700 1 -- start start 2023-10-06T03:26:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80e39a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa808156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80e39a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa808153d60 0x7fa808156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80e39a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa80815c300 0x7fa80815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80e39a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8081465d0 con 0x7fa7f4004810 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80e39a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa808144570 con 0x7fa808153d60 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80e39a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80815ccc0 con 0x7fa80815c300 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80d398700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa808156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80d398700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa808156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50460/0 (socket says 172.21.15.84:50460) 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80d398700 1 -- 172.21.15.84:0/3978420825 learned_addr learned my addr 172.21.15.84:0/3978420825 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80db99700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa80815c300 0x7fa80815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.348+0000 7fa80cb97700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa808153d60 0x7fa808156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa80d398700 1 -- 172.21.15.84:0/3978420825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa80815c300 msgr2=0x7fa80815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa80d398700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa80815c300 0x7fa80815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa80d398700 1 -- 172.21.15.84:0/3978420825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa808153d60 msgr2=0x7fa808156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa80d398700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa808153d60 0x7fa808156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa80d398700 1 -- 172.21.15.84:0/3978420825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa808143960 con 0x7fa7f4004810 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa80d398700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa808156850 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa804011d70 tx=0x7fa8040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa7fd7fa700 1 -- 172.21.15.84:0/3978420825 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804009700 con 0x7fa7f4004810 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa7fd7fa700 1 -- 172.21.15.84:0/3978420825 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80400fc70 con 0x7fa7f4004810 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa80e39a700 1 -- 172.21.15.84:0/3978420825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa808143c40 con 0x7fa7f4004810 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa7fd7fa700 1 -- 172.21.15.84:0/3978420825 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804014440 con 0x7fa7f4004810 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.349+0000 7fa80e39a700 1 -- 172.21.15.84:0/3978420825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa808144200 con 0x7fa7f4004810 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.350+0000 7fa80e39a700 1 -- 172.21.15.84:0/3978420825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80805f270 con 0x7fa7f4004810 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.350+0000 7fa7fd7fa700 1 -- 172.21.15.84:0/3978420825 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa804014870 con 0x7fa7f4004810 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.351+0000 7fa7fd7fa700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa7ec066f30 0x7fa7ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.351+0000 7fa7fd7fa700 1 -- 172.21.15.84:0/3978420825 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fa804018030 con 0x7fa7f4004810 2023-10-06T03:26:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.351+0000 7fa80cb97700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa7ec066f30 0x7fa7ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.351+0000 7fa80cb97700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa7ec066f30 0x7fa7ec0693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa8080cc640 tx=0x7fa7f8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.355+0000 7fa7fd7fa700 1 -- 172.21.15.84:0/3978420825 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa804052240 con 0x7fa7f4004810 2023-10-06T03:26:02.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:02.618+0000 7fa80e39a700 1 -- 172.21.15.84:0/3978420825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) v1 -- 0x7fa808159850 con 0x7fa7f4004810 2023-10-06T03:26:03.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.221+0000 7fa7fd7fa700 1 -- 172.21.15.84:0/3978420825 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v145) v1 ==== 146+0+0 (secure 0 0 0) 0x7fa8040220d0 con 0x7fa7f4004810 2023-10-06T03:26:03.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 -- 172.21.15.84:0/3978420825 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa7ec066f30 msgr2=0x7fa7ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:03.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa7ec066f30 0x7fa7ec0693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa8080cc640 tx=0x7fa7f8015000 comp rx=0 tx=0).stop 2023-10-06T03:26:03.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 -- 172.21.15.84:0/3978420825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 msgr2=0x7fa808156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:03.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa808156850 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa804011d70 tx=0x7fa8040091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 -- 172.21.15.84:0/3978420825 shutdown_connections 2023-10-06T03:26:03.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa7ec066f30 0x7fa7ec0693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa80815c300 0x7fa80815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7f4004810 0x7fa808156850 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 --2- 172.21.15.84:0/3978420825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa808153d60 0x7fa808156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 -- 172.21.15.84:0/3978420825 >> 172.21.15.84:0/3978420825 conn(0x7fa80806ed20 msgr2=0x7fa8081548c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:03.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 -- 172.21.15.84:0/3978420825 shutdown_connections 2023-10-06T03:26:03.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.224+0000 7fa80e39a700 1 -- 172.21.15.84:0/3978420825 wait complete. 2023-10-06T03:26:03.238 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:26:03.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.362+0000 7f8526e0b700 1 Processor -- start 2023-10-06T03:26:03.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.362+0000 7f8526e0b700 1 -- start start 2023-10-06T03:26:03.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8526e0b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f85200b2660 0x7f85200cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8526e0b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f85200cf1f0 0x7f85200cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8526e0b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85200cc9b0 con 0x7f85200b2a30 2023-10-06T03:26:03.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8526e0b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85200cbda0 con 0x7f85200b2660 2023-10-06T03:26:03.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8526e0b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85200cc080 con 0x7f85200cf1f0 2023-10-06T03:26:03.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8525e09700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f85200b2660 0x7f85200cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8525e09700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f85200b2660 0x7f85200cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50472/0 (socket says 172.21.15.84:50472) 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8525e09700 1 -- 172.21.15.84:0/1762885036 learned_addr learned my addr 172.21.15.84:0/1762885036 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8525e09700 1 -- 172.21.15.84:0/1762885036 >> v2:172.21.15.131:3300/0 conn(0x7f85200cf1f0 msgr2=0x7f85200cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8525e09700 1 --2- 172.21.15.84:0/1762885036 >> v2:172.21.15.131:3300/0 conn(0x7f85200cf1f0 0x7f85200cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8525e09700 1 -- 172.21.15.84:0/1762885036 >> v1:172.21.15.131:6789/0 conn(0x7f85200b2a30 legacy=0x7f85200ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8525e09700 1 -- 172.21.15.84:0/1762885036 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85200cc360 con 0x7f85200b2660 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8525e09700 1 --2- 172.21.15.84:0/1762885036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200b2660 0x7f85200cccf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f85200894b0 tx=0x7f851c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a59b91027c7c78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8524e07700 1 -- 172.21.15.84:0/1762885036 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00e070 con 0x7f85200b2660 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8524e07700 1 -- 172.21.15.84:0/1762885036 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c00ba90 con 0x7f85200b2660 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.363+0000 7f8524e07700 1 -- 172.21.15.84:0/1762885036 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c0092e0 con 0x7f85200b2660 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.364+0000 7f8526e0b700 1 -- 172.21.15.84:0/1762885036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200b2660 msgr2=0x7f85200cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:03.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.364+0000 7f8526e0b700 1 --2- 172.21.15.84:0/1762885036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200b2660 0x7f85200cccf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f85200894b0 tx=0x7f851c009840 comp rx=0 tx=0).stop 2023-10-06T03:26:03.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.364+0000 7f8526e0b700 1 -- 172.21.15.84:0/1762885036 shutdown_connections 2023-10-06T03:26:03.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.364+0000 7f8526e0b700 1 --2- 172.21.15.84:0/1762885036 >> v2:172.21.15.131:3300/0 conn(0x7f85200cf1f0 0x7f85200cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.364+0000 7f8526e0b700 1 --2- 172.21.15.84:0/1762885036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200b2660 0x7f85200cccf0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.364+0000 7f8526e0b700 1 -- 172.21.15.84:0/1762885036 >> 172.21.15.84:0/1762885036 conn(0x7f8520099560 msgr2=0x7f852006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:03.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.364+0000 7f8526e0b700 1 -- 172.21.15.84:0/1762885036 shutdown_connections 2023-10-06T03:26:03.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.364+0000 7f8526e0b700 1 -- 172.21.15.84:0/1762885036 wait complete. 2023-10-06T03:26:03.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.365+0000 7f8526e0b700 1 Processor -- start 2023-10-06T03:26:03.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.365+0000 7f8526e0b700 1 -- start start 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f8526e0b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85200b2660 0x7f8520167590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f8526e0b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85200b2a30 0x7f852016a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f8526e0b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200cf1f0 0x7f8520169210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f8526e0b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852016bc30 con 0x7f85200cf1f0 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f8526e0b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8520167ad0 con 0x7f85200b2a30 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f8526e0b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8520158040 con 0x7f85200b2660 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f852660a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200cf1f0 0x7f8520169210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f852660a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200cf1f0 0x7f8520169210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50480/0 (socket says 172.21.15.84:50480) 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f852660a700 1 -- 172.21.15.84:0/2380210973 learned_addr learned my addr 172.21.15.84:0/2380210973 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f852660a700 1 -- 172.21.15.84:0/2380210973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85200b2660 msgr2=0x7f8520167590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:03.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f852660a700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85200b2660 0x7f8520167590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f852660a700 1 -- 172.21.15.84:0/2380210973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85200b2a30 msgr2=0x7f852016a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f852660a700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85200b2a30 0x7f852016a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f852660a700 1 -- 172.21.15.84:0/2380210973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c009ae0 con 0x7f85200cf1f0 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f852660a700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200cf1f0 0x7f8520169210 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f851800b840 tx=0x7f85180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f8515ffb700 1 -- 172.21.15.84:0/2380210973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851800f510 con 0x7f85200cf1f0 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f8515ffb700 1 -- 172.21.15.84:0/2380210973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851800f670 con 0x7f85200cf1f0 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.366+0000 7f8526e0b700 1 -- 172.21.15.84:0/2380210973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852016a8c0 con 0x7f85200cf1f0 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.367+0000 7f8515ffb700 1 -- 172.21.15.84:0/2380210973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851800fa30 con 0x7f85200cf1f0 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.367+0000 7f8526e0b700 1 -- 172.21.15.84:0/2380210973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852016b300 con 0x7f85200cf1f0 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.368+0000 7f8526e0b700 1 -- 172.21.15.84:0/2380210973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852005f270 con 0x7f85200cf1f0 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.368+0000 7f8515ffb700 1 -- 172.21.15.84:0/2380210973 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f851801a400 con 0x7f85200cf1f0 2023-10-06T03:26:03.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.368+0000 7f8515ffb700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8504066f30 0x7f85040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.368+0000 7f8515ffb700 1 -- 172.21.15.84:0/2380210973 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f8518084070 con 0x7f85200cf1f0 2023-10-06T03:26:03.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.368+0000 7f8525e09700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8504066f30 0x7f85040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:03.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.369+0000 7f8525e09700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8504066f30 0x7f85040693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f85200ca250 tx=0x7f851c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:03.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.372+0000 7f8515ffb700 1 -- 172.21.15.84:0/2380210973 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85180513c0 con 0x7f85200cf1f0 2023-10-06T03:26:03.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.556+0000 7f8526e0b700 1 -- 172.21.15.84:0/2380210973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f852016bd70 con 0x7f85200cf1f0 2023-10-06T03:26:03.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.560+0000 7f8515ffb700 1 -- 172.21.15.84:0/2380210973 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f852016bd70 con 0x7f85200cf1f0 2023-10-06T03:26:03.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 -- 172.21.15.84:0/2380210973 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8504066f30 msgr2=0x7f85040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:03.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8504066f30 0x7f85040693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f85200ca250 tx=0x7f851c017000 comp rx=0 tx=0).stop 2023-10-06T03:26:03.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 -- 172.21.15.84:0/2380210973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200cf1f0 msgr2=0x7f8520169210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:03.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200cf1f0 0x7f8520169210 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f851800b840 tx=0x7f85180091d0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 -- 172.21.15.84:0/2380210973 shutdown_connections 2023-10-06T03:26:03.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8504066f30 0x7f85040693e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85200cf1f0 0x7f8520169210 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85200b2660 0x7f8520167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 --2- 172.21.15.84:0/2380210973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85200b2a30 0x7f852016a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 -- 172.21.15.84:0/2380210973 >> 172.21.15.84:0/2380210973 conn(0x7f8520099560 msgr2=0x7f8520158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:03.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 -- 172.21.15.84:0/2380210973 shutdown_connections 2023-10-06T03:26:03.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.562+0000 7f8526e0b700 1 -- 172.21.15.84:0/2380210973 wait complete. 2023-10-06T03:26:03.575 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:26:03.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:26:03.621 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:26:03.667 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:26:03.667 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:26:03.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:03.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.779+0000 7f5a8636a700 1 Processor -- start 2023-10-06T03:26:03.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.779+0000 7f5a8636a700 1 -- start start 2023-10-06T03:26:03.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a8636a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5a800b49e0 0x7f5a800aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a8636a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a800b07a0 0x7f5a800b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a8636a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a800b0ca0 con 0x7f5a801595a0 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a8636a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a800b0f80 con 0x7f5a800b07a0 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a8636a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a800b1260 con 0x7f5a800b49e0 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a84907700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a800b07a0 0x7f5a800b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a84907700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a800b07a0 0x7f5a800b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50496/0 (socket says 172.21.15.84:50496) 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a84907700 1 -- 172.21.15.84:0/2299230008 learned_addr learned my addr 172.21.15.84:0/2299230008 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a7f7fe700 1 --2- 172.21.15.84:0/2299230008 >> v2:172.21.15.131:3300/0 conn(0x7f5a800b49e0 0x7f5a800aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a84907700 1 -- 172.21.15.84:0/2299230008 >> v2:172.21.15.131:3300/0 conn(0x7f5a800b49e0 msgr2=0x7f5a800aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a84907700 1 --2- 172.21.15.84:0/2299230008 >> v2:172.21.15.131:3300/0 conn(0x7f5a800b49e0 0x7f5a800aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a84907700 1 -- 172.21.15.84:0/2299230008 >> v1:172.21.15.131:6789/0 conn(0x7f5a801595a0 legacy=0x7f5a800aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.780+0000 7f5a84907700 1 -- 172.21.15.84:0/2299230008 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a800b1540 con 0x7f5a800b07a0 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a84907700 1 --2- 172.21.15.84:0/2299230008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b07a0 0x7f5a800b1c00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009f20 tx=0x7f5a78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1678bc04475b0e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a7effd700 1 -- 172.21.15.84:0/2299230008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7800e070 con 0x7f5a800b07a0 2023-10-06T03:26:03.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a7effd700 1 -- 172.21.15.84:0/2299230008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7800ba00 con 0x7f5a800b07a0 2023-10-06T03:26:03.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a7effd700 1 -- 172.21.15.84:0/2299230008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a780092e0 con 0x7f5a800b07a0 2023-10-06T03:26:03.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a8636a700 1 -- 172.21.15.84:0/2299230008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b07a0 msgr2=0x7f5a800b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:03.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a8636a700 1 --2- 172.21.15.84:0/2299230008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b07a0 0x7f5a800b1c00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009f20 tx=0x7f5a78009840 comp rx=0 tx=0).stop 2023-10-06T03:26:03.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a8636a700 1 -- 172.21.15.84:0/2299230008 shutdown_connections 2023-10-06T03:26:03.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a8636a700 1 --2- 172.21.15.84:0/2299230008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b07a0 0x7f5a800b1c00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a8636a700 1 --2- 172.21.15.84:0/2299230008 >> v2:172.21.15.131:3300/0 conn(0x7f5a800b49e0 0x7f5a800aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a8636a700 1 -- 172.21.15.84:0/2299230008 >> 172.21.15.84:0/2299230008 conn(0x7f5a80099830 msgr2=0x7f5a8006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:03.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a8636a700 1 -- 172.21.15.84:0/2299230008 shutdown_connections 2023-10-06T03:26:03.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.781+0000 7f5a8636a700 1 -- 172.21.15.84:0/2299230008 wait complete. 2023-10-06T03:26:03.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.782+0000 7f5a8636a700 1 Processor -- start 2023-10-06T03:26:03.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.783+0000 7f5a8636a700 1 -- start start 2023-10-06T03:26:03.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.783+0000 7f5a8636a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a800b07a0 0x7f5a80158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.783+0000 7f5a8636a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b49e0 0x7f5a8015c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.783+0000 7f5a8636a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a801595a0 0x7f5a8015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.783+0000 7f5a8636a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8015b270 con 0x7f5a800b49e0 2023-10-06T03:26:03.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.783+0000 7f5a8636a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8015a660 con 0x7f5a800b07a0 2023-10-06T03:26:03.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.783+0000 7f5a8636a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8015a940 con 0x7f5a801595a0 2023-10-06T03:26:03.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.783+0000 7f5a7f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b49e0 0x7f5a8015c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:03.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.783+0000 7f5a7f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b49e0 0x7f5a8015c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50504/0 (socket says 172.21.15.84:50504) 2023-10-06T03:26:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.783+0000 7f5a7f7fe700 1 -- 172.21.15.84:0/3138970174 learned_addr learned my addr 172.21.15.84:0/3138970174 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a84907700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a801595a0 0x7f5a8015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a7ffff700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a800b07a0 0x7f5a80158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a7f7fe700 1 -- 172.21.15.84:0/3138970174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a801595a0 msgr2=0x7f5a8015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a7f7fe700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a801595a0 0x7f5a8015cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a7f7fe700 1 -- 172.21.15.84:0/3138970174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a800b07a0 msgr2=0x7f5a80158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a7f7fe700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a800b07a0 0x7f5a80158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a7f7fe700 1 -- 172.21.15.84:0/3138970174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a78009ae0 con 0x7f5a800b49e0 2023-10-06T03:26:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a84907700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a801595a0 0x7f5a8015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a7ffff700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a800b07a0 0x7f5a80158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a7f7fe700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b49e0 0x7f5a8015c630 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400d890 tx=0x7f5a74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a67fff700 1 -- 172.21.15.84:0/3138970174 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74018070 con 0x7f5a800b49e0 2023-10-06T03:26:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a67fff700 1 -- 172.21.15.84:0/3138970174 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a740125f0 con 0x7f5a800b49e0 2023-10-06T03:26:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a8636a700 1 -- 172.21.15.84:0/3138970174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8015ac20 con 0x7f5a800b49e0 2023-10-06T03:26:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a67fff700 1 -- 172.21.15.84:0/3138970174 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a740129b0 con 0x7f5a800b49e0 2023-10-06T03:26:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.784+0000 7f5a8636a700 1 -- 172.21.15.84:0/3138970174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a80158d90 con 0x7f5a800b49e0 2023-10-06T03:26:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.785+0000 7f5a8636a700 1 -- 172.21.15.84:0/3138970174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a80158f80 con 0x7f5a800b49e0 2023-10-06T03:26:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.785+0000 7f5a67fff700 1 -- 172.21.15.84:0/3138970174 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a74014430 con 0x7f5a800b49e0 2023-10-06T03:26:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.786+0000 7f5a67fff700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 0x7f5a6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.786+0000 7f5a67fff700 1 -- 172.21.15.84:0/3138970174 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f5a74084900 con 0x7f5a800b49e0 2023-10-06T03:26:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.786+0000 7f5a7ffff700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 0x7f5a6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.786+0000 7f5a7ffff700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 0x7f5a6c0693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5a700099f0 tx=0x7f5a70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:03.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:03.790+0000 7f5a67fff700 1 -- 172.21.15.84:0/3138970174 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a80158f80 con 0x7f5a800b49e0 2023-10-06T03:26:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.015+0000 7f5a8636a700 1 -- 172.21.15.84:0/3138970174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a80158f80 con 0x7f5a800b49e0 2023-10-06T03:26:04.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.015+0000 7f5a67fff700 1 -- 172.21.15.84:0/3138970174 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f5a80158f80 con 0x7f5a800b49e0 2023-10-06T03:26:04.017 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:04.017 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1896877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1896877693},{"type":"v1","addr":"172.21.15.131:6834","nonce":1896877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/236530865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":236530865},{"type":"v1","addr":"172.21.15.131:6835","nonce":236530865}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2675057738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2675057738},{"type":"v1","addr":"172.21.15.84:6836","nonce":2675057738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4194916399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4194916399},{"type":"v1","addr":"172.21.15.84:6837","nonce":4194916399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[]} 2023-10-06T03:26:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 -- 172.21.15.84:0/3138970174 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 msgr2=0x7f5a6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 0x7f5a6c0693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5a700099f0 tx=0x7f5a70008040 comp rx=0 tx=0).stop 2023-10-06T03:26:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 -- 172.21.15.84:0/3138970174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b49e0 msgr2=0x7f5a8015c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b49e0 0x7f5a8015c630 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400d890 tx=0x7f5a74008040 comp rx=0 tx=0).stop 2023-10-06T03:26:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 -- 172.21.15.84:0/3138970174 shutdown_connections 2023-10-06T03:26:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a6c066f30 0x7f5a6c0693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a800b07a0 0x7f5a80158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a801595a0 0x7f5a8015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 --2- 172.21.15.84:0/3138970174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a800b49e0 0x7f5a8015c630 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 -- 172.21.15.84:0/3138970174 >> 172.21.15.84:0/3138970174 conn(0x7f5a80099830 msgr2=0x7f5a800b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 -- 172.21.15.84:0/3138970174 shutdown_connections 2023-10-06T03:26:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.017+0000 7f5a8636a700 1 -- 172.21.15.84:0/3138970174 wait complete. 2023-10-06T03:26:04.021 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 33 2023-10-06T03:26:04.031 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:26:04.031 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:26:04.031 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:26:04.031 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:26:04.032 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:26:04.032 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:26:04.032 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:26:04.032 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:26:04.032 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:26:04.032 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:26:04.033 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:26:04.033 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:26:04.033 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:26:04.033 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:26:04.033 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:26:04.033 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:26:04.041 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:26:04.041 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:26:04.042 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:26:04.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:26:04.044 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:26:04.044 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:26:04.045 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:26:04.045 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:26:04.083 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:26:04.083 DEBUG:teuthology.parallel:result is None 2023-10-06T03:26:04.084 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:26:04.084 DEBUG:teuthology.parallel:result is None 2023-10-06T03:26:04.087 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:26:04.087 DEBUG:teuthology.parallel:result is None 2023-10-06T03:26:04.088 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:26:04.088 DEBUG:teuthology.parallel:result is None 2023-10-06T03:26:04.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:26:04.156 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:26:04.156 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:26:04.171 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:26:04.171 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:26:04.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.208+0000 7fb168ce3700 1 Processor -- start 2023-10-06T03:26:04.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.208+0000 7fb168ce3700 1 -- start start 2023-10-06T03:26:04.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.209+0000 7fb168ce3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1640adba0 0x7fb1640ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:04.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.209+0000 7fb168ce3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1640ceb70 con 0x7fb1640ce710 2023-10-06T03:26:04.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.209+0000 7fb168ce3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb164157e20 con 0x7fb1640ca3b0 2023-10-06T03:26:04.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.209+0000 7fb168ce3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640cbbd0 con 0x7fb1640adba0 2023-10-06T03:26:04.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.209+0000 7fb162d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb1640ce710 0x7fb16415af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55220/0 (socket says 172.21.15.84:55220) 2023-10-06T03:26:04.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.209+0000 7fb162d9d700 1 -- 172.21.15.84:0/4291071516 learned_addr learned my addr 172.21.15.84:0/4291071516 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.209+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831039629 0 0) 0x7fb15c001490 con 0x7fb1640ce710 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb161d9b700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1640adba0 0x7fb1640ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb14c003570 con 0x7fb1640ce710 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3531680460 0 0) 0x7fb14c003570 con 0x7fb1640ce710 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1640adba0 msgr2=0x7fb1640ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1640adba0 0x7fb1640ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 >> v1:172.21.15.131:6789/0 conn(0x7fb1640ca3b0 legacy=0x7fb1641582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640cb610 con 0x7fb1640ce710 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fb15c001980 con 0x7fb1640ce710 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 >> v1:172.21.15.84:6789/0 conn(0x7fb1640ce710 legacy=0x7fb16415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c003a90 0x7fb14c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb14c004810 0x7fb14c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1640adba0 0x7fb14c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640cbbd0 con 0x7fb14c003a90 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c00bb60 con 0x7fb14c004810 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c00bd20 con 0x7fb1640adba0 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16259c700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c003a90 0x7fb14c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb162d9d700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1640adba0 0x7fb14c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb161d9b700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb14c004810 0x7fb14c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16259c700 1 -- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1640adba0 msgr2=0x7fb14c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16259c700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1640adba0 0x7fb14c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16259c700 1 -- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb14c004810 msgr2=0x7fb14c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16259c700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb14c004810 0x7fb14c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16259c700 1 -- 172.21.15.84:0/4291071516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c003570 con 0x7fb14c003a90 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.210+0000 7fb16259c700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c003a90 0x7fb14c003ea0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb1540018e0 tx=0x7fb154007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc4291bd1bff480 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.211+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154012420 con 0x7fb14c003a90 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.211+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb154012580 con 0x7fb14c003a90 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.211+0000 7fb16159a700 1 -- 172.21.15.84:0/4291071516 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154012920 con 0x7fb14c003a90 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.211+0000 7fb168ce3700 1 -- 172.21.15.84:0/4291071516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c003a90 msgr2=0x7fb14c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.211+0000 7fb168ce3700 1 --2- 172.21.15.84:0/4291071516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c003a90 0x7fb14c003ea0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb1540018e0 tx=0x7fb154007d30 comp rx=0 tx=0).stop 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.211+0000 7fb162d9d700 1 -- 172.21.15.84:0/4291071516 reap_dead start 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.211+0000 7fb168ce3700 1 -- 172.21.15.84:0/4291071516 shutdown_connections 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.211+0000 7fb168ce3700 1 -- 172.21.15.84:0/4291071516 >> 172.21.15.84:0/4291071516 conn(0x7fb164070810 msgr2=0x7fb164070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.211+0000 7fb168ce3700 1 -- 172.21.15.84:0/4291071516 shutdown_connections 2023-10-06T03:26:04.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.211+0000 7fb168ce3700 1 -- 172.21.15.84:0/4291071516 wait complete. 2023-10-06T03:26:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.212+0000 7fb168ce3700 1 Processor -- start 2023-10-06T03:26:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.212+0000 7fb168ce3700 1 -- start start 2023-10-06T03:26:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb168ce3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c003a90 0x7fb1640b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb168ce3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1640b3330 0x7fb164151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb168ce3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1640cc140 0x7fb1640cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb168ce3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640b1ff0 con 0x7fb1640b3330 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb168ce3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640c2a40 con 0x7fb1640cc140 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb168ce3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640ccad0 con 0x7fb14c003a90 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb161d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1640b3330 0x7fb164151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb161d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1640b3330 0x7fb164151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50546/0 (socket says 172.21.15.84:50546) 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb161d9b700 1 -- 172.21.15.84:0/2977890655 learned_addr learned my addr 172.21.15.84:0/2977890655 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb16259c700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c003a90 0x7fb1640b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb162d9d700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1640cc140 0x7fb1640cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb161d9b700 1 -- 172.21.15.84:0/2977890655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c003a90 msgr2=0x7fb1640b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb161d9b700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c003a90 0x7fb1640b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb161d9b700 1 -- 172.21.15.84:0/2977890655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1640cc140 msgr2=0x7fb1640cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb161d9b700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1640cc140 0x7fb1640cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb161d9b700 1 -- 172.21.15.84:0/2977890655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164156aa0 con 0x7fb1640b3330 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.213+0000 7fb161d9b700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1640b3330 0x7fb164151750 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb158011d70 tx=0x7fb1580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.214+0000 7fb1527fc700 1 -- 172.21.15.84:0/2977890655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15800fac0 con 0x7fb1640b3330 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.214+0000 7fb1527fc700 1 -- 172.21.15.84:0/2977890655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15800fc20 con 0x7fb1640b3330 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.214+0000 7fb168ce3700 1 -- 172.21.15.84:0/2977890655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1640c2710 con 0x7fb1640b3330 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.214+0000 7fb1527fc700 1 -- 172.21.15.84:0/2977890655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158014440 con 0x7fb1640b3330 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.214+0000 7fb168ce3700 1 -- 172.21.15.84:0/2977890655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1640b1a30 con 0x7fb1640b3330 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.214+0000 7fb168ce3700 1 -- 172.21.15.84:0/2977890655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1640c2bf0 con 0x7fb1640b3330 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.215+0000 7fb1527fc700 1 -- 172.21.15.84:0/2977890655 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb158014870 con 0x7fb1640b3330 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.215+0000 7fb1527fc700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb144066f30 0x7fb1440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.215+0000 7fb1527fc700 1 -- 172.21.15.84:0/2977890655 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fb158018030 con 0x7fb1640b3330 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.215+0000 7fb16259c700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb144066f30 0x7fb1440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.216+0000 7fb16259c700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb144066f30 0x7fb1440693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb154008fd0 tx=0x7fb154015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:04.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.220+0000 7fb1527fc700 1 -- 172.21.15.84:0/2977890655 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1640c2bf0 con 0x7fb1640b3330 2023-10-06T03:26:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:04.420+0000 7fb168ce3700 1 -- 172.21.15.84:0/2977890655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb1640c2bb0 con 0x7fb1640b3330 2023-10-06T03:26:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.243+0000 7fb1527fc700 1 -- 172.21.15.84:0/2977890655 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v70) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb158022080 con 0x7fb1640b3330 2023-10-06T03:26:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 -- 172.21.15.84:0/2977890655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb144066f30 msgr2=0x7fb1440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb144066f30 0x7fb1440693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb154008fd0 tx=0x7fb154015000 comp rx=0 tx=0).stop 2023-10-06T03:26:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 -- 172.21.15.84:0/2977890655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1640b3330 msgr2=0x7fb164151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1640b3330 0x7fb164151750 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb158011d70 tx=0x7fb1580091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 -- 172.21.15.84:0/2977890655 shutdown_connections 2023-10-06T03:26:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb144066f30 0x7fb1440693e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1640cc140 0x7fb1640cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c003a90 0x7fb1640b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 --2- 172.21.15.84:0/2977890655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1640b3330 0x7fb164151750 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 -- 172.21.15.84:0/2977890655 >> 172.21.15.84:0/2977890655 conn(0x7fb164070810 msgr2=0x7fb164154640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 -- 172.21.15.84:0/2977890655 shutdown_connections 2023-10-06T03:26:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.246+0000 7fb168ce3700 1 -- 172.21.15.84:0/2977890655 wait complete. 2023-10-06T03:26:05.249 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T03:26:05.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:26:05.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.374+0000 7faba91b4700 1 Processor -- start 2023-10-06T03:26:05.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.374+0000 7faba91b4700 1 -- start start 2023-10-06T03:26:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba91b4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cbc70 0x7faba40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba91b4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faba40b2140 0x7faba40b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba91b4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba40cb7e0 con 0x7faba4159480 2023-10-06T03:26:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba91b4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40b08a0 con 0x7faba40b2140 2023-10-06T03:26:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba91b4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba40cb190 con 0x7faba40cbc70 2023-10-06T03:26:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faba4159480 0x7faba40b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55228/0 (socket says 172.21.15.84:55228) 2023-10-06T03:26:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba3fff700 1 -- 172.21.15.84:0/2908462831 learned_addr learned my addr 172.21.15.84:0/2908462831 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666484973 0 0) 0x7faba40cb7e0 con 0x7faba4159480 2023-10-06T03:26:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab8c003570 con 0x7faba4159480 2023-10-06T03:26:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba37fe700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cbc70 0x7faba40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.375+0000 7faba89b3700 1 --2- 172.21.15.84:0/2908462831 >> v2:172.21.15.131:3300/0 conn(0x7faba40b2140 0x7faba40b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 978664819 0 0) 0x7fab8c003570 con 0x7faba4159480 2023-10-06T03:26:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cbc70 msgr2=0x7faba40cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cbc70 0x7faba40cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 >> v2:172.21.15.131:3300/0 conn(0x7faba40b2140 msgr2=0x7faba40b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 --2- 172.21.15.84:0/2908462831 >> v2:172.21.15.131:3300/0 conn(0x7faba40b2140 0x7faba40b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40cb470 con 0x7faba4159480 2023-10-06T03:26:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fab94001470 con 0x7faba4159480 2023-10-06T03:26:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 >> v1:172.21.15.84:6789/0 conn(0x7faba4159480 legacy=0x7faba40b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c003a60 0x7fab8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cbc70 0x7fab8c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c004d50 0x7fab8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40b08a0 con 0x7fab8c003a60 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40cb190 con 0x7fab8c004d50 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c00ba60 con 0x7faba40cbc70 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba3fff700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c003a60 0x7fab8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba37fe700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cbc70 0x7fab8c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba89b3700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c004d50 0x7fab8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba3fff700 1 -- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cbc70 msgr2=0x7fab8c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba3fff700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cbc70 0x7fab8c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba3fff700 1 -- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c004d50 msgr2=0x7fab8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba3fff700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c004d50 0x7fab8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba3fff700 1 -- 172.21.15.84:0/2908462831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c003570 con 0x7fab8c003a60 2023-10-06T03:26:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba3fff700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c003a60 0x7fab8c003e70 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fab9400c3c0 tx=0x7fab94001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b631043d3f597a5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9400cc30 con 0x7fab8c003a60 2023-10-06T03:26:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9400cdb0 con 0x7fab8c003a60 2023-10-06T03:26:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.376+0000 7faba2ffd700 1 -- 172.21.15.84:0/2908462831 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94005b70 con 0x7fab8c003a60 2023-10-06T03:26:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.377+0000 7faba91b4700 1 -- 172.21.15.84:0/2908462831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c003a60 msgr2=0x7fab8c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.377+0000 7faba91b4700 1 --2- 172.21.15.84:0/2908462831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c003a60 0x7fab8c003e70 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fab9400c3c0 tx=0x7fab94001e90 comp rx=0 tx=0).stop 2023-10-06T03:26:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.377+0000 7faba89b3700 1 -- 172.21.15.84:0/2908462831 reap_dead start 2023-10-06T03:26:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.377+0000 7faba91b4700 1 -- 172.21.15.84:0/2908462831 shutdown_connections 2023-10-06T03:26:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.377+0000 7faba91b4700 1 -- 172.21.15.84:0/2908462831 >> 172.21.15.84:0/2908462831 conn(0x7faba406ed20 msgr2=0x7faba406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.377+0000 7faba91b4700 1 -- 172.21.15.84:0/2908462831 shutdown_connections 2023-10-06T03:26:05.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.377+0000 7faba91b4700 1 -- 172.21.15.84:0/2908462831 wait complete. 2023-10-06T03:26:05.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.378+0000 7faba91b4700 1 Processor -- start 2023-10-06T03:26:05.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.378+0000 7faba91b4700 1 -- start start 2023-10-06T03:26:05.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba91b4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c003a60 0x7faba415f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba91b4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba40cf1d0 0x7faba40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba91b4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cf640 0x7faba40d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba91b4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba415e250 con 0x7faba40cf1d0 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba91b4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba415ed90 con 0x7fab8c003a60 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba91b4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba415e460 con 0x7faba40cf640 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba40cf1d0 0x7faba40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba40cf1d0 0x7faba40d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50564/0 (socket says 172.21.15.84:50564) 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba37fe700 1 -- 172.21.15.84:0/4147991294 learned_addr learned my addr 172.21.15.84:0/4147991294 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba89b3700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cf640 0x7faba40d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba3fff700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c003a60 0x7faba415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba37fe700 1 -- 172.21.15.84:0/4147991294 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cf640 msgr2=0x7faba40d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba37fe700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cf640 0x7faba40d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba37fe700 1 -- 172.21.15.84:0/4147991294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c003a60 msgr2=0x7faba415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba37fe700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c003a60 0x7faba415f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba37fe700 1 -- 172.21.15.84:0/4147991294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba415e740 con 0x7faba40cf1d0 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.379+0000 7faba37fe700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba40cf1d0 0x7faba40d0300 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fab98011d40 tx=0x7fab980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.380+0000 7fab8bfff700 1 -- 172.21.15.84:0/4147991294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9800f990 con 0x7faba40cf1d0 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.380+0000 7fab8bfff700 1 -- 172.21.15.84:0/4147991294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9800faf0 con 0x7faba40cf1d0 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.380+0000 7fab8bfff700 1 -- 172.21.15.84:0/4147991294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9800feb0 con 0x7faba40cf1d0 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.380+0000 7faba91b4700 1 -- 172.21.15.84:0/4147991294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba415ea20 con 0x7faba40cf1d0 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.380+0000 7faba91b4700 1 -- 172.21.15.84:0/4147991294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba416cdc0 con 0x7faba40cf1d0 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.381+0000 7faba91b4700 1 -- 172.21.15.84:0/4147991294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba415ef40 con 0x7faba40cf1d0 2023-10-06T03:26:05.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.381+0000 7fab8bfff700 1 -- 172.21.15.84:0/4147991294 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab98014650 con 0x7faba40cf1d0 2023-10-06T03:26:05.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.381+0000 7fab8bfff700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab90066f60 0x7fab90069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.381+0000 7fab8bfff700 1 -- 172.21.15.84:0/4147991294 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fab98018030 con 0x7faba40cf1d0 2023-10-06T03:26:05.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.381+0000 7faba3fff700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab90066f60 0x7fab90069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.382+0000 7faba3fff700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab90066f60 0x7fab90069410 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fab94001ed0 tx=0x7fab94015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:05.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.386+0000 7fab8bfff700 1 -- 172.21.15.84:0/4147991294 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faba415ef40 con 0x7faba40cf1d0 2023-10-06T03:26:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.643+0000 7faba91b4700 1 -- 172.21.15.84:0/4147991294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7faba415ef00 con 0x7faba40cf1d0 2023-10-06T03:26:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.643+0000 7fab8bfff700 1 -- 172.21.15.84:0/4147991294 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fab98022090 con 0x7faba40cf1d0 2023-10-06T03:26:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:05.645 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:26:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T03:26:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lA8KvDxAA2irSaBc/QiMm9oI5GEK1PA==", 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lq2TnGhAAOzV6kE1Ji9yvQGuouda9GQ==", 2023-10-06T03:26:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9l4w54FhAASOElKyXlWzXB7pDJV5TzVQ==", 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lh/61IRAANVLLVFSkTIhlvAyQkmkbqQ==", 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:26:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCVfR9lPd++MRAAikRAaM5HcwQgYYfszDoMzQ==", 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCYfR9l3ovfLxAAkuD96aBKGZX1SQvItQjbmA==", 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T03:26:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCbfR9lsbQpMBAApjEhKZ3RZXIXNFPmGrp3Rg==", 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCefR9lOhnPMRAAinzeYJrHzI3Laz+kRo7U9w==", 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCkfR9liYL2MhAAVzzPBy1+K4n9a324eCqKSg==", 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCnfR9lEe8GMBAAgXFWAPLix5BkHtrqQazDqA==", 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCqfR9lcprFMBAA4/ksqag9gsivr9htt3UDBg==", 2023-10-06T03:26:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCtfR9leIi9MBAAaco3XMawt8uFNMNRbPQAQQ==", 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lGQaGJRAALZ28ylNKJSf4AhF9KcsrBg==", 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ls6nPLRAA/94kuDcXCPlYoYcCuqwN2A==", 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lY17ZKhAAyLFVSlBM5vWr4LSl+wwWZw==", 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lPWYyMxAAmgd5iQq7RQp80iK1oBfUww==", 2023-10-06T03:26:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRfR9loncpLhAA2cZSGjrup5zj13Xtt9k6Xw==", 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ltUixDBAAQN/x3iVJcTKF7hTMehPYgQ==", 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lFqqSBhAA1km5fSJT2+QAdMBBxBWrXQ==", 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T03:26:05.660 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:26:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.645+0000 7faba91b4700 1 -- 172.21.15.84:0/4147991294 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab90066f60 msgr2=0x7fab90069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.645+0000 7faba91b4700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab90066f60 0x7fab90069410 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fab94001ed0 tx=0x7fab94015000 comp rx=0 tx=0).stop 2023-10-06T03:26:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.645+0000 7faba91b4700 1 -- 172.21.15.84:0/4147991294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba40cf1d0 msgr2=0x7faba40d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.645+0000 7faba91b4700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba40cf1d0 0x7faba40d0300 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fab98011d40 tx=0x7fab980091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.645+0000 7faba91b4700 1 -- 172.21.15.84:0/4147991294 shutdown_connections 2023-10-06T03:26:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.645+0000 7faba91b4700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab90066f60 0x7fab90069410 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.645+0000 7faba91b4700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c003a60 0x7faba415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.645+0000 7faba91b4700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba40cf640 0x7faba40d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.645+0000 7faba91b4700 1 --2- 172.21.15.84:0/4147991294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba40cf1d0 0x7faba40d0300 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.645+0000 7faba91b4700 1 -- 172.21.15.84:0/4147991294 >> 172.21.15.84:0/4147991294 conn(0x7faba406ed20 msgr2=0x7faba40b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.646+0000 7faba91b4700 1 -- 172.21.15.84:0/4147991294 shutdown_connections 2023-10-06T03:26:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.646+0000 7faba91b4700 1 -- 172.21.15.84:0/4147991294 wait complete. 2023-10-06T03:26:05.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:05.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.776+0000 7f34d00dc700 1 Processor -- start 2023-10-06T03:26:05.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.777+0000 7f34d00dc700 1 -- start start 2023-10-06T03:26:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.777+0000 7f34d00dc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34c80adf60 0x7f34c80ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.777+0000 7f34d00dc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c80c7370 con 0x7f34c8069c70 2023-10-06T03:26:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.777+0000 7f34d00dc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c80ac580 con 0x7f34c806e280 2023-10-06T03:26:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.777+0000 7f34d00dc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c8156150 con 0x7f34c80adf60 2023-10-06T03:26:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34cde78700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34c80adf60 0x7f34c80ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34ce679700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f34c8069c70 0x7f34c80c7800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55238/0 (socket says 172.21.15.84:55238) 2023-10-06T03:26:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34cde78700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34c80adf60 0x7f34c80ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50580/0 (socket says 172.21.15.84:50580) 2023-10-06T03:26:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34ce679700 1 -- 172.21.15.84:0/2784731122 learned_addr learned my addr 172.21.15.84:0/2784731122 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34cde78700 1 -- 172.21.15.84:0/2784731122 >> v1:172.21.15.131:6789/0 conn(0x7f34c806e280 legacy=0x7f34c8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34cde78700 1 -- 172.21.15.84:0/2784731122 >> v1:172.21.15.84:6789/0 conn(0x7f34c8069c70 legacy=0x7f34c80c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34cde78700 1 -- 172.21.15.84:0/2784731122 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c80c6760 con 0x7f34c80adf60 2023-10-06T03:26:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34cce76700 1 -- 172.21.15.84:0/2784731122 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672008769 0 0) 0x7f34c80c7370 con 0x7f34c8069c70 2023-10-06T03:26:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34cde78700 1 --2- 172.21.15.84:0/2784731122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 0x7f34c80ac040 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f34c40098e0 tx=0x7f34c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b926587427739c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34cce76700 1 -- 172.21.15.84:0/2784731122 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4009e80 con 0x7f34c80adf60 2023-10-06T03:26:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34cce76700 1 -- 172.21.15.84:0/2784731122 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c400b860 con 0x7f34c80adf60 2023-10-06T03:26:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.778+0000 7f34cce76700 1 -- 172.21.15.84:0/2784731122 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c400bbe0 con 0x7f34c80adf60 2023-10-06T03:26:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.779+0000 7f34d00dc700 1 -- 172.21.15.84:0/2784731122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 msgr2=0x7f34c80ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.779+0000 7f34d00dc700 1 --2- 172.21.15.84:0/2784731122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 0x7f34c80ac040 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f34c40098e0 tx=0x7f34c40091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.779+0000 7f34d00dc700 1 -- 172.21.15.84:0/2784731122 shutdown_connections 2023-10-06T03:26:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.779+0000 7f34d00dc700 1 --2- 172.21.15.84:0/2784731122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 0x7f34c80ac040 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.779+0000 7f34d00dc700 1 -- 172.21.15.84:0/2784731122 >> 172.21.15.84:0/2784731122 conn(0x7f34c80680c0 msgr2=0x7f34c80cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.779+0000 7f34d00dc700 1 -- 172.21.15.84:0/2784731122 shutdown_connections 2023-10-06T03:26:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.779+0000 7f34d00dc700 1 -- 172.21.15.84:0/2784731122 wait complete. 2023-10-06T03:26:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.780+0000 7f34d00dc700 1 Processor -- start 2023-10-06T03:26:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.780+0000 7f34d00dc700 1 -- start start 2023-10-06T03:26:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34d00dc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34c8069c70 0x7f34c81671b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34d00dc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34c806e280 0x7f34c80c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34d00dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 0x7f34c80c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34d00dc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8151f70 con 0x7f34c80adf60 2023-10-06T03:26:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34d00dc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8167840 con 0x7f34c806e280 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34d00dc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c80b0fb0 con 0x7f34c8069c70 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34ce679700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 0x7f34c80c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34ce679700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 0x7f34c80c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50596/0 (socket says 172.21.15.84:50596) 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34ce679700 1 -- 172.21.15.84:0/711389506 learned_addr learned my addr 172.21.15.84:0/711389506 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34ce679700 1 -- 172.21.15.84:0/711389506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34c8069c70 msgr2=0x7f34c81671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34ce679700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34c8069c70 0x7f34c81671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34ce679700 1 -- 172.21.15.84:0/711389506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34c806e280 msgr2=0x7f34c80c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34ce679700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34c806e280 0x7f34c80c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34ce679700 1 -- 172.21.15.84:0/711389506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c4009420 con 0x7f34c80adf60 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34ce679700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 0x7f34c80c5880 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f34c000cb40 tx=0x7f34c0001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34bdffb700 1 -- 172.21.15.84:0/711389506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0004dc0 con 0x7f34c80adf60 2023-10-06T03:26:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34bdffb700 1 -- 172.21.15.84:0/711389506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c000a6a0 con 0x7f34c80adf60 2023-10-06T03:26:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34d00dc700 1 -- 172.21.15.84:0/711389506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c80b1290 con 0x7f34c80adf60 2023-10-06T03:26:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34bdffb700 1 -- 172.21.15.84:0/711389506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c000aa60 con 0x7f34c80adf60 2023-10-06T03:26:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.781+0000 7f34d00dc700 1 -- 172.21.15.84:0/711389506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c80b1850 con 0x7f34c80adf60 2023-10-06T03:26:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.782+0000 7f34d00dc700 1 -- 172.21.15.84:0/711389506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c8064ad0 con 0x7f34c80adf60 2023-10-06T03:26:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.783+0000 7f34bdffb700 1 -- 172.21.15.84:0/711389506 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34c00060f0 con 0x7f34c80adf60 2023-10-06T03:26:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.783+0000 7f34bdffb700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f34ac066f30 0x7f34ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.783+0000 7f34bdffb700 1 -- 172.21.15.84:0/711389506 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f34c00843a0 con 0x7f34c80adf60 2023-10-06T03:26:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.783+0000 7f34cde78700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f34ac066f30 0x7f34ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.784+0000 7f34cde78700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f34ac066f30 0x7f34ac0693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f34c40091e0 tx=0x7f34c4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.787+0000 7f34bdffb700 1 -- 172.21.15.84:0/711389506 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34c0051740 con 0x7f34c80adf60 2023-10-06T03:26:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.970+0000 7f34d00dc700 1 -- 172.21.15.84:0/711389506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34c81679b0 con 0x7f34c80adf60 2023-10-06T03:26:05.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.971+0000 7f34bdffb700 1 -- 172.21.15.84:0/711389506 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+13856 (secure 0 0 0) 0x7f34c0054d60 con 0x7f34c80adf60 2023-10-06T03:26:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:05.973 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:05.241388+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:05.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 -- 172.21.15.84:0/711389506 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f34ac066f30 msgr2=0x7f34ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f34ac066f30 0x7f34ac0693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f34c40091e0 tx=0x7f34c4017000 comp rx=0 tx=0).stop 2023-10-06T03:26:05.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 -- 172.21.15.84:0/711389506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 msgr2=0x7f34c80c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:05.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 0x7f34c80c5880 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f34c000cb40 tx=0x7f34c0001900 comp rx=0 tx=0).stop 2023-10-06T03:26:05.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 -- 172.21.15.84:0/711389506 shutdown_connections 2023-10-06T03:26:05.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f34ac066f30 0x7f34ac0693e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34c80adf60 0x7f34c80c5880 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34c8069c70 0x7f34c81671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 --2- 172.21.15.84:0/711389506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34c806e280 0x7f34c80c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:05.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 -- 172.21.15.84:0/711389506 >> 172.21.15.84:0/711389506 conn(0x7f34c80680c0 msgr2=0x7f34c8069560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:05.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 -- 172.21.15.84:0/711389506 shutdown_connections 2023-10-06T03:26:05.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:05.974+0000 7f34d00dc700 1 -- 172.21.15.84:0/711389506 wait complete. 2023-10-06T03:26:05.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:26:05.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:26:06.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.103+0000 7f49737b6700 1 Processor -- start 2023-10-06T03:26:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.103+0000 7f49737b6700 1 -- start start 2023-10-06T03:26:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f49737b6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f496c159510 0x7f496c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f49737b6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f496c0cbae0 0x7f496c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f49737b6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0cbef0 con 0x7f496c1598e0 2023-10-06T03:26:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f49737b6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c0cf610 con 0x7f496c159510 2023-10-06T03:26:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f49737b6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0cf8f0 con 0x7f496c0cbae0 2023-10-06T03:26:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4971552700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f496c159510 0x7f496c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4971552700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f496c159510 0x7f496c0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50606/0 (socket says 172.21.15.84:50606) 2023-10-06T03:26:06.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4971552700 1 -- 172.21.15.84:0/1621737501 learned_addr learned my addr 172.21.15.84:0/1621737501 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:06.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4971d53700 1 --2- 172.21.15.84:0/1621737501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f496c0cbae0 0x7f496c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4971552700 1 -- 172.21.15.84:0/1621737501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f496c0cbae0 msgr2=0x7f496c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:06.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4971552700 1 --2- 172.21.15.84:0/1621737501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f496c0cbae0 0x7f496c0cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4971552700 1 -- 172.21.15.84:0/1621737501 >> v1:172.21.15.84:6789/0 conn(0x7f496c1598e0 legacy=0x7f496c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4971552700 1 -- 172.21.15.84:0/1621737501 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c0cfbd0 con 0x7f496c159510 2023-10-06T03:26:06.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4963fff700 1 -- 172.21.15.84:0/1621737501 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378183518 0 0) 0x7f496c0cbef0 con 0x7f496c1598e0 2023-10-06T03:26:06.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4971552700 1 --2- 172.21.15.84:0/1621737501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c159510 0x7f496c0cb5a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f49680099b0 tx=0x7f4968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87507d17cd4985a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:06.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4963fff700 1 -- 172.21.15.84:0/1621737501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496800b860 con 0x7f496c159510 2023-10-06T03:26:06.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4963fff700 1 -- 172.21.15.84:0/1621737501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496800b9c0 con 0x7f496c159510 2023-10-06T03:26:06.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.104+0000 7f4963fff700 1 -- 172.21.15.84:0/1621737501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496800bd60 con 0x7f496c159510 2023-10-06T03:26:06.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.105+0000 7f49737b6700 1 -- 172.21.15.84:0/1621737501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c159510 msgr2=0x7f496c0cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.105+0000 7f49737b6700 1 --2- 172.21.15.84:0/1621737501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c159510 0x7f496c0cb5a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f49680099b0 tx=0x7f4968009250 comp rx=0 tx=0).stop 2023-10-06T03:26:06.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.105+0000 7f49737b6700 1 -- 172.21.15.84:0/1621737501 shutdown_connections 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.105+0000 7f49737b6700 1 --2- 172.21.15.84:0/1621737501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f496c0cbae0 0x7f496c0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.105+0000 7f49737b6700 1 --2- 172.21.15.84:0/1621737501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c159510 0x7f496c0cb5a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.105+0000 7f49737b6700 1 -- 172.21.15.84:0/1621737501 >> 172.21.15.84:0/1621737501 conn(0x7f496c089e90 msgr2=0x7f496c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.105+0000 7f49737b6700 1 -- 172.21.15.84:0/1621737501 shutdown_connections 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.105+0000 7f49737b6700 1 -- 172.21.15.84:0/1621737501 wait complete. 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.106+0000 7f49737b6700 1 Processor -- start 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.106+0000 7f49737b6700 1 -- start start 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f49737b6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c0cbae0 0x7f496c1556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f49737b6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f496c159510 0x7f496c13d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f49737b6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c1598e0 0x7f496c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f49737b6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c16d3a0 con 0x7f496c0cbae0 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f49737b6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c16e200 con 0x7f496c1598e0 2023-10-06T03:26:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f49737b6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c16d5f0 con 0x7f496c159510 2023-10-06T03:26:06.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f4971552700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c0cbae0 0x7f496c1556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f4971552700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c0cbae0 0x7f496c1556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50612/0 (socket says 172.21.15.84:50612) 2023-10-06T03:26:06.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f4971552700 1 -- 172.21.15.84:0/961347647 learned_addr learned my addr 172.21.15.84:0/961347647 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:06.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f4971552700 1 -- 172.21.15.84:0/961347647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f496c159510 msgr2=0x7f496c13d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f4971552700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f496c159510 0x7f496c13d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f4971552700 1 -- 172.21.15.84:0/961347647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c1598e0 msgr2=0x7f496c069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f4971552700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c1598e0 0x7f496c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.107+0000 7f4971552700 1 -- 172.21.15.84:0/961347647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680094f0 con 0x7f496c0cbae0 2023-10-06T03:26:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.108+0000 7f4971552700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c0cbae0 0x7f496c1556c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4968006fd0 tx=0x7f4968017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.108+0000 7f49617fa700 1 -- 172.21.15.84:0/961347647 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496801a420 con 0x7f496c0cbae0 2023-10-06T03:26:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.108+0000 7f49617fa700 1 -- 172.21.15.84:0/961347647 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496801a5a0 con 0x7f496c0cbae0 2023-10-06T03:26:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.108+0000 7f49737b6700 1 -- 172.21.15.84:0/961347647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c16d8d0 con 0x7f496c0cbae0 2023-10-06T03:26:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.108+0000 7f49617fa700 1 -- 172.21.15.84:0/961347647 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496801a960 con 0x7f496c0cbae0 2023-10-06T03:26:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.108+0000 7f49737b6700 1 -- 172.21.15.84:0/961347647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c16de90 con 0x7f496c0cbae0 2023-10-06T03:26:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.109+0000 7f49737b6700 1 -- 172.21.15.84:0/961347647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c064ad0 con 0x7f496c0cbae0 2023-10-06T03:26:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.109+0000 7f49617fa700 1 -- 172.21.15.84:0/961347647 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f496801acd0 con 0x7f496c0cbae0 2023-10-06T03:26:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.109+0000 7f49617fa700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4950066f30 0x7f49500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.109+0000 7f49617fa700 1 -- 172.21.15.84:0/961347647 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4968086010 con 0x7f496c0cbae0 2023-10-06T03:26:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.110+0000 7f4970d51700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4950066f30 0x7f49500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.110+0000 7f4970d51700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4950066f30 0x7f49500693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f496c0c7c40 tx=0x7f495c007b40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.114+0000 7f49617fa700 1 -- 172.21.15.84:0/961347647 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4968053330 con 0x7f496c0cbae0 2023-10-06T03:26:06.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.294+0000 7f49737b6700 1 -- 172.21.15.84:0/961347647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f496c0cfeb0 con 0x7f496c0cbae0 2023-10-06T03:26:06.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.295+0000 7f49617fa700 1 -- 172.21.15.84:0/961347647 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4968015020 con 0x7f496c0cbae0 2023-10-06T03:26:06.297 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:26:06.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 -- 172.21.15.84:0/961347647 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4950066f30 msgr2=0x7f49500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4950066f30 0x7f49500693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f496c0c7c40 tx=0x7f495c007b40 comp rx=0 tx=0).stop 2023-10-06T03:26:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 -- 172.21.15.84:0/961347647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c0cbae0 msgr2=0x7f496c1556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c0cbae0 0x7f496c1556c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4968006fd0 tx=0x7f4968017000 comp rx=0 tx=0).stop 2023-10-06T03:26:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 -- 172.21.15.84:0/961347647 shutdown_connections 2023-10-06T03:26:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4950066f30 0x7f49500693e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c1598e0 0x7f496c069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f496c0cbae0 0x7f496c1556c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 --2- 172.21.15.84:0/961347647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f496c159510 0x7f496c13d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 -- 172.21.15.84:0/961347647 >> 172.21.15.84:0/961347647 conn(0x7f496c089e90 msgr2=0x7f496c15bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:06.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 -- 172.21.15.84:0/961347647 shutdown_connections 2023-10-06T03:26:06.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.297+0000 7f49737b6700 1 -- 172.21.15.84:0/961347647 wait complete. 2023-10-06T03:26:06.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:26:06.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.426+0000 7f5aad06a700 1 Processor -- start 2023-10-06T03:26:06.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.426+0000 7f5aad06a700 1 -- start start 2023-10-06T03:26:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.427+0000 7f5aad06a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5aa80b2660 0x7f5aa80cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.427+0000 7f5aad06a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa80cc9b0 con 0x7f5aa80b2a30 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.427+0000 7f5aad06a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa80cbda0 con 0x7f5aa80cf1f0 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.427+0000 7f5aad06a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa80cc080 con 0x7f5aa80b2660 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.427+0000 7f5aa77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5aa80b2a30 0x7f5aa80ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55244/0 (socket says 172.21.15.84:55244) 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.427+0000 7f5aa77fe700 1 -- 172.21.15.84:0/3485862661 learned_addr learned my addr 172.21.15.84:0/3485862661 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.427+0000 7f5aa7fff700 1 --2- 172.21.15.84:0/3485862661 >> v2:172.21.15.131:3300/0 conn(0x7f5aa80b2660 0x7f5aa80cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.427+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836014697 0 0) 0x7f5aa80cc9b0 con 0x7f5aa80b2a30 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.427+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a90003570 con 0x7f5aa80b2a30 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.427+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3765857600 0 0) 0x7f5a90003570 con 0x7f5aa80b2a30 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 >> v2:172.21.15.131:3300/0 conn(0x7f5aa80b2660 msgr2=0x7f5aa80cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 --2- 172.21.15.84:0/3485862661 >> v2:172.21.15.131:3300/0 conn(0x7f5aa80b2660 0x7f5aa80cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 >> v1:172.21.15.131:6789/0 conn(0x7f5aa80cf1f0 legacy=0x7f5aa80c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa80cc360 con 0x7f5aa80b2a30 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f5a9c001470 con 0x7f5aa80b2a30 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 >> v1:172.21.15.84:6789/0 conn(0x7f5aa80b2a30 legacy=0x7f5aa80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a90003a60 0x7f5a90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a90004810 0x7f5a90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a900051c0 0x7f5a9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80cc080 con 0x7f5a900051c0 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9000c0d0 con 0x7f5a90003a60 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9000c290 con 0x7f5a90004810 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aac869700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a900051c0 0x7f5a9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa7fff700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a90003a60 0x7f5a90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa77fe700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a90004810 0x7f5a90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aac869700 1 -- 172.21.15.84:0/3485862661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a90004810 msgr2=0x7f5a90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aac869700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a90004810 0x7f5a90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aac869700 1 -- 172.21.15.84:0/3485862661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a90003a60 msgr2=0x7f5a90003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aac869700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a90003a60 0x7f5a90003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aac869700 1 -- 172.21.15.84:0/3485862661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90003570 con 0x7f5a900051c0 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aac869700 1 -- 172.21.15.84:0/3485862661 reap_dead start 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aac869700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a900051c0 0x7f5a9000ba60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0001fc0 tx=0x7f5aa0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db1792c464fe102 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0001950 con 0x7f5a900051c0 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa000c8b0 con 0x7f5a900051c0 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.428+0000 7f5aa6ffd700 1 -- 172.21.15.84:0/3485862661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000cc50 con 0x7f5a900051c0 2023-10-06T03:26:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.429+0000 7f5aad06a700 1 -- 172.21.15.84:0/3485862661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a900051c0 msgr2=0x7f5a9000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.429+0000 7f5aad06a700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a900051c0 0x7f5a9000ba60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0001fc0 tx=0x7f5aa0001640 comp rx=0 tx=0).stop 2023-10-06T03:26:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.429+0000 7f5aad06a700 1 -- 172.21.15.84:0/3485862661 shutdown_connections 2023-10-06T03:26:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.429+0000 7f5aad06a700 1 --2- 172.21.15.84:0/3485862661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a900051c0 0x7f5a9000ba60 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.429+0000 7f5aad06a700 1 -- 172.21.15.84:0/3485862661 >> 172.21.15.84:0/3485862661 conn(0x7f5aa8099560 msgr2=0x7f5aa806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.429+0000 7f5aad06a700 1 -- 172.21.15.84:0/3485862661 shutdown_connections 2023-10-06T03:26:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.429+0000 7f5aad06a700 1 -- 172.21.15.84:0/3485862661 wait complete. 2023-10-06T03:26:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.430+0000 7f5aad06a700 1 Processor -- start 2023-10-06T03:26:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.430+0000 7f5aad06a700 1 -- start start 2023-10-06T03:26:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aad06a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a900051c0 0x7f5aa8150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aad06a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5aa80c5290 0x7f5aa80c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aad06a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aa815b050 0x7f5aa815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aad06a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80c5c40 con 0x7f5aa815b050 2023-10-06T03:26:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aad06a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa815bdc0 con 0x7f5a900051c0 2023-10-06T03:26:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aad06a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa815c0a0 con 0x7f5aa80c5290 2023-10-06T03:26:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aac869700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aa815b050 0x7f5aa815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aac869700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aa815b050 0x7f5aa815b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50634/0 (socket says 172.21.15.84:50634) 2023-10-06T03:26:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aac869700 1 -- 172.21.15.84:0/1628782724 learned_addr learned my addr 172.21.15.84:0/1628782724 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aa77fe700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5aa80c5290 0x7f5aa80c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aa7fff700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a900051c0 0x7f5aa8150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aac869700 1 -- 172.21.15.84:0/1628782724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5aa80c5290 msgr2=0x7f5aa80c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aac869700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5aa80c5290 0x7f5aa80c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aac869700 1 -- 172.21.15.84:0/1628782724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a900051c0 msgr2=0x7f5aa8150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aac869700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a900051c0 0x7f5aa8150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aac869700 1 -- 172.21.15.84:0/1628782724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa815c380 con 0x7f5aa815b050 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.431+0000 7f5aac869700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aa815b050 0x7f5aa815b480 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5aa806a610 tx=0x7f5aa0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.432+0000 7f5a8ffff700 1 -- 172.21.15.84:0/1628782724 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000c6d0 con 0x7f5aa815b050 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.432+0000 7f5a8ffff700 1 -- 172.21.15.84:0/1628782724 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa0012e10 con 0x7f5aa815b050 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.432+0000 7f5aad06a700 1 -- 172.21.15.84:0/1628782724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa80b4210 con 0x7f5aa815b050 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.432+0000 7f5a8ffff700 1 -- 172.21.15.84:0/1628782724 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0006dd0 con 0x7f5aa815b050 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.432+0000 7f5aad06a700 1 -- 172.21.15.84:0/1628782724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa80b3ec0 con 0x7f5aa815b050 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.432+0000 7f5aad06a700 1 -- 172.21.15.84:0/1628782724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa815c510 con 0x7f5aa815b050 2023-10-06T03:26:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.433+0000 7f5a8ffff700 1 -- 172.21.15.84:0/1628782724 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5aa001e640 con 0x7f5aa815b050 2023-10-06T03:26:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.433+0000 7f5a8ffff700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a94066f30 0x7f5a940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.433+0000 7f5a8ffff700 1 -- 172.21.15.84:0/1628782724 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5aa0085ea0 con 0x7f5aa815b050 2023-10-06T03:26:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.433+0000 7f5aa7fff700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a94066f30 0x7f5a940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.434+0000 7f5aa7fff700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a94066f30 0x7f5a940693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5a980090f0 tx=0x7f5a98009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.438+0000 7f5a8ffff700 1 -- 172.21.15.84:0/1628782724 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5aa815c510 con 0x7f5aa815b050 2023-10-06T03:26:06.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.617+0000 7f5aad06a700 1 -- 172.21.15.84:0/1628782724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5aa815c510 con 0x7f5aa815b050 2023-10-06T03:26:06.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.618+0000 7f5a8ffff700 1 -- 172.21.15.84:0/1628782724 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5aa815c510 con 0x7f5aa815b050 2023-10-06T03:26:06.620 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:26:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 -- 172.21.15.84:0/1628782724 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a94066f30 msgr2=0x7f5a940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a94066f30 0x7f5a940693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5a980090f0 tx=0x7f5a98009120 comp rx=0 tx=0).stop 2023-10-06T03:26:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 -- 172.21.15.84:0/1628782724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aa815b050 msgr2=0x7f5aa815b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aa815b050 0x7f5aa815b480 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5aa806a610 tx=0x7f5aa0015000 comp rx=0 tx=0).stop 2023-10-06T03:26:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 -- 172.21.15.84:0/1628782724 shutdown_connections 2023-10-06T03:26:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a94066f30 0x7f5a940693e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a900051c0 0x7f5aa8150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aa815b050 0x7f5aa815b480 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 --2- 172.21.15.84:0/1628782724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5aa80c5290 0x7f5aa80c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 -- 172.21.15.84:0/1628782724 >> 172.21.15.84:0/1628782724 conn(0x7f5aa8099560 msgr2=0x7f5aa8158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 -- 172.21.15.84:0/1628782724 shutdown_connections 2023-10-06T03:26:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.620+0000 7f5aad06a700 1 -- 172.21.15.84:0/1628782724 wait complete. 2023-10-06T03:26:06.633 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.746+0000 7fdc76780700 1 Processor -- start 2023-10-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.746+0000 7fdc76780700 1 -- start start 2023-10-06T03:26:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc76780700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc70157080 0x7fdc700cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc76780700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc70157450 0x7fdc7006d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc76780700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7015b210 con 0x7fdc7015b6a0 2023-10-06T03:26:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc76780700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7006db20 con 0x7fdc70157450 2023-10-06T03:26:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc76780700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700ce4f0 con 0x7fdc70157080 2023-10-06T03:26:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc75f7f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdc7015b6a0 0x7fdc700c9fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55256/0 (socket says 172.21.15.84:55256) 2023-10-06T03:26:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc75f7f700 1 -- 172.21.15.84:0/4019542384 learned_addr learned my addr 172.21.15.84:0/4019542384 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc7577e700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc70157080 0x7fdc700cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc74f7d700 1 --2- 172.21.15.84:0/4019542384 >> v2:172.21.15.131:3300/0 conn(0x7fdc70157450 0x7fdc7006d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289510879 0 0) 0x7fdc7015b210 con 0x7fdc7015b6a0 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.747+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc5c003570 con 0x7fdc7015b6a0 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2839061652 0 0) 0x7fdc5c003570 con 0x7fdc7015b6a0 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc70157080 msgr2=0x7fdc700cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc70157080 0x7fdc700cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 >> v2:172.21.15.131:3300/0 conn(0x7fdc70157450 msgr2=0x7fdc7006d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 --2- 172.21.15.84:0/4019542384 >> v2:172.21.15.131:3300/0 conn(0x7fdc70157450 0x7fdc7006d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc700ce7d0 con 0x7fdc7015b6a0 2023-10-06T03:26:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fdc680017f0 con 0x7fdc7015b6a0 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 >> v1:172.21.15.84:6789/0 conn(0x7fdc7015b6a0 legacy=0x7fdc700c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc5c003a60 0x7fdc5c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc70157080 0x7fdc5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc5c004d50 0x7fdc5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7006db20 con 0x7fdc5c003a60 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700ce4f0 con 0x7fdc5c004d50 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c00ba60 con 0x7fdc70157080 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc7577e700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc5c003a60 0x7fdc5c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc74f7d700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc70157080 0x7fdc5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc75f7f700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc5c004d50 0x7fdc5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc7577e700 1 -- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc70157080 msgr2=0x7fdc5c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc7577e700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc70157080 0x7fdc5c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc7577e700 1 -- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc5c004d50 msgr2=0x7fdc5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc7577e700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc5c004d50 0x7fdc5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc7577e700 1 -- 172.21.15.84:0/4019542384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c003570 con 0x7fdc5c003a60 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc74f7d700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc70157080 0x7fdc5c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc7577e700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc5c003a60 0x7fdc5c003e70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009c00 tx=0x7fdc6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd6cfcf00726484 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c00e6b0 con 0x7fdc5c003a60 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c00e810 con 0x7fdc5c003a60 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.748+0000 7fdc67fff700 1 -- 172.21.15.84:0/4019542384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c00ebd0 con 0x7fdc5c003a60 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.749+0000 7fdc76780700 1 -- 172.21.15.84:0/4019542384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc5c003a60 msgr2=0x7fdc5c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.749+0000 7fdc76780700 1 --2- 172.21.15.84:0/4019542384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc5c003a60 0x7fdc5c003e70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009c00 tx=0x7fdc6c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.749+0000 7fdc75f7f700 1 -- 172.21.15.84:0/4019542384 reap_dead start 2023-10-06T03:26:06.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.749+0000 7fdc76780700 1 -- 172.21.15.84:0/4019542384 shutdown_connections 2023-10-06T03:26:06.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.749+0000 7fdc76780700 1 -- 172.21.15.84:0/4019542384 >> 172.21.15.84:0/4019542384 conn(0x7fdc7006b540 msgr2=0x7fdc7006b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:06.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.749+0000 7fdc76780700 1 -- 172.21.15.84:0/4019542384 shutdown_connections 2023-10-06T03:26:06.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.749+0000 7fdc76780700 1 -- 172.21.15.84:0/4019542384 wait complete. 2023-10-06T03:26:06.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.750+0000 7fdc76780700 1 Processor -- start 2023-10-06T03:26:06.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.750+0000 7fdc76780700 1 -- start start 2023-10-06T03:26:06.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc76780700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc5c003a60 0x7fdc7014fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc76780700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc700adc20 0x7fdc700ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc76780700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc70153900 0x7fdc70153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc76780700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700ae5d0 con 0x7fdc70153900 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc76780700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc70167200 con 0x7fdc700adc20 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc76780700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc70154630 con 0x7fdc5c003a60 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc75f7f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc70153900 0x7fdc70153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc75f7f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc70153900 0x7fdc70153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50648/0 (socket says 172.21.15.84:50648) 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc75f7f700 1 -- 172.21.15.84:0/4265982610 learned_addr learned my addr 172.21.15.84:0/4265982610 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc7577e700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc5c003a60 0x7fdc7014fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc74f7d700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc700adc20 0x7fdc700ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc75f7f700 1 -- 172.21.15.84:0/4265982610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc5c003a60 msgr2=0x7fdc7014fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc75f7f700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc5c003a60 0x7fdc7014fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc75f7f700 1 -- 172.21.15.84:0/4265982610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc700adc20 msgr2=0x7fdc700ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc75f7f700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc700adc20 0x7fdc700ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc75f7f700 1 -- 172.21.15.84:0/4265982610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc70154910 con 0x7fdc70153900 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc7577e700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc5c003a60 0x7fdc7014fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.751+0000 7fdc75f7f700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc70153900 0x7fdc70153d50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fdc7015ba70 tx=0x7fdc68001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.752+0000 7fdc657fa700 1 -- 172.21.15.84:0/4265982610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6800ebc0 con 0x7fdc70153900 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.752+0000 7fdc657fa700 1 -- 172.21.15.84:0/4265982610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6800ed60 con 0x7fdc70153900 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.752+0000 7fdc657fa700 1 -- 172.21.15.84:0/4265982610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68013670 con 0x7fdc70153900 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.752+0000 7fdc76780700 1 -- 172.21.15.84:0/4265982610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc70154bf0 con 0x7fdc70153900 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.752+0000 7fdc76780700 1 -- 172.21.15.84:0/4265982610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc70154290 con 0x7fdc70153900 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.752+0000 7fdc76780700 1 -- 172.21.15.84:0/4265982610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc70167420 con 0x7fdc70153900 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.753+0000 7fdc657fa700 1 -- 172.21.15.84:0/4265982610 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc68013a20 con 0x7fdc70153900 2023-10-06T03:26:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.753+0000 7fdc657fa700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc54066f30 0x7fdc540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.753+0000 7fdc657fa700 1 -- 172.21.15.84:0/4265982610 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fdc68084a80 con 0x7fdc70153900 2023-10-06T03:26:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.753+0000 7fdc7577e700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc54066f30 0x7fdc540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.754+0000 7fdc7577e700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc54066f30 0x7fdc540693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0091e0 tx=0x7fdc6c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.757+0000 7fdc657fa700 1 -- 172.21.15.84:0/4265982610 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc70167420 con 0x7fdc70153900 2023-10-06T03:26:06.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.942+0000 7fdc76780700 1 -- 172.21.15.84:0/4265982610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdc7005f270 con 0x7fdc70153900 2023-10-06T03:26:06.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.943+0000 7fdc657fa700 1 -- 172.21.15.84:0/4265982610 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) v1 ==== 84+0+126 (secure 0 0 0) 0x7fdc68051da0 con 0x7fdc70153900 2023-10-06T03:26:06.945 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:06.945 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T03:26:06.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:06.945 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T03:26:06.945 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T03:26:06.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:06.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:06.945 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T03:26:06.945 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T03:26:06.945 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:06.946 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T03:26:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 -- 172.21.15.84:0/4265982610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc54066f30 msgr2=0x7fdc540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc54066f30 0x7fdc540693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0091e0 tx=0x7fdc6c01a000 comp rx=0 tx=0).stop 2023-10-06T03:26:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 -- 172.21.15.84:0/4265982610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc70153900 msgr2=0x7fdc70153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc70153900 0x7fdc70153d50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fdc7015ba70 tx=0x7fdc68001860 comp rx=0 tx=0).stop 2023-10-06T03:26:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 -- 172.21.15.84:0/4265982610 shutdown_connections 2023-10-06T03:26:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc54066f30 0x7fdc540693e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc70153900 0x7fdc70153d50 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc5c003a60 0x7fdc7014fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 --2- 172.21.15.84:0/4265982610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc700adc20 0x7fdc700ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:06.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 -- 172.21.15.84:0/4265982610 >> 172.21.15.84:0/4265982610 conn(0x7fdc7006b540 msgr2=0x7fdc700cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:06.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 -- 172.21.15.84:0/4265982610 shutdown_connections 2023-10-06T03:26:06.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:06.945+0000 7fdc76780700 1 -- 172.21.15.84:0/4265982610 wait complete. 2023-10-06T03:26:06.959 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:26:06.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:26:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.076+0000 7fc9ab1dd700 1 Processor -- start 2023-10-06T03:26:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.076+0000 7fc9ab1dd700 1 -- start start 2023-10-06T03:26:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9ab1dd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9a40ccab0 0x7fc9a40d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9ab1dd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a40d0830 0x7fc9a40ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9ab1dd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a40d0c90 con 0x7fc9a41539d0 2023-10-06T03:26:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9ab1dd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a40cdc30 con 0x7fc9a40ccab0 2023-10-06T03:26:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9ab1dd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40cb500 con 0x7fc9a40d0830 2023-10-06T03:26:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9aa1db700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc9a41539d0 0x7fc9a415a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55260/0 (socket says 172.21.15.84:55260) 2023-10-06T03:26:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9aa1db700 1 -- 172.21.15.84:0/3442225337 learned_addr learned my addr 172.21.15.84:0/3442225337 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9aa9dc700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a40d0830 0x7fc9a40ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9a99da700 1 --2- 172.21.15.84:0/3442225337 >> v2:172.21.15.131:3300/0 conn(0x7fc9a40ccab0 0x7fc9a40d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571885047 0 0) 0x7fc99c001110 con 0x7fc9a41539d0 2023-10-06T03:26:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.077+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc98c003570 con 0x7fc9a41539d0 2023-10-06T03:26:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 194630175 0 0) 0x7fc98c003570 con 0x7fc9a41539d0 2023-10-06T03:26:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a40d0830 msgr2=0x7fc9a40ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a40d0830 0x7fc9a40ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 >> v2:172.21.15.131:3300/0 conn(0x7fc9a40ccab0 msgr2=0x7fc9a40d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 --2- 172.21.15.84:0/3442225337 >> v2:172.21.15.131:3300/0 conn(0x7fc9a40ccab0 0x7fc9a40d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40cd020 con 0x7fc9a41539d0 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fc99c001600 con 0x7fc9a41539d0 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 >> v1:172.21.15.84:6789/0 conn(0x7fc9a41539d0 legacy=0x7fc9a415a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a40d0830 0x7fc98c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c003fe0 0x7fc98c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 0x7fc98c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40cdc30 con 0x7fc98c004d50 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40cb500 con 0x7fc98c003fe0 2023-10-06T03:26:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c00ba90 con 0x7fc9a40d0830 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9aa9dc700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 0x7fc98c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9aa1db700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a40d0830 0x7fc98c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a99da700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c003fe0 0x7fc98c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9aa9dc700 1 -- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a40d0830 msgr2=0x7fc98c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9aa9dc700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a40d0830 0x7fc98c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9aa9dc700 1 -- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c003fe0 msgr2=0x7fc98c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9aa9dc700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c003fe0 0x7fc98c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9aa9dc700 1 -- 172.21.15.84:0/3442225337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c003570 con 0x7fc98c004d50 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a99da700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c003fe0 0x7fc98c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9aa9dc700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 0x7fc98c0051c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc99400e210 tx=0x7fc99400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a4dbcb002120ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400ea60 con 0x7fc98c004d50 2023-10-06T03:26:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99400f040 con 0x7fc98c004d50 2023-10-06T03:26:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.078+0000 7fc9a91d9700 1 -- 172.21.15.84:0/3442225337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400ee10 con 0x7fc98c004d50 2023-10-06T03:26:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.079+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/3442225337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 msgr2=0x7fc98c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.079+0000 7fc9ab1dd700 1 --2- 172.21.15.84:0/3442225337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 0x7fc98c0051c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc99400e210 tx=0x7fc99400b040 comp rx=0 tx=0).stop 2023-10-06T03:26:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.079+0000 7fc9aa9dc700 1 -- 172.21.15.84:0/3442225337 reap_dead start 2023-10-06T03:26:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.079+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/3442225337 shutdown_connections 2023-10-06T03:26:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.079+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/3442225337 >> 172.21.15.84:0/3442225337 conn(0x7fc9a4068100 msgr2=0x7fc9a40684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.079+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/3442225337 shutdown_connections 2023-10-06T03:26:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.079+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/3442225337 wait complete. 2023-10-06T03:26:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.080+0000 7fc9ab1dd700 1 Processor -- start 2023-10-06T03:26:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.080+0000 7fc9ab1dd700 1 -- start start 2023-10-06T03:26:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9ab1dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 0x7fc9a4153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9ab1dd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a4158fe0 0x7fc9a416d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9ab1dd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a416d600 0x7fc9a40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9ab1dd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a416da70 con 0x7fc98c004d50 2023-10-06T03:26:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9ab1dd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a4141660 con 0x7fc9a416d600 2023-10-06T03:26:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9ab1dd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40c88d0 con 0x7fc9a4158fe0 2023-10-06T03:26:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa1db700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 0x7fc9a4153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa1db700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 0x7fc9a4153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50662/0 (socket says 172.21.15.84:50662) 2023-10-06T03:26:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa1db700 1 -- 172.21.15.84:0/1116977729 learned_addr learned my addr 172.21.15.84:0/1116977729 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9a99da700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a4158fe0 0x7fc9a416d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa9dc700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a416d600 0x7fc9a40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa1db700 1 -- 172.21.15.84:0/1116977729 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a4158fe0 msgr2=0x7fc9a416d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa1db700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a4158fe0 0x7fc9a416d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa1db700 1 -- 172.21.15.84:0/1116977729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a416d600 msgr2=0x7fc9a40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa1db700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a416d600 0x7fc9a40b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa1db700 1 -- 172.21.15.84:0/1116977729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40c7cc0 con 0x7fc98c004d50 2023-10-06T03:26:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa9dc700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a416d600 0x7fc9a40b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.081+0000 7fc9aa1db700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 0x7fc9a4153da0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc99c007390 tx=0x7fc99c007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.082+0000 7fc9a27fc700 1 -- 172.21.15.84:0/1116977729 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c018030 con 0x7fc98c004d50 2023-10-06T03:26:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.082+0000 7fc9a27fc700 1 -- 172.21.15.84:0/1116977729 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c00f8d0 con 0x7fc98c004d50 2023-10-06T03:26:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.082+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/1116977729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a40c7fa0 con 0x7fc98c004d50 2023-10-06T03:26:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.082+0000 7fc9a27fc700 1 -- 172.21.15.84:0/1116977729 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00fcd0 con 0x7fc98c004d50 2023-10-06T03:26:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.082+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/1116977729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a40c8560 con 0x7fc98c004d50 2023-10-06T03:26:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.082+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/1116977729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a405f270 con 0x7fc98c004d50 2023-10-06T03:26:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.083+0000 7fc9a27fc700 1 -- 172.21.15.84:0/1116977729 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc99c01b070 con 0x7fc98c004d50 2023-10-06T03:26:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.083+0000 7fc9a27fc700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc990066f30 0x7fc9900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.083+0000 7fc9a27fc700 1 -- 172.21.15.84:0/1116977729 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc99c019070 con 0x7fc98c004d50 2023-10-06T03:26:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.083+0000 7fc9a99da700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc990066f30 0x7fc9900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.084+0000 7fc9a99da700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc990066f30 0x7fc9900693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc998009170 tx=0x7fc998008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.087+0000 7fc9a27fc700 1 -- 172.21.15.84:0/1116977729 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc99c0514e0 con 0x7fc98c004d50 2023-10-06T03:26:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:07.271+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/1116977729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc9a40d0c90 con 0x7fc98c004d50 2023-10-06T03:26:08.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.249+0000 7fc9a27fc700 1 -- 172.21.15.84:0/1116977729 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc9a40d0c90 con 0x7fc98c004d50 2023-10-06T03:26:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.253+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/1116977729 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc990066f30 msgr2=0x7fc9900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.253+0000 7fc9ab1dd700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc990066f30 0x7fc9900693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc998009170 tx=0x7fc998008040 comp rx=0 tx=0).stop 2023-10-06T03:26:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.253+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/1116977729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 msgr2=0x7fc9a4153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.253+0000 7fc9ab1dd700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 0x7fc9a4153da0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc99c007390 tx=0x7fc99c007a80 comp rx=0 tx=0).stop 2023-10-06T03:26:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.253+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/1116977729 shutdown_connections 2023-10-06T03:26:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.253+0000 7fc9ab1dd700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc990066f30 0x7fc9900693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.253+0000 7fc9ab1dd700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a416d600 0x7fc9a40b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.253+0000 7fc9ab1dd700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c004d50 0x7fc9a4153da0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.253+0000 7fc9ab1dd700 1 --2- 172.21.15.84:0/1116977729 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a4158fe0 0x7fc9a416d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.254+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/1116977729 >> 172.21.15.84:0/1116977729 conn(0x7fc9a4068100 msgr2=0x7fc9a41599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:08.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.254+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/1116977729 shutdown_connections 2023-10-06T03:26:08.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.254+0000 7fc9ab1dd700 1 -- 172.21.15.84:0/1116977729 wait complete. 2023-10-06T03:26:08.257 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T03:26:08.270 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:26:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.389+0000 7f3e4bfff700 1 Processor -- start 2023-10-06T03:26:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.390+0000 7f3e4bfff700 1 -- start start 2023-10-06T03:26:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.390+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e4c0b2660 0x7f3e4c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.390+0000 7f3e4bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e4c0b2a30 0x7f3e4c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.390+0000 7f3e4bfff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3e4c0ceae0 0x7f3e4c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.390+0000 7f3e4bfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0cc9b0 con 0x7f3e4c0b2a30 2023-10-06T03:26:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.390+0000 7f3e4bfff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0cf4c0 con 0x7f3e4c0ceae0 2023-10-06T03:26:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.390+0000 7f3e4bfff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0cbda0 con 0x7f3e4c0b2660 2023-10-06T03:26:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.390+0000 7f3e427fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e4c0b2a30 0x7f3e4c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e427fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e4c0b2a30 0x7f3e4c0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50666/0 (socket says 172.21.15.84:50666) 2023-10-06T03:26:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e427fc700 1 -- 172.21.15.84:0/2143200444 learned_addr learned my addr 172.21.15.84:0/2143200444 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e4affd700 1 --2- 172.21.15.84:0/2143200444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e4c0b2660 0x7f3e4c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e4b7fe700 1 --2- 172.21.15.84:0/2143200444 >> v2:172.21.15.131:3300/0 conn(0x7f3e4c0ceae0 0x7f3e4c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e427fc700 1 -- 172.21.15.84:0/2143200444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e4c0b2660 msgr2=0x7f3e4c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e427fc700 1 --2- 172.21.15.84:0/2143200444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e4c0b2660 0x7f3e4c0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e427fc700 1 -- 172.21.15.84:0/2143200444 >> v2:172.21.15.131:3300/0 conn(0x7f3e4c0ceae0 msgr2=0x7f3e4c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e427fc700 1 --2- 172.21.15.84:0/2143200444 >> v2:172.21.15.131:3300/0 conn(0x7f3e4c0ceae0 0x7f3e4c0cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e427fc700 1 -- 172.21.15.84:0/2143200444 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0cc080 con 0x7f3e4c0b2a30 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e4b7fe700 1 --2- 172.21.15.84:0/2143200444 >> v2:172.21.15.131:3300/0 conn(0x7f3e4c0ceae0 0x7f3e4c0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e427fc700 1 --2- 172.21.15.84:0/2143200444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2a30 0x7f3e4c0cd230 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c089690 tx=0x7f3e34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9246c0747cf1a0c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e4a7fc700 1 -- 172.21.15.84:0/2143200444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34009e70 con 0x7f3e4c0b2a30 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e4a7fc700 1 -- 172.21.15.84:0/2143200444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400b860 con 0x7f3e4c0b2a30 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.391+0000 7f3e4a7fc700 1 -- 172.21.15.84:0/2143200444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400bc00 con 0x7f3e4c0b2a30 2023-10-06T03:26:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.392+0000 7f3e4bfff700 1 -- 172.21.15.84:0/2143200444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2a30 msgr2=0x7f3e4c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.392+0000 7f3e4bfff700 1 --2- 172.21.15.84:0/2143200444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2a30 0x7f3e4c0cd230 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c089690 tx=0x7f3e34009250 comp rx=0 tx=0).stop 2023-10-06T03:26:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.392+0000 7f3e4bfff700 1 -- 172.21.15.84:0/2143200444 shutdown_connections 2023-10-06T03:26:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.392+0000 7f3e4bfff700 1 --2- 172.21.15.84:0/2143200444 >> v2:172.21.15.131:3300/0 conn(0x7f3e4c0ceae0 0x7f3e4c0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.392+0000 7f3e4bfff700 1 --2- 172.21.15.84:0/2143200444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e4c0b2660 0x7f3e4c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.392+0000 7f3e4bfff700 1 --2- 172.21.15.84:0/2143200444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2a30 0x7f3e4c0cd230 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.392+0000 7f3e4bfff700 1 -- 172.21.15.84:0/2143200444 >> 172.21.15.84:0/2143200444 conn(0x7f3e4c099560 msgr2=0x7f3e4c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.392+0000 7f3e4bfff700 1 -- 172.21.15.84:0/2143200444 shutdown_connections 2023-10-06T03:26:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.392+0000 7f3e4bfff700 1 -- 172.21.15.84:0/2143200444 wait complete. 2023-10-06T03:26:08.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.393+0000 7f3e4bfff700 1 Processor -- start 2023-10-06T03:26:08.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.393+0000 7f3e4bfff700 1 -- start start 2023-10-06T03:26:08.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2660 0x7f3e4c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:08.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e4c0b2a30 0x7f3e4c09c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e4c0ceae0 0x7f3e4c0c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c146910 con 0x7f3e4c0b2660 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4bfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c09cc40 con 0x7f3e4c0b2a30 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4bfff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c09cf20 con 0x7f3e4c0ceae0 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2660 0x7f3e4c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2660 0x7f3e4c15a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50668/0 (socket says 172.21.15.84:50668) 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4affd700 1 -- 172.21.15.84:0/3233997899 learned_addr learned my addr 172.21.15.84:0/3233997899 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4b7fe700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e4c0ceae0 0x7f3e4c0c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e427fc700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e4c0b2a30 0x7f3e4c09c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4affd700 1 -- 172.21.15.84:0/3233997899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e4c0ceae0 msgr2=0x7f3e4c0c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4affd700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e4c0ceae0 0x7f3e4c0c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4affd700 1 -- 172.21.15.84:0/3233997899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e4c0b2a30 msgr2=0x7f3e4c09c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4affd700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e4c0b2a30 0x7f3e4c09c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4affd700 1 -- 172.21.15.84:0/3233997899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e340094f0 con 0x7f3e4c0b2660 2023-10-06T03:26:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4affd700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2660 0x7f3e4c15a320 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00ea00 tx=0x7f3e3c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e437fe700 1 -- 172.21.15.84:0/3233997899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00c850 con 0x7f3e4c0b2660 2023-10-06T03:26:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e437fe700 1 -- 172.21.15.84:0/3233997899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c00c9b0 con 0x7f3e4c0b2660 2023-10-06T03:26:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4bfff700 1 -- 172.21.15.84:0/3233997899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c09d200 con 0x7f3e4c0b2660 2023-10-06T03:26:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e437fe700 1 -- 172.21.15.84:0/3233997899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00cd30 con 0x7f3e4c0b2660 2023-10-06T03:26:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.394+0000 7f3e4bfff700 1 -- 172.21.15.84:0/3233997899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c09d7c0 con 0x7f3e4c0b2660 2023-10-06T03:26:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.395+0000 7f3e4bfff700 1 -- 172.21.15.84:0/3233997899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c05f270 con 0x7f3e4c0b2660 2023-10-06T03:26:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.396+0000 7f3e437fe700 1 -- 172.21.15.84:0/3233997899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e3c013680 con 0x7f3e4c0b2660 2023-10-06T03:26:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.396+0000 7f3e437fe700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e2c066f30 0x7f3e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.396+0000 7f3e437fe700 1 -- 172.21.15.84:0/3233997899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f3e3c084c90 con 0x7f3e4c0b2660 2023-10-06T03:26:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.396+0000 7f3e427fc700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e2c066f30 0x7f3e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.397+0000 7f3e427fc700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e2c066f30 0x7f3e2c0693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c089690 tx=0x7f3e34017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.400+0000 7f3e437fe700 1 -- 172.21.15.84:0/3233997899 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e3c051e40 con 0x7f3e4c0b2660 2023-10-06T03:26:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:08.583+0000 7f3e4bfff700 1 -- 172.21.15.84:0/3233997899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3e4c0cc360 con 0x7f3e4c0b2660 2023-10-06T03:26:09.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.256+0000 7f3e437fe700 1 -- 172.21.15.84:0/3233997899 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v72) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3e3c0210d0 con 0x7f3e4c0b2660 2023-10-06T03:26:09.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.259+0000 7f3e4bfff700 1 -- 172.21.15.84:0/3233997899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e2c066f30 msgr2=0x7f3e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:09.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.259+0000 7f3e4bfff700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e2c066f30 0x7f3e2c0693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c089690 tx=0x7f3e34017000 comp rx=0 tx=0).stop 2023-10-06T03:26:09.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.259+0000 7f3e4bfff700 1 -- 172.21.15.84:0/3233997899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2660 msgr2=0x7f3e4c15a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:09.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.259+0000 7f3e4bfff700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2660 0x7f3e4c15a320 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00ea00 tx=0x7f3e3c009120 comp rx=0 tx=0).stop 2023-10-06T03:26:09.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.260+0000 7f3e4bfff700 1 -- 172.21.15.84:0/3233997899 shutdown_connections 2023-10-06T03:26:09.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.260+0000 7f3e4bfff700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3e2c066f30 0x7f3e2c0693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:09.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.260+0000 7f3e4bfff700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e4c0ceae0 0x7f3e4c0c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:09.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.260+0000 7f3e4bfff700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e4c0b2660 0x7f3e4c15a320 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:09.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.260+0000 7f3e4bfff700 1 --2- 172.21.15.84:0/3233997899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e4c0b2a30 0x7f3e4c09c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:09.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.260+0000 7f3e4bfff700 1 -- 172.21.15.84:0/3233997899 >> 172.21.15.84:0/3233997899 conn(0x7f3e4c099560 msgr2=0x7f3e4c158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:09.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.260+0000 7f3e4bfff700 1 -- 172.21.15.84:0/3233997899 shutdown_connections 2023-10-06T03:26:09.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.260+0000 7f3e4bfff700 1 -- 172.21.15.84:0/3233997899 wait complete. 2023-10-06T03:26:09.272 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T03:26:09.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:26:09.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.403+0000 7f61b86f1700 1 Processor -- start 2023-10-06T03:26:09.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.403+0000 7f61b86f1700 1 -- start start 2023-10-06T03:26:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.404+0000 7f61b86f1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61b00b0860 0x7f61b0068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.404+0000 7f61b86f1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f61b00c4490 0x7f61b00cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.404+0000 7f61b86f1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b00c96b0 con 0x7f61b00cc780 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.404+0000 7f61b86f1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b0159c40 con 0x7f61b00b0860 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.404+0000 7f61b86f1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b00c8aa0 con 0x7f61b00c4490 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.404+0000 7f61b648d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61b00b0860 0x7f61b0068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.404+0000 7f61b648d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61b00b0860 0x7f61b0068700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50678/0 (socket says 172.21.15.84:50678) 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.404+0000 7f61b6c8e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f61b00cc780 0x7f61b00ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55272/0 (socket says 172.21.15.84:55272) 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.404+0000 7f61b648d700 1 -- 172.21.15.84:0/1678219173 learned_addr learned my addr 172.21.15.84:0/1678219173 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.405+0000 7f61b5c8c700 1 --2- 172.21.15.84:0/1678219173 >> v2:172.21.15.131:3300/0 conn(0x7f61b00c4490 0x7f61b00cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.405+0000 7f61b648d700 1 -- 172.21.15.84:0/1678219173 >> v2:172.21.15.131:3300/0 conn(0x7f61b00c4490 msgr2=0x7f61b00cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.405+0000 7f61b648d700 1 --2- 172.21.15.84:0/1678219173 >> v2:172.21.15.131:3300/0 conn(0x7f61b00c4490 0x7f61b00cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.405+0000 7f61b648d700 1 -- 172.21.15.84:0/1678219173 >> v1:172.21.15.84:6789/0 conn(0x7f61b00cc780 legacy=0x7f61b00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.405+0000 7f61b648d700 1 -- 172.21.15.84:0/1678219173 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b00c8d80 con 0x7f61b00b0860 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.405+0000 7f61b548b700 1 -- 172.21.15.84:0/1678219173 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359547684 0 0) 0x7f61b00c96b0 con 0x7f61b00cc780 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.405+0000 7f61b648d700 1 --2- 172.21.15.84:0/1678219173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00b0860 0x7f61b0068700 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f61b006edb0 tx=0x7f61ac009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bd8de3d66702bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.405+0000 7f61b548b700 1 -- 172.21.15.84:0/1678219173 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac005c10 con 0x7f61b00b0860 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.405+0000 7f61b548b700 1 -- 172.21.15.84:0/1678219173 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac005d70 con 0x7f61b00b0860 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.405+0000 7f61b548b700 1 -- 172.21.15.84:0/1678219173 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac00b880 con 0x7f61b00b0860 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.406+0000 7f61b86f1700 1 -- 172.21.15.84:0/1678219173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00b0860 msgr2=0x7f61b0068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.406+0000 7f61b86f1700 1 --2- 172.21.15.84:0/1678219173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00b0860 0x7f61b0068700 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f61b006edb0 tx=0x7f61ac009220 comp rx=0 tx=0).stop 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.406+0000 7f61b86f1700 1 -- 172.21.15.84:0/1678219173 shutdown_connections 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.406+0000 7f61b86f1700 1 --2- 172.21.15.84:0/1678219173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00b0860 0x7f61b0068700 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.406+0000 7f61b86f1700 1 --2- 172.21.15.84:0/1678219173 >> v2:172.21.15.131:3300/0 conn(0x7f61b00c4490 0x7f61b00cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.406+0000 7f61b86f1700 1 -- 172.21.15.84:0/1678219173 >> 172.21.15.84:0/1678219173 conn(0x7f61b0088000 msgr2=0x7f61b00ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.406+0000 7f61b86f1700 1 -- 172.21.15.84:0/1678219173 shutdown_connections 2023-10-06T03:26:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.406+0000 7f61b86f1700 1 -- 172.21.15.84:0/1678219173 wait complete. 2023-10-06T03:26:09.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.407+0000 7f61b86f1700 1 Processor -- start 2023-10-06T03:26:09.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.407+0000 7f61b86f1700 1 -- start start 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.407+0000 7f61b86f1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61b00b0860 0x7f61b0146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.407+0000 7f61b86f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00c4490 0x7f61b016a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b86f1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b00cc780 0x7f61b016abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b86f1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0146760 con 0x7f61b00c4490 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b86f1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b006c180 con 0x7f61b00b0860 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b86f1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b006b570 con 0x7f61b00cc780 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b5c8c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00c4490 0x7f61b016a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b5c8c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00c4490 0x7f61b016a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50682/0 (socket says 172.21.15.84:50682) 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b5c8c700 1 -- 172.21.15.84:0/2947408391 learned_addr learned my addr 172.21.15.84:0/2947408391 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b648d700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61b00b0860 0x7f61b0146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b5c8c700 1 -- 172.21.15.84:0/2947408391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b00cc780 msgr2=0x7f61b016abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b5c8c700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b00cc780 0x7f61b016abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b5c8c700 1 -- 172.21.15.84:0/2947408391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61b00b0860 msgr2=0x7f61b0146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b5c8c700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61b00b0860 0x7f61b0146220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b5c8c700 1 -- 172.21.15.84:0/2947408391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac009480 con 0x7f61b00c4490 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b5c8c700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00c4490 0x7f61b016a1b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f61a000d890 tx=0x7f61a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61a67fc700 1 -- 172.21.15.84:0/2947408391 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000b600 con 0x7f61b00c4490 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61a67fc700 1 -- 172.21.15.84:0/2947408391 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a000b760 con 0x7f61b00c4490 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61a67fc700 1 -- 172.21.15.84:0/2947408391 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000bae0 con 0x7f61b00c4490 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b86f1700 1 -- 172.21.15.84:0/2947408391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b006b850 con 0x7f61b00c4490 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.408+0000 7f61b86f1700 1 -- 172.21.15.84:0/2947408391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b006be10 con 0x7f61b00c4490 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.409+0000 7f61b86f1700 1 -- 172.21.15.84:0/2947408391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b006c2f0 con 0x7f61b00c4490 2023-10-06T03:26:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.410+0000 7f61a67fc700 1 -- 172.21.15.84:0/2947408391 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61a001e460 con 0x7f61b00c4490 2023-10-06T03:26:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.410+0000 7f61a67fc700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6194066f30 0x7f61940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.410+0000 7f61a67fc700 1 -- 172.21.15.84:0/2947408391 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f61a0084e00 con 0x7f61b00c4490 2023-10-06T03:26:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.410+0000 7f61b648d700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6194066f30 0x7f61940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.410+0000 7f61b648d700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6194066f30 0x7f61940693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009fd0 tx=0x7f61ac016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.414+0000 7f61a67fc700 1 -- 172.21.15.84:0/2947408391 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61a0051e30 con 0x7f61b00c4490 2023-10-06T03:26:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:09.640+0000 7f61b86f1700 1 -- 172.21.15.84:0/2947408391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f61b0064ad0 con 0x7f61b00c4490 2023-10-06T03:26:10.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.268+0000 7f61a67fc700 1 -- 172.21.15.84:0/2947408391 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v35) v1 ==== 174+0+0 (secure 0 0 0) 0x7f61a0055450 con 0x7f61b00c4490 2023-10-06T03:26:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 -- 172.21.15.84:0/2947408391 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6194066f30 msgr2=0x7f61940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6194066f30 0x7f61940693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009fd0 tx=0x7f61ac016000 comp rx=0 tx=0).stop 2023-10-06T03:26:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 -- 172.21.15.84:0/2947408391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00c4490 msgr2=0x7f61b016a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00c4490 0x7f61b016a1b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f61a000d890 tx=0x7f61a0008040 comp rx=0 tx=0).stop 2023-10-06T03:26:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 -- 172.21.15.84:0/2947408391 shutdown_connections 2023-10-06T03:26:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6194066f30 0x7f61940693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61b00b0860 0x7f61b0146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b00cc780 0x7f61b016abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 --2- 172.21.15.84:0/2947408391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b00c4490 0x7f61b016a1b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 -- 172.21.15.84:0/2947408391 >> 172.21.15.84:0/2947408391 conn(0x7f61b0088000 msgr2=0x7f61b00c30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 -- 172.21.15.84:0/2947408391 shutdown_connections 2023-10-06T03:26:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.282+0000 7f61b86f1700 1 -- 172.21.15.84:0/2947408391 wait complete. 2023-10-06T03:26:10.291 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 12 and data pool 13 2023-10-06T03:26:10.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:10.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.417+0000 7f1fe359e700 1 Processor -- start 2023-10-06T03:26:10.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.417+0000 7f1fe359e700 1 -- start start 2023-10-06T03:26:10.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe359e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1fe4157080 0x7f1fe40cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fe4157450 0x7f1fe406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1fe415b6a0 0x7f1fe40c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe359e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe415b210 con 0x7f1fe415b6a0 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe359e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe406db20 con 0x7f1fe4157080 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40ce4f0 con 0x7f1fe4157450 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe2d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1fe415b6a0 0x7f1fe40c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe2d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1fe415b6a0 0x7f1fe40c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50694/0 (socket says 172.21.15.84:50694) 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe2d9d700 1 -- 172.21.15.84:0/105417172 learned_addr learned my addr 172.21.15.84:0/105417172 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fd9d9b700 1 --2- 172.21.15.84:0/105417172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fe4157450 0x7f1fe406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe259c700 1 --2- 172.21.15.84:0/105417172 >> v2:172.21.15.131:3300/0 conn(0x7f1fe4157080 0x7f1fe40cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe2d9d700 1 -- 172.21.15.84:0/105417172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fe4157450 msgr2=0x7f1fe406d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe2d9d700 1 --2- 172.21.15.84:0/105417172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fe4157450 0x7f1fe406d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe2d9d700 1 -- 172.21.15.84:0/105417172 >> v2:172.21.15.131:3300/0 conn(0x7f1fe4157080 msgr2=0x7f1fe40cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe2d9d700 1 --2- 172.21.15.84:0/105417172 >> v2:172.21.15.131:3300/0 conn(0x7f1fe4157080 0x7f1fe40cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe2d9d700 1 -- 172.21.15.84:0/105417172 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40ce7d0 con 0x7f1fe415b6a0 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.418+0000 7f1fe259c700 1 --2- 172.21.15.84:0/105417172 >> v2:172.21.15.131:3300/0 conn(0x7f1fe4157080 0x7f1fe40cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe2d9d700 1 --2- 172.21.15.84:0/105417172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe415b6a0 0x7f1fe40c9fd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1fe406ebd0 tx=0x7f1fdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d565189c6ada00c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe1d9b700 1 -- 172.21.15.84:0/105417172 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00e070 con 0x7f1fe415b6a0 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe1d9b700 1 -- 172.21.15.84:0/105417172 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc00ba50 con 0x7f1fe415b6a0 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe1d9b700 1 -- 172.21.15.84:0/105417172 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0092e0 con 0x7f1fe415b6a0 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe359e700 1 -- 172.21.15.84:0/105417172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe415b6a0 msgr2=0x7f1fe40c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe359e700 1 --2- 172.21.15.84:0/105417172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe415b6a0 0x7f1fe40c9fd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1fe406ebd0 tx=0x7f1fdc009840 comp rx=0 tx=0).stop 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe359e700 1 -- 172.21.15.84:0/105417172 shutdown_connections 2023-10-06T03:26:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe359e700 1 --2- 172.21.15.84:0/105417172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe415b6a0 0x7f1fe40c9fd0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe359e700 1 --2- 172.21.15.84:0/105417172 >> v2:172.21.15.131:3300/0 conn(0x7f1fe4157080 0x7f1fe40cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe359e700 1 --2- 172.21.15.84:0/105417172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fe4157450 0x7f1fe406d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe359e700 1 -- 172.21.15.84:0/105417172 >> 172.21.15.84:0/105417172 conn(0x7f1fe406b540 msgr2=0x7f1fe406b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:10.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe359e700 1 -- 172.21.15.84:0/105417172 shutdown_connections 2023-10-06T03:26:10.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.419+0000 7f1fe359e700 1 -- 172.21.15.84:0/105417172 wait complete. 2023-10-06T03:26:10.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.420+0000 7f1fe359e700 1 Processor -- start 2023-10-06T03:26:10.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.421+0000 7f1fe359e700 1 -- start start 2023-10-06T03:26:10.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.421+0000 7f1fe359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fe4157080 0x7f1fe4146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.421+0000 7f1fe359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe4157450 0x7f1fe4149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.421+0000 7f1fe359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fe415b6a0 0x7f1fe4149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.421+0000 7f1fe359e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4147220 con 0x7f1fe4157450 2023-10-06T03:26:10.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.421+0000 7f1fe359e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe414e320 con 0x7f1fe415b6a0 2023-10-06T03:26:10.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.421+0000 7f1fe359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe41490b0 con 0x7f1fe4157080 2023-10-06T03:26:10.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.421+0000 7f1fd9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe4157450 0x7f1fe4149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.421+0000 7f1fd9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe4157450 0x7f1fe4149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50708/0 (socket says 172.21.15.84:50708) 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.421+0000 7f1fd9d9b700 1 -- 172.21.15.84:0/2987321659 learned_addr learned my addr 172.21.15.84:0/2987321659 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fe259c700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fe4157080 0x7f1fe4146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fe2d9d700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fe415b6a0 0x7f1fe4149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fd9d9b700 1 -- 172.21.15.84:0/2987321659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fe4157080 msgr2=0x7f1fe4146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fd9d9b700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fe4157080 0x7f1fe4146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fd9d9b700 1 -- 172.21.15.84:0/2987321659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fe415b6a0 msgr2=0x7f1fe4149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fd9d9b700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fe415b6a0 0x7f1fe4149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fd9d9b700 1 -- 172.21.15.84:0/2987321659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc009ae0 con 0x7f1fe4157450 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fe2d9d700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fe415b6a0 0x7f1fe4149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:10.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fd9d9b700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe4157450 0x7f1fe4149830 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00d890 tx=0x7f1fcc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fdaffd700 1 -- 172.21.15.84:0/2987321659 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00b600 con 0x7f1fe4157450 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fdaffd700 1 -- 172.21.15.84:0/2987321659 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc00b760 con 0x7f1fe4157450 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fe359e700 1 -- 172.21.15.84:0/2987321659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe414e5c0 con 0x7f1fe4157450 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fdaffd700 1 -- 172.21.15.84:0/2987321659 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00bae0 con 0x7f1fe4157450 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.422+0000 7f1fe359e700 1 -- 172.21.15.84:0/2987321659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe4159e20 con 0x7f1fe4157450 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.423+0000 7f1fe359e700 1 -- 172.21.15.84:0/2987321659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe414ea60 con 0x7f1fe4157450 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.423+0000 7f1fdaffd700 1 -- 172.21.15.84:0/2987321659 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fcc01e460 con 0x7f1fe4157450 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.424+0000 7f1fdaffd700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1fc4066f30 0x7f1fc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.424+0000 7f1fdaffd700 1 -- 172.21.15.84:0/2987321659 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1fcc084f50 con 0x7f1fe4157450 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.424+0000 7f1fe259c700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1fc4066f30 0x7f1fc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.424+0000 7f1fe259c700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1fc4066f30 0x7f1fc40693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4006f00 tx=0x7f1fd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:10.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.428+0000 7f1fdaffd700 1 -- 172.21.15.84:0/2987321659 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fcc051e80 con 0x7f1fe4157450 2023-10-06T03:26:10.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.613+0000 7f1fe359e700 1 -- 172.21.15.84:0/2987321659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fe415aea0 con 0x7f1fe4157450 2023-10-06T03:26:10.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.614+0000 7f1fdaffd700 1 -- 172.21.15.84:0/2987321659 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f1fcc0554a0 con 0x7f1fe4157450 2023-10-06T03:26:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:10.616 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":73,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:09.642246+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:07.289525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:08.601697+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:10.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.616+0000 7f1fe359e700 1 -- 172.21.15.84:0/2987321659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1fc4066f30 msgr2=0x7f1fc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.616+0000 7f1fe359e700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1fc4066f30 0x7f1fc40693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4006f00 tx=0x7f1fd4008040 comp rx=0 tx=0).stop 2023-10-06T03:26:10.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.617+0000 7f1fe359e700 1 -- 172.21.15.84:0/2987321659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe4157450 msgr2=0x7f1fe4149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.617+0000 7f1fe359e700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe4157450 0x7f1fe4149830 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00d890 tx=0x7f1fcc008040 comp rx=0 tx=0).stop 2023-10-06T03:26:10.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.617+0000 7f1fe359e700 1 -- 172.21.15.84:0/2987321659 shutdown_connections 2023-10-06T03:26:10.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.617+0000 7f1fe359e700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1fc4066f30 0x7f1fc40693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.617+0000 7f1fe359e700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fe415b6a0 0x7f1fe4149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.617+0000 7f1fe359e700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fe4157080 0x7f1fe4146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.617+0000 7f1fe359e700 1 --2- 172.21.15.84:0/2987321659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fe4157450 0x7f1fe4149830 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.617+0000 7f1fe359e700 1 -- 172.21.15.84:0/2987321659 >> 172.21.15.84:0/2987321659 conn(0x7f1fe406b540 msgr2=0x7f1fe4147a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:10.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.617+0000 7f1fe359e700 1 -- 172.21.15.84:0/2987321659 shutdown_connections 2023-10-06T03:26:10.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.617+0000 7f1fe359e700 1 -- 172.21.15.84:0/2987321659 wait complete. 2023-10-06T03:26:10.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:10.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.742+0000 7f564a749700 1 Processor -- start 2023-10-06T03:26:10.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.742+0000 7f564a749700 1 -- start start 2023-10-06T03:26:10.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.743+0000 7f564a749700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56441595a0 0x7f56440aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.743+0000 7f564a749700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56440b49e0 0x7f56440aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.743+0000 7f564a749700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440b0ca0 con 0x7f56440b07a0 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.743+0000 7f564a749700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56440b0f80 con 0x7f56440b49e0 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.743+0000 7f564a749700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440b1260 con 0x7f56441595a0 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.743+0000 7f56437fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56440b49e0 0x7f56440aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.743+0000 7f5648ce6700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f56440b07a0 0x7f56440b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48242/0 (socket says 172.21.15.84:48242) 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.743+0000 7f5648ce6700 1 -- 172.21.15.84:0/2333348254 learned_addr learned my addr 172.21.15.84:0/2333348254 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f5643fff700 1 --2- 172.21.15.84:0/2333348254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56441595a0 0x7f56440aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f56437fe700 1 -- 172.21.15.84:0/2333348254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56441595a0 msgr2=0x7f56440aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f56437fe700 1 --2- 172.21.15.84:0/2333348254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56441595a0 0x7f56440aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f56437fe700 1 -- 172.21.15.84:0/2333348254 >> v1:172.21.15.84:6789/0 conn(0x7f56440b07a0 legacy=0x7f56440b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f56437fe700 1 -- 172.21.15.84:0/2333348254 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440b1540 con 0x7f56440b49e0 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f5642ffd700 1 -- 172.21.15.84:0/2333348254 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222325783 0 0) 0x7f56440b0ca0 con 0x7f56440b07a0 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f5643fff700 1 --2- 172.21.15.84:0/2333348254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56441595a0 0x7f56440aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f56437fe700 1 --2- 172.21.15.84:0/2333348254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 0x7f56440aaab0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f56380098e0 tx=0x7f56380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274a573e662320e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f5642ffd700 1 -- 172.21.15.84:0/2333348254 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638009e80 con 0x7f56440b49e0 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f5642ffd700 1 -- 172.21.15.84:0/2333348254 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800b860 con 0x7f56440b49e0 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.744+0000 7f5642ffd700 1 -- 172.21.15.84:0/2333348254 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800bbe0 con 0x7f56440b49e0 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.745+0000 7f564a749700 1 -- 172.21.15.84:0/2333348254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 msgr2=0x7f56440aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.745+0000 7f564a749700 1 --2- 172.21.15.84:0/2333348254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 0x7f56440aaab0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f56380098e0 tx=0x7f56380091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.745+0000 7f564a749700 1 -- 172.21.15.84:0/2333348254 shutdown_connections 2023-10-06T03:26:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.745+0000 7f564a749700 1 --2- 172.21.15.84:0/2333348254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56441595a0 0x7f56440aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.745+0000 7f564a749700 1 --2- 172.21.15.84:0/2333348254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 0x7f56440aaab0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.745+0000 7f564a749700 1 -- 172.21.15.84:0/2333348254 >> 172.21.15.84:0/2333348254 conn(0x7f5644099830 msgr2=0x7f564406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.745+0000 7f564a749700 1 -- 172.21.15.84:0/2333348254 shutdown_connections 2023-10-06T03:26:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.745+0000 7f564a749700 1 -- 172.21.15.84:0/2333348254 wait complete. 2023-10-06T03:26:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.746+0000 7f564a749700 1 Processor -- start 2023-10-06T03:26:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.746+0000 7f564a749700 1 -- start start 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f564a749700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56440b07a0 0x7f564415e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f564a749700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 0x7f564409a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f564a749700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56441595a0 0x7f564409b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f564a749700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564409a5d0 con 0x7f56440b49e0 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f564a749700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564409b410 con 0x7f56441595a0 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f564a749700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564409a800 con 0x7f56440b07a0 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f56437fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 0x7f564409a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f56437fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 0x7f564409a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49368/0 (socket says 172.21.15.84:49368) 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f56437fe700 1 -- 172.21.15.84:0/1601330419 learned_addr learned my addr 172.21.15.84:0/1601330419 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f5643fff700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56440b07a0 0x7f564415e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f56437fe700 1 -- 172.21.15.84:0/1601330419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56440b07a0 msgr2=0x7f564415e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f56437fe700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56440b07a0 0x7f564415e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f56437fe700 1 -- 172.21.15.84:0/1601330419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56441595a0 msgr2=0x7f564409b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f56437fe700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56441595a0 0x7f564409b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f56437fe700 1 -- 172.21.15.84:0/1601330419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638009420 con 0x7f56440b49e0 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f56437fe700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 0x7f564409a090 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5638013000 tx=0x7f5638017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f562bfff700 1 -- 172.21.15.84:0/1601330419 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800bbe0 con 0x7f56440b49e0 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f562bfff700 1 -- 172.21.15.84:0/1601330419 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638011420 con 0x7f56440b49e0 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f562bfff700 1 -- 172.21.15.84:0/1601330419 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56380117e0 con 0x7f56440b49e0 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f564a749700 1 -- 172.21.15.84:0/1601330419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564409aae0 con 0x7f56440b49e0 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.747+0000 7f564a749700 1 -- 172.21.15.84:0/1601330419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564409b0a0 con 0x7f56440b49e0 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.748+0000 7f564a749700 1 -- 172.21.15.84:0/1601330419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564409b5a0 con 0x7f56440b49e0 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.749+0000 7f562bfff700 1 -- 172.21.15.84:0/1601330419 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5638011bd0 con 0x7f56440b49e0 2023-10-06T03:26:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.749+0000 7f562bfff700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5630066f30 0x7f56300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.749+0000 7f562bfff700 1 -- 172.21.15.84:0/1601330419 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5638086320 con 0x7f56440b49e0 2023-10-06T03:26:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.749+0000 7f5643fff700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5630066f30 0x7f56300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.749+0000 7f5643fff700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5630066f30 0x7f56300693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5634008900 tx=0x7f5634008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.753+0000 7f562bfff700 1 -- 172.21.15.84:0/1601330419 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56380532f0 con 0x7f56440b49e0 2023-10-06T03:26:10.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.938+0000 7f564a749700 1 -- 172.21.15.84:0/1601330419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5644064ad0 con 0x7f56440b49e0 2023-10-06T03:26:10.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.939+0000 7f562bfff700 1 -- 172.21.15.84:0/1601330419 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f5638056910 con 0x7f56440b49e0 2023-10-06T03:26:10.940 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:10.941 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":73,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:09.642246+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:07.289525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:08.601697+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:10.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 -- 172.21.15.84:0/1601330419 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5630066f30 msgr2=0x7f56300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5630066f30 0x7f56300693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5634008900 tx=0x7f5634008040 comp rx=0 tx=0).stop 2023-10-06T03:26:10.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 -- 172.21.15.84:0/1601330419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 msgr2=0x7f564409a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:10.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 0x7f564409a090 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5638013000 tx=0x7f5638017000 comp rx=0 tx=0).stop 2023-10-06T03:26:10.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 -- 172.21.15.84:0/1601330419 shutdown_connections 2023-10-06T03:26:10.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5630066f30 0x7f56300693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56441595a0 0x7f564409b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56440b07a0 0x7f564415e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 --2- 172.21.15.84:0/1601330419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56440b49e0 0x7f564409a090 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 -- 172.21.15.84:0/1601330419 >> 172.21.15.84:0/1601330419 conn(0x7f5644099830 msgr2=0x7f56441587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 -- 172.21.15.84:0/1601330419 shutdown_connections 2023-10-06T03:26:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:10.941+0000 7f564a749700 1 -- 172.21.15.84:0/1601330419 wait complete. 2023-10-06T03:26:10.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:26:11.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.069+0000 7f0d15371700 1 Processor -- start 2023-10-06T03:26:11.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.069+0000 7f0d15371700 1 -- start start 2023-10-06T03:26:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.070+0000 7f0d15371700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0d100b0680 0x7f0d100ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.070+0000 7f0d15371700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 0x7f0d100c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.070+0000 7f0d15371700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d100ccad0 con 0x7f0d100b0a50 2023-10-06T03:26:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.070+0000 7f0d15371700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d100ca7d0 con 0x7f0d100b0680 2023-10-06T03:26:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.070+0000 7f0d15371700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100c5400 con 0x7f0d100cc630 2023-10-06T03:26:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0f7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 0x7f0d100c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0effd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0d100b0680 0x7f0d100ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0f7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 0x7f0d100c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:36544/0 (socket says 172.21.15.84:36544) 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d07fff700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f0d100b0a50 0x7f0d100cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:60588/0 (socket says 172.21.15.84:60588) 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0effd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0d100b0680 0x7f0d100ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:51706/0 (socket says 172.21.15.84:51706) 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0f7fe700 1 -- 172.21.15.84:0/3637097942 learned_addr learned my addr 172.21.15.84:0/3637097942 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0effd700 1 -- 172.21.15.84:0/3637097942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 msgr2=0x7f0d100c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0effd700 1 --2- 172.21.15.84:0/3637097942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 0x7f0d100c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0effd700 1 -- 172.21.15.84:0/3637097942 >> v1:172.21.15.131:6789/0 conn(0x7f0d100b0a50 legacy=0x7f0d100cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0effd700 1 -- 172.21.15.84:0/3637097942 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d100ccd40 con 0x7f0d100b0680 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0f7fe700 1 --2- 172.21.15.84:0/3637097942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 0x7f0d100c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0e7fc700 1 -- 172.21.15.84:0/3637097942 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017513375 0 0) 0x7f0d100ccad0 con 0x7f0d100b0a50 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0effd700 1 --2- 172.21.15.84:0/3637097942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d100b0680 0x7f0d100ced10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0d000098d0 tx=0x7f0d00009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83787ffeaa568d77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0e7fc700 1 -- 172.21.15.84:0/3637097942 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00005c10 con 0x7f0d100b0680 2023-10-06T03:26:11.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0e7fc700 1 -- 172.21.15.84:0/3637097942 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d00005d70 con 0x7f0d100b0680 2023-10-06T03:26:11.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.071+0000 7f0d0e7fc700 1 -- 172.21.15.84:0/3637097942 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00006280 con 0x7f0d100b0680 2023-10-06T03:26:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.072+0000 7f0d15371700 1 -- 172.21.15.84:0/3637097942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d100b0680 msgr2=0x7f0d100ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.072+0000 7f0d15371700 1 --2- 172.21.15.84:0/3637097942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d100b0680 0x7f0d100ced10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0d000098d0 tx=0x7f0d00009120 comp rx=0 tx=0).stop 2023-10-06T03:26:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.072+0000 7f0d15371700 1 -- 172.21.15.84:0/3637097942 shutdown_connections 2023-10-06T03:26:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.072+0000 7f0d15371700 1 --2- 172.21.15.84:0/3637097942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 0x7f0d100c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.072+0000 7f0d15371700 1 --2- 172.21.15.84:0/3637097942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d100b0680 0x7f0d100ced10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.072+0000 7f0d15371700 1 -- 172.21.15.84:0/3637097942 >> 172.21.15.84:0/3637097942 conn(0x7f0d10088000 msgr2=0x7f0d100ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.072+0000 7f0d15371700 1 -- 172.21.15.84:0/3637097942 shutdown_connections 2023-10-06T03:26:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.072+0000 7f0d15371700 1 -- 172.21.15.84:0/3637097942 wait complete. 2023-10-06T03:26:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.073+0000 7f0d15371700 1 Processor -- start 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.073+0000 7f0d15371700 1 -- start start 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d15371700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d100b0680 0x7f0d100989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d15371700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d100b0a50 0x7f0d1016a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d15371700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 0x7f0d1016d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d15371700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1016a9e0 con 0x7f0d100b0a50 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d15371700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d10099040 con 0x7f0d100b0680 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d15371700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d10099320 con 0x7f0d100cc630 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d07fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d100b0a50 0x7f0d1016a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d07fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d100b0a50 0x7f0d1016a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49376/0 (socket says 172.21.15.84:49376) 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d07fff700 1 -- 172.21.15.84:0/542322100 learned_addr learned my addr 172.21.15.84:0/542322100 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d0f7fe700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 0x7f0d1016d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d0effd700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d100b0680 0x7f0d100989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d07fff700 1 -- 172.21.15.84:0/542322100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 msgr2=0x7f0d1016d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d07fff700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 0x7f0d1016d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d07fff700 1 -- 172.21.15.84:0/542322100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d100b0680 msgr2=0x7f0d100989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d07fff700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d100b0680 0x7f0d100989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d07fff700 1 -- 172.21.15.84:0/542322100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08009ae0 con 0x7f0d100b0a50 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d0effd700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d100b0680 0x7f0d100989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d07fff700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d100b0a50 0x7f0d1016a4a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c5b0 tx=0x7f0cf8001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d06ffd700 1 -- 172.21.15.84:0/542322100 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8005a70 con 0x7f0d100b0a50 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d06ffd700 1 -- 172.21.15.84:0/542322100 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf8005bd0 con 0x7f0d100b0a50 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d15371700 1 -- 172.21.15.84:0/542322100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d000093c0 con 0x7f0d100b0a50 2023-10-06T03:26:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d06ffd700 1 -- 172.21.15.84:0/542322100 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80070d0 con 0x7f0d100b0a50 2023-10-06T03:26:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.074+0000 7f0d15371700 1 -- 172.21.15.84:0/542322100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d10169f80 con 0x7f0d100b0a50 2023-10-06T03:26:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.075+0000 7f0d15371700 1 -- 172.21.15.84:0/542322100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1016a1a0 con 0x7f0d100b0a50 2023-10-06T03:26:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.076+0000 7f0d06ffd700 1 -- 172.21.15.84:0/542322100 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cf8007480 con 0x7f0d100b0a50 2023-10-06T03:26:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.076+0000 7f0d06ffd700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0cf0066f30 0x7f0cf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.076+0000 7f0d06ffd700 1 -- 172.21.15.84:0/542322100 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0cf8083cb0 con 0x7f0d100b0a50 2023-10-06T03:26:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.076+0000 7f0d0effd700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0cf0066f30 0x7f0cf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.077+0000 7f0d0effd700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0cf0066f30 0x7f0cf00693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009160 tx=0x7f0d00016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:11.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.080+0000 7f0d06ffd700 1 -- 172.21.15.84:0/542322100 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cf8050c80 con 0x7f0d100b0a50 2023-10-06T03:26:11.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:11.307+0000 7f0d15371700 1 -- 172.21.15.84:0/542322100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0d1016de40 con 0x7f0d100b0a50 2023-10-06T03:26:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.283+0000 7f0d06ffd700 1 -- 172.21.15.84:0/542322100 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0cf8017070 con 0x7f0d100b0a50 2023-10-06T03:26:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.285+0000 7f0d15371700 1 -- 172.21.15.84:0/542322100 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0cf0066f30 msgr2=0x7f0cf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.285+0000 7f0d15371700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0cf0066f30 0x7f0cf00693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009160 tx=0x7f0d00016000 comp rx=0 tx=0).stop 2023-10-06T03:26:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.285+0000 7f0d15371700 1 -- 172.21.15.84:0/542322100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d100b0a50 msgr2=0x7f0d1016a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.285+0000 7f0d15371700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d100b0a50 0x7f0d1016a4a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c5b0 tx=0x7f0cf8001040 comp rx=0 tx=0).stop 2023-10-06T03:26:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.285+0000 7f0d15371700 1 -- 172.21.15.84:0/542322100 shutdown_connections 2023-10-06T03:26:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.285+0000 7f0d15371700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0cf0066f30 0x7f0cf00693e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.285+0000 7f0d15371700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d100b0680 0x7f0d100989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.285+0000 7f0d15371700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d100cc630 0x7f0d1016d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.285+0000 7f0d15371700 1 --2- 172.21.15.84:0/542322100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d100b0a50 0x7f0d1016a4a0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.285+0000 7f0d15371700 1 -- 172.21.15.84:0/542322100 >> 172.21.15.84:0/542322100 conn(0x7f0d10088000 msgr2=0x7f0d1006be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.286+0000 7f0d15371700 1 -- 172.21.15.84:0/542322100 shutdown_connections 2023-10-06T03:26:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.286+0000 7f0d15371700 1 -- 172.21.15.84:0/542322100 wait complete. 2023-10-06T03:26:12.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:26:12.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.419+0000 7fa91bbc3700 1 Processor -- start 2023-10-06T03:26:12.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.419+0000 7fa91bbc3700 1 -- start start 2023-10-06T03:26:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91bbc3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa914159510 0x7fa9140cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91bbc3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9140cbf20 con 0x7fa9140cbae0 2023-10-06T03:26:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91bbc3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9140cf610 con 0x7fa9141598e0 2023-10-06T03:26:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91bbc3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9140cf8f0 con 0x7fa914159510 2023-10-06T03:26:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91995f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa914159510 0x7fa9140cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91a160700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa9140cbae0 0x7fa9140c56d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48256/0 (socket says 172.21.15.84:48256) 2023-10-06T03:26:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91a160700 1 -- 172.21.15.84:0/1833044762 learned_addr learned my addr 172.21.15.84:0/1833044762 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91995f700 1 -- 172.21.15.84:0/1833044762 >> v1:172.21.15.131:6789/0 conn(0x7fa9141598e0 legacy=0x7fa9140ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91995f700 1 -- 172.21.15.84:0/1833044762 >> v1:172.21.15.84:6789/0 conn(0x7fa9140cbae0 legacy=0x7fa9140c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91995f700 1 -- 172.21.15.84:0/1833044762 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9140cfbd0 con 0x7fa914159510 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91895d700 1 -- 172.21.15.84:0/1833044762 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295105784 0 0) 0x7fa9140cbf20 con 0x7fa9140cbae0 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.420+0000 7fa91995f700 1 --2- 172.21.15.84:0/1833044762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa914159510 0x7fa9140cb5a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa9100098e0 tx=0x7fa9100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de556b85fadd7ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.421+0000 7fa91895d700 1 -- 172.21.15.84:0/1833044762 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910009e80 con 0x7fa914159510 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.421+0000 7fa91895d700 1 -- 172.21.15.84:0/1833044762 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91000b820 con 0x7fa914159510 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.421+0000 7fa91895d700 1 -- 172.21.15.84:0/1833044762 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91000bba0 con 0x7fa914159510 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.421+0000 7fa91bbc3700 1 -- 172.21.15.84:0/1833044762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa914159510 msgr2=0x7fa9140cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.421+0000 7fa91bbc3700 1 --2- 172.21.15.84:0/1833044762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa914159510 0x7fa9140cb5a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa9100098e0 tx=0x7fa9100091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.421+0000 7fa91bbc3700 1 -- 172.21.15.84:0/1833044762 shutdown_connections 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.421+0000 7fa91bbc3700 1 --2- 172.21.15.84:0/1833044762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa914159510 0x7fa9140cb5a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.421+0000 7fa91bbc3700 1 -- 172.21.15.84:0/1833044762 >> 172.21.15.84:0/1833044762 conn(0x7fa914089e90 msgr2=0x7fa9140997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:12.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.421+0000 7fa91bbc3700 1 -- 172.21.15.84:0/1833044762 shutdown_connections 2023-10-06T03:26:12.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.421+0000 7fa91bbc3700 1 -- 172.21.15.84:0/1833044762 wait complete. 2023-10-06T03:26:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.422+0000 7fa91bbc3700 1 Processor -- start 2023-10-06T03:26:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.422+0000 7fa91bbc3700 1 -- start start 2023-10-06T03:26:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91bbc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9140cbae0 0x7fa9140c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91bbc3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa914159510 0x7fa91416ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91bbc3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9141598e0 0x7fa9140b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91bbc3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91416b060 con 0x7fa9140cbae0 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91bbc3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140b4e50 con 0x7fa9141598e0 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91bbc3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140b50f0 con 0x7fa914159510 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91995f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9140cbae0 0x7fa9140c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91995f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9140cbae0 0x7fa9140c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49390/0 (socket says 172.21.15.84:49390) 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91995f700 1 -- 172.21.15.84:0/3173373858 learned_addr learned my addr 172.21.15.84:0/3173373858 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91a160700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9141598e0 0x7fa9140b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91915e700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa914159510 0x7fa91416ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91995f700 1 -- 172.21.15.84:0/3173373858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa914159510 msgr2=0x7fa91416ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91995f700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa914159510 0x7fa91416ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91995f700 1 -- 172.21.15.84:0/3173373858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9141598e0 msgr2=0x7fa9140b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91995f700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9141598e0 0x7fa9140b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91995f700 1 -- 172.21.15.84:0/3173373858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910009420 con 0x7fa9140cbae0 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.423+0000 7fa91915e700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa914159510 0x7fa91416ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.424+0000 7fa91995f700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9140cbae0 0x7fa9140c8bb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa9100030c0 tx=0x7fa910016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.424+0000 7fa909ffb700 1 -- 172.21.15.84:0/3173373858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91000ba10 con 0x7fa9140cbae0 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.424+0000 7fa909ffb700 1 -- 172.21.15.84:0/3173373858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa910020070 con 0x7fa9140cbae0 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.424+0000 7fa909ffb700 1 -- 172.21.15.84:0/3173373858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91001b6a0 con 0x7fa9140cbae0 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.424+0000 7fa91bbc3700 1 -- 172.21.15.84:0/3173373858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9140b39b0 con 0x7fa9140cbae0 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.424+0000 7fa91bbc3700 1 -- 172.21.15.84:0/3173373858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9140b5390 con 0x7fa9140cbae0 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.425+0000 7fa91bbc3700 1 -- 172.21.15.84:0/3173373858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa914064ad0 con 0x7fa9140cbae0 2023-10-06T03:26:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.425+0000 7fa909ffb700 1 -- 172.21.15.84:0/3173373858 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa910022030 con 0x7fa9140cbae0 2023-10-06T03:26:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.426+0000 7fa909ffb700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa8f8066f30 0x7fa8f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.426+0000 7fa91915e700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa8f8066f30 0x7fa8f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.426+0000 7fa909ffb700 1 -- 172.21.15.84:0/3173373858 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa9100868b0 con 0x7fa9140cbae0 2023-10-06T03:26:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.426+0000 7fa91915e700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa8f8066f30 0x7fa8f80693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa904006fd0 tx=0x7fa904008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:12.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.430+0000 7fa909ffb700 1 -- 172.21.15.84:0/3173373858 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa910053880 con 0x7fa9140cbae0 2023-10-06T03:26:12.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:12.656+0000 7fa91bbc3700 1 -- 172.21.15.84:0/3173373858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa914064ad0 con 0x7fa9140cbae0 2023-10-06T03:26:13.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.288+0000 7fa909ffb700 1 -- 172.21.15.84:0/3173373858 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa910056ea0 con 0x7fa9140cbae0 2023-10-06T03:26:13.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 -- 172.21.15.84:0/3173373858 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa8f8066f30 msgr2=0x7fa8f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa8f8066f30 0x7fa8f80693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa904006fd0 tx=0x7fa904008040 comp rx=0 tx=0).stop 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 -- 172.21.15.84:0/3173373858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9140cbae0 msgr2=0x7fa9140c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9140cbae0 0x7fa9140c8bb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa9100030c0 tx=0x7fa910016000 comp rx=0 tx=0).stop 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 -- 172.21.15.84:0/3173373858 shutdown_connections 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa8f8066f30 0x7fa8f80693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9141598e0 0x7fa9140b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9140cbae0 0x7fa9140c8bb0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 --2- 172.21.15.84:0/3173373858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa914159510 0x7fa91416ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 -- 172.21.15.84:0/3173373858 >> 172.21.15.84:0/3173373858 conn(0x7fa914089e90 msgr2=0x7fa9140683b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 -- 172.21.15.84:0/3173373858 shutdown_connections 2023-10-06T03:26:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.291+0000 7fa91bbc3700 1 -- 172.21.15.84:0/3173373858 wait complete. 2023-10-06T03:26:13.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:13.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.424+0000 7f18f0c3a700 1 Processor -- start 2023-10-06T03:26:13.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.424+0000 7f18f0c3a700 1 -- start start 2023-10-06T03:26:13.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18f0c3a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18ec159480 0x7f18ec0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18f0c3a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f18ec0b2140 0x7f18ec0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18f0c3a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ec0cb7e0 con 0x7f18ec0b3610 2023-10-06T03:26:13.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18f0c3a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ec0b08a0 con 0x7f18ec0b2140 2023-10-06T03:26:13.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18f0c3a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec0cb190 con 0x7f18ec159480 2023-10-06T03:26:13.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18ebfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f18ec0b2140 0x7f18ec0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18ebfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f18ec0b2140 0x7f18ec0b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49406/0 (socket says 172.21.15.84:49406) 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18ebfff700 1 -- 172.21.15.84:0/2020092912 learned_addr learned my addr 172.21.15.84:0/2020092912 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18eb7fe700 1 --2- 172.21.15.84:0/2020092912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18ec159480 0x7f18ec0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18ebfff700 1 -- 172.21.15.84:0/2020092912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18ec159480 msgr2=0x7f18ec0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18ebfff700 1 --2- 172.21.15.84:0/2020092912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18ec159480 0x7f18ec0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18ebfff700 1 -- 172.21.15.84:0/2020092912 >> v1:172.21.15.131:6789/0 conn(0x7f18ec0b3610 legacy=0x7f18ec0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18ebfff700 1 -- 172.21.15.84:0/2020092912 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec0cb470 con 0x7f18ec0b2140 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.425+0000 7f18ebfff700 1 --2- 172.21.15.84:0/2020092912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b2140 0x7f18ec0b25c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f18e40099b0 tx=0x7f18e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b58b5cc4cea9f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18ea7fc700 1 -- 172.21.15.84:0/2020092912 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e400b860 con 0x7f18ec0b2140 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18ea7fc700 1 -- 172.21.15.84:0/2020092912 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e400b9c0 con 0x7f18ec0b2140 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18ea7fc700 1 -- 172.21.15.84:0/2020092912 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e400bd60 con 0x7f18ec0b2140 2023-10-06T03:26:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18f0c3a700 1 -- 172.21.15.84:0/2020092912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b2140 msgr2=0x7f18ec0b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18f0c3a700 1 --2- 172.21.15.84:0/2020092912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b2140 0x7f18ec0b25c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f18e40099b0 tx=0x7f18e4009250 comp rx=0 tx=0).stop 2023-10-06T03:26:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18f0c3a700 1 -- 172.21.15.84:0/2020092912 shutdown_connections 2023-10-06T03:26:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18f0c3a700 1 --2- 172.21.15.84:0/2020092912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b2140 0x7f18ec0b25c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18f0c3a700 1 --2- 172.21.15.84:0/2020092912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18ec159480 0x7f18ec0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18f0c3a700 1 -- 172.21.15.84:0/2020092912 >> 172.21.15.84:0/2020092912 conn(0x7f18ec06ed20 msgr2=0x7f18ec06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18f0c3a700 1 -- 172.21.15.84:0/2020092912 shutdown_connections 2023-10-06T03:26:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.426+0000 7f18f0c3a700 1 -- 172.21.15.84:0/2020092912 wait complete. 2023-10-06T03:26:13.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.427+0000 7f18f0c3a700 1 Processor -- start 2023-10-06T03:26:13.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.427+0000 7f18f0c3a700 1 -- start start 2023-10-06T03:26:13.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18f0c3a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18ec0b2140 0x7f18ec153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18f0c3a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b3610 0x7f18ec169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18f0c3a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18ec159480 0x7f18ec169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18f0c3a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec0c85d0 con 0x7f18ec0b3610 2023-10-06T03:26:13.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18f0c3a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec0c5550 con 0x7f18ec0b2140 2023-10-06T03:26:13.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18f0c3a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec0c4c20 con 0x7f18ec159480 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18eaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b3610 0x7f18ec169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18eaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b3610 0x7f18ec169400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49418/0 (socket says 172.21.15.84:49418) 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18eaffd700 1 -- 172.21.15.84:0/695794078 learned_addr learned my addr 172.21.15.84:0/695794078 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18eb7fe700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18ec0b2140 0x7f18ec153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18ebfff700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18ec159480 0x7f18ec169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18eaffd700 1 -- 172.21.15.84:0/695794078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18ec159480 msgr2=0x7f18ec169940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18eaffd700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18ec159480 0x7f18ec169940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18eaffd700 1 -- 172.21.15.84:0/695794078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18ec0b2140 msgr2=0x7f18ec153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.428+0000 7f18eaffd700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18ec0b2140 0x7f18ec153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.429+0000 7f18eaffd700 1 -- 172.21.15.84:0/695794078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e40094f0 con 0x7f18ec0b3610 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.429+0000 7f18eaffd700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b3610 0x7f18ec169400 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f18e000c590 tx=0x7f18e000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:13.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.429+0000 7f18d37fe700 1 -- 172.21.15.84:0/695794078 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0011590 con 0x7f18ec0b3610 2023-10-06T03:26:13.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.429+0000 7f18d37fe700 1 -- 172.21.15.84:0/695794078 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e0011710 con 0x7f18ec0b3610 2023-10-06T03:26:13.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.429+0000 7f18f0c3a700 1 -- 172.21.15.84:0/695794078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec0c4f00 con 0x7f18ec0b3610 2023-10-06T03:26:13.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.429+0000 7f18d37fe700 1 -- 172.21.15.84:0/695794078 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0011ad0 con 0x7f18ec0b3610 2023-10-06T03:26:13.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.429+0000 7f18f0c3a700 1 -- 172.21.15.84:0/695794078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec154510 con 0x7f18ec0b3610 2023-10-06T03:26:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.430+0000 7f18f0c3a700 1 -- 172.21.15.84:0/695794078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec068c60 con 0x7f18ec0b3610 2023-10-06T03:26:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.430+0000 7f18d37fe700 1 -- 172.21.15.84:0/695794078 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18e001b3b0 con 0x7f18ec0b3610 2023-10-06T03:26:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.431+0000 7f18d37fe700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18d8066f30 0x7f18d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.431+0000 7f18d37fe700 1 -- 172.21.15.84:0/695794078 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f18e0083d00 con 0x7f18ec0b3610 2023-10-06T03:26:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.431+0000 7f18eb7fe700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18d8066f30 0x7f18d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.431+0000 7f18eb7fe700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18d8066f30 0x7f18d80693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0075a0 tx=0x7f18dc0097e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.435+0000 7f18d37fe700 1 -- 172.21.15.84:0/695794078 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18e0050c30 con 0x7f18ec0b3610 2023-10-06T03:26:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.664+0000 7f18f0c3a700 1 -- 172.21.15.84:0/695794078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18ec0c56c0 con 0x7f18ec0b3610 2023-10-06T03:26:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.665+0000 7f18d37fe700 1 -- 172.21.15.84:0/695794078 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f18e0017070 con 0x7f18ec0b3610 2023-10-06T03:26:13.667 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:13.667 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1214313207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1214313207},{"type":"v1","addr":"172.21.15.131:6835","nonce":1214313207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/63470384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":63470384},{"type":"v1","addr":"172.21.15.84:6837","nonce":63470384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3440632646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3440632646},{"type":"v1","addr":"172.21.15.131:6834","nonce":3440632646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:09.642630+0000","modified":"2023-10-06T03:26:13.283595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/390518387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":390518387},{"type":"v1","addr":"172.21.15.84:6836","nonce":390518387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:26:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 -- 172.21.15.84:0/695794078 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18d8066f30 msgr2=0x7f18d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18d8066f30 0x7f18d80693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0075a0 tx=0x7f18dc0097e0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 -- 172.21.15.84:0/695794078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b3610 msgr2=0x7f18ec169400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b3610 0x7f18ec169400 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f18e000c590 tx=0x7f18e000c8a0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 -- 172.21.15.84:0/695794078 shutdown_connections 2023-10-06T03:26:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f18d8066f30 0x7f18d80693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18ec0b2140 0x7f18ec153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18ec159480 0x7f18ec169940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 --2- 172.21.15.84:0/695794078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18ec0b3610 0x7f18ec169400 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 -- 172.21.15.84:0/695794078 >> 172.21.15.84:0/695794078 conn(0x7f18ec06ed20 msgr2=0x7f18ec0af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 -- 172.21.15.84:0/695794078 shutdown_connections 2023-10-06T03:26:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.667+0000 7f18f0c3a700 1 -- 172.21.15.84:0/695794078 wait complete. 2023-10-06T03:26:13.671 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 39 2023-10-06T03:26:13.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:13.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.800+0000 7f7bfe9fb700 1 Processor -- start 2023-10-06T03:26:13.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.800+0000 7f7bfe9fb700 1 -- start start 2023-10-06T03:26:13.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfe9fb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7bf80cbc70 0x7f7bf80cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfe9fb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bf80b2140 0x7f7bf80b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfe9fb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf80cb7e0 con 0x7f7bf8159480 2023-10-06T03:26:13.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfe9fb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf80b08a0 con 0x7f7bf80cbc70 2023-10-06T03:26:13.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfe9fb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80cb190 con 0x7f7bf80b2140 2023-10-06T03:26:13.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfd1f8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7bf80cbc70 0x7f7bf80cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfd9f9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7bf8159480 0x7f7bf80b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48272/0 (socket says 172.21.15.84:48272) 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfd9f9700 1 -- 172.21.15.84:0/1356314002 learned_addr learned my addr 172.21.15.84:0/1356314002 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfd1f8700 1 -- 172.21.15.84:0/1356314002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bf80b2140 msgr2=0x7f7bf80b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfe1fa700 1 --2- 172.21.15.84:0/1356314002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bf80b2140 0x7f7bf80b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfd1f8700 1 --2- 172.21.15.84:0/1356314002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bf80b2140 0x7f7bf80b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfd1f8700 1 -- 172.21.15.84:0/1356314002 >> v1:172.21.15.84:6789/0 conn(0x7f7bf8159480 legacy=0x7f7bf80b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.801+0000 7f7bfc9f7700 1 -- 172.21.15.84:0/1356314002 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155855611 0 0) 0x7f7bf80cb7e0 con 0x7f7bf8159480 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfd1f8700 1 -- 172.21.15.84:0/1356314002 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf80cb470 con 0x7f7bf80cbc70 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfd1f8700 1 --2- 172.21.15.84:0/1356314002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 0x7f7bf80cc0c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7be80098e0 tx=0x7f7be80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309197128a64d7f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfc9f7700 1 -- 172.21.15.84:0/1356314002 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8009e80 con 0x7f7bf80cbc70 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfc9f7700 1 -- 172.21.15.84:0/1356314002 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be800b860 con 0x7f7bf80cbc70 2023-10-06T03:26:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfc9f7700 1 -- 172.21.15.84:0/1356314002 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800bbe0 con 0x7f7bf80cbc70 2023-10-06T03:26:13.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/1356314002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 msgr2=0x7f7bf80cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfe9fb700 1 --2- 172.21.15.84:0/1356314002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 0x7f7bf80cc0c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7be80098e0 tx=0x7f7be80091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/1356314002 shutdown_connections 2023-10-06T03:26:13.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfe9fb700 1 --2- 172.21.15.84:0/1356314002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bf80b2140 0x7f7bf80b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfe9fb700 1 --2- 172.21.15.84:0/1356314002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 0x7f7bf80cc0c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/1356314002 >> 172.21.15.84:0/1356314002 conn(0x7f7bf806ed20 msgr2=0x7f7bf806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:13.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.802+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/1356314002 shutdown_connections 2023-10-06T03:26:13.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.803+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/1356314002 wait complete. 2023-10-06T03:26:13.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfe9fb700 1 Processor -- start 2023-10-06T03:26:13.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfe9fb700 1 -- start start 2023-10-06T03:26:13.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfe9fb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bf80b2140 0x7f7bf81547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfe9fb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 0x7f7bf80c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfe9fb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8159480 0x7f7bf80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfe9fb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf8154d00 con 0x7f7bf80cbc70 2023-10-06T03:26:13.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfe9fb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80cec00 con 0x7f7bf8159480 2023-10-06T03:26:13.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfe9fb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80ce5f0 con 0x7f7bf80b2140 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfd1f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 0x7f7bf80c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfd1f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 0x7f7bf80c7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49440/0 (socket says 172.21.15.84:49440) 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.804+0000 7f7bfd1f8700 1 -- 172.21.15.84:0/2458364360 learned_addr learned my addr 172.21.15.84:0/2458364360 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bfd9f9700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bf80b2140 0x7f7bf81547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bfe1fa700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8159480 0x7f7bf80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bfd1f8700 1 -- 172.21.15.84:0/2458364360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bf80b2140 msgr2=0x7f7bf81547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bfd1f8700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bf80b2140 0x7f7bf81547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bfd1f8700 1 -- 172.21.15.84:0/2458364360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8159480 msgr2=0x7f7bf80c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bfd1f8700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8159480 0x7f7bf80c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bfd1f8700 1 -- 172.21.15.84:0/2458364360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be8009420 con 0x7f7bf80cbc70 2023-10-06T03:26:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bfd1f8700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 0x7f7bf80c7770 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8069190 tx=0x7f7be8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bedffb700 1 -- 172.21.15.84:0/2458364360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800bbe0 con 0x7f7bf80cbc70 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bedffb700 1 -- 172.21.15.84:0/2458364360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be8011420 con 0x7f7bf80cbc70 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/2458364360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf80ca2f0 con 0x7f7bf80cbc70 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bedffb700 1 -- 172.21.15.84:0/2458364360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80117e0 con 0x7f7bf80cbc70 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.805+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/2458364360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf80ca5d0 con 0x7f7bf80cbc70 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.806+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/2458364360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf80ced70 con 0x7f7bf80cbc70 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.807+0000 7f7bedffb700 1 -- 172.21.15.84:0/2458364360 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7be8011bd0 con 0x7f7bf80cbc70 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.807+0000 7f7bedffb700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7bdc066f30 0x7f7bdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.807+0000 7f7bedffb700 1 -- 172.21.15.84:0/2458364360 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7be8086330 con 0x7f7bf80cbc70 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.807+0000 7f7bfd9f9700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7bdc066f30 0x7f7bdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.807+0000 7f7bfd9f9700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7bdc066f30 0x7f7bdc0693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4001750 tx=0x7f7bf4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.811+0000 7f7bedffb700 1 -- 172.21.15.84:0/2458364360 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7be8053300 con 0x7f7bf80cbc70 2023-10-06T03:26:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.996+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/2458364360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bf805f270 con 0x7f7bf80cbc70 2023-10-06T03:26:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.996+0000 7f7bedffb700 1 -- 172.21.15.84:0/2458364360 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f7be8056920 con 0x7f7bf80cbc70 2023-10-06T03:26:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:13.999 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":74,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:11.256666+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:07.289525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:08.601697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/2458364360 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7bdc066f30 msgr2=0x7f7bdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7bdc066f30 0x7f7bdc0693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4001750 tx=0x7f7bf4009040 comp rx=0 tx=0).stop 2023-10-06T03:26:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/2458364360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 msgr2=0x7f7bf80c7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 0x7f7bf80c7770 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8069190 tx=0x7f7be8017000 comp rx=0 tx=0).stop 2023-10-06T03:26:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/2458364360 shutdown_connections 2023-10-06T03:26:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7bdc066f30 0x7f7bdc0693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8159480 0x7f7bf80c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bf80b2140 0x7f7bf81547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 --2- 172.21.15.84:0/2458364360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf80cbc70 0x7f7bf80c7770 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/2458364360 >> 172.21.15.84:0/2458364360 conn(0x7f7bf806ed20 msgr2=0x7f7bf81556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:14.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/2458364360 shutdown_connections 2023-10-06T03:26:14.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:13.999+0000 7f7bfe9fb700 1 -- 172.21.15.84:0/2458364360 wait complete. 2023-10-06T03:26:14.013 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:26:14.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:26:14.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.127+0000 7f809ba29700 1 Processor -- start 2023-10-06T03:26:14.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.128+0000 7f809ba29700 1 -- start start 2023-10-06T03:26:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.128+0000 7f809ba29700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f80941595a0 0x7f80940aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.128+0000 7f809ba29700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80940b0ca0 con 0x7f80940b07a0 2023-10-06T03:26:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.128+0000 7f809ba29700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80940b0f80 con 0x7f80940b49e0 2023-10-06T03:26:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.128+0000 7f809ba29700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80940b1260 con 0x7f80941595a0 2023-10-06T03:26:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.128+0000 7f8099fc6700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f80940b07a0 0x7f80940b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48288/0 (socket says 172.21.15.84:48288) 2023-10-06T03:26:14.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.128+0000 7f8099fc6700 1 -- 172.21.15.84:0/695817352 learned_addr learned my addr 172.21.15.84:0/695817352 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:14.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f80997c5700 1 --2- 172.21.15.84:0/695817352 >> v2:172.21.15.131:3300/0 conn(0x7f80941595a0 0x7f80940aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f808bfff700 1 -- 172.21.15.84:0/695817352 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055963587 0 0) 0x7f80940b0ca0 con 0x7f80940b07a0 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f808bfff700 1 -- 172.21.15.84:0/695817352 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8080003570 con 0x7f80940b07a0 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f808bfff700 1 -- 172.21.15.84:0/695817352 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295046928 0 0) 0x7f80940b0f80 con 0x7f80940b49e0 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f808bfff700 1 -- 172.21.15.84:0/695817352 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80940b0ca0 con 0x7f80940b49e0 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f808bfff700 1 -- 172.21.15.84:0/695817352 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1355714480 0 0) 0x7f8080003570 con 0x7f80940b07a0 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f80997c5700 1 -- 172.21.15.84:0/695817352 >> v1:172.21.15.131:6789/0 conn(0x7f80940b49e0 legacy=0x7f80940aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f80997c5700 1 -- 172.21.15.84:0/695817352 >> v1:172.21.15.84:6789/0 conn(0x7f80940b07a0 legacy=0x7f80940b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f80997c5700 1 -- 172.21.15.84:0/695817352 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80940b1540 con 0x7f80941595a0 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f80997c5700 1 --2- 172.21.15.84:0/695817352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80941595a0 0x7f80940aa570 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8090009900 tx=0x7f8090009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=264ba290460d5834 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f808bfff700 1 -- 172.21.15.84:0/695817352 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0017f0 con 0x7f80941595a0 2023-10-06T03:26:14.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f808bfff700 1 -- 172.21.15.84:0/695817352 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090011420 con 0x7f80941595a0 2023-10-06T03:26:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.129+0000 7f808bfff700 1 -- 172.21.15.84:0/695817352 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80900117c0 con 0x7f80941595a0 2023-10-06T03:26:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.130+0000 7f809ba29700 1 -- 172.21.15.84:0/695817352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80941595a0 msgr2=0x7f80940aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.130+0000 7f809ba29700 1 --2- 172.21.15.84:0/695817352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80941595a0 0x7f80940aa570 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8090009900 tx=0x7f8090009120 comp rx=0 tx=0).stop 2023-10-06T03:26:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.130+0000 7f809ba29700 1 -- 172.21.15.84:0/695817352 shutdown_connections 2023-10-06T03:26:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.130+0000 7f809ba29700 1 --2- 172.21.15.84:0/695817352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80941595a0 0x7f80940aa570 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.130+0000 7f809ba29700 1 -- 172.21.15.84:0/695817352 >> 172.21.15.84:0/695817352 conn(0x7f8094099830 msgr2=0x7f809406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.130+0000 7f809ba29700 1 -- 172.21.15.84:0/695817352 shutdown_connections 2023-10-06T03:26:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.130+0000 7f809ba29700 1 -- 172.21.15.84:0/695817352 wait complete. 2023-10-06T03:26:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.131+0000 7f809ba29700 1 Processor -- start 2023-10-06T03:26:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.131+0000 7f809ba29700 1 -- start start 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f809ba29700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b07a0 0x7f80941569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f809ba29700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80940b49e0 0x7f80940ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f809ba29700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80941595a0 0x7f809415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f809ba29700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809409a3d0 con 0x7f80941595a0 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f809ba29700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80940ad8c0 con 0x7f80940b07a0 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f809ba29700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809409b790 con 0x7f80940b49e0 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f8099fc6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80941595a0 0x7f809415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f8099fc6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80941595a0 0x7f809415b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49450/0 (socket says 172.21.15.84:49450) 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f8099fc6700 1 -- 172.21.15.84:0/2235140812 learned_addr learned my addr 172.21.15.84:0/2235140812 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f80997c5700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b07a0 0x7f80941569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f8098fc4700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80940b49e0 0x7f80940ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f8099fc6700 1 -- 172.21.15.84:0/2235140812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80940b49e0 msgr2=0x7f80940ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f8099fc6700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80940b49e0 0x7f80940ac1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f8099fc6700 1 -- 172.21.15.84:0/2235140812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b07a0 msgr2=0x7f80941569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f8099fc6700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b07a0 0x7f80941569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f8099fc6700 1 -- 172.21.15.84:0/2235140812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80900093c0 con 0x7f80941595a0 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f80997c5700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b07a0 0x7f80941569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.132+0000 7f8099fc6700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80941595a0 0x7f809415b980 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f808c00ccc0 tx=0x7f808c007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.133+0000 7f80897fa700 1 -- 172.21.15.84:0/2235140812 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c004dc0 con 0x7f80941595a0 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.133+0000 7f80897fa700 1 -- 172.21.15.84:0/2235140812 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00a8e0 con 0x7f80941595a0 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.133+0000 7f809ba29700 1 -- 172.21.15.84:0/2235140812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80940acf90 con 0x7f80941595a0 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.133+0000 7f80897fa700 1 -- 172.21.15.84:0/2235140812 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00aca0 con 0x7f80941595a0 2023-10-06T03:26:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.133+0000 7f809ba29700 1 -- 172.21.15.84:0/2235140812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80940ad550 con 0x7f80941595a0 2023-10-06T03:26:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.134+0000 7f809ba29700 1 -- 172.21.15.84:0/2235140812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80940cf9d0 con 0x7f80941595a0 2023-10-06T03:26:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.134+0000 7f80897fa700 1 -- 172.21.15.84:0/2235140812 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f808c007360 con 0x7f80941595a0 2023-10-06T03:26:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.134+0000 7f80897fa700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8078066f30 0x7f80780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.134+0000 7f80897fa700 1 -- 172.21.15.84:0/2235140812 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f808c084360 con 0x7f80941595a0 2023-10-06T03:26:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.135+0000 7f80997c5700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8078066f30 0x7f80780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.135+0000 7f80997c5700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8078066f30 0x7f80780693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8090003080 tx=0x7f8090016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:14.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.139+0000 7f80897fa700 1 -- 172.21.15.84:0/2235140812 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f808c0513b0 con 0x7f80941595a0 2023-10-06T03:26:14.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.318+0000 7f809ba29700 1 -- 172.21.15.84:0/2235140812 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8094159190 con 0x7f8078066f30 2023-10-06T03:26:14.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.326+0000 7f80897fa700 1 -- 172.21.15.84:0/2235140812 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306692 (secure 0 0 0) 0x7f8094159190 con 0x7f8078066f30 2023-10-06T03:26:14.331 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:14.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.329+0000 7f809ba29700 1 -- 172.21.15.84:0/2235140812 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8078066f30 msgr2=0x7f80780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.329+0000 7f809ba29700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8078066f30 0x7f80780693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8090003080 tx=0x7f8090016000 comp rx=0 tx=0).stop 2023-10-06T03:26:14.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.329+0000 7f809ba29700 1 -- 172.21.15.84:0/2235140812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80941595a0 msgr2=0x7f809415b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.329+0000 7f809ba29700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80941595a0 0x7f809415b980 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f808c00ccc0 tx=0x7f808c007d50 comp rx=0 tx=0).stop 2023-10-06T03:26:14.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.329+0000 7f809ba29700 1 -- 172.21.15.84:0/2235140812 shutdown_connections 2023-10-06T03:26:14.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.329+0000 7f809ba29700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8078066f30 0x7f80780693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.329+0000 7f809ba29700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b07a0 0x7f80941569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.329+0000 7f809ba29700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80941595a0 0x7f809415b980 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.329+0000 7f809ba29700 1 --2- 172.21.15.84:0/2235140812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80940b49e0 0x7f80940ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.329+0000 7f809ba29700 1 -- 172.21.15.84:0/2235140812 >> 172.21.15.84:0/2235140812 conn(0x7f8094099830 msgr2=0x7f80940b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:14.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.330+0000 7f809ba29700 1 -- 172.21.15.84:0/2235140812 shutdown_connections 2023-10-06T03:26:14.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.330+0000 7f809ba29700 1 -- 172.21.15.84:0/2235140812 wait complete. 2023-10-06T03:26:14.335 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:26:14.343 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2023-10-06T03:26:13.069609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592008,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386376,"kb_used_data":8072,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588344,"statfs":{"total":773094113280,"available":770650464256,"internally_reserved":0,"allocated":8265728,"data_stored":4472603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.819968"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290649+0000","last_change":"2023-10-06T03:26:10.288789+0000","last_active":"2023-10-06T03:26:10.290649+0000","last_peered":"2023-10-06T03:26:10.290649+0000","last_clean":"2023-10-06T03:26:10.290649+0000","last_became_active":"2023-10-06T03:26:10.288490+0000","last_became_peered":"2023-10-06T03:26:10.288490+0000","last_unstale":"2023-10-06T03:26:10.290649+0000","last_undegraded":"2023-10-06T03:26:10.290649+0000","last_fullsized":"2023-10-06T03:26:10.290649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:26.085236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271421+0000","last_change":"2023-10-06T03:26:10.265089+0000","last_active":"2023-10-06T03:26:10.271421+0000","last_peered":"2023-10-06T03:26:10.271421+0000","last_clean":"2023-10-06T03:26:10.271421+0000","last_became_active":"2023-10-06T03:26:10.264799+0000","last_became_peered":"2023-10-06T03:26:10.264799+0000","last_unstale":"2023-10-06T03:26:10.271421+0000","last_undegraded":"2023-10-06T03:26:10.271421+0000","last_fullsized":"2023-10-06T03:26:10.271421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:40.805767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282199+0000","last_change":"2023-10-06T03:26:10.274603+0000","last_active":"2023-10-06T03:26:10.282199+0000","last_peered":"2023-10-06T03:26:10.282199+0000","last_clean":"2023-10-06T03:26:10.282199+0000","last_became_active":"2023-10-06T03:26:10.274368+0000","last_became_peered":"2023-10-06T03:26:10.274368+0000","last_unstale":"2023-10-06T03:26:10.282199+0000","last_undegraded":"2023-10-06T03:26:10.282199+0000","last_fullsized":"2023-10-06T03:26:10.282199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:22.065858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282010+0000","last_change":"2023-10-06T03:26:10.278848+0000","last_active":"2023-10-06T03:26:10.282010+0000","last_peered":"2023-10-06T03:26:10.282010+0000","last_clean":"2023-10-06T03:26:10.282010+0000","last_became_active":"2023-10-06T03:26:10.278604+0000","last_became_peered":"2023-10-06T03:26:10.278604+0000","last_unstale":"2023-10-06T03:26:10.282010+0000","last_undegraded":"2023-10-06T03:26:10.282010+0000","last_fullsized":"2023-10-06T03:26:10.282010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:57.583036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.269336+0000","last_change":"2023-10-06T03:26:10.264610+0000","last_active":"2023-10-06T03:26:10.269336+0000","last_peered":"2023-10-06T03:26:10.269336+0000","last_clean":"2023-10-06T03:26:10.269336+0000","last_became_active":"2023-10-06T03:26:10.264360+0000","last_became_peered":"2023-10-06T03:26:10.264360+0000","last_unstale":"2023-10-06T03:26:10.269336+0000","last_undegraded":"2023-10-06T03:26:10.269336+0000","last_fullsized":"2023-10-06T03:26:10.269336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:44.966408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.294483+0000","last_change":"2023-10-06T03:26:10.289416+0000","last_active":"2023-10-06T03:26:10.294483+0000","last_peered":"2023-10-06T03:26:10.294483+0000","last_clean":"2023-10-06T03:26:10.294483+0000","last_became_active":"2023-10-06T03:26:10.289136+0000","last_became_peered":"2023-10-06T03:26:10.289136+0000","last_unstale":"2023-10-06T03:26:10.294483+0000","last_undegraded":"2023-10-06T03:26:10.294483+0000","last_fullsized":"2023-10-06T03:26:10.294483+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:26.684095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277565+0000","last_change":"2023-10-06T03:26:10.274574+0000","last_active":"2023-10-06T03:26:10.277565+0000","last_peered":"2023-10-06T03:26:10.277565+0000","last_clean":"2023-10-06T03:26:10.277565+0000","last_became_active":"2023-10-06T03:26:10.274274+0000","last_became_peered":"2023-10-06T03:26:10.274274+0000","last_unstale":"2023-10-06T03:26:10.277565+0000","last_undegraded":"2023-10-06T03:26:10.277565+0000","last_fullsized":"2023-10-06T03:26:10.277565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288219+0000","last_change":"2023-10-06T03:26:10.276484+0000","last_active":"2023-10-06T03:26:10.288219+0000","last_peered":"2023-10-06T03:26:10.288219+0000","last_clean":"2023-10-06T03:26:10.288219+0000","last_became_active":"2023-10-06T03:26:10.276132+0000","last_became_peered":"2023-10-06T03:26:10.276132+0000","last_unstale":"2023-10-06T03:26:10.288219+0000","last_undegraded":"2023-10-06T03:26:10.288219+0000","last_fullsized":"2023-10-06T03:26:10.288219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:23.660405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.287197+0000","last_change":"2023-10-06T03:26:10.283921+0000","last_active":"2023-10-06T03:26:10.287197+0000","last_peered":"2023-10-06T03:26:10.287197+0000","last_clean":"2023-10-06T03:26:10.287197+0000","last_became_active":"2023-10-06T03:26:10.283622+0000","last_became_peered":"2023-10-06T03:26:10.283622+0000","last_unstale":"2023-10-06T03:26:10.287197+0000","last_undegraded":"2023-10-06T03:26:10.287197+0000","last_fullsized":"2023-10-06T03:26:10.287197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:37.030135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286698+0000","last_change":"2023-10-06T03:26:10.281874+0000","last_active":"2023-10-06T03:26:10.286698+0000","last_peered":"2023-10-06T03:26:10.286698+0000","last_clean":"2023-10-06T03:26:10.286698+0000","last_became_active":"2023-10-06T03:26:10.281250+0000","last_became_peered":"2023-10-06T03:26:10.281250+0000","last_unstale":"2023-10-06T03:26:10.286698+0000","last_undegraded":"2023-10-06T03:26:10.286698+0000","last_fullsized":"2023-10-06T03:26:10.286698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:06.471008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.269176+0000","last_change":"2023-10-06T03:26:10.264466+0000","last_active":"2023-10-06T03:26:10.269176+0000","last_peered":"2023-10-06T03:26:10.269176+0000","last_clean":"2023-10-06T03:26:10.269176+0000","last_became_active":"2023-10-06T03:26:10.264162+0000","last_became_peered":"2023-10-06T03:26:10.264162+0000","last_unstale":"2023-10-06T03:26:10.269176+0000","last_undegraded":"2023-10-06T03:26:10.269176+0000","last_fullsized":"2023-10-06T03:26:10.269176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:23.246504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.281789+0000","last_change":"2023-10-06T03:26:10.269887+0000","last_active":"2023-10-06T03:26:10.281789+0000","last_peered":"2023-10-06T03:26:10.281789+0000","last_clean":"2023-10-06T03:26:10.281789+0000","last_became_active":"2023-10-06T03:26:10.269397+0000","last_became_peered":"2023-10-06T03:26:10.269397+0000","last_unstale":"2023-10-06T03:26:10.281789+0000","last_undegraded":"2023-10-06T03:26:10.281789+0000","last_fullsized":"2023-10-06T03:26:10.281789+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:48.998501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.281751+0000","last_change":"2023-10-06T03:26:10.273079+0000","last_active":"2023-10-06T03:26:10.281751+0000","last_peered":"2023-10-06T03:26:10.281751+0000","last_clean":"2023-10-06T03:26:10.281751+0000","last_became_active":"2023-10-06T03:26:10.272822+0000","last_became_peered":"2023-10-06T03:26:10.272822+0000","last_unstale":"2023-10-06T03:26:10.281751+0000","last_undegraded":"2023-10-06T03:26:10.281751+0000","last_fullsized":"2023-10-06T03:26:10.281751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:22.093208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288661+0000","last_change":"2023-10-06T03:26:10.280816+0000","last_active":"2023-10-06T03:26:10.288661+0000","last_peered":"2023-10-06T03:26:10.288661+0000","last_clean":"2023-10-06T03:26:10.288661+0000","last_became_active":"2023-10-06T03:26:10.280318+0000","last_became_peered":"2023-10-06T03:26:10.280318+0000","last_unstale":"2023-10-06T03:26:10.288661+0000","last_undegraded":"2023-10-06T03:26:10.288661+0000","last_fullsized":"2023-10-06T03:26:10.288661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:44.966408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282363+0000","last_change":"2023-10-06T03:26:10.274678+0000","last_active":"2023-10-06T03:26:10.282363+0000","last_peered":"2023-10-06T03:26:10.282363+0000","last_clean":"2023-10-06T03:26:10.282363+0000","last_became_active":"2023-10-06T03:26:10.274409+0000","last_became_peered":"2023-10-06T03:26:10.274409+0000","last_unstale":"2023-10-06T03:26:10.282363+0000","last_undegraded":"2023-10-06T03:26:10.282363+0000","last_fullsized":"2023-10-06T03:26:10.282363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:38.350999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.289382+0000","last_change":"2023-10-06T03:26:10.283714+0000","last_active":"2023-10-06T03:26:10.289382+0000","last_peered":"2023-10-06T03:26:10.289382+0000","last_clean":"2023-10-06T03:26:10.289382+0000","last_became_active":"2023-10-06T03:26:10.283184+0000","last_became_peered":"2023-10-06T03:26:10.283184+0000","last_unstale":"2023-10-06T03:26:10.289382+0000","last_undegraded":"2023-10-06T03:26:10.289382+0000","last_fullsized":"2023-10-06T03:26:10.289382+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:35.682913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292296+0000","last_change":"2023-10-06T03:26:10.289063+0000","last_active":"2023-10-06T03:26:10.292296+0000","last_peered":"2023-10-06T03:26:10.292296+0000","last_clean":"2023-10-06T03:26:10.292296+0000","last_became_active":"2023-10-06T03:26:10.288750+0000","last_became_peered":"2023-10-06T03:26:10.288750+0000","last_unstale":"2023-10-06T03:26:10.292296+0000","last_undegraded":"2023-10-06T03:26:10.292296+0000","last_fullsized":"2023-10-06T03:26:10.292296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:56.252304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288551+0000","last_change":"2023-10-06T03:26:10.280335+0000","last_active":"2023-10-06T03:26:10.288551+0000","last_peered":"2023-10-06T03:26:10.288551+0000","last_clean":"2023-10-06T03:26:10.288551+0000","last_became_active":"2023-10-06T03:26:10.280015+0000","last_became_peered":"2023-10-06T03:26:10.280015+0000","last_unstale":"2023-10-06T03:26:10.288551+0000","last_undegraded":"2023-10-06T03:26:10.288551+0000","last_fullsized":"2023-10-06T03:26:10.288551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:13.025592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290452+0000","last_change":"2023-10-06T03:26:10.284367+0000","last_active":"2023-10-06T03:26:10.290452+0000","last_peered":"2023-10-06T03:26:10.290452+0000","last_clean":"2023-10-06T03:26:10.290452+0000","last_became_active":"2023-10-06T03:26:10.284121+0000","last_became_peered":"2023-10-06T03:26:10.284121+0000","last_unstale":"2023-10-06T03:26:10.290452+0000","last_undegraded":"2023-10-06T03:26:10.290452+0000","last_fullsized":"2023-10-06T03:26:10.290452+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:58.156565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255350+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:55.620133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254074+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.102438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253912+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:14.918357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.270673+0000","last_change":"2023-10-06T03:26:10.263185+0000","last_active":"2023-10-06T03:26:10.270673+0000","last_peered":"2023-10-06T03:26:10.270673+0000","last_clean":"2023-10-06T03:26:10.270673+0000","last_became_active":"2023-10-06T03:26:10.262810+0000","last_became_peered":"2023-10-06T03:26:10.262810+0000","last_unstale":"2023-10-06T03:26:10.270673+0000","last_undegraded":"2023-10-06T03:26:10.270673+0000","last_fullsized":"2023-10-06T03:26:10.270673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:23.033550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254778+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:36.025261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291508+0000","last_change":"2023-10-06T03:26:10.289206+0000","last_active":"2023-10-06T03:26:10.291508+0000","last_peered":"2023-10-06T03:26:10.291508+0000","last_clean":"2023-10-06T03:26:10.291508+0000","last_became_active":"2023-10-06T03:26:10.288939+0000","last_became_peered":"2023-10-06T03:26:10.288939+0000","last_unstale":"2023-10-06T03:26:10.291508+0000","last_undegraded":"2023-10-06T03:26:10.291508+0000","last_fullsized":"2023-10-06T03:26:10.291508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:56.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253418+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:45.059087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253860+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:25.679221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277460+0000","last_change":"2023-10-06T03:26:10.275173+0000","last_active":"2023-10-06T03:26:10.277460+0000","last_peered":"2023-10-06T03:26:10.277460+0000","last_clean":"2023-10-06T03:26:10.277460+0000","last_became_active":"2023-10-06T03:26:10.274909+0000","last_became_peered":"2023-10-06T03:26:10.274909+0000","last_unstale":"2023-10-06T03:26:10.277460+0000","last_undegraded":"2023-10-06T03:26:10.277460+0000","last_fullsized":"2023-10-06T03:26:10.277460+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:33.455977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253726+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.102438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276708+0000","last_change":"2023-10-06T03:26:09.270274+0000","last_active":"2023-10-06T03:26:10.276708+0000","last_peered":"2023-10-06T03:26:10.276708+0000","last_clean":"2023-10-06T03:26:10.276708+0000","last_became_active":"2023-10-06T03:26:09.270010+0000","last_became_peered":"2023-10-06T03:26:09.270010+0000","last_unstale":"2023-10-06T03:26:10.276708+0000","last_undegraded":"2023-10-06T03:26:10.276708+0000","last_fullsized":"2023-10-06T03:26:10.276708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:15.677167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254313+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:43.961534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282111+0000","last_change":"2023-10-06T03:26:10.279524+0000","last_active":"2023-10-06T03:26:10.282111+0000","last_peered":"2023-10-06T03:26:10.282111+0000","last_clean":"2023-10-06T03:26:10.282111+0000","last_became_active":"2023-10-06T03:26:10.279224+0000","last_became_peered":"2023-10-06T03:26:10.279224+0000","last_unstale":"2023-10-06T03:26:10.282111+0000","last_undegraded":"2023-10-06T03:26:10.282111+0000","last_fullsized":"2023-10-06T03:26:10.282111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:36.078198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255060+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:57.151691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255786+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:35.881495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"73'6","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.294552+0000","last_change":"2023-10-06T03:26:09.274118+0000","last_active":"2023-10-06T03:26:10.294552+0000","last_peered":"2023-10-06T03:26:10.294552+0000","last_clean":"2023-10-06T03:26:10.294552+0000","last_became_active":"2023-10-06T03:26:09.273846+0000","last_became_peered":"2023-10-06T03:26:09.273846+0000","last_unstale":"2023-10-06T03:26:10.294552+0000","last_undegraded":"2023-10-06T03:26:10.294552+0000","last_fullsized":"2023-10-06T03:26:10.294552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:34.678039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291495+0000","last_change":"2023-10-06T03:26:09.270358+0000","last_active":"2023-10-06T03:26:10.291495+0000","last_peered":"2023-10-06T03:26:10.291495+0000","last_clean":"2023-10-06T03:26:10.291495+0000","last_became_active":"2023-10-06T03:26:09.268859+0000","last_became_peered":"2023-10-06T03:26:09.268859+0000","last_unstale":"2023-10-06T03:26:10.291495+0000","last_undegraded":"2023-10-06T03:26:10.291495+0000","last_fullsized":"2023-10-06T03:26:10.291495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:11.840868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277429+0000","last_change":"2023-10-06T03:26:10.274400+0000","last_active":"2023-10-06T03:26:10.277429+0000","last_peered":"2023-10-06T03:26:10.277429+0000","last_clean":"2023-10-06T03:26:10.277429+0000","last_became_active":"2023-10-06T03:26:10.272719+0000","last_became_peered":"2023-10-06T03:26:10.272719+0000","last_unstale":"2023-10-06T03:26:10.277429+0000","last_undegraded":"2023-10-06T03:26:10.277429+0000","last_fullsized":"2023-10-06T03:26:10.277429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:44.549351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.256105+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:43.544478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290606+0000","last_change":"2023-10-06T03:26:10.285343+0000","last_active":"2023-10-06T03:26:10.290606+0000","last_peered":"2023-10-06T03:26:10.290606+0000","last_clean":"2023-10-06T03:26:10.290606+0000","last_became_active":"2023-10-06T03:26:10.284618+0000","last_became_peered":"2023-10-06T03:26:10.284618+0000","last_unstale":"2023-10-06T03:26:10.290606+0000","last_undegraded":"2023-10-06T03:26:10.290606+0000","last_fullsized":"2023-10-06T03:26:10.290606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:23.246504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267438+0000","last_change":"2023-10-06T03:26:09.276331+0000","last_active":"2023-10-06T03:26:10.267438+0000","last_peered":"2023-10-06T03:26:10.267438+0000","last_clean":"2023-10-06T03:26:10.267438+0000","last_became_active":"2023-10-06T03:26:09.276038+0000","last_became_peered":"2023-10-06T03:26:09.276038+0000","last_unstale":"2023-10-06T03:26:10.267438+0000","last_undegraded":"2023-10-06T03:26:10.267438+0000","last_fullsized":"2023-10-06T03:26:10.267438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:15.335321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.289651+0000","last_change":"2023-10-06T03:26:10.283421+0000","last_active":"2023-10-06T03:26:10.289651+0000","last_peered":"2023-10-06T03:26:10.289651+0000","last_clean":"2023-10-06T03:26:10.289651+0000","last_became_active":"2023-10-06T03:26:10.283133+0000","last_became_peered":"2023-10-06T03:26:10.283133+0000","last_unstale":"2023-10-06T03:26:10.289651+0000","last_undegraded":"2023-10-06T03:26:10.289651+0000","last_fullsized":"2023-10-06T03:26:10.289651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:36.886369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253864+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:24.807628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290102+0000","last_change":"2023-10-06T03:26:09.276138+0000","last_active":"2023-10-06T03:26:10.290102+0000","last_peered":"2023-10-06T03:26:10.290102+0000","last_clean":"2023-10-06T03:26:10.290102+0000","last_became_active":"2023-10-06T03:26:09.275927+0000","last_became_peered":"2023-10-06T03:26:09.275927+0000","last_unstale":"2023-10-06T03:26:10.290102+0000","last_undegraded":"2023-10-06T03:26:10.290102+0000","last_fullsized":"2023-10-06T03:26:10.290102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:19.285384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273154+0000","last_change":"2023-10-06T03:26:10.266427+0000","last_active":"2023-10-06T03:26:10.273154+0000","last_peered":"2023-10-06T03:26:10.273154+0000","last_clean":"2023-10-06T03:26:10.273154+0000","last_became_active":"2023-10-06T03:26:10.266130+0000","last_became_peered":"2023-10-06T03:26:10.266130+0000","last_unstale":"2023-10-06T03:26:10.273154+0000","last_undegraded":"2023-10-06T03:26:10.273154+0000","last_fullsized":"2023-10-06T03:26:10.273154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:47.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.278801+0000","last_change":"2023-10-06T03:26:09.270391+0000","last_active":"2023-10-06T03:26:10.278801+0000","last_peered":"2023-10-06T03:26:10.278801+0000","last_clean":"2023-10-06T03:26:10.278801+0000","last_became_active":"2023-10-06T03:26:09.270124+0000","last_became_peered":"2023-10-06T03:26:09.270124+0000","last_unstale":"2023-10-06T03:26:10.278801+0000","last_undegraded":"2023-10-06T03:26:10.278801+0000","last_fullsized":"2023-10-06T03:26:10.278801+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:20.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255376+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:12.020718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254669+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:01.199072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277520+0000","last_change":"2023-10-06T03:26:10.275099+0000","last_active":"2023-10-06T03:26:10.277520+0000","last_peered":"2023-10-06T03:26:10.277520+0000","last_clean":"2023-10-06T03:26:10.277520+0000","last_became_active":"2023-10-06T03:26:10.274837+0000","last_became_peered":"2023-10-06T03:26:10.274837+0000","last_unstale":"2023-10-06T03:26:10.277520+0000","last_undegraded":"2023-10-06T03:26:10.277520+0000","last_fullsized":"2023-10-06T03:26:10.277520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:56.297907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254175+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:43.544478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253236+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:56.578162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292304+0000","last_change":"2023-10-06T03:26:10.289118+0000","last_active":"2023-10-06T03:26:10.292304+0000","last_peered":"2023-10-06T03:26:10.292304+0000","last_clean":"2023-10-06T03:26:10.292304+0000","last_became_active":"2023-10-06T03:26:10.288760+0000","last_became_peered":"2023-10-06T03:26:10.288760+0000","last_unstale":"2023-10-06T03:26:10.292304+0000","last_undegraded":"2023-10-06T03:26:10.292304+0000","last_fullsized":"2023-10-06T03:26:10.292304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:08.877217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254219+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:05.466134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253315+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:49.259150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277457+0000","last_change":"2023-10-06T03:26:10.274551+0000","last_active":"2023-10-06T03:26:10.277457+0000","last_peered":"2023-10-06T03:26:10.277457+0000","last_clean":"2023-10-06T03:26:10.277457+0000","last_became_active":"2023-10-06T03:26:10.274250+0000","last_became_peered":"2023-10-06T03:26:10.274250+0000","last_unstale":"2023-10-06T03:26:10.277457+0000","last_undegraded":"2023-10-06T03:26:10.277457+0000","last_fullsized":"2023-10-06T03:26:10.277457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.063961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.257312+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:32.451103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":58,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.549757+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:26:05.549757+0000","last_peered":"2023-10-06T03:26:05.549757+0000","last_clean":"2023-10-06T03:26:05.549757+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:26:05.549757+0000","last_undegraded":"2023-10-06T03:26:05.549757+0000","last_fullsized":"2023-10-06T03:26:05.549757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282378+0000","last_change":"2023-10-06T03:26:10.274993+0000","last_active":"2023-10-06T03:26:10.282378+0000","last_peered":"2023-10-06T03:26:10.282378+0000","last_clean":"2023-10-06T03:26:10.282378+0000","last_became_active":"2023-10-06T03:26:10.273552+0000","last_became_peered":"2023-10-06T03:26:10.273552+0000","last_unstale":"2023-10-06T03:26:10.282378+0000","last_undegraded":"2023-10-06T03:26:10.282378+0000","last_fullsized":"2023-10-06T03:26:10.282378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:02.203946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.258204+0000","last_change":"2023-10-06T03:26:09.273820+0000","last_active":"2023-10-06T03:26:10.258204+0000","last_peered":"2023-10-06T03:26:10.258204+0000","last_clean":"2023-10-06T03:26:10.258204+0000","last_became_active":"2023-10-06T03:26:09.273557+0000","last_became_peered":"2023-10-06T03:26:09.273557+0000","last_unstale":"2023-10-06T03:26:10.258204+0000","last_undegraded":"2023-10-06T03:26:10.258204+0000","last_fullsized":"2023-10-06T03:26:10.258204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:00.402266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.259090+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:26:05.259090+0000","last_peered":"2023-10-06T03:26:05.259090+0000","last_clean":"2023-10-06T03:26:05.259090+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:26:05.259090+0000","last_undegraded":"2023-10-06T03:26:05.259090+0000","last_fullsized":"2023-10-06T03:26:05.259090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253931+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:22.028676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273041+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:26:10.273041+0000","last_peered":"2023-10-06T03:26:10.273041+0000","last_clean":"2023-10-06T03:26:10.273041+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:26:10.273041+0000","last_undegraded":"2023-10-06T03:26:10.273041+0000","last_fullsized":"2023-10-06T03:26:10.273041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":217,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261049+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:26:10.261049+0000","last_peered":"2023-10-06T03:26:10.261049+0000","last_clean":"2023-10-06T03:26:10.261049+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:26:10.261049+0000","last_undegraded":"2023-10-06T03:26:10.261049+0000","last_fullsized":"2023-10-06T03:26:10.261049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276526+0000","last_change":"2023-10-06T03:26:10.272687+0000","last_active":"2023-10-06T03:26:10.276526+0000","last_peered":"2023-10-06T03:26:10.276526+0000","last_clean":"2023-10-06T03:26:10.276526+0000","last_became_active":"2023-10-06T03:26:10.272443+0000","last_became_peered":"2023-10-06T03:26:10.272443+0000","last_unstale":"2023-10-06T03:26:10.276526+0000","last_undegraded":"2023-10-06T03:26:10.276526+0000","last_fullsized":"2023-10-06T03:26:10.276526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254822+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:22.241630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.260348+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:26:10.260348+0000","last_peered":"2023-10-06T03:26:10.260348+0000","last_clean":"2023-10-06T03:26:10.260348+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:26:10.260348+0000","last_undegraded":"2023-10-06T03:26:10.260348+0000","last_fullsized":"2023-10-06T03:26:10.260348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288455+0000","last_change":"2023-10-06T03:26:10.280327+0000","last_active":"2023-10-06T03:26:10.288455+0000","last_peered":"2023-10-06T03:26:10.288455+0000","last_clean":"2023-10-06T03:26:10.288455+0000","last_became_active":"2023-10-06T03:26:10.280026+0000","last_became_peered":"2023-10-06T03:26:10.280026+0000","last_unstale":"2023-10-06T03:26:10.288455+0000","last_undegraded":"2023-10-06T03:26:10.288455+0000","last_fullsized":"2023-10-06T03:26:10.288455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:02.203946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290273+0000","last_change":"2023-10-06T03:26:09.277164+0000","last_active":"2023-10-06T03:26:10.290273+0000","last_peered":"2023-10-06T03:26:10.290273+0000","last_clean":"2023-10-06T03:26:10.290273+0000","last_became_active":"2023-10-06T03:26:09.276901+0000","last_became_peered":"2023-10-06T03:26:09.276901+0000","last_unstale":"2023-10-06T03:26:10.290273+0000","last_undegraded":"2023-10-06T03:26:10.290273+0000","last_fullsized":"2023-10-06T03:26:10.290273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:00.081929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.260972+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:26:10.260972+0000","last_peered":"2023-10-06T03:26:10.260972+0000","last_clean":"2023-10-06T03:26:10.260972+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:26:10.260972+0000","last_undegraded":"2023-10-06T03:26:10.260972+0000","last_fullsized":"2023-10-06T03:26:10.260972+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254168+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:07.827990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":54,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267532+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:26:10.267532+0000","last_peered":"2023-10-06T03:26:10.267532+0000","last_clean":"2023-10-06T03:26:10.267532+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:26:10.267532+0000","last_undegraded":"2023-10-06T03:26:10.267532+0000","last_fullsized":"2023-10-06T03:26:10.267532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286719+0000","last_change":"2023-10-06T03:26:10.282039+0000","last_active":"2023-10-06T03:26:10.286719+0000","last_peered":"2023-10-06T03:26:10.286719+0000","last_clean":"2023-10-06T03:26:10.286719+0000","last_became_active":"2023-10-06T03:26:10.281621+0000","last_became_peered":"2023-10-06T03:26:10.281621+0000","last_unstale":"2023-10-06T03:26:10.286719+0000","last_undegraded":"2023-10-06T03:26:10.286719+0000","last_fullsized":"2023-10-06T03:26:10.286719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:51.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.256621+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:07.872343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":50,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.550531+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:26:05.550531+0000","last_peered":"2023-10-06T03:26:05.550531+0000","last_clean":"2023-10-06T03:26:05.550531+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:26:05.550531+0000","last_undegraded":"2023-10-06T03:26:05.550531+0000","last_fullsized":"2023-10-06T03:26:05.550531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277440+0000","last_change":"2023-10-06T03:26:10.276362+0000","last_active":"2023-10-06T03:26:10.277440+0000","last_peered":"2023-10-06T03:26:10.277440+0000","last_clean":"2023-10-06T03:26:10.277440+0000","last_became_active":"2023-10-06T03:26:10.276083+0000","last_became_peered":"2023-10-06T03:26:10.276083+0000","last_unstale":"2023-10-06T03:26:10.277440+0000","last_undegraded":"2023-10-06T03:26:10.277440+0000","last_fullsized":"2023-10-06T03:26:10.277440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:50.264024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.258579+0000","last_change":"2023-10-06T03:26:09.267273+0000","last_active":"2023-10-06T03:26:10.258579+0000","last_peered":"2023-10-06T03:26:10.258579+0000","last_clean":"2023-10-06T03:26:10.258579+0000","last_became_active":"2023-10-06T03:26:09.267016+0000","last_became_peered":"2023-10-06T03:26:09.267016+0000","last_unstale":"2023-10-06T03:26:10.258579+0000","last_undegraded":"2023-10-06T03:26:10.258579+0000","last_fullsized":"2023-10-06T03:26:10.258579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:20.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":50,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.550585+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:26:05.550585+0000","last_peered":"2023-10-06T03:26:05.550585+0000","last_clean":"2023-10-06T03:26:05.550585+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:26:05.550585+0000","last_undegraded":"2023-10-06T03:26:05.550585+0000","last_fullsized":"2023-10-06T03:26:05.550585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1640,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298756,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073084,"statfs":{"total":96636764160,"available":96330838016,"internally_reserved":0,"allocated":1503232,"data_stored":1015699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69199999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.72999999999999998,"15min":0.76300000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66200000000000003,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.752,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67100000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81699999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73599999999999999,"5min":1.103,"15min":1.103},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81799999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.629}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.878,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":397450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.343,"15min":1.343},"last":0.36499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.329,"15min":1.329},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.76400000000000001,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80400000000000005,"15min":0.83999999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.042,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.80600000000000005,"15min":0.84199999999999997},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.81899999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.45800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39800000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.503},{"interface":"front","average":{"1min":0.63,"5min":0.626,"15min":0.625},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.49299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1015823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.38700000000000001,"15min":0.40300000000000002},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.38500000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.41199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.40600000000000003,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.44800000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.44600000000000001,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.41699999999999998,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.745,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80100000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.70899999999999996,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":396097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.435,"5min":12.19,"15min":12.19},"last":0.215},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.64000000000000001,"15min":0.68799999999999994},"min":{"1min":0.28599999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46800000000000003,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.28000000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50800000000000001,"5min":1.357,"15min":1.357},"last":0.314},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.24199999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.92000000000000004,"15min":1.02},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.495,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.29099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.49099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.089,"15min":1.179},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":16.919,"15min":16.919},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.1000000000000001,"15min":1.1930000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79700000000000004,"5min":16.948,"15min":16.948},"last":0.749}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67700000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.1140000000000001,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":16.881,"15min":16.881},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298176,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073664,"statfs":{"total":96636764160,"available":96331431936,"internally_reserved":0,"allocated":909312,"data_stored":425815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33800000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.51500000000000001,"5min":0.62,"15min":0.62},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.48599999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.42799999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.311},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52100000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33600000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.376}]},{"osd":6,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.875,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.46100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":397450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32400000000000001,"15min":0.32600000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42699999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49199999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32000000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77100000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.436},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75700000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":397450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2709999999999999,"5min":4.758,"15min":4.758},"last":0.377},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.88900000000000001,"15min":0.95299999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.5}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.432},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84399999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":426819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60699999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.64700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69399999999999995,"5min":0.999,"15min":0.999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68500000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73399999999999999,"5min":0.746,"15min":0.746},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":1.04,"15min":1.04},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.378,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":1.284,"15min":1.284},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:26:14.350 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:26:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.495+0000 7fcebc49d700 1 Processor -- start 2023-10-06T03:26:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.495+0000 7fcebc49d700 1 -- start start 2023-10-06T03:26:14.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.496+0000 7fcebc49d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fceb41595a0 0x7fceb40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.496+0000 7fcebc49d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fceb40b07a0 0x7fceb40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.496+0000 7fcebc49d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb40b0ca0 con 0x7fceb40b49e0 2023-10-06T03:26:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.496+0000 7fcebc49d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb40b0f80 con 0x7fceb41595a0 2023-10-06T03:26:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.496+0000 7fcebc49d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40b1260 con 0x7fceb40b07a0 2023-10-06T03:26:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.496+0000 7fceba239700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fceb41595a0 0x7fceb40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.496+0000 7fceba239700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fceb41595a0 0x7fceb40aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49466/0 (socket says 172.21.15.84:49466) 2023-10-06T03:26:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.496+0000 7fceba239700 1 -- 172.21.15.84:0/3135737654 learned_addr learned my addr 172.21.15.84:0/3135737654 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fceba239700 1 -- 172.21.15.84:0/3135737654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fceb40b07a0 msgr2=0x7fceb40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fceba239700 1 --2- 172.21.15.84:0/3135737654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fceb40b07a0 0x7fceb40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fceba239700 1 -- 172.21.15.84:0/3135737654 >> v1:172.21.15.131:6789/0 conn(0x7fceb40b49e0 legacy=0x7fceb40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fceba239700 1 -- 172.21.15.84:0/3135737654 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb40b1540 con 0x7fceb41595a0 2023-10-06T03:26:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fceba239700 1 --2- 172.21.15.84:0/3135737654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 0x7fceb40aa570 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009fa0 tx=0x7fceb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad7a83f1d7291d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fceb9237700 1 -- 172.21.15.84:0/3135737654 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000e070 con 0x7fceb41595a0 2023-10-06T03:26:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fceb9237700 1 -- 172.21.15.84:0/3135737654 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb000ba80 con 0x7fceb41595a0 2023-10-06T03:26:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fceb9237700 1 -- 172.21.15.84:0/3135737654 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb00092e0 con 0x7fceb41595a0 2023-10-06T03:26:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fcebc49d700 1 -- 172.21.15.84:0/3135737654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 msgr2=0x7fceb40aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fcebc49d700 1 --2- 172.21.15.84:0/3135737654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 0x7fceb40aa570 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009fa0 tx=0x7fceb0009840 comp rx=0 tx=0).stop 2023-10-06T03:26:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fcebc49d700 1 -- 172.21.15.84:0/3135737654 shutdown_connections 2023-10-06T03:26:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fcebc49d700 1 --2- 172.21.15.84:0/3135737654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fceb40b07a0 0x7fceb40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fcebc49d700 1 --2- 172.21.15.84:0/3135737654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 0x7fceb40aa570 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fcebc49d700 1 -- 172.21.15.84:0/3135737654 >> 172.21.15.84:0/3135737654 conn(0x7fceb4099830 msgr2=0x7fceb406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.497+0000 7fcebc49d700 1 -- 172.21.15.84:0/3135737654 shutdown_connections 2023-10-06T03:26:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.498+0000 7fcebc49d700 1 -- 172.21.15.84:0/3135737654 wait complete. 2023-10-06T03:26:14.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebc49d700 1 Processor -- start 2023-10-06T03:26:14.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebc49d700 1 -- start start 2023-10-06T03:26:14.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebc49d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fceb40b07a0 0x7fceb40af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebc49d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceb40b49e0 0x7fceb41579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebc49d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 0x7fceb40ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebc49d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb416da00 con 0x7fceb41595a0 2023-10-06T03:26:14.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebc49d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb416dce0 con 0x7fceb40b49e0 2023-10-06T03:26:14.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebc49d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb416dfc0 con 0x7fceb40b07a0 2023-10-06T03:26:14.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebaa3a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 0x7fceb40ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebaa3a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 0x7fceb40ce960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49478/0 (socket says 172.21.15.84:49478) 2023-10-06T03:26:14.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fcebaa3a700 1 -- 172.21.15.84:0/124788297 learned_addr learned my addr 172.21.15.84:0/124788297 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:14.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fceba239700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fceb40b07a0 0x7fceb40af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.499+0000 7fceb9a38700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceb40b49e0 0x7fceb41579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fcebaa3a700 1 -- 172.21.15.84:0/124788297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fceb40b07a0 msgr2=0x7fceb40af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fcebaa3a700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fceb40b07a0 0x7fceb40af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fcebaa3a700 1 -- 172.21.15.84:0/124788297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceb40b49e0 msgr2=0x7fceb41579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fcebaa3a700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceb40b49e0 0x7fceb41579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fcebaa3a700 1 -- 172.21.15.84:0/124788297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0009ae0 con 0x7fceb41595a0 2023-10-06T03:26:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fceba239700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fceb40b07a0 0x7fceb40af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fceb9a38700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceb40b49e0 0x7fceb41579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fcebaa3a700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 0x7fceb40ce960 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fceac00b600 tx=0x7fceac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fceaa7fc700 1 -- 172.21.15.84:0/124788297 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00f510 con 0x7fceb41595a0 2023-10-06T03:26:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fceaa7fc700 1 -- 172.21.15.84:0/124788297 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac00f690 con 0x7fceb41595a0 2023-10-06T03:26:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fcebc49d700 1 -- 172.21.15.84:0/124788297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb416e2a0 con 0x7fceb41595a0 2023-10-06T03:26:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fceaa7fc700 1 -- 172.21.15.84:0/124788297 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00fa50 con 0x7fceb41595a0 2023-10-06T03:26:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.500+0000 7fcebc49d700 1 -- 172.21.15.84:0/124788297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb40ad480 con 0x7fceb41595a0 2023-10-06T03:26:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.501+0000 7fcebc49d700 1 -- 172.21.15.84:0/124788297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb4064ad0 con 0x7fceb41595a0 2023-10-06T03:26:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.501+0000 7fceaa7fc700 1 -- 172.21.15.84:0/124788297 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fceac01a400 con 0x7fceb41595a0 2023-10-06T03:26:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.502+0000 7fceaa7fc700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce98066f30 0x7fce980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.502+0000 7fceaa7fc700 1 -- 172.21.15.84:0/124788297 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fceac0843b0 con 0x7fceb41595a0 2023-10-06T03:26:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.502+0000 7fceba239700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce98066f30 0x7fce980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.502+0000 7fceba239700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce98066f30 0x7fce980693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009880 tx=0x7fceb0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:14.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.506+0000 7fceaa7fc700 1 -- 172.21.15.84:0/124788297 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fceac051400 con 0x7fceb41595a0 2023-10-06T03:26:14.567 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:26:14.565+0000 7f74e7fac700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:26:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.685+0000 7fcebc49d700 1 -- 172.21.15.84:0/124788297 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fceb40b1820 con 0x7fce98066f30 2023-10-06T03:26:14.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.693+0000 7fceaa7fc700 1 -- 172.21.15.84:0/124788297 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306692 (secure 0 0 0) 0x7fceb40b1820 con 0x7fce98066f30 2023-10-06T03:26:14.699 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:14.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 -- 172.21.15.84:0/124788297 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce98066f30 msgr2=0x7fce980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce98066f30 0x7fce980693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009880 tx=0x7fceb0017000 comp rx=0 tx=0).stop 2023-10-06T03:26:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 -- 172.21.15.84:0/124788297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 msgr2=0x7fceb40ce960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 0x7fceb40ce960 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fceac00b600 tx=0x7fceac0091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 -- 172.21.15.84:0/124788297 shutdown_connections 2023-10-06T03:26:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce98066f30 0x7fce980693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceb41595a0 0x7fceb40ce960 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fceb40b07a0 0x7fceb40af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 --2- 172.21.15.84:0/124788297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceb40b49e0 0x7fceb41579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 -- 172.21.15.84:0/124788297 >> 172.21.15.84:0/124788297 conn(0x7fceb4099830 msgr2=0x7fceb4158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.696+0000 7fcebc49d700 1 -- 172.21.15.84:0/124788297 shutdown_connections 2023-10-06T03:26:14.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.697+0000 7fcebc49d700 1 -- 172.21.15.84:0/124788297 wait complete. 2023-10-06T03:26:14.703 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:26:14.710 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2023-10-06T03:26:13.069609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592008,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386376,"kb_used_data":8072,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588344,"statfs":{"total":773094113280,"available":770650464256,"internally_reserved":0,"allocated":8265728,"data_stored":4472603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.819968"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290649+0000","last_change":"2023-10-06T03:26:10.288789+0000","last_active":"2023-10-06T03:26:10.290649+0000","last_peered":"2023-10-06T03:26:10.290649+0000","last_clean":"2023-10-06T03:26:10.290649+0000","last_became_active":"2023-10-06T03:26:10.288490+0000","last_became_peered":"2023-10-06T03:26:10.288490+0000","last_unstale":"2023-10-06T03:26:10.290649+0000","last_undegraded":"2023-10-06T03:26:10.290649+0000","last_fullsized":"2023-10-06T03:26:10.290649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:26.085236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271421+0000","last_change":"2023-10-06T03:26:10.265089+0000","last_active":"2023-10-06T03:26:10.271421+0000","last_peered":"2023-10-06T03:26:10.271421+0000","last_clean":"2023-10-06T03:26:10.271421+0000","last_became_active":"2023-10-06T03:26:10.264799+0000","last_became_peered":"2023-10-06T03:26:10.264799+0000","last_unstale":"2023-10-06T03:26:10.271421+0000","last_undegraded":"2023-10-06T03:26:10.271421+0000","last_fullsized":"2023-10-06T03:26:10.271421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:40.805767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282199+0000","last_change":"2023-10-06T03:26:10.274603+0000","last_active":"2023-10-06T03:26:10.282199+0000","last_peered":"2023-10-06T03:26:10.282199+0000","last_clean":"2023-10-06T03:26:10.282199+0000","last_became_active":"2023-10-06T03:26:10.274368+0000","last_became_peered":"2023-10-06T03:26:10.274368+0000","last_unstale":"2023-10-06T03:26:10.282199+0000","last_undegraded":"2023-10-06T03:26:10.282199+0000","last_fullsized":"2023-10-06T03:26:10.282199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:22.065858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282010+0000","last_change":"2023-10-06T03:26:10.278848+0000","last_active":"2023-10-06T03:26:10.282010+0000","last_peered":"2023-10-06T03:26:10.282010+0000","last_clean":"2023-10-06T03:26:10.282010+0000","last_became_active":"2023-10-06T03:26:10.278604+0000","last_became_peered":"2023-10-06T03:26:10.278604+0000","last_unstale":"2023-10-06T03:26:10.282010+0000","last_undegraded":"2023-10-06T03:26:10.282010+0000","last_fullsized":"2023-10-06T03:26:10.282010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:57.583036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.269336+0000","last_change":"2023-10-06T03:26:10.264610+0000","last_active":"2023-10-06T03:26:10.269336+0000","last_peered":"2023-10-06T03:26:10.269336+0000","last_clean":"2023-10-06T03:26:10.269336+0000","last_became_active":"2023-10-06T03:26:10.264360+0000","last_became_peered":"2023-10-06T03:26:10.264360+0000","last_unstale":"2023-10-06T03:26:10.269336+0000","last_undegraded":"2023-10-06T03:26:10.269336+0000","last_fullsized":"2023-10-06T03:26:10.269336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:44.966408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.294483+0000","last_change":"2023-10-06T03:26:10.289416+0000","last_active":"2023-10-06T03:26:10.294483+0000","last_peered":"2023-10-06T03:26:10.294483+0000","last_clean":"2023-10-06T03:26:10.294483+0000","last_became_active":"2023-10-06T03:26:10.289136+0000","last_became_peered":"2023-10-06T03:26:10.289136+0000","last_unstale":"2023-10-06T03:26:10.294483+0000","last_undegraded":"2023-10-06T03:26:10.294483+0000","last_fullsized":"2023-10-06T03:26:10.294483+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:26.684095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277565+0000","last_change":"2023-10-06T03:26:10.274574+0000","last_active":"2023-10-06T03:26:10.277565+0000","last_peered":"2023-10-06T03:26:10.277565+0000","last_clean":"2023-10-06T03:26:10.277565+0000","last_became_active":"2023-10-06T03:26:10.274274+0000","last_became_peered":"2023-10-06T03:26:10.274274+0000","last_unstale":"2023-10-06T03:26:10.277565+0000","last_undegraded":"2023-10-06T03:26:10.277565+0000","last_fullsized":"2023-10-06T03:26:10.277565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288219+0000","last_change":"2023-10-06T03:26:10.276484+0000","last_active":"2023-10-06T03:26:10.288219+0000","last_peered":"2023-10-06T03:26:10.288219+0000","last_clean":"2023-10-06T03:26:10.288219+0000","last_became_active":"2023-10-06T03:26:10.276132+0000","last_became_peered":"2023-10-06T03:26:10.276132+0000","last_unstale":"2023-10-06T03:26:10.288219+0000","last_undegraded":"2023-10-06T03:26:10.288219+0000","last_fullsized":"2023-10-06T03:26:10.288219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:23.660405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.287197+0000","last_change":"2023-10-06T03:26:10.283921+0000","last_active":"2023-10-06T03:26:10.287197+0000","last_peered":"2023-10-06T03:26:10.287197+0000","last_clean":"2023-10-06T03:26:10.287197+0000","last_became_active":"2023-10-06T03:26:10.283622+0000","last_became_peered":"2023-10-06T03:26:10.283622+0000","last_unstale":"2023-10-06T03:26:10.287197+0000","last_undegraded":"2023-10-06T03:26:10.287197+0000","last_fullsized":"2023-10-06T03:26:10.287197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:37.030135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286698+0000","last_change":"2023-10-06T03:26:10.281874+0000","last_active":"2023-10-06T03:26:10.286698+0000","last_peered":"2023-10-06T03:26:10.286698+0000","last_clean":"2023-10-06T03:26:10.286698+0000","last_became_active":"2023-10-06T03:26:10.281250+0000","last_became_peered":"2023-10-06T03:26:10.281250+0000","last_unstale":"2023-10-06T03:26:10.286698+0000","last_undegraded":"2023-10-06T03:26:10.286698+0000","last_fullsized":"2023-10-06T03:26:10.286698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:06.471008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.269176+0000","last_change":"2023-10-06T03:26:10.264466+0000","last_active":"2023-10-06T03:26:10.269176+0000","last_peered":"2023-10-06T03:26:10.269176+0000","last_clean":"2023-10-06T03:26:10.269176+0000","last_became_active":"2023-10-06T03:26:10.264162+0000","last_became_peered":"2023-10-06T03:26:10.264162+0000","last_unstale":"2023-10-06T03:26:10.269176+0000","last_undegraded":"2023-10-06T03:26:10.269176+0000","last_fullsized":"2023-10-06T03:26:10.269176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:23.246504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.281789+0000","last_change":"2023-10-06T03:26:10.269887+0000","last_active":"2023-10-06T03:26:10.281789+0000","last_peered":"2023-10-06T03:26:10.281789+0000","last_clean":"2023-10-06T03:26:10.281789+0000","last_became_active":"2023-10-06T03:26:10.269397+0000","last_became_peered":"2023-10-06T03:26:10.269397+0000","last_unstale":"2023-10-06T03:26:10.281789+0000","last_undegraded":"2023-10-06T03:26:10.281789+0000","last_fullsized":"2023-10-06T03:26:10.281789+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:48.998501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.281751+0000","last_change":"2023-10-06T03:26:10.273079+0000","last_active":"2023-10-06T03:26:10.281751+0000","last_peered":"2023-10-06T03:26:10.281751+0000","last_clean":"2023-10-06T03:26:10.281751+0000","last_became_active":"2023-10-06T03:26:10.272822+0000","last_became_peered":"2023-10-06T03:26:10.272822+0000","last_unstale":"2023-10-06T03:26:10.281751+0000","last_undegraded":"2023-10-06T03:26:10.281751+0000","last_fullsized":"2023-10-06T03:26:10.281751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:22.093208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288661+0000","last_change":"2023-10-06T03:26:10.280816+0000","last_active":"2023-10-06T03:26:10.288661+0000","last_peered":"2023-10-06T03:26:10.288661+0000","last_clean":"2023-10-06T03:26:10.288661+0000","last_became_active":"2023-10-06T03:26:10.280318+0000","last_became_peered":"2023-10-06T03:26:10.280318+0000","last_unstale":"2023-10-06T03:26:10.288661+0000","last_undegraded":"2023-10-06T03:26:10.288661+0000","last_fullsized":"2023-10-06T03:26:10.288661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:44.966408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282363+0000","last_change":"2023-10-06T03:26:10.274678+0000","last_active":"2023-10-06T03:26:10.282363+0000","last_peered":"2023-10-06T03:26:10.282363+0000","last_clean":"2023-10-06T03:26:10.282363+0000","last_became_active":"2023-10-06T03:26:10.274409+0000","last_became_peered":"2023-10-06T03:26:10.274409+0000","last_unstale":"2023-10-06T03:26:10.282363+0000","last_undegraded":"2023-10-06T03:26:10.282363+0000","last_fullsized":"2023-10-06T03:26:10.282363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:38.350999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.289382+0000","last_change":"2023-10-06T03:26:10.283714+0000","last_active":"2023-10-06T03:26:10.289382+0000","last_peered":"2023-10-06T03:26:10.289382+0000","last_clean":"2023-10-06T03:26:10.289382+0000","last_became_active":"2023-10-06T03:26:10.283184+0000","last_became_peered":"2023-10-06T03:26:10.283184+0000","last_unstale":"2023-10-06T03:26:10.289382+0000","last_undegraded":"2023-10-06T03:26:10.289382+0000","last_fullsized":"2023-10-06T03:26:10.289382+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:35.682913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292296+0000","last_change":"2023-10-06T03:26:10.289063+0000","last_active":"2023-10-06T03:26:10.292296+0000","last_peered":"2023-10-06T03:26:10.292296+0000","last_clean":"2023-10-06T03:26:10.292296+0000","last_became_active":"2023-10-06T03:26:10.288750+0000","last_became_peered":"2023-10-06T03:26:10.288750+0000","last_unstale":"2023-10-06T03:26:10.292296+0000","last_undegraded":"2023-10-06T03:26:10.292296+0000","last_fullsized":"2023-10-06T03:26:10.292296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:56.252304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288551+0000","last_change":"2023-10-06T03:26:10.280335+0000","last_active":"2023-10-06T03:26:10.288551+0000","last_peered":"2023-10-06T03:26:10.288551+0000","last_clean":"2023-10-06T03:26:10.288551+0000","last_became_active":"2023-10-06T03:26:10.280015+0000","last_became_peered":"2023-10-06T03:26:10.280015+0000","last_unstale":"2023-10-06T03:26:10.288551+0000","last_undegraded":"2023-10-06T03:26:10.288551+0000","last_fullsized":"2023-10-06T03:26:10.288551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:13.025592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290452+0000","last_change":"2023-10-06T03:26:10.284367+0000","last_active":"2023-10-06T03:26:10.290452+0000","last_peered":"2023-10-06T03:26:10.290452+0000","last_clean":"2023-10-06T03:26:10.290452+0000","last_became_active":"2023-10-06T03:26:10.284121+0000","last_became_peered":"2023-10-06T03:26:10.284121+0000","last_unstale":"2023-10-06T03:26:10.290452+0000","last_undegraded":"2023-10-06T03:26:10.290452+0000","last_fullsized":"2023-10-06T03:26:10.290452+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:58.156565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255350+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:55.620133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254074+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.102438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253912+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:14.918357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.270673+0000","last_change":"2023-10-06T03:26:10.263185+0000","last_active":"2023-10-06T03:26:10.270673+0000","last_peered":"2023-10-06T03:26:10.270673+0000","last_clean":"2023-10-06T03:26:10.270673+0000","last_became_active":"2023-10-06T03:26:10.262810+0000","last_became_peered":"2023-10-06T03:26:10.262810+0000","last_unstale":"2023-10-06T03:26:10.270673+0000","last_undegraded":"2023-10-06T03:26:10.270673+0000","last_fullsized":"2023-10-06T03:26:10.270673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:23.033550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254778+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:36.025261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291508+0000","last_change":"2023-10-06T03:26:10.289206+0000","last_active":"2023-10-06T03:26:10.291508+0000","last_peered":"2023-10-06T03:26:10.291508+0000","last_clean":"2023-10-06T03:26:10.291508+0000","last_became_active":"2023-10-06T03:26:10.288939+0000","last_became_peered":"2023-10-06T03:26:10.288939+0000","last_unstale":"2023-10-06T03:26:10.291508+0000","last_undegraded":"2023-10-06T03:26:10.291508+0000","last_fullsized":"2023-10-06T03:26:10.291508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:56.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253418+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:45.059087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253860+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:25.679221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277460+0000","last_change":"2023-10-06T03:26:10.275173+0000","last_active":"2023-10-06T03:26:10.277460+0000","last_peered":"2023-10-06T03:26:10.277460+0000","last_clean":"2023-10-06T03:26:10.277460+0000","last_became_active":"2023-10-06T03:26:10.274909+0000","last_became_peered":"2023-10-06T03:26:10.274909+0000","last_unstale":"2023-10-06T03:26:10.277460+0000","last_undegraded":"2023-10-06T03:26:10.277460+0000","last_fullsized":"2023-10-06T03:26:10.277460+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:33.455977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253726+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.102438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276708+0000","last_change":"2023-10-06T03:26:09.270274+0000","last_active":"2023-10-06T03:26:10.276708+0000","last_peered":"2023-10-06T03:26:10.276708+0000","last_clean":"2023-10-06T03:26:10.276708+0000","last_became_active":"2023-10-06T03:26:09.270010+0000","last_became_peered":"2023-10-06T03:26:09.270010+0000","last_unstale":"2023-10-06T03:26:10.276708+0000","last_undegraded":"2023-10-06T03:26:10.276708+0000","last_fullsized":"2023-10-06T03:26:10.276708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:15.677167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254313+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:43.961534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282111+0000","last_change":"2023-10-06T03:26:10.279524+0000","last_active":"2023-10-06T03:26:10.282111+0000","last_peered":"2023-10-06T03:26:10.282111+0000","last_clean":"2023-10-06T03:26:10.282111+0000","last_became_active":"2023-10-06T03:26:10.279224+0000","last_became_peered":"2023-10-06T03:26:10.279224+0000","last_unstale":"2023-10-06T03:26:10.282111+0000","last_undegraded":"2023-10-06T03:26:10.282111+0000","last_fullsized":"2023-10-06T03:26:10.282111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:36.078198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255060+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:57.151691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255786+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:35.881495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"73'6","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.294552+0000","last_change":"2023-10-06T03:26:09.274118+0000","last_active":"2023-10-06T03:26:10.294552+0000","last_peered":"2023-10-06T03:26:10.294552+0000","last_clean":"2023-10-06T03:26:10.294552+0000","last_became_active":"2023-10-06T03:26:09.273846+0000","last_became_peered":"2023-10-06T03:26:09.273846+0000","last_unstale":"2023-10-06T03:26:10.294552+0000","last_undegraded":"2023-10-06T03:26:10.294552+0000","last_fullsized":"2023-10-06T03:26:10.294552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:34.678039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291495+0000","last_change":"2023-10-06T03:26:09.270358+0000","last_active":"2023-10-06T03:26:10.291495+0000","last_peered":"2023-10-06T03:26:10.291495+0000","last_clean":"2023-10-06T03:26:10.291495+0000","last_became_active":"2023-10-06T03:26:09.268859+0000","last_became_peered":"2023-10-06T03:26:09.268859+0000","last_unstale":"2023-10-06T03:26:10.291495+0000","last_undegraded":"2023-10-06T03:26:10.291495+0000","last_fullsized":"2023-10-06T03:26:10.291495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:11.840868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277429+0000","last_change":"2023-10-06T03:26:10.274400+0000","last_active":"2023-10-06T03:26:10.277429+0000","last_peered":"2023-10-06T03:26:10.277429+0000","last_clean":"2023-10-06T03:26:10.277429+0000","last_became_active":"2023-10-06T03:26:10.272719+0000","last_became_peered":"2023-10-06T03:26:10.272719+0000","last_unstale":"2023-10-06T03:26:10.277429+0000","last_undegraded":"2023-10-06T03:26:10.277429+0000","last_fullsized":"2023-10-06T03:26:10.277429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:44.549351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.256105+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:43.544478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290606+0000","last_change":"2023-10-06T03:26:10.285343+0000","last_active":"2023-10-06T03:26:10.290606+0000","last_peered":"2023-10-06T03:26:10.290606+0000","last_clean":"2023-10-06T03:26:10.290606+0000","last_became_active":"2023-10-06T03:26:10.284618+0000","last_became_peered":"2023-10-06T03:26:10.284618+0000","last_unstale":"2023-10-06T03:26:10.290606+0000","last_undegraded":"2023-10-06T03:26:10.290606+0000","last_fullsized":"2023-10-06T03:26:10.290606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:23.246504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267438+0000","last_change":"2023-10-06T03:26:09.276331+0000","last_active":"2023-10-06T03:26:10.267438+0000","last_peered":"2023-10-06T03:26:10.267438+0000","last_clean":"2023-10-06T03:26:10.267438+0000","last_became_active":"2023-10-06T03:26:09.276038+0000","last_became_peered":"2023-10-06T03:26:09.276038+0000","last_unstale":"2023-10-06T03:26:10.267438+0000","last_undegraded":"2023-10-06T03:26:10.267438+0000","last_fullsized":"2023-10-06T03:26:10.267438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:15.335321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.289651+0000","last_change":"2023-10-06T03:26:10.283421+0000","last_active":"2023-10-06T03:26:10.289651+0000","last_peered":"2023-10-06T03:26:10.289651+0000","last_clean":"2023-10-06T03:26:10.289651+0000","last_became_active":"2023-10-06T03:26:10.283133+0000","last_became_peered":"2023-10-06T03:26:10.283133+0000","last_unstale":"2023-10-06T03:26:10.289651+0000","last_undegraded":"2023-10-06T03:26:10.289651+0000","last_fullsized":"2023-10-06T03:26:10.289651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:36.886369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253864+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:24.807628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290102+0000","last_change":"2023-10-06T03:26:09.276138+0000","last_active":"2023-10-06T03:26:10.290102+0000","last_peered":"2023-10-06T03:26:10.290102+0000","last_clean":"2023-10-06T03:26:10.290102+0000","last_became_active":"2023-10-06T03:26:09.275927+0000","last_became_peered":"2023-10-06T03:26:09.275927+0000","last_unstale":"2023-10-06T03:26:10.290102+0000","last_undegraded":"2023-10-06T03:26:10.290102+0000","last_fullsized":"2023-10-06T03:26:10.290102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:19.285384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273154+0000","last_change":"2023-10-06T03:26:10.266427+0000","last_active":"2023-10-06T03:26:10.273154+0000","last_peered":"2023-10-06T03:26:10.273154+0000","last_clean":"2023-10-06T03:26:10.273154+0000","last_became_active":"2023-10-06T03:26:10.266130+0000","last_became_peered":"2023-10-06T03:26:10.266130+0000","last_unstale":"2023-10-06T03:26:10.273154+0000","last_undegraded":"2023-10-06T03:26:10.273154+0000","last_fullsized":"2023-10-06T03:26:10.273154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:47.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.278801+0000","last_change":"2023-10-06T03:26:09.270391+0000","last_active":"2023-10-06T03:26:10.278801+0000","last_peered":"2023-10-06T03:26:10.278801+0000","last_clean":"2023-10-06T03:26:10.278801+0000","last_became_active":"2023-10-06T03:26:09.270124+0000","last_became_peered":"2023-10-06T03:26:09.270124+0000","last_unstale":"2023-10-06T03:26:10.278801+0000","last_undegraded":"2023-10-06T03:26:10.278801+0000","last_fullsized":"2023-10-06T03:26:10.278801+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:20.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255376+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:12.020718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254669+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:01.199072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277520+0000","last_change":"2023-10-06T03:26:10.275099+0000","last_active":"2023-10-06T03:26:10.277520+0000","last_peered":"2023-10-06T03:26:10.277520+0000","last_clean":"2023-10-06T03:26:10.277520+0000","last_became_active":"2023-10-06T03:26:10.274837+0000","last_became_peered":"2023-10-06T03:26:10.274837+0000","last_unstale":"2023-10-06T03:26:10.277520+0000","last_undegraded":"2023-10-06T03:26:10.277520+0000","last_fullsized":"2023-10-06T03:26:10.277520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:56.297907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254175+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:43.544478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253236+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:56.578162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292304+0000","last_change":"2023-10-06T03:26:10.289118+0000","last_active":"2023-10-06T03:26:10.292304+0000","last_peered":"2023-10-06T03:26:10.292304+0000","last_clean":"2023-10-06T03:26:10.292304+0000","last_became_active":"2023-10-06T03:26:10.288760+0000","last_became_peered":"2023-10-06T03:26:10.288760+0000","last_unstale":"2023-10-06T03:26:10.292304+0000","last_undegraded":"2023-10-06T03:26:10.292304+0000","last_fullsized":"2023-10-06T03:26:10.292304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:08.877217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254219+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:05.466134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253315+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:49.259150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277457+0000","last_change":"2023-10-06T03:26:10.274551+0000","last_active":"2023-10-06T03:26:10.277457+0000","last_peered":"2023-10-06T03:26:10.277457+0000","last_clean":"2023-10-06T03:26:10.277457+0000","last_became_active":"2023-10-06T03:26:10.274250+0000","last_became_peered":"2023-10-06T03:26:10.274250+0000","last_unstale":"2023-10-06T03:26:10.277457+0000","last_undegraded":"2023-10-06T03:26:10.277457+0000","last_fullsized":"2023-10-06T03:26:10.277457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.063961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.257312+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:32.451103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":58,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.549757+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:26:05.549757+0000","last_peered":"2023-10-06T03:26:05.549757+0000","last_clean":"2023-10-06T03:26:05.549757+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:26:05.549757+0000","last_undegraded":"2023-10-06T03:26:05.549757+0000","last_fullsized":"2023-10-06T03:26:05.549757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282378+0000","last_change":"2023-10-06T03:26:10.274993+0000","last_active":"2023-10-06T03:26:10.282378+0000","last_peered":"2023-10-06T03:26:10.282378+0000","last_clean":"2023-10-06T03:26:10.282378+0000","last_became_active":"2023-10-06T03:26:10.273552+0000","last_became_peered":"2023-10-06T03:26:10.273552+0000","last_unstale":"2023-10-06T03:26:10.282378+0000","last_undegraded":"2023-10-06T03:26:10.282378+0000","last_fullsized":"2023-10-06T03:26:10.282378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:02.203946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.258204+0000","last_change":"2023-10-06T03:26:09.273820+0000","last_active":"2023-10-06T03:26:10.258204+0000","last_peered":"2023-10-06T03:26:10.258204+0000","last_clean":"2023-10-06T03:26:10.258204+0000","last_became_active":"2023-10-06T03:26:09.273557+0000","last_became_peered":"2023-10-06T03:26:09.273557+0000","last_unstale":"2023-10-06T03:26:10.258204+0000","last_undegraded":"2023-10-06T03:26:10.258204+0000","last_fullsized":"2023-10-06T03:26:10.258204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:00.402266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.259090+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:26:05.259090+0000","last_peered":"2023-10-06T03:26:05.259090+0000","last_clean":"2023-10-06T03:26:05.259090+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:26:05.259090+0000","last_undegraded":"2023-10-06T03:26:05.259090+0000","last_fullsized":"2023-10-06T03:26:05.259090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253931+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:22.028676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273041+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:26:10.273041+0000","last_peered":"2023-10-06T03:26:10.273041+0000","last_clean":"2023-10-06T03:26:10.273041+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:26:10.273041+0000","last_undegraded":"2023-10-06T03:26:10.273041+0000","last_fullsized":"2023-10-06T03:26:10.273041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":217,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261049+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:26:10.261049+0000","last_peered":"2023-10-06T03:26:10.261049+0000","last_clean":"2023-10-06T03:26:10.261049+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:26:10.261049+0000","last_undegraded":"2023-10-06T03:26:10.261049+0000","last_fullsized":"2023-10-06T03:26:10.261049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276526+0000","last_change":"2023-10-06T03:26:10.272687+0000","last_active":"2023-10-06T03:26:10.276526+0000","last_peered":"2023-10-06T03:26:10.276526+0000","last_clean":"2023-10-06T03:26:10.276526+0000","last_became_active":"2023-10-06T03:26:10.272443+0000","last_became_peered":"2023-10-06T03:26:10.272443+0000","last_unstale":"2023-10-06T03:26:10.276526+0000","last_undegraded":"2023-10-06T03:26:10.276526+0000","last_fullsized":"2023-10-06T03:26:10.276526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254822+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:22.241630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.260348+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:26:10.260348+0000","last_peered":"2023-10-06T03:26:10.260348+0000","last_clean":"2023-10-06T03:26:10.260348+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:26:10.260348+0000","last_undegraded":"2023-10-06T03:26:10.260348+0000","last_fullsized":"2023-10-06T03:26:10.260348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288455+0000","last_change":"2023-10-06T03:26:10.280327+0000","last_active":"2023-10-06T03:26:10.288455+0000","last_peered":"2023-10-06T03:26:10.288455+0000","last_clean":"2023-10-06T03:26:10.288455+0000","last_became_active":"2023-10-06T03:26:10.280026+0000","last_became_peered":"2023-10-06T03:26:10.280026+0000","last_unstale":"2023-10-06T03:26:10.288455+0000","last_undegraded":"2023-10-06T03:26:10.288455+0000","last_fullsized":"2023-10-06T03:26:10.288455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:02.203946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290273+0000","last_change":"2023-10-06T03:26:09.277164+0000","last_active":"2023-10-06T03:26:10.290273+0000","last_peered":"2023-10-06T03:26:10.290273+0000","last_clean":"2023-10-06T03:26:10.290273+0000","last_became_active":"2023-10-06T03:26:09.276901+0000","last_became_peered":"2023-10-06T03:26:09.276901+0000","last_unstale":"2023-10-06T03:26:10.290273+0000","last_undegraded":"2023-10-06T03:26:10.290273+0000","last_fullsized":"2023-10-06T03:26:10.290273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:00.081929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.260972+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:26:10.260972+0000","last_peered":"2023-10-06T03:26:10.260972+0000","last_clean":"2023-10-06T03:26:10.260972+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:26:10.260972+0000","last_undegraded":"2023-10-06T03:26:10.260972+0000","last_fullsized":"2023-10-06T03:26:10.260972+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254168+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:07.827990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":54,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267532+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:26:10.267532+0000","last_peered":"2023-10-06T03:26:10.267532+0000","last_clean":"2023-10-06T03:26:10.267532+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:26:10.267532+0000","last_undegraded":"2023-10-06T03:26:10.267532+0000","last_fullsized":"2023-10-06T03:26:10.267532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286719+0000","last_change":"2023-10-06T03:26:10.282039+0000","last_active":"2023-10-06T03:26:10.286719+0000","last_peered":"2023-10-06T03:26:10.286719+0000","last_clean":"2023-10-06T03:26:10.286719+0000","last_became_active":"2023-10-06T03:26:10.281621+0000","last_became_peered":"2023-10-06T03:26:10.281621+0000","last_unstale":"2023-10-06T03:26:10.286719+0000","last_undegraded":"2023-10-06T03:26:10.286719+0000","last_fullsized":"2023-10-06T03:26:10.286719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:51.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.256621+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:07.872343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":50,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.550531+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:26:05.550531+0000","last_peered":"2023-10-06T03:26:05.550531+0000","last_clean":"2023-10-06T03:26:05.550531+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:26:05.550531+0000","last_undegraded":"2023-10-06T03:26:05.550531+0000","last_fullsized":"2023-10-06T03:26:05.550531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277440+0000","last_change":"2023-10-06T03:26:10.276362+0000","last_active":"2023-10-06T03:26:10.277440+0000","last_peered":"2023-10-06T03:26:10.277440+0000","last_clean":"2023-10-06T03:26:10.277440+0000","last_became_active":"2023-10-06T03:26:10.276083+0000","last_became_peered":"2023-10-06T03:26:10.276083+0000","last_unstale":"2023-10-06T03:26:10.277440+0000","last_undegraded":"2023-10-06T03:26:10.277440+0000","last_fullsized":"2023-10-06T03:26:10.277440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:50.264024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.258579+0000","last_change":"2023-10-06T03:26:09.267273+0000","last_active":"2023-10-06T03:26:10.258579+0000","last_peered":"2023-10-06T03:26:10.258579+0000","last_clean":"2023-10-06T03:26:10.258579+0000","last_became_active":"2023-10-06T03:26:09.267016+0000","last_became_peered":"2023-10-06T03:26:09.267016+0000","last_unstale":"2023-10-06T03:26:10.258579+0000","last_undegraded":"2023-10-06T03:26:10.258579+0000","last_fullsized":"2023-10-06T03:26:10.258579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:20.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":50,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.550585+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:26:05.550585+0000","last_peered":"2023-10-06T03:26:05.550585+0000","last_clean":"2023-10-06T03:26:05.550585+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:26:05.550585+0000","last_undegraded":"2023-10-06T03:26:05.550585+0000","last_fullsized":"2023-10-06T03:26:05.550585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1640,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298756,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073084,"statfs":{"total":96636764160,"available":96330838016,"internally_reserved":0,"allocated":1503232,"data_stored":1015699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69199999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.72999999999999998,"15min":0.76300000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66200000000000003,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.752,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67100000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81699999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73599999999999999,"5min":1.103,"15min":1.103},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81799999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.629}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.878,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":397450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.343,"15min":1.343},"last":0.36499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.329,"15min":1.329},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.76400000000000001,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80400000000000005,"15min":0.83999999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.042,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.80600000000000005,"15min":0.84199999999999997},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.81899999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.45800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39800000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.503},{"interface":"front","average":{"1min":0.63,"5min":0.626,"15min":0.625},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.49299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1015823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.38700000000000001,"15min":0.40300000000000002},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.38500000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.41199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.40600000000000003,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.44800000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.44600000000000001,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.41699999999999998,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.745,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80100000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.70899999999999996,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":396097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.435,"5min":12.19,"15min":12.19},"last":0.215},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.64000000000000001,"15min":0.68799999999999994},"min":{"1min":0.28599999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46800000000000003,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.28000000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50800000000000001,"5min":1.357,"15min":1.357},"last":0.314},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.24199999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.92000000000000004,"15min":1.02},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.495,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.29099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.49099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.089,"15min":1.179},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":16.919,"15min":16.919},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.1000000000000001,"15min":1.1930000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79700000000000004,"5min":16.948,"15min":16.948},"last":0.749}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67700000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.1140000000000001,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":16.881,"15min":16.881},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298176,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073664,"statfs":{"total":96636764160,"available":96331431936,"internally_reserved":0,"allocated":909312,"data_stored":425815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33800000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.51500000000000001,"5min":0.62,"15min":0.62},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.48599999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.42799999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.311},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52100000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33600000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.376}]},{"osd":6,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.875,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.46100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":397450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32400000000000001,"15min":0.32600000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42699999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49199999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32000000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77100000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.436},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75700000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":397450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2709999999999999,"5min":4.758,"15min":4.758},"last":0.377},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.88900000000000001,"15min":0.95299999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.5}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.432},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84399999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":426819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60699999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.64700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69399999999999995,"5min":0.999,"15min":0.999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68500000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73399999999999999,"5min":0.746,"15min":0.746},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":1.04,"15min":1.04},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.378,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":1.284,"15min":1.284},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:26:14.717 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:26:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.863+0000 7f2629b3c700 1 Processor -- start 2023-10-06T03:26:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.863+0000 7f2629b3c700 1 -- start start 2023-10-06T03:26:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2629b3c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f26241595a0 0x7f26240aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2629b3c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26240b07a0 0x7f26240b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2629b3c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240b0ca0 con 0x7f26240b49e0 2023-10-06T03:26:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2629b3c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26240b0f80 con 0x7f26240b07a0 2023-10-06T03:26:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2629b3c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26240b1260 con 0x7f26241595a0 2023-10-06T03:26:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2623fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26240b07a0 0x7f26240b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2623fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26240b07a0 0x7f26240b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49482/0 (socket says 172.21.15.84:49482) 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2622ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26240b49e0 0x7f26240aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48296/0 (socket says 172.21.15.84:48296) 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2623fff700 1 -- 172.21.15.84:0/325353650 learned_addr learned my addr 172.21.15.84:0/325353650 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f26237fe700 1 --2- 172.21.15.84:0/325353650 >> v2:172.21.15.131:3300/0 conn(0x7f26241595a0 0x7f26240aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2623fff700 1 -- 172.21.15.84:0/325353650 >> v2:172.21.15.131:3300/0 conn(0x7f26241595a0 msgr2=0x7f26240aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2623fff700 1 --2- 172.21.15.84:0/325353650 >> v2:172.21.15.131:3300/0 conn(0x7f26241595a0 0x7f26240aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2623fff700 1 -- 172.21.15.84:0/325353650 >> v1:172.21.15.84:6789/0 conn(0x7f26240b49e0 legacy=0x7f26240aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2623fff700 1 -- 172.21.15.84:0/325353650 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240b1540 con 0x7f26240b07a0 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f26227fc700 1 -- 172.21.15.84:0/325353650 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760403249 0 0) 0x7f26240b0ca0 con 0x7f26240b49e0 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f2623fff700 1 --2- 172.21.15.84:0/325353650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 0x7f26240b1c00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f261c009f20 tx=0x7f261c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f3f60d996fba40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f26227fc700 1 -- 172.21.15.84:0/325353650 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00e070 con 0x7f26240b07a0 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f26227fc700 1 -- 172.21.15.84:0/325353650 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c00ba40 con 0x7f26240b07a0 2023-10-06T03:26:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.864+0000 7f26227fc700 1 -- 172.21.15.84:0/325353650 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c0092e0 con 0x7f26240b07a0 2023-10-06T03:26:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.865+0000 7f2629b3c700 1 -- 172.21.15.84:0/325353650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 msgr2=0x7f26240b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.865+0000 7f2629b3c700 1 --2- 172.21.15.84:0/325353650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 0x7f26240b1c00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f261c009f20 tx=0x7f261c009840 comp rx=0 tx=0).stop 2023-10-06T03:26:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.865+0000 7f2629b3c700 1 -- 172.21.15.84:0/325353650 shutdown_connections 2023-10-06T03:26:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.865+0000 7f2629b3c700 1 --2- 172.21.15.84:0/325353650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 0x7f26240b1c00 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.865+0000 7f2629b3c700 1 --2- 172.21.15.84:0/325353650 >> v2:172.21.15.131:3300/0 conn(0x7f26241595a0 0x7f26240aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.865+0000 7f2629b3c700 1 -- 172.21.15.84:0/325353650 >> 172.21.15.84:0/325353650 conn(0x7f2624099830 msgr2=0x7f262406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.865+0000 7f2629b3c700 1 -- 172.21.15.84:0/325353650 shutdown_connections 2023-10-06T03:26:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.865+0000 7f2629b3c700 1 -- 172.21.15.84:0/325353650 wait complete. 2023-10-06T03:26:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.866+0000 7f2629b3c700 1 Processor -- start 2023-10-06T03:26:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.866+0000 7f2629b3c700 1 -- start start 2023-10-06T03:26:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f2629b3c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 0x7f2624158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f2629b3c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26240b49e0 0x7f262415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f2629b3c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26241595a0 0x7f262409a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f2629b3c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26241697c0 con 0x7f26240b07a0 2023-10-06T03:26:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f2629b3c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262415ab10 con 0x7f26240b49e0 2023-10-06T03:26:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f2629b3c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262415adf0 con 0x7f26241595a0 2023-10-06T03:26:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f26237fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 0x7f2624158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f26237fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 0x7f2624158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49494/0 (socket says 172.21.15.84:49494) 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f26237fe700 1 -- 172.21.15.84:0/1530534979 learned_addr learned my addr 172.21.15.84:0/1530534979 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f2623fff700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26241595a0 0x7f262409a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f2622ffd700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26240b49e0 0x7f262415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f26237fe700 1 -- 172.21.15.84:0/1530534979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26241595a0 msgr2=0x7f262409a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f26237fe700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26241595a0 0x7f262409a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f26237fe700 1 -- 172.21.15.84:0/1530534979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26240b49e0 msgr2=0x7f262415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f26237fe700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26240b49e0 0x7f262415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f26237fe700 1 -- 172.21.15.84:0/1530534979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c009ae0 con 0x7f26240b07a0 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f2623fff700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26241595a0 0x7f262409a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.867+0000 7f26237fe700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 0x7f2624158b90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f261400d840 tx=0x7f2614008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.868+0000 7f260b7fe700 1 -- 172.21.15.84:0/1530534979 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614014620 con 0x7f26240b07a0 2023-10-06T03:26:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.868+0000 7f260b7fe700 1 -- 172.21.15.84:0/1530534979 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614014780 con 0x7f26240b07a0 2023-10-06T03:26:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.868+0000 7f260b7fe700 1 -- 172.21.15.84:0/1530534979 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614014b40 con 0x7f26240b07a0 2023-10-06T03:26:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.868+0000 7f2629b3c700 1 -- 172.21.15.84:0/1530534979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262415b0d0 con 0x7f26240b07a0 2023-10-06T03:26:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.868+0000 7f2629b3c700 1 -- 172.21.15.84:0/1530534979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262415d010 con 0x7f26240b07a0 2023-10-06T03:26:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.868+0000 7f2629b3c700 1 -- 172.21.15.84:0/1530534979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2624169a40 con 0x7f26240b07a0 2023-10-06T03:26:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.869+0000 7f260b7fe700 1 -- 172.21.15.84:0/1530534979 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f261401d400 con 0x7f26240b07a0 2023-10-06T03:26:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.869+0000 7f260b7fe700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2610066f30 0x7f26100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.869+0000 7f260b7fe700 1 -- 172.21.15.84:0/1530534979 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2614085040 con 0x7f26240b07a0 2023-10-06T03:26:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.869+0000 7f2622ffd700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2610066f30 0x7f26100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.870+0000 7f2622ffd700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2610066f30 0x7f26100693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f262409dee0 tx=0x7f2618007bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:14.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:14.873+0000 7f260b7fe700 1 -- 172.21.15.84:0/1530534979 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2614052010 con 0x7f26240b07a0 2023-10-06T03:26:15.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.050+0000 7f2629b3c700 1 -- 172.21.15.84:0/1530534979 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2624064ad0 con 0x7f2610066f30 2023-10-06T03:26:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.058+0000 7f260b7fe700 1 -- 172.21.15.84:0/1530534979 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306692 (secure 0 0 0) 0x7f2624064ad0 con 0x7f2610066f30 2023-10-06T03:26:15.063 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.061+0000 7f2629b3c700 1 -- 172.21.15.84:0/1530534979 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2610066f30 msgr2=0x7f26100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.061+0000 7f2629b3c700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2610066f30 0x7f26100693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f262409dee0 tx=0x7f2618007bf0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.061+0000 7f2629b3c700 1 -- 172.21.15.84:0/1530534979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 msgr2=0x7f2624158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.061+0000 7f2629b3c700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 0x7f2624158b90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f261400d840 tx=0x7f2614008040 comp rx=0 tx=0).stop 2023-10-06T03:26:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.062+0000 7f2629b3c700 1 -- 172.21.15.84:0/1530534979 shutdown_connections 2023-10-06T03:26:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.062+0000 7f2629b3c700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2610066f30 0x7f26100693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.062+0000 7f2629b3c700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26241595a0 0x7f262409a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.062+0000 7f2629b3c700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26240b07a0 0x7f2624158b90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.062+0000 7f2629b3c700 1 --2- 172.21.15.84:0/1530534979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26240b49e0 0x7f262415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.062+0000 7f2629b3c700 1 -- 172.21.15.84:0/1530534979 >> 172.21.15.84:0/1530534979 conn(0x7f2624099830 msgr2=0x7f26240b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.062+0000 7f2629b3c700 1 -- 172.21.15.84:0/1530534979 shutdown_connections 2023-10-06T03:26:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.062+0000 7f2629b3c700 1 -- 172.21.15.84:0/1530534979 wait complete. 2023-10-06T03:26:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:26:15.075 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2023-10-06T03:26:13.069609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592008,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386376,"kb_used_data":8072,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588344,"statfs":{"total":773094113280,"available":770650464256,"internally_reserved":0,"allocated":8265728,"data_stored":4472603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.819968"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290649+0000","last_change":"2023-10-06T03:26:10.288789+0000","last_active":"2023-10-06T03:26:10.290649+0000","last_peered":"2023-10-06T03:26:10.290649+0000","last_clean":"2023-10-06T03:26:10.290649+0000","last_became_active":"2023-10-06T03:26:10.288490+0000","last_became_peered":"2023-10-06T03:26:10.288490+0000","last_unstale":"2023-10-06T03:26:10.290649+0000","last_undegraded":"2023-10-06T03:26:10.290649+0000","last_fullsized":"2023-10-06T03:26:10.290649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:26.085236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271421+0000","last_change":"2023-10-06T03:26:10.265089+0000","last_active":"2023-10-06T03:26:10.271421+0000","last_peered":"2023-10-06T03:26:10.271421+0000","last_clean":"2023-10-06T03:26:10.271421+0000","last_became_active":"2023-10-06T03:26:10.264799+0000","last_became_peered":"2023-10-06T03:26:10.264799+0000","last_unstale":"2023-10-06T03:26:10.271421+0000","last_undegraded":"2023-10-06T03:26:10.271421+0000","last_fullsized":"2023-10-06T03:26:10.271421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:40.805767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282199+0000","last_change":"2023-10-06T03:26:10.274603+0000","last_active":"2023-10-06T03:26:10.282199+0000","last_peered":"2023-10-06T03:26:10.282199+0000","last_clean":"2023-10-06T03:26:10.282199+0000","last_became_active":"2023-10-06T03:26:10.274368+0000","last_became_peered":"2023-10-06T03:26:10.274368+0000","last_unstale":"2023-10-06T03:26:10.282199+0000","last_undegraded":"2023-10-06T03:26:10.282199+0000","last_fullsized":"2023-10-06T03:26:10.282199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:22.065858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282010+0000","last_change":"2023-10-06T03:26:10.278848+0000","last_active":"2023-10-06T03:26:10.282010+0000","last_peered":"2023-10-06T03:26:10.282010+0000","last_clean":"2023-10-06T03:26:10.282010+0000","last_became_active":"2023-10-06T03:26:10.278604+0000","last_became_peered":"2023-10-06T03:26:10.278604+0000","last_unstale":"2023-10-06T03:26:10.282010+0000","last_undegraded":"2023-10-06T03:26:10.282010+0000","last_fullsized":"2023-10-06T03:26:10.282010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:57.583036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.269336+0000","last_change":"2023-10-06T03:26:10.264610+0000","last_active":"2023-10-06T03:26:10.269336+0000","last_peered":"2023-10-06T03:26:10.269336+0000","last_clean":"2023-10-06T03:26:10.269336+0000","last_became_active":"2023-10-06T03:26:10.264360+0000","last_became_peered":"2023-10-06T03:26:10.264360+0000","last_unstale":"2023-10-06T03:26:10.269336+0000","last_undegraded":"2023-10-06T03:26:10.269336+0000","last_fullsized":"2023-10-06T03:26:10.269336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:44.966408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.294483+0000","last_change":"2023-10-06T03:26:10.289416+0000","last_active":"2023-10-06T03:26:10.294483+0000","last_peered":"2023-10-06T03:26:10.294483+0000","last_clean":"2023-10-06T03:26:10.294483+0000","last_became_active":"2023-10-06T03:26:10.289136+0000","last_became_peered":"2023-10-06T03:26:10.289136+0000","last_unstale":"2023-10-06T03:26:10.294483+0000","last_undegraded":"2023-10-06T03:26:10.294483+0000","last_fullsized":"2023-10-06T03:26:10.294483+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:26.684095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277565+0000","last_change":"2023-10-06T03:26:10.274574+0000","last_active":"2023-10-06T03:26:10.277565+0000","last_peered":"2023-10-06T03:26:10.277565+0000","last_clean":"2023-10-06T03:26:10.277565+0000","last_became_active":"2023-10-06T03:26:10.274274+0000","last_became_peered":"2023-10-06T03:26:10.274274+0000","last_unstale":"2023-10-06T03:26:10.277565+0000","last_undegraded":"2023-10-06T03:26:10.277565+0000","last_fullsized":"2023-10-06T03:26:10.277565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288219+0000","last_change":"2023-10-06T03:26:10.276484+0000","last_active":"2023-10-06T03:26:10.288219+0000","last_peered":"2023-10-06T03:26:10.288219+0000","last_clean":"2023-10-06T03:26:10.288219+0000","last_became_active":"2023-10-06T03:26:10.276132+0000","last_became_peered":"2023-10-06T03:26:10.276132+0000","last_unstale":"2023-10-06T03:26:10.288219+0000","last_undegraded":"2023-10-06T03:26:10.288219+0000","last_fullsized":"2023-10-06T03:26:10.288219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:23.660405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.287197+0000","last_change":"2023-10-06T03:26:10.283921+0000","last_active":"2023-10-06T03:26:10.287197+0000","last_peered":"2023-10-06T03:26:10.287197+0000","last_clean":"2023-10-06T03:26:10.287197+0000","last_became_active":"2023-10-06T03:26:10.283622+0000","last_became_peered":"2023-10-06T03:26:10.283622+0000","last_unstale":"2023-10-06T03:26:10.287197+0000","last_undegraded":"2023-10-06T03:26:10.287197+0000","last_fullsized":"2023-10-06T03:26:10.287197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:37.030135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286698+0000","last_change":"2023-10-06T03:26:10.281874+0000","last_active":"2023-10-06T03:26:10.286698+0000","last_peered":"2023-10-06T03:26:10.286698+0000","last_clean":"2023-10-06T03:26:10.286698+0000","last_became_active":"2023-10-06T03:26:10.281250+0000","last_became_peered":"2023-10-06T03:26:10.281250+0000","last_unstale":"2023-10-06T03:26:10.286698+0000","last_undegraded":"2023-10-06T03:26:10.286698+0000","last_fullsized":"2023-10-06T03:26:10.286698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:06.471008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.269176+0000","last_change":"2023-10-06T03:26:10.264466+0000","last_active":"2023-10-06T03:26:10.269176+0000","last_peered":"2023-10-06T03:26:10.269176+0000","last_clean":"2023-10-06T03:26:10.269176+0000","last_became_active":"2023-10-06T03:26:10.264162+0000","last_became_peered":"2023-10-06T03:26:10.264162+0000","last_unstale":"2023-10-06T03:26:10.269176+0000","last_undegraded":"2023-10-06T03:26:10.269176+0000","last_fullsized":"2023-10-06T03:26:10.269176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:23.246504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.281789+0000","last_change":"2023-10-06T03:26:10.269887+0000","last_active":"2023-10-06T03:26:10.281789+0000","last_peered":"2023-10-06T03:26:10.281789+0000","last_clean":"2023-10-06T03:26:10.281789+0000","last_became_active":"2023-10-06T03:26:10.269397+0000","last_became_peered":"2023-10-06T03:26:10.269397+0000","last_unstale":"2023-10-06T03:26:10.281789+0000","last_undegraded":"2023-10-06T03:26:10.281789+0000","last_fullsized":"2023-10-06T03:26:10.281789+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:48.998501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.281751+0000","last_change":"2023-10-06T03:26:10.273079+0000","last_active":"2023-10-06T03:26:10.281751+0000","last_peered":"2023-10-06T03:26:10.281751+0000","last_clean":"2023-10-06T03:26:10.281751+0000","last_became_active":"2023-10-06T03:26:10.272822+0000","last_became_peered":"2023-10-06T03:26:10.272822+0000","last_unstale":"2023-10-06T03:26:10.281751+0000","last_undegraded":"2023-10-06T03:26:10.281751+0000","last_fullsized":"2023-10-06T03:26:10.281751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:22.093208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288661+0000","last_change":"2023-10-06T03:26:10.280816+0000","last_active":"2023-10-06T03:26:10.288661+0000","last_peered":"2023-10-06T03:26:10.288661+0000","last_clean":"2023-10-06T03:26:10.288661+0000","last_became_active":"2023-10-06T03:26:10.280318+0000","last_became_peered":"2023-10-06T03:26:10.280318+0000","last_unstale":"2023-10-06T03:26:10.288661+0000","last_undegraded":"2023-10-06T03:26:10.288661+0000","last_fullsized":"2023-10-06T03:26:10.288661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:44.966408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282363+0000","last_change":"2023-10-06T03:26:10.274678+0000","last_active":"2023-10-06T03:26:10.282363+0000","last_peered":"2023-10-06T03:26:10.282363+0000","last_clean":"2023-10-06T03:26:10.282363+0000","last_became_active":"2023-10-06T03:26:10.274409+0000","last_became_peered":"2023-10-06T03:26:10.274409+0000","last_unstale":"2023-10-06T03:26:10.282363+0000","last_undegraded":"2023-10-06T03:26:10.282363+0000","last_fullsized":"2023-10-06T03:26:10.282363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:38.350999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.289382+0000","last_change":"2023-10-06T03:26:10.283714+0000","last_active":"2023-10-06T03:26:10.289382+0000","last_peered":"2023-10-06T03:26:10.289382+0000","last_clean":"2023-10-06T03:26:10.289382+0000","last_became_active":"2023-10-06T03:26:10.283184+0000","last_became_peered":"2023-10-06T03:26:10.283184+0000","last_unstale":"2023-10-06T03:26:10.289382+0000","last_undegraded":"2023-10-06T03:26:10.289382+0000","last_fullsized":"2023-10-06T03:26:10.289382+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:35.682913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292296+0000","last_change":"2023-10-06T03:26:10.289063+0000","last_active":"2023-10-06T03:26:10.292296+0000","last_peered":"2023-10-06T03:26:10.292296+0000","last_clean":"2023-10-06T03:26:10.292296+0000","last_became_active":"2023-10-06T03:26:10.288750+0000","last_became_peered":"2023-10-06T03:26:10.288750+0000","last_unstale":"2023-10-06T03:26:10.292296+0000","last_undegraded":"2023-10-06T03:26:10.292296+0000","last_fullsized":"2023-10-06T03:26:10.292296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:56.252304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288551+0000","last_change":"2023-10-06T03:26:10.280335+0000","last_active":"2023-10-06T03:26:10.288551+0000","last_peered":"2023-10-06T03:26:10.288551+0000","last_clean":"2023-10-06T03:26:10.288551+0000","last_became_active":"2023-10-06T03:26:10.280015+0000","last_became_peered":"2023-10-06T03:26:10.280015+0000","last_unstale":"2023-10-06T03:26:10.288551+0000","last_undegraded":"2023-10-06T03:26:10.288551+0000","last_fullsized":"2023-10-06T03:26:10.288551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:13.025592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290452+0000","last_change":"2023-10-06T03:26:10.284367+0000","last_active":"2023-10-06T03:26:10.290452+0000","last_peered":"2023-10-06T03:26:10.290452+0000","last_clean":"2023-10-06T03:26:10.290452+0000","last_became_active":"2023-10-06T03:26:10.284121+0000","last_became_peered":"2023-10-06T03:26:10.284121+0000","last_unstale":"2023-10-06T03:26:10.290452+0000","last_undegraded":"2023-10-06T03:26:10.290452+0000","last_fullsized":"2023-10-06T03:26:10.290452+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:58.156565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255350+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:55.620133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254074+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.102438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253912+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:14.918357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.270673+0000","last_change":"2023-10-06T03:26:10.263185+0000","last_active":"2023-10-06T03:26:10.270673+0000","last_peered":"2023-10-06T03:26:10.270673+0000","last_clean":"2023-10-06T03:26:10.270673+0000","last_became_active":"2023-10-06T03:26:10.262810+0000","last_became_peered":"2023-10-06T03:26:10.262810+0000","last_unstale":"2023-10-06T03:26:10.270673+0000","last_undegraded":"2023-10-06T03:26:10.270673+0000","last_fullsized":"2023-10-06T03:26:10.270673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:23.033550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254778+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:36.025261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291508+0000","last_change":"2023-10-06T03:26:10.289206+0000","last_active":"2023-10-06T03:26:10.291508+0000","last_peered":"2023-10-06T03:26:10.291508+0000","last_clean":"2023-10-06T03:26:10.291508+0000","last_became_active":"2023-10-06T03:26:10.288939+0000","last_became_peered":"2023-10-06T03:26:10.288939+0000","last_unstale":"2023-10-06T03:26:10.291508+0000","last_undegraded":"2023-10-06T03:26:10.291508+0000","last_fullsized":"2023-10-06T03:26:10.291508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:56.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253418+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:45.059087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253860+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:25.679221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277460+0000","last_change":"2023-10-06T03:26:10.275173+0000","last_active":"2023-10-06T03:26:10.277460+0000","last_peered":"2023-10-06T03:26:10.277460+0000","last_clean":"2023-10-06T03:26:10.277460+0000","last_became_active":"2023-10-06T03:26:10.274909+0000","last_became_peered":"2023-10-06T03:26:10.274909+0000","last_unstale":"2023-10-06T03:26:10.277460+0000","last_undegraded":"2023-10-06T03:26:10.277460+0000","last_fullsized":"2023-10-06T03:26:10.277460+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:33.455977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253726+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.102438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276708+0000","last_change":"2023-10-06T03:26:09.270274+0000","last_active":"2023-10-06T03:26:10.276708+0000","last_peered":"2023-10-06T03:26:10.276708+0000","last_clean":"2023-10-06T03:26:10.276708+0000","last_became_active":"2023-10-06T03:26:09.270010+0000","last_became_peered":"2023-10-06T03:26:09.270010+0000","last_unstale":"2023-10-06T03:26:10.276708+0000","last_undegraded":"2023-10-06T03:26:10.276708+0000","last_fullsized":"2023-10-06T03:26:10.276708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:15.677167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254313+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:43.961534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282111+0000","last_change":"2023-10-06T03:26:10.279524+0000","last_active":"2023-10-06T03:26:10.282111+0000","last_peered":"2023-10-06T03:26:10.282111+0000","last_clean":"2023-10-06T03:26:10.282111+0000","last_became_active":"2023-10-06T03:26:10.279224+0000","last_became_peered":"2023-10-06T03:26:10.279224+0000","last_unstale":"2023-10-06T03:26:10.282111+0000","last_undegraded":"2023-10-06T03:26:10.282111+0000","last_fullsized":"2023-10-06T03:26:10.282111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:36.078198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255060+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:57.151691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255786+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:35.881495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"73'6","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.294552+0000","last_change":"2023-10-06T03:26:09.274118+0000","last_active":"2023-10-06T03:26:10.294552+0000","last_peered":"2023-10-06T03:26:10.294552+0000","last_clean":"2023-10-06T03:26:10.294552+0000","last_became_active":"2023-10-06T03:26:09.273846+0000","last_became_peered":"2023-10-06T03:26:09.273846+0000","last_unstale":"2023-10-06T03:26:10.294552+0000","last_undegraded":"2023-10-06T03:26:10.294552+0000","last_fullsized":"2023-10-06T03:26:10.294552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:34.678039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291495+0000","last_change":"2023-10-06T03:26:09.270358+0000","last_active":"2023-10-06T03:26:10.291495+0000","last_peered":"2023-10-06T03:26:10.291495+0000","last_clean":"2023-10-06T03:26:10.291495+0000","last_became_active":"2023-10-06T03:26:09.268859+0000","last_became_peered":"2023-10-06T03:26:09.268859+0000","last_unstale":"2023-10-06T03:26:10.291495+0000","last_undegraded":"2023-10-06T03:26:10.291495+0000","last_fullsized":"2023-10-06T03:26:10.291495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:11.840868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277429+0000","last_change":"2023-10-06T03:26:10.274400+0000","last_active":"2023-10-06T03:26:10.277429+0000","last_peered":"2023-10-06T03:26:10.277429+0000","last_clean":"2023-10-06T03:26:10.277429+0000","last_became_active":"2023-10-06T03:26:10.272719+0000","last_became_peered":"2023-10-06T03:26:10.272719+0000","last_unstale":"2023-10-06T03:26:10.277429+0000","last_undegraded":"2023-10-06T03:26:10.277429+0000","last_fullsized":"2023-10-06T03:26:10.277429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:44.549351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.256105+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:43.544478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290606+0000","last_change":"2023-10-06T03:26:10.285343+0000","last_active":"2023-10-06T03:26:10.290606+0000","last_peered":"2023-10-06T03:26:10.290606+0000","last_clean":"2023-10-06T03:26:10.290606+0000","last_became_active":"2023-10-06T03:26:10.284618+0000","last_became_peered":"2023-10-06T03:26:10.284618+0000","last_unstale":"2023-10-06T03:26:10.290606+0000","last_undegraded":"2023-10-06T03:26:10.290606+0000","last_fullsized":"2023-10-06T03:26:10.290606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:23.246504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267438+0000","last_change":"2023-10-06T03:26:09.276331+0000","last_active":"2023-10-06T03:26:10.267438+0000","last_peered":"2023-10-06T03:26:10.267438+0000","last_clean":"2023-10-06T03:26:10.267438+0000","last_became_active":"2023-10-06T03:26:09.276038+0000","last_became_peered":"2023-10-06T03:26:09.276038+0000","last_unstale":"2023-10-06T03:26:10.267438+0000","last_undegraded":"2023-10-06T03:26:10.267438+0000","last_fullsized":"2023-10-06T03:26:10.267438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:15.335321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.289651+0000","last_change":"2023-10-06T03:26:10.283421+0000","last_active":"2023-10-06T03:26:10.289651+0000","last_peered":"2023-10-06T03:26:10.289651+0000","last_clean":"2023-10-06T03:26:10.289651+0000","last_became_active":"2023-10-06T03:26:10.283133+0000","last_became_peered":"2023-10-06T03:26:10.283133+0000","last_unstale":"2023-10-06T03:26:10.289651+0000","last_undegraded":"2023-10-06T03:26:10.289651+0000","last_fullsized":"2023-10-06T03:26:10.289651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:36.886369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253864+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:24.807628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290102+0000","last_change":"2023-10-06T03:26:09.276138+0000","last_active":"2023-10-06T03:26:10.290102+0000","last_peered":"2023-10-06T03:26:10.290102+0000","last_clean":"2023-10-06T03:26:10.290102+0000","last_became_active":"2023-10-06T03:26:09.275927+0000","last_became_peered":"2023-10-06T03:26:09.275927+0000","last_unstale":"2023-10-06T03:26:10.290102+0000","last_undegraded":"2023-10-06T03:26:10.290102+0000","last_fullsized":"2023-10-06T03:26:10.290102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:19.285384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273154+0000","last_change":"2023-10-06T03:26:10.266427+0000","last_active":"2023-10-06T03:26:10.273154+0000","last_peered":"2023-10-06T03:26:10.273154+0000","last_clean":"2023-10-06T03:26:10.273154+0000","last_became_active":"2023-10-06T03:26:10.266130+0000","last_became_peered":"2023-10-06T03:26:10.266130+0000","last_unstale":"2023-10-06T03:26:10.273154+0000","last_undegraded":"2023-10-06T03:26:10.273154+0000","last_fullsized":"2023-10-06T03:26:10.273154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:47.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.278801+0000","last_change":"2023-10-06T03:26:09.270391+0000","last_active":"2023-10-06T03:26:10.278801+0000","last_peered":"2023-10-06T03:26:10.278801+0000","last_clean":"2023-10-06T03:26:10.278801+0000","last_became_active":"2023-10-06T03:26:09.270124+0000","last_became_peered":"2023-10-06T03:26:09.270124+0000","last_unstale":"2023-10-06T03:26:10.278801+0000","last_undegraded":"2023-10-06T03:26:10.278801+0000","last_fullsized":"2023-10-06T03:26:10.278801+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:20.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.255376+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:12.020718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254669+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:01.199072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277520+0000","last_change":"2023-10-06T03:26:10.275099+0000","last_active":"2023-10-06T03:26:10.277520+0000","last_peered":"2023-10-06T03:26:10.277520+0000","last_clean":"2023-10-06T03:26:10.277520+0000","last_became_active":"2023-10-06T03:26:10.274837+0000","last_became_peered":"2023-10-06T03:26:10.274837+0000","last_unstale":"2023-10-06T03:26:10.277520+0000","last_undegraded":"2023-10-06T03:26:10.277520+0000","last_fullsized":"2023-10-06T03:26:10.277520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:56.297907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254175+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:43.544478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253236+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:56.578162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292304+0000","last_change":"2023-10-06T03:26:10.289118+0000","last_active":"2023-10-06T03:26:10.292304+0000","last_peered":"2023-10-06T03:26:10.292304+0000","last_clean":"2023-10-06T03:26:10.292304+0000","last_became_active":"2023-10-06T03:26:10.288760+0000","last_became_peered":"2023-10-06T03:26:10.288760+0000","last_unstale":"2023-10-06T03:26:10.292304+0000","last_undegraded":"2023-10-06T03:26:10.292304+0000","last_fullsized":"2023-10-06T03:26:10.292304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:08.877217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254219+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:05.466134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253315+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:49.259150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277457+0000","last_change":"2023-10-06T03:26:10.274551+0000","last_active":"2023-10-06T03:26:10.277457+0000","last_peered":"2023-10-06T03:26:10.277457+0000","last_clean":"2023-10-06T03:26:10.277457+0000","last_became_active":"2023-10-06T03:26:10.274250+0000","last_became_peered":"2023-10-06T03:26:10.274250+0000","last_unstale":"2023-10-06T03:26:10.277457+0000","last_undegraded":"2023-10-06T03:26:10.277457+0000","last_fullsized":"2023-10-06T03:26:10.277457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.063961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.257312+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:32.451103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":58,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.549757+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:26:05.549757+0000","last_peered":"2023-10-06T03:26:05.549757+0000","last_clean":"2023-10-06T03:26:05.549757+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:26:05.549757+0000","last_undegraded":"2023-10-06T03:26:05.549757+0000","last_fullsized":"2023-10-06T03:26:05.549757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282378+0000","last_change":"2023-10-06T03:26:10.274993+0000","last_active":"2023-10-06T03:26:10.282378+0000","last_peered":"2023-10-06T03:26:10.282378+0000","last_clean":"2023-10-06T03:26:10.282378+0000","last_became_active":"2023-10-06T03:26:10.273552+0000","last_became_peered":"2023-10-06T03:26:10.273552+0000","last_unstale":"2023-10-06T03:26:10.282378+0000","last_undegraded":"2023-10-06T03:26:10.282378+0000","last_fullsized":"2023-10-06T03:26:10.282378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:02.203946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.258204+0000","last_change":"2023-10-06T03:26:09.273820+0000","last_active":"2023-10-06T03:26:10.258204+0000","last_peered":"2023-10-06T03:26:10.258204+0000","last_clean":"2023-10-06T03:26:10.258204+0000","last_became_active":"2023-10-06T03:26:09.273557+0000","last_became_peered":"2023-10-06T03:26:09.273557+0000","last_unstale":"2023-10-06T03:26:10.258204+0000","last_undegraded":"2023-10-06T03:26:10.258204+0000","last_fullsized":"2023-10-06T03:26:10.258204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:00.402266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.259090+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:26:05.259090+0000","last_peered":"2023-10-06T03:26:05.259090+0000","last_clean":"2023-10-06T03:26:05.259090+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:26:05.259090+0000","last_undegraded":"2023-10-06T03:26:05.259090+0000","last_fullsized":"2023-10-06T03:26:05.259090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.253931+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:22.028676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273041+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:26:10.273041+0000","last_peered":"2023-10-06T03:26:10.273041+0000","last_clean":"2023-10-06T03:26:10.273041+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:26:10.273041+0000","last_undegraded":"2023-10-06T03:26:10.273041+0000","last_fullsized":"2023-10-06T03:26:10.273041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":217,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261049+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:26:10.261049+0000","last_peered":"2023-10-06T03:26:10.261049+0000","last_clean":"2023-10-06T03:26:10.261049+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:26:10.261049+0000","last_undegraded":"2023-10-06T03:26:10.261049+0000","last_fullsized":"2023-10-06T03:26:10.261049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276526+0000","last_change":"2023-10-06T03:26:10.272687+0000","last_active":"2023-10-06T03:26:10.276526+0000","last_peered":"2023-10-06T03:26:10.276526+0000","last_clean":"2023-10-06T03:26:10.276526+0000","last_became_active":"2023-10-06T03:26:10.272443+0000","last_became_peered":"2023-10-06T03:26:10.272443+0000","last_unstale":"2023-10-06T03:26:10.276526+0000","last_undegraded":"2023-10-06T03:26:10.276526+0000","last_fullsized":"2023-10-06T03:26:10.276526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254822+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:22.241630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.260348+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:26:10.260348+0000","last_peered":"2023-10-06T03:26:10.260348+0000","last_clean":"2023-10-06T03:26:10.260348+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:26:10.260348+0000","last_undegraded":"2023-10-06T03:26:10.260348+0000","last_fullsized":"2023-10-06T03:26:10.260348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288455+0000","last_change":"2023-10-06T03:26:10.280327+0000","last_active":"2023-10-06T03:26:10.288455+0000","last_peered":"2023-10-06T03:26:10.288455+0000","last_clean":"2023-10-06T03:26:10.288455+0000","last_became_active":"2023-10-06T03:26:10.280026+0000","last_became_peered":"2023-10-06T03:26:10.280026+0000","last_unstale":"2023-10-06T03:26:10.288455+0000","last_undegraded":"2023-10-06T03:26:10.288455+0000","last_fullsized":"2023-10-06T03:26:10.288455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:02.203946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290273+0000","last_change":"2023-10-06T03:26:09.277164+0000","last_active":"2023-10-06T03:26:10.290273+0000","last_peered":"2023-10-06T03:26:10.290273+0000","last_clean":"2023-10-06T03:26:10.290273+0000","last_became_active":"2023-10-06T03:26:09.276901+0000","last_became_peered":"2023-10-06T03:26:09.276901+0000","last_unstale":"2023-10-06T03:26:10.290273+0000","last_undegraded":"2023-10-06T03:26:10.290273+0000","last_fullsized":"2023-10-06T03:26:10.290273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:00.081929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.260972+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:26:10.260972+0000","last_peered":"2023-10-06T03:26:10.260972+0000","last_clean":"2023-10-06T03:26:10.260972+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:26:10.260972+0000","last_undegraded":"2023-10-06T03:26:10.260972+0000","last_fullsized":"2023-10-06T03:26:10.260972+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T03:26:09.249940+0000","last_change":"2023-10-06T03:26:09.249940+0000","last_active":"2023-10-06T03:26:09.249940+0000","last_peered":"2023-10-06T03:26:09.249940+0000","last_clean":"2023-10-06T03:26:09.249940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:09.249940+0000","last_undegraded":"2023-10-06T03:26:09.249940+0000","last_fullsized":"2023-10-06T03:26:09.249940+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.254168+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:07.827990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":54,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267532+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:26:10.267532+0000","last_peered":"2023-10-06T03:26:10.267532+0000","last_clean":"2023-10-06T03:26:10.267532+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:26:10.267532+0000","last_undegraded":"2023-10-06T03:26:10.267532+0000","last_fullsized":"2023-10-06T03:26:10.267532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286719+0000","last_change":"2023-10-06T03:26:10.282039+0000","last_active":"2023-10-06T03:26:10.286719+0000","last_peered":"2023-10-06T03:26:10.286719+0000","last_clean":"2023-10-06T03:26:10.286719+0000","last_became_active":"2023-10-06T03:26:10.281621+0000","last_became_peered":"2023-10-06T03:26:10.281621+0000","last_unstale":"2023-10-06T03:26:10.286719+0000","last_undegraded":"2023-10-06T03:26:10.286719+0000","last_fullsized":"2023-10-06T03:26:10.286719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:51.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:26:08.245066+0000","last_change":"2023-10-06T03:26:08.256621+0000","last_active":"2023-10-06T03:26:08.245066+0000","last_peered":"2023-10-06T03:26:08.245066+0000","last_clean":"2023-10-06T03:26:08.245066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:26:08.245066+0000","last_undegraded":"2023-10-06T03:26:08.245066+0000","last_fullsized":"2023-10-06T03:26:08.245066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:07.872343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":50,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.550531+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:26:05.550531+0000","last_peered":"2023-10-06T03:26:05.550531+0000","last_clean":"2023-10-06T03:26:05.550531+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:26:05.550531+0000","last_undegraded":"2023-10-06T03:26:05.550531+0000","last_fullsized":"2023-10-06T03:26:05.550531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277440+0000","last_change":"2023-10-06T03:26:10.276362+0000","last_active":"2023-10-06T03:26:10.277440+0000","last_peered":"2023-10-06T03:26:10.277440+0000","last_clean":"2023-10-06T03:26:10.277440+0000","last_became_active":"2023-10-06T03:26:10.276083+0000","last_became_peered":"2023-10-06T03:26:10.276083+0000","last_unstale":"2023-10-06T03:26:10.277440+0000","last_undegraded":"2023-10-06T03:26:10.277440+0000","last_fullsized":"2023-10-06T03:26:10.277440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:50.264024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.258579+0000","last_change":"2023-10-06T03:26:09.267273+0000","last_active":"2023-10-06T03:26:10.258579+0000","last_peered":"2023-10-06T03:26:10.258579+0000","last_clean":"2023-10-06T03:26:10.258579+0000","last_became_active":"2023-10-06T03:26:09.267016+0000","last_became_peered":"2023-10-06T03:26:09.267016+0000","last_unstale":"2023-10-06T03:26:10.258579+0000","last_undegraded":"2023-10-06T03:26:10.258579+0000","last_fullsized":"2023-10-06T03:26:10.258579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:20.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":50,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T03:26:05.550585+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:26:05.550585+0000","last_peered":"2023-10-06T03:26:05.550585+0000","last_clean":"2023-10-06T03:26:05.550585+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:26:05.550585+0000","last_undegraded":"2023-10-06T03:26:05.550585+0000","last_fullsized":"2023-10-06T03:26:05.550585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1640,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298756,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073084,"statfs":{"total":96636764160,"available":96330838016,"internally_reserved":0,"allocated":1503232,"data_stored":1015699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69199999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.72999999999999998,"15min":0.76300000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66200000000000003,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.752,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67100000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81699999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73599999999999999,"5min":1.103,"15min":1.103},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81799999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.629}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.878,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":397450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.343,"15min":1.343},"last":0.36499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.329,"15min":1.329},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.76400000000000001,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80400000000000005,"15min":0.83999999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.042,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.80600000000000005,"15min":0.84199999999999997},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.81899999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.45800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39800000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.503},{"interface":"front","average":{"1min":0.63,"5min":0.626,"15min":0.625},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.49299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1015823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.38700000000000001,"15min":0.40300000000000002},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.38500000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.41199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.40600000000000003,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.44800000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.44600000000000001,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.41699999999999998,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.745,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80100000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.70899999999999996,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":396097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.435,"5min":12.19,"15min":12.19},"last":0.215},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.64000000000000001,"15min":0.68799999999999994},"min":{"1min":0.28599999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46800000000000003,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.28000000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50800000000000001,"5min":1.357,"15min":1.357},"last":0.314},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.24199999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.92000000000000004,"15min":1.02},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.495,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.29099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.49099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.089,"15min":1.179},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":16.919,"15min":16.919},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.1000000000000001,"15min":1.1930000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79700000000000004,"5min":16.948,"15min":16.948},"last":0.749}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67700000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.1140000000000001,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":16.881,"15min":16.881},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298176,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073664,"statfs":{"total":96636764160,"available":96331431936,"internally_reserved":0,"allocated":909312,"data_stored":425815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33800000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.51500000000000001,"5min":0.62,"15min":0.62},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.48599999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.42799999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.311},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52100000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33600000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.376}]},{"osd":6,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.875,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.46100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":397450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32400000000000001,"15min":0.32600000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42699999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49199999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32000000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77100000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.436},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75700000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":397450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2709999999999999,"5min":4.758,"15min":4.758},"last":0.377},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.88900000000000001,"15min":0.95299999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.5}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.432},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84399999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":426819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60699999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.64700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69399999999999995,"5min":0.999,"15min":0.999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68500000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73399999999999999,"5min":0.746,"15min":0.746},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":1.04,"15min":1.04},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.378,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":1.284,"15min":1.284},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:26:15.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-10-06T03:26:15.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-10-06T03:26:15.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-10-06T03:26:15.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-10-06T03:26:15.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-10-06T03:26:15.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-10-06T03:26:15.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-10-06T03:26:15.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-10-06T03:26:15.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-10-06T03:26:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-10-06T03:26:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-10-06T03:26:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-10-06T03:26:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-10-06T03:26:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-10-06T03:26:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-10-06T03:26:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.255350+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:58:55.620133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:26:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-10-06T03:26:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-10-06T03:26:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.254074+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:44:02.102438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:26:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-10-06T03:26:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-10-06T03:26:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.253912+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:58:14.918357+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:26:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-10-06T03:26:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.254778+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:19:36.025261+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:26:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-10-06T03:26:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.253418+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:25:45.059087+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:26:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-10-06T03:26:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-10-06T03:26:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.253860+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:37:25.679221+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:26:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-10-06T03:26:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.253726+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:44:02.102438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:26:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-10-06T03:26:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-10-06T03:26:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-10-06T03:26:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.254313+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:26:43.961534+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:26:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-10-06T03:26:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.255060+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:05:57.151691+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:26:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-10-06T03:26:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-10-06T03:26:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.255786+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:22:35.881495+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:26:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-10-06T03:26:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-10-06T03:26:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-10-06T03:26:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.256105+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:23:43.544478+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:26:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-10-06T03:26:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.253864+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:40:24.807628+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:26:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-10-06T03:26:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-10-06T03:26:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-10-06T03:26:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.255376+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:05:12.020718+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:26:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-10-06T03:26:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-10-06T03:26:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.254669+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:51:01.199072+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:26:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-10-06T03:26:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.254175+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:23:43.544478+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:26:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-10-06T03:26:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-10-06T03:26:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.253236+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:53:56.578162+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:26:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-10-06T03:26:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.254219+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:29:05.466134+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:26:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-10-06T03:26:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-10-06T03:26:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.253315+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:15:49.259150+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:26:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-10-06T03:26:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.257312+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:03:32.451103+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:26:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-10-06T03:26:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-10-06T03:26:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.253931+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:43:22.028676+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:26:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-10-06T03:26:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.254822+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:02:22.241630+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:26:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-10-06T03:26:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T03:26:09.249940+0000', 'last_change': '2023-10-06T03:26:09.249940+0000', 'last_active': '2023-10-06T03:26:09.249940+0000', 'last_peered': '2023-10-06T03:26:09.249940+0000', 'last_clean': '2023-10-06T03:26:09.249940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:09.249940+0000', 'last_undegraded': '2023-10-06T03:26:09.249940+0000', 'last_fullsized': '2023-10-06T03:26:09.249940+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:09.249940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T03:26:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-10-06T03:26:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.254168+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:23:07.827990+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:26:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-10-06T03:26:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:26:08.245066+0000', 'last_change': '2023-10-06T03:26:08.256621+0000', 'last_active': '2023-10-06T03:26:08.245066+0000', 'last_peered': '2023-10-06T03:26:08.245066+0000', 'last_clean': '2023-10-06T03:26:08.245066+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:26:08.245066+0000', 'last_undegraded': '2023-10-06T03:26:08.245066+0000', 'last_fullsized': '2023-10-06T03:26:08.245066+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'last_clean_scrub_stamp': '2023-10-06T03:26:08.245066+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:23:07.872343+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:26:15.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:26:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.228+0000 7fdefc8d7700 1 Processor -- start 2023-10-06T03:26:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.228+0000 7fdefc8d7700 1 -- start start 2023-10-06T03:26:15.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdefc8d7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8159480 0x7fdef80b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdefc8d7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdef80b3610 0x7fdef80cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdefc8d7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef80cb7e0 con 0x7fdef80cc1b0 2023-10-06T03:26:15.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdefc8d7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef80b08a0 con 0x7fdef80b3610 2023-10-06T03:26:15.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdefc8d7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80cb190 con 0x7fdef8159480 2023-10-06T03:26:15.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef759e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdef80cc1b0 0x7fdef80b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48304/0 (socket says 172.21.15.84:48304) 2023-10-06T03:26:15.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef759e700 1 -- 172.21.15.84:0/3812141759 learned_addr learned my addr 172.21.15.84:0/3812141759 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:15.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef6d9d700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8159480 0x7fdef80b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdeee59c700 1 --2- 172.21.15.84:0/3812141759 >> v2:172.21.15.131:3300/0 conn(0x7fdef80b3610 0x7fdef80cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247482857 0 0) 0x7fdef80cb7e0 con 0x7fdef80cc1b0 2023-10-06T03:26:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee4003570 con 0x7fdef80cc1b0 2023-10-06T03:26:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4160240203 0 0) 0x7fdee4003570 con 0x7fdef80cc1b0 2023-10-06T03:26:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8159480 msgr2=0x7fdef80b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8159480 0x7fdef80b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 >> v2:172.21.15.131:3300/0 conn(0x7fdef80b3610 msgr2=0x7fdef80cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 --2- 172.21.15.84:0/3812141759 >> v2:172.21.15.131:3300/0 conn(0x7fdef80b3610 0x7fdef80cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80cb470 con 0x7fdef80cc1b0 2023-10-06T03:26:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fdef00017f0 con 0x7fdef80cc1b0 2023-10-06T03:26:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 >> v1:172.21.15.84:6789/0 conn(0x7fdef80cc1b0 legacy=0x7fdef80b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8159480 0x7fdee4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 0x7fdee4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdee4004d50 0x7fdee40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80b08a0 con 0x7fdee4003fe0 2023-10-06T03:26:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80cb190 con 0x7fdee4004d50 2023-10-06T03:26:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.229+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee400ba90 con 0x7fdef8159480 2023-10-06T03:26:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdeee59c700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 0x7fdee4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdef6d9d700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8159480 0x7fdee4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdef759e700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdee4004d50 0x7fdee40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdeee59c700 1 -- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8159480 msgr2=0x7fdee4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdeee59c700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8159480 0x7fdee4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdeee59c700 1 -- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdee4004d50 msgr2=0x7fdee40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdeee59c700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdee4004d50 0x7fdee40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdeee59c700 1 -- 172.21.15.84:0/3812141759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4003570 con 0x7fdee4003fe0 2023-10-06T03:26:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdeee59c700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 0x7fdee4004810 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009c00 tx=0x7fdee00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9ed406c06c6447 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee000e6b0 con 0x7fdee4003fe0 2023-10-06T03:26:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee000e810 con 0x7fdee4003fe0 2023-10-06T03:26:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.230+0000 7fdef659c700 1 -- 172.21.15.84:0/3812141759 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee000ebd0 con 0x7fdee4003fe0 2023-10-06T03:26:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.231+0000 7fdefc8d7700 1 -- 172.21.15.84:0/3812141759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 msgr2=0x7fdee4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.231+0000 7fdefc8d7700 1 --2- 172.21.15.84:0/3812141759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 0x7fdee4004810 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009c00 tx=0x7fdee00091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.231+0000 7fdef759e700 1 -- 172.21.15.84:0/3812141759 reap_dead start 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.231+0000 7fdefc8d7700 1 -- 172.21.15.84:0/3812141759 shutdown_connections 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.231+0000 7fdefc8d7700 1 -- 172.21.15.84:0/3812141759 >> 172.21.15.84:0/3812141759 conn(0x7fdef806ed20 msgr2=0x7fdef806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.231+0000 7fdefc8d7700 1 -- 172.21.15.84:0/3812141759 shutdown_connections 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.231+0000 7fdefc8d7700 1 -- 172.21.15.84:0/3812141759 wait complete. 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.232+0000 7fdefc8d7700 1 Processor -- start 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.232+0000 7fdefc8d7700 1 -- start start 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdefc8d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 0x7fdef80cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdefc8d7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8155600 0x7fdef80cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdefc8d7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef8155030 0x7fdef80ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdefc8d7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80c6b70 con 0x7fdee4003fe0 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdefc8d7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef816d150 con 0x7fdef8155030 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdefc8d7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef816d430 con 0x7fdef8155600 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdef6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 0x7fdef80cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdef6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 0x7fdef80cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49512/0 (socket says 172.21.15.84:49512) 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdef6d9d700 1 -- 172.21.15.84:0/2185049869 learned_addr learned my addr 172.21.15.84:0/2185049869 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdef6d9d700 1 -- 172.21.15.84:0/2185049869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8155600 msgr2=0x7fdef80cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdef6d9d700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8155600 0x7fdef80cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdef6d9d700 1 -- 172.21.15.84:0/2185049869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef8155030 msgr2=0x7fdef80ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdef6d9d700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef8155030 0x7fdef80ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdef6d9d700 1 -- 172.21.15.84:0/2185049869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80cded0 con 0x7fdee4003fe0 2023-10-06T03:26:15.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdef6d9d700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 0x7fdef80cf7e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fdee8011d40 tx=0x7fdee80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:15.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdeef7fe700 1 -- 172.21.15.84:0/2185049869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee800fac0 con 0x7fdee4003fe0 2023-10-06T03:26:15.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdeef7fe700 1 -- 172.21.15.84:0/2185049869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee800fc20 con 0x7fdee4003fe0 2023-10-06T03:26:15.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdefc8d7700 1 -- 172.21.15.84:0/2185049869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef80ce1b0 con 0x7fdee4003fe0 2023-10-06T03:26:15.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdeef7fe700 1 -- 172.21.15.84:0/2185049869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8014440 con 0x7fdee4003fe0 2023-10-06T03:26:15.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.233+0000 7fdefc8d7700 1 -- 172.21.15.84:0/2185049869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef80cec10 con 0x7fdee4003fe0 2023-10-06T03:26:15.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.234+0000 7fdefc8d7700 1 -- 172.21.15.84:0/2185049869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef805f270 con 0x7fdee4003fe0 2023-10-06T03:26:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.235+0000 7fdeef7fe700 1 -- 172.21.15.84:0/2185049869 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdee8014a80 con 0x7fdee4003fe0 2023-10-06T03:26:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.235+0000 7fdeef7fe700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded8066f30 0x7fded80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.235+0000 7fdeef7fe700 1 -- 172.21.15.84:0/2185049869 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdee8018030 con 0x7fdee4003fe0 2023-10-06T03:26:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.235+0000 7fdeee59c700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded8066f30 0x7fded80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.236+0000 7fdeee59c700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded8066f30 0x7fded80693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdee000a010 tx=0x7fdee001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.239+0000 7fdeef7fe700 1 -- 172.21.15.84:0/2185049869 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdee8052460 con 0x7fdee4003fe0 2023-10-06T03:26:15.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.498+0000 7fdefc8d7700 1 -- 172.21.15.84:0/2185049869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdef815cd40 con 0x7fdee4003fe0 2023-10-06T03:26:15.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.499+0000 7fdeef7fe700 1 -- 172.21.15.84:0/2185049869 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1436 (secure 0 0 0) 0x7fdee80225b0 con 0x7fdee4003fe0 2023-10-06T03:26:15.501 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:15.501 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":163,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":74,"num_osds":8,"num_up_osds":8,"osd_up_since":1696562622,"num_in_osds":8,"osd_in_since":1696562613,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592674,"bytes_used":2443874304,"bytes_avail":770650238976,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":39,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6207}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-06T03:25:59.067149+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:26:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 -- 172.21.15.84:0/2185049869 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded8066f30 msgr2=0x7fded80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded8066f30 0x7fded80693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdee000a010 tx=0x7fdee001a000 comp rx=0 tx=0).stop 2023-10-06T03:26:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 -- 172.21.15.84:0/2185049869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 msgr2=0x7fdef80cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 0x7fdef80cf7e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fdee8011d40 tx=0x7fdee80091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 -- 172.21.15.84:0/2185049869 shutdown_connections 2023-10-06T03:26:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fded8066f30 0x7fded80693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdef8155030 0x7fdef80ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4003fe0 0x7fdef80cf7e0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 --2- 172.21.15.84:0/2185049869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdef8155600 0x7fdef80cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 -- 172.21.15.84:0/2185049869 >> 172.21.15.84:0/2185049869 conn(0x7fdef806ed20 msgr2=0x7fdef80680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 -- 172.21.15.84:0/2185049869 shutdown_connections 2023-10-06T03:26:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.501+0000 7fdefc8d7700 1 -- 172.21.15.84:0/2185049869 wait complete. 2023-10-06T03:26:15.514 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T03:26:15.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:26:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.628+0000 7f6c91a3c700 1 Processor -- start 2023-10-06T03:26:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.628+0000 7f6c91a3c700 1 -- start start 2023-10-06T03:26:15.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.629+0000 7f6c91a3c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c8c1595a0 0x7f6c8c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.629+0000 7f6c91a3c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6c8c0b49e0 0x7f6c8c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.629+0000 7f6c91a3c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c0b0ca0 con 0x7f6c8c0b07a0 2023-10-06T03:26:15.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.629+0000 7f6c91a3c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c0b0f80 con 0x7f6c8c1595a0 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.629+0000 7f6c91a3c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c0b1260 con 0x7f6c8c0b49e0 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.629+0000 7f6c8affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c8c1595a0 0x7f6c8c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.629+0000 7f6c8affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c8c1595a0 0x7f6c8c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49520/0 (socket says 172.21.15.84:49520) 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.629+0000 7f6c8affd700 1 -- 172.21.15.84:0/3569848069 learned_addr learned my addr 172.21.15.84:0/3569848069 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.629+0000 7f6c827fc700 1 --2- 172.21.15.84:0/3569848069 >> v2:172.21.15.131:3300/0 conn(0x7f6c8c0b49e0 0x7f6c8c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c8affd700 1 -- 172.21.15.84:0/3569848069 >> v2:172.21.15.131:3300/0 conn(0x7f6c8c0b49e0 msgr2=0x7f6c8c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c8affd700 1 --2- 172.21.15.84:0/3569848069 >> v2:172.21.15.131:3300/0 conn(0x7f6c8c0b49e0 0x7f6c8c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c8affd700 1 -- 172.21.15.84:0/3569848069 >> v1:172.21.15.131:6789/0 conn(0x7f6c8c0b07a0 legacy=0x7f6c8c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c8affd700 1 -- 172.21.15.84:0/3569848069 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0b1540 con 0x7f6c8c1595a0 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c8affd700 1 --2- 172.21.15.84:0/3569848069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 0x7f6c8c0aa570 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009990 tx=0x7f6c7c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba48941dfcc8f6f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c8a7fc700 1 -- 172.21.15.84:0/3569848069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c005c10 con 0x7f6c8c1595a0 2023-10-06T03:26:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c8a7fc700 1 -- 172.21.15.84:0/3569848069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c005d70 con 0x7f6c8c1595a0 2023-10-06T03:26:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c8a7fc700 1 -- 172.21.15.84:0/3569848069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00b800 con 0x7f6c8c1595a0 2023-10-06T03:26:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3569848069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 msgr2=0x7f6c8c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c91a3c700 1 --2- 172.21.15.84:0/3569848069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 0x7f6c8c0aa570 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009990 tx=0x7f6c7c009220 comp rx=0 tx=0).stop 2023-10-06T03:26:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3569848069 shutdown_connections 2023-10-06T03:26:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c91a3c700 1 --2- 172.21.15.84:0/3569848069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 0x7f6c8c0aa570 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c91a3c700 1 --2- 172.21.15.84:0/3569848069 >> v2:172.21.15.131:3300/0 conn(0x7f6c8c0b49e0 0x7f6c8c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3569848069 >> 172.21.15.84:0/3569848069 conn(0x7f6c8c099830 msgr2=0x7f6c8c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.630+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3569848069 shutdown_connections 2023-10-06T03:26:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.631+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3569848069 wait complete. 2023-10-06T03:26:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.632+0000 7f6c91a3c700 1 Processor -- start 2023-10-06T03:26:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.632+0000 7f6c91a3c700 1 -- start start 2023-10-06T03:26:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.632+0000 7f6c91a3c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8c0b07a0 0x7f6c8c09bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.632+0000 7f6c91a3c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c8c0b49e0 0x7f6c8c1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.632+0000 7f6c91a3c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 0x7f6c8c09a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.632+0000 7f6c91a3c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c09b6f0 con 0x7f6c8c1595a0 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.632+0000 7f6c91a3c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c09aae0 con 0x7f6c8c0b07a0 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.632+0000 7f6c91a3c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c09adc0 con 0x7f6c8c0b49e0 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 0x7f6c8c09a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 0x7f6c8c09a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49532/0 (socket says 172.21.15.84:49532) 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8b7fe700 1 -- 172.21.15.84:0/3834520390 learned_addr learned my addr 172.21.15.84:0/3834520390 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c827fc700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c8c0b49e0 0x7f6c8c1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8affd700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8c0b07a0 0x7f6c8c09bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8b7fe700 1 -- 172.21.15.84:0/3834520390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c8c0b49e0 msgr2=0x7f6c8c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8b7fe700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c8c0b49e0 0x7f6c8c1568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8b7fe700 1 -- 172.21.15.84:0/3834520390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8c0b07a0 msgr2=0x7f6c8c09bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8b7fe700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8c0b07a0 0x7f6c8c09bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8b7fe700 1 -- 172.21.15.84:0/3834520390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c009480 con 0x7f6c8c1595a0 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c827fc700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c8c0b49e0 0x7f6c8c1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8affd700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8c0b07a0 0x7f6c8c09bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c8b7fe700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 0x7f6c8c09a090 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c930 tx=0x7f6c840026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c837fe700 1 -- 172.21.15.84:0/3834520390 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400ce70 con 0x7f6c8c1595a0 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c837fe700 1 -- 172.21.15.84:0/3834520390 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8400a7e0 con 0x7f6c8c1595a0 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c837fe700 1 -- 172.21.15.84:0/3834520390 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400aba0 con 0x7f6c8c1595a0 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3834520390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c09b0a0 con 0x7f6c8c1595a0 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.633+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3834520390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c15b8b0 con 0x7f6c8c1595a0 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.634+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3834520390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c09b8a0 con 0x7f6c8c1595a0 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.635+0000 7f6c837fe700 1 -- 172.21.15.84:0/3834520390 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c84012420 con 0x7f6c8c1595a0 2023-10-06T03:26:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.635+0000 7f6c837fe700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c6c066f30 0x7f6c6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.635+0000 7f6c837fe700 1 -- 172.21.15.84:0/3834520390 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6c84084ba0 con 0x7f6c8c1595a0 2023-10-06T03:26:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.635+0000 7f6c8affd700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c6c066f30 0x7f6c6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.635+0000 7f6c8affd700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c6c066f30 0x7f6c6c0693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009990 tx=0x7f6c7c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.639+0000 7f6c837fe700 1 -- 172.21.15.84:0/3834520390 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c8c09b8a0 con 0x7f6c8c1595a0 2023-10-06T03:26:15.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.818+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3834520390 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c8c064ad0 con 0x7f6c6c066f30 2023-10-06T03:26:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.826+0000 7f6c837fe700 1 -- 172.21.15.84:0/3834520390 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311938 (secure 0 0 0) 0x7f6c8c064ad0 con 0x7f6c6c066f30 2023-10-06T03:26:15.831 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3834520390 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c6c066f30 msgr2=0x7f6c6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c6c066f30 0x7f6c6c0693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009990 tx=0x7f6c7c015000 comp rx=0 tx=0).stop 2023-10-06T03:26:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3834520390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 msgr2=0x7f6c8c09a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 0x7f6c8c09a090 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c930 tx=0x7f6c840026e0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3834520390 shutdown_connections 2023-10-06T03:26:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c6c066f30 0x7f6c6c0693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8c0b07a0 0x7f6c8c09bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8c1595a0 0x7f6c8c09a090 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 --2- 172.21.15.84:0/3834520390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c8c0b49e0 0x7f6c8c1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:15.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3834520390 >> 172.21.15.84:0/3834520390 conn(0x7f6c8c099830 msgr2=0x7f6c8c068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:15.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3834520390 shutdown_connections 2023-10-06T03:26:15.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:15.829+0000 7f6c91a3c700 1 -- 172.21.15.84:0/3834520390 wait complete. 2023-10-06T03:26:15.835 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:26:15.843 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2023-10-06T03:26:15.069998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386596,"kb_used_data":8292,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588124,"statfs":{"total":773094113280,"available":770650238976,"internally_reserved":0,"allocated":8491008,"data_stored":4586083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001191"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.287076+0000","last_change":"2023-10-06T03:26:10.281003+0000","last_active":"2023-10-06T03:26:10.287076+0000","last_peered":"2023-10-06T03:26:10.287076+0000","last_clean":"2023-10-06T03:26:10.287076+0000","last_became_active":"2023-10-06T03:26:10.280754+0000","last_became_peered":"2023-10-06T03:26:10.280754+0000","last_unstale":"2023-10-06T03:26:10.287076+0000","last_undegraded":"2023-10-06T03:26:10.287076+0000","last_fullsized":"2023-10-06T03:26:10.287076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:23.888714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290649+0000","last_change":"2023-10-06T03:26:10.288789+0000","last_active":"2023-10-06T03:26:10.290649+0000","last_peered":"2023-10-06T03:26:10.290649+0000","last_clean":"2023-10-06T03:26:10.290649+0000","last_became_active":"2023-10-06T03:26:10.288490+0000","last_became_peered":"2023-10-06T03:26:10.288490+0000","last_unstale":"2023-10-06T03:26:10.290649+0000","last_undegraded":"2023-10-06T03:26:10.290649+0000","last_fullsized":"2023-10-06T03:26:10.290649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:26.085236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271421+0000","last_change":"2023-10-06T03:26:10.265089+0000","last_active":"2023-10-06T03:26:10.271421+0000","last_peered":"2023-10-06T03:26:10.271421+0000","last_clean":"2023-10-06T03:26:10.271421+0000","last_became_active":"2023-10-06T03:26:10.264799+0000","last_became_peered":"2023-10-06T03:26:10.264799+0000","last_unstale":"2023-10-06T03:26:10.271421+0000","last_undegraded":"2023-10-06T03:26:10.271421+0000","last_fullsized":"2023-10-06T03:26:10.271421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:40.805767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282199+0000","last_change":"2023-10-06T03:26:10.274603+0000","last_active":"2023-10-06T03:26:10.282199+0000","last_peered":"2023-10-06T03:26:10.282199+0000","last_clean":"2023-10-06T03:26:10.282199+0000","last_became_active":"2023-10-06T03:26:10.274368+0000","last_became_peered":"2023-10-06T03:26:10.274368+0000","last_unstale":"2023-10-06T03:26:10.282199+0000","last_undegraded":"2023-10-06T03:26:10.282199+0000","last_fullsized":"2023-10-06T03:26:10.282199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:22.065858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283357+0000","last_change":"2023-10-06T03:26:10.275726+0000","last_active":"2023-10-06T03:26:10.283357+0000","last_peered":"2023-10-06T03:26:10.283357+0000","last_clean":"2023-10-06T03:26:10.283357+0000","last_became_active":"2023-10-06T03:26:10.275453+0000","last_became_peered":"2023-10-06T03:26:10.275453+0000","last_unstale":"2023-10-06T03:26:10.283357+0000","last_undegraded":"2023-10-06T03:26:10.283357+0000","last_fullsized":"2023-10-06T03:26:10.283357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:27.364662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282010+0000","last_change":"2023-10-06T03:26:10.278848+0000","last_active":"2023-10-06T03:26:10.282010+0000","last_peered":"2023-10-06T03:26:10.282010+0000","last_clean":"2023-10-06T03:26:10.282010+0000","last_became_active":"2023-10-06T03:26:10.278604+0000","last_became_peered":"2023-10-06T03:26:10.278604+0000","last_unstale":"2023-10-06T03:26:10.282010+0000","last_undegraded":"2023-10-06T03:26:10.282010+0000","last_fullsized":"2023-10-06T03:26:10.282010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:57.583036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.269336+0000","last_change":"2023-10-06T03:26:10.264610+0000","last_active":"2023-10-06T03:26:10.269336+0000","last_peered":"2023-10-06T03:26:10.269336+0000","last_clean":"2023-10-06T03:26:10.269336+0000","last_became_active":"2023-10-06T03:26:10.264360+0000","last_became_peered":"2023-10-06T03:26:10.264360+0000","last_unstale":"2023-10-06T03:26:10.269336+0000","last_undegraded":"2023-10-06T03:26:10.269336+0000","last_fullsized":"2023-10-06T03:26:10.269336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:44.966408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.294483+0000","last_change":"2023-10-06T03:26:10.289416+0000","last_active":"2023-10-06T03:26:10.294483+0000","last_peered":"2023-10-06T03:26:10.294483+0000","last_clean":"2023-10-06T03:26:10.294483+0000","last_became_active":"2023-10-06T03:26:10.289136+0000","last_became_peered":"2023-10-06T03:26:10.289136+0000","last_unstale":"2023-10-06T03:26:10.294483+0000","last_undegraded":"2023-10-06T03:26:10.294483+0000","last_fullsized":"2023-10-06T03:26:10.294483+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:26.684095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277565+0000","last_change":"2023-10-06T03:26:10.274574+0000","last_active":"2023-10-06T03:26:10.277565+0000","last_peered":"2023-10-06T03:26:10.277565+0000","last_clean":"2023-10-06T03:26:10.277565+0000","last_became_active":"2023-10-06T03:26:10.274274+0000","last_became_peered":"2023-10-06T03:26:10.274274+0000","last_unstale":"2023-10-06T03:26:10.277565+0000","last_undegraded":"2023-10-06T03:26:10.277565+0000","last_fullsized":"2023-10-06T03:26:10.277565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276705+0000","last_change":"2023-10-06T03:26:10.266900+0000","last_active":"2023-10-06T03:26:10.276705+0000","last_peered":"2023-10-06T03:26:10.276705+0000","last_clean":"2023-10-06T03:26:10.276705+0000","last_became_active":"2023-10-06T03:26:10.266662+0000","last_became_peered":"2023-10-06T03:26:10.266662+0000","last_unstale":"2023-10-06T03:26:10.276705+0000","last_undegraded":"2023-10-06T03:26:10.276705+0000","last_fullsized":"2023-10-06T03:26:10.276705+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:15.923231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288219+0000","last_change":"2023-10-06T03:26:10.276484+0000","last_active":"2023-10-06T03:26:10.288219+0000","last_peered":"2023-10-06T03:26:10.288219+0000","last_clean":"2023-10-06T03:26:10.288219+0000","last_became_active":"2023-10-06T03:26:10.276132+0000","last_became_peered":"2023-10-06T03:26:10.276132+0000","last_unstale":"2023-10-06T03:26:10.288219+0000","last_undegraded":"2023-10-06T03:26:10.288219+0000","last_fullsized":"2023-10-06T03:26:10.288219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:23.660405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276817+0000","last_change":"2023-10-06T03:26:10.272898+0000","last_active":"2023-10-06T03:26:10.276817+0000","last_peered":"2023-10-06T03:26:10.276817+0000","last_clean":"2023-10-06T03:26:10.276817+0000","last_became_active":"2023-10-06T03:26:10.272265+0000","last_became_peered":"2023-10-06T03:26:10.272265+0000","last_unstale":"2023-10-06T03:26:10.276817+0000","last_undegraded":"2023-10-06T03:26:10.276817+0000","last_fullsized":"2023-10-06T03:26:10.276817+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:08.832863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.287197+0000","last_change":"2023-10-06T03:26:10.283921+0000","last_active":"2023-10-06T03:26:10.287197+0000","last_peered":"2023-10-06T03:26:10.287197+0000","last_clean":"2023-10-06T03:26:10.287197+0000","last_became_active":"2023-10-06T03:26:10.283622+0000","last_became_peered":"2023-10-06T03:26:10.283622+0000","last_unstale":"2023-10-06T03:26:10.287197+0000","last_undegraded":"2023-10-06T03:26:10.287197+0000","last_fullsized":"2023-10-06T03:26:10.287197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:37.030135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286698+0000","last_change":"2023-10-06T03:26:10.281874+0000","last_active":"2023-10-06T03:26:10.286698+0000","last_peered":"2023-10-06T03:26:10.286698+0000","last_clean":"2023-10-06T03:26:10.286698+0000","last_became_active":"2023-10-06T03:26:10.281250+0000","last_became_peered":"2023-10-06T03:26:10.281250+0000","last_unstale":"2023-10-06T03:26:10.286698+0000","last_undegraded":"2023-10-06T03:26:10.286698+0000","last_fullsized":"2023-10-06T03:26:10.286698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:06.471008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.278244+0000","last_change":"2023-10-06T03:26:10.271762+0000","last_active":"2023-10-06T03:26:10.278244+0000","last_peered":"2023-10-06T03:26:10.278244+0000","last_clean":"2023-10-06T03:26:10.278244+0000","last_became_active":"2023-10-06T03:26:10.271203+0000","last_became_peered":"2023-10-06T03:26:10.271203+0000","last_unstale":"2023-10-06T03:26:10.278244+0000","last_undegraded":"2023-10-06T03:26:10.278244+0000","last_fullsized":"2023-10-06T03:26:10.278244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:53.115726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.284319+0000","last_change":"2023-10-06T03:26:10.278721+0000","last_active":"2023-10-06T03:26:10.284319+0000","last_peered":"2023-10-06T03:26:10.284319+0000","last_clean":"2023-10-06T03:26:10.284319+0000","last_became_active":"2023-10-06T03:26:10.278415+0000","last_became_peered":"2023-10-06T03:26:10.278415+0000","last_unstale":"2023-10-06T03:26:10.284319+0000","last_undegraded":"2023-10-06T03:26:10.284319+0000","last_fullsized":"2023-10-06T03:26:10.284319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:56.263137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.284355+0000","last_change":"2023-10-06T03:26:10.278917+0000","last_active":"2023-10-06T03:26:10.284355+0000","last_peered":"2023-10-06T03:26:10.284355+0000","last_clean":"2023-10-06T03:26:10.284355+0000","last_became_active":"2023-10-06T03:26:10.278646+0000","last_became_peered":"2023-10-06T03:26:10.278646+0000","last_unstale":"2023-10-06T03:26:10.284355+0000","last_undegraded":"2023-10-06T03:26:10.284355+0000","last_fullsized":"2023-10-06T03:26:10.284355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.091395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.269176+0000","last_change":"2023-10-06T03:26:10.264466+0000","last_active":"2023-10-06T03:26:10.269176+0000","last_peered":"2023-10-06T03:26:10.269176+0000","last_clean":"2023-10-06T03:26:10.269176+0000","last_became_active":"2023-10-06T03:26:10.264162+0000","last_became_peered":"2023-10-06T03:26:10.264162+0000","last_unstale":"2023-10-06T03:26:10.269176+0000","last_undegraded":"2023-10-06T03:26:10.269176+0000","last_fullsized":"2023-10-06T03:26:10.269176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:23.246504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273374+0000","last_change":"2023-10-06T03:26:10.270773+0000","last_active":"2023-10-06T03:26:10.273374+0000","last_peered":"2023-10-06T03:26:10.273374+0000","last_clean":"2023-10-06T03:26:10.273374+0000","last_became_active":"2023-10-06T03:26:10.270519+0000","last_became_peered":"2023-10-06T03:26:10.270519+0000","last_unstale":"2023-10-06T03:26:10.273374+0000","last_undegraded":"2023-10-06T03:26:10.273374+0000","last_fullsized":"2023-10-06T03:26:10.273374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:54.381978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.281789+0000","last_change":"2023-10-06T03:26:10.269887+0000","last_active":"2023-10-06T03:26:10.281789+0000","last_peered":"2023-10-06T03:26:10.281789+0000","last_clean":"2023-10-06T03:26:10.281789+0000","last_became_active":"2023-10-06T03:26:10.269397+0000","last_became_peered":"2023-10-06T03:26:10.269397+0000","last_unstale":"2023-10-06T03:26:10.281789+0000","last_undegraded":"2023-10-06T03:26:10.281789+0000","last_fullsized":"2023-10-06T03:26:10.281789+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:48.998501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.281751+0000","last_change":"2023-10-06T03:26:10.273079+0000","last_active":"2023-10-06T03:26:10.281751+0000","last_peered":"2023-10-06T03:26:10.281751+0000","last_clean":"2023-10-06T03:26:10.281751+0000","last_became_active":"2023-10-06T03:26:10.272822+0000","last_became_peered":"2023-10-06T03:26:10.272822+0000","last_unstale":"2023-10-06T03:26:10.281751+0000","last_undegraded":"2023-10-06T03:26:10.281751+0000","last_fullsized":"2023-10-06T03:26:10.281751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:22.093208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288661+0000","last_change":"2023-10-06T03:26:10.280816+0000","last_active":"2023-10-06T03:26:10.288661+0000","last_peered":"2023-10-06T03:26:10.288661+0000","last_clean":"2023-10-06T03:26:10.288661+0000","last_became_active":"2023-10-06T03:26:10.280318+0000","last_became_peered":"2023-10-06T03:26:10.280318+0000","last_unstale":"2023-10-06T03:26:10.288661+0000","last_undegraded":"2023-10-06T03:26:10.288661+0000","last_fullsized":"2023-10-06T03:26:10.288661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:44.966408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276799+0000","last_change":"2023-10-06T03:26:10.272038+0000","last_active":"2023-10-06T03:26:10.276799+0000","last_peered":"2023-10-06T03:26:10.276799+0000","last_clean":"2023-10-06T03:26:10.276799+0000","last_became_active":"2023-10-06T03:26:10.269075+0000","last_became_peered":"2023-10-06T03:26:10.269075+0000","last_unstale":"2023-10-06T03:26:10.276799+0000","last_undegraded":"2023-10-06T03:26:10.276799+0000","last_fullsized":"2023-10-06T03:26:10.276799+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:47.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282363+0000","last_change":"2023-10-06T03:26:10.274678+0000","last_active":"2023-10-06T03:26:10.282363+0000","last_peered":"2023-10-06T03:26:10.282363+0000","last_clean":"2023-10-06T03:26:10.282363+0000","last_became_active":"2023-10-06T03:26:10.274409+0000","last_became_peered":"2023-10-06T03:26:10.274409+0000","last_unstale":"2023-10-06T03:26:10.282363+0000","last_undegraded":"2023-10-06T03:26:10.282363+0000","last_fullsized":"2023-10-06T03:26:10.282363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:38.350999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.289382+0000","last_change":"2023-10-06T03:26:10.283714+0000","last_active":"2023-10-06T03:26:10.289382+0000","last_peered":"2023-10-06T03:26:10.289382+0000","last_clean":"2023-10-06T03:26:10.289382+0000","last_became_active":"2023-10-06T03:26:10.283184+0000","last_became_peered":"2023-10-06T03:26:10.283184+0000","last_unstale":"2023-10-06T03:26:10.289382+0000","last_undegraded":"2023-10-06T03:26:10.289382+0000","last_fullsized":"2023-10-06T03:26:10.289382+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:35.682913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292296+0000","last_change":"2023-10-06T03:26:10.289063+0000","last_active":"2023-10-06T03:26:10.292296+0000","last_peered":"2023-10-06T03:26:10.292296+0000","last_clean":"2023-10-06T03:26:10.292296+0000","last_became_active":"2023-10-06T03:26:10.288750+0000","last_became_peered":"2023-10-06T03:26:10.288750+0000","last_unstale":"2023-10-06T03:26:10.292296+0000","last_undegraded":"2023-10-06T03:26:10.292296+0000","last_fullsized":"2023-10-06T03:26:10.292296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:56.252304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.284488+0000","last_change":"2023-10-06T03:26:10.280841+0000","last_active":"2023-10-06T03:26:10.284488+0000","last_peered":"2023-10-06T03:26:10.284488+0000","last_clean":"2023-10-06T03:26:10.284488+0000","last_became_active":"2023-10-06T03:26:10.280547+0000","last_became_peered":"2023-10-06T03:26:10.280547+0000","last_unstale":"2023-10-06T03:26:10.284488+0000","last_undegraded":"2023-10-06T03:26:10.284488+0000","last_fullsized":"2023-10-06T03:26:10.284488+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:54.381978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276833+0000","last_change":"2023-10-06T03:26:10.273081+0000","last_active":"2023-10-06T03:26:10.276833+0000","last_peered":"2023-10-06T03:26:10.276833+0000","last_clean":"2023-10-06T03:26:10.276833+0000","last_became_active":"2023-10-06T03:26:10.272613+0000","last_became_peered":"2023-10-06T03:26:10.272613+0000","last_unstale":"2023-10-06T03:26:10.276833+0000","last_undegraded":"2023-10-06T03:26:10.276833+0000","last_fullsized":"2023-10-06T03:26:10.276833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:08.877217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288551+0000","last_change":"2023-10-06T03:26:10.280335+0000","last_active":"2023-10-06T03:26:10.288551+0000","last_peered":"2023-10-06T03:26:10.288551+0000","last_clean":"2023-10-06T03:26:10.288551+0000","last_became_active":"2023-10-06T03:26:10.280015+0000","last_became_peered":"2023-10-06T03:26:10.280015+0000","last_unstale":"2023-10-06T03:26:10.288551+0000","last_undegraded":"2023-10-06T03:26:10.288551+0000","last_fullsized":"2023-10-06T03:26:10.288551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:13.025592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290452+0000","last_change":"2023-10-06T03:26:10.284367+0000","last_active":"2023-10-06T03:26:10.290452+0000","last_peered":"2023-10-06T03:26:10.290452+0000","last_clean":"2023-10-06T03:26:10.290452+0000","last_became_active":"2023-10-06T03:26:10.284121+0000","last_became_peered":"2023-10-06T03:26:10.284121+0000","last_unstale":"2023-10-06T03:26:10.290452+0000","last_undegraded":"2023-10-06T03:26:10.290452+0000","last_fullsized":"2023-10-06T03:26:10.290452+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:58.156565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283287+0000","last_change":"2023-10-06T03:26:10.274398+0000","last_active":"2023-10-06T03:26:10.283287+0000","last_peered":"2023-10-06T03:26:10.283287+0000","last_clean":"2023-10-06T03:26:10.283287+0000","last_became_active":"2023-10-06T03:26:10.274113+0000","last_became_peered":"2023-10-06T03:26:10.274113+0000","last_unstale":"2023-10-06T03:26:10.283287+0000","last_undegraded":"2023-10-06T03:26:10.283287+0000","last_fullsized":"2023-10-06T03:26:10.283287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:14.412629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292222+0000","last_change":"2023-10-06T03:26:10.289705+0000","last_active":"2023-10-06T03:26:10.292222+0000","last_peered":"2023-10-06T03:26:10.292222+0000","last_clean":"2023-10-06T03:26:10.292222+0000","last_became_active":"2023-10-06T03:26:10.289389+0000","last_became_peered":"2023-10-06T03:26:10.289389+0000","last_unstale":"2023-10-06T03:26:10.292222+0000","last_undegraded":"2023-10-06T03:26:10.292222+0000","last_fullsized":"2023-10-06T03:26:10.292222+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:37.030135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.284424+0000","last_change":"2023-10-06T03:26:10.279643+0000","last_active":"2023-10-06T03:26:10.284424+0000","last_peered":"2023-10-06T03:26:10.284424+0000","last_clean":"2023-10-06T03:26:10.284424+0000","last_became_active":"2023-10-06T03:26:10.279137+0000","last_became_peered":"2023-10-06T03:26:10.279137+0000","last_unstale":"2023-10-06T03:26:10.284424+0000","last_undegraded":"2023-10-06T03:26:10.284424+0000","last_fullsized":"2023-10-06T03:26:10.284424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:04.105480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"73'4","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.285555+0000","last_change":"2023-10-06T03:26:09.277402+0000","last_active":"2023-10-06T03:26:10.285555+0000","last_peered":"2023-10-06T03:26:10.285555+0000","last_clean":"2023-10-06T03:26:10.285555+0000","last_became_active":"2023-10-06T03:26:09.277183+0000","last_became_peered":"2023-10-06T03:26:09.277183+0000","last_unstale":"2023-10-06T03:26:10.285555+0000","last_undegraded":"2023-10-06T03:26:10.285555+0000","last_fullsized":"2023-10-06T03:26:10.285555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:34.678039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273436+0000","last_change":"2023-10-06T03:26:10.264996+0000","last_active":"2023-10-06T03:26:10.273436+0000","last_peered":"2023-10-06T03:26:10.273436+0000","last_clean":"2023-10-06T03:26:10.273436+0000","last_became_active":"2023-10-06T03:26:10.264754+0000","last_became_peered":"2023-10-06T03:26:10.264754+0000","last_unstale":"2023-10-06T03:26:10.273436+0000","last_undegraded":"2023-10-06T03:26:10.273436+0000","last_fullsized":"2023-10-06T03:26:10.273436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:40.805767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288617+0000","last_change":"2023-10-06T03:26:09.282813+0000","last_active":"2023-10-06T03:26:10.288617+0000","last_peered":"2023-10-06T03:26:10.288617+0000","last_clean":"2023-10-06T03:26:10.288617+0000","last_became_active":"2023-10-06T03:26:09.282590+0000","last_became_peered":"2023-10-06T03:26:09.282590+0000","last_unstale":"2023-10-06T03:26:10.288617+0000","last_undegraded":"2023-10-06T03:26:10.288617+0000","last_fullsized":"2023-10-06T03:26:10.288617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:43.544478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292201+0000","last_change":"2023-10-06T03:26:10.289564+0000","last_active":"2023-10-06T03:26:10.292201+0000","last_peered":"2023-10-06T03:26:10.292201+0000","last_clean":"2023-10-06T03:26:10.292201+0000","last_became_active":"2023-10-06T03:26:10.289243+0000","last_became_peered":"2023-10-06T03:26:10.289243+0000","last_unstale":"2023-10-06T03:26:10.292201+0000","last_undegraded":"2023-10-06T03:26:10.292201+0000","last_fullsized":"2023-10-06T03:26:10.292201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:33.455977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292535+0000","last_change":"2023-10-06T03:26:09.269371+0000","last_active":"2023-10-06T03:26:10.292535+0000","last_peered":"2023-10-06T03:26:10.292535+0000","last_clean":"2023-10-06T03:26:10.292535+0000","last_became_active":"2023-10-06T03:26:09.269122+0000","last_became_peered":"2023-10-06T03:26:09.269122+0000","last_unstale":"2023-10-06T03:26:10.292535+0000","last_undegraded":"2023-10-06T03:26:10.292535+0000","last_fullsized":"2023-10-06T03:26:10.292535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:07.872343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.270673+0000","last_change":"2023-10-06T03:26:10.263185+0000","last_active":"2023-10-06T03:26:10.270673+0000","last_peered":"2023-10-06T03:26:10.270673+0000","last_clean":"2023-10-06T03:26:10.270673+0000","last_became_active":"2023-10-06T03:26:10.262810+0000","last_became_peered":"2023-10-06T03:26:10.262810+0000","last_unstale":"2023-10-06T03:26:10.270673+0000","last_undegraded":"2023-10-06T03:26:10.270673+0000","last_fullsized":"2023-10-06T03:26:10.270673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:23.033550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291255+0000","last_change":"2023-10-06T03:26:09.269129+0000","last_active":"2023-10-06T03:26:10.291255+0000","last_peered":"2023-10-06T03:26:10.291255+0000","last_clean":"2023-10-06T03:26:10.291255+0000","last_became_active":"2023-10-06T03:26:09.268855+0000","last_became_peered":"2023-10-06T03:26:09.268855+0000","last_unstale":"2023-10-06T03:26:10.291255+0000","last_undegraded":"2023-10-06T03:26:10.291255+0000","last_fullsized":"2023-10-06T03:26:10.291255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:46.861569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291508+0000","last_change":"2023-10-06T03:26:10.289206+0000","last_active":"2023-10-06T03:26:10.291508+0000","last_peered":"2023-10-06T03:26:10.291508+0000","last_clean":"2023-10-06T03:26:10.291508+0000","last_became_active":"2023-10-06T03:26:10.288939+0000","last_became_peered":"2023-10-06T03:26:10.288939+0000","last_unstale":"2023-10-06T03:26:10.291508+0000","last_undegraded":"2023-10-06T03:26:10.291508+0000","last_fullsized":"2023-10-06T03:26:10.291508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:56.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290276+0000","last_change":"2023-10-06T03:26:09.272337+0000","last_active":"2023-10-06T03:26:10.290276+0000","last_peered":"2023-10-06T03:26:10.290276+0000","last_clean":"2023-10-06T03:26:10.290276+0000","last_became_active":"2023-10-06T03:26:09.272079+0000","last_became_peered":"2023-10-06T03:26:09.272079+0000","last_unstale":"2023-10-06T03:26:10.290276+0000","last_undegraded":"2023-10-06T03:26:10.290276+0000","last_fullsized":"2023-10-06T03:26:10.290276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:22.028676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283238+0000","last_change":"2023-10-06T03:26:10.271411+0000","last_active":"2023-10-06T03:26:10.283238+0000","last_peered":"2023-10-06T03:26:10.283238+0000","last_clean":"2023-10-06T03:26:10.283238+0000","last_became_active":"2023-10-06T03:26:10.271147+0000","last_became_peered":"2023-10-06T03:26:10.271147+0000","last_unstale":"2023-10-06T03:26:10.283238+0000","last_undegraded":"2023-10-06T03:26:10.283238+0000","last_fullsized":"2023-10-06T03:26:10.283238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:01.260563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288598+0000","last_change":"2023-10-06T03:26:09.276337+0000","last_active":"2023-10-06T03:26:10.288598+0000","last_peered":"2023-10-06T03:26:10.288598+0000","last_clean":"2023-10-06T03:26:10.288598+0000","last_became_active":"2023-10-06T03:26:09.276068+0000","last_became_peered":"2023-10-06T03:26:09.276068+0000","last_unstale":"2023-10-06T03:26:10.288598+0000","last_undegraded":"2023-10-06T03:26:10.288598+0000","last_fullsized":"2023-10-06T03:26:10.288598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:14.918357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277460+0000","last_change":"2023-10-06T03:26:10.275173+0000","last_active":"2023-10-06T03:26:10.277460+0000","last_peered":"2023-10-06T03:26:10.277460+0000","last_clean":"2023-10-06T03:26:10.277460+0000","last_became_active":"2023-10-06T03:26:10.274909+0000","last_became_peered":"2023-10-06T03:26:10.274909+0000","last_unstale":"2023-10-06T03:26:10.277460+0000","last_undegraded":"2023-10-06T03:26:10.277460+0000","last_fullsized":"2023-10-06T03:26:10.277460+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:33.455977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.264130+0000","last_change":"2023-10-06T03:26:09.271505+0000","last_active":"2023-10-06T03:26:10.264130+0000","last_peered":"2023-10-06T03:26:10.264130+0000","last_clean":"2023-10-06T03:26:10.264130+0000","last_became_active":"2023-10-06T03:26:09.271223+0000","last_became_peered":"2023-10-06T03:26:09.271223+0000","last_unstale":"2023-10-06T03:26:10.264130+0000","last_undegraded":"2023-10-06T03:26:10.264130+0000","last_fullsized":"2023-10-06T03:26:10.264130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:56.636169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.278265+0000","last_change":"2023-10-06T03:26:10.271929+0000","last_active":"2023-10-06T03:26:10.278265+0000","last_peered":"2023-10-06T03:26:10.278265+0000","last_clean":"2023-10-06T03:26:10.278265+0000","last_became_active":"2023-10-06T03:26:10.271522+0000","last_became_peered":"2023-10-06T03:26:10.271522+0000","last_unstale":"2023-10-06T03:26:10.278265+0000","last_undegraded":"2023-10-06T03:26:10.278265+0000","last_fullsized":"2023-10-06T03:26:10.278265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:59.932901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276708+0000","last_change":"2023-10-06T03:26:09.270274+0000","last_active":"2023-10-06T03:26:10.276708+0000","last_peered":"2023-10-06T03:26:10.276708+0000","last_clean":"2023-10-06T03:26:10.276708+0000","last_became_active":"2023-10-06T03:26:09.270010+0000","last_became_peered":"2023-10-06T03:26:09.270010+0000","last_unstale":"2023-10-06T03:26:10.276708+0000","last_undegraded":"2023-10-06T03:26:10.276708+0000","last_fullsized":"2023-10-06T03:26:10.276708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:15.677167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290516+0000","last_change":"2023-10-06T03:26:10.289563+0000","last_active":"2023-10-06T03:26:10.290516+0000","last_peered":"2023-10-06T03:26:10.290516+0000","last_clean":"2023-10-06T03:26:10.290516+0000","last_became_active":"2023-10-06T03:26:10.289315+0000","last_became_peered":"2023-10-06T03:26:10.289315+0000","last_unstale":"2023-10-06T03:26:10.290516+0000","last_undegraded":"2023-10-06T03:26:10.290516+0000","last_fullsized":"2023-10-06T03:26:10.290516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:30.978969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261889+0000","last_change":"2023-10-06T03:26:09.281300+0000","last_active":"2023-10-06T03:26:10.261889+0000","last_peered":"2023-10-06T03:26:10.261889+0000","last_clean":"2023-10-06T03:26:10.261889+0000","last_became_active":"2023-10-06T03:26:09.281106+0000","last_became_peered":"2023-10-06T03:26:09.281106+0000","last_unstale":"2023-10-06T03:26:10.261889+0000","last_undegraded":"2023-10-06T03:26:10.261889+0000","last_fullsized":"2023-10-06T03:26:10.261889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:27.760245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282111+0000","last_change":"2023-10-06T03:26:10.279524+0000","last_active":"2023-10-06T03:26:10.282111+0000","last_peered":"2023-10-06T03:26:10.282111+0000","last_clean":"2023-10-06T03:26:10.282111+0000","last_became_active":"2023-10-06T03:26:10.279224+0000","last_became_peered":"2023-10-06T03:26:10.279224+0000","last_unstale":"2023-10-06T03:26:10.282111+0000","last_undegraded":"2023-10-06T03:26:10.282111+0000","last_fullsized":"2023-10-06T03:26:10.282111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:36.078198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261850+0000","last_change":"2023-10-06T03:26:09.278880+0000","last_active":"2023-10-06T03:26:10.261850+0000","last_peered":"2023-10-06T03:26:10.261850+0000","last_clean":"2023-10-06T03:26:10.261850+0000","last_became_active":"2023-10-06T03:26:09.278612+0000","last_became_peered":"2023-10-06T03:26:09.278612+0000","last_unstale":"2023-10-06T03:26:10.261850+0000","last_undegraded":"2023-10-06T03:26:10.261850+0000","last_fullsized":"2023-10-06T03:26:10.261850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:22.655531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271246+0000","last_change":"2023-10-06T03:26:10.265712+0000","last_active":"2023-10-06T03:26:10.271246+0000","last_peered":"2023-10-06T03:26:10.271246+0000","last_clean":"2023-10-06T03:26:10.271246+0000","last_became_active":"2023-10-06T03:26:10.265480+0000","last_became_peered":"2023-10-06T03:26:10.265480+0000","last_unstale":"2023-10-06T03:26:10.271246+0000","last_undegraded":"2023-10-06T03:26:10.271246+0000","last_fullsized":"2023-10-06T03:26:10.271246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:56.263137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"73'3","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291694+0000","last_change":"2023-10-06T03:26:09.279911+0000","last_active":"2023-10-06T03:26:10.291694+0000","last_peered":"2023-10-06T03:26:10.291694+0000","last_clean":"2023-10-06T03:26:10.291694+0000","last_became_active":"2023-10-06T03:26:09.279622+0000","last_became_peered":"2023-10-06T03:26:09.279622+0000","last_unstale":"2023-10-06T03:26:10.291694+0000","last_undegraded":"2023-10-06T03:26:10.291694+0000","last_fullsized":"2023-10-06T03:26:10.291694+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:47.061356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283387+0000","last_change":"2023-10-06T03:26:10.274962+0000","last_active":"2023-10-06T03:26:10.283387+0000","last_peered":"2023-10-06T03:26:10.283387+0000","last_clean":"2023-10-06T03:26:10.283387+0000","last_became_active":"2023-10-06T03:26:10.274474+0000","last_became_peered":"2023-10-06T03:26:10.274474+0000","last_unstale":"2023-10-06T03:26:10.283387+0000","last_undegraded":"2023-10-06T03:26:10.283387+0000","last_fullsized":"2023-10-06T03:26:10.283387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:49.593659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"73'6","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.294552+0000","last_change":"2023-10-06T03:26:09.274118+0000","last_active":"2023-10-06T03:26:10.294552+0000","last_peered":"2023-10-06T03:26:10.294552+0000","last_clean":"2023-10-06T03:26:10.294552+0000","last_became_active":"2023-10-06T03:26:09.273846+0000","last_became_peered":"2023-10-06T03:26:09.273846+0000","last_unstale":"2023-10-06T03:26:10.294552+0000","last_undegraded":"2023-10-06T03:26:10.294552+0000","last_fullsized":"2023-10-06T03:26:10.294552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:34.678039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.285887+0000","last_change":"2023-10-06T03:26:10.279311+0000","last_active":"2023-10-06T03:26:10.285887+0000","last_peered":"2023-10-06T03:26:10.285887+0000","last_clean":"2023-10-06T03:26:10.285887+0000","last_became_active":"2023-10-06T03:26:10.278961+0000","last_became_peered":"2023-10-06T03:26:10.278961+0000","last_unstale":"2023-10-06T03:26:10.285887+0000","last_undegraded":"2023-10-06T03:26:10.285887+0000","last_fullsized":"2023-10-06T03:26:10.285887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:50.357206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291495+0000","last_change":"2023-10-06T03:26:09.270358+0000","last_active":"2023-10-06T03:26:10.291495+0000","last_peered":"2023-10-06T03:26:10.291495+0000","last_clean":"2023-10-06T03:26:10.291495+0000","last_became_active":"2023-10-06T03:26:09.268859+0000","last_became_peered":"2023-10-06T03:26:09.268859+0000","last_unstale":"2023-10-06T03:26:10.291495+0000","last_undegraded":"2023-10-06T03:26:10.291495+0000","last_fullsized":"2023-10-06T03:26:10.291495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:11.840868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277429+0000","last_change":"2023-10-06T03:26:10.274400+0000","last_active":"2023-10-06T03:26:10.277429+0000","last_peered":"2023-10-06T03:26:10.277429+0000","last_clean":"2023-10-06T03:26:10.277429+0000","last_became_active":"2023-10-06T03:26:10.272719+0000","last_became_peered":"2023-10-06T03:26:10.272719+0000","last_unstale":"2023-10-06T03:26:10.277429+0000","last_undegraded":"2023-10-06T03:26:10.277429+0000","last_fullsized":"2023-10-06T03:26:10.277429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:44.549351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262675+0000","last_change":"2023-10-06T03:26:09.274952+0000","last_active":"2023-10-06T03:26:10.262675+0000","last_peered":"2023-10-06T03:26:10.262675+0000","last_clean":"2023-10-06T03:26:10.262675+0000","last_became_active":"2023-10-06T03:26:09.274489+0000","last_became_peered":"2023-10-06T03:26:09.274489+0000","last_unstale":"2023-10-06T03:26:10.262675+0000","last_undegraded":"2023-10-06T03:26:10.262675+0000","last_fullsized":"2023-10-06T03:26:10.262675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:39.800893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290606+0000","last_change":"2023-10-06T03:26:10.285343+0000","last_active":"2023-10-06T03:26:10.290606+0000","last_peered":"2023-10-06T03:26:10.290606+0000","last_clean":"2023-10-06T03:26:10.290606+0000","last_became_active":"2023-10-06T03:26:10.284618+0000","last_became_peered":"2023-10-06T03:26:10.284618+0000","last_unstale":"2023-10-06T03:26:10.290606+0000","last_undegraded":"2023-10-06T03:26:10.290606+0000","last_fullsized":"2023-10-06T03:26:10.290606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:23.246504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267438+0000","last_change":"2023-10-06T03:26:09.276331+0000","last_active":"2023-10-06T03:26:10.267438+0000","last_peered":"2023-10-06T03:26:10.267438+0000","last_clean":"2023-10-06T03:26:10.267438+0000","last_became_active":"2023-10-06T03:26:09.276038+0000","last_became_peered":"2023-10-06T03:26:09.276038+0000","last_unstale":"2023-10-06T03:26:10.267438+0000","last_undegraded":"2023-10-06T03:26:10.267438+0000","last_fullsized":"2023-10-06T03:26:10.267438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:15.335321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.289651+0000","last_change":"2023-10-06T03:26:10.283421+0000","last_active":"2023-10-06T03:26:10.289651+0000","last_peered":"2023-10-06T03:26:10.289651+0000","last_clean":"2023-10-06T03:26:10.289651+0000","last_became_active":"2023-10-06T03:26:10.283133+0000","last_became_peered":"2023-10-06T03:26:10.283133+0000","last_unstale":"2023-10-06T03:26:10.289651+0000","last_undegraded":"2023-10-06T03:26:10.289651+0000","last_fullsized":"2023-10-06T03:26:10.289651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:36.886369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"73'8","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292711+0000","last_change":"2023-10-06T03:26:09.271167+0000","last_active":"2023-10-06T03:26:10.292711+0000","last_peered":"2023-10-06T03:26:10.292711+0000","last_clean":"2023-10-06T03:26:10.292711+0000","last_became_active":"2023-10-06T03:26:09.270925+0000","last_became_peered":"2023-10-06T03:26:09.270925+0000","last_unstale":"2023-10-06T03:26:10.292711+0000","last_undegraded":"2023-10-06T03:26:10.292711+0000","last_fullsized":"2023-10-06T03:26:10.292711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:32.451103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.284443+0000","last_change":"2023-10-06T03:26:10.279812+0000","last_active":"2023-10-06T03:26:10.284443+0000","last_peered":"2023-10-06T03:26:10.284443+0000","last_clean":"2023-10-06T03:26:10.284443+0000","last_became_active":"2023-10-06T03:26:10.279401+0000","last_became_peered":"2023-10-06T03:26:10.279401+0000","last_unstale":"2023-10-06T03:26:10.284443+0000","last_undegraded":"2023-10-06T03:26:10.284443+0000","last_fullsized":"2023-10-06T03:26:10.284443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:50.494148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290102+0000","last_change":"2023-10-06T03:26:09.276138+0000","last_active":"2023-10-06T03:26:10.290102+0000","last_peered":"2023-10-06T03:26:10.290102+0000","last_clean":"2023-10-06T03:26:10.290102+0000","last_became_active":"2023-10-06T03:26:09.275927+0000","last_became_peered":"2023-10-06T03:26:09.275927+0000","last_unstale":"2023-10-06T03:26:10.290102+0000","last_undegraded":"2023-10-06T03:26:10.290102+0000","last_fullsized":"2023-10-06T03:26:10.290102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:19.285384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273154+0000","last_change":"2023-10-06T03:26:10.266427+0000","last_active":"2023-10-06T03:26:10.273154+0000","last_peered":"2023-10-06T03:26:10.273154+0000","last_clean":"2023-10-06T03:26:10.273154+0000","last_became_active":"2023-10-06T03:26:10.266130+0000","last_became_peered":"2023-10-06T03:26:10.266130+0000","last_unstale":"2023-10-06T03:26:10.273154+0000","last_undegraded":"2023-10-06T03:26:10.273154+0000","last_fullsized":"2023-10-06T03:26:10.273154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:47.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.278801+0000","last_change":"2023-10-06T03:26:09.270391+0000","last_active":"2023-10-06T03:26:10.278801+0000","last_peered":"2023-10-06T03:26:10.278801+0000","last_clean":"2023-10-06T03:26:10.278801+0000","last_became_active":"2023-10-06T03:26:09.270124+0000","last_became_peered":"2023-10-06T03:26:09.270124+0000","last_unstale":"2023-10-06T03:26:10.278801+0000","last_undegraded":"2023-10-06T03:26:10.278801+0000","last_fullsized":"2023-10-06T03:26:10.278801+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:20.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276799+0000","last_change":"2023-10-06T03:26:10.266500+0000","last_active":"2023-10-06T03:26:10.276799+0000","last_peered":"2023-10-06T03:26:10.276799+0000","last_clean":"2023-10-06T03:26:10.276799+0000","last_became_active":"2023-10-06T03:26:10.266247+0000","last_became_peered":"2023-10-06T03:26:10.266247+0000","last_unstale":"2023-10-06T03:26:10.276799+0000","last_undegraded":"2023-10-06T03:26:10.276799+0000","last_fullsized":"2023-10-06T03:26:10.276799+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:44.549351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262163+0000","last_change":"2023-10-06T03:26:09.276320+0000","last_active":"2023-10-06T03:26:10.262163+0000","last_peered":"2023-10-06T03:26:10.262163+0000","last_clean":"2023-10-06T03:26:10.262163+0000","last_became_active":"2023-10-06T03:26:09.276067+0000","last_became_peered":"2023-10-06T03:26:09.276067+0000","last_unstale":"2023-10-06T03:26:10.262163+0000","last_undegraded":"2023-10-06T03:26:10.262163+0000","last_fullsized":"2023-10-06T03:26:10.262163+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:10.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283367+0000","last_change":"2023-10-06T03:26:10.274764+0000","last_active":"2023-10-06T03:26:10.283367+0000","last_peered":"2023-10-06T03:26:10.283367+0000","last_clean":"2023-10-06T03:26:10.283367+0000","last_became_active":"2023-10-06T03:26:10.274145+0000","last_became_peered":"2023-10-06T03:26:10.274145+0000","last_unstale":"2023-10-06T03:26:10.283367+0000","last_undegraded":"2023-10-06T03:26:10.283367+0000","last_fullsized":"2023-10-06T03:26:10.283367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:50.357206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262373+0000","last_change":"2023-10-06T03:26:09.274880+0000","last_active":"2023-10-06T03:26:10.262373+0000","last_peered":"2023-10-06T03:26:10.262373+0000","last_clean":"2023-10-06T03:26:10.262373+0000","last_became_active":"2023-10-06T03:26:09.274557+0000","last_became_peered":"2023-10-06T03:26:09.274557+0000","last_unstale":"2023-10-06T03:26:10.262373+0000","last_undegraded":"2023-10-06T03:26:10.262373+0000","last_fullsized":"2023-10-06T03:26:10.262373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:15.335321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277520+0000","last_change":"2023-10-06T03:26:10.275099+0000","last_active":"2023-10-06T03:26:10.277520+0000","last_peered":"2023-10-06T03:26:10.277520+0000","last_clean":"2023-10-06T03:26:10.277520+0000","last_became_active":"2023-10-06T03:26:10.274837+0000","last_became_peered":"2023-10-06T03:26:10.274837+0000","last_unstale":"2023-10-06T03:26:10.277520+0000","last_undegraded":"2023-10-06T03:26:10.277520+0000","last_fullsized":"2023-10-06T03:26:10.277520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:56.297907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.264536+0000","last_change":"2023-10-06T03:26:09.275525+0000","last_active":"2023-10-06T03:26:10.264536+0000","last_peered":"2023-10-06T03:26:10.264536+0000","last_clean":"2023-10-06T03:26:10.264536+0000","last_became_active":"2023-10-06T03:26:09.275255+0000","last_became_peered":"2023-10-06T03:26:09.275255+0000","last_unstale":"2023-10-06T03:26:10.264536+0000","last_undegraded":"2023-10-06T03:26:10.264536+0000","last_fullsized":"2023-10-06T03:26:10.264536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:39.800893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286545+0000","last_change":"2023-10-06T03:26:10.279562+0000","last_active":"2023-10-06T03:26:10.286545+0000","last_peered":"2023-10-06T03:26:10.286545+0000","last_clean":"2023-10-06T03:26:10.286545+0000","last_became_active":"2023-10-06T03:26:10.279299+0000","last_became_peered":"2023-10-06T03:26:10.279299+0000","last_unstale":"2023-10-06T03:26:10.286545+0000","last_undegraded":"2023-10-06T03:26:10.286545+0000","last_fullsized":"2023-10-06T03:26:10.286545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:35.527819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271992+0000","last_change":"2023-10-06T03:26:09.269594+0000","last_active":"2023-10-06T03:26:10.271992+0000","last_peered":"2023-10-06T03:26:10.271992+0000","last_clean":"2023-10-06T03:26:10.271992+0000","last_became_active":"2023-10-06T03:26:09.269372+0000","last_became_peered":"2023-10-06T03:26:09.269372+0000","last_unstale":"2023-10-06T03:26:10.271992+0000","last_undegraded":"2023-10-06T03:26:10.271992+0000","last_fullsized":"2023-10-06T03:26:10.271992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:07.827990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292304+0000","last_change":"2023-10-06T03:26:10.289118+0000","last_active":"2023-10-06T03:26:10.292304+0000","last_peered":"2023-10-06T03:26:10.292304+0000","last_clean":"2023-10-06T03:26:10.292304+0000","last_became_active":"2023-10-06T03:26:10.288760+0000","last_became_peered":"2023-10-06T03:26:10.288760+0000","last_unstale":"2023-10-06T03:26:10.292304+0000","last_undegraded":"2023-10-06T03:26:10.292304+0000","last_fullsized":"2023-10-06T03:26:10.292304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:08.877217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262151+0000","last_change":"2023-10-06T03:26:09.277881+0000","last_active":"2023-10-06T03:26:10.262151+0000","last_peered":"2023-10-06T03:26:10.262151+0000","last_clean":"2023-10-06T03:26:10.262151+0000","last_became_active":"2023-10-06T03:26:09.277073+0000","last_became_peered":"2023-10-06T03:26:09.277073+0000","last_unstale":"2023-10-06T03:26:10.262151+0000","last_undegraded":"2023-10-06T03:26:10.262151+0000","last_fullsized":"2023-10-06T03:26:10.262151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:25.080362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267404+0000","last_change":"2023-10-06T03:26:10.264115+0000","last_active":"2023-10-06T03:26:10.267404+0000","last_peered":"2023-10-06T03:26:10.267404+0000","last_clean":"2023-10-06T03:26:10.267404+0000","last_became_active":"2023-10-06T03:26:10.263790+0000","last_became_peered":"2023-10-06T03:26:10.263790+0000","last_unstale":"2023-10-06T03:26:10.267404+0000","last_undegraded":"2023-10-06T03:26:10.267404+0000","last_fullsized":"2023-10-06T03:26:10.267404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271830+0000","last_change":"2023-10-06T03:26:09.272395+0000","last_active":"2023-10-06T03:26:10.271830+0000","last_peered":"2023-10-06T03:26:10.271830+0000","last_clean":"2023-10-06T03:26:10.271830+0000","last_became_active":"2023-10-06T03:26:09.271834+0000","last_became_peered":"2023-10-06T03:26:09.271834+0000","last_unstale":"2023-10-06T03:26:10.271830+0000","last_undegraded":"2023-10-06T03:26:10.271830+0000","last_fullsized":"2023-10-06T03:26:10.271830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:24.807628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277457+0000","last_change":"2023-10-06T03:26:10.274551+0000","last_active":"2023-10-06T03:26:10.277457+0000","last_peered":"2023-10-06T03:26:10.277457+0000","last_clean":"2023-10-06T03:26:10.277457+0000","last_became_active":"2023-10-06T03:26:10.274250+0000","last_became_peered":"2023-10-06T03:26:10.274250+0000","last_unstale":"2023-10-06T03:26:10.277457+0000","last_undegraded":"2023-10-06T03:26:10.277457+0000","last_fullsized":"2023-10-06T03:26:10.277457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.063961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262375+0000","last_change":"2023-10-06T03:26:09.266484+0000","last_active":"2023-10-06T03:26:10.262375+0000","last_peered":"2023-10-06T03:26:10.262375+0000","last_clean":"2023-10-06T03:26:10.262375+0000","last_became_active":"2023-10-06T03:26:09.265895+0000","last_became_peered":"2023-10-06T03:26:09.265895+0000","last_unstale":"2023-10-06T03:26:10.262375+0000","last_undegraded":"2023-10-06T03:26:10.262375+0000","last_fullsized":"2023-10-06T03:26:10.262375+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:55.247430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.272404+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:26:10.272404+0000","last_peered":"2023-10-06T03:26:10.272404+0000","last_clean":"2023-10-06T03:26:10.272404+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:26:10.272404+0000","last_undegraded":"2023-10-06T03:26:10.272404+0000","last_fullsized":"2023-10-06T03:26:10.272404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282378+0000","last_change":"2023-10-06T03:26:10.274993+0000","last_active":"2023-10-06T03:26:10.282378+0000","last_peered":"2023-10-06T03:26:10.282378+0000","last_clean":"2023-10-06T03:26:10.282378+0000","last_became_active":"2023-10-06T03:26:10.273552+0000","last_became_peered":"2023-10-06T03:26:10.273552+0000","last_unstale":"2023-10-06T03:26:10.282378+0000","last_undegraded":"2023-10-06T03:26:10.282378+0000","last_fullsized":"2023-10-06T03:26:10.282378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:02.203946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.258204+0000","last_change":"2023-10-06T03:26:09.273820+0000","last_active":"2023-10-06T03:26:10.258204+0000","last_peered":"2023-10-06T03:26:10.258204+0000","last_clean":"2023-10-06T03:26:10.258204+0000","last_became_active":"2023-10-06T03:26:09.273557+0000","last_became_peered":"2023-10-06T03:26:09.273557+0000","last_unstale":"2023-10-06T03:26:10.258204+0000","last_undegraded":"2023-10-06T03:26:10.258204+0000","last_fullsized":"2023-10-06T03:26:10.258204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:00.402266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262759+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:26:10.262759+0000","last_peered":"2023-10-06T03:26:10.262759+0000","last_clean":"2023-10-06T03:26:10.262759+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:26:10.262759+0000","last_undegraded":"2023-10-06T03:26:10.262759+0000","last_fullsized":"2023-10-06T03:26:10.262759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273417+0000","last_change":"2023-10-06T03:26:10.264839+0000","last_active":"2023-10-06T03:26:10.273417+0000","last_peered":"2023-10-06T03:26:10.273417+0000","last_clean":"2023-10-06T03:26:10.273417+0000","last_became_active":"2023-10-06T03:26:10.264486+0000","last_became_peered":"2023-10-06T03:26:10.264486+0000","last_unstale":"2023-10-06T03:26:10.273417+0000","last_undegraded":"2023-10-06T03:26:10.273417+0000","last_fullsized":"2023-10-06T03:26:10.273417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:56.252304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292078+0000","last_change":"2023-10-06T03:26:09.277098+0000","last_active":"2023-10-06T03:26:10.292078+0000","last_peered":"2023-10-06T03:26:10.292078+0000","last_clean":"2023-10-06T03:26:10.292078+0000","last_became_active":"2023-10-06T03:26:09.276806+0000","last_became_peered":"2023-10-06T03:26:09.276806+0000","last_unstale":"2023-10-06T03:26:10.292078+0000","last_undegraded":"2023-10-06T03:26:10.292078+0000","last_fullsized":"2023-10-06T03:26:10.292078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:55.247430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273041+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:26:10.273041+0000","last_peered":"2023-10-06T03:26:10.273041+0000","last_clean":"2023-10-06T03:26:10.273041+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:26:10.273041+0000","last_undegraded":"2023-10-06T03:26:10.273041+0000","last_fullsized":"2023-10-06T03:26:10.273041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":217,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261049+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:26:10.261049+0000","last_peered":"2023-10-06T03:26:10.261049+0000","last_clean":"2023-10-06T03:26:10.261049+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:26:10.261049+0000","last_undegraded":"2023-10-06T03:26:10.261049+0000","last_fullsized":"2023-10-06T03:26:10.261049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276526+0000","last_change":"2023-10-06T03:26:10.272687+0000","last_active":"2023-10-06T03:26:10.276526+0000","last_peered":"2023-10-06T03:26:10.276526+0000","last_clean":"2023-10-06T03:26:10.276526+0000","last_became_active":"2023-10-06T03:26:10.272443+0000","last_became_peered":"2023-10-06T03:26:10.272443+0000","last_unstale":"2023-10-06T03:26:10.276526+0000","last_undegraded":"2023-10-06T03:26:10.276526+0000","last_fullsized":"2023-10-06T03:26:10.276526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282924+0000","last_change":"2023-10-06T03:26:09.279808+0000","last_active":"2023-10-06T03:26:10.282924+0000","last_peered":"2023-10-06T03:26:10.282924+0000","last_clean":"2023-10-06T03:26:10.282924+0000","last_became_active":"2023-10-06T03:26:09.279411+0000","last_became_peered":"2023-10-06T03:26:09.279411+0000","last_unstale":"2023-10-06T03:26:10.282924+0000","last_undegraded":"2023-10-06T03:26:10.282924+0000","last_fullsized":"2023-10-06T03:26:10.282924+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:02.694143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.260348+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:26:10.260348+0000","last_peered":"2023-10-06T03:26:10.260348+0000","last_clean":"2023-10-06T03:26:10.260348+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:26:10.260348+0000","last_undegraded":"2023-10-06T03:26:10.260348+0000","last_fullsized":"2023-10-06T03:26:10.260348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288455+0000","last_change":"2023-10-06T03:26:10.280327+0000","last_active":"2023-10-06T03:26:10.288455+0000","last_peered":"2023-10-06T03:26:10.288455+0000","last_clean":"2023-10-06T03:26:10.288455+0000","last_became_active":"2023-10-06T03:26:10.280026+0000","last_became_peered":"2023-10-06T03:26:10.280026+0000","last_unstale":"2023-10-06T03:26:10.288455+0000","last_undegraded":"2023-10-06T03:26:10.288455+0000","last_fullsized":"2023-10-06T03:26:10.288455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:02.203946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290273+0000","last_change":"2023-10-06T03:26:09.277164+0000","last_active":"2023-10-06T03:26:10.290273+0000","last_peered":"2023-10-06T03:26:10.290273+0000","last_clean":"2023-10-06T03:26:10.290273+0000","last_became_active":"2023-10-06T03:26:09.276901+0000","last_became_peered":"2023-10-06T03:26:09.276901+0000","last_unstale":"2023-10-06T03:26:10.290273+0000","last_undegraded":"2023-10-06T03:26:10.290273+0000","last_fullsized":"2023-10-06T03:26:10.290273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:00.081929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.260972+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:26:10.260972+0000","last_peered":"2023-10-06T03:26:10.260972+0000","last_clean":"2023-10-06T03:26:10.260972+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:26:10.260972+0000","last_undegraded":"2023-10-06T03:26:10.260972+0000","last_fullsized":"2023-10-06T03:26:10.260972+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283403+0000","last_change":"2023-10-06T03:26:10.275097+0000","last_active":"2023-10-06T03:26:10.283403+0000","last_peered":"2023-10-06T03:26:10.283403+0000","last_clean":"2023-10-06T03:26:10.283403+0000","last_became_active":"2023-10-06T03:26:10.274801+0000","last_became_peered":"2023-10-06T03:26:10.274801+0000","last_unstale":"2023-10-06T03:26:10.283403+0000","last_undegraded":"2023-10-06T03:26:10.283403+0000","last_fullsized":"2023-10-06T03:26:10.283403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:35.527819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.264876+0000","last_change":"2023-10-06T03:26:09.271613+0000","last_active":"2023-10-06T03:26:10.264876+0000","last_peered":"2023-10-06T03:26:10.264876+0000","last_clean":"2023-10-06T03:26:10.264876+0000","last_became_active":"2023-10-06T03:26:09.271419+0000","last_became_peered":"2023-10-06T03:26:09.271419+0000","last_unstale":"2023-10-06T03:26:10.264876+0000","last_undegraded":"2023-10-06T03:26:10.264876+0000","last_fullsized":"2023-10-06T03:26:10.264876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:22.883840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":54,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267532+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:26:10.267532+0000","last_peered":"2023-10-06T03:26:10.267532+0000","last_clean":"2023-10-06T03:26:10.267532+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:26:10.267532+0000","last_undegraded":"2023-10-06T03:26:10.267532+0000","last_fullsized":"2023-10-06T03:26:10.267532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286719+0000","last_change":"2023-10-06T03:26:10.282039+0000","last_active":"2023-10-06T03:26:10.286719+0000","last_peered":"2023-10-06T03:26:10.286719+0000","last_clean":"2023-10-06T03:26:10.286719+0000","last_became_active":"2023-10-06T03:26:10.281621+0000","last_became_peered":"2023-10-06T03:26:10.281621+0000","last_unstale":"2023-10-06T03:26:10.286719+0000","last_undegraded":"2023-10-06T03:26:10.286719+0000","last_fullsized":"2023-10-06T03:26:10.286719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:51.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286320+0000","last_change":"2023-10-06T03:26:09.272953+0000","last_active":"2023-10-06T03:26:10.286320+0000","last_peered":"2023-10-06T03:26:10.286320+0000","last_clean":"2023-10-06T03:26:10.286320+0000","last_became_active":"2023-10-06T03:26:09.272679+0000","last_became_peered":"2023-10-06T03:26:09.272679+0000","last_unstale":"2023-10-06T03:26:10.286320+0000","last_undegraded":"2023-10-06T03:26:10.286320+0000","last_fullsized":"2023-10-06T03:26:10.286320+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:36.025261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":53,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261941+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:26:10.261941+0000","last_peered":"2023-10-06T03:26:10.261941+0000","last_clean":"2023-10-06T03:26:10.261941+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:26:10.261941+0000","last_undegraded":"2023-10-06T03:26:10.261941+0000","last_fullsized":"2023-10-06T03:26:10.261941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277440+0000","last_change":"2023-10-06T03:26:10.276362+0000","last_active":"2023-10-06T03:26:10.277440+0000","last_peered":"2023-10-06T03:26:10.277440+0000","last_clean":"2023-10-06T03:26:10.277440+0000","last_became_active":"2023-10-06T03:26:10.276083+0000","last_became_peered":"2023-10-06T03:26:10.276083+0000","last_unstale":"2023-10-06T03:26:10.277440+0000","last_undegraded":"2023-10-06T03:26:10.277440+0000","last_fullsized":"2023-10-06T03:26:10.277440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:50.264024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.258579+0000","last_change":"2023-10-06T03:26:09.267273+0000","last_active":"2023-10-06T03:26:10.258579+0000","last_peered":"2023-10-06T03:26:10.258579+0000","last_clean":"2023-10-06T03:26:10.258579+0000","last_became_active":"2023-10-06T03:26:09.267016+0000","last_became_peered":"2023-10-06T03:26:09.267016+0000","last_unstale":"2023-10-06T03:26:10.258579+0000","last_undegraded":"2023-10-06T03:26:10.258579+0000","last_fullsized":"2023-10-06T03:26:10.258579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:20.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":53,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261777+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:26:10.261777+0000","last_peered":"2023-10-06T03:26:10.261777+0000","last_clean":"2023-10-06T03:26:10.261777+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:26:10.261777+0000","last_undegraded":"2023-10-06T03:26:10.261777+0000","last_fullsized":"2023-10-06T03:26:10.261777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298756,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073084,"statfs":{"total":96636764160,"available":96330838016,"internally_reserved":0,"allocated":1503232,"data_stored":1015699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69199999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.72999999999999998,"15min":0.76300000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66200000000000003,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.752,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67100000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81699999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73599999999999999,"5min":1.103,"15min":1.103},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81799999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.629}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.878,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":425927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.343,"15min":1.343},"last":0.36499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.329,"15min":1.329},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.76400000000000001,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80400000000000005,"15min":0.83999999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.042,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.80600000000000005,"15min":0.84199999999999997},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.81899999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.45800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39800000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.503},{"interface":"front","average":{"1min":0.63,"5min":0.626,"15min":0.625},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.49299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1015823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.38700000000000001,"15min":0.40300000000000002},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.38500000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.41199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.40600000000000003,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.44800000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.44600000000000001,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.41699999999999998,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.745,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80100000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.70899999999999996,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":423942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.435,"5min":12.19,"15min":12.19},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.64000000000000001,"15min":0.68799999999999994},"min":{"1min":0.28599999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46800000000000003,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.374}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50800000000000001,"5min":1.357,"15min":1.357},"last":0.246},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.309}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.92000000000000004,"15min":1.02},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.495,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.29099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.49099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.089,"15min":1.179},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":16.919,"15min":16.919},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.1000000000000001,"15min":1.1930000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79700000000000004,"5min":16.948,"15min":16.948},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67700000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.1140000000000001,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":16.881,"15min":16.881},"last":0.52000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298176,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073664,"statfs":{"total":96636764160,"available":96331431936,"internally_reserved":0,"allocated":909312,"data_stored":425815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33800000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.51500000000000001,"5min":0.62,"15min":0.62},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.48599999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.42799999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.311},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52100000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33600000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.376}]},{"osd":6,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.875,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.46100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":426797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.19700000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.25800000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32400000000000001,"15min":0.32600000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42699999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49199999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.311}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77100000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.42499999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75700000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.436}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.443},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46600000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.41199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":425261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2709999999999999,"5min":4.758,"15min":4.758},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.88700000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.88900000000000001,"15min":0.95299999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.873}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.499},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.75},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84399999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.94799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":426819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60699999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.64700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69399999999999995,"5min":0.999,"15min":0.999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68500000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73399999999999999,"5min":0.746,"15min":0.746},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":1.04,"15min":1.04},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.378,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":1.284,"15min":1.284},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:26:18.851 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:26:18.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.976+0000 7ff1e0f00700 1 Processor -- start 2023-10-06T03:26:18.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.976+0000 7ff1e0f00700 1 -- start start 2023-10-06T03:26:18.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1e0f00700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff1dc157080 0x7ff1dc0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:18.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1e0f00700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff1dc15b6a0 0x7ff1dc0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:18.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1e0f00700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1dc15b210 con 0x7ff1dc157450 2023-10-06T03:26:18.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1e0f00700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc0ce4f0 con 0x7ff1dc157080 2023-10-06T03:26:18.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1e0f00700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc0ce7d0 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1db7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff1dc157080 0x7ff1dc0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:18.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1db7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff1dc157080 0x7ff1dc0cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49542/0 (socket says 172.21.15.84:49542) 2023-10-06T03:26:18.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1db7fe700 1 -- 172.21.15.84:0/558972253 learned_addr learned my addr 172.21.15.84:0/558972253 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:18.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1db7fe700 1 -- 172.21.15.84:0/558972253 >> v2:172.21.15.131:3300/0 conn(0x7ff1dc15b6a0 msgr2=0x7ff1dc0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:18.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1dbfff700 1 --2- 172.21.15.84:0/558972253 >> v2:172.21.15.131:3300/0 conn(0x7ff1dc15b6a0 0x7ff1dc0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:18.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.977+0000 7ff1db7fe700 1 --2- 172.21.15.84:0/558972253 >> v2:172.21.15.131:3300/0 conn(0x7ff1dc15b6a0 0x7ff1dc0c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:18.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1db7fe700 1 -- 172.21.15.84:0/558972253 >> v1:172.21.15.131:6789/0 conn(0x7ff1dc157450 legacy=0x7ff1dc06d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:18.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1db7fe700 1 -- 172.21.15.84:0/558972253 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc15aea0 con 0x7ff1dc157080 2023-10-06T03:26:18.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1dbfff700 1 --2- 172.21.15.84:0/558972253 >> v2:172.21.15.131:3300/0 conn(0x7ff1dc15b6a0 0x7ff1dc0c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:18.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1db7fe700 1 --2- 172.21.15.84:0/558972253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc157080 0x7ff1dc0cdea0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0b1030 tx=0x7ff1cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c875f05e4c2ded5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:18.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1da7fc700 1 -- 172.21.15.84:0/558972253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc00e070 con 0x7ff1dc157080 2023-10-06T03:26:18.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1da7fc700 1 -- 172.21.15.84:0/558972253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc00ba10 con 0x7ff1dc157080 2023-10-06T03:26:18.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1da7fc700 1 -- 172.21.15.84:0/558972253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0092e0 con 0x7ff1dc157080 2023-10-06T03:26:18.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1e0f00700 1 -- 172.21.15.84:0/558972253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc157080 msgr2=0x7ff1dc0cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:18.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1e0f00700 1 --2- 172.21.15.84:0/558972253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc157080 0x7ff1dc0cdea0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0b1030 tx=0x7ff1cc009840 comp rx=0 tx=0).stop 2023-10-06T03:26:18.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1e0f00700 1 -- 172.21.15.84:0/558972253 shutdown_connections 2023-10-06T03:26:18.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1e0f00700 1 --2- 172.21.15.84:0/558972253 >> v2:172.21.15.131:3300/0 conn(0x7ff1dc15b6a0 0x7ff1dc0c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:18.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1e0f00700 1 --2- 172.21.15.84:0/558972253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc157080 0x7ff1dc0cdea0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:18.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1e0f00700 1 -- 172.21.15.84:0/558972253 >> 172.21.15.84:0/558972253 conn(0x7ff1dc06b540 msgr2=0x7ff1dc06b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:18.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.978+0000 7ff1e0f00700 1 -- 172.21.15.84:0/558972253 shutdown_connections 2023-10-06T03:26:18.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.979+0000 7ff1e0f00700 1 -- 172.21.15.84:0/558972253 wait complete. 2023-10-06T03:26:18.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.980+0000 7ff1e0f00700 1 Processor -- start 2023-10-06T03:26:18.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.980+0000 7ff1e0f00700 1 -- start start 2023-10-06T03:26:18.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.980+0000 7ff1e0f00700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1dc157080 0x7ff1dc153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:18.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.980+0000 7ff1e0f00700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1dc157450 0x7ff1dc0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:18.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.980+0000 7ff1e0f00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc15b6a0 0x7ff1dc1676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:18.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.980+0000 7ff1e0f00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc15a180 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.980+0000 7ff1e0f00700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc0c3410 con 0x7ff1dc157450 2023-10-06T03:26:18.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.980+0000 7ff1e0f00700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc142080 con 0x7ff1dc157080 2023-10-06T03:26:18.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1dbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc15b6a0 0x7ff1dc1676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:18.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1dbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc15b6a0 0x7ff1dc1676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49544/0 (socket says 172.21.15.84:49544) 2023-10-06T03:26:18.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1dbfff700 1 -- 172.21.15.84:0/3276417369 learned_addr learned my addr 172.21.15.84:0/3276417369 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:18.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1db7fe700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1dc157080 0x7ff1dc153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:18.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1daffd700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1dc157450 0x7ff1dc0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:18.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1dbfff700 1 -- 172.21.15.84:0/3276417369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1dc157080 msgr2=0x7ff1dc153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:18.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1dbfff700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1dc157080 0x7ff1dc153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:18.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1dbfff700 1 -- 172.21.15.84:0/3276417369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1dc157450 msgr2=0x7ff1dc0c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:18.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1dbfff700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1dc157450 0x7ff1dc0c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:18.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1dbfff700 1 -- 172.21.15.84:0/3276417369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc009ae0 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1db7fe700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1dc157080 0x7ff1dc153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:18.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1daffd700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1dc157450 0x7ff1dc0c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:18.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1dbfff700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc15b6a0 0x7ff1dc1676a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400c850 tx=0x7ff1d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:18.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1c37fe700 1 -- 172.21.15.84:0/3276417369 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4011600 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1c37fe700 1 -- 172.21.15.84:0/3276417369 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d4011760 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1e0f00700 1 -- 172.21.15.84:0/3276417369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1dc159850 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1c37fe700 1 -- 172.21.15.84:0/3276417369 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4011b20 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.981+0000 7ff1e0f00700 1 -- 172.21.15.84:0/3276417369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1dc159e10 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.982+0000 7ff1e0f00700 1 -- 172.21.15.84:0/3276417369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1dc05f270 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.983+0000 7ff1c37fe700 1 -- 172.21.15.84:0/3276417369 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1d4018350 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.983+0000 7ff1c37fe700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff1c8066f30 0x7ff1c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:18.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.983+0000 7ff1c37fe700 1 -- 172.21.15.84:0/3276417369 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff1d4084800 con 0x7ff1dc15b6a0 2023-10-06T03:26:18.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.983+0000 7ff1db7fe700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff1c8066f30 0x7ff1c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.983+0000 7ff1db7fe700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff1c8066f30 0x7ff1c80693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0caee0 tx=0x7ff1cc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:18.987+0000 7ff1c37fe700 1 -- 172.21.15.84:0/3276417369 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1d4055260 con 0x7ff1dc15b6a0 2023-10-06T03:26:19.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.167+0000 7ff1e0f00700 1 -- 172.21.15.84:0/3276417369 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1dc15a2c0 con 0x7ff1c8066f30 2023-10-06T03:26:19.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.175+0000 7ff1c37fe700 1 -- 172.21.15.84:0/3276417369 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311829 (secure 0 0 0) 0x7ff1dc15a2c0 con 0x7ff1c8066f30 2023-10-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 -- 172.21.15.84:0/3276417369 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff1c8066f30 msgr2=0x7ff1c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff1c8066f30 0x7ff1c80693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0caee0 tx=0x7ff1cc017000 comp rx=0 tx=0).stop 2023-10-06T03:26:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 -- 172.21.15.84:0/3276417369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc15b6a0 msgr2=0x7ff1dc1676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc15b6a0 0x7ff1dc1676a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400c850 tx=0x7ff1d4008040 comp rx=0 tx=0).stop 2023-10-06T03:26:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 -- 172.21.15.84:0/3276417369 shutdown_connections 2023-10-06T03:26:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff1c8066f30 0x7ff1c80693e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1dc15b6a0 0x7ff1dc1676a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1dc157080 0x7ff1dc153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 --2- 172.21.15.84:0/3276417369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1dc157450 0x7ff1dc0c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 -- 172.21.15.84:0/3276417369 >> 172.21.15.84:0/3276417369 conn(0x7ff1dc06b540 msgr2=0x7ff1dc0b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 -- 172.21.15.84:0/3276417369 shutdown_connections 2023-10-06T03:26:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.179+0000 7ff1e0f00700 1 -- 172.21.15.84:0/3276417369 wait complete. 2023-10-06T03:26:19.187 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:26:19.192 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2023-10-06T03:26:19.071150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386596,"kb_used_data":8292,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588124,"statfs":{"total":773094113280,"available":770650238976,"internally_reserved":0,"allocated":8491008,"data_stored":4586083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.814282"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.287076+0000","last_change":"2023-10-06T03:26:10.281003+0000","last_active":"2023-10-06T03:26:10.287076+0000","last_peered":"2023-10-06T03:26:10.287076+0000","last_clean":"2023-10-06T03:26:10.287076+0000","last_became_active":"2023-10-06T03:26:10.280754+0000","last_became_peered":"2023-10-06T03:26:10.280754+0000","last_unstale":"2023-10-06T03:26:10.287076+0000","last_undegraded":"2023-10-06T03:26:10.287076+0000","last_fullsized":"2023-10-06T03:26:10.287076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:23.888714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290649+0000","last_change":"2023-10-06T03:26:10.288789+0000","last_active":"2023-10-06T03:26:10.290649+0000","last_peered":"2023-10-06T03:26:10.290649+0000","last_clean":"2023-10-06T03:26:10.290649+0000","last_became_active":"2023-10-06T03:26:10.288490+0000","last_became_peered":"2023-10-06T03:26:10.288490+0000","last_unstale":"2023-10-06T03:26:10.290649+0000","last_undegraded":"2023-10-06T03:26:10.290649+0000","last_fullsized":"2023-10-06T03:26:10.290649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:26.085236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271421+0000","last_change":"2023-10-06T03:26:10.265089+0000","last_active":"2023-10-06T03:26:10.271421+0000","last_peered":"2023-10-06T03:26:10.271421+0000","last_clean":"2023-10-06T03:26:10.271421+0000","last_became_active":"2023-10-06T03:26:10.264799+0000","last_became_peered":"2023-10-06T03:26:10.264799+0000","last_unstale":"2023-10-06T03:26:10.271421+0000","last_undegraded":"2023-10-06T03:26:10.271421+0000","last_fullsized":"2023-10-06T03:26:10.271421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:40.805767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282199+0000","last_change":"2023-10-06T03:26:10.274603+0000","last_active":"2023-10-06T03:26:10.282199+0000","last_peered":"2023-10-06T03:26:10.282199+0000","last_clean":"2023-10-06T03:26:10.282199+0000","last_became_active":"2023-10-06T03:26:10.274368+0000","last_became_peered":"2023-10-06T03:26:10.274368+0000","last_unstale":"2023-10-06T03:26:10.282199+0000","last_undegraded":"2023-10-06T03:26:10.282199+0000","last_fullsized":"2023-10-06T03:26:10.282199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:22.065858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283357+0000","last_change":"2023-10-06T03:26:10.275726+0000","last_active":"2023-10-06T03:26:10.283357+0000","last_peered":"2023-10-06T03:26:10.283357+0000","last_clean":"2023-10-06T03:26:10.283357+0000","last_became_active":"2023-10-06T03:26:10.275453+0000","last_became_peered":"2023-10-06T03:26:10.275453+0000","last_unstale":"2023-10-06T03:26:10.283357+0000","last_undegraded":"2023-10-06T03:26:10.283357+0000","last_fullsized":"2023-10-06T03:26:10.283357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:27.364662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282010+0000","last_change":"2023-10-06T03:26:10.278848+0000","last_active":"2023-10-06T03:26:10.282010+0000","last_peered":"2023-10-06T03:26:10.282010+0000","last_clean":"2023-10-06T03:26:10.282010+0000","last_became_active":"2023-10-06T03:26:10.278604+0000","last_became_peered":"2023-10-06T03:26:10.278604+0000","last_unstale":"2023-10-06T03:26:10.282010+0000","last_undegraded":"2023-10-06T03:26:10.282010+0000","last_fullsized":"2023-10-06T03:26:10.282010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:57.583036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.269336+0000","last_change":"2023-10-06T03:26:10.264610+0000","last_active":"2023-10-06T03:26:10.269336+0000","last_peered":"2023-10-06T03:26:10.269336+0000","last_clean":"2023-10-06T03:26:10.269336+0000","last_became_active":"2023-10-06T03:26:10.264360+0000","last_became_peered":"2023-10-06T03:26:10.264360+0000","last_unstale":"2023-10-06T03:26:10.269336+0000","last_undegraded":"2023-10-06T03:26:10.269336+0000","last_fullsized":"2023-10-06T03:26:10.269336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:44.966408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.294483+0000","last_change":"2023-10-06T03:26:10.289416+0000","last_active":"2023-10-06T03:26:10.294483+0000","last_peered":"2023-10-06T03:26:10.294483+0000","last_clean":"2023-10-06T03:26:10.294483+0000","last_became_active":"2023-10-06T03:26:10.289136+0000","last_became_peered":"2023-10-06T03:26:10.289136+0000","last_unstale":"2023-10-06T03:26:10.294483+0000","last_undegraded":"2023-10-06T03:26:10.294483+0000","last_fullsized":"2023-10-06T03:26:10.294483+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:26.684095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277565+0000","last_change":"2023-10-06T03:26:10.274574+0000","last_active":"2023-10-06T03:26:10.277565+0000","last_peered":"2023-10-06T03:26:10.277565+0000","last_clean":"2023-10-06T03:26:10.277565+0000","last_became_active":"2023-10-06T03:26:10.274274+0000","last_became_peered":"2023-10-06T03:26:10.274274+0000","last_unstale":"2023-10-06T03:26:10.277565+0000","last_undegraded":"2023-10-06T03:26:10.277565+0000","last_fullsized":"2023-10-06T03:26:10.277565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276705+0000","last_change":"2023-10-06T03:26:10.266900+0000","last_active":"2023-10-06T03:26:10.276705+0000","last_peered":"2023-10-06T03:26:10.276705+0000","last_clean":"2023-10-06T03:26:10.276705+0000","last_became_active":"2023-10-06T03:26:10.266662+0000","last_became_peered":"2023-10-06T03:26:10.266662+0000","last_unstale":"2023-10-06T03:26:10.276705+0000","last_undegraded":"2023-10-06T03:26:10.276705+0000","last_fullsized":"2023-10-06T03:26:10.276705+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:15.923231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288219+0000","last_change":"2023-10-06T03:26:10.276484+0000","last_active":"2023-10-06T03:26:10.288219+0000","last_peered":"2023-10-06T03:26:10.288219+0000","last_clean":"2023-10-06T03:26:10.288219+0000","last_became_active":"2023-10-06T03:26:10.276132+0000","last_became_peered":"2023-10-06T03:26:10.276132+0000","last_unstale":"2023-10-06T03:26:10.288219+0000","last_undegraded":"2023-10-06T03:26:10.288219+0000","last_fullsized":"2023-10-06T03:26:10.288219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:23.660405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276817+0000","last_change":"2023-10-06T03:26:10.272898+0000","last_active":"2023-10-06T03:26:10.276817+0000","last_peered":"2023-10-06T03:26:10.276817+0000","last_clean":"2023-10-06T03:26:10.276817+0000","last_became_active":"2023-10-06T03:26:10.272265+0000","last_became_peered":"2023-10-06T03:26:10.272265+0000","last_unstale":"2023-10-06T03:26:10.276817+0000","last_undegraded":"2023-10-06T03:26:10.276817+0000","last_fullsized":"2023-10-06T03:26:10.276817+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:08.832863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.287197+0000","last_change":"2023-10-06T03:26:10.283921+0000","last_active":"2023-10-06T03:26:10.287197+0000","last_peered":"2023-10-06T03:26:10.287197+0000","last_clean":"2023-10-06T03:26:10.287197+0000","last_became_active":"2023-10-06T03:26:10.283622+0000","last_became_peered":"2023-10-06T03:26:10.283622+0000","last_unstale":"2023-10-06T03:26:10.287197+0000","last_undegraded":"2023-10-06T03:26:10.287197+0000","last_fullsized":"2023-10-06T03:26:10.287197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:37.030135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286698+0000","last_change":"2023-10-06T03:26:10.281874+0000","last_active":"2023-10-06T03:26:10.286698+0000","last_peered":"2023-10-06T03:26:10.286698+0000","last_clean":"2023-10-06T03:26:10.286698+0000","last_became_active":"2023-10-06T03:26:10.281250+0000","last_became_peered":"2023-10-06T03:26:10.281250+0000","last_unstale":"2023-10-06T03:26:10.286698+0000","last_undegraded":"2023-10-06T03:26:10.286698+0000","last_fullsized":"2023-10-06T03:26:10.286698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:06.471008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.278244+0000","last_change":"2023-10-06T03:26:10.271762+0000","last_active":"2023-10-06T03:26:10.278244+0000","last_peered":"2023-10-06T03:26:10.278244+0000","last_clean":"2023-10-06T03:26:10.278244+0000","last_became_active":"2023-10-06T03:26:10.271203+0000","last_became_peered":"2023-10-06T03:26:10.271203+0000","last_unstale":"2023-10-06T03:26:10.278244+0000","last_undegraded":"2023-10-06T03:26:10.278244+0000","last_fullsized":"2023-10-06T03:26:10.278244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:53.115726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.284319+0000","last_change":"2023-10-06T03:26:10.278721+0000","last_active":"2023-10-06T03:26:10.284319+0000","last_peered":"2023-10-06T03:26:10.284319+0000","last_clean":"2023-10-06T03:26:10.284319+0000","last_became_active":"2023-10-06T03:26:10.278415+0000","last_became_peered":"2023-10-06T03:26:10.278415+0000","last_unstale":"2023-10-06T03:26:10.284319+0000","last_undegraded":"2023-10-06T03:26:10.284319+0000","last_fullsized":"2023-10-06T03:26:10.284319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:56.263137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.284355+0000","last_change":"2023-10-06T03:26:10.278917+0000","last_active":"2023-10-06T03:26:10.284355+0000","last_peered":"2023-10-06T03:26:10.284355+0000","last_clean":"2023-10-06T03:26:10.284355+0000","last_became_active":"2023-10-06T03:26:10.278646+0000","last_became_peered":"2023-10-06T03:26:10.278646+0000","last_unstale":"2023-10-06T03:26:10.284355+0000","last_undegraded":"2023-10-06T03:26:10.284355+0000","last_fullsized":"2023-10-06T03:26:10.284355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.091395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.269176+0000","last_change":"2023-10-06T03:26:10.264466+0000","last_active":"2023-10-06T03:26:10.269176+0000","last_peered":"2023-10-06T03:26:10.269176+0000","last_clean":"2023-10-06T03:26:10.269176+0000","last_became_active":"2023-10-06T03:26:10.264162+0000","last_became_peered":"2023-10-06T03:26:10.264162+0000","last_unstale":"2023-10-06T03:26:10.269176+0000","last_undegraded":"2023-10-06T03:26:10.269176+0000","last_fullsized":"2023-10-06T03:26:10.269176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:23.246504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273374+0000","last_change":"2023-10-06T03:26:10.270773+0000","last_active":"2023-10-06T03:26:10.273374+0000","last_peered":"2023-10-06T03:26:10.273374+0000","last_clean":"2023-10-06T03:26:10.273374+0000","last_became_active":"2023-10-06T03:26:10.270519+0000","last_became_peered":"2023-10-06T03:26:10.270519+0000","last_unstale":"2023-10-06T03:26:10.273374+0000","last_undegraded":"2023-10-06T03:26:10.273374+0000","last_fullsized":"2023-10-06T03:26:10.273374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:54.381978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.281789+0000","last_change":"2023-10-06T03:26:10.269887+0000","last_active":"2023-10-06T03:26:10.281789+0000","last_peered":"2023-10-06T03:26:10.281789+0000","last_clean":"2023-10-06T03:26:10.281789+0000","last_became_active":"2023-10-06T03:26:10.269397+0000","last_became_peered":"2023-10-06T03:26:10.269397+0000","last_unstale":"2023-10-06T03:26:10.281789+0000","last_undegraded":"2023-10-06T03:26:10.281789+0000","last_fullsized":"2023-10-06T03:26:10.281789+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:48.998501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.281751+0000","last_change":"2023-10-06T03:26:10.273079+0000","last_active":"2023-10-06T03:26:10.281751+0000","last_peered":"2023-10-06T03:26:10.281751+0000","last_clean":"2023-10-06T03:26:10.281751+0000","last_became_active":"2023-10-06T03:26:10.272822+0000","last_became_peered":"2023-10-06T03:26:10.272822+0000","last_unstale":"2023-10-06T03:26:10.281751+0000","last_undegraded":"2023-10-06T03:26:10.281751+0000","last_fullsized":"2023-10-06T03:26:10.281751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:22.093208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288661+0000","last_change":"2023-10-06T03:26:10.280816+0000","last_active":"2023-10-06T03:26:10.288661+0000","last_peered":"2023-10-06T03:26:10.288661+0000","last_clean":"2023-10-06T03:26:10.288661+0000","last_became_active":"2023-10-06T03:26:10.280318+0000","last_became_peered":"2023-10-06T03:26:10.280318+0000","last_unstale":"2023-10-06T03:26:10.288661+0000","last_undegraded":"2023-10-06T03:26:10.288661+0000","last_fullsized":"2023-10-06T03:26:10.288661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:44.966408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276799+0000","last_change":"2023-10-06T03:26:10.272038+0000","last_active":"2023-10-06T03:26:10.276799+0000","last_peered":"2023-10-06T03:26:10.276799+0000","last_clean":"2023-10-06T03:26:10.276799+0000","last_became_active":"2023-10-06T03:26:10.269075+0000","last_became_peered":"2023-10-06T03:26:10.269075+0000","last_unstale":"2023-10-06T03:26:10.276799+0000","last_undegraded":"2023-10-06T03:26:10.276799+0000","last_fullsized":"2023-10-06T03:26:10.276799+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:47.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282363+0000","last_change":"2023-10-06T03:26:10.274678+0000","last_active":"2023-10-06T03:26:10.282363+0000","last_peered":"2023-10-06T03:26:10.282363+0000","last_clean":"2023-10-06T03:26:10.282363+0000","last_became_active":"2023-10-06T03:26:10.274409+0000","last_became_peered":"2023-10-06T03:26:10.274409+0000","last_unstale":"2023-10-06T03:26:10.282363+0000","last_undegraded":"2023-10-06T03:26:10.282363+0000","last_fullsized":"2023-10-06T03:26:10.282363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:38.350999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.289382+0000","last_change":"2023-10-06T03:26:10.283714+0000","last_active":"2023-10-06T03:26:10.289382+0000","last_peered":"2023-10-06T03:26:10.289382+0000","last_clean":"2023-10-06T03:26:10.289382+0000","last_became_active":"2023-10-06T03:26:10.283184+0000","last_became_peered":"2023-10-06T03:26:10.283184+0000","last_unstale":"2023-10-06T03:26:10.289382+0000","last_undegraded":"2023-10-06T03:26:10.289382+0000","last_fullsized":"2023-10-06T03:26:10.289382+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:35.682913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292296+0000","last_change":"2023-10-06T03:26:10.289063+0000","last_active":"2023-10-06T03:26:10.292296+0000","last_peered":"2023-10-06T03:26:10.292296+0000","last_clean":"2023-10-06T03:26:10.292296+0000","last_became_active":"2023-10-06T03:26:10.288750+0000","last_became_peered":"2023-10-06T03:26:10.288750+0000","last_unstale":"2023-10-06T03:26:10.292296+0000","last_undegraded":"2023-10-06T03:26:10.292296+0000","last_fullsized":"2023-10-06T03:26:10.292296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:56.252304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.284488+0000","last_change":"2023-10-06T03:26:10.280841+0000","last_active":"2023-10-06T03:26:10.284488+0000","last_peered":"2023-10-06T03:26:10.284488+0000","last_clean":"2023-10-06T03:26:10.284488+0000","last_became_active":"2023-10-06T03:26:10.280547+0000","last_became_peered":"2023-10-06T03:26:10.280547+0000","last_unstale":"2023-10-06T03:26:10.284488+0000","last_undegraded":"2023-10-06T03:26:10.284488+0000","last_fullsized":"2023-10-06T03:26:10.284488+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:54.381978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276833+0000","last_change":"2023-10-06T03:26:10.273081+0000","last_active":"2023-10-06T03:26:10.276833+0000","last_peered":"2023-10-06T03:26:10.276833+0000","last_clean":"2023-10-06T03:26:10.276833+0000","last_became_active":"2023-10-06T03:26:10.272613+0000","last_became_peered":"2023-10-06T03:26:10.272613+0000","last_unstale":"2023-10-06T03:26:10.276833+0000","last_undegraded":"2023-10-06T03:26:10.276833+0000","last_fullsized":"2023-10-06T03:26:10.276833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:08.877217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288551+0000","last_change":"2023-10-06T03:26:10.280335+0000","last_active":"2023-10-06T03:26:10.288551+0000","last_peered":"2023-10-06T03:26:10.288551+0000","last_clean":"2023-10-06T03:26:10.288551+0000","last_became_active":"2023-10-06T03:26:10.280015+0000","last_became_peered":"2023-10-06T03:26:10.280015+0000","last_unstale":"2023-10-06T03:26:10.288551+0000","last_undegraded":"2023-10-06T03:26:10.288551+0000","last_fullsized":"2023-10-06T03:26:10.288551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:13.025592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290452+0000","last_change":"2023-10-06T03:26:10.284367+0000","last_active":"2023-10-06T03:26:10.290452+0000","last_peered":"2023-10-06T03:26:10.290452+0000","last_clean":"2023-10-06T03:26:10.290452+0000","last_became_active":"2023-10-06T03:26:10.284121+0000","last_became_peered":"2023-10-06T03:26:10.284121+0000","last_unstale":"2023-10-06T03:26:10.290452+0000","last_undegraded":"2023-10-06T03:26:10.290452+0000","last_fullsized":"2023-10-06T03:26:10.290452+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:58.156565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283287+0000","last_change":"2023-10-06T03:26:10.274398+0000","last_active":"2023-10-06T03:26:10.283287+0000","last_peered":"2023-10-06T03:26:10.283287+0000","last_clean":"2023-10-06T03:26:10.283287+0000","last_became_active":"2023-10-06T03:26:10.274113+0000","last_became_peered":"2023-10-06T03:26:10.274113+0000","last_unstale":"2023-10-06T03:26:10.283287+0000","last_undegraded":"2023-10-06T03:26:10.283287+0000","last_fullsized":"2023-10-06T03:26:10.283287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:14.412629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292222+0000","last_change":"2023-10-06T03:26:10.289705+0000","last_active":"2023-10-06T03:26:10.292222+0000","last_peered":"2023-10-06T03:26:10.292222+0000","last_clean":"2023-10-06T03:26:10.292222+0000","last_became_active":"2023-10-06T03:26:10.289389+0000","last_became_peered":"2023-10-06T03:26:10.289389+0000","last_unstale":"2023-10-06T03:26:10.292222+0000","last_undegraded":"2023-10-06T03:26:10.292222+0000","last_fullsized":"2023-10-06T03:26:10.292222+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:37.030135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.284424+0000","last_change":"2023-10-06T03:26:10.279643+0000","last_active":"2023-10-06T03:26:10.284424+0000","last_peered":"2023-10-06T03:26:10.284424+0000","last_clean":"2023-10-06T03:26:10.284424+0000","last_became_active":"2023-10-06T03:26:10.279137+0000","last_became_peered":"2023-10-06T03:26:10.279137+0000","last_unstale":"2023-10-06T03:26:10.284424+0000","last_undegraded":"2023-10-06T03:26:10.284424+0000","last_fullsized":"2023-10-06T03:26:10.284424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:04.105480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"73'4","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.285555+0000","last_change":"2023-10-06T03:26:09.277402+0000","last_active":"2023-10-06T03:26:10.285555+0000","last_peered":"2023-10-06T03:26:10.285555+0000","last_clean":"2023-10-06T03:26:10.285555+0000","last_became_active":"2023-10-06T03:26:09.277183+0000","last_became_peered":"2023-10-06T03:26:09.277183+0000","last_unstale":"2023-10-06T03:26:10.285555+0000","last_undegraded":"2023-10-06T03:26:10.285555+0000","last_fullsized":"2023-10-06T03:26:10.285555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:34.678039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273436+0000","last_change":"2023-10-06T03:26:10.264996+0000","last_active":"2023-10-06T03:26:10.273436+0000","last_peered":"2023-10-06T03:26:10.273436+0000","last_clean":"2023-10-06T03:26:10.273436+0000","last_became_active":"2023-10-06T03:26:10.264754+0000","last_became_peered":"2023-10-06T03:26:10.264754+0000","last_unstale":"2023-10-06T03:26:10.273436+0000","last_undegraded":"2023-10-06T03:26:10.273436+0000","last_fullsized":"2023-10-06T03:26:10.273436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:40.805767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288617+0000","last_change":"2023-10-06T03:26:09.282813+0000","last_active":"2023-10-06T03:26:10.288617+0000","last_peered":"2023-10-06T03:26:10.288617+0000","last_clean":"2023-10-06T03:26:10.288617+0000","last_became_active":"2023-10-06T03:26:09.282590+0000","last_became_peered":"2023-10-06T03:26:09.282590+0000","last_unstale":"2023-10-06T03:26:10.288617+0000","last_undegraded":"2023-10-06T03:26:10.288617+0000","last_fullsized":"2023-10-06T03:26:10.288617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:43.544478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292201+0000","last_change":"2023-10-06T03:26:10.289564+0000","last_active":"2023-10-06T03:26:10.292201+0000","last_peered":"2023-10-06T03:26:10.292201+0000","last_clean":"2023-10-06T03:26:10.292201+0000","last_became_active":"2023-10-06T03:26:10.289243+0000","last_became_peered":"2023-10-06T03:26:10.289243+0000","last_unstale":"2023-10-06T03:26:10.292201+0000","last_undegraded":"2023-10-06T03:26:10.292201+0000","last_fullsized":"2023-10-06T03:26:10.292201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:33.455977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292535+0000","last_change":"2023-10-06T03:26:09.269371+0000","last_active":"2023-10-06T03:26:10.292535+0000","last_peered":"2023-10-06T03:26:10.292535+0000","last_clean":"2023-10-06T03:26:10.292535+0000","last_became_active":"2023-10-06T03:26:09.269122+0000","last_became_peered":"2023-10-06T03:26:09.269122+0000","last_unstale":"2023-10-06T03:26:10.292535+0000","last_undegraded":"2023-10-06T03:26:10.292535+0000","last_fullsized":"2023-10-06T03:26:10.292535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:07.872343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.270673+0000","last_change":"2023-10-06T03:26:10.263185+0000","last_active":"2023-10-06T03:26:10.270673+0000","last_peered":"2023-10-06T03:26:10.270673+0000","last_clean":"2023-10-06T03:26:10.270673+0000","last_became_active":"2023-10-06T03:26:10.262810+0000","last_became_peered":"2023-10-06T03:26:10.262810+0000","last_unstale":"2023-10-06T03:26:10.270673+0000","last_undegraded":"2023-10-06T03:26:10.270673+0000","last_fullsized":"2023-10-06T03:26:10.270673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:23.033550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291255+0000","last_change":"2023-10-06T03:26:09.269129+0000","last_active":"2023-10-06T03:26:10.291255+0000","last_peered":"2023-10-06T03:26:10.291255+0000","last_clean":"2023-10-06T03:26:10.291255+0000","last_became_active":"2023-10-06T03:26:09.268855+0000","last_became_peered":"2023-10-06T03:26:09.268855+0000","last_unstale":"2023-10-06T03:26:10.291255+0000","last_undegraded":"2023-10-06T03:26:10.291255+0000","last_fullsized":"2023-10-06T03:26:10.291255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:46.861569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291508+0000","last_change":"2023-10-06T03:26:10.289206+0000","last_active":"2023-10-06T03:26:10.291508+0000","last_peered":"2023-10-06T03:26:10.291508+0000","last_clean":"2023-10-06T03:26:10.291508+0000","last_became_active":"2023-10-06T03:26:10.288939+0000","last_became_peered":"2023-10-06T03:26:10.288939+0000","last_unstale":"2023-10-06T03:26:10.291508+0000","last_undegraded":"2023-10-06T03:26:10.291508+0000","last_fullsized":"2023-10-06T03:26:10.291508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:56.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290276+0000","last_change":"2023-10-06T03:26:09.272337+0000","last_active":"2023-10-06T03:26:10.290276+0000","last_peered":"2023-10-06T03:26:10.290276+0000","last_clean":"2023-10-06T03:26:10.290276+0000","last_became_active":"2023-10-06T03:26:09.272079+0000","last_became_peered":"2023-10-06T03:26:09.272079+0000","last_unstale":"2023-10-06T03:26:10.290276+0000","last_undegraded":"2023-10-06T03:26:10.290276+0000","last_fullsized":"2023-10-06T03:26:10.290276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:22.028676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283238+0000","last_change":"2023-10-06T03:26:10.271411+0000","last_active":"2023-10-06T03:26:10.283238+0000","last_peered":"2023-10-06T03:26:10.283238+0000","last_clean":"2023-10-06T03:26:10.283238+0000","last_became_active":"2023-10-06T03:26:10.271147+0000","last_became_peered":"2023-10-06T03:26:10.271147+0000","last_unstale":"2023-10-06T03:26:10.283238+0000","last_undegraded":"2023-10-06T03:26:10.283238+0000","last_fullsized":"2023-10-06T03:26:10.283238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:01.260563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288598+0000","last_change":"2023-10-06T03:26:09.276337+0000","last_active":"2023-10-06T03:26:10.288598+0000","last_peered":"2023-10-06T03:26:10.288598+0000","last_clean":"2023-10-06T03:26:10.288598+0000","last_became_active":"2023-10-06T03:26:09.276068+0000","last_became_peered":"2023-10-06T03:26:09.276068+0000","last_unstale":"2023-10-06T03:26:10.288598+0000","last_undegraded":"2023-10-06T03:26:10.288598+0000","last_fullsized":"2023-10-06T03:26:10.288598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:14.918357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277460+0000","last_change":"2023-10-06T03:26:10.275173+0000","last_active":"2023-10-06T03:26:10.277460+0000","last_peered":"2023-10-06T03:26:10.277460+0000","last_clean":"2023-10-06T03:26:10.277460+0000","last_became_active":"2023-10-06T03:26:10.274909+0000","last_became_peered":"2023-10-06T03:26:10.274909+0000","last_unstale":"2023-10-06T03:26:10.277460+0000","last_undegraded":"2023-10-06T03:26:10.277460+0000","last_fullsized":"2023-10-06T03:26:10.277460+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:33.455977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.264130+0000","last_change":"2023-10-06T03:26:09.271505+0000","last_active":"2023-10-06T03:26:10.264130+0000","last_peered":"2023-10-06T03:26:10.264130+0000","last_clean":"2023-10-06T03:26:10.264130+0000","last_became_active":"2023-10-06T03:26:09.271223+0000","last_became_peered":"2023-10-06T03:26:09.271223+0000","last_unstale":"2023-10-06T03:26:10.264130+0000","last_undegraded":"2023-10-06T03:26:10.264130+0000","last_fullsized":"2023-10-06T03:26:10.264130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:56.636169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.278265+0000","last_change":"2023-10-06T03:26:10.271929+0000","last_active":"2023-10-06T03:26:10.278265+0000","last_peered":"2023-10-06T03:26:10.278265+0000","last_clean":"2023-10-06T03:26:10.278265+0000","last_became_active":"2023-10-06T03:26:10.271522+0000","last_became_peered":"2023-10-06T03:26:10.271522+0000","last_unstale":"2023-10-06T03:26:10.278265+0000","last_undegraded":"2023-10-06T03:26:10.278265+0000","last_fullsized":"2023-10-06T03:26:10.278265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:59.932901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276708+0000","last_change":"2023-10-06T03:26:09.270274+0000","last_active":"2023-10-06T03:26:10.276708+0000","last_peered":"2023-10-06T03:26:10.276708+0000","last_clean":"2023-10-06T03:26:10.276708+0000","last_became_active":"2023-10-06T03:26:09.270010+0000","last_became_peered":"2023-10-06T03:26:09.270010+0000","last_unstale":"2023-10-06T03:26:10.276708+0000","last_undegraded":"2023-10-06T03:26:10.276708+0000","last_fullsized":"2023-10-06T03:26:10.276708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:15.677167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290516+0000","last_change":"2023-10-06T03:26:10.289563+0000","last_active":"2023-10-06T03:26:10.290516+0000","last_peered":"2023-10-06T03:26:10.290516+0000","last_clean":"2023-10-06T03:26:10.290516+0000","last_became_active":"2023-10-06T03:26:10.289315+0000","last_became_peered":"2023-10-06T03:26:10.289315+0000","last_unstale":"2023-10-06T03:26:10.290516+0000","last_undegraded":"2023-10-06T03:26:10.290516+0000","last_fullsized":"2023-10-06T03:26:10.290516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:30.978969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261889+0000","last_change":"2023-10-06T03:26:09.281300+0000","last_active":"2023-10-06T03:26:10.261889+0000","last_peered":"2023-10-06T03:26:10.261889+0000","last_clean":"2023-10-06T03:26:10.261889+0000","last_became_active":"2023-10-06T03:26:09.281106+0000","last_became_peered":"2023-10-06T03:26:09.281106+0000","last_unstale":"2023-10-06T03:26:10.261889+0000","last_undegraded":"2023-10-06T03:26:10.261889+0000","last_fullsized":"2023-10-06T03:26:10.261889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:27.760245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282111+0000","last_change":"2023-10-06T03:26:10.279524+0000","last_active":"2023-10-06T03:26:10.282111+0000","last_peered":"2023-10-06T03:26:10.282111+0000","last_clean":"2023-10-06T03:26:10.282111+0000","last_became_active":"2023-10-06T03:26:10.279224+0000","last_became_peered":"2023-10-06T03:26:10.279224+0000","last_unstale":"2023-10-06T03:26:10.282111+0000","last_undegraded":"2023-10-06T03:26:10.282111+0000","last_fullsized":"2023-10-06T03:26:10.282111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:36.078198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261850+0000","last_change":"2023-10-06T03:26:09.278880+0000","last_active":"2023-10-06T03:26:10.261850+0000","last_peered":"2023-10-06T03:26:10.261850+0000","last_clean":"2023-10-06T03:26:10.261850+0000","last_became_active":"2023-10-06T03:26:09.278612+0000","last_became_peered":"2023-10-06T03:26:09.278612+0000","last_unstale":"2023-10-06T03:26:10.261850+0000","last_undegraded":"2023-10-06T03:26:10.261850+0000","last_fullsized":"2023-10-06T03:26:10.261850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:22.655531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271246+0000","last_change":"2023-10-06T03:26:10.265712+0000","last_active":"2023-10-06T03:26:10.271246+0000","last_peered":"2023-10-06T03:26:10.271246+0000","last_clean":"2023-10-06T03:26:10.271246+0000","last_became_active":"2023-10-06T03:26:10.265480+0000","last_became_peered":"2023-10-06T03:26:10.265480+0000","last_unstale":"2023-10-06T03:26:10.271246+0000","last_undegraded":"2023-10-06T03:26:10.271246+0000","last_fullsized":"2023-10-06T03:26:10.271246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:56.263137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"73'3","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291694+0000","last_change":"2023-10-06T03:26:09.279911+0000","last_active":"2023-10-06T03:26:10.291694+0000","last_peered":"2023-10-06T03:26:10.291694+0000","last_clean":"2023-10-06T03:26:10.291694+0000","last_became_active":"2023-10-06T03:26:09.279622+0000","last_became_peered":"2023-10-06T03:26:09.279622+0000","last_unstale":"2023-10-06T03:26:10.291694+0000","last_undegraded":"2023-10-06T03:26:10.291694+0000","last_fullsized":"2023-10-06T03:26:10.291694+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:47.061356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283387+0000","last_change":"2023-10-06T03:26:10.274962+0000","last_active":"2023-10-06T03:26:10.283387+0000","last_peered":"2023-10-06T03:26:10.283387+0000","last_clean":"2023-10-06T03:26:10.283387+0000","last_became_active":"2023-10-06T03:26:10.274474+0000","last_became_peered":"2023-10-06T03:26:10.274474+0000","last_unstale":"2023-10-06T03:26:10.283387+0000","last_undegraded":"2023-10-06T03:26:10.283387+0000","last_fullsized":"2023-10-06T03:26:10.283387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:49.593659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"73'6","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.294552+0000","last_change":"2023-10-06T03:26:09.274118+0000","last_active":"2023-10-06T03:26:10.294552+0000","last_peered":"2023-10-06T03:26:10.294552+0000","last_clean":"2023-10-06T03:26:10.294552+0000","last_became_active":"2023-10-06T03:26:09.273846+0000","last_became_peered":"2023-10-06T03:26:09.273846+0000","last_unstale":"2023-10-06T03:26:10.294552+0000","last_undegraded":"2023-10-06T03:26:10.294552+0000","last_fullsized":"2023-10-06T03:26:10.294552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:34.678039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.285887+0000","last_change":"2023-10-06T03:26:10.279311+0000","last_active":"2023-10-06T03:26:10.285887+0000","last_peered":"2023-10-06T03:26:10.285887+0000","last_clean":"2023-10-06T03:26:10.285887+0000","last_became_active":"2023-10-06T03:26:10.278961+0000","last_became_peered":"2023-10-06T03:26:10.278961+0000","last_unstale":"2023-10-06T03:26:10.285887+0000","last_undegraded":"2023-10-06T03:26:10.285887+0000","last_fullsized":"2023-10-06T03:26:10.285887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:50.357206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.291495+0000","last_change":"2023-10-06T03:26:09.270358+0000","last_active":"2023-10-06T03:26:10.291495+0000","last_peered":"2023-10-06T03:26:10.291495+0000","last_clean":"2023-10-06T03:26:10.291495+0000","last_became_active":"2023-10-06T03:26:09.268859+0000","last_became_peered":"2023-10-06T03:26:09.268859+0000","last_unstale":"2023-10-06T03:26:10.291495+0000","last_undegraded":"2023-10-06T03:26:10.291495+0000","last_fullsized":"2023-10-06T03:26:10.291495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:11.840868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277429+0000","last_change":"2023-10-06T03:26:10.274400+0000","last_active":"2023-10-06T03:26:10.277429+0000","last_peered":"2023-10-06T03:26:10.277429+0000","last_clean":"2023-10-06T03:26:10.277429+0000","last_became_active":"2023-10-06T03:26:10.272719+0000","last_became_peered":"2023-10-06T03:26:10.272719+0000","last_unstale":"2023-10-06T03:26:10.277429+0000","last_undegraded":"2023-10-06T03:26:10.277429+0000","last_fullsized":"2023-10-06T03:26:10.277429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:44.549351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262675+0000","last_change":"2023-10-06T03:26:09.274952+0000","last_active":"2023-10-06T03:26:10.262675+0000","last_peered":"2023-10-06T03:26:10.262675+0000","last_clean":"2023-10-06T03:26:10.262675+0000","last_became_active":"2023-10-06T03:26:09.274489+0000","last_became_peered":"2023-10-06T03:26:09.274489+0000","last_unstale":"2023-10-06T03:26:10.262675+0000","last_undegraded":"2023-10-06T03:26:10.262675+0000","last_fullsized":"2023-10-06T03:26:10.262675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:39.800893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290606+0000","last_change":"2023-10-06T03:26:10.285343+0000","last_active":"2023-10-06T03:26:10.290606+0000","last_peered":"2023-10-06T03:26:10.290606+0000","last_clean":"2023-10-06T03:26:10.290606+0000","last_became_active":"2023-10-06T03:26:10.284618+0000","last_became_peered":"2023-10-06T03:26:10.284618+0000","last_unstale":"2023-10-06T03:26:10.290606+0000","last_undegraded":"2023-10-06T03:26:10.290606+0000","last_fullsized":"2023-10-06T03:26:10.290606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:23.246504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267438+0000","last_change":"2023-10-06T03:26:09.276331+0000","last_active":"2023-10-06T03:26:10.267438+0000","last_peered":"2023-10-06T03:26:10.267438+0000","last_clean":"2023-10-06T03:26:10.267438+0000","last_became_active":"2023-10-06T03:26:09.276038+0000","last_became_peered":"2023-10-06T03:26:09.276038+0000","last_unstale":"2023-10-06T03:26:10.267438+0000","last_undegraded":"2023-10-06T03:26:10.267438+0000","last_fullsized":"2023-10-06T03:26:10.267438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:15.335321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.289651+0000","last_change":"2023-10-06T03:26:10.283421+0000","last_active":"2023-10-06T03:26:10.289651+0000","last_peered":"2023-10-06T03:26:10.289651+0000","last_clean":"2023-10-06T03:26:10.289651+0000","last_became_active":"2023-10-06T03:26:10.283133+0000","last_became_peered":"2023-10-06T03:26:10.283133+0000","last_unstale":"2023-10-06T03:26:10.289651+0000","last_undegraded":"2023-10-06T03:26:10.289651+0000","last_fullsized":"2023-10-06T03:26:10.289651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:36.886369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"73'8","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292711+0000","last_change":"2023-10-06T03:26:09.271167+0000","last_active":"2023-10-06T03:26:10.292711+0000","last_peered":"2023-10-06T03:26:10.292711+0000","last_clean":"2023-10-06T03:26:10.292711+0000","last_became_active":"2023-10-06T03:26:09.270925+0000","last_became_peered":"2023-10-06T03:26:09.270925+0000","last_unstale":"2023-10-06T03:26:10.292711+0000","last_undegraded":"2023-10-06T03:26:10.292711+0000","last_fullsized":"2023-10-06T03:26:10.292711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:32.451103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.284443+0000","last_change":"2023-10-06T03:26:10.279812+0000","last_active":"2023-10-06T03:26:10.284443+0000","last_peered":"2023-10-06T03:26:10.284443+0000","last_clean":"2023-10-06T03:26:10.284443+0000","last_became_active":"2023-10-06T03:26:10.279401+0000","last_became_peered":"2023-10-06T03:26:10.279401+0000","last_unstale":"2023-10-06T03:26:10.284443+0000","last_undegraded":"2023-10-06T03:26:10.284443+0000","last_fullsized":"2023-10-06T03:26:10.284443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:50.494148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290102+0000","last_change":"2023-10-06T03:26:09.276138+0000","last_active":"2023-10-06T03:26:10.290102+0000","last_peered":"2023-10-06T03:26:10.290102+0000","last_clean":"2023-10-06T03:26:10.290102+0000","last_became_active":"2023-10-06T03:26:09.275927+0000","last_became_peered":"2023-10-06T03:26:09.275927+0000","last_unstale":"2023-10-06T03:26:10.290102+0000","last_undegraded":"2023-10-06T03:26:10.290102+0000","last_fullsized":"2023-10-06T03:26:10.290102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:19.285384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273154+0000","last_change":"2023-10-06T03:26:10.266427+0000","last_active":"2023-10-06T03:26:10.273154+0000","last_peered":"2023-10-06T03:26:10.273154+0000","last_clean":"2023-10-06T03:26:10.273154+0000","last_became_active":"2023-10-06T03:26:10.266130+0000","last_became_peered":"2023-10-06T03:26:10.266130+0000","last_unstale":"2023-10-06T03:26:10.273154+0000","last_undegraded":"2023-10-06T03:26:10.273154+0000","last_fullsized":"2023-10-06T03:26:10.273154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:47.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"74'1","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T03:26:11.484539+0000","last_change":"2023-10-06T03:26:09.270391+0000","last_active":"2023-10-06T03:26:11.484539+0000","last_peered":"2023-10-06T03:26:11.484539+0000","last_clean":"2023-10-06T03:26:11.484539+0000","last_became_active":"2023-10-06T03:26:09.270124+0000","last_became_peered":"2023-10-06T03:26:09.270124+0000","last_unstale":"2023-10-06T03:26:11.484539+0000","last_undegraded":"2023-10-06T03:26:11.484539+0000","last_fullsized":"2023-10-06T03:26:11.484539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:20.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276799+0000","last_change":"2023-10-06T03:26:10.266500+0000","last_active":"2023-10-06T03:26:10.276799+0000","last_peered":"2023-10-06T03:26:10.276799+0000","last_clean":"2023-10-06T03:26:10.276799+0000","last_became_active":"2023-10-06T03:26:10.266247+0000","last_became_peered":"2023-10-06T03:26:10.266247+0000","last_unstale":"2023-10-06T03:26:10.276799+0000","last_undegraded":"2023-10-06T03:26:10.276799+0000","last_fullsized":"2023-10-06T03:26:10.276799+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:44.549351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262163+0000","last_change":"2023-10-06T03:26:09.276320+0000","last_active":"2023-10-06T03:26:10.262163+0000","last_peered":"2023-10-06T03:26:10.262163+0000","last_clean":"2023-10-06T03:26:10.262163+0000","last_became_active":"2023-10-06T03:26:09.276067+0000","last_became_peered":"2023-10-06T03:26:09.276067+0000","last_unstale":"2023-10-06T03:26:10.262163+0000","last_undegraded":"2023-10-06T03:26:10.262163+0000","last_fullsized":"2023-10-06T03:26:10.262163+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:10.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283367+0000","last_change":"2023-10-06T03:26:10.274764+0000","last_active":"2023-10-06T03:26:10.283367+0000","last_peered":"2023-10-06T03:26:10.283367+0000","last_clean":"2023-10-06T03:26:10.283367+0000","last_became_active":"2023-10-06T03:26:10.274145+0000","last_became_peered":"2023-10-06T03:26:10.274145+0000","last_unstale":"2023-10-06T03:26:10.283367+0000","last_undegraded":"2023-10-06T03:26:10.283367+0000","last_fullsized":"2023-10-06T03:26:10.283367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:50.357206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262373+0000","last_change":"2023-10-06T03:26:09.274880+0000","last_active":"2023-10-06T03:26:10.262373+0000","last_peered":"2023-10-06T03:26:10.262373+0000","last_clean":"2023-10-06T03:26:10.262373+0000","last_became_active":"2023-10-06T03:26:09.274557+0000","last_became_peered":"2023-10-06T03:26:09.274557+0000","last_unstale":"2023-10-06T03:26:10.262373+0000","last_undegraded":"2023-10-06T03:26:10.262373+0000","last_fullsized":"2023-10-06T03:26:10.262373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:15.335321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277520+0000","last_change":"2023-10-06T03:26:10.275099+0000","last_active":"2023-10-06T03:26:10.277520+0000","last_peered":"2023-10-06T03:26:10.277520+0000","last_clean":"2023-10-06T03:26:10.277520+0000","last_became_active":"2023-10-06T03:26:10.274837+0000","last_became_peered":"2023-10-06T03:26:10.274837+0000","last_unstale":"2023-10-06T03:26:10.277520+0000","last_undegraded":"2023-10-06T03:26:10.277520+0000","last_fullsized":"2023-10-06T03:26:10.277520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:56.297907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.264536+0000","last_change":"2023-10-06T03:26:09.275525+0000","last_active":"2023-10-06T03:26:10.264536+0000","last_peered":"2023-10-06T03:26:10.264536+0000","last_clean":"2023-10-06T03:26:10.264536+0000","last_became_active":"2023-10-06T03:26:09.275255+0000","last_became_peered":"2023-10-06T03:26:09.275255+0000","last_unstale":"2023-10-06T03:26:10.264536+0000","last_undegraded":"2023-10-06T03:26:10.264536+0000","last_fullsized":"2023-10-06T03:26:10.264536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:39.800893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286545+0000","last_change":"2023-10-06T03:26:10.279562+0000","last_active":"2023-10-06T03:26:10.286545+0000","last_peered":"2023-10-06T03:26:10.286545+0000","last_clean":"2023-10-06T03:26:10.286545+0000","last_became_active":"2023-10-06T03:26:10.279299+0000","last_became_peered":"2023-10-06T03:26:10.279299+0000","last_unstale":"2023-10-06T03:26:10.286545+0000","last_undegraded":"2023-10-06T03:26:10.286545+0000","last_fullsized":"2023-10-06T03:26:10.286545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:35.527819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271992+0000","last_change":"2023-10-06T03:26:09.269594+0000","last_active":"2023-10-06T03:26:10.271992+0000","last_peered":"2023-10-06T03:26:10.271992+0000","last_clean":"2023-10-06T03:26:10.271992+0000","last_became_active":"2023-10-06T03:26:09.269372+0000","last_became_peered":"2023-10-06T03:26:09.269372+0000","last_unstale":"2023-10-06T03:26:10.271992+0000","last_undegraded":"2023-10-06T03:26:10.271992+0000","last_fullsized":"2023-10-06T03:26:10.271992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:07.827990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292304+0000","last_change":"2023-10-06T03:26:10.289118+0000","last_active":"2023-10-06T03:26:10.292304+0000","last_peered":"2023-10-06T03:26:10.292304+0000","last_clean":"2023-10-06T03:26:10.292304+0000","last_became_active":"2023-10-06T03:26:10.288760+0000","last_became_peered":"2023-10-06T03:26:10.288760+0000","last_unstale":"2023-10-06T03:26:10.292304+0000","last_undegraded":"2023-10-06T03:26:10.292304+0000","last_fullsized":"2023-10-06T03:26:10.292304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:08.877217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262151+0000","last_change":"2023-10-06T03:26:09.277881+0000","last_active":"2023-10-06T03:26:10.262151+0000","last_peered":"2023-10-06T03:26:10.262151+0000","last_clean":"2023-10-06T03:26:10.262151+0000","last_became_active":"2023-10-06T03:26:09.277073+0000","last_became_peered":"2023-10-06T03:26:09.277073+0000","last_unstale":"2023-10-06T03:26:10.262151+0000","last_undegraded":"2023-10-06T03:26:10.262151+0000","last_fullsized":"2023-10-06T03:26:10.262151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:25.080362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267404+0000","last_change":"2023-10-06T03:26:10.264115+0000","last_active":"2023-10-06T03:26:10.267404+0000","last_peered":"2023-10-06T03:26:10.267404+0000","last_clean":"2023-10-06T03:26:10.267404+0000","last_became_active":"2023-10-06T03:26:10.263790+0000","last_became_peered":"2023-10-06T03:26:10.263790+0000","last_unstale":"2023-10-06T03:26:10.267404+0000","last_undegraded":"2023-10-06T03:26:10.267404+0000","last_fullsized":"2023-10-06T03:26:10.267404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.271830+0000","last_change":"2023-10-06T03:26:09.272395+0000","last_active":"2023-10-06T03:26:10.271830+0000","last_peered":"2023-10-06T03:26:10.271830+0000","last_clean":"2023-10-06T03:26:10.271830+0000","last_became_active":"2023-10-06T03:26:09.271834+0000","last_became_peered":"2023-10-06T03:26:09.271834+0000","last_unstale":"2023-10-06T03:26:10.271830+0000","last_undegraded":"2023-10-06T03:26:10.271830+0000","last_fullsized":"2023-10-06T03:26:10.271830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:24.807628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277457+0000","last_change":"2023-10-06T03:26:10.274551+0000","last_active":"2023-10-06T03:26:10.277457+0000","last_peered":"2023-10-06T03:26:10.277457+0000","last_clean":"2023-10-06T03:26:10.277457+0000","last_became_active":"2023-10-06T03:26:10.274250+0000","last_became_peered":"2023-10-06T03:26:10.274250+0000","last_unstale":"2023-10-06T03:26:10.277457+0000","last_undegraded":"2023-10-06T03:26:10.277457+0000","last_fullsized":"2023-10-06T03:26:10.277457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.063961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262375+0000","last_change":"2023-10-06T03:26:09.266484+0000","last_active":"2023-10-06T03:26:10.262375+0000","last_peered":"2023-10-06T03:26:10.262375+0000","last_clean":"2023-10-06T03:26:10.262375+0000","last_became_active":"2023-10-06T03:26:09.265895+0000","last_became_peered":"2023-10-06T03:26:09.265895+0000","last_unstale":"2023-10-06T03:26:10.262375+0000","last_undegraded":"2023-10-06T03:26:10.262375+0000","last_fullsized":"2023-10-06T03:26:10.262375+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:55.247430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.272404+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:26:10.272404+0000","last_peered":"2023-10-06T03:26:10.272404+0000","last_clean":"2023-10-06T03:26:10.272404+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:26:10.272404+0000","last_undegraded":"2023-10-06T03:26:10.272404+0000","last_fullsized":"2023-10-06T03:26:10.272404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282378+0000","last_change":"2023-10-06T03:26:10.274993+0000","last_active":"2023-10-06T03:26:10.282378+0000","last_peered":"2023-10-06T03:26:10.282378+0000","last_clean":"2023-10-06T03:26:10.282378+0000","last_became_active":"2023-10-06T03:26:10.273552+0000","last_became_peered":"2023-10-06T03:26:10.273552+0000","last_unstale":"2023-10-06T03:26:10.282378+0000","last_undegraded":"2023-10-06T03:26:10.282378+0000","last_fullsized":"2023-10-06T03:26:10.282378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:02.203946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.258204+0000","last_change":"2023-10-06T03:26:09.273820+0000","last_active":"2023-10-06T03:26:10.258204+0000","last_peered":"2023-10-06T03:26:10.258204+0000","last_clean":"2023-10-06T03:26:10.258204+0000","last_became_active":"2023-10-06T03:26:09.273557+0000","last_became_peered":"2023-10-06T03:26:09.273557+0000","last_unstale":"2023-10-06T03:26:10.258204+0000","last_undegraded":"2023-10-06T03:26:10.258204+0000","last_fullsized":"2023-10-06T03:26:10.258204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:00.402266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.262759+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:26:10.262759+0000","last_peered":"2023-10-06T03:26:10.262759+0000","last_clean":"2023-10-06T03:26:10.262759+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:26:10.262759+0000","last_undegraded":"2023-10-06T03:26:10.262759+0000","last_fullsized":"2023-10-06T03:26:10.262759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273417+0000","last_change":"2023-10-06T03:26:10.264839+0000","last_active":"2023-10-06T03:26:10.273417+0000","last_peered":"2023-10-06T03:26:10.273417+0000","last_clean":"2023-10-06T03:26:10.273417+0000","last_became_active":"2023-10-06T03:26:10.264486+0000","last_became_peered":"2023-10-06T03:26:10.264486+0000","last_unstale":"2023-10-06T03:26:10.273417+0000","last_undegraded":"2023-10-06T03:26:10.273417+0000","last_fullsized":"2023-10-06T03:26:10.273417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:56.252304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.292078+0000","last_change":"2023-10-06T03:26:09.277098+0000","last_active":"2023-10-06T03:26:10.292078+0000","last_peered":"2023-10-06T03:26:10.292078+0000","last_clean":"2023-10-06T03:26:10.292078+0000","last_became_active":"2023-10-06T03:26:09.276806+0000","last_became_peered":"2023-10-06T03:26:09.276806+0000","last_unstale":"2023-10-06T03:26:10.292078+0000","last_undegraded":"2023-10-06T03:26:10.292078+0000","last_fullsized":"2023-10-06T03:26:10.292078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:55.247430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.273041+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:26:10.273041+0000","last_peered":"2023-10-06T03:26:10.273041+0000","last_clean":"2023-10-06T03:26:10.273041+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:26:10.273041+0000","last_undegraded":"2023-10-06T03:26:10.273041+0000","last_fullsized":"2023-10-06T03:26:10.273041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":217,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261049+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:26:10.261049+0000","last_peered":"2023-10-06T03:26:10.261049+0000","last_clean":"2023-10-06T03:26:10.261049+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:26:10.261049+0000","last_undegraded":"2023-10-06T03:26:10.261049+0000","last_fullsized":"2023-10-06T03:26:10.261049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.276526+0000","last_change":"2023-10-06T03:26:10.272687+0000","last_active":"2023-10-06T03:26:10.276526+0000","last_peered":"2023-10-06T03:26:10.276526+0000","last_clean":"2023-10-06T03:26:10.276526+0000","last_became_active":"2023-10-06T03:26:10.272443+0000","last_became_peered":"2023-10-06T03:26:10.272443+0000","last_unstale":"2023-10-06T03:26:10.276526+0000","last_undegraded":"2023-10-06T03:26:10.276526+0000","last_fullsized":"2023-10-06T03:26:10.276526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:03.107312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.282924+0000","last_change":"2023-10-06T03:26:09.279808+0000","last_active":"2023-10-06T03:26:10.282924+0000","last_peered":"2023-10-06T03:26:10.282924+0000","last_clean":"2023-10-06T03:26:10.282924+0000","last_became_active":"2023-10-06T03:26:09.279411+0000","last_became_peered":"2023-10-06T03:26:09.279411+0000","last_unstale":"2023-10-06T03:26:10.282924+0000","last_undegraded":"2023-10-06T03:26:10.282924+0000","last_fullsized":"2023-10-06T03:26:10.282924+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:02.694143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.260348+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:26:10.260348+0000","last_peered":"2023-10-06T03:26:10.260348+0000","last_clean":"2023-10-06T03:26:10.260348+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:26:10.260348+0000","last_undegraded":"2023-10-06T03:26:10.260348+0000","last_fullsized":"2023-10-06T03:26:10.260348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.288455+0000","last_change":"2023-10-06T03:26:10.280327+0000","last_active":"2023-10-06T03:26:10.288455+0000","last_peered":"2023-10-06T03:26:10.288455+0000","last_clean":"2023-10-06T03:26:10.288455+0000","last_became_active":"2023-10-06T03:26:10.280026+0000","last_became_peered":"2023-10-06T03:26:10.280026+0000","last_unstale":"2023-10-06T03:26:10.288455+0000","last_undegraded":"2023-10-06T03:26:10.288455+0000","last_fullsized":"2023-10-06T03:26:10.288455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:02.203946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"73'1","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.290273+0000","last_change":"2023-10-06T03:26:09.277164+0000","last_active":"2023-10-06T03:26:10.290273+0000","last_peered":"2023-10-06T03:26:10.290273+0000","last_clean":"2023-10-06T03:26:10.290273+0000","last_became_active":"2023-10-06T03:26:09.276901+0000","last_became_peered":"2023-10-06T03:26:09.276901+0000","last_unstale":"2023-10-06T03:26:10.290273+0000","last_undegraded":"2023-10-06T03:26:10.290273+0000","last_fullsized":"2023-10-06T03:26:10.290273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:00.081929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.260972+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:26:10.260972+0000","last_peered":"2023-10-06T03:26:10.260972+0000","last_clean":"2023-10-06T03:26:10.260972+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:26:10.260972+0000","last_undegraded":"2023-10-06T03:26:10.260972+0000","last_fullsized":"2023-10-06T03:26:10.260972+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.283403+0000","last_change":"2023-10-06T03:26:10.275097+0000","last_active":"2023-10-06T03:26:10.283403+0000","last_peered":"2023-10-06T03:26:10.283403+0000","last_clean":"2023-10-06T03:26:10.283403+0000","last_became_active":"2023-10-06T03:26:10.274801+0000","last_became_peered":"2023-10-06T03:26:10.274801+0000","last_unstale":"2023-10-06T03:26:10.283403+0000","last_undegraded":"2023-10-06T03:26:10.283403+0000","last_fullsized":"2023-10-06T03:26:10.283403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:35.527819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.264876+0000","last_change":"2023-10-06T03:26:09.271613+0000","last_active":"2023-10-06T03:26:10.264876+0000","last_peered":"2023-10-06T03:26:10.264876+0000","last_clean":"2023-10-06T03:26:10.264876+0000","last_became_active":"2023-10-06T03:26:09.271419+0000","last_became_peered":"2023-10-06T03:26:09.271419+0000","last_unstale":"2023-10-06T03:26:10.264876+0000","last_undegraded":"2023-10-06T03:26:10.264876+0000","last_fullsized":"2023-10-06T03:26:10.264876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:22.883840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":54,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.267532+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:26:10.267532+0000","last_peered":"2023-10-06T03:26:10.267532+0000","last_clean":"2023-10-06T03:26:10.267532+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:26:10.267532+0000","last_undegraded":"2023-10-06T03:26:10.267532+0000","last_fullsized":"2023-10-06T03:26:10.267532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286719+0000","last_change":"2023-10-06T03:26:10.282039+0000","last_active":"2023-10-06T03:26:10.286719+0000","last_peered":"2023-10-06T03:26:10.286719+0000","last_clean":"2023-10-06T03:26:10.286719+0000","last_became_active":"2023-10-06T03:26:10.281621+0000","last_became_peered":"2023-10-06T03:26:10.281621+0000","last_unstale":"2023-10-06T03:26:10.286719+0000","last_undegraded":"2023-10-06T03:26:10.286719+0000","last_fullsized":"2023-10-06T03:26:10.286719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:51.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.286320+0000","last_change":"2023-10-06T03:26:09.272953+0000","last_active":"2023-10-06T03:26:10.286320+0000","last_peered":"2023-10-06T03:26:10.286320+0000","last_clean":"2023-10-06T03:26:10.286320+0000","last_became_active":"2023-10-06T03:26:09.272679+0000","last_became_peered":"2023-10-06T03:26:09.272679+0000","last_unstale":"2023-10-06T03:26:10.286320+0000","last_undegraded":"2023-10-06T03:26:10.286320+0000","last_fullsized":"2023-10-06T03:26:10.286320+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:36.025261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":53,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261941+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:26:10.261941+0000","last_peered":"2023-10-06T03:26:10.261941+0000","last_clean":"2023-10-06T03:26:10.261941+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:26:10.261941+0000","last_undegraded":"2023-10-06T03:26:10.261941+0000","last_fullsized":"2023-10-06T03:26:10.261941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.277440+0000","last_change":"2023-10-06T03:26:10.276362+0000","last_active":"2023-10-06T03:26:10.277440+0000","last_peered":"2023-10-06T03:26:10.277440+0000","last_clean":"2023-10-06T03:26:10.277440+0000","last_became_active":"2023-10-06T03:26:10.276083+0000","last_became_peered":"2023-10-06T03:26:10.276083+0000","last_unstale":"2023-10-06T03:26:10.277440+0000","last_undegraded":"2023-10-06T03:26:10.277440+0000","last_fullsized":"2023-10-06T03:26:10.277440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:09.249940+0000","last_clean_scrub_stamp":"2023-10-06T03:26:09.249940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:50.264024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.258579+0000","last_change":"2023-10-06T03:26:09.267273+0000","last_active":"2023-10-06T03:26:10.258579+0000","last_peered":"2023-10-06T03:26:10.258579+0000","last_clean":"2023-10-06T03:26:10.258579+0000","last_became_active":"2023-10-06T03:26:09.267016+0000","last_became_peered":"2023-10-06T03:26:09.267016+0000","last_unstale":"2023-10-06T03:26:10.258579+0000","last_undegraded":"2023-10-06T03:26:10.258579+0000","last_fullsized":"2023-10-06T03:26:10.258579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:08.245066+0000","last_clean_scrub_stamp":"2023-10-06T03:26:08.245066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:20.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":53,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T03:26:10.261777+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:26:10.261777+0000","last_peered":"2023-10-06T03:26:10.261777+0000","last_clean":"2023-10-06T03:26:10.261777+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:26:10.261777+0000","last_undegraded":"2023-10-06T03:26:10.261777+0000","last_fullsized":"2023-10-06T03:26:10.261777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298756,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073084,"statfs":{"total":96636764160,"available":96330838016,"internally_reserved":0,"allocated":1503232,"data_stored":1015699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69199999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.72999999999999998,"15min":0.76300000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66200000000000003,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.628},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.752,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67100000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81699999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73599999999999999,"5min":1.103,"15min":1.103},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81799999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.878,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":425927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.343,"15min":1.343},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.329,"15min":1.329},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.76400000000000001,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80400000000000005,"15min":0.83999999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.042,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.80600000000000005,"15min":0.84199999999999997},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.371}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.438}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.626,"15min":0.625},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.40200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1015823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.38700000000000001,"15min":0.40300000000000002},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.38500000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.41199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.40600000000000003,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.26600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.44800000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.307},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.44600000000000001,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.41699999999999998,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.443},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.745,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80100000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.70899999999999996,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":423942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.435,"5min":12.19,"15min":12.19},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.64000000000000001,"15min":0.68799999999999994},"min":{"1min":0.28599999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46800000000000003,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.374}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50800000000000001,"5min":1.357,"15min":1.357},"last":0.246},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.309}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.92000000000000004,"15min":1.02},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.495,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.29099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.49099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.089,"15min":1.179},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":16.919,"15min":16.919},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.1000000000000001,"15min":1.1930000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79700000000000004,"5min":16.948,"15min":16.948},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67700000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.1140000000000001,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":16.881,"15min":16.881},"last":0.52000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298176,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073664,"statfs":{"total":96636764160,"available":96331431936,"internally_reserved":0,"allocated":909312,"data_stored":425815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33800000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.51500000000000001,"5min":0.62,"15min":0.62},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.48599999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.42799999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.28000000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52100000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.374}]},{"osd":4,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.875,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":426797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34200000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32400000000000001,"15min":0.32600000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42699999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.318},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.379},{"interface":"front","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49199999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.436}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77100000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75700000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":425261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2709999999999999,"5min":4.758,"15min":4.758},"last":0.624},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.88900000000000001,"15min":0.95299999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44900000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84399999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.51100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":426819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60699999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.64700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69399999999999995,"5min":0.999,"15min":0.999},"last":0.627},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68500000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73399999999999999,"5min":0.746,"15min":0.746},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":1.04,"15min":1.04},"last":0.47499999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.378,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":1.284,"15min":1.284},"last":0.52700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:26:19.200 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:26:19.200 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:26:19.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.352+0000 7f57e2c91700 1 Processor -- start 2023-10-06T03:26:19.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.352+0000 7f57e2c91700 1 -- start start 2023-10-06T03:26:19.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.353+0000 7f57e2c91700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f57dc0b0860 0x7f57dc068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.353+0000 7f57e2c91700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f57dc0cc780 0x7f57dc0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.353+0000 7f57e2c91700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc0c96b0 con 0x7f57dc0c4490 2023-10-06T03:26:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.353+0000 7f57e2c91700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc159c40 con 0x7f57dc0cc780 2023-10-06T03:26:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.353+0000 7f57e2c91700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc0c8aa0 con 0x7f57dc0b0860 2023-10-06T03:26:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.353+0000 7f57dbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f57dc0c4490 0x7f57dc0cec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48318/0 (socket says 172.21.15.84:48318) 2023-10-06T03:26:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.353+0000 7f57e122e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f57dc0cc780 0x7f57dc0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.353+0000 7f57dbfff700 1 -- 172.21.15.84:0/337029924 learned_addr learned my addr 172.21.15.84:0/337029924 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.353+0000 7f57e0a2d700 1 --2- 172.21.15.84:0/337029924 >> v2:172.21.15.131:3300/0 conn(0x7f57dc0b0860 0x7f57dc068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.354+0000 7f57e122e700 1 -- 172.21.15.84:0/337029924 >> v2:172.21.15.131:3300/0 conn(0x7f57dc0b0860 msgr2=0x7f57dc068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.354+0000 7f57e122e700 1 --2- 172.21.15.84:0/337029924 >> v2:172.21.15.131:3300/0 conn(0x7f57dc0b0860 0x7f57dc068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.354+0000 7f57e122e700 1 -- 172.21.15.84:0/337029924 >> v1:172.21.15.84:6789/0 conn(0x7f57dc0c4490 legacy=0x7f57dc0cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.354+0000 7f57e122e700 1 -- 172.21.15.84:0/337029924 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc0c8d80 con 0x7f57dc0cc780 2023-10-06T03:26:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.354+0000 7f57e122e700 1 --2- 172.21.15.84:0/337029924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 0x7f57dc0ccba0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f57dc06e1c0 tx=0x7f57d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc19ca4591f9185f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.354+0000 7f57db7fe700 1 -- 172.21.15.84:0/337029924 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400e070 con 0x7f57dc0cc780 2023-10-06T03:26:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.354+0000 7f57db7fe700 1 -- 172.21.15.84:0/337029924 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d400bb60 con 0x7f57dc0cc780 2023-10-06T03:26:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.354+0000 7f57db7fe700 1 -- 172.21.15.84:0/337029924 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4012430 con 0x7f57dc0cc780 2023-10-06T03:26:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.355+0000 7f57e2c91700 1 -- 172.21.15.84:0/337029924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 msgr2=0x7f57dc0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.355+0000 7f57e2c91700 1 --2- 172.21.15.84:0/337029924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 0x7f57dc0ccba0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f57dc06e1c0 tx=0x7f57d4009780 comp rx=0 tx=0).stop 2023-10-06T03:26:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.355+0000 7f57e2c91700 1 -- 172.21.15.84:0/337029924 shutdown_connections 2023-10-06T03:26:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.355+0000 7f57e2c91700 1 --2- 172.21.15.84:0/337029924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 0x7f57dc0ccba0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.355+0000 7f57e2c91700 1 --2- 172.21.15.84:0/337029924 >> v2:172.21.15.131:3300/0 conn(0x7f57dc0b0860 0x7f57dc068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.355+0000 7f57e2c91700 1 -- 172.21.15.84:0/337029924 >> 172.21.15.84:0/337029924 conn(0x7f57dc088000 msgr2=0x7f57dc0ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:19.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.355+0000 7f57e2c91700 1 -- 172.21.15.84:0/337029924 shutdown_connections 2023-10-06T03:26:19.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.355+0000 7f57e2c91700 1 -- 172.21.15.84:0/337029924 wait complete. 2023-10-06T03:26:19.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.356+0000 7f57e2c91700 1 Processor -- start 2023-10-06T03:26:19.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.356+0000 7f57e2c91700 1 -- start start 2023-10-06T03:26:19.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e2c91700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57dc0b0860 0x7f57dc1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e2c91700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57dc0c4490 0x7f57dc169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e2c91700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 0x7f57dc15b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e2c91700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc15afe0 con 0x7f57dc0cc780 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e2c91700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc155c10 con 0x7f57dc0c4490 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e2c91700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc16a4b0 con 0x7f57dc0b0860 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e122e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 0x7f57dc15b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e122e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 0x7f57dc15b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49568/0 (socket says 172.21.15.84:49568) 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e122e700 1 -- 172.21.15.84:0/3870145463 learned_addr learned my addr 172.21.15.84:0/3870145463 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e0a2d700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57dc0b0860 0x7f57dc1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57dbfff700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57dc0c4490 0x7f57dc169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e122e700 1 -- 172.21.15.84:0/3870145463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57dc0b0860 msgr2=0x7f57dc1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e122e700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57dc0b0860 0x7f57dc1556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e122e700 1 -- 172.21.15.84:0/3870145463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57dc0c4490 msgr2=0x7f57dc169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e122e700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57dc0c4490 0x7f57dc169f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e122e700 1 -- 172.21.15.84:0/3870145463 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d4009a20 con 0x7f57dc0cc780 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e122e700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 0x7f57dc15b900 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009fd0 tx=0x7f57d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57d8ff9700 1 -- 172.21.15.84:0/3870145463 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4027470 con 0x7f57dc0cc780 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57d8ff9700 1 -- 172.21.15.84:0/3870145463 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d40275f0 con 0x7f57dc0cc780 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e2c91700 1 -- 172.21.15.84:0/3870145463 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc159f40 con 0x7f57dc0cc780 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57d8ff9700 1 -- 172.21.15.84:0/3870145463 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d40279b0 con 0x7f57dc0cc780 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.357+0000 7f57e2c91700 1 -- 172.21.15.84:0/3870145463 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc15a500 con 0x7f57dc0cc780 2023-10-06T03:26:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.358+0000 7f57e2c91700 1 -- 172.21.15.84:0/3870145463 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc064ad0 con 0x7f57dc0cc780 2023-10-06T03:26:19.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.359+0000 7f57d8ff9700 1 -- 172.21.15.84:0/3870145463 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57d4024070 con 0x7f57dc0cc780 2023-10-06T03:26:19.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.359+0000 7f57d8ff9700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f57c0066f30 0x7f57c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.359+0000 7f57d8ff9700 1 -- 172.21.15.84:0/3870145463 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f57d40870a0 con 0x7f57dc0cc780 2023-10-06T03:26:19.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.359+0000 7f57e0a2d700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f57c0066f30 0x7f57c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.359+0000 7f57e0a2d700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f57c0066f30 0x7f57c00693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009da0 tx=0x7f57d0009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:19.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.364+0000 7f57d8ff9700 1 -- 172.21.15.84:0/3870145463 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57d4054070 con 0x7f57dc0cc780 2023-10-06T03:26:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.618+0000 7f57e2c91700 1 -- 172.21.15.84:0/3870145463 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f57dc04bb80 con 0x7f57dc0cc780 2023-10-06T03:26:19.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.624+0000 7f57d8ff9700 1 -- 172.21.15.84:0/3870145463 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f57d4057690 con 0x7f57dc0cc780 2023-10-06T03:26:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 -- 172.21.15.84:0/3870145463 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f57c0066f30 msgr2=0x7f57c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f57c0066f30 0x7f57c00693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009da0 tx=0x7f57d0009120 comp rx=0 tx=0).stop 2023-10-06T03:26:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 -- 172.21.15.84:0/3870145463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 msgr2=0x7f57dc15b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 0x7f57dc15b900 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009fd0 tx=0x7f57d4019000 comp rx=0 tx=0).stop 2023-10-06T03:26:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 -- 172.21.15.84:0/3870145463 shutdown_connections 2023-10-06T03:26:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f57c0066f30 0x7f57c00693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57dc0cc780 0x7f57dc15b900 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57dc0b0860 0x7f57dc1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 --2- 172.21.15.84:0/3870145463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57dc0c4490 0x7f57dc169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 -- 172.21.15.84:0/3870145463 >> 172.21.15.84:0/3870145463 conn(0x7f57dc088000 msgr2=0x7f57dc06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 -- 172.21.15.84:0/3870145463 shutdown_connections 2023-10-06T03:26:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.626+0000 7f57e2c91700 1 -- 172.21.15.84:0/3870145463 wait complete. 2023-10-06T03:26:19.630 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T03:26:19.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.753+0000 7f62c64a9700 1 Processor -- start 2023-10-06T03:26:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.753+0000 7f62c64a9700 1 -- start start 2023-10-06T03:26:19.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.754+0000 7f62c64a9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62c01595a0 0x7f62c00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.754+0000 7f62c64a9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62c00b49e0 0x7f62c00aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.754+0000 7f62c64a9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c00b0ca0 con 0x7f62c00b07a0 2023-10-06T03:26:19.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.754+0000 7f62c64a9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c00b0f80 con 0x7f62c01595a0 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.754+0000 7f62c64a9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c00b1260 con 0x7f62c00b49e0 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.754+0000 7f62bffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62c01595a0 0x7f62c00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.754+0000 7f62bffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62c01595a0 0x7f62c00aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49576/0 (socket says 172.21.15.84:49576) 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.754+0000 7f62bffff700 1 -- 172.21.15.84:0/3838423361 learned_addr learned my addr 172.21.15.84:0/3838423361 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.754+0000 7f62bf7fe700 1 --2- 172.21.15.84:0/3838423361 >> v2:172.21.15.131:3300/0 conn(0x7f62c00b49e0 0x7f62c00aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.754+0000 7f62bffff700 1 -- 172.21.15.84:0/3838423361 >> v2:172.21.15.131:3300/0 conn(0x7f62c00b49e0 msgr2=0x7f62c00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62bffff700 1 --2- 172.21.15.84:0/3838423361 >> v2:172.21.15.131:3300/0 conn(0x7f62c00b49e0 0x7f62c00aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62bffff700 1 -- 172.21.15.84:0/3838423361 >> v1:172.21.15.131:6789/0 conn(0x7f62c00b07a0 legacy=0x7f62c00b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62bffff700 1 -- 172.21.15.84:0/3838423361 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c00b1540 con 0x7f62c01595a0 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62bffff700 1 --2- 172.21.15.84:0/3838423361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 0x7f62c00aa570 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009990 tx=0x7f62b0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a4a64042add7a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62beffd700 1 -- 172.21.15.84:0/3838423361 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0005c10 con 0x7f62c01595a0 2023-10-06T03:26:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62beffd700 1 -- 172.21.15.84:0/3838423361 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0005d70 con 0x7f62c01595a0 2023-10-06T03:26:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62beffd700 1 -- 172.21.15.84:0/3838423361 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b000b840 con 0x7f62c01595a0 2023-10-06T03:26:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62c64a9700 1 -- 172.21.15.84:0/3838423361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 msgr2=0x7f62c00aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62c64a9700 1 --2- 172.21.15.84:0/3838423361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 0x7f62c00aa570 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009990 tx=0x7f62b0009220 comp rx=0 tx=0).stop 2023-10-06T03:26:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62c64a9700 1 -- 172.21.15.84:0/3838423361 shutdown_connections 2023-10-06T03:26:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62c64a9700 1 --2- 172.21.15.84:0/3838423361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 0x7f62c00aa570 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62c64a9700 1 --2- 172.21.15.84:0/3838423361 >> v2:172.21.15.131:3300/0 conn(0x7f62c00b49e0 0x7f62c00aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62c64a9700 1 -- 172.21.15.84:0/3838423361 >> 172.21.15.84:0/3838423361 conn(0x7f62c0099830 msgr2=0x7f62c006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62c64a9700 1 -- 172.21.15.84:0/3838423361 shutdown_connections 2023-10-06T03:26:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.755+0000 7f62c64a9700 1 -- 172.21.15.84:0/3838423361 wait complete. 2023-10-06T03:26:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.756+0000 7f62c64a9700 1 Processor -- start 2023-10-06T03:26:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.757+0000 7f62c64a9700 1 -- start start 2023-10-06T03:26:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.757+0000 7f62c64a9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62c00b07a0 0x7f62c00d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.757+0000 7f62c64a9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c00b49e0 0x7f62c0155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.757+0000 7f62c64a9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 0x7f62c014d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.757+0000 7f62c64a9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0155b50 con 0x7f62c01595a0 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.757+0000 7f62c64a9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0155d40 con 0x7f62c00b49e0 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.757+0000 7f62c64a9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0156020 con 0x7f62c00b07a0 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.757+0000 7f62c4a46700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 0x7f62c014d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62c4a46700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 0x7f62c014d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49584/0 (socket says 172.21.15.84:49584) 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62c4a46700 1 -- 172.21.15.84:0/2309119396 learned_addr learned my addr 172.21.15.84:0/2309119396 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62bf7fe700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c00b49e0 0x7f62c0155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62bffff700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62c00b07a0 0x7f62c00d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62c4a46700 1 -- 172.21.15.84:0/2309119396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62c00b07a0 msgr2=0x7f62c00d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62c4a46700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62c00b07a0 0x7f62c00d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62c4a46700 1 -- 172.21.15.84:0/2309119396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c00b49e0 msgr2=0x7f62c0155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62c4a46700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c00b49e0 0x7f62c0155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62c4a46700 1 -- 172.21.15.84:0/2309119396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b0009480 con 0x7f62c01595a0 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62bffff700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62c00b07a0 0x7f62c00d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62c4a46700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 0x7f62c014d8b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f62b800c8e0 tx=0x7f62b8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62a7fff700 1 -- 172.21.15.84:0/2309119396 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b800ce80 con 0x7f62c01595a0 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62a7fff700 1 -- 172.21.15.84:0/2309119396 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b800a7e0 con 0x7f62c01595a0 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62a7fff700 1 -- 172.21.15.84:0/2309119396 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b800ab80 con 0x7f62c01595a0 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62c64a9700 1 -- 172.21.15.84:0/2309119396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c0156300 con 0x7f62c01595a0 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.758+0000 7f62c64a9700 1 -- 172.21.15.84:0/2309119396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c0152220 con 0x7f62c01595a0 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.759+0000 7f62c64a9700 1 -- 172.21.15.84:0/2309119396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c01524d0 con 0x7f62c01595a0 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.759+0000 7f62a7fff700 1 -- 172.21.15.84:0/2309119396 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62b8012420 con 0x7f62c01595a0 2023-10-06T03:26:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.760+0000 7f62a7fff700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62ac066f30 0x7f62ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:19.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.760+0000 7f62a7fff700 1 -- 172.21.15.84:0/2309119396 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f62b8084a80 con 0x7f62c01595a0 2023-10-06T03:26:19.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.760+0000 7f62bffff700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62ac066f30 0x7f62ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:19.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.760+0000 7f62bffff700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62ac066f30 0x7f62ac0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f62b0007fd0 tx=0x7f62b0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:19.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.765+0000 7f62a7fff700 1 -- 172.21.15.84:0/2309119396 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62c01524d0 con 0x7f62c01595a0 2023-10-06T03:26:19.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.988+0000 7f62c64a9700 1 -- 172.21.15.84:0/2309119396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62c01524d0 con 0x7f62c01595a0 2023-10-06T03:26:19.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.988+0000 7f62a7fff700 1 -- 172.21.15.84:0/2309119396 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f62c01524d0 con 0x7f62c01595a0 2023-10-06T03:26:19.990 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:19.990 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1214313207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1214313207},{"type":"v1","addr":"172.21.15.131:6835","nonce":1214313207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/63470384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":63470384},{"type":"v1","addr":"172.21.15.84:6837","nonce":63470384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3440632646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3440632646},{"type":"v1","addr":"172.21.15.131:6834","nonce":3440632646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:09.642630+0000","modified":"2023-10-06T03:26:13.283595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/390518387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":390518387},{"type":"v1","addr":"172.21.15.84:6836","nonce":390518387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:26:19.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 -- 172.21.15.84:0/2309119396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62ac066f30 msgr2=0x7f62ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62ac066f30 0x7f62ac0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f62b0007fd0 tx=0x7f62b0016000 comp rx=0 tx=0).stop 2023-10-06T03:26:19.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 -- 172.21.15.84:0/2309119396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 msgr2=0x7f62c014d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:19.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 0x7f62c014d8b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f62b800c8e0 tx=0x7f62b8001710 comp rx=0 tx=0).stop 2023-10-06T03:26:19.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 -- 172.21.15.84:0/2309119396 shutdown_connections 2023-10-06T03:26:19.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f62ac066f30 0x7f62ac0693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c01595a0 0x7f62c014d8b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62c00b07a0 0x7f62c00d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 --2- 172.21.15.84:0/2309119396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c00b49e0 0x7f62c0155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:19.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 -- 172.21.15.84:0/2309119396 >> 172.21.15.84:0/2309119396 conn(0x7f62c0099830 msgr2=0x7f62c0068860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:19.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 -- 172.21.15.84:0/2309119396 shutdown_connections 2023-10-06T03:26:19.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:19.990+0000 7f62c64a9700 1 -- 172.21.15.84:0/2309119396 wait complete. 2023-10-06T03:26:19.994 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 39 2023-10-06T03:26:20.406 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:26:09.642630+0000', 'modified': '2023-10-06T03:26:13.283595+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6207': {'gid': 6207, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6836/390518387', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 390518387}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 390518387}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:26:20.407 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:26:20.407 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:26:20.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.523+0000 7f424ce4d700 1 Processor -- start 2023-10-06T03:26:20.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.523+0000 7f424ce4d700 1 -- start start 2023-10-06T03:26:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.524+0000 7f424ce4d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f424806a5d0 0x7f4248153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.524+0000 7f424ce4d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 0x7f4248153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.524+0000 7f424ce4d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42480c9d00 con 0x7f424806a9a0 2023-10-06T03:26:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.524+0000 7f424ce4d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424806f5a0 con 0x7f424806a5d0 2023-10-06T03:26:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.524+0000 7f424ce4d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424806eb00 con 0x7f424806e6a0 2023-10-06T03:26:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.524+0000 7f42477fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f424806a5d0 0x7f4248153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.524+0000 7f4247fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 0x7f4248153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.524+0000 7f42477fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f424806a5d0 0x7f4248153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:51894/0 (socket says 172.21.15.84:51894) 2023-10-06T03:26:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.524+0000 7f42477fe700 1 -- 172.21.15.84:0/3149920949 learned_addr learned my addr 172.21.15.84:0/3149920949 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.524+0000 7f4246ffd700 1 --1- 172.21.15.84:0/3149920949 >> v1:172.21.15.131:6789/0 conn(0x7f424806a9a0 0x7f424806df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:60672/0 (socket says 172.21.15.84:60672) 2023-10-06T03:26:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.525+0000 7f42477fe700 1 -- 172.21.15.84:0/3149920949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 msgr2=0x7f4248153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.525+0000 7f42477fe700 1 --2- 172.21.15.84:0/3149920949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 0x7f4248153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.525+0000 7f42477fe700 1 -- 172.21.15.84:0/3149920949 >> v1:172.21.15.131:6789/0 conn(0x7f424806a9a0 legacy=0x7f424806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.525+0000 7f42467fc700 1 -- 172.21.15.84:0/3149920949 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096323539 0 0) 0x7f42480c9d00 con 0x7f424806a9a0 2023-10-06T03:26:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.525+0000 7f42477fe700 1 -- 172.21.15.84:0/3149920949 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480c6750 con 0x7f424806a5d0 2023-10-06T03:26:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.525+0000 7f4247fff700 1 --2- 172.21.15.84:0/3149920949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 0x7f4248153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.525+0000 7f42477fe700 1 --2- 172.21.15.84:0/3149920949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f424806a5d0 0x7f4248153730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4238009f50 tx=0x7f4238009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a42f51abac8bbee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.525+0000 7f42467fc700 1 -- 172.21.15.84:0/3149920949 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423800e070 con 0x7f424806a5d0 2023-10-06T03:26:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.525+0000 7f42467fc700 1 -- 172.21.15.84:0/3149920949 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423800b9c0 con 0x7f424806a5d0 2023-10-06T03:26:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.525+0000 7f42467fc700 1 -- 172.21.15.84:0/3149920949 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380092e0 con 0x7f424806a5d0 2023-10-06T03:26:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.526+0000 7f424ce4d700 1 -- 172.21.15.84:0/3149920949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f424806a5d0 msgr2=0x7f4248153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.526+0000 7f424ce4d700 1 --2- 172.21.15.84:0/3149920949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f424806a5d0 0x7f4248153730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4238009f50 tx=0x7f4238009840 comp rx=0 tx=0).stop 2023-10-06T03:26:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.526+0000 7f424ce4d700 1 -- 172.21.15.84:0/3149920949 shutdown_connections 2023-10-06T03:26:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.526+0000 7f424ce4d700 1 --2- 172.21.15.84:0/3149920949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 0x7f4248153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.526+0000 7f424ce4d700 1 --2- 172.21.15.84:0/3149920949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f424806a5d0 0x7f4248153730 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.526+0000 7f424ce4d700 1 -- 172.21.15.84:0/3149920949 >> 172.21.15.84:0/3149920949 conn(0x7f42480680c0 msgr2=0x7f42480cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.526+0000 7f424ce4d700 1 -- 172.21.15.84:0/3149920949 shutdown_connections 2023-10-06T03:26:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.526+0000 7f424ce4d700 1 -- 172.21.15.84:0/3149920949 wait complete. 2023-10-06T03:26:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.527+0000 7f424ce4d700 1 Processor -- start 2023-10-06T03:26:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.527+0000 7f424ce4d700 1 -- start start 2023-10-06T03:26:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f424ce4d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f424806a5d0 0x7f42481592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f424ce4d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424806a9a0 0x7f42480afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f424ce4d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 0x7f42481493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f424ce4d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4248158e30 con 0x7f424806a9a0 2023-10-06T03:26:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f424ce4d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42480aef60 con 0x7f424806a5d0 2023-10-06T03:26:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f424ce4d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424814acd0 con 0x7f424806e6a0 2023-10-06T03:26:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4246ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424806a9a0 0x7f42480afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4246ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424806a9a0 0x7f42480afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49592/0 (socket says 172.21.15.84:49592) 2023-10-06T03:26:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4246ffd700 1 -- 172.21.15.84:0/577227664 learned_addr learned my addr 172.21.15.84:0/577227664 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f42477fe700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f424806a5d0 0x7f42481592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4247fff700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 0x7f42481493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4246ffd700 1 -- 172.21.15.84:0/577227664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 msgr2=0x7f42481493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4246ffd700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 0x7f42481493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4246ffd700 1 -- 172.21.15.84:0/577227664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f424806a5d0 msgr2=0x7f42481592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4246ffd700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f424806a5d0 0x7f42481592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4246ffd700 1 -- 172.21.15.84:0/577227664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240009420 con 0x7f424806a9a0 2023-10-06T03:26:20.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4247fff700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 0x7f42481493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:20.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.528+0000 7f4246ffd700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424806a9a0 0x7f42480afb70 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f423c00c5e0 tx=0x7f423c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:20.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.529+0000 7f422f7fe700 1 -- 172.21.15.84:0/577227664 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c005a70 con 0x7f424806a9a0 2023-10-06T03:26:20.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.529+0000 7f422f7fe700 1 -- 172.21.15.84:0/577227664 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c005bd0 con 0x7f424806a9a0 2023-10-06T03:26:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.529+0000 7f424ce4d700 1 -- 172.21.15.84:0/577227664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4238009ae0 con 0x7f424806a9a0 2023-10-06T03:26:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.529+0000 7f422f7fe700 1 -- 172.21.15.84:0/577227664 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0070d0 con 0x7f424806a9a0 2023-10-06T03:26:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.529+0000 7f424ce4d700 1 -- 172.21.15.84:0/577227664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4248158500 con 0x7f424806a9a0 2023-10-06T03:26:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.530+0000 7f422f7fe700 1 -- 172.21.15.84:0/577227664 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f423c007480 con 0x7f424806a9a0 2023-10-06T03:26:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.530+0000 7f422f7fe700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4234066f30 0x7f42340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.530+0000 7f422f7fe700 1 -- 172.21.15.84:0/577227664 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f423c083d10 con 0x7f424806a9a0 2023-10-06T03:26:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.530+0000 7f42477fe700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4234066f30 0x7f42340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.531+0000 7f42477fe700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4234066f30 0x7f42340693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4238009ea0 tx=0x7f4238018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.532+0000 7f42573a7b80 1 Processor -- start 2023-10-06T03:26:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.533+0000 7f42573a7b80 1 -- start start 2023-10-06T03:26:20.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.533+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f682cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.533+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f683200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.533+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f683740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.533+0000 7f42573a7b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56156f5dda70 con 0x56156f6882c0 2023-10-06T03:26:20.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.533+0000 7f42573a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56156f5db270 con 0x56156f689a10 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.533+0000 7f42573a7b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56156f5d7060 con 0x56156f6a7e50 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.533+0000 7f4246ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f683200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.533+0000 7f4246ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f683200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49604/0 (socket says 172.21.15.84:49604) 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.533+0000 7f4246ffd700 1 -- 172.21.15.84:0/4116971570 learned_addr learned my addr 172.21.15.84:0/4116971570 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f42477fe700 1 --2- 172.21.15.84:0/4116971570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f682cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f4247fff700 1 --2- 172.21.15.84:0/4116971570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f683740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f4246ffd700 1 -- 172.21.15.84:0/4116971570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 msgr2=0x56156f682cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f4246ffd700 1 --2- 172.21.15.84:0/4116971570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f682cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f4246ffd700 1 -- 172.21.15.84:0/4116971570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 msgr2=0x56156f683740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f4246ffd700 1 --2- 172.21.15.84:0/4116971570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f683740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f4246ffd700 1 -- 172.21.15.84:0/4116971570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56156f471270 con 0x56156f6882c0 2023-10-06T03:26:20.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f4247fff700 1 --2- 172.21.15.84:0/4116971570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f683740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f4246ffd700 1 --2- 172.21.15.84:0/4116971570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f683200 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f423c0070a0 tx=0x7f423c081e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742db0ea76bee2b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f422cff9700 1 -- 172.21.15.84:0/4116971570 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c05b8a0 con 0x56156f6882c0 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f422cff9700 1 -- 172.21.15.84:0/4116971570 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c052af0 con 0x56156f6882c0 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.534+0000 7f422cff9700 1 -- 172.21.15.84:0/4116971570 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c053ea0 con 0x56156f6882c0 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 -- 172.21.15.84:0/4116971570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 msgr2=0x56156f683200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 --2- 172.21.15.84:0/4116971570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f683200 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f423c0070a0 tx=0x7f423c081e50 comp rx=0 tx=0).stop 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 -- 172.21.15.84:0/4116971570 shutdown_connections 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 --2- 172.21.15.84:0/4116971570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f683740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 --2- 172.21.15.84:0/4116971570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f682cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 --2- 172.21.15.84:0/4116971570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f683200 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 -- 172.21.15.84:0/4116971570 >> 172.21.15.84:0/4116971570 conn(0x56156f687e80 msgr2=0x56156f6886b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 -- 172.21.15.84:0/4116971570 shutdown_connections 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 -- 172.21.15.84:0/4116971570 wait complete. 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 -- start start 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.535+0000 7f42573a7b80 1 Processor -- start 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f6882c0 0x56156f6cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f689a10 0x56156f6d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6a7e50 0x56156f6d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f42573a7b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56156f582890 con 0x56156f6a7e50 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f42573a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56156f59dea0 con 0x56156f6882c0 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f42573a7b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56156f459e30 con 0x56156f689a10 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f42573a7b80 10 client.0 _ll_register_callbacks cb 0x56156f64a020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:26:20.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f4247fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6a7e50 0x56156f6d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f4247fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6a7e50 0x56156f6d0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49620/0 (socket says 172.21.15.84:49620) 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f4247fff700 1 -- 172.21.15.84:0/1278226302 learned_addr learned my addr 172.21.15.84:0/1278226302 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f4246ffd700 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f689a10 0x56156f6d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.536+0000 7f42477fe700 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f6882c0 0x56156f6cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4247fff700 1 -- 172.21.15.84:0/1278226302 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f689a10 msgr2=0x56156f6d1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4247fff700 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f689a10 0x56156f6d1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4247fff700 1 -- 172.21.15.84:0/1278226302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f6882c0 msgr2=0x56156f6cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4247fff700 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f6882c0 0x56156f6cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4247fff700 1 -- 172.21.15.84:0/1278226302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4248158500 con 0x56156f6a7e50 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4247fff700 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6a7e50 0x56156f6d0090 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f42400129e0 tx=0x7f4240008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655a7b9d196ac297 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4225ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:26:20.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4225ffb700 1 -- 172.21.15.84:0/1278226302 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240017070 con 0x56156f6a7e50 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f42573a7b80 1 -- 172.21.15.84:0/1278226302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56156f67b940 con 0x56156f6a7e50 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4225ffb700 1 -- 172.21.15.84:0/1278226302 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f424000e8d0 con 0x56156f6a7e50 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4225ffb700 1 -- 172.21.15.84:0/1278226302 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f424000eca0 con 0x56156f6a7e50 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f42573a7b80 10 client.6387 fetch_fsmap learned FSMap version 39 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f42573a7b80 1 -- 172.21.15.84:0/1278226302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x56156f413fe0 con 0x56156f6a7e50 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4225ffb700 1 -- 172.21.15.84:0/1278226302 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56156f67b940 con 0x56156f6a7e50 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f4225ffb700 1 -- 172.21.15.84:0/1278226302 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4240005a00 con 0x56156f6a7e50 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f42573a7b80 10 client.6387 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f42573a7b80 10 client.6387 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f42573a7b80 20 client.6387 populate_metadata read hostname 'smithi084' 2023-10-06T03:26:20.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f42573a7b80 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x56156f6a82f0 0x56156f6a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f42573a7b80 4 client.6387 mds_command: new command op to 6207 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f42573a7b80 1 -- 172.21.15.84:0/1278226302 --> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56156f658870 con 0x56156f6a82f0 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.537+0000 7f42477fe700 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x56156f6a82f0 0x56156f6a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f4225ffb700 10 client.6387 ms_handle_connect on v2:172.21.15.84:6834/390518387 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f42477fe700 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x56156f6a82f0 0x56156f6a86c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10f5910c9035a629 server_cookie=8c3b7730f730e28d in_seq=0 out_seq=0 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f4225ffb700 1 -- 172.21.15.84:0/1278226302 <== mds.0 v2:172.21.15.84:6834/390518387 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56156f658870 con 0x56156f6a82f0 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f4225ffb700 10 client.6387 handle_command_reply: tid=0 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f42573a7b80 1 client.6387 shutdown 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f42573a7b80 1 -- 172.21.15.84:0/1278226302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6a7e50 msgr2=0x56156f6d0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f42573a7b80 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6a7e50 0x56156f6d0090 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f42400129e0 tx=0x7f4240008040 comp rx=0 tx=0).stop 2023-10-06T03:26:20.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f42573a7b80 1 -- 172.21.15.84:0/1278226302 shutdown_connections 2023-10-06T03:26:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f42573a7b80 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x56156f6a82f0 0x56156f6a86c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f42573a7b80 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f6882c0 0x56156f6cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f4225ffb700 0 client.6387 ms_handle_reset on v2:172.21.15.84:6834/390518387 2023-10-06T03:26:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f42573a7b80 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6a7e50 0x56156f6d0090 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.538+0000 7f42573a7b80 1 --2- 172.21.15.84:0/1278226302 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f689a10 0x56156f6d1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.539+0000 7f42573a7b80 1 -- 172.21.15.84:0/1278226302 >> 172.21.15.84:0/1278226302 conn(0x56156f687e80 msgr2=0x56156f686d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.539+0000 7f42573a7b80 1 -- 172.21.15.84:0/1278226302 shutdown_connections 2023-10-06T03:26:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.539+0000 7f42573a7b80 1 -- 172.21.15.84:0/1278226302 wait complete. 2023-10-06T03:26:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.539+0000 7f42573a7b80 20 client.6387 trim_cache size 0 max 16384 2023-10-06T03:26:20.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.555+0000 7f42573a7b80 1 Processor -- start 2023-10-06T03:26:20.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.555+0000 7f42573a7b80 1 -- start start 2023-10-06T03:26:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6a7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f683e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f67d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42573a7b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56156f6a8fb0 con 0x56156f6882c0 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42573a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56156f6b6f10 con 0x56156f689a10 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42573a7b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56156f6cd080 con 0x56156f6a7e50 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6a7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49636/0 (socket says 172.21.15.84:49636) 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42477fe700 1 -- 172.21.15.84:0/2635486247 learned_addr learned my addr 172.21.15.84:0/2635486247 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f4247fff700 1 --2- 172.21.15.84:0/2635486247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f67d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f4246ffd700 1 --2- 172.21.15.84:0/2635486247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f683e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42477fe700 1 -- 172.21.15.84:0/2635486247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 msgr2=0x56156f67d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42477fe700 1 --2- 172.21.15.84:0/2635486247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f67d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42477fe700 1 -- 172.21.15.84:0/2635486247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 msgr2=0x56156f683e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42477fe700 1 --2- 172.21.15.84:0/2635486247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f683e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42477fe700 1 -- 172.21.15.84:0/2635486247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56156f5a5780 con 0x56156f6882c0 2023-10-06T03:26:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f4246ffd700 1 --2- 172.21.15.84:0/2635486247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f683e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f42477fe700 1 --2- 172.21.15.84:0/2635486247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6a7090 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f424806c7c0 tx=0x7f4238032250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f363045b05dd9f18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f422d7fa700 1 -- 172.21.15.84:0/2635486247 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238031070 con 0x56156f6882c0 2023-10-06T03:26:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f422d7fa700 1 -- 172.21.15.84:0/2635486247 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4238021070 con 0x56156f6882c0 2023-10-06T03:26:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.556+0000 7f422d7fa700 1 -- 172.21.15.84:0/2635486247 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423802a830 con 0x56156f6882c0 2023-10-06T03:26:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.557+0000 7f42573a7b80 1 -- 172.21.15.84:0/2635486247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 msgr2=0x56156f6a7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.557+0000 7f42573a7b80 1 --2- 172.21.15.84:0/2635486247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6a7090 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f424806c7c0 tx=0x7f4238032250 comp rx=0 tx=0).stop 2023-10-06T03:26:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.557+0000 7f42573a7b80 1 -- 172.21.15.84:0/2635486247 shutdown_connections 2023-10-06T03:26:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.557+0000 7f42573a7b80 1 --2- 172.21.15.84:0/2635486247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f67d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.557+0000 7f42573a7b80 1 --2- 172.21.15.84:0/2635486247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6a7090 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.557+0000 7f42573a7b80 1 --2- 172.21.15.84:0/2635486247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f683e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.557+0000 7f42573a7b80 1 -- 172.21.15.84:0/2635486247 >> 172.21.15.84:0/2635486247 conn(0x56156f687e80 msgr2=0x56156f6d1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.557+0000 7f42573a7b80 1 -- 172.21.15.84:0/2635486247 shutdown_connections 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.557+0000 7f42573a7b80 1 -- 172.21.15.84:0/2635486247 wait complete. 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.557+0000 7f42573a7b80 1 -- start start 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42573a7b80 1 Processor -- start 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f6871f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42573a7b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f732100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42573a7b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56156f6838d0 con 0x56156f6882c0 2023-10-06T03:26:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42573a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56156f693400 con 0x56156f689a10 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42573a7b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56156f686d60 con 0x56156f6a7e50 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42573a7b80 10 client.0 _ll_register_callbacks cb 0x56156f64a020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49640/0 (socket says 172.21.15.84:49640) 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.558+0000 7f42477fe700 1 -- 172.21.15.84:0/3683640487 learned_addr learned my addr 172.21.15.84:0/3683640487 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4246ffd700 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f6871f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42477fe700 1 -- 172.21.15.84:0/3683640487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 msgr2=0x56156f732100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4247fff700 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f732100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42477fe700 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f732100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42477fe700 1 -- 172.21.15.84:0/3683640487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 msgr2=0x56156f6871f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42477fe700 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f6871f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42477fe700 1 -- 172.21.15.84:0/3683640487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42480c6750 con 0x56156f6882c0 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4246ffd700 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f6871f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4247fff700 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f732100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42477fe700 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6b3820 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f423800b800 tx=0x7f4238031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a349fa0610b446 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4225ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4225ffb700 1 -- 172.21.15.84:0/3683640487 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423801d6e0 con 0x56156f6882c0 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4225ffb700 1 -- 172.21.15.84:0/3683640487 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4238023070 con 0x56156f6882c0 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42573a7b80 1 -- 172.21.15.84:0/3683640487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f423c052af0 con 0x56156f6882c0 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4225ffb700 1 -- 172.21.15.84:0/3683640487 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f423801fba0 con 0x56156f6882c0 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42573a7b80 10 client.6393 fetch_fsmap learned FSMap version 39 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42573a7b80 1 -- 172.21.15.84:0/3683640487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x56156f58c470 con 0x56156f6882c0 2023-10-06T03:26:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4225ffb700 1 -- 172.21.15.84:0/3683640487 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c052af0 con 0x56156f6882c0 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4225ffb700 1 -- 172.21.15.84:0/3683640487 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f423801fd00 con 0x56156f6882c0 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42573a7b80 10 client.6393 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42573a7b80 10 client.6393 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42573a7b80 20 client.6393 populate_metadata read hostname 'smithi084' 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42573a7b80 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x56156f67d400 0x56156f67d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42573a7b80 4 client.6393 mds_command: new command op to 6207 tid=0[{"prefix": "status"}] 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f42573a7b80 1 -- 172.21.15.84:0/3683640487 --> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56156f579e00 con 0x56156f67d400 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.559+0000 7f4246ffd700 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x56156f67d400 0x56156f67d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f4225ffb700 10 client.6393 ms_handle_connect on v2:172.21.15.84:6834/390518387 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f4246ffd700 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x56156f67d400 0x56156f67d7d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7efa95dcef5dfa1 server_cookie=a3eb13aead08b145 in_seq=0 out_seq=0 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f4225ffb700 1 -- 172.21.15.84:0/3683640487 <== mds.0 v2:172.21.15.84:6834/390518387 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56156f579e00 con 0x56156f67d400 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f4225ffb700 10 client.6393 handle_command_reply: tid=0 2023-10-06T03:26:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 client.6393 shutdown 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 -- 172.21.15.84:0/3683640487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 msgr2=0x56156f6b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6b3820 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f423800b800 tx=0x7f4238031000 comp rx=0 tx=0).stop 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 -- 172.21.15.84:0/3683640487 shutdown_connections 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56156f6a7e50 0x56156f732100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56156f6882c0 0x56156f6b3820 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x56156f67d400 0x56156f67d7d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 --2- 172.21.15.84:0/3683640487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56156f689a10 0x56156f6871f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f4225ffb700 0 client.6393 ms_handle_reset on v2:172.21.15.84:6834/390518387 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 -- 172.21.15.84:0/3683640487 >> 172.21.15.84:0/3683640487 conn(0x56156f687e80 msgr2=0x56156f6a86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 -- 172.21.15.84:0/3683640487 shutdown_connections 2023-10-06T03:26:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 1 -- 172.21.15.84:0/3683640487 wait complete. 2023-10-06T03:26:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.560+0000 7f42573a7b80 20 client.6393 trim_cache size 0 max 16384 2023-10-06T03:26:20.571 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:26:20.571 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:26:20.571 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:26:20.571 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6207, 2023-10-06T03:26:20.571 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:26:20.571 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:26:20.571 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:26:20.571 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 10.292519633, 2023-10-06T03:26:20.572 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 39, 2023-10-06T03:26:20.572 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 74, 2023-10-06T03:26:20.572 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 74, 2023-10-06T03:26:20.572 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.404403301999999 2023-10-06T03:26:20.572 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:26:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 -- 172.21.15.84:0/577227664 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4234066f30 msgr2=0x7f42340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4234066f30 0x7f42340693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4238009ea0 tx=0x7f4238018000 comp rx=0 tx=0).stop 2023-10-06T03:26:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 -- 172.21.15.84:0/577227664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424806a9a0 msgr2=0x7f42480afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424806a9a0 0x7f42480afb70 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f423c00c5e0 tx=0x7f423c001040 comp rx=0 tx=0).stop 2023-10-06T03:26:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 -- 172.21.15.84:0/577227664 shutdown_connections 2023-10-06T03:26:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4234066f30 0x7f42340693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f424806a5d0 0x7f42481592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f424806e6a0 0x7f42481493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 --2- 172.21.15.84:0/577227664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424806a9a0 0x7f42480afb70 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 -- 172.21.15.84:0/577227664 >> 172.21.15.84:0/577227664 conn(0x7f42480680c0 msgr2=0x7f42480c1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 -- 172.21.15.84:0/577227664 shutdown_connections 2023-10-06T03:26:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.561+0000 7f424ce4d700 1 -- 172.21.15.84:0/577227664 wait complete. 2023-10-06T03:26:20.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:26:20.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.687+0000 7fb8a759e700 1 Processor -- start 2023-10-06T03:26:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.687+0000 7fb8a759e700 1 -- start start 2023-10-06T03:26:20.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 0x7fb8a80b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8a80b2140 0x7fb8a80b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a80cb7e0 con 0x7fb8a80b3610 2023-10-06T03:26:20.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a80b08a0 con 0x7fb8a80b2140 2023-10-06T03:26:20.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a80cb190 con 0x7fb8a8159480 2023-10-06T03:26:20.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a5d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb8a80b3610 0x7fb8a80cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34566/0 (socket says 172.21.15.84:34566) 2023-10-06T03:26:20.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8a80b2140 0x7fb8a80b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a5d9b700 1 -- 172.21.15.84:0/313711105 learned_addr learned my addr 172.21.15.84:0/313711105 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:20.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a659c700 1 --2- 172.21.15.84:0/313711105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 0x7fb8a80b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a6d9d700 1 -- 172.21.15.84:0/313711105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 msgr2=0x7fb8a80b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:20.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a6d9d700 1 --2- 172.21.15.84:0/313711105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 0x7fb8a80b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a6d9d700 1 -- 172.21.15.84:0/313711105 >> v1:172.21.15.84:6789/0 conn(0x7fb8a80b3610 legacy=0x7fb8a80cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a6d9d700 1 -- 172.21.15.84:0/313711105 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80cb470 con 0x7fb8a80b2140 2023-10-06T03:26:20.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a559a700 1 -- 172.21.15.84:0/313711105 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161740388 0 0) 0x7fb8a80cb7e0 con 0x7fb8a80b3610 2023-10-06T03:26:20.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.688+0000 7fb8a659c700 1 --2- 172.21.15.84:0/313711105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 0x7fb8a80b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:20.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a6d9d700 1 --2- 172.21.15.84:0/313711105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b2140 0x7fb8a80b25c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009e60 tx=0x7fb8a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9294238e2ea4fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:20.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a559a700 1 -- 172.21.15.84:0/313711105 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000e070 con 0x7fb8a80b2140 2023-10-06T03:26:20.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a559a700 1 -- 172.21.15.84:0/313711105 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a000bc30 con 0x7fb8a80b2140 2023-10-06T03:26:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a559a700 1 -- 172.21.15.84:0/313711105 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0012430 con 0x7fb8a80b2140 2023-10-06T03:26:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a759e700 1 -- 172.21.15.84:0/313711105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b2140 msgr2=0x7fb8a80b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a759e700 1 --2- 172.21.15.84:0/313711105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b2140 0x7fb8a80b25c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009e60 tx=0x7fb8a0009780 comp rx=0 tx=0).stop 2023-10-06T03:26:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a759e700 1 -- 172.21.15.84:0/313711105 shutdown_connections 2023-10-06T03:26:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a759e700 1 --2- 172.21.15.84:0/313711105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b2140 0x7fb8a80b25c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a759e700 1 --2- 172.21.15.84:0/313711105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 0x7fb8a80b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a759e700 1 -- 172.21.15.84:0/313711105 >> 172.21.15.84:0/313711105 conn(0x7fb8a806ed20 msgr2=0x7fb8a806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a759e700 1 -- 172.21.15.84:0/313711105 shutdown_connections 2023-10-06T03:26:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.689+0000 7fb8a759e700 1 -- 172.21.15.84:0/313711105 wait complete. 2023-10-06T03:26:20.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.690+0000 7fb8a759e700 1 Processor -- start 2023-10-06T03:26:20.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.690+0000 7fb8a759e700 1 -- start start 2023-10-06T03:26:20.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a80b2140 0x7fb8a80c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b3610 0x7fb8a80c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 0x7fb8a81559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a816a5f0 con 0x7fb8a80b3610 2023-10-06T03:26:20.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a80c97e0 con 0x7fb8a80b2140 2023-10-06T03:26:20.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a80c9ac0 con 0x7fb8a8159480 2023-10-06T03:26:20.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b3610 0x7fb8a80c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b3610 0x7fb8a80c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33452/0 (socket says 172.21.15.84:33452) 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a5d9b700 1 -- 172.21.15.84:0/125572519 learned_addr learned my addr 172.21.15.84:0/125572519 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a659c700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a80b2140 0x7fb8a80c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a5d9b700 1 -- 172.21.15.84:0/125572519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 msgr2=0x7fb8a81559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.691+0000 7fb8a6d9d700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 0x7fb8a81559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8a5d9b700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 0x7fb8a81559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8a5d9b700 1 -- 172.21.15.84:0/125572519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a80b2140 msgr2=0x7fb8a80c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8a5d9b700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a80b2140 0x7fb8a80c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8a5d9b700 1 -- 172.21.15.84:0/125572519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a0009a20 con 0x7fb8a80b3610 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8a659c700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a80b2140 0x7fb8a80c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8a5d9b700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b3610 0x7fb8a80c8d00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00c7e0 tx=0x7fb89c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:20.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8967fc700 1 -- 172.21.15.84:0/125572519 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c005b30 con 0x7fb8a80b3610 2023-10-06T03:26:20.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8967fc700 1 -- 172.21.15.84:0/125572519 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c005c90 con 0x7fb8a80b3610 2023-10-06T03:26:20.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8a759e700 1 -- 172.21.15.84:0/125572519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a80c9da0 con 0x7fb8a80b3610 2023-10-06T03:26:20.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8967fc700 1 -- 172.21.15.84:0/125572519 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c007300 con 0x7fb8a80b3610 2023-10-06T03:26:20.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.692+0000 7fb8a759e700 1 -- 172.21.15.84:0/125572519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a80c6710 con 0x7fb8a80b3610 2023-10-06T03:26:20.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.693+0000 7fb8a759e700 1 -- 172.21.15.84:0/125572519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a816a7a0 con 0x7fb8a80b3610 2023-10-06T03:26:20.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.693+0000 7fb8967fc700 1 -- 172.21.15.84:0/125572519 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb89c01b400 con 0x7fb8a80b3610 2023-10-06T03:26:20.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.694+0000 7fb8967fc700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb888066f30 0x7fb8880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:20.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.694+0000 7fb8a659c700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb888066f30 0x7fb8880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:20.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.694+0000 7fb8967fc700 1 -- 172.21.15.84:0/125572519 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb89c084280 con 0x7fb8a80b3610 2023-10-06T03:26:20.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.694+0000 7fb8a659c700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb888066f30 0x7fb8880693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb898006fd0 tx=0x7fb898008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:20.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.698+0000 7fb8967fc700 1 -- 172.21.15.84:0/125572519 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8a816a7a0 con 0x7fb8a80b3610 2023-10-06T03:26:20.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.924+0000 7fb8a759e700 1 -- 172.21.15.84:0/125572519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8a805f2c0 con 0x7fb8a80b3610 2023-10-06T03:26:20.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.924+0000 7fb8967fc700 1 -- 172.21.15.84:0/125572519 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb89c054d60 con 0x7fb8a80b3610 2023-10-06T03:26:20.925 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 -- 172.21.15.84:0/125572519 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb888066f30 msgr2=0x7fb8880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb888066f30 0x7fb8880693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb898006fd0 tx=0x7fb898008040 comp rx=0 tx=0).stop 2023-10-06T03:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 -- 172.21.15.84:0/125572519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b3610 msgr2=0x7fb8a80c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b3610 0x7fb8a80c8d00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00c7e0 tx=0x7fb89c007df0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 -- 172.21.15.84:0/125572519 shutdown_connections 2023-10-06T03:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb888066f30 0x7fb8880693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a80b2140 0x7fb8a80c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8a8159480 0x7fb8a81559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 --2- 172.21.15.84:0/125572519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a80b3610 0x7fb8a80c8d00 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 -- 172.21.15.84:0/125572519 >> 172.21.15.84:0/125572519 conn(0x7fb8a806ed20 msgr2=0x7fb8a8156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 -- 172.21.15.84:0/125572519 shutdown_connections 2023-10-06T03:26:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:20.926+0000 7fb8a759e700 1 -- 172.21.15.84:0/125572519 wait complete. 2023-10-06T03:26:20.938 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:26:20.938 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:26:20.939 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:26:20.939 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:26:20.939 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:26:20.939 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:26:20.939 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:26:20.939 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:26:20.939 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:26:20.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:20.939 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:26:20.954 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:26:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9c01:bbff:fec1:72ce/64 scope link 2023-10-06T03:26:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:20.957 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:26:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:26:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::74a6:25ff:fe2a:c673/64 scope link 2023-10-06T03:26:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:20.957 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:26:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether de:34:c5:3f:21:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:26:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc34:c5ff:fe3f:21c3/64 scope link 2023-10-06T03:26:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:20.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:20.958 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:26:21.017 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:26:21.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:21.019 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:26:21.075 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:26:21.075 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:26:21.076 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:26:21.076 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:26:21.076 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:26:21.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:21.077 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:26:21.077 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:26:21.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:26:21.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:26:21.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:26:21.077 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:26:21.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:21.175 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:26:21.189 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:26:21.189 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:26:21.189 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:26:21.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:21.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:26:21.254 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:26:21.254 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:26:21.308 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:26:21.308 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:26:21.309 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:26:21.363 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:26:21.363 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:26:21.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:21.443 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:21.443 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:21.461 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:21.461 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:21.461 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:26:21.462 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:26:21.462 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:26:21.462 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:26:21.462 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:26:21.462 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:26:21.484 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:21.484 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:21.484 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:26:21.484 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:26:21.484 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:26:21.484 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:26:21.484 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:26:21.484 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:26:21.485 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:26:21.485 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:26:21.485 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:26:21.486 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:26:21.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:21.486 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:26:21.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:26:21.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.705+0000 7f327f35b700 1 Processor -- start 2023-10-06T03:26:21.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.705+0000 7f327f35b700 1 -- start start 2023-10-06T03:26:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.706+0000 7f327f35b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32781595a0 0x7f32780aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.706+0000 7f327f35b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32780b49e0 0x7f32780aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.706+0000 7f327f35b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32780b0ca0 con 0x7f32780b07a0 2023-10-06T03:26:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.706+0000 7f327f35b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32780b0f80 con 0x7f32781595a0 2023-10-06T03:26:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.706+0000 7f327f35b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32780b1260 con 0x7f32780b49e0 2023-10-06T03:26:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.706+0000 7f327d0f7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32781595a0 0x7f32780aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.706+0000 7f327d8f8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f32780b07a0 0x7f32780b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34572/0 (socket says 172.21.15.84:34572) 2023-10-06T03:26:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.706+0000 7f327d8f8700 1 -- 172.21.15.84:0/2307883409 learned_addr learned my addr 172.21.15.84:0/2307883409 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327c8f6700 1 --2- 172.21.15.84:0/2307883409 >> v2:172.21.15.131:3300/0 conn(0x7f32780b49e0 0x7f32780aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327d0f7700 1 -- 172.21.15.84:0/2307883409 >> v2:172.21.15.131:3300/0 conn(0x7f32780b49e0 msgr2=0x7f32780aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327d0f7700 1 --2- 172.21.15.84:0/2307883409 >> v2:172.21.15.131:3300/0 conn(0x7f32780b49e0 0x7f32780aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327d0f7700 1 -- 172.21.15.84:0/2307883409 >> v1:172.21.15.84:6789/0 conn(0x7f32780b07a0 legacy=0x7f32780b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327d0f7700 1 -- 172.21.15.84:0/2307883409 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32780b1540 con 0x7f32781595a0 2023-10-06T03:26:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f326ffff700 1 -- 172.21.15.84:0/2307883409 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190744676 0 0) 0x7f32780b0ca0 con 0x7f32780b07a0 2023-10-06T03:26:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327c8f6700 1 --2- 172.21.15.84:0/2307883409 >> v2:172.21.15.131:3300/0 conn(0x7f32780b49e0 0x7f32780aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327d0f7700 1 --2- 172.21.15.84:0/2307883409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 0x7f32780aa570 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3274009eb0 tx=0x7f3274009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc600b94d9d7f17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f326ffff700 1 -- 172.21.15.84:0/2307883409 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400e070 con 0x7f32781595a0 2023-10-06T03:26:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f326ffff700 1 -- 172.21.15.84:0/2307883409 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400bbf0 con 0x7f32781595a0 2023-10-06T03:26:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f326ffff700 1 -- 172.21.15.84:0/2307883409 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274012430 con 0x7f32781595a0 2023-10-06T03:26:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327f35b700 1 -- 172.21.15.84:0/2307883409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 msgr2=0x7f32780aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327f35b700 1 --2- 172.21.15.84:0/2307883409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 0x7f32780aa570 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3274009eb0 tx=0x7f3274009780 comp rx=0 tx=0).stop 2023-10-06T03:26:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327f35b700 1 -- 172.21.15.84:0/2307883409 shutdown_connections 2023-10-06T03:26:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327f35b700 1 --2- 172.21.15.84:0/2307883409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 0x7f32780aa570 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327f35b700 1 --2- 172.21.15.84:0/2307883409 >> v2:172.21.15.131:3300/0 conn(0x7f32780b49e0 0x7f32780aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.707+0000 7f327f35b700 1 -- 172.21.15.84:0/2307883409 >> 172.21.15.84:0/2307883409 conn(0x7f3278099830 msgr2=0x7f327806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.708+0000 7f327f35b700 1 -- 172.21.15.84:0/2307883409 shutdown_connections 2023-10-06T03:26:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.708+0000 7f327f35b700 1 -- 172.21.15.84:0/2307883409 wait complete. 2023-10-06T03:26:21.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.709+0000 7f327f35b700 1 Processor -- start 2023-10-06T03:26:21.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.709+0000 7f327f35b700 1 -- start start 2023-10-06T03:26:21.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.709+0000 7f327f35b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32780b07a0 0x7f32780af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.709+0000 7f327f35b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32780b49e0 0x7f3278144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.709+0000 7f327f35b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 0x7f327815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.709+0000 7f327f35b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32781599f0 con 0x7f32781595a0 2023-10-06T03:26:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.709+0000 7f327f35b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327815a530 con 0x7f32780b49e0 2023-10-06T03:26:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.709+0000 7f327f35b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3278159c00 con 0x7f32780b07a0 2023-10-06T03:26:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327d8f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 0x7f327815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327d8f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 0x7f327815c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33458/0 (socket says 172.21.15.84:33458) 2023-10-06T03:26:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327d8f8700 1 -- 172.21.15.84:0/1099375948 learned_addr learned my addr 172.21.15.84:0/1099375948 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327d0f7700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32780b07a0 0x7f32780af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327d8f8700 1 -- 172.21.15.84:0/1099375948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32780b07a0 msgr2=0x7f32780af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327d8f8700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32780b07a0 0x7f32780af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327d8f8700 1 -- 172.21.15.84:0/1099375948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32780b49e0 msgr2=0x7f3278144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327d8f8700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32780b49e0 0x7f3278144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327d8f8700 1 -- 172.21.15.84:0/1099375948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3274009a20 con 0x7f32781595a0 2023-10-06T03:26:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327d8f8700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 0x7f327815c090 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f327000c7e0 tx=0x7f3270007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f326d7fa700 1 -- 172.21.15.84:0/1099375948 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270005c00 con 0x7f32781595a0 2023-10-06T03:26:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f326d7fa700 1 -- 172.21.15.84:0/1099375948 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270005d60 con 0x7f32781595a0 2023-10-06T03:26:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f326d7fa700 1 -- 172.21.15.84:0/1099375948 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270004a80 con 0x7f32781595a0 2023-10-06T03:26:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327f35b700 1 -- 172.21.15.84:0/1099375948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3278159ee0 con 0x7f32781595a0 2023-10-06T03:26:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.710+0000 7f327f35b700 1 -- 172.21.15.84:0/1099375948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32780af800 con 0x7f32781595a0 2023-10-06T03:26:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.711+0000 7f327f35b700 1 -- 172.21.15.84:0/1099375948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327815a6c0 con 0x7f32781595a0 2023-10-06T03:26:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.711+0000 7f326d7fa700 1 -- 172.21.15.84:0/1099375948 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3270005030 con 0x7f32781595a0 2023-10-06T03:26:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.712+0000 7f326d7fa700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f325c066f30 0x7f325c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.712+0000 7f326d7fa700 1 -- 172.21.15.84:0/1099375948 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3270083c40 con 0x7f32781595a0 2023-10-06T03:26:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.712+0000 7f327d0f7700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f325c066f30 0x7f325c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.712+0000 7f327d0f7700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f325c066f30 0x7f325c0693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f32740099f0 tx=0x7f3274017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.716+0000 7f326d7fa700 1 -- 172.21.15.84:0/1099375948 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f327004b5a0 con 0x7f32781595a0 2023-10-06T03:26:21.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.941+0000 7f327f35b700 1 -- 172.21.15.84:0/1099375948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3278064ad0 con 0x7f32781595a0 2023-10-06T03:26:21.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.941+0000 7f326d7fa700 1 -- 172.21.15.84:0/1099375948 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3270050c10 con 0x7f32781595a0 2023-10-06T03:26:21.942 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:26:21.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 -- 172.21.15.84:0/1099375948 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f325c066f30 msgr2=0x7f325c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:21.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f325c066f30 0x7f325c0693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f32740099f0 tx=0x7f3274017000 comp rx=0 tx=0).stop 2023-10-06T03:26:21.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 -- 172.21.15.84:0/1099375948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 msgr2=0x7f327815c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:21.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 0x7f327815c090 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f327000c7e0 tx=0x7f3270007d90 comp rx=0 tx=0).stop 2023-10-06T03:26:21.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 -- 172.21.15.84:0/1099375948 shutdown_connections 2023-10-06T03:26:21.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f325c066f30 0x7f325c0693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:21.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781595a0 0x7f327815c090 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:21.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32780b07a0 0x7f32780af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:21.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 --2- 172.21.15.84:0/1099375948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32780b49e0 0x7f3278144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:21.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 -- 172.21.15.84:0/1099375948 >> 172.21.15.84:0/1099375948 conn(0x7f3278099830 msgr2=0x7f3278068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:21.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 -- 172.21.15.84:0/1099375948 shutdown_connections 2023-10-06T03:26:21.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:21.943+0000 7f327f35b700 1 -- 172.21.15.84:0/1099375948 wait complete. 2023-10-06T03:26:21.956 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:26:21.956 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:26:21.956 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T03:26:21.956 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:26:21.956 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:26:21.956 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:26:21.957 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:26:21.957 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:26:21.957 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:26:21.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:21.957 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T03:26:21.976 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:26:21.976 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:26:21.976 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:26:21.976 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:21.976 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:26:21.976 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:21.976 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:21.976 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:21.976 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42371sec preferred_lft 42371sec 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:21.977 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::a0d2:65ff:fe0e:962d/64 scope link 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether e6:c9:c5:59:18:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::e4c9:c5ff:fe59:18bb/64 scope link 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:26:21.978 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4f1:c0ff:fe85:853d/64 scope link 2023-10-06T03:26:21.979 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:21.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:21.979 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:26:22.044 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T03:26:22.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:22.046 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T03:26:22.105 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T03:26:22.105 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:26:22.105 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:26:22.105 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:26:22.105 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:26:22.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:22.106 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:26:22.106 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:26:22.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:26:22.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:26:22.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:26:22.106 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:26:22.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:22.213 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:26:22.228 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:26:22.228 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:26:22.229 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:26:22.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:22.229 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-10-06T03:26:22.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:26:22.295 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:26:22.350 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:26:22.351 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:26:22.351 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:26:22.406 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T03:26:22.406 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:26:22.406 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:22.486 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:22.486 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:22.505 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:22.505 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:22.505 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:26:22.505 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:26:22.505 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:26:22.505 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:26:22.505 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:26:22.506 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:26:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:26:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:26:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:26:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:26:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:26:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:26:22.527 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:26:22.528 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:26:22.528 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:26:22.529 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:26:22.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:22.529 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:26:22.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2023-10-06T03:26:22.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.711+0000 7fd1e35da700 1 Processor -- start 2023-10-06T03:26:22.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.711+0000 7fd1e35da700 1 -- start start 2023-10-06T03:26:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.712+0000 7fd1e35da700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd1dc159510 0x7fd1dc0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.712+0000 7fd1e35da700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc0cbf20 con 0x7fd1dc0cbae0 2023-10-06T03:26:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.712+0000 7fd1e35da700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc0cf610 con 0x7fd1dc1598e0 2023-10-06T03:26:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.712+0000 7fd1e35da700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc0cf8f0 con 0x7fd1dc159510 2023-10-06T03:26:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.712+0000 7fd1e1b77700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd1dc0cbae0 0x7fd1dc0c56d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34582/0 (socket says 172.21.15.84:34582) 2023-10-06T03:26:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.712+0000 7fd1e1b77700 1 -- 172.21.15.84:0/1901636016 learned_addr learned my addr 172.21.15.84:0/1901636016 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.712+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116582190 0 0) 0x7fd1dc0cbf20 con 0x7fd1dc0cbae0 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.712+0000 7fd1e1376700 1 --2- 172.21.15.84:0/1901636016 >> v2:172.21.15.131:3300/0 conn(0x7fd1dc159510 0x7fd1dc0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.712+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c8003570 con 0x7fd1dc0cbae0 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 626579709 0 0) 0x7fd1c8003570 con 0x7fd1dc0cbae0 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 >> v2:172.21.15.131:3300/0 conn(0x7fd1dc159510 msgr2=0x7fd1dc0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 --2- 172.21.15.84:0/1901636016 >> v2:172.21.15.131:3300/0 conn(0x7fd1dc159510 0x7fd1dc0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 >> v1:172.21.15.131:6789/0 conn(0x7fd1dc1598e0 legacy=0x7fd1dc0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0cfbd0 con 0x7fd1dc0cbae0 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fd1d4001470 con 0x7fd1dc0cbae0 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 >> v1:172.21.15.84:6789/0 conn(0x7fd1dc0cbae0 legacy=0x7fd1dc0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1c8003a60 0x7fd1c8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c8004810 0x7fd1c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0cf8f0 con 0x7fd1c80051c0 2023-10-06T03:26:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800c050 con 0x7fd1c8003a60 2023-10-06T03:26:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800c210 con 0x7fd1c8004810 2023-10-06T03:26:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e1b77700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e1376700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1c8003a60 0x7fd1c8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e0b75700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c8004810 0x7fd1c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e1b77700 1 -- 172.21.15.84:0/1901636016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c8004810 msgr2=0x7fd1c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e1b77700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c8004810 0x7fd1c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e1b77700 1 -- 172.21.15.84:0/1901636016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1c8003a60 msgr2=0x7fd1c8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e1b77700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1c8003a60 0x7fd1c8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e1b77700 1 -- 172.21.15.84:0/1901636016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8003570 con 0x7fd1c80051c0 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e0b75700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c8004810 0x7fd1c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e1b77700 1 -- 172.21.15.84:0/1901636016 reap_dead start 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1e1b77700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1c800ba60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400c3c0 tx=0x7fd1d4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841c8d344c84c016 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d400cc90 con 0x7fd1c80051c0 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d400ce30 con 0x7fd1c80051c0 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.713+0000 7fd1d3fff700 1 -- 172.21.15.84:0/1901636016 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4005b70 con 0x7fd1c80051c0 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.714+0000 7fd1e35da700 1 -- 172.21.15.84:0/1901636016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 msgr2=0x7fd1c800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.714+0000 7fd1e35da700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1c800ba60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400c3c0 tx=0x7fd1d4001e70 comp rx=0 tx=0).stop 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.714+0000 7fd1e35da700 1 -- 172.21.15.84:0/1901636016 shutdown_connections 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.714+0000 7fd1e35da700 1 --2- 172.21.15.84:0/1901636016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1c800ba60 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.714+0000 7fd1e35da700 1 -- 172.21.15.84:0/1901636016 >> 172.21.15.84:0/1901636016 conn(0x7fd1dc089e90 msgr2=0x7fd1dc0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.714+0000 7fd1e35da700 1 -- 172.21.15.84:0/1901636016 shutdown_connections 2023-10-06T03:26:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.714+0000 7fd1e35da700 1 -- 172.21.15.84:0/1901636016 wait complete. 2023-10-06T03:26:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.715+0000 7fd1e35da700 1 Processor -- start 2023-10-06T03:26:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.715+0000 7fd1e35da700 1 -- start start 2023-10-06T03:26:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e35da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1dc146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e35da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc0c8a00 0x7fd1dc15acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e35da700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc0c8e70 0x7fd1dc15b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e35da700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0c9f80 con 0x7fd1c80051c0 2023-10-06T03:26:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e35da700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0c9370 con 0x7fd1dc0c8a00 2023-10-06T03:26:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e35da700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0c9650 con 0x7fd1dc0c8e70 2023-10-06T03:26:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e1376700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1dc146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e1376700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1dc146ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33480/0 (socket says 172.21.15.84:33480) 2023-10-06T03:26:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e1376700 1 -- 172.21.15.84:0/2696596977 learned_addr learned my addr 172.21.15.84:0/2696596977 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e0b75700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc0c8a00 0x7fd1dc15acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e1b77700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc0c8e70 0x7fd1dc15b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e1376700 1 -- 172.21.15.84:0/2696596977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc0c8e70 msgr2=0x7fd1dc15b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e1376700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc0c8e70 0x7fd1dc15b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e1376700 1 -- 172.21.15.84:0/2696596977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc0c8a00 msgr2=0x7fd1dc15acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e1376700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc0c8a00 0x7fd1dc15acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.716+0000 7fd1e1376700 1 -- 172.21.15.84:0/2696596977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0c9930 con 0x7fd1c80051c0 2023-10-06T03:26:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.717+0000 7fd1e1376700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1dc146ea0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009fd0 tx=0x7fd1d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.717+0000 7fd1d17fa700 1 -- 172.21.15.84:0/2696596977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800e040 con 0x7fd1c80051c0 2023-10-06T03:26:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.717+0000 7fd1d17fa700 1 -- 172.21.15.84:0/2696596977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800f040 con 0x7fd1c80051c0 2023-10-06T03:26:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.717+0000 7fd1e35da700 1 -- 172.21.15.84:0/2696596977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc0c9c10 con 0x7fd1c80051c0 2023-10-06T03:26:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.717+0000 7fd1d17fa700 1 -- 172.21.15.84:0/2696596977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800fda0 con 0x7fd1c80051c0 2023-10-06T03:26:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.717+0000 7fd1e35da700 1 -- 172.21.15.84:0/2696596977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc1473e0 con 0x7fd1c80051c0 2023-10-06T03:26:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.718+0000 7fd1e35da700 1 -- 172.21.15.84:0/2696596977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc0ca260 con 0x7fd1c80051c0 2023-10-06T03:26:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.718+0000 7fd1d17fa700 1 -- 172.21.15.84:0/2696596977 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1d8015640 con 0x7fd1c80051c0 2023-10-06T03:26:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.719+0000 7fd1d17fa700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1c0066f30 0x7fd1c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.719+0000 7fd1d17fa700 1 -- 172.21.15.84:0/2696596977 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd1d8085330 con 0x7fd1c80051c0 2023-10-06T03:26:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.719+0000 7fd1e0b75700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1c0066f30 0x7fd1c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.719+0000 7fd1e0b75700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1c0066f30 0x7fd1c00693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0ccbb0 tx=0x7fd1cc00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.723+0000 7fd1d17fa700 1 -- 172.21.15.84:0/2696596977 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1d8052300 con 0x7fd1c80051c0 2023-10-06T03:26:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.903+0000 7fd1e35da700 1 -- 172.21.15.84:0/2696596977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) v1 -- 0x7fd1dc064ad0 con 0x7fd1c80051c0 2023-10-06T03:26:22.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.907+0000 7fd1d17fa700 1 -- 172.21.15.84:0/2696596977 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v19)=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd1d8055920 con 0x7fd1c80051c0 2023-10-06T03:26:22.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 -- 172.21.15.84:0/2696596977 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1c0066f30 msgr2=0x7fd1c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:22.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1c0066f30 0x7fd1c00693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0ccbb0 tx=0x7fd1cc00c040 comp rx=0 tx=0).stop 2023-10-06T03:26:22.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 -- 172.21.15.84:0/2696596977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 msgr2=0x7fd1dc146ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:22.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1dc146ea0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009fd0 tx=0x7fd1d800b040 comp rx=0 tx=0).stop 2023-10-06T03:26:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 -- 172.21.15.84:0/2696596977 shutdown_connections 2023-10-06T03:26:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd1c0066f30 0x7fd1c00693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc0c8e70 0x7fd1dc15b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c80051c0 0x7fd1dc146ea0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 --2- 172.21.15.84:0/2696596977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc0c8a00 0x7fd1dc15acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 -- 172.21.15.84:0/2696596977 >> 172.21.15.84:0/2696596977 conn(0x7fd1dc089e90 msgr2=0x7fd1dc152950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 -- 172.21.15.84:0/2696596977 shutdown_connections 2023-10-06T03:26:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:22.909+0000 7fd1e35da700 1 -- 172.21.15.84:0/2696596977 wait complete. 2023-10-06T03:26:22.921 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:26:22.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:26:22.922 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:26:22.964 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:26:22.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:22.964 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:26:23.019 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:26:23.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:26:23.020 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:26:23.059 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:26:23.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:23.060 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:26:23.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:23.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.228+0000 7fa67aeb5700 1 Processor -- start 2023-10-06T03:26:23.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.228+0000 7fa67aeb5700 1 -- start start 2023-10-06T03:26:23.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.229+0000 7fa67aeb5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b49e0 0x7fa6740aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.229+0000 7fa67aeb5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6740b07a0 0x7fa6740b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.229+0000 7fa67aeb5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6740b0ca0 con 0x7fa6741595a0 2023-10-06T03:26:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.229+0000 7fa67aeb5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6740b0f80 con 0x7fa6740b07a0 2023-10-06T03:26:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.229+0000 7fa67aeb5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740b1260 con 0x7fa6740b49e0 2023-10-06T03:26:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.229+0000 7fa678c51700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa6741595a0 0x7fa6740aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34590/0 (socket says 172.21.15.84:34590) 2023-10-06T03:26:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.229+0000 7fa678c51700 1 -- 172.21.15.84:0/1332435418 learned_addr learned my addr 172.21.15.84:0/1332435418 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.229+0000 7fa679452700 1 --2- 172.21.15.84:0/1332435418 >> v2:172.21.15.131:3300/0 conn(0x7fa6740b07a0 0x7fa6740b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.229+0000 7fa66bfff700 1 --2- 172.21.15.84:0/1332435418 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b49e0 0x7fa6740aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa66b7fe700 1 -- 172.21.15.84:0/1332435418 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760346699 0 0) 0x7fa6740b0ca0 con 0x7fa6741595a0 2023-10-06T03:26:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa66b7fe700 1 -- 172.21.15.84:0/1332435418 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65c003570 con 0x7fa6741595a0 2023-10-06T03:26:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa679452700 1 -- 172.21.15.84:0/1332435418 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b49e0 msgr2=0x7fa6740aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa679452700 1 --2- 172.21.15.84:0/1332435418 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b49e0 0x7fa6740aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa679452700 1 -- 172.21.15.84:0/1332435418 >> v1:172.21.15.84:6789/0 conn(0x7fa6741595a0 legacy=0x7fa6740aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa679452700 1 -- 172.21.15.84:0/1332435418 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6740b1540 con 0x7fa6740b07a0 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa66bfff700 1 --2- 172.21.15.84:0/1332435418 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b49e0 0x7fa6740aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa679452700 1 --2- 172.21.15.84:0/1332435418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6740b07a0 0x7fa6740b1c00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0098e0 tx=0x7fa66c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54ddb4a2fb86fdc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa66b7fe700 1 -- 172.21.15.84:0/1332435418 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c011630 con 0x7fa6740b07a0 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa66b7fe700 1 -- 172.21.15.84:0/1332435418 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c011790 con 0x7fa6740b07a0 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.230+0000 7fa66b7fe700 1 -- 172.21.15.84:0/1332435418 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c011b30 con 0x7fa6740b07a0 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.231+0000 7fa67aeb5700 1 -- 172.21.15.84:0/1332435418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6740b07a0 msgr2=0x7fa6740b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.231+0000 7fa67aeb5700 1 --2- 172.21.15.84:0/1332435418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6740b07a0 0x7fa6740b1c00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0098e0 tx=0x7fa66c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.231+0000 7fa67aeb5700 1 -- 172.21.15.84:0/1332435418 shutdown_connections 2023-10-06T03:26:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.231+0000 7fa67aeb5700 1 --2- 172.21.15.84:0/1332435418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6740b07a0 0x7fa6740b1c00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.231+0000 7fa67aeb5700 1 --2- 172.21.15.84:0/1332435418 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b49e0 0x7fa6740aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.231+0000 7fa67aeb5700 1 -- 172.21.15.84:0/1332435418 >> 172.21.15.84:0/1332435418 conn(0x7fa674099830 msgr2=0x7fa67406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:23.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.231+0000 7fa67aeb5700 1 -- 172.21.15.84:0/1332435418 shutdown_connections 2023-10-06T03:26:23.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.231+0000 7fa67aeb5700 1 -- 172.21.15.84:0/1332435418 wait complete. 2023-10-06T03:26:23.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.232+0000 7fa67aeb5700 1 Processor -- start 2023-10-06T03:26:23.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.232+0000 7fa67aeb5700 1 -- start start 2023-10-06T03:26:23.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa67aeb5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b07a0 0x7fa674144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa67aeb5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6740b49e0 0x7fa67415add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa67aeb5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6741595a0 0x7fa67415c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa67aeb5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa674144e80 con 0x7fa6740b49e0 2023-10-06T03:26:23.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa67aeb5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67415a940 con 0x7fa6741595a0 2023-10-06T03:26:23.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa67aeb5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67415b310 con 0x7fa6740b07a0 2023-10-06T03:26:23.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa66bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6740b49e0 0x7fa67415add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa66bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6740b49e0 0x7fa67415add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33482/0 (socket says 172.21.15.84:33482) 2023-10-06T03:26:23.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa66bfff700 1 -- 172.21.15.84:0/752299086 learned_addr learned my addr 172.21.15.84:0/752299086 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa678c51700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b07a0 0x7fa674144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa679452700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6741595a0 0x7fa67415c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa66bfff700 1 -- 172.21.15.84:0/752299086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b07a0 msgr2=0x7fa674144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa66bfff700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b07a0 0x7fa674144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa66bfff700 1 -- 172.21.15.84:0/752299086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6741595a0 msgr2=0x7fa67415c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa66bfff700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6741595a0 0x7fa67415c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa66bfff700 1 -- 172.21.15.84:0/752299086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa664009420 con 0x7fa6740b49e0 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa678c51700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b07a0 0x7fa674144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa679452700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6741595a0 0x7fa67415c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa66bfff700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6740b49e0 0x7fa67415add0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa66400ec80 tx=0x7fa6640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa668ff9700 1 -- 172.21.15.84:0/752299086 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66400c9d0 con 0x7fa6740b49e0 2023-10-06T03:26:23.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa668ff9700 1 -- 172.21.15.84:0/752299086 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66400cb30 con 0x7fa6740b49e0 2023-10-06T03:26:23.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa67aeb5700 1 -- 172.21.15.84:0/752299086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c009420 con 0x7fa6740b49e0 2023-10-06T03:26:23.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa668ff9700 1 -- 172.21.15.84:0/752299086 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66400ceb0 con 0x7fa6740b49e0 2023-10-06T03:26:23.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.233+0000 7fa67aeb5700 1 -- 172.21.15.84:0/752299086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67415a010 con 0x7fa6740b49e0 2023-10-06T03:26:23.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.234+0000 7fa67aeb5700 1 -- 172.21.15.84:0/752299086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67415aad0 con 0x7fa6740b49e0 2023-10-06T03:26:23.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.235+0000 7fa668ff9700 1 -- 172.21.15.84:0/752299086 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa664013680 con 0x7fa6740b49e0 2023-10-06T03:26:23.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.235+0000 7fa668ff9700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa660066f30 0x7fa6600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.235+0000 7fa668ff9700 1 -- 172.21.15.84:0/752299086 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa664084cc0 con 0x7fa6740b49e0 2023-10-06T03:26:23.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.235+0000 7fa678c51700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa660066f30 0x7fa6600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.236+0000 7fa678c51700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa660066f30 0x7fa6600693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa670007fd0 tx=0x7fa670009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:23.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.239+0000 7fa668ff9700 1 -- 172.21.15.84:0/752299086 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa66408b080 con 0x7fa6740b49e0 2023-10-06T03:26:23.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.465+0000 7fa67aeb5700 1 -- 172.21.15.84:0/752299086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa674064ad0 con 0x7fa6740b49e0 2023-10-06T03:26:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.465+0000 7fa668ff9700 1 -- 172.21.15.84:0/752299086 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa664051bf0 con 0x7fa6740b49e0 2023-10-06T03:26:23.466 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:23.466 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1214313207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1214313207},{"type":"v1","addr":"172.21.15.131:6835","nonce":1214313207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/63470384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":63470384},{"type":"v1","addr":"172.21.15.84:6837","nonce":63470384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3440632646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3440632646},{"type":"v1","addr":"172.21.15.131:6834","nonce":3440632646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:09.642630+0000","modified":"2023-10-06T03:26:13.283595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/390518387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":390518387},{"type":"v1","addr":"172.21.15.84:6836","nonce":390518387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:26:23.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.467+0000 7fa67aeb5700 1 -- 172.21.15.84:0/752299086 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa660066f30 msgr2=0x7fa6600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.467+0000 7fa67aeb5700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa660066f30 0x7fa6600693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa670007fd0 tx=0x7fa670009040 comp rx=0 tx=0).stop 2023-10-06T03:26:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.467+0000 7fa67aeb5700 1 -- 172.21.15.84:0/752299086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6740b49e0 msgr2=0x7fa67415add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.467+0000 7fa67aeb5700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6740b49e0 0x7fa67415add0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa66400ec80 tx=0x7fa6640091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.467+0000 7fa67aeb5700 1 -- 172.21.15.84:0/752299086 shutdown_connections 2023-10-06T03:26:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.467+0000 7fa67aeb5700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa660066f30 0x7fa6600693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.467+0000 7fa67aeb5700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6741595a0 0x7fa67415c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.467+0000 7fa67aeb5700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6740b07a0 0x7fa674144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.468+0000 7fa67aeb5700 1 --2- 172.21.15.84:0/752299086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6740b49e0 0x7fa67415add0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.468+0000 7fa67aeb5700 1 -- 172.21.15.84:0/752299086 >> 172.21.15.84:0/752299086 conn(0x7fa674099830 msgr2=0x7fa6740cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.468+0000 7fa67aeb5700 1 -- 172.21.15.84:0/752299086 shutdown_connections 2023-10-06T03:26:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.468+0000 7fa67aeb5700 1 -- 172.21.15.84:0/752299086 wait complete. 2023-10-06T03:26:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 39 2023-10-06T03:26:23.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2023-10-06T03:26:23.612 INFO:teuthology.orchestra.run.smithi084.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":62,"msgr_send_messages":55,"msgr_recv_bytes":110157,"msgr_send_bytes":19199,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.005429667,"msgr_running_send_time":0.000950560,"msgr_running_recv_time":0.004945942,"msgr_running_fast_dispatch_time":0.000297877,"msgr_send_messages_queue_lat":{"avgcount":55,"sum":0.033889101,"avgtime":0.000616165},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":21,"msgr_send_messages":26,"msgr_recv_bytes":4657,"msgr_send_bytes":110085,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.004492731,"msgr_running_send_time":0.000769393,"msgr_running_recv_time":0.003359111,"msgr_running_fast_dispatch_time":0.000263563,"msgr_send_messages_queue_lat":{"avgcount":25,"sum":0.013233719,"avgtime":0.000529348},"msgr_handle_ack_lat":{"avgcount":7,"sum":0.000002769,"avgtime":0.000000395}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":30,"msgr_send_messages":31,"msgr_recv_bytes":7595,"msgr_send_bytes":15780,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.003273179,"msgr_running_send_time":0.000389673,"msgr_running_recv_time":0.002249717,"msgr_running_fast_dispatch_time":0.000554779,"msgr_send_messages_queue_lat":{"avgcount":30,"sum":0.112754002,"avgtime":0.003758466},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000001565,"avgtime":0.000000782}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":42,"sum":0.003258230,"avgtime":0.000077576}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000012683,"avgtime":0.000006341}},"mds":{"request":4,"reply":4,"reply_latency":{"avgcount":4,"sum":0.000824015,"avgtime":0.000206003},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":7,"traverse_hit":7,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":233,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196957,"rdpos":0,"jlat":{"avgcount":5,"sum":0.010781480,"avgtime":0.002156296},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":36448,"heap":207104},"mds_server":{"dispatch_client_request":4,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":3,"sum":0.000563022,"avgtime":0.000187674},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000260993,"avgtime":0.000260993},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":3,"average_load":1,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":212424,"buffer_anon_items":56,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6216,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50464,"mds_co_items":205,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13597,"op_resend":30,"op_reply":43,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":74,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":107,"get_sum":108822,"get_or_fail_fail":0,"get_or_fail_success":107,"take":0,"take_sum":0,"put":107,"put_sum":108822,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13597,"put":43,"put_sum":13597,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x560a6392fe00":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":2653,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":5,"put_sum":2653,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:26:23.614 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 110157, "msgr_recv_messages": 62, "msgr_running_fast_dispatch_time": 0.000297877, "msgr_running_recv_time": 0.004945942, "msgr_running_send_time": 0.00095056, "msgr_running_total_time": 0.005429667, "msgr_send_bytes": 19199, "msgr_send_messages": 55, "msgr_send_messages_queue_lat": { "avgcount": 55, "avgtime": 0.000616165, "sum": 0.033889101 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 7, "avgtime": 3.95e-07, "sum": 2.769e-06 }, "msgr_recv_bytes": 4657, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000263563, "msgr_running_recv_time": 0.003359111, "msgr_running_send_time": 0.000769393, "msgr_running_total_time": 0.004492731, "msgr_send_bytes": 110085, "msgr_send_messages": 26, "msgr_send_messages_queue_lat": { "avgcount": 25, "avgtime": 0.000529348, "sum": 0.013233719 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 7.82e-07, "sum": 1.565e-06 }, "msgr_recv_bytes": 7595, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.000554779, "msgr_running_recv_time": 0.002249717, "msgr_running_send_time": 0.000389673, "msgr_running_total_time": 0.003273179, "msgr_send_bytes": 15780, "msgr_send_messages": 31, "msgr_send_messages_queue_lat": { "avgcount": 30, "avgtime": 0.003758466, "sum": 0.112754002 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 42, "avgtime": 7.7576e-05, "sum": 0.00325823 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.341e-06, "sum": 1.2683e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 233, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 4, "reply_latency": { "avgcount": 4, "avgtime": 0.000206003, "sum": 0.000824015 }, "request": 4, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 7, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 7, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002156296, "sum": 0.01078148 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196957 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207104, "ino": 13, "ino+": 13, "ino-": 0, "rss": 36448 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 3, "avgtime": 0.000187674, "sum": 0.000563022 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000260993, "sum": 0.000260993 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 3 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 212424, "buffer_anon_items": 56, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50464, "mds_co_items": 205, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6216, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 74, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 30, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13597, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 107, "get_or_fail_fail": 0, "get_or_fail_success": 107, "get_started": 0, "get_sum": 108822, "max": 104857600, "put": 107, "put_sum": 108822, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13597, "take": 43, "take_sum": 13597, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x560a6392fe00": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 2653, "max": 3758096384, "put": 5, "put_sum": 2653, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:26:23.615 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 session ls 2023-10-06T03:26:23.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.730+0000 7fc631ecc700 1 Processor -- start 2023-10-06T03:26:23.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.730+0000 7fc631ecc700 1 -- start start 2023-10-06T03:26:23.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.731+0000 7fc631ecc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c0b2a90 0x7fc62c0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.731+0000 7fc631ecc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c0cbdf0 con 0x7fc62c0c6610 2023-10-06T03:26:23.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.731+0000 7fc631ecc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c0b2e60 con 0x7fc62c0cb980 2023-10-06T03:26:23.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.731+0000 7fc631ecc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0cf5d0 con 0x7fc62c0b2a90 2023-10-06T03:26:23.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.731+0000 7fc62bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc62c0c6610 0x7fc62c1631a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34594/0 (socket says 172.21.15.84:34594) 2023-10-06T03:26:23.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.731+0000 7fc62bfff700 1 -- 172.21.15.84:0/3846045482 learned_addr learned my addr 172.21.15.84:0/3846045482 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:23.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.731+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c0b2a90 0x7fc62c0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.731+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121180264 0 0) 0x7fc62c0cbdf0 con 0x7fc62c0c6610 2023-10-06T03:26:23.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc614003570 con 0x7fc62c0c6610 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313970058 0 0) 0x7fc614003570 con 0x7fc62c0c6610 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c0b2a90 msgr2=0x7fc62c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c0b2a90 0x7fc62c0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 >> v1:172.21.15.131:6789/0 conn(0x7fc62c0cb980 legacy=0x7fc62c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c0cf8b0 con 0x7fc62c0c6610 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fc624001470 con 0x7fc62c0c6610 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 >> v1:172.21.15.84:6789/0 conn(0x7fc62c0c6610 legacy=0x7fc62c1631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c0b2a90 0x7fc614003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc614004010 0x7fc614004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc614004d50 0x7fc6140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0cf5d0 con 0x7fc614004010 2023-10-06T03:26:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61400bbf0 con 0x7fc614004d50 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61400bdb0 con 0x7fc62c0b2a90 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62affd700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc614004010 0x7fc614004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c0b2a90 0x7fc614003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62bfff700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc614004d50 0x7fc6140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62affd700 1 -- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c0b2a90 msgr2=0x7fc614003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62affd700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c0b2a90 0x7fc614003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62affd700 1 -- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc614004d50 msgr2=0x7fc6140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62affd700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc614004d50 0x7fc6140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62affd700 1 -- 172.21.15.84:0/3846045482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc614003570 con 0x7fc614004010 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62bfff700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc614004d50 0x7fc6140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.732+0000 7fc62affd700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc614004010 0x7fc614004810 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc620001880 tx=0x7fc620007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c5e57691a24970 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.733+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620012420 con 0x7fc614004010 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.733+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620012580 con 0x7fc614004010 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.733+0000 7fc62a7fc700 1 -- 172.21.15.84:0/3846045482 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620012920 con 0x7fc614004010 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.733+0000 7fc631ecc700 1 -- 172.21.15.84:0/3846045482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc614004010 msgr2=0x7fc614004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.733+0000 7fc631ecc700 1 --2- 172.21.15.84:0/3846045482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc614004010 0x7fc614004810 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc620001880 tx=0x7fc620007d30 comp rx=0 tx=0).stop 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.733+0000 7fc62bfff700 1 -- 172.21.15.84:0/3846045482 reap_dead start 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.733+0000 7fc631ecc700 1 -- 172.21.15.84:0/3846045482 shutdown_connections 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.733+0000 7fc631ecc700 1 -- 172.21.15.84:0/3846045482 >> 172.21.15.84:0/3846045482 conn(0x7fc62c099740 msgr2=0x7fc62c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.733+0000 7fc631ecc700 1 -- 172.21.15.84:0/3846045482 shutdown_connections 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.733+0000 7fc631ecc700 1 -- 172.21.15.84:0/3846045482 wait complete. 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.734+0000 7fc631ecc700 1 Processor -- start 2023-10-06T03:26:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.734+0000 7fc631ecc700 1 -- start start 2023-10-06T03:26:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc631ecc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc614004010 0x7fc62c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc631ecc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c09d7a0 0x7fc62c0cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc631ecc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62c0c7e20 0x7fc62c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc631ecc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c09c4f0 con 0x7fc62c0c7e20 2023-10-06T03:26:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc631ecc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c156140 con 0x7fc614004010 2023-10-06T03:26:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc631ecc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0c87d0 con 0x7fc62c09d7a0 2023-10-06T03:26:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62c0c7e20 0x7fc62c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62c0c7e20 0x7fc62c0c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33500/0 (socket says 172.21.15.84:33500) 2023-10-06T03:26:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62bfff700 1 -- 172.21.15.84:0/2345376899 learned_addr learned my addr 172.21.15.84:0/2345376899 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc614004010 0x7fc62c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62affd700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c09d7a0 0x7fc62c0cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62bfff700 1 -- 172.21.15.84:0/2345376899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c09d7a0 msgr2=0x7fc62c0cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62bfff700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c09d7a0 0x7fc62c0cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62bfff700 1 -- 172.21.15.84:0/2345376899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc614004010 msgr2=0x7fc62c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62bfff700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc614004010 0x7fc62c155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62bfff700 1 -- 172.21.15.84:0/2345376899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c09d310 con 0x7fc62c0c7e20 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.735+0000 7fc62bfff700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62c0c7e20 0x7fc62c0c8290 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc624000c00 tx=0x7fc624000f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.736+0000 7fc6137fe700 1 -- 172.21.15.84:0/2345376899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624012590 con 0x7fc62c0c7e20 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.736+0000 7fc6137fe700 1 -- 172.21.15.84:0/2345376899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6240126f0 con 0x7fc62c0c7e20 2023-10-06T03:26:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.736+0000 7fc631ecc700 1 -- 172.21.15.84:0/2345376899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c09c700 con 0x7fc62c0c7e20 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.736+0000 7fc6137fe700 1 -- 172.21.15.84:0/2345376899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624012a90 con 0x7fc62c0c7e20 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.736+0000 7fc631ecc700 1 -- 172.21.15.84:0/2345376899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c09ccc0 con 0x7fc62c0c7e20 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.737+0000 7fc6137fe700 1 -- 172.21.15.84:0/2345376899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc62401d460 con 0x7fc62c0c7e20 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.738+0000 7fc6137fe700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc618066f60 0x7fc618069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.738+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc618066f60 0x7fc618069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.738+0000 7fc6137fe700 1 -- 172.21.15.84:0/2345376899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc624084530 con 0x7fc62c0c7e20 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.738+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc618066f60 0x7fc618069410 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0094d0 tx=0x7fc61c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.740+0000 7fc63b1c4b80 1 Processor -- start 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.740+0000 7fc63b1c4b80 1 -- start start 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.740+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e13278cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.740+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 0x55e1327dc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.740+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.740+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1326e3ac0 con 0x55e1327dcc50 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.740+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1326e12c0 con 0x55e13278c890 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.740+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1326dd0b0 con 0x55e13278dd10 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327dd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327dd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33504/0 (socket says 172.21.15.84:33504) 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62bfff700 1 -- 172.21.15.84:0/1898508850 learned_addr learned my addr 172.21.15.84:0/1898508850 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62affd700 1 --2- 172.21.15.84:0/1898508850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 0x55e1327dc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/1898508850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e13278cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62bfff700 1 -- 172.21.15.84:0/1898508850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 msgr2=0x55e1327dc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62bfff700 1 --2- 172.21.15.84:0/1898508850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 0x55e1327dc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62bfff700 1 -- 172.21.15.84:0/1898508850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 msgr2=0x55e13278cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62bfff700 1 --2- 172.21.15.84:0/1898508850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e13278cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62bfff700 1 -- 172.21.15.84:0/1898508850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1325772c0 con 0x55e1327dcc50 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62affd700 1 --2- 172.21.15.84:0/1898508850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 0x55e1327dc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc62bfff700 1 --2- 172.21.15.84:0/1898508850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327dd0a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc62400a040 tx=0x7fc624082670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb52645a6f2eb2b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc610ff9700 1 -- 172.21.15.84:0/1898508850 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624057040 con 0x55e1327dcc50 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc610ff9700 1 -- 172.21.15.84:0/1898508850 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6240551a0 con 0x55e1327dcc50 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.741+0000 7fc610ff9700 1 -- 172.21.15.84:0/1898508850 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624058370 con 0x55e1327dcc50 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.742+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/1898508850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 msgr2=0x55e1327dd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.742+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/1898508850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327dd0a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc62400a040 tx=0x7fc624082670 comp rx=0 tx=0).stop 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.742+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/1898508850 shutdown_connections 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.742+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/1898508850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e13278cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.742+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/1898508850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327dd0a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.742+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/1898508850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 0x55e1327dc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.742+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/1898508850 >> 172.21.15.84:0/1898508850 conn(0x55e13278e1b0 msgr2=0x55e13278e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:23.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.742+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/1898508850 shutdown_connections 2023-10-06T03:26:23.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.742+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/1898508850 wait complete. 2023-10-06T03:26:23.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.742+0000 7fc63b1c4b80 1 -- start start 2023-10-06T03:26:23.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc63b1c4b80 1 Processor -- start 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e1327dba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 0x55e1327cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327890e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1326888e0 con 0x55e1327dcc50 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1326a3ef0 con 0x55e13278c890 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e13255fe80 con 0x55e13278dd10 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc63b1c4b80 10 client.0 _ll_register_callbacks cb 0x55e13274fec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327890e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327890e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33514/0 (socket says 172.21.15.84:33514) 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.743+0000 7fc62bfff700 1 -- 172.21.15.84:0/4209695404 learned_addr learned my addr 172.21.15.84:0/4209695404 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc62affd700 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 0x55e1327cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e1327dba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc62bfff700 1 -- 172.21.15.84:0/4209695404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 msgr2=0x55e1327cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc62bfff700 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 0x55e1327cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc62bfff700 1 -- 172.21.15.84:0/4209695404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 msgr2=0x55e1327dba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc62bfff700 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e1327dba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc62bfff700 1 -- 172.21.15.84:0/4209695404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c09ccc0 con 0x55e1327dcc50 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc62bfff700 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327890e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc62406a040 tx=0x7fc624068000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba99a6ee90d91909 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc609ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc609ffb700 1 -- 172.21.15.84:0/4209695404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6240534c0 con 0x55e1327dcc50 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc609ffb700 1 -- 172.21.15.84:0/4209695404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc624082030 con 0x55e1327dcc50 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/4209695404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e132781990 con 0x55e1327dcc50 2023-10-06T03:26:23.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc609ffb700 1 -- 172.21.15.84:0/4209695404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc624054820 con 0x55e1327dcc50 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc63b1c4b80 10 client.6438 fetch_fsmap learned FSMap version 39 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/4209695404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55e13251a030 con 0x55e1327dcc50 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc609ffb700 1 -- 172.21.15.84:0/4209695404 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc624074020 con 0x55e1327dcc50 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc609ffb700 1 -- 172.21.15.84:0/4209695404 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc62405bc30 con 0x55e1327dcc50 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc63b1c4b80 10 client.6438 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc63b1c4b80 10 client.6438 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc63b1c4b80 20 client.6438 populate_metadata read hostname 'smithi084' 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x55e1327d96f0 0x55e1327cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc63b1c4b80 4 client.6438 mds_command: new command op to 6207 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.744+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/4209695404 --> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e13275e8c0 con 0x55e1327d96f0 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x55e1327d96f0 0x55e1327cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc609ffb700 10 client.6438 ms_handle_connect on v2:172.21.15.84:6834/390518387 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x55e1327d96f0 0x55e1327cb290 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4986be9334b7b07 server_cookie=23f4a68415ee5656 in_seq=0 out_seq=0 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc609ffb700 1 -- 172.21.15.84:0/4209695404 <== mds.0 v2:172.21.15.84:6834/390518387 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e13275e8c0 con 0x55e1327d96f0 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc609ffb700 10 client.6438 handle_command_reply: tid=0 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc63b1c4b80 1 client.6438 shutdown 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/4209695404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 msgr2=0x55e1327890e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327890e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc62406a040 tx=0x7fc624068000 comp rx=0 tx=0).stop 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/4209695404 shutdown_connections 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x55e1327d96f0 0x55e1327cb290 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e1327dba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc609ffb700 0 client.6438 ms_handle_reset on v2:172.21.15.84:6834/390518387 2023-10-06T03:26:23.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327890e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/4209695404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278dd10 0x55e1327cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.745+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/4209695404 >> 172.21.15.84:0/4209695404 conn(0x55e13278e1b0 msgr2=0x55e13278d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:23.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.746+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/4209695404 shutdown_connections 2023-10-06T03:26:23.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.746+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/4209695404 wait complete. 2023-10-06T03:26:23.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.746+0000 7fc63b1c4b80 20 client.6438 trim_cache size 0 max 16384 2023-10-06T03:26:23.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.763+0000 7fc63b1c4b80 1 Processor -- start 2023-10-06T03:26:23.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.763+0000 7fc63b1c4b80 1 -- start start 2023-10-06T03:26:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.763+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278c890 0x55e132788fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.763+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.763+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327da080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.763+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1327db580 con 0x55e1327dcc50 2023-10-06T03:26:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.763+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1327cb4b0 con 0x55e13278dd10 2023-10-06T03:26:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.763+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1327d1e30 con 0x55e13278c890 2023-10-06T03:26:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327da080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327da080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33522/0 (socket says 172.21.15.84:33522) 2023-10-06T03:26:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62bfff700 1 -- 172.21.15.84:0/1606942124 learned_addr learned my addr 172.21.15.84:0/1606942124 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278c890 0x55e132788fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62affd700 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62bfff700 1 -- 172.21.15.84:0/1606942124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278c890 msgr2=0x55e132788fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62bfff700 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278c890 0x55e132788fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62bfff700 1 -- 172.21.15.84:0/1606942124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278dd10 msgr2=0x55e1327d9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62bfff700 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62bfff700 1 -- 172.21.15.84:0/1606942124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1327dc430 con 0x55e1327dcc50 2023-10-06T03:26:23.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278c890 0x55e132788fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:23.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62affd700 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:23.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc62bfff700 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327da080 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc624001100 tx=0x7fc62407e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bf8918ea8836ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:23.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc6117fa700 1 -- 172.21.15.84:0/1606942124 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624057070 con 0x55e1327dcc50 2023-10-06T03:26:23.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc6117fa700 1 -- 172.21.15.84:0/1606942124 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc624074070 con 0x55e1327dcc50 2023-10-06T03:26:23.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.764+0000 7fc6117fa700 1 -- 172.21.15.84:0/1606942124 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624058370 con 0x55e1327dcc50 2023-10-06T03:26:23.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/1606942124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 msgr2=0x55e1327da080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327da080 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc624001100 tx=0x7fc62407e070 comp rx=0 tx=0).stop 2023-10-06T03:26:23.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/1606942124 shutdown_connections 2023-10-06T03:26:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e1327dcc50 0x55e1327da080 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e13278c890 0x55e132788fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/1606942124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/1606942124 >> 172.21.15.84:0/1606942124 conn(0x55e13278e1b0 msgr2=0x55e13278d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/1606942124 shutdown_connections 2023-10-06T03:26:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/1606942124 wait complete. 2023-10-06T03:26:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 -- start start 2023-10-06T03:26:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.765+0000 7fc63b1c4b80 1 Processor -- start 2023-10-06T03:26:23.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e1327db470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc63b1c4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1327dcc50 0x55e1327da080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e132839f20 con 0x55e13278dd10 2023-10-06T03:26:23.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1327890d0 con 0x55e13278c890 2023-10-06T03:26:23.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc63b1c4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1327d7da0 con 0x55e1327dcc50 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc63b1c4b80 10 client.0 _ll_register_callbacks cb 0x55e13274fec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc62affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc62affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33532/0 (socket says 172.21.15.84:33532) 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc62affd700 1 -- 172.21.15.84:0/138628194 learned_addr learned my addr 172.21.15.84:0/138628194 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e1327db470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc62bfff700 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1327dcc50 0x55e1327da080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc62affd700 1 -- 172.21.15.84:0/138628194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1327dcc50 msgr2=0x55e1327da080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc62affd700 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1327dcc50 0x55e1327da080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc62affd700 1 -- 172.21.15.84:0/138628194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 msgr2=0x55e1327db470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc62affd700 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e1327db470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.766+0000 7fc62affd700 1 -- 172.21.15.84:0/138628194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c09ccc0 con 0x55e13278dd10 2023-10-06T03:26:23.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc62affd700 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc6140057d0 tx=0x7fc620015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30f6fbc28a74bcc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc609ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc609ffb700 1 -- 172.21.15.84:0/138628194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620012900 con 0x55e13278dd10 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc609ffb700 1 -- 172.21.15.84:0/138628194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc6200219a0 con 0x55e13278dd10 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/138628194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e13278ffc0 con 0x55e13278dd10 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc609ffb700 1 -- 172.21.15.84:0/138628194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc620021db0 con 0x55e13278dd10 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc63b1c4b80 10 client.6444 fetch_fsmap learned FSMap version 39 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/138628194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55e1326ab7d0 con 0x55e13278dd10 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc609ffb700 1 -- 172.21.15.84:0/138628194 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e13278ffc0 con 0x55e13278dd10 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc609ffb700 1 -- 172.21.15.84:0/138628194 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc620006820 con 0x55e13278dd10 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc63b1c4b80 10 client.6444 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc63b1c4b80 10 client.6444 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-10-06T03:26:23.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc63b1c4b80 20 client.6444 populate_metadata read hostname 'smithi084' 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x55e132838bb0 0x55e132838fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc63b1c4b80 4 client.6444 mds_command: new command op to 6207 tid=0[{"prefix": "session ls"}] 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/138628194 --> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] -- command(tid 0: {"prefix": "session ls"}) v1 -- 0x7fc6240551a0 con 0x55e132838bb0 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.767+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x55e132838bb0 0x55e132838fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc609ffb700 10 client.6444 ms_handle_connect on v2:172.21.15.84:6834/390518387 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc62b7fe700 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x55e132838bb0 0x55e132838fb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=442649894ab3a91a server_cookie=5e8097f19eee297d in_seq=0 out_seq=0 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc609ffb700 1 -- 172.21.15.84:0/138628194 <== mds.0 v2:172.21.15.84:6834/390518387 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fc6240551a0 con 0x55e132838bb0 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc609ffb700 10 client.6444 handle_command_reply: tid=0 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 client.6444 shutdown 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/138628194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e13278dd10 msgr2=0x55e1327d9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc6140057d0 tx=0x7fc620015000 comp rx=0 tx=0).stop 2023-10-06T03:26:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/138628194 shutdown_connections 2023-10-06T03:26:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.84:6834/390518387,v1:172.21.15.84:6836/390518387] conn(0x55e132838bb0 0x55e132838fb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e13278c890 0x55e1327db470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc609ffb700 0 client.6444 ms_handle_reset on v2:172.21.15.84:6834/390518387 2023-10-06T03:26:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1327dcc50 0x55e1327da080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 --2- 172.21.15.84:0/138628194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e13278dd10 0x55e1327d9b40 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/138628194 >> 172.21.15.84:0/138628194 conn(0x55e13278e1b0 msgr2=0x55e1327cabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/138628194 shutdown_connections 2023-10-06T03:26:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 1 -- 172.21.15.84:0/138628194 wait complete. 2023-10-06T03:26:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc63b1c4b80 20 client.6444 trim_cache size 0 max 16384 2023-10-06T03:26:23.778 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2023-10-06T03:26:23.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc631ecc700 1 -- 172.21.15.84:0/2345376899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc618066f60 msgr2=0x7fc618069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc631ecc700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc618066f60 0x7fc618069410 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0094d0 tx=0x7fc61c00b040 comp rx=0 tx=0).stop 2023-10-06T03:26:23.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc631ecc700 1 -- 172.21.15.84:0/2345376899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62c0c7e20 msgr2=0x7fc62c0c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:23.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc631ecc700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62c0c7e20 0x7fc62c0c8290 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc624000c00 tx=0x7fc624000f00 comp rx=0 tx=0).stop 2023-10-06T03:26:23.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc631ecc700 1 -- 172.21.15.84:0/2345376899 shutdown_connections 2023-10-06T03:26:23.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc631ecc700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc618066f60 0x7fc618069410 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc631ecc700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc614004010 0x7fc62c155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc631ecc700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62c0c7e20 0x7fc62c0c8290 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc631ecc700 1 --2- 172.21.15.84:0/2345376899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc62c09d7a0 0x7fc62c0cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:23.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.768+0000 7fc631ecc700 1 -- 172.21.15.84:0/2345376899 >> 172.21.15.84:0/2345376899 conn(0x7fc62c099740 msgr2=0x7fc62c158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:23.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.769+0000 7fc631ecc700 1 -- 172.21.15.84:0/2345376899 shutdown_connections 2023-10-06T03:26:23.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:23.769+0000 7fc631ecc700 1 -- 172.21.15.84:0/2345376899 wait complete. 2023-10-06T03:26:23.781 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2023-10-06T03:26:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":62,"msgr_send_messages":55,"msgr_recv_bytes":110157,"msgr_send_bytes":19199,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.005529035,"msgr_running_send_time":0.000950560,"msgr_running_recv_time":0.004945942,"msgr_running_fast_dispatch_time":0.000297877,"msgr_send_messages_queue_lat":{"avgcount":55,"sum":0.033889101,"avgtime":0.000616165},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":23,"msgr_send_messages":28,"msgr_recv_bytes":4947,"msgr_send_bytes":127238,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.005220775,"msgr_running_send_time":0.000819623,"msgr_running_recv_time":0.003975376,"msgr_running_fast_dispatch_time":0.000263563,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.013249327,"avgtime":0.000490715},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000002937,"avgtime":0.000000326}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":30,"msgr_send_messages":31,"msgr_recv_bytes":7595,"msgr_send_bytes":15780,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.003273179,"msgr_running_send_time":0.000389673,"msgr_running_recv_time":0.002249717,"msgr_running_fast_dispatch_time":0.000554779,"msgr_send_messages_queue_lat":{"avgcount":30,"sum":0.112754002,"avgtime":0.003758466},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000001565,"avgtime":0.000000782}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":42,"sum":0.003258230,"avgtime":0.000077576}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000012683,"avgtime":0.000006341}},"mds":{"request":4,"reply":4,"reply_latency":{"avgcount":4,"sum":0.000824015,"avgtime":0.000206003},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":7,"traverse_hit":7,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":233,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196957,"rdpos":0,"jlat":{"avgcount":5,"sum":0.010781480,"avgtime":0.002156296},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":36448,"heap":207104},"mds_server":{"dispatch_client_request":4,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":3,"sum":0.000563022,"avgtime":0.000187674},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000260993,"avgtime":0.000260993},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":3,"average_load":1,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":212424,"buffer_anon_items":56,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6216,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50464,"mds_co_items":205,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13597,"op_resend":30,"op_reply":43,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":74,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":109,"get_sum":108932,"get_or_fail_fail":0,"get_or_fail_success":109,"take":0,"take_sum":0,"put":109,"put_sum":108932,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13597,"put":43,"put_sum":13597,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x560a6392fe00":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":2653,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":5,"put_sum":2653,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:26:23.914 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 110157, "msgr_recv_messages": 62, "msgr_running_fast_dispatch_time": 0.000297877, "msgr_running_recv_time": 0.004945942, "msgr_running_send_time": 0.00095056, "msgr_running_total_time": 0.005529035, "msgr_send_bytes": 19199, "msgr_send_messages": 55, "msgr_send_messages_queue_lat": { "avgcount": 55, "avgtime": 0.000616165, "sum": 0.033889101 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 3.26e-07, "sum": 2.937e-06 }, "msgr_recv_bytes": 4947, "msgr_recv_messages": 23, "msgr_running_fast_dispatch_time": 0.000263563, "msgr_running_recv_time": 0.003975376, "msgr_running_send_time": 0.000819623, "msgr_running_total_time": 0.005220775, "msgr_send_bytes": 127238, "msgr_send_messages": 28, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.000490715, "sum": 0.013249327 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 7.82e-07, "sum": 1.565e-06 }, "msgr_recv_bytes": 7595, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.000554779, "msgr_running_recv_time": 0.002249717, "msgr_running_send_time": 0.000389673, "msgr_running_total_time": 0.003273179, "msgr_send_bytes": 15780, "msgr_send_messages": 31, "msgr_send_messages_queue_lat": { "avgcount": 30, "avgtime": 0.003758466, "sum": 0.112754002 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 42, "avgtime": 7.7576e-05, "sum": 0.00325823 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.341e-06, "sum": 1.2683e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 233, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 4, "reply_latency": { "avgcount": 4, "avgtime": 0.000206003, "sum": 0.000824015 }, "request": 4, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 7, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 7, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002156296, "sum": 0.01078148 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196957 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207104, "ino": 13, "ino+": 13, "ino-": 0, "rss": 36448 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 3, "avgtime": 0.000187674, "sum": 0.000563022 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000260993, "sum": 0.000260993 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 3 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 212424, "buffer_anon_items": 56, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50464, "mds_co_items": 205, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6216, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 74, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 30, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13597, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 109, "get_or_fail_fail": 0, "get_or_fail_success": 109, "get_started": 0, "get_sum": 108932, "max": 104857600, "put": 109, "put_sum": 108932, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13597, "take": 43, "take_sum": 13597, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x560a6392fe00": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 2653, "max": 3758096384, "put": 5, "put_sum": 2653, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:26:23.917 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T03:26:23.917 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:26:23.917 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:26:23.956 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:26:23.999 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:26:24.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:24.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.113+0000 7f2afb59e700 1 Processor -- start 2023-10-06T03:26:24.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.113+0000 7f2afb59e700 1 -- start start 2023-10-06T03:26:24.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2afb59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2afc159480 0x7f2afc0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2afb59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2afc0b3610 0x7f2afc0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2afb59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2afc0cb7e0 con 0x7f2afc0cc1b0 2023-10-06T03:26:24.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2afb59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc0b08a0 con 0x7f2afc0b3610 2023-10-06T03:26:24.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2afb59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0cb190 con 0x7f2afc159480 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2af1d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2afc0b3610 0x7f2afc0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2af1d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2afc0b3610 0x7f2afc0cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33544/0 (socket says 172.21.15.84:33544) 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2af1d9b700 1 -- 172.21.15.84:0/4215660538 learned_addr learned my addr 172.21.15.84:0/4215660538 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2afa59c700 1 --2- 172.21.15.84:0/4215660538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2afc159480 0x7f2afc0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2af1d9b700 1 -- 172.21.15.84:0/4215660538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2afc159480 msgr2=0x7f2afc0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2af1d9b700 1 --2- 172.21.15.84:0/4215660538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2afc159480 0x7f2afc0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2af1d9b700 1 -- 172.21.15.84:0/4215660538 >> v1:172.21.15.131:6789/0 conn(0x7f2afc0cc1b0 legacy=0x7f2afc0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2af1d9b700 1 -- 172.21.15.84:0/4215660538 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc0cb470 con 0x7f2afc0b3610 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.114+0000 7f2af1d9b700 1 --2- 172.21.15.84:0/4215660538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc0b3610 0x7f2afc0cbc70 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40099b0 tx=0x7f2ae4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce647acb13fa4e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2af9d9b700 1 -- 172.21.15.84:0/4215660538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400b820 con 0x7f2afc0b3610 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2af9d9b700 1 -- 172.21.15.84:0/4215660538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae400b980 con 0x7f2afc0b3610 2023-10-06T03:26:24.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2af9d9b700 1 -- 172.21.15.84:0/4215660538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400bd20 con 0x7f2afc0b3610 2023-10-06T03:26:24.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2afb59e700 1 -- 172.21.15.84:0/4215660538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc0b3610 msgr2=0x7f2afc0cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2afb59e700 1 --2- 172.21.15.84:0/4215660538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc0b3610 0x7f2afc0cbc70 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40099b0 tx=0x7f2ae4009250 comp rx=0 tx=0).stop 2023-10-06T03:26:24.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2afb59e700 1 -- 172.21.15.84:0/4215660538 shutdown_connections 2023-10-06T03:26:24.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2afb59e700 1 --2- 172.21.15.84:0/4215660538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2afc159480 0x7f2afc0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2afb59e700 1 --2- 172.21.15.84:0/4215660538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc0b3610 0x7f2afc0cbc70 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2afb59e700 1 -- 172.21.15.84:0/4215660538 >> 172.21.15.84:0/4215660538 conn(0x7f2afc06ed20 msgr2=0x7f2afc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:24.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2afb59e700 1 -- 172.21.15.84:0/4215660538 shutdown_connections 2023-10-06T03:26:24.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.115+0000 7f2afb59e700 1 -- 172.21.15.84:0/4215660538 wait complete. 2023-10-06T03:26:24.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.116+0000 7f2afb59e700 1 Processor -- start 2023-10-06T03:26:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.116+0000 7f2afb59e700 1 -- start start 2023-10-06T03:26:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afb59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2afc0b3610 0x7f2afc1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afb59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2afc0cc1b0 0x7f2afc0b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afb59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc159480 0x7f2afc0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afb59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc159ad0 con 0x7f2afc159480 2023-10-06T03:26:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afb59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0d02e0 con 0x7f2afc0b3610 2023-10-06T03:26:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afb59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0d05c0 con 0x7f2afc0cc1b0 2023-10-06T03:26:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc159480 0x7f2afc0b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc159480 0x7f2afc0b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33560/0 (socket says 172.21.15.84:33560) 2023-10-06T03:26:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afad9d700 1 -- 172.21.15.84:0/2223793492 learned_addr learned my addr 172.21.15.84:0/2223793492 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afad9d700 1 -- 172.21.15.84:0/2223793492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2afc0cc1b0 msgr2=0x7f2afc0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afad9d700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2afc0cc1b0 0x7f2afc0b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afad9d700 1 -- 172.21.15.84:0/2223793492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2afc0b3610 msgr2=0x7f2afc1547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afad9d700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2afc0b3610 0x7f2afc1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.117+0000 7f2afad9d700 1 -- 172.21.15.84:0/2223793492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae40094f0 con 0x7f2afc159480 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.118+0000 7f2afad9d700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc159480 0x7f2afc0b4030 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c930 tx=0x7f2af40026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.118+0000 7f2af2ffd700 1 -- 172.21.15.84:0/2223793492 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400ce70 con 0x7f2afc159480 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.118+0000 7f2af2ffd700 1 -- 172.21.15.84:0/2223793492 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af400a7e0 con 0x7f2afc159480 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.118+0000 7f2af2ffd700 1 -- 172.21.15.84:0/2223793492 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400aba0 con 0x7f2afc159480 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.118+0000 7f2afb59e700 1 -- 172.21.15.84:0/2223793492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc0d08a0 con 0x7f2afc159480 2023-10-06T03:26:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.118+0000 7f2afb59e700 1 -- 172.21.15.84:0/2223793492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc154d00 con 0x7f2afc159480 2023-10-06T03:26:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.119+0000 7f2afb59e700 1 -- 172.21.15.84:0/2223793492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc154ef0 con 0x7f2afc159480 2023-10-06T03:26:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.119+0000 7f2af2ffd700 1 -- 172.21.15.84:0/2223793492 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2af4012420 con 0x7f2afc159480 2023-10-06T03:26:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.119+0000 7f2af2ffd700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2adc066f30 0x7f2adc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.120+0000 7f2af2ffd700 1 -- 172.21.15.84:0/2223793492 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2af4084c40 con 0x7f2afc159480 2023-10-06T03:26:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.120+0000 7f2afa59c700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2adc066f30 0x7f2adc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.120+0000 7f2afa59c700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2adc066f30 0x7f2adc0693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0b4680 tx=0x7f2aec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:24.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.124+0000 7f2af2ffd700 1 -- 172.21.15.84:0/2223793492 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2af40556b0 con 0x7f2afc159480 2023-10-06T03:26:24.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.346+0000 7f2afb59e700 1 -- 172.21.15.84:0/2223793492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2afc159cb0 con 0x7f2afc159480 2023-10-06T03:26:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.346+0000 7f2af2ffd700 1 -- 172.21.15.84:0/2223793492 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f2af4055240 con 0x7f2afc159480 2023-10-06T03:26:24.348 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:24.348 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1214313207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1214313207},{"type":"v1","addr":"172.21.15.131:6835","nonce":1214313207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/63470384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":63470384},{"type":"v1","addr":"172.21.15.84:6837","nonce":63470384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3440632646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3440632646},{"type":"v1","addr":"172.21.15.131:6834","nonce":3440632646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:09.642630+0000","modified":"2023-10-06T03:26:13.283595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/390518387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":390518387},{"type":"v1","addr":"172.21.15.84:6836","nonce":390518387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:26:24.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.348+0000 7f2afb59e700 1 -- 172.21.15.84:0/2223793492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2adc066f30 msgr2=0x7f2adc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.348+0000 7f2afb59e700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2adc066f30 0x7f2adc0693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0b4680 tx=0x7f2aec008040 comp rx=0 tx=0).stop 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.348+0000 7f2afb59e700 1 -- 172.21.15.84:0/2223793492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc159480 msgr2=0x7f2afc0b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.348+0000 7f2afb59e700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc159480 0x7f2afc0b4030 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c930 tx=0x7f2af40026e0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.348+0000 7f2afb59e700 1 -- 172.21.15.84:0/2223793492 shutdown_connections 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.348+0000 7f2afb59e700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2adc066f30 0x7f2adc0693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.348+0000 7f2afb59e700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2afc0b3610 0x7f2afc1547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.348+0000 7f2afb59e700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2afc159480 0x7f2afc0b4030 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.348+0000 7f2afb59e700 1 --2- 172.21.15.84:0/2223793492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2afc0cc1b0 0x7f2afc0b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.348+0000 7f2afb59e700 1 -- 172.21.15.84:0/2223793492 >> 172.21.15.84:0/2223793492 conn(0x7f2afc06ed20 msgr2=0x7f2afc155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.349+0000 7f2afb59e700 1 -- 172.21.15.84:0/2223793492 shutdown_connections 2023-10-06T03:26:24.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.349+0000 7f2afb59e700 1 -- 172.21.15.84:0/2223793492 wait complete. 2023-10-06T03:26:24.351 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 39 2023-10-06T03:26:24.362 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:24.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.476+0000 7f4803cb7700 1 Processor -- start 2023-10-06T03:26:24.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.477+0000 7f4803cb7700 1 -- start start 2023-10-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.477+0000 7f4803cb7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f47fc068d10 0x7f47fc1644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.477+0000 7f4803cb7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc0ac980 con 0x7f47fc0ad730 2023-10-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.477+0000 7f4803cb7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc159f80 con 0x7f47fc0ad360 2023-10-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.477+0000 7f4803cb7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc15a260 con 0x7f47fc068d10 2023-10-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4801252700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f47fc0ad730 0x7f47fc068600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34596/0 (socket says 172.21.15.84:34596) 2023-10-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4801252700 1 -- 172.21.15.84:0/2989146454 learned_addr learned my addr 172.21.15.84:0/2989146454 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4802254700 1 --2- 172.21.15.84:0/2989146454 >> v2:172.21.15.131:3300/0 conn(0x7f47fc068d10 0x7f47fc1644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241541033 0 0) 0x7f47fc0ac980 con 0x7f47fc0ad730 2023-10-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e8003570 con 0x7f47fc0ad730 2023-10-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806440248 0 0) 0x7f47fc159f80 con 0x7f47fc0ad360 2023-10-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47fc0ac980 con 0x7f47fc0ad360 2023-10-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1291280035 0 0) 0x7f47e8003570 con 0x7f47fc0ad730 2023-10-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 >> v2:172.21.15.131:3300/0 conn(0x7f47fc068d10 msgr2=0x7f47fc1644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 --2- 172.21.15.84:0/2989146454 >> v2:172.21.15.131:3300/0 conn(0x7f47fc068d10 0x7f47fc1644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 >> v1:172.21.15.131:6789/0 conn(0x7f47fc0ad360 legacy=0x7f47fc0ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc15a540 con 0x7f47fc0ad730 2023-10-06T03:26:24.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f47ec001470 con 0x7f47fc0ad730 2023-10-06T03:26:24.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 >> v1:172.21.15.84:6789/0 conn(0x7f47fc0ad730 legacy=0x7f47fc068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e8003bf0 0x7f47e8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47e8004810 0x7f47e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47e80051c0 0x7f47e800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc15a260 con 0x7f47e80051c0 2023-10-06T03:26:24.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e800c160 con 0x7f47e8004810 2023-10-06T03:26:24.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e800c320 con 0x7f47e8003bf0 2023-10-06T03:26:24.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4802254700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47e80051c0 0x7f47e800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4801252700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47e8004810 0x7f47e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.478+0000 7f4801a53700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e8003bf0 0x7f47e8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4802254700 1 -- 172.21.15.84:0/2989146454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e8003bf0 msgr2=0x7f47e8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:24.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4802254700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e8003bf0 0x7f47e8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4802254700 1 -- 172.21.15.84:0/2989146454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47e8004810 msgr2=0x7f47e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:24.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4802254700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47e8004810 0x7f47e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4802254700 1 -- 172.21.15.84:0/2989146454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e8003570 con 0x7f47e80051c0 2023-10-06T03:26:24.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4801a53700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e8003bf0 0x7f47e8003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:24.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4801252700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47e8004810 0x7f47e8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:24.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4802254700 1 -- 172.21.15.84:0/2989146454 reap_dead start 2023-10-06T03:26:24.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4802254700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47e80051c0 0x7f47e800ba60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f47f4006f00 tx=0x7f47f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a915b55efc2bbf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:24.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400e6e0 con 0x7f47e80051c0 2023-10-06T03:26:24.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f400e860 con 0x7f47e80051c0 2023-10-06T03:26:24.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4800a51700 1 -- 172.21.15.84:0/2989146454 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400ec20 con 0x7f47e80051c0 2023-10-06T03:26:24.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4803cb7700 1 -- 172.21.15.84:0/2989146454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47e80051c0 msgr2=0x7f47e800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4803cb7700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47e80051c0 0x7f47e800ba60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f47f4006f00 tx=0x7f47f40091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4803cb7700 1 -- 172.21.15.84:0/2989146454 shutdown_connections 2023-10-06T03:26:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4803cb7700 1 --2- 172.21.15.84:0/2989146454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47e80051c0 0x7f47e800ba60 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.479+0000 7f4803cb7700 1 -- 172.21.15.84:0/2989146454 >> 172.21.15.84:0/2989146454 conn(0x7f47fc06dd10 msgr2=0x7f47fc06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.480+0000 7f4803cb7700 1 -- 172.21.15.84:0/2989146454 shutdown_connections 2023-10-06T03:26:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.480+0000 7f4803cb7700 1 -- 172.21.15.84:0/2989146454 wait complete. 2023-10-06T03:26:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4803cb7700 1 Processor -- start 2023-10-06T03:26:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4803cb7700 1 -- start start 2023-10-06T03:26:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4803cb7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e80051c0 0x7f47fc15e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4803cb7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc1587a0 0x7f47fc14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4803cb7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc158c10 0x7f47fc1504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4803cb7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc158310 con 0x7f47fc1587a0 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4803cb7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc157460 con 0x7f47fc158c10 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4803cb7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc157700 con 0x7f47e80051c0 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4801252700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc1587a0 0x7f47fc14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4801252700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc1587a0 0x7f47fc14ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33580/0 (socket says 172.21.15.84:33580) 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.481+0000 7f4801252700 1 -- 172.21.15.84:0/408643350 learned_addr learned my addr 172.21.15.84:0/408643350 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4802254700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc158c10 0x7f47fc1504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4801a53700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e80051c0 0x7f47fc15e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4801252700 1 -- 172.21.15.84:0/408643350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e80051c0 msgr2=0x7f47fc15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4801252700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e80051c0 0x7f47fc15e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4801252700 1 -- 172.21.15.84:0/408643350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc158c10 msgr2=0x7f47fc1504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4801252700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc158c10 0x7f47fc1504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4801252700 1 -- 172.21.15.84:0/408643350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc1579e0 con 0x7f47fc1587a0 2023-10-06T03:26:24.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4802254700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc158c10 0x7f47fc1504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:24.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4801a53700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e80051c0 0x7f47fc15e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:24.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4801252700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc1587a0 0x7f47fc14ffb0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00e900 tx=0x7f47ec001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:24.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f47f1ffb700 1 -- 172.21.15.84:0/408643350 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00eea0 con 0x7f47fc1587a0 2023-10-06T03:26:24.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f47f1ffb700 1 -- 172.21.15.84:0/408643350 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec010040 con 0x7f47fc1587a0 2023-10-06T03:26:24.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4803cb7700 1 -- 172.21.15.84:0/408643350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47fc157cc0 con 0x7f47fc1587a0 2023-10-06T03:26:24.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f47f1ffb700 1 -- 172.21.15.84:0/408643350 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00a970 con 0x7f47fc1587a0 2023-10-06T03:26:24.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.482+0000 7f4803cb7700 1 -- 172.21.15.84:0/408643350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc15e840 con 0x7f47fc1587a0 2023-10-06T03:26:24.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.483+0000 7f4803cb7700 1 -- 172.21.15.84:0/408643350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47fc064ad0 con 0x7f47fc1587a0 2023-10-06T03:26:24.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.483+0000 7f47f1ffb700 1 -- 172.21.15.84:0/408643350 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47ec0143f0 con 0x7f47fc1587a0 2023-10-06T03:26:24.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.484+0000 7f47f1ffb700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f47e0066f30 0x7f47e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.484+0000 7f47f1ffb700 1 -- 172.21.15.84:0/408643350 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f47ec083d30 con 0x7f47fc1587a0 2023-10-06T03:26:24.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.484+0000 7f4801a53700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f47e0066f30 0x7f47e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.484+0000 7f4801a53700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f47e0066f30 0x7f47e00693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f47f8007fd0 tx=0x7f47f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:24.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.488+0000 7f47f1ffb700 1 -- 172.21.15.84:0/408643350 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47ec04d5a0 con 0x7f47fc1587a0 2023-10-06T03:26:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.672+0000 7f4803cb7700 1 -- 172.21.15.84:0/408643350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47fc04bb80 con 0x7f47fc1587a0 2023-10-06T03:26:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.673+0000 7f47f1ffb700 1 -- 172.21.15.84:0/408643350 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f47ec019070 con 0x7f47fc1587a0 2023-10-06T03:26:24.674 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:24.675 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":74,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:11.256666+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:07.289525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:08.601697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 -- 172.21.15.84:0/408643350 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f47e0066f30 msgr2=0x7f47e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f47e0066f30 0x7f47e00693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f47f8007fd0 tx=0x7f47f8009040 comp rx=0 tx=0).stop 2023-10-06T03:26:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 -- 172.21.15.84:0/408643350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc1587a0 msgr2=0x7f47fc14ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc1587a0 0x7f47fc14ffb0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00e900 tx=0x7f47ec001c10 comp rx=0 tx=0).stop 2023-10-06T03:26:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 -- 172.21.15.84:0/408643350 shutdown_connections 2023-10-06T03:26:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f47e0066f30 0x7f47e00693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc158c10 0x7f47fc1504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47e80051c0 0x7f47fc15e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 --2- 172.21.15.84:0/408643350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc1587a0 0x7f47fc14ffb0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 -- 172.21.15.84:0/408643350 >> 172.21.15.84:0/408643350 conn(0x7f47fc06dd10 msgr2=0x7f47fc1521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 -- 172.21.15.84:0/408643350 shutdown_connections 2023-10-06T03:26:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.675+0000 7f4803cb7700 1 -- 172.21.15.84:0/408643350 wait complete. 2023-10-06T03:26:24.688 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:26:07.289525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:26:08.601697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:26:24.689 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:26:24.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.806+0000 7fda6e7c2700 1 Processor -- start 2023-10-06T03:26:24.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.806+0000 7fda6e7c2700 1 -- start start 2023-10-06T03:26:24.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.806+0000 7fda6e7c2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fda681598e0 0x7fda680ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.806+0000 7fda6e7c2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680cf610 con 0x7fda68159510 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.806+0000 7fda6e7c2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680cf8f0 con 0x7fda680cbcb0 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.806+0000 7fda6e7c2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda680cfbd0 con 0x7fda681598e0 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda677fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fda681598e0 0x7fda680ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda67fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fda68159510 0x7fda680cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34608/0 (socket says 172.21.15.84:34608) 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda67fff700 1 -- 172.21.15.84:0/1745170642 learned_addr learned my addr 172.21.15.84:0/1745170642 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda677fe700 1 -- 172.21.15.84:0/1745170642 >> v1:172.21.15.131:6789/0 conn(0x7fda680cbcb0 legacy=0x7fda680ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda677fe700 1 -- 172.21.15.84:0/1745170642 >> v1:172.21.15.84:6789/0 conn(0x7fda68159510 legacy=0x7fda680cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda66ffd700 1 -- 172.21.15.84:0/1745170642 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361710344 0 0) 0x7fda680cf610 con 0x7fda68159510 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda677fe700 1 -- 172.21.15.84:0/1745170642 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680cfeb0 con 0x7fda681598e0 2023-10-06T03:26:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda677fe700 1 --2- 172.21.15.84:0/1745170642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda681598e0 0x7fda680ce820 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0098e0 tx=0x7fda5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c186cc1bedc126 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:24.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda66ffd700 1 -- 172.21.15.84:0/1745170642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c009e80 con 0x7fda681598e0 2023-10-06T03:26:24.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda66ffd700 1 -- 172.21.15.84:0/1745170642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c00b860 con 0x7fda681598e0 2023-10-06T03:26:24.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.807+0000 7fda66ffd700 1 -- 172.21.15.84:0/1745170642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00bbe0 con 0x7fda681598e0 2023-10-06T03:26:24.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.808+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1745170642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda681598e0 msgr2=0x7fda680ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.808+0000 7fda6e7c2700 1 --2- 172.21.15.84:0/1745170642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda681598e0 0x7fda680ce820 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0098e0 tx=0x7fda5c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.808+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1745170642 shutdown_connections 2023-10-06T03:26:24.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.808+0000 7fda6e7c2700 1 --2- 172.21.15.84:0/1745170642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda681598e0 0x7fda680ce820 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.808+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1745170642 >> 172.21.15.84:0/1745170642 conn(0x7fda68089e90 msgr2=0x7fda680997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:24.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.808+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1745170642 shutdown_connections 2023-10-06T03:26:24.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.808+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1745170642 wait complete. 2023-10-06T03:26:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.809+0000 7fda6e7c2700 1 Processor -- start 2023-10-06T03:26:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.809+0000 7fda6e7c2700 1 -- start start 2023-10-06T03:26:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda6e7c2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda680cbcb0 0x7fda6816e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda6e7c2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68159510 0x7fda680c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda6e7c2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda681598e0 0x7fda681496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda6e7c2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda68171c80 con 0x7fda68159510 2023-10-06T03:26:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda6e7c2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6816eb30 con 0x7fda680cbcb0 2023-10-06T03:26:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda6e7c2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6816ee10 con 0x7fda681598e0 2023-10-06T03:26:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda677fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68159510 0x7fda680c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda677fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68159510 0x7fda680c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33590/0 (socket says 172.21.15.84:33590) 2023-10-06T03:26:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda677fe700 1 -- 172.21.15.84:0/1503434095 learned_addr learned my addr 172.21.15.84:0/1503434095 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda67fff700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda680cbcb0 0x7fda6816e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda6cd5f700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda681598e0 0x7fda681496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda677fe700 1 -- 172.21.15.84:0/1503434095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda681598e0 msgr2=0x7fda681496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda677fe700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda681598e0 0x7fda681496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda677fe700 1 -- 172.21.15.84:0/1503434095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda680cbcb0 msgr2=0x7fda6816e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda677fe700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda680cbcb0 0x7fda6816e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda677fe700 1 -- 172.21.15.84:0/1503434095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c009420 con 0x7fda68159510 2023-10-06T03:26:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.810+0000 7fda677fe700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68159510 0x7fda680c97d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fda5c013000 tx=0x7fda5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.811+0000 7fda4ffff700 1 -- 172.21.15.84:0/1503434095 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00bbe0 con 0x7fda68159510 2023-10-06T03:26:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.811+0000 7fda4ffff700 1 -- 172.21.15.84:0/1503434095 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c011420 con 0x7fda68159510 2023-10-06T03:26:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.811+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1503434095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6816f0f0 con 0x7fda68159510 2023-10-06T03:26:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.811+0000 7fda4ffff700 1 -- 172.21.15.84:0/1503434095 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0117e0 con 0x7fda68159510 2023-10-06T03:26:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.811+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1503434095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda681555d0 con 0x7fda68159510 2023-10-06T03:26:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.811+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1503434095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda68171df0 con 0x7fda68159510 2023-10-06T03:26:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.812+0000 7fda4ffff700 1 -- 172.21.15.84:0/1503434095 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda5c011bd0 con 0x7fda68159510 2023-10-06T03:26:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.812+0000 7fda4ffff700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda54066f30 0x7fda540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.812+0000 7fda4ffff700 1 -- 172.21.15.84:0/1503434095 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fda5c0862d0 con 0x7fda68159510 2023-10-06T03:26:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.812+0000 7fda67fff700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda54066f30 0x7fda540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.813+0000 7fda67fff700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda54066f30 0x7fda540693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fda58007fd0 tx=0x7fda58007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.817+0000 7fda4ffff700 1 -- 172.21.15.84:0/1503434095 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda5c053200 con 0x7fda68159510 2023-10-06T03:26:24.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.998+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1503434095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda68064ad0 con 0x7fda68159510 2023-10-06T03:26:24.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:24.999+0000 7fda4ffff700 1 -- 172.21.15.84:0/1503434095 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda5c056820 con 0x7fda68159510 2023-10-06T03:26:25.000 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:26:25.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1503434095 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda54066f30 msgr2=0x7fda540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda54066f30 0x7fda540693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fda58007fd0 tx=0x7fda58007d10 comp rx=0 tx=0).stop 2023-10-06T03:26:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1503434095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68159510 msgr2=0x7fda680c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68159510 0x7fda680c97d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fda5c013000 tx=0x7fda5c017000 comp rx=0 tx=0).stop 2023-10-06T03:26:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1503434095 shutdown_connections 2023-10-06T03:26:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fda54066f30 0x7fda540693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda680cbcb0 0x7fda6816e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda681598e0 0x7fda681496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 --2- 172.21.15.84:0/1503434095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68159510 0x7fda680c97d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1503434095 >> 172.21.15.84:0/1503434095 conn(0x7fda68089e90 msgr2=0x7fda68063450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:25.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1503434095 shutdown_connections 2023-10-06T03:26:25.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.001+0000 7fda6e7c2700 1 -- 172.21.15.84:0/1503434095 wait complete. 2023-10-06T03:26:25.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:26:25.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.130+0000 7ff9fe0ff700 1 Processor -- start 2023-10-06T03:26:25.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.130+0000 7ff9fe0ff700 1 -- start start 2023-10-06T03:26:25.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9fe0ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9f8159340 0x7ff9f80af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9fe0ff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9f8159710 0x7ff9f80cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9fe0ff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff9f80cba70 0x7ff9f80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9fe0ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80cbed0 con 0x7ff9f8159340 2023-10-06T03:26:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9fe0ff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80cf820 con 0x7ff9f80cba70 2023-10-06T03:26:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9fe0ff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80cfb00 con 0x7ff9f8159710 2023-10-06T03:26:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9f77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9f8159340 0x7ff9f80af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9f77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9f8159340 0x7ff9f80af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33592/0 (socket says 172.21.15.84:33592) 2023-10-06T03:26:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9f77fe700 1 -- 172.21.15.84:0/4128215943 learned_addr learned my addr 172.21.15.84:0/4128215943 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9f7fff700 1 --2- 172.21.15.84:0/4128215943 >> v2:172.21.15.131:3300/0 conn(0x7ff9f80cba70 0x7ff9f80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9f6ffd700 1 --2- 172.21.15.84:0/4128215943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9f8159710 0x7ff9f80cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9f77fe700 1 -- 172.21.15.84:0/4128215943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9f8159710 msgr2=0x7ff9f80cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9f77fe700 1 --2- 172.21.15.84:0/4128215943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9f8159710 0x7ff9f80cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.131+0000 7ff9f77fe700 1 -- 172.21.15.84:0/4128215943 >> v2:172.21.15.131:3300/0 conn(0x7ff9f80cba70 msgr2=0x7ff9f80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9f77fe700 1 --2- 172.21.15.84:0/4128215943 >> v2:172.21.15.131:3300/0 conn(0x7ff9f80cba70 0x7ff9f80cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9f77fe700 1 -- 172.21.15.84:0/4128215943 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80cfde0 con 0x7ff9f8159340 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9f7fff700 1 --2- 172.21.15.84:0/4128215943 >> v2:172.21.15.131:3300/0 conn(0x7ff9f80cba70 0x7ff9f80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9f77fe700 1 --2- 172.21.15.84:0/4128215943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 0x7ff9f80af4d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80b3000 tx=0x7ff9e8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fa48310b4dc2b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9f67fc700 1 -- 172.21.15.84:0/4128215943 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8005c10 con 0x7ff9f8159340 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9f67fc700 1 -- 172.21.15.84:0/4128215943 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e8005d70 con 0x7ff9f8159340 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9f67fc700 1 -- 172.21.15.84:0/4128215943 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800b880 con 0x7ff9f8159340 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/4128215943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 msgr2=0x7ff9f80af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9fe0ff700 1 --2- 172.21.15.84:0/4128215943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 0x7ff9f80af4d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80b3000 tx=0x7ff9e8009220 comp rx=0 tx=0).stop 2023-10-06T03:26:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/4128215943 shutdown_connections 2023-10-06T03:26:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9fe0ff700 1 --2- 172.21.15.84:0/4128215943 >> v2:172.21.15.131:3300/0 conn(0x7ff9f80cba70 0x7ff9f80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9fe0ff700 1 --2- 172.21.15.84:0/4128215943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 0x7ff9f80af4d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9fe0ff700 1 --2- 172.21.15.84:0/4128215943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9f8159710 0x7ff9f80cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/4128215943 >> 172.21.15.84:0/4128215943 conn(0x7ff9f8099720 msgr2=0x7ff9f806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/4128215943 shutdown_connections 2023-10-06T03:26:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.132+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/4128215943 wait complete. 2023-10-06T03:26:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.134+0000 7ff9fe0ff700 1 Processor -- start 2023-10-06T03:26:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.134+0000 7ff9fe0ff700 1 -- start start 2023-10-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.134+0000 7ff9fe0ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9f80cba70 0x7ff9f80b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.134+0000 7ff9fe0ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 0x7ff9f80b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.134+0000 7ff9fe0ff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9f8159710 0x7ff9f80684f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.134+0000 7ff9fe0ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80c86e0 con 0x7ff9f8159340 2023-10-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.134+0000 7ff9fe0ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80c89c0 con 0x7ff9f80cba70 2023-10-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.134+0000 7ff9fe0ff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80c8ca0 con 0x7ff9f8159710 2023-10-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.134+0000 7ff9f6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 0x7ff9f80b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9f6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 0x7ff9f80b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33598/0 (socket says 172.21.15.84:33598) 2023-10-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9f6ffd700 1 -- 172.21.15.84:0/1361341554 learned_addr learned my addr 172.21.15.84:0/1361341554 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9f7fff700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9f8159710 0x7ff9f80684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9f77fe700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9f80cba70 0x7ff9f80b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9f6ffd700 1 -- 172.21.15.84:0/1361341554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9f8159710 msgr2=0x7ff9f80684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9f6ffd700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9f8159710 0x7ff9f80684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9f6ffd700 1 -- 172.21.15.84:0/1361341554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9f80cba70 msgr2=0x7ff9f80b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9f6ffd700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9f80cba70 0x7ff9f80b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9f6ffd700 1 -- 172.21.15.84:0/1361341554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e8009480 con 0x7ff9f8159340 2023-10-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9f6ffd700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 0x7ff9f80b1ac0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00d860 tx=0x7ff9ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9df7fe700 1 -- 172.21.15.84:0/1361341554 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0125f0 con 0x7ff9f8159340 2023-10-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9df7fe700 1 -- 172.21.15.84:0/1361341554 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec012750 con 0x7ff9f8159340 2023-10-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/1361341554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f80c8f80 con 0x7ff9f8159340 2023-10-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9df7fe700 1 -- 172.21.15.84:0/1361341554 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec012b10 con 0x7ff9f8159340 2023-10-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.135+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/1361341554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f80b37c0 con 0x7ff9f8159340 2023-10-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.136+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/1361341554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f80c9420 con 0x7ff9f8159340 2023-10-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.136+0000 7ff9df7fe700 1 -- 172.21.15.84:0/1361341554 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9ec01e460 con 0x7ff9f8159340 2023-10-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.137+0000 7ff9df7fe700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff9e4066f30 0x7ff9e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.137+0000 7ff9df7fe700 1 -- 172.21.15.84:0/1361341554 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff9ec084e60 con 0x7ff9f8159340 2023-10-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.137+0000 7ff9f77fe700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff9e4066f30 0x7ff9e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.137+0000 7ff9f77fe700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff9e4066f30 0x7ff9e40693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009260 tx=0x7ff9e8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.141+0000 7ff9df7fe700 1 -- 172.21.15.84:0/1361341554 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9ec0558c0 con 0x7ff9f8159340 2023-10-06T03:26:25.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.324+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/1361341554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9f8064ad0 con 0x7ff9f8159340 2023-10-06T03:26:25.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.325+0000 7ff9df7fe700 1 -- 172.21.15.84:0/1361341554 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9ec055450 con 0x7ff9f8159340 2023-10-06T03:26:25.326 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:26:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/1361341554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff9e4066f30 msgr2=0x7ff9e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff9e4066f30 0x7ff9e40693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009260 tx=0x7ff9e8016000 comp rx=0 tx=0).stop 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/1361341554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 msgr2=0x7ff9f80b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 0x7ff9f80b1ac0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00d860 tx=0x7ff9ec008040 comp rx=0 tx=0).stop 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/1361341554 shutdown_connections 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff9e4066f30 0x7ff9e40693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9f80cba70 0x7ff9f80b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9f8159710 0x7ff9f80684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 --2- 172.21.15.84:0/1361341554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8159340 0x7ff9f80b1ac0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/1361341554 >> 172.21.15.84:0/1361341554 conn(0x7ff9f8099720 msgr2=0x7ff9f80c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/1361341554 shutdown_connections 2023-10-06T03:26:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.327+0000 7ff9fe0ff700 1 -- 172.21.15.84:0/1361341554 wait complete. 2023-10-06T03:26:25.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:26:25.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.455+0000 7fa317fff700 1 Processor -- start 2023-10-06T03:26:25.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.455+0000 7fa317fff700 1 -- start start 2023-10-06T03:26:25.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa317fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3180b2660 0x7fa3180cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa317fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa3180b2a30 0x7fa3180cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa317fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3180cc9b0 con 0x7fa3180ceae0 2023-10-06T03:26:25.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa317fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3180cbda0 con 0x7fa3180b2a30 2023-10-06T03:26:25.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa317fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180cc080 con 0x7fa3180b2660 2023-10-06T03:26:25.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa3177fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa3180ceae0 0x7fa3180cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34624/0 (socket says 172.21.15.84:34624) 2023-10-06T03:26:25.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa3177fe700 1 -- 172.21.15.84:0/3431544472 learned_addr learned my addr 172.21.15.84:0/3431544472 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:25.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120867384 0 0) 0x7fa3180cc9b0 con 0x7fa3180ceae0 2023-10-06T03:26:25.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa30e7fc700 1 --2- 172.21.15.84:0/3431544472 >> v2:172.21.15.131:3300/0 conn(0x7fa3180b2a30 0x7fa3180cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa316ffd700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3180b2660 0x7fa3180cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.456+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa304003570 con 0x7fa3180ceae0 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349828680 0 0) 0x7fa304003570 con 0x7fa3180ceae0 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3180b2660 msgr2=0x7fa3180cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3180b2660 0x7fa3180cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 >> v2:172.21.15.131:3300/0 conn(0x7fa3180b2a30 msgr2=0x7fa3180cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 --2- 172.21.15.84:0/3431544472 >> v2:172.21.15.131:3300/0 conn(0x7fa3180b2a30 0x7fa3180cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180cc360 con 0x7fa3180ceae0 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fa3100017f0 con 0x7fa3180ceae0 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 >> v1:172.21.15.84:6789/0 conn(0x7fa3180ceae0 legacy=0x7fa3180cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa304003a60 0x7fa304003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3180b2660 0x7fa304004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa304004d50 0x7fa3040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180cbda0 con 0x7fa304004d50 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180cc080 con 0x7fa304003a60 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30400ba60 con 0x7fa3180b2660 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3177fe700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa304004d50 0x7fa3040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa316ffd700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa304003a60 0x7fa304003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa30e7fc700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3180b2660 0x7fa304004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3177fe700 1 -- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3180b2660 msgr2=0x7fa304004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3177fe700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3180b2660 0x7fa304004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3177fe700 1 -- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa304003a60 msgr2=0x7fa304003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3177fe700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa304003a60 0x7fa304003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3177fe700 1 -- 172.21.15.84:0/3431544472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304003570 con 0x7fa304004d50 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3177fe700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa304004d50 0x7fa3040051c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa31000a970 tx=0x7fa310002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d834945b67212336 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310012440 con 0x7fa304004d50 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3100125c0 con 0x7fa304004d50 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.457+0000 7fa3167fc700 1 -- 172.21.15.84:0/3431544472 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310012980 con 0x7fa304004d50 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.458+0000 7fa317fff700 1 -- 172.21.15.84:0/3431544472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa304004d50 msgr2=0x7fa3040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.458+0000 7fa317fff700 1 --2- 172.21.15.84:0/3431544472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa304004d50 0x7fa3040051c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa31000a970 tx=0x7fa310002210 comp rx=0 tx=0).stop 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.458+0000 7fa3177fe700 1 -- 172.21.15.84:0/3431544472 reap_dead start 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.458+0000 7fa317fff700 1 -- 172.21.15.84:0/3431544472 shutdown_connections 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.458+0000 7fa317fff700 1 -- 172.21.15.84:0/3431544472 >> 172.21.15.84:0/3431544472 conn(0x7fa318099560 msgr2=0x7fa31806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.458+0000 7fa317fff700 1 -- 172.21.15.84:0/3431544472 shutdown_connections 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.458+0000 7fa317fff700 1 -- 172.21.15.84:0/3431544472 wait complete. 2023-10-06T03:26:25.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.459+0000 7fa317fff700 1 Processor -- start 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.459+0000 7fa317fff700 1 -- start start 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa317fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa304004d50 0x7fa3180b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa317fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180b3180 0x7fa3180b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa317fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa31815cb50 0x7fa318154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa317fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180b3940 con 0x7fa3180b3180 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa317fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180b3660 con 0x7fa304004d50 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa317fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31815c070 con 0x7fa31815cb50 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa30e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180b3180 0x7fa3180b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa30e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180b3180 0x7fa3180b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33626/0 (socket says 172.21.15.84:33626) 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa30e7fc700 1 -- 172.21.15.84:0/2941459653 learned_addr learned my addr 172.21.15.84:0/2941459653 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa316ffd700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa304004d50 0x7fa3180b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa3177fe700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa31815cb50 0x7fa318154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa30e7fc700 1 -- 172.21.15.84:0/2941459653 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa31815cb50 msgr2=0x7fa318154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa30e7fc700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa31815cb50 0x7fa318154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa30e7fc700 1 -- 172.21.15.84:0/2941459653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa304004d50 msgr2=0x7fa3180b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa30e7fc700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa304004d50 0x7fa3180b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa30e7fc700 1 -- 172.21.15.84:0/2941459653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31815c350 con 0x7fa3180b3180 2023-10-06T03:26:25.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa3177fe700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa31815cb50 0x7fa318154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:25.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.460+0000 7fa30e7fc700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180b3180 0x7fa3180b5ab0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa300006ac0 tx=0x7fa3000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:25.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.461+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2941459653 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000f940 con 0x7fa3180b3180 2023-10-06T03:26:25.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.461+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2941459653 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000faa0 con 0x7fa3180b3180 2023-10-06T03:26:25.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.461+0000 7fa317fff700 1 -- 172.21.15.84:0/2941459653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31815c630 con 0x7fa3180b3180 2023-10-06T03:26:25.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.461+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2941459653 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000fe20 con 0x7fa3180b3180 2023-10-06T03:26:25.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.461+0000 7fa317fff700 1 -- 172.21.15.84:0/2941459653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa318154980 con 0x7fa3180b3180 2023-10-06T03:26:25.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.461+0000 7fa317fff700 1 -- 172.21.15.84:0/2941459653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31815c850 con 0x7fa3180b3180 2023-10-06T03:26:25.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.462+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2941459653 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa300014650 con 0x7fa3180b3180 2023-10-06T03:26:25.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.462+0000 7fa30f7fe700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa2f8066f30 0x7fa2f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.462+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2941459653 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa300018030 con 0x7fa3180b3180 2023-10-06T03:26:25.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.462+0000 7fa316ffd700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa2f8066f30 0x7fa2f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.463+0000 7fa316ffd700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa2f8066f30 0x7fa2f80693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa308006e50 tx=0x7fa308009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:25.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.467+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2941459653 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa300052160 con 0x7fa3180b3180 2023-10-06T03:26:25.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.647+0000 7fa317fff700 1 -- 172.21.15.84:0/2941459653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa31815bea0 con 0x7fa3180b3180 2023-10-06T03:26:25.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.648+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2941459653 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa300055780 con 0x7fa3180b3180 2023-10-06T03:26:25.649 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:26:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 -- 172.21.15.84:0/2941459653 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa2f8066f30 msgr2=0x7fa2f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa2f8066f30 0x7fa2f80693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa308006e50 tx=0x7fa308009120 comp rx=0 tx=0).stop 2023-10-06T03:26:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 -- 172.21.15.84:0/2941459653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180b3180 msgr2=0x7fa3180b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180b3180 0x7fa3180b5ab0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa300006ac0 tx=0x7fa3000091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 -- 172.21.15.84:0/2941459653 shutdown_connections 2023-10-06T03:26:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa2f8066f30 0x7fa2f80693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa304004d50 0x7fa3180b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa31815cb50 0x7fa318154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 --2- 172.21.15.84:0/2941459653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180b3180 0x7fa3180b5ab0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 -- 172.21.15.84:0/2941459653 >> 172.21.15.84:0/2941459653 conn(0x7fa318099560 msgr2=0x7fa318069800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 -- 172.21.15.84:0/2941459653 shutdown_connections 2023-10-06T03:26:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.650+0000 7fa317fff700 1 -- 172.21.15.84:0/2941459653 wait complete. 2023-10-06T03:26:25.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:26:25.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.778+0000 7f277e5af700 1 Processor -- start 2023-10-06T03:26:25.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.778+0000 7f277e5af700 1 -- start start 2023-10-06T03:26:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f277e5af700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2778159510 0x7f27780cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f277e5af700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27780cbf20 con 0x7f27781598e0 2023-10-06T03:26:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f277e5af700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27780cf610 con 0x7f27780cbae0 2023-10-06T03:26:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f277e5af700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27780cf8f0 con 0x7f2778159510 2023-10-06T03:26:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f2777fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2778159510 0x7f27780cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f27777fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f27781598e0 0x7f27780ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34636/0 (socket says 172.21.15.84:34636) 2023-10-06T03:26:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f27777fe700 1 -- 172.21.15.84:0/2509917761 learned_addr learned my addr 172.21.15.84:0/2509917761 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f2777fff700 1 -- 172.21.15.84:0/2509917761 >> v1:172.21.15.131:6789/0 conn(0x7f27780cbae0 legacy=0x7f27780c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f2776ffd700 1 -- 172.21.15.84:0/2509917761 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939513496 0 0) 0x7f27780cbf20 con 0x7f27781598e0 2023-10-06T03:26:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f2777fff700 1 -- 172.21.15.84:0/2509917761 >> v1:172.21.15.84:6789/0 conn(0x7f27781598e0 legacy=0x7f27780ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.779+0000 7f2777fff700 1 -- 172.21.15.84:0/2509917761 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780cfbd0 con 0x7f2778159510 2023-10-06T03:26:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f2777fff700 1 --2- 172.21.15.84:0/2509917761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2778159510 0x7f27780cb5a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f27680098e0 tx=0x7f27680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36582f74d5c751dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f2776ffd700 1 -- 172.21.15.84:0/2509917761 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768009e80 con 0x7f2778159510 2023-10-06T03:26:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f2776ffd700 1 -- 172.21.15.84:0/2509917761 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276800b820 con 0x7f2778159510 2023-10-06T03:26:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f2776ffd700 1 -- 172.21.15.84:0/2509917761 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800bbe0 con 0x7f2778159510 2023-10-06T03:26:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f277e5af700 1 -- 172.21.15.84:0/2509917761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2778159510 msgr2=0x7f27780cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f277e5af700 1 --2- 172.21.15.84:0/2509917761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2778159510 0x7f27780cb5a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f27680098e0 tx=0x7f27680091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f277e5af700 1 -- 172.21.15.84:0/2509917761 shutdown_connections 2023-10-06T03:26:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f277e5af700 1 --2- 172.21.15.84:0/2509917761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2778159510 0x7f27780cb5a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f277e5af700 1 -- 172.21.15.84:0/2509917761 >> 172.21.15.84:0/2509917761 conn(0x7f2778089e90 msgr2=0x7f27780997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f277e5af700 1 -- 172.21.15.84:0/2509917761 shutdown_connections 2023-10-06T03:26:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.780+0000 7f277e5af700 1 -- 172.21.15.84:0/2509917761 wait complete. 2023-10-06T03:26:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.781+0000 7f277e5af700 1 Processor -- start 2023-10-06T03:26:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f277e5af700 1 -- start start 2023-10-06T03:26:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f277e5af700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27780cbae0 0x7f277814f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f277e5af700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2778159510 0x7f277814e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f277e5af700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27781598e0 0x7f27780c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f277e5af700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780b3ac0 con 0x7f27781598e0 2023-10-06T03:26:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f277e5af700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778069fe0 con 0x7f27780cbae0 2023-10-06T03:26:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f277e5af700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780b3470 con 0x7f2778159510 2023-10-06T03:26:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f277cb4c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27781598e0 0x7f27780c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f277cb4c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27781598e0 0x7f27780c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33650/0 (socket says 172.21.15.84:33650) 2023-10-06T03:26:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f277cb4c700 1 -- 172.21.15.84:0/1991550955 learned_addr learned my addr 172.21.15.84:0/1991550955 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f27777fe700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2778159510 0x7f277814e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.782+0000 7f2777fff700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27780cbae0 0x7f277814f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f277cb4c700 1 -- 172.21.15.84:0/1991550955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2778159510 msgr2=0x7f277814e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f277cb4c700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2778159510 0x7f277814e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f277cb4c700 1 -- 172.21.15.84:0/1991550955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27780cbae0 msgr2=0x7f277814f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f277cb4c700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27780cbae0 0x7f277814f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f277cb4c700 1 -- 172.21.15.84:0/1991550955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2768009420 con 0x7f27781598e0 2023-10-06T03:26:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f277cb4c700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27781598e0 0x7f27780c9750 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f277000c930 tx=0x7f27700026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f275ffff700 1 -- 172.21.15.84:0/1991550955 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770012630 con 0x7f27781598e0 2023-10-06T03:26:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f275ffff700 1 -- 172.21.15.84:0/1991550955 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27700127d0 con 0x7f27781598e0 2023-10-06T03:26:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f277e5af700 1 -- 172.21.15.84:0/1991550955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27780b3750 con 0x7f27781598e0 2023-10-06T03:26:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f275ffff700 1 -- 172.21.15.84:0/1991550955 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770012b90 con 0x7f27781598e0 2023-10-06T03:26:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.783+0000 7f277e5af700 1 -- 172.21.15.84:0/1991550955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277814ec80 con 0x7f27781598e0 2023-10-06T03:26:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.784+0000 7f277e5af700 1 -- 172.21.15.84:0/1991550955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2778064ad0 con 0x7f27781598e0 2023-10-06T03:26:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.784+0000 7f275ffff700 1 -- 172.21.15.84:0/1991550955 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f277001b400 con 0x7f27781598e0 2023-10-06T03:26:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.785+0000 7f275ffff700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2764066f30 0x7f27640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.785+0000 7f275ffff700 1 -- 172.21.15.84:0/1991550955 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2770084a40 con 0x7f27781598e0 2023-10-06T03:26:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.785+0000 7f2777fff700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2764066f30 0x7f27640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:25.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.785+0000 7f2777fff700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2764066f30 0x7f27640693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f27680098e0 tx=0x7f2768016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:25.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.789+0000 7f275ffff700 1 -- 172.21.15.84:0/1991550955 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2770086e60 con 0x7f27781598e0 2023-10-06T03:26:25.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.971+0000 7f277e5af700 1 -- 172.21.15.84:0/1991550955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27780cfeb0 con 0x7f27781598e0 2023-10-06T03:26:25.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.972+0000 7f275ffff700 1 -- 172.21.15.84:0/1991550955 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27700554a0 con 0x7f27781598e0 2023-10-06T03:26:25.972 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:26:25.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 -- 172.21.15.84:0/1991550955 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2764066f30 msgr2=0x7f27640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2764066f30 0x7f27640693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f27680098e0 tx=0x7f2768016000 comp rx=0 tx=0).stop 2023-10-06T03:26:25.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 -- 172.21.15.84:0/1991550955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27781598e0 msgr2=0x7f27780c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:25.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27781598e0 0x7f27780c9750 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f277000c930 tx=0x7f27700026e0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 -- 172.21.15.84:0/1991550955 shutdown_connections 2023-10-06T03:26:25.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2764066f30 0x7f27640693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27780cbae0 0x7f277814f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27781598e0 0x7f27780c9750 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 --2- 172.21.15.84:0/1991550955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2778159510 0x7f277814e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:25.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 -- 172.21.15.84:0/1991550955 >> 172.21.15.84:0/1991550955 conn(0x7f2778089e90 msgr2=0x7f277815bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:25.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 -- 172.21.15.84:0/1991550955 shutdown_connections 2023-10-06T03:26:25.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:25.974+0000 7f277e5af700 1 -- 172.21.15.84:0/1991550955 wait complete. 2023-10-06T03:26:25.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.100+0000 7fb886653700 1 Processor -- start 2023-10-06T03:26:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.100+0000 7fb886653700 1 -- start start 2023-10-06T03:26:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb886653700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb880159480 0x7fb8800b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb886653700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb8800b3610 0x7fb8800cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb886653700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8800cb7e0 con 0x7fb8800cc1b0 2023-10-06T03:26:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb886653700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8800b08a0 con 0x7fb880159480 2023-10-06T03:26:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb886653700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8800cb190 con 0x7fb8800b3610 2023-10-06T03:26:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb885651700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb880159480 0x7fb8800b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb885651700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb880159480 0x7fb8800b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33654/0 (socket says 172.21.15.84:33654) 2023-10-06T03:26:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb885e52700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb8800cc1b0 0x7fb8800b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34648/0 (socket says 172.21.15.84:34648) 2023-10-06T03:26:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb885651700 1 -- 172.21.15.84:0/2530824736 learned_addr learned my addr 172.21.15.84:0/2530824736 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb884e50700 1 --2- 172.21.15.84:0/2530824736 >> v2:172.21.15.131:3300/0 conn(0x7fb8800b3610 0x7fb8800cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb885651700 1 -- 172.21.15.84:0/2530824736 >> v2:172.21.15.131:3300/0 conn(0x7fb8800b3610 msgr2=0x7fb8800cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.101+0000 7fb885651700 1 --2- 172.21.15.84:0/2530824736 >> v2:172.21.15.131:3300/0 conn(0x7fb8800b3610 0x7fb8800cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb885651700 1 -- 172.21.15.84:0/2530824736 >> v1:172.21.15.84:6789/0 conn(0x7fb8800cc1b0 legacy=0x7fb8800b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb885651700 1 -- 172.21.15.84:0/2530824736 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8800cb470 con 0x7fb880159480 2023-10-06T03:26:26.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb877fff700 1 -- 172.21.15.84:0/2530824736 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368513339 0 0) 0x7fb8800cb7e0 con 0x7fb8800cc1b0 2023-10-06T03:26:26.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb885651700 1 --2- 172.21.15.84:0/2530824736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb880159480 0x7fb8800b30d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb8800d0260 tx=0x7fb87c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9134dd32867b2896 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:26.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb877fff700 1 -- 172.21.15.84:0/2530824736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c00b860 con 0x7fb880159480 2023-10-06T03:26:26.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb877fff700 1 -- 172.21.15.84:0/2530824736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87c00b9c0 con 0x7fb880159480 2023-10-06T03:26:26.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb877fff700 1 -- 172.21.15.84:0/2530824736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c00bd60 con 0x7fb880159480 2023-10-06T03:26:26.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb886653700 1 -- 172.21.15.84:0/2530824736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb880159480 msgr2=0x7fb8800b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb886653700 1 --2- 172.21.15.84:0/2530824736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb880159480 0x7fb8800b30d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb8800d0260 tx=0x7fb87c009250 comp rx=0 tx=0).stop 2023-10-06T03:26:26.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb886653700 1 -- 172.21.15.84:0/2530824736 shutdown_connections 2023-10-06T03:26:26.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb886653700 1 --2- 172.21.15.84:0/2530824736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb880159480 0x7fb8800b30d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb886653700 1 --2- 172.21.15.84:0/2530824736 >> v2:172.21.15.131:3300/0 conn(0x7fb8800b3610 0x7fb8800cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb886653700 1 -- 172.21.15.84:0/2530824736 >> 172.21.15.84:0/2530824736 conn(0x7fb88006ed20 msgr2=0x7fb88006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:26.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.102+0000 7fb886653700 1 -- 172.21.15.84:0/2530824736 shutdown_connections 2023-10-06T03:26:26.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.103+0000 7fb886653700 1 -- 172.21.15.84:0/2530824736 wait complete. 2023-10-06T03:26:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.104+0000 7fb886653700 1 Processor -- start 2023-10-06T03:26:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.104+0000 7fb886653700 1 -- start start 2023-10-06T03:26:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.104+0000 7fb886653700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8800b3610 0x7fb88015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.104+0000 7fb886653700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8800cc1b0 0x7fb88015d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.104+0000 7fb886653700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb880159480 0x7fb88016c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.104+0000 7fb886653700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800c7f70 con 0x7fb8800cc1b0 2023-10-06T03:26:26.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.104+0000 7fb886653700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800c8250 con 0x7fb8800b3610 2023-10-06T03:26:26.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.104+0000 7fb886653700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800c8530 con 0x7fb880159480 2023-10-06T03:26:26.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb884e50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8800cc1b0 0x7fb88015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb884e50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8800cc1b0 0x7fb88015d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33660/0 (socket says 172.21.15.84:33660) 2023-10-06T03:26:26.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb884e50700 1 -- 172.21.15.84:0/1104582200 learned_addr learned my addr 172.21.15.84:0/1104582200 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:26.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb885651700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8800b3610 0x7fb88015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb885e52700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb880159480 0x7fb88016c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb884e50700 1 -- 172.21.15.84:0/1104582200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb880159480 msgr2=0x7fb88016c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb884e50700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb880159480 0x7fb88016c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb884e50700 1 -- 172.21.15.84:0/1104582200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8800b3610 msgr2=0x7fb88015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb884e50700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8800b3610 0x7fb88015cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb884e50700 1 -- 172.21.15.84:0/1104582200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c0094f0 con 0x7fb8800cc1b0 2023-10-06T03:26:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb884e50700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8800cc1b0 0x7fb88015d490 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb87000d890 tx=0x7fb870008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb8757fa700 1 -- 172.21.15.84:0/1104582200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000b600 con 0x7fb8800cc1b0 2023-10-06T03:26:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb8757fa700 1 -- 172.21.15.84:0/1104582200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87000b760 con 0x7fb8800cc1b0 2023-10-06T03:26:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb886653700 1 -- 172.21.15.84:0/1104582200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8800c8810 con 0x7fb8800cc1b0 2023-10-06T03:26:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb8757fa700 1 -- 172.21.15.84:0/1104582200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000bae0 con 0x7fb8800cc1b0 2023-10-06T03:26:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.105+0000 7fb886653700 1 -- 172.21.15.84:0/1104582200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88016cda0 con 0x7fb8800cc1b0 2023-10-06T03:26:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.106+0000 7fb886653700 1 -- 172.21.15.84:0/1104582200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88005f270 con 0x7fb8800cc1b0 2023-10-06T03:26:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.106+0000 7fb8757fa700 1 -- 172.21.15.84:0/1104582200 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb87001e460 con 0x7fb8800cc1b0 2023-10-06T03:26:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.107+0000 7fb8757fa700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb864066f30 0x7fb8640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.107+0000 7fb8757fa700 1 -- 172.21.15.84:0/1104582200 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb870084df0 con 0x7fb8800cc1b0 2023-10-06T03:26:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.107+0000 7fb885651700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb864066f30 0x7fb8640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.107+0000 7fb885651700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb864066f30 0x7fb8640693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb8800d0260 tx=0x7fb87c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.111+0000 7fb8757fa700 1 -- 172.21.15.84:0/1104582200 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb870051dc0 con 0x7fb8800cc1b0 2023-10-06T03:26:26.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:26:26.194 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:26:26.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.345+0000 7fb886653700 1 -- 172.21.15.84:0/1104582200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb880159850 con 0x7fb8800cc1b0 2023-10-06T03:26:26.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.346+0000 7fb8757fa700 1 -- 172.21.15.84:0/1104582200 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fb8700553e0 con 0x7fb8800cc1b0 2023-10-06T03:26:26.347 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:26.347 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1214313207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1214313207},{"type":"v1","addr":"172.21.15.131:6835","nonce":1214313207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/63470384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":63470384},{"type":"v1","addr":"172.21.15.84:6837","nonce":63470384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3440632646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3440632646},{"type":"v1","addr":"172.21.15.131:6834","nonce":3440632646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:09.642630+0000","modified":"2023-10-06T03:26:13.283595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/390518387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":390518387},{"type":"v1","addr":"172.21.15.84:6836","nonce":390518387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 -- 172.21.15.84:0/1104582200 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb864066f30 msgr2=0x7fb8640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb864066f30 0x7fb8640693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb8800d0260 tx=0x7fb87c017000 comp rx=0 tx=0).stop 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 -- 172.21.15.84:0/1104582200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8800cc1b0 msgr2=0x7fb88015d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8800cc1b0 0x7fb88015d490 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb87000d890 tx=0x7fb870008040 comp rx=0 tx=0).stop 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 -- 172.21.15.84:0/1104582200 shutdown_connections 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb864066f30 0x7fb8640693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8800b3610 0x7fb88015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb880159480 0x7fb88016c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 --2- 172.21.15.84:0/1104582200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8800cc1b0 0x7fb88015d490 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 -- 172.21.15.84:0/1104582200 >> 172.21.15.84:0/1104582200 conn(0x7fb88006ed20 msgr2=0x7fb880157430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 -- 172.21.15.84:0/1104582200 shutdown_connections 2023-10-06T03:26:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.348+0000 7fb886653700 1 -- 172.21.15.84:0/1104582200 wait complete. 2023-10-06T03:26:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 39 2023-10-06T03:26:26.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:26.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.474+0000 7f665bfff700 1 Processor -- start 2023-10-06T03:26:26.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.474+0000 7f665bfff700 1 -- start start 2023-10-06T03:26:26.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f665bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f665c0cbc70 0x7f665c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f665bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f665c0b2140 0x7f665c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f665bfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665c0cb7e0 con 0x7f665c159480 2023-10-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f665bfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665c0b08a0 con 0x7f665c0cbc70 2023-10-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f665bfff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0cb190 con 0x7f665c0b2140 2023-10-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f66527fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f665c0cbc70 0x7f665c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f665affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f665c159480 0x7f665c0b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34658/0 (socket says 172.21.15.84:34658) 2023-10-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f665affd700 1 -- 172.21.15.84:0/1675750439 learned_addr learned my addr 172.21.15.84:0/1675750439 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f665b7fe700 1 --2- 172.21.15.84:0/1675750439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f665c0b2140 0x7f665c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f66527fc700 1 -- 172.21.15.84:0/1675750439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f665c0b2140 msgr2=0x7f665c0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f66527fc700 1 --2- 172.21.15.84:0/1675750439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f665c0b2140 0x7f665c0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f66527fc700 1 -- 172.21.15.84:0/1675750439 >> v1:172.21.15.84:6789/0 conn(0x7f665c159480 legacy=0x7f665c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.475+0000 7f665a7fc700 1 -- 172.21.15.84:0/1675750439 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494652709 0 0) 0x7f665c0cb7e0 con 0x7f665c159480 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f66527fc700 1 -- 172.21.15.84:0/1675750439 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c0cb470 con 0x7f665c0cbc70 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f66527fc700 1 --2- 172.21.15.84:0/1675750439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0cbc70 0x7f665c0cc0c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f66440098e0 tx=0x7f66440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7775fe09691c0e07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665a7fc700 1 -- 172.21.15.84:0/1675750439 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644009e80 con 0x7f665c0cbc70 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665a7fc700 1 -- 172.21.15.84:0/1675750439 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664400b860 con 0x7f665c0cbc70 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665a7fc700 1 -- 172.21.15.84:0/1675750439 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400bbe0 con 0x7f665c0cbc70 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665bfff700 1 -- 172.21.15.84:0/1675750439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0cbc70 msgr2=0x7f665c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665bfff700 1 --2- 172.21.15.84:0/1675750439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0cbc70 0x7f665c0cc0c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f66440098e0 tx=0x7f66440091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665bfff700 1 -- 172.21.15.84:0/1675750439 shutdown_connections 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665bfff700 1 --2- 172.21.15.84:0/1675750439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f665c0b2140 0x7f665c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665bfff700 1 --2- 172.21.15.84:0/1675750439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0cbc70 0x7f665c0cc0c0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665bfff700 1 -- 172.21.15.84:0/1675750439 >> 172.21.15.84:0/1675750439 conn(0x7f665c06ed20 msgr2=0x7f665c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665bfff700 1 -- 172.21.15.84:0/1675750439 shutdown_connections 2023-10-06T03:26:26.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.476+0000 7f665bfff700 1 -- 172.21.15.84:0/1675750439 wait complete. 2023-10-06T03:26:26.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.477+0000 7f665bfff700 1 Processor -- start 2023-10-06T03:26:26.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.478+0000 7f665bfff700 1 -- start start 2023-10-06T03:26:26.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.478+0000 7f665bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f665c0b2140 0x7f665c0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.478+0000 7f665bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f665c0cbc70 0x7f665c0c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.478+0000 7f665bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c159480 0x7f665c0c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.478+0000 7f665bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0cf950 con 0x7f665c159480 2023-10-06T03:26:26.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.478+0000 7f665bfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0cf4c0 con 0x7f665c0b2140 2023-10-06T03:26:26.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.478+0000 7f665bfff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0ce8b0 con 0x7f665c0cbc70 2023-10-06T03:26:26.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.478+0000 7f665b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c159480 0x7f665c0c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.478+0000 7f665b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c159480 0x7f665c0c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33690/0 (socket says 172.21.15.84:33690) 2023-10-06T03:26:26.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.478+0000 7f665b7fe700 1 -- 172.21.15.84:0/4011183195 learned_addr learned my addr 172.21.15.84:0/4011183195 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f665affd700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f665c0b2140 0x7f665c0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f66527fc700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f665c0cbc70 0x7f665c0c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f665b7fe700 1 -- 172.21.15.84:0/4011183195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f665c0cbc70 msgr2=0x7f665c0c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f665b7fe700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f665c0cbc70 0x7f665c0c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f665b7fe700 1 -- 172.21.15.84:0/4011183195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f665c0b2140 msgr2=0x7f665c0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f665b7fe700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f665c0b2140 0x7f665c0cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f665b7fe700 1 -- 172.21.15.84:0/4011183195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644009420 con 0x7f665c159480 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f665affd700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f665c0b2140 0x7f665c0cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f665b7fe700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c159480 0x7f665c0c8f50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6654009fd0 tx=0x7f6654009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f66537fe700 1 -- 172.21.15.84:0/4011183195 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665400ed50 con 0x7f665c159480 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f66537fe700 1 -- 172.21.15.84:0/4011183195 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665400eeb0 con 0x7f665c159480 2023-10-06T03:26:26.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f665bfff700 1 -- 172.21.15.84:0/4011183195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c0ceb90 con 0x7f665c159480 2023-10-06T03:26:26.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f66537fe700 1 -- 172.21.15.84:0/4011183195 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6654014650 con 0x7f665c159480 2023-10-06T03:26:26.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.479+0000 7f665bfff700 1 -- 172.21.15.84:0/4011183195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665c0cf150 con 0x7f665c159480 2023-10-06T03:26:26.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.480+0000 7f665bfff700 1 -- 172.21.15.84:0/4011183195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665c05f270 con 0x7f665c159480 2023-10-06T03:26:26.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.480+0000 7f66537fe700 1 -- 172.21.15.84:0/4011183195 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66540149c0 con 0x7f665c159480 2023-10-06T03:26:26.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.481+0000 7f66537fe700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f663c066f30 0x7f663c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.481+0000 7f66537fe700 1 -- 172.21.15.84:0/4011183195 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6654084fc0 con 0x7f665c159480 2023-10-06T03:26:26.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.481+0000 7f665affd700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f663c066f30 0x7f663c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.481+0000 7f665affd700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f663c066f30 0x7f663c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f664c001810 tx=0x7f664c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:26.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.485+0000 7f66537fe700 1 -- 172.21.15.84:0/4011183195 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6654051f90 con 0x7f665c159480 2023-10-06T03:26:26.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.670+0000 7f665bfff700 1 -- 172.21.15.84:0/4011183195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f665c0b2ae0 con 0x7f665c159480 2023-10-06T03:26:26.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.671+0000 7f66537fe700 1 -- 172.21.15.84:0/4011183195 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f66540555b0 con 0x7f665c159480 2023-10-06T03:26:26.672 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:26.672 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":74,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:11.256666+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:07.289525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:08.601697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 -- 172.21.15.84:0/4011183195 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f663c066f30 msgr2=0x7f663c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f663c066f30 0x7f663c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f664c001810 tx=0x7f664c009040 comp rx=0 tx=0).stop 2023-10-06T03:26:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 -- 172.21.15.84:0/4011183195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c159480 msgr2=0x7f665c0c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c159480 0x7f665c0c8f50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6654009fd0 tx=0x7f6654009900 comp rx=0 tx=0).stop 2023-10-06T03:26:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 -- 172.21.15.84:0/4011183195 shutdown_connections 2023-10-06T03:26:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f663c066f30 0x7f663c0693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f665c0b2140 0x7f665c0cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c159480 0x7f665c0c8f50 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 --2- 172.21.15.84:0/4011183195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f665c0cbc70 0x7f665c0c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 -- 172.21.15.84:0/4011183195 >> 172.21.15.84:0/4011183195 conn(0x7f665c06ed20 msgr2=0x7f665c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 -- 172.21.15.84:0/4011183195 shutdown_connections 2023-10-06T03:26:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.673+0000 7f665bfff700 1 -- 172.21.15.84:0/4011183195 wait complete. 2023-10-06T03:26:26.686 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:26:26.686 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:26.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.799+0000 7f68154c7700 1 Processor -- start 2023-10-06T03:26:26.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.799+0000 7f68154c7700 1 -- start start 2023-10-06T03:26:26.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.800+0000 7f68154c7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6810156540 0x7f68100c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.800+0000 7f68154c7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f68100c75b0 0x7f681006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.800+0000 7f68154c7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68100acd60 con 0x7f681006ebd0 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.800+0000 7f68154c7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681006f470 con 0x7f68100c75b0 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.800+0000 7f68154c7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681006f050 con 0x7f6810156540 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.800+0000 7f680f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f681006ebd0 0x7f681006d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34672/0 (socket says 172.21.15.84:34672) 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.800+0000 7f680f7fe700 1 -- 172.21.15.84:0/2187584712 learned_addr learned my addr 172.21.15.84:0/2187584712 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680effd700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6810156540 0x7f68100c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f68067fc700 1 --2- 172.21.15.84:0/2187584712 >> v2:172.21.15.131:3300/0 conn(0x7f68100c75b0 0x7f681006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011627404 0 0) 0x7f68100acd60 con 0x7f681006ebd0 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67fc003570 con 0x7f681006ebd0 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2979044217 0 0) 0x7f67fc003570 con 0x7f681006ebd0 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6810156540 msgr2=0x7f68100c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:26.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6810156540 0x7f68100c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 >> v2:172.21.15.131:3300/0 conn(0x7f68100c75b0 msgr2=0x7f681006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:26.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 --2- 172.21.15.84:0/2187584712 >> v2:172.21.15.131:3300/0 conn(0x7f68100c75b0 0x7f681006e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6810156910 con 0x7f681006ebd0 2023-10-06T03:26:26.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f68080017f0 con 0x7f681006ebd0 2023-10-06T03:26:26.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 >> v1:172.21.15.84:6789/0 conn(0x7f681006ebd0 legacy=0x7f681006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6810156540 0x7f67fc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67fc004010 0x7f67fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 0x7f67fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681006f470 con 0x7f67fc004d50 2023-10-06T03:26:26.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681006f050 con 0x7f67fc004010 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc00bab0 con 0x7f6810156540 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f68067fc700 1 --2- 172.21.15.84:0/2187584712 >> v2:172.21.15.131:3300/0 conn(0x7f68100c75b0 0x7f681006e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680f7fe700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 0x7f67fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680effd700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6810156540 0x7f67fc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680f7fe700 1 -- 172.21.15.84:0/2187584712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6810156540 msgr2=0x7f67fc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680f7fe700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6810156540 0x7f67fc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680f7fe700 1 -- 172.21.15.84:0/2187584712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67fc004010 msgr2=0x7f67fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680f7fe700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67fc004010 0x7f67fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.801+0000 7f680f7fe700 1 -- 172.21.15.84:0/2187584712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc003570 con 0x7f67fc004d50 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f680f7fe700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 0x7f67fc0051c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f680800a930 tx=0x7f68080021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc39a49fe80d24c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:26.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080070d0 con 0x7f67fc004d50 2023-10-06T03:26:26.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808007230 con 0x7f67fc004d50 2023-10-06T03:26:26.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f680e7fc700 1 -- 172.21.15.84:0/2187584712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080075d0 con 0x7f67fc004d50 2023-10-06T03:26:26.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f68154c7700 1 -- 172.21.15.84:0/2187584712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 msgr2=0x7f67fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f68154c7700 1 --2- 172.21.15.84:0/2187584712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 0x7f67fc0051c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f680800a930 tx=0x7f68080021d0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f680f7fe700 1 -- 172.21.15.84:0/2187584712 reap_dead start 2023-10-06T03:26:26.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f68154c7700 1 -- 172.21.15.84:0/2187584712 shutdown_connections 2023-10-06T03:26:26.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f68154c7700 1 -- 172.21.15.84:0/2187584712 >> 172.21.15.84:0/2187584712 conn(0x7f68100680c0 msgr2=0x7f68100cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:26.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f68154c7700 1 -- 172.21.15.84:0/2187584712 shutdown_connections 2023-10-06T03:26:26.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.802+0000 7f68154c7700 1 -- 172.21.15.84:0/2187584712 wait complete. 2023-10-06T03:26:26.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.803+0000 7f68154c7700 1 Processor -- start 2023-10-06T03:26:26.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.804+0000 7f68154c7700 1 -- start start 2023-10-06T03:26:26.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.804+0000 7f68154c7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 0x7f681014f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.804+0000 7f68154c7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f681016a750 0x7f6810069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.804+0000 7f68154c7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f681016abc0 0x7f6810069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.804+0000 7f68154c7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6810153780 con 0x7f67fc004d50 2023-10-06T03:26:26.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.804+0000 7f68154c7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6810152820 con 0x7f681016a750 2023-10-06T03:26:26.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.804+0000 7f68154c7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6810152b00 con 0x7f681016abc0 2023-10-06T03:26:26.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.804+0000 7f680effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 0x7f681014f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.804+0000 7f680effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 0x7f681014f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33712/0 (socket says 172.21.15.84:33712) 2023-10-06T03:26:26.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.804+0000 7f680effd700 1 -- 172.21.15.84:0/1301497586 learned_addr learned my addr 172.21.15.84:0/1301497586 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:26.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f680f7fe700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f681016abc0 0x7f6810069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f68067fc700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f681016a750 0x7f6810069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f680effd700 1 -- 172.21.15.84:0/1301497586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f681016abc0 msgr2=0x7f6810069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f680effd700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f681016abc0 0x7f6810069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f680effd700 1 -- 172.21.15.84:0/1301497586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f681016a750 msgr2=0x7f6810069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:26.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f680effd700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f681016a750 0x7f6810069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:26.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f680effd700 1 -- 172.21.15.84:0/1301497586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6810152de0 con 0x7f67fc004d50 2023-10-06T03:26:26.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f68067fc700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f681016a750 0x7f6810069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:26.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f680effd700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 0x7f681014f900 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6800006ac0 tx=0x7f68000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:26.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f68077fe700 1 -- 172.21.15.84:0/1301497586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000fa10 con 0x7f67fc004d50 2023-10-06T03:26:26.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f68077fe700 1 -- 172.21.15.84:0/1301497586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680000fb70 con 0x7f67fc004d50 2023-10-06T03:26:26.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f68154c7700 1 -- 172.21.15.84:0/1301497586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68101530c0 con 0x7f67fc004d50 2023-10-06T03:26:26.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f68077fe700 1 -- 172.21.15.84:0/1301497586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800014440 con 0x7f67fc004d50 2023-10-06T03:26:26.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.805+0000 7f68154c7700 1 -- 172.21.15.84:0/1301497586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6810155220 con 0x7f67fc004d50 2023-10-06T03:26:26.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.806+0000 7f68154c7700 1 -- 172.21.15.84:0/1301497586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68101539f0 con 0x7f67fc004d50 2023-10-06T03:26:26.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.806+0000 7f68077fe700 1 -- 172.21.15.84:0/1301497586 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6800014870 con 0x7f67fc004d50 2023-10-06T03:26:26.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.807+0000 7f68077fe700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f67f0066f30 0x7f67f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:26.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.807+0000 7f68077fe700 1 -- 172.21.15.84:0/1301497586 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6800018030 con 0x7f67fc004d50 2023-10-06T03:26:26.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.807+0000 7f68067fc700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f67f0066f30 0x7f67f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:26.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.807+0000 7f68067fc700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f67f0066f30 0x7f67f00693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009170 tx=0x7f67f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:26.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:26.811+0000 7f68077fe700 1 -- 172.21.15.84:0/1301497586 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6800052260 con 0x7f67fc004d50 2023-10-06T03:26:27.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.035+0000 7f68154c7700 1 -- 172.21.15.84:0/1301497586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6810064ad0 con 0x7f67fc004d50 2023-10-06T03:26:27.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.035+0000 7f68077fe700 1 -- 172.21.15.84:0/1301497586 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f6800055880 con 0x7f67fc004d50 2023-10-06T03:26:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:27.036 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1214313207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1214313207},{"type":"v1","addr":"172.21.15.131:6835","nonce":1214313207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/63470384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":63470384},{"type":"v1","addr":"172.21.15.84:6837","nonce":63470384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3440632646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3440632646},{"type":"v1","addr":"172.21.15.131:6834","nonce":3440632646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:09.642630+0000","modified":"2023-10-06T03:26:13.283595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/390518387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":390518387},{"type":"v1","addr":"172.21.15.84:6836","nonce":390518387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:26:27.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 -- 172.21.15.84:0/1301497586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f67f0066f30 msgr2=0x7f67f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f67f0066f30 0x7f67f00693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009170 tx=0x7f67f8008040 comp rx=0 tx=0).stop 2023-10-06T03:26:27.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 -- 172.21.15.84:0/1301497586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 msgr2=0x7f681014f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 0x7f681014f900 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6800006ac0 tx=0x7f68000091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 -- 172.21.15.84:0/1301497586 shutdown_connections 2023-10-06T03:26:27.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f67f0066f30 0x7f67f00693e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f681016abc0 0x7f6810069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67fc004d50 0x7f681014f900 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 --2- 172.21.15.84:0/1301497586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f681016a750 0x7f6810069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 -- 172.21.15.84:0/1301497586 >> 172.21.15.84:0/1301497586 conn(0x7f68100680c0 msgr2=0x7f681014e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:27.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 -- 172.21.15.84:0/1301497586 shutdown_connections 2023-10-06T03:26:27.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.037+0000 7f68154c7700 1 -- 172.21.15.84:0/1301497586 wait complete. 2023-10-06T03:26:27.040 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 39 2023-10-06T03:26:27.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:27.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.164+0000 7f22610c0700 1 Processor -- start 2023-10-06T03:26:27.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.164+0000 7f22610c0700 1 -- start start 2023-10-06T03:26:27.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.165+0000 7f22610c0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f225c157830 0x7f225c0ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.165+0000 7f22610c0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c0ac480 0x7f225c068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.165+0000 7f22610c0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c0cae60 con 0x7f225c157460 2023-10-06T03:26:27.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.165+0000 7f22610c0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c0aeed0 con 0x7f225c157830 2023-10-06T03:26:27.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.165+0000 7f22610c0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0af1b0 con 0x7f225c0ac480 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.165+0000 7f225ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f225c157460 0x7f225c0cc2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34684/0 (socket says 172.21.15.84:34684) 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.165+0000 7f225ad9d700 1 -- 172.21.15.84:0/425990985 learned_addr learned my addr 172.21.15.84:0/425990985 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.165+0000 7f225b59e700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c0ac480 0x7f225c068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.165+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868319208 0 0) 0x7f225c0cae60 con 0x7f225c157460 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.165+0000 7f225259c700 1 --2- 172.21.15.84:0/425990985 >> v2:172.21.15.131:3300/0 conn(0x7f225c157830 0x7f225c0ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2248003570 con 0x7f225c157460 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1551839153 0 0) 0x7f2248003570 con 0x7f225c157460 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c0ac480 msgr2=0x7f225c068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c0ac480 0x7f225c068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 >> v2:172.21.15.131:3300/0 conn(0x7f225c157830 msgr2=0x7f225c0ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 --2- 172.21.15.84:0/425990985 >> v2:172.21.15.131:3300/0 conn(0x7f225c157830 0x7f225c0ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0af490 con 0x7f225c157460 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f224c0015f0 con 0x7f225c157460 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 >> v1:172.21.15.84:6789/0 conn(0x7f225c157460 legacy=0x7f225c0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c0ac480 0x7f2248003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2248003fe0 0x7f2248004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2248004d50 0x7f22480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0aeed0 con 0x7f2248004d50 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0af1b0 con 0x7f2248003fe0 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224800bbf0 con 0x7f225c0ac480 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225259c700 1 --2- 172.21.15.84:0/425990985 >> v2:172.21.15.131:3300/0 conn(0x7f225c157830 0x7f225c0ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225b59e700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2248004d50 0x7f22480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225ad9d700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c0ac480 0x7f2248003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225259c700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2248003fe0 0x7f2248004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225b59e700 1 -- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c0ac480 msgr2=0x7f2248003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225b59e700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c0ac480 0x7f2248003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225b59e700 1 -- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2248003fe0 msgr2=0x7f2248004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225b59e700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2248003fe0 0x7f2248004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225b59e700 1 -- 172.21.15.84:0/425990985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248003570 con 0x7f2248004d50 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225259c700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2248003fe0 0x7f2248004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.166+0000 7f225b59e700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2248004d50 0x7f22480051c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f22540094d0 tx=0x7f225400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8530970bdd58dffc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.167+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225400ea90 con 0x7f2248004d50 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.167+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225400f040 con 0x7f2248004d50 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.167+0000 7f225a59c700 1 -- 172.21.15.84:0/425990985 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225400ee20 con 0x7f2248004d50 2023-10-06T03:26:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.167+0000 7f22610c0700 1 -- 172.21.15.84:0/425990985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2248004d50 msgr2=0x7f22480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.167+0000 7f22610c0700 1 --2- 172.21.15.84:0/425990985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2248004d50 0x7f22480051c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f22540094d0 tx=0x7f225400b040 comp rx=0 tx=0).stop 2023-10-06T03:26:27.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.167+0000 7f225b59e700 1 -- 172.21.15.84:0/425990985 reap_dead start 2023-10-06T03:26:27.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.167+0000 7f22610c0700 1 -- 172.21.15.84:0/425990985 shutdown_connections 2023-10-06T03:26:27.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.167+0000 7f22610c0700 1 -- 172.21.15.84:0/425990985 >> 172.21.15.84:0/425990985 conn(0x7f225c06de80 msgr2=0x7f225c06e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:27.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.167+0000 7f22610c0700 1 -- 172.21.15.84:0/425990985 shutdown_connections 2023-10-06T03:26:27.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.167+0000 7f22610c0700 1 -- 172.21.15.84:0/425990985 wait complete. 2023-10-06T03:26:27.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.168+0000 7f22610c0700 1 Processor -- start 2023-10-06T03:26:27.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.168+0000 7f22610c0700 1 -- start start 2023-10-06T03:26:27.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f22610c0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c15c780 0x7f225c151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f22610c0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f225c153950 0x7f225c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f22610c0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f225c155e10 0x7f225c1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f22610c0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c154280 con 0x7f225c153950 2023-10-06T03:26:27.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f22610c0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c153dc0 con 0x7f225c155e10 2023-10-06T03:26:27.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f22610c0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c15cb50 con 0x7f225c15c780 2023-10-06T03:26:27.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f225c153950 0x7f225c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f225c153950 0x7f225c152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33720/0 (socket says 172.21.15.84:33720) 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225259c700 1 -- 172.21.15.84:0/1396369856 learned_addr learned my addr 172.21.15.84:0/1396369856 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225ad9d700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c15c780 0x7f225c151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225b59e700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f225c155e10 0x7f225c1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225259c700 1 -- 172.21.15.84:0/1396369856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c15c780 msgr2=0x7f225c151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225259c700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c15c780 0x7f225c151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225259c700 1 -- 172.21.15.84:0/1396369856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f225c155e10 msgr2=0x7f225c1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225259c700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f225c155e10 0x7f225c1562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225259c700 1 -- 172.21.15.84:0/1396369856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c152780 con 0x7f225c153950 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.169+0000 7f225b59e700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f225c155e10 0x7f225c1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.170+0000 7f225259c700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f225c153950 0x7f225c152f50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2244010970 tx=0x7f224400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.170+0000 7f22537fe700 1 -- 172.21.15.84:0/1396369856 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244010e60 con 0x7f225c153950 2023-10-06T03:26:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.170+0000 7f22537fe700 1 -- 172.21.15.84:0/1396369856 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224400e870 con 0x7f225c153950 2023-10-06T03:26:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.170+0000 7f22610c0700 1 -- 172.21.15.84:0/1396369856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c154490 con 0x7f225c153950 2023-10-06T03:26:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.170+0000 7f22537fe700 1 -- 172.21.15.84:0/1396369856 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224400ec30 con 0x7f225c153950 2023-10-06T03:26:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.170+0000 7f22610c0700 1 -- 172.21.15.84:0/1396369856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c152a30 con 0x7f225c153950 2023-10-06T03:26:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.171+0000 7f22610c0700 1 -- 172.21.15.84:0/1396369856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c064ad0 con 0x7f225c153950 2023-10-06T03:26:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.171+0000 7f22537fe700 1 -- 172.21.15.84:0/1396369856 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2244015470 con 0x7f225c153950 2023-10-06T03:26:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.171+0000 7f22537fe700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f223c066f30 0x7f223c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.172+0000 7f225ad9d700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f223c066f30 0x7f223c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.172+0000 7f22537fe700 1 -- 172.21.15.84:0/1396369856 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2244085080 con 0x7f225c153950 2023-10-06T03:26:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.172+0000 7f225ad9d700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f223c066f30 0x7f223c0693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f224c001260 tx=0x7f224c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.176+0000 7f22537fe700 1 -- 172.21.15.84:0/1396369856 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2244055ae0 con 0x7f225c153950 2023-10-06T03:26:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.402+0000 7f22610c0700 1 -- 172.21.15.84:0/1396369856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f225c152da0 con 0x7f225c153950 2023-10-06T03:26:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.403+0000 7f22537fe700 1 -- 172.21.15.84:0/1396369856 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f2244055670 con 0x7f225c153950 2023-10-06T03:26:27.403 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:27.404 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1214313207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1214313207},{"type":"v1","addr":"172.21.15.131:6835","nonce":1214313207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/63470384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":63470384},{"type":"v1","addr":"172.21.15.84:6837","nonce":63470384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3440632646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3440632646},{"type":"v1","addr":"172.21.15.131:6834","nonce":3440632646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:09.642630+0000","modified":"2023-10-06T03:26:13.283595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/390518387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":390518387},{"type":"v1","addr":"172.21.15.84:6836","nonce":390518387}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:26:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.404+0000 7f22610c0700 1 -- 172.21.15.84:0/1396369856 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f223c066f30 msgr2=0x7f223c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.404+0000 7f22610c0700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f223c066f30 0x7f223c0693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f224c001260 tx=0x7f224c009040 comp rx=0 tx=0).stop 2023-10-06T03:26:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.404+0000 7f22610c0700 1 -- 172.21.15.84:0/1396369856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f225c153950 msgr2=0x7f225c152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.404+0000 7f22610c0700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f225c153950 0x7f225c152f50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2244010970 tx=0x7f224400b040 comp rx=0 tx=0).stop 2023-10-06T03:26:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.404+0000 7f22610c0700 1 -- 172.21.15.84:0/1396369856 shutdown_connections 2023-10-06T03:26:27.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.404+0000 7f22610c0700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f223c066f30 0x7f223c0693e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.404+0000 7f22610c0700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f225c155e10 0x7f225c1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.404+0000 7f22610c0700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c15c780 0x7f225c151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.405+0000 7f22610c0700 1 --2- 172.21.15.84:0/1396369856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f225c153950 0x7f225c152f50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.405+0000 7f22610c0700 1 -- 172.21.15.84:0/1396369856 >> 172.21.15.84:0/1396369856 conn(0x7f225c06de80 msgr2=0x7f225c0aa950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:27.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.405+0000 7f22610c0700 1 -- 172.21.15.84:0/1396369856 shutdown_connections 2023-10-06T03:26:27.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.405+0000 7f22610c0700 1 -- 172.21.15.84:0/1396369856 wait complete. 2023-10-06T03:26:27.406 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 39 2023-10-06T03:26:27.417 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:27.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.531+0000 7fe539fe2700 1 Processor -- start 2023-10-06T03:26:27.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.531+0000 7fe539fe2700 1 -- start start 2023-10-06T03:26:27.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe539fe2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe5341595a0 0x7fe5340aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe539fe2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340b49e0 0x7fe5340aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe539fe2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5340b0ca0 con 0x7fe5340b07a0 2023-10-06T03:26:27.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe539fe2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340b0f80 con 0x7fe5341595a0 2023-10-06T03:26:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe539fe2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340b1260 con 0x7fe5340b49e0 2023-10-06T03:26:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe533fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe5340b07a0 0x7fe5340b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34690/0 (socket says 172.21.15.84:34690) 2023-10-06T03:26:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe533fff700 1 -- 172.21.15.84:0/1498149286 learned_addr learned my addr 172.21.15.84:0/1498149286 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe5337fe700 1 --2- 172.21.15.84:0/1498149286 >> v2:172.21.15.131:3300/0 conn(0x7fe5341595a0 0x7fe5340aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe532ffd700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340b49e0 0x7fe5340aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111011983 0 0) 0x7fe5340b0ca0 con 0x7fe5340b07a0 2023-10-06T03:26:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe51c003570 con 0x7fe5340b07a0 2023-10-06T03:26:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2037066910 0 0) 0x7fe51c003570 con 0x7fe5340b07a0 2023-10-06T03:26:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340b49e0 msgr2=0x7fe5340aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe5327fc700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340b49e0 0x7fe5340aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 >> v2:172.21.15.131:3300/0 conn(0x7fe5341595a0 msgr2=0x7fe5340aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe5327fc700 1 --2- 172.21.15.84:0/1498149286 >> v2:172.21.15.131:3300/0 conn(0x7fe5341595a0 0x7fe5340aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340b1540 con 0x7fe5340b07a0 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.532+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fe52c001470 con 0x7fe5340b07a0 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 >> v1:172.21.15.84:6789/0 conn(0x7fe5340b07a0 legacy=0x7fe5340b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5327fc700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340b49e0 0x7fe51c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5327fc700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c003fe0 0x7fe51c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5327fc700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe51c004d50 0x7fe51c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340b0f80 con 0x7fe51c003fe0 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340b1260 con 0x7fe51c004d50 2023-10-06T03:26:27.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c00ba90 con 0x7fe5340b49e0 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe532ffd700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c003fe0 0x7fe51c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5337fe700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340b49e0 0x7fe51c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe532ffd700 1 -- 172.21.15.84:0/1498149286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340b49e0 msgr2=0x7fe51c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe532ffd700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340b49e0 0x7fe51c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe532ffd700 1 -- 172.21.15.84:0/1498149286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe51c004d50 msgr2=0x7fe51c0051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe532ffd700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe51c004d50 0x7fe51c0051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe532ffd700 1 -- 172.21.15.84:0/1498149286 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c003570 con 0x7fe51c003fe0 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe532ffd700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c003fe0 0x7fe51c004810 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe528009c00 tx=0x7fe5280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9346ba3ac3c068ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800e6b0 con 0x7fe51c003fe0 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52800e810 con 0x7fe51c003fe0 2023-10-06T03:26:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.533+0000 7fe5327fc700 1 -- 172.21.15.84:0/1498149286 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800ebd0 con 0x7fe51c003fe0 2023-10-06T03:26:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.534+0000 7fe539fe2700 1 -- 172.21.15.84:0/1498149286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c003fe0 msgr2=0x7fe51c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.534+0000 7fe539fe2700 1 --2- 172.21.15.84:0/1498149286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c003fe0 0x7fe51c004810 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe528009c00 tx=0x7fe5280091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.534+0000 7fe533fff700 1 -- 172.21.15.84:0/1498149286 reap_dead start 2023-10-06T03:26:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.534+0000 7fe539fe2700 1 -- 172.21.15.84:0/1498149286 shutdown_connections 2023-10-06T03:26:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.534+0000 7fe539fe2700 1 -- 172.21.15.84:0/1498149286 >> 172.21.15.84:0/1498149286 conn(0x7fe534099830 msgr2=0x7fe53406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.534+0000 7fe539fe2700 1 -- 172.21.15.84:0/1498149286 shutdown_connections 2023-10-06T03:26:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.534+0000 7fe539fe2700 1 -- 172.21.15.84:0/1498149286 wait complete. 2023-10-06T03:26:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.535+0000 7fe539fe2700 1 Processor -- start 2023-10-06T03:26:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.535+0000 7fe539fe2700 1 -- start start 2023-10-06T03:26:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe539fe2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe51c003fe0 0x7fe534149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe539fe2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5340c5270 0x7fe5340c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe539fe2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340c66e0 0x7fe5340c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe539fe2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340c70c0 con 0x7fe5340c5270 2023-10-06T03:26:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe539fe2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340c5cf0 con 0x7fe51c003fe0 2023-10-06T03:26:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe539fe2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340c5fd0 con 0x7fe5340c66e0 2023-10-06T03:26:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe532ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5340c5270 0x7fe5340c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe532ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5340c5270 0x7fe5340c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33744/0 (socket says 172.21.15.84:33744) 2023-10-06T03:26:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe532ffd700 1 -- 172.21.15.84:0/785580602 learned_addr learned my addr 172.21.15.84:0/785580602 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe5337fe700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe51c003fe0 0x7fe534149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe533fff700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340c66e0 0x7fe5340c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe532ffd700 1 -- 172.21.15.84:0/785580602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340c66e0 msgr2=0x7fe5340c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe532ffd700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340c66e0 0x7fe5340c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe532ffd700 1 -- 172.21.15.84:0/785580602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe51c003fe0 msgr2=0x7fe534149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe532ffd700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe51c003fe0 0x7fe534149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe532ffd700 1 -- 172.21.15.84:0/785580602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340c62b0 con 0x7fe5340c5270 2023-10-06T03:26:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe533fff700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340c66e0 0x7fe5340c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe5337fe700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe51c003fe0 0x7fe534149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.536+0000 7fe532ffd700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5340c5270 0x7fe5340c56e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe5280091e0 tx=0x7fe52801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.537+0000 7fe51b7fe700 1 -- 172.21.15.84:0/785580602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528022070 con 0x7fe5340c5270 2023-10-06T03:26:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.537+0000 7fe51b7fe700 1 -- 172.21.15.84:0/785580602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52800e980 con 0x7fe5340c5270 2023-10-06T03:26:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.537+0000 7fe539fe2700 1 -- 172.21.15.84:0/785580602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53409a230 con 0x7fe5340c5270 2023-10-06T03:26:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.537+0000 7fe51b7fe700 1 -- 172.21.15.84:0/785580602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528027470 con 0x7fe5340c5270 2023-10-06T03:26:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.537+0000 7fe539fe2700 1 -- 172.21.15.84:0/785580602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe534149ca0 con 0x7fe5340c5270 2023-10-06T03:26:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.538+0000 7fe539fe2700 1 -- 172.21.15.84:0/785580602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53409a090 con 0x7fe5340c5270 2023-10-06T03:26:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.538+0000 7fe51b7fe700 1 -- 172.21.15.84:0/785580602 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe52801c450 con 0x7fe5340c5270 2023-10-06T03:26:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.538+0000 7fe51b7fe700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe520066f30 0x7fe5200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.538+0000 7fe5337fe700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe520066f30 0x7fe5200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.538+0000 7fe51b7fe700 1 -- 172.21.15.84:0/785580602 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe528086310 con 0x7fe5340c5270 2023-10-06T03:26:27.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.539+0000 7fe5337fe700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe520066f30 0x7fe5200693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe534069eb0 tx=0x7fe52400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:27.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.543+0000 7fe51b7fe700 1 -- 172.21.15.84:0/785580602 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe53409a090 con 0x7fe5340c5270 2023-10-06T03:26:27.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.727+0000 7fe539fe2700 1 -- 172.21.15.84:0/785580602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe53409a090 con 0x7fe5340c5270 2023-10-06T03:26:27.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.728+0000 7fe51b7fe700 1 -- 172.21.15.84:0/785580602 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fe53409a090 con 0x7fe5340c5270 2023-10-06T03:26:27.729 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:27.729 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":74,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:11.256666+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:07.289525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:08.601697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:27.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 -- 172.21.15.84:0/785580602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe520066f30 msgr2=0x7fe5200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe520066f30 0x7fe5200693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe534069eb0 tx=0x7fe52400b040 comp rx=0 tx=0).stop 2023-10-06T03:26:27.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 -- 172.21.15.84:0/785580602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5340c5270 msgr2=0x7fe5340c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5340c5270 0x7fe5340c56e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe5280091e0 tx=0x7fe52801a000 comp rx=0 tx=0).stop 2023-10-06T03:26:27.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 -- 172.21.15.84:0/785580602 shutdown_connections 2023-10-06T03:26:27.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe520066f30 0x7fe5200693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe51c003fe0 0x7fe534149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5340c66e0 0x7fe5340c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 --2- 172.21.15.84:0/785580602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5340c5270 0x7fe5340c56e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 -- 172.21.15.84:0/785580602 >> 172.21.15.84:0/785580602 conn(0x7fe534099830 msgr2=0x7fe534157460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:27.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 -- 172.21.15.84:0/785580602 shutdown_connections 2023-10-06T03:26:27.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.730+0000 7fe539fe2700 1 -- 172.21.15.84:0/785580602 wait complete. 2023-10-06T03:26:27.743 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:26:27.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.857+0000 7fb0a07a2700 1 Processor -- start 2023-10-06T03:26:27.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.857+0000 7fb0a07a2700 1 -- start start 2023-10-06T03:26:27.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.858+0000 7fb0a07a2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb0980ad250 0x7fb0980cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.858+0000 7fb0a07a2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0980ad620 0x7fb09815d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.858+0000 7fb0a07a2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0980ced30 con 0x7fb09815d980 2023-10-06T03:26:27.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.858+0000 7fb0a07a2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09815de20 con 0x7fb0980ad250 2023-10-06T03:26:27.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.858+0000 7fb0a07a2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980cf010 con 0x7fb0980ad620 2023-10-06T03:26:27.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.858+0000 7fb09e53e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb0980ad250 0x7fb0980cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.858+0000 7fb09e53e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb0980ad250 0x7fb0980cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33754/0 (socket says 172.21.15.84:33754) 2023-10-06T03:26:27.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.858+0000 7fb09e53e700 1 -- 172.21.15.84:0/1104632085 learned_addr learned my addr 172.21.15.84:0/1104632085 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:27.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.859+0000 7fb09dd3d700 1 --2- 172.21.15.84:0/1104632085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0980ad620 0x7fb09815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.859+0000 7fb09e53e700 1 -- 172.21.15.84:0/1104632085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0980ad620 msgr2=0x7fb09815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:27.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.859+0000 7fb09e53e700 1 --2- 172.21.15.84:0/1104632085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0980ad620 0x7fb09815d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.859+0000 7fb09e53e700 1 -- 172.21.15.84:0/1104632085 >> v1:172.21.15.131:6789/0 conn(0x7fb09815d980 legacy=0x7fb098068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.859+0000 7fb09e53e700 1 -- 172.21.15.84:0/1104632085 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0980ccad0 con 0x7fb0980ad250 2023-10-06T03:26:27.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.859+0000 7fb09e53e700 1 --2- 172.21.15.84:0/1104632085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0980ad250 0x7fb0980cd2d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb094009990 tx=0x7fb094009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59093cf976e2fd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:27.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.859+0000 7fb09d53c700 1 -- 172.21.15.84:0/1104632085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094009e80 con 0x7fb0980ad250 2023-10-06T03:26:27.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.859+0000 7fb09d53c700 1 -- 172.21.15.84:0/1104632085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb094005c10 con 0x7fb0980ad250 2023-10-06T03:26:27.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.859+0000 7fb09d53c700 1 -- 172.21.15.84:0/1104632085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09400b650 con 0x7fb0980ad250 2023-10-06T03:26:27.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.860+0000 7fb0a07a2700 1 -- 172.21.15.84:0/1104632085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0980ad250 msgr2=0x7fb0980cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.860+0000 7fb0a07a2700 1 --2- 172.21.15.84:0/1104632085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0980ad250 0x7fb0980cd2d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb094009990 tx=0x7fb094009220 comp rx=0 tx=0).stop 2023-10-06T03:26:27.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.860+0000 7fb0a07a2700 1 -- 172.21.15.84:0/1104632085 shutdown_connections 2023-10-06T03:26:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.860+0000 7fb0a07a2700 1 --2- 172.21.15.84:0/1104632085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0980ad250 0x7fb0980cd2d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.860+0000 7fb0a07a2700 1 --2- 172.21.15.84:0/1104632085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0980ad620 0x7fb09815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.860+0000 7fb0a07a2700 1 -- 172.21.15.84:0/1104632085 >> 172.21.15.84:0/1104632085 conn(0x7fb098067dd0 msgr2=0x7fb0980ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.860+0000 7fb0a07a2700 1 -- 172.21.15.84:0/1104632085 shutdown_connections 2023-10-06T03:26:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.860+0000 7fb0a07a2700 1 -- 172.21.15.84:0/1104632085 wait complete. 2023-10-06T03:26:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.861+0000 7fb0a07a2700 1 Processor -- start 2023-10-06T03:26:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.861+0000 7fb0a07a2700 1 -- start start 2023-10-06T03:26:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.861+0000 7fb0a07a2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0980ad250 0x7fb0980b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.861+0000 7fb0a07a2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0980ad620 0x7fb09816a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.861+0000 7fb0a07a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09815d980 0x7fb0980af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.861+0000 7fb0a07a2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09816a8d0 con 0x7fb09815d980 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.861+0000 7fb0a07a2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09816abb0 con 0x7fb0980ad620 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.861+0000 7fb0a07a2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09816ae90 con 0x7fb0980ad250 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09ed3f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09815d980 0x7fb0980af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09ed3f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09815d980 0x7fb0980af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33760/0 (socket says 172.21.15.84:33760) 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09ed3f700 1 -- 172.21.15.84:0/2061078355 learned_addr learned my addr 172.21.15.84:0/2061078355 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09dd3d700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0980ad620 0x7fb09816a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09e53e700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0980ad250 0x7fb0980b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09ed3f700 1 -- 172.21.15.84:0/2061078355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0980ad250 msgr2=0x7fb0980b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09ed3f700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0980ad250 0x7fb0980b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09ed3f700 1 -- 172.21.15.84:0/2061078355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0980ad620 msgr2=0x7fb09816a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09ed3f700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0980ad620 0x7fb09816a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09ed3f700 1 -- 172.21.15.84:0/2061078355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb094009480 con 0x7fb09815d980 2023-10-06T03:26:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb09ed3f700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09815d980 0x7fb0980af290 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb09000c840 tx=0x7fb090001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb08e7fc700 1 -- 172.21.15.84:0/2061078355 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090012630 con 0x7fb09815d980 2023-10-06T03:26:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb08e7fc700 1 -- 172.21.15.84:0/2061078355 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0900127b0 con 0x7fb09815d980 2023-10-06T03:26:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb0a07a2700 1 -- 172.21.15.84:0/2061078355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0980aea90 con 0x7fb09815d980 2023-10-06T03:26:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb08e7fc700 1 -- 172.21.15.84:0/2061078355 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090012b70 con 0x7fb09815d980 2023-10-06T03:26:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.862+0000 7fb0a07a2700 1 -- 172.21.15.84:0/2061078355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0980b3eb0 con 0x7fb09815d980 2023-10-06T03:26:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.863+0000 7fb0a07a2700 1 -- 172.21.15.84:0/2061078355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb098064ad0 con 0x7fb09815d980 2023-10-06T03:26:27.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.864+0000 7fb08e7fc700 1 -- 172.21.15.84:0/2061078355 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb09001a3a0 con 0x7fb09815d980 2023-10-06T03:26:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.864+0000 7fb08e7fc700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb07c066f30 0x7fb07c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.864+0000 7fb09e53e700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb07c066f30 0x7fb07c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.864+0000 7fb08e7fc700 1 -- 172.21.15.84:0/2061078355 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb090084900 con 0x7fb09815d980 2023-10-06T03:26:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.865+0000 7fb09e53e700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb07c066f30 0x7fb07c0693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb09806c150 tx=0x7fb094016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:27.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:27.868+0000 7fb08e7fc700 1 -- 172.21.15.84:0/2061078355 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0900518d0 con 0x7fb09815d980 2023-10-06T03:26:28.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.098+0000 7fb0a07a2700 1 -- 172.21.15.84:0/2061078355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb0980ccdb0 con 0x7fb09815d980 2023-10-06T03:26:28.099 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:26:28.098+0000 7f573ff98700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:26:28.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.103+0000 7fb08e7fc700 1 -- 172.21.15.84:0/2061078355 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb090054ef0 con 0x7fb09815d980 2023-10-06T03:26:28.103 INFO:tasks.ceph.mds.a.smithi084.stderr: -727> 2023-10-06T03:26:14.565+0000 7f74e7fac700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:26:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.105+0000 7fb0a07a2700 1 -- 172.21.15.84:0/2061078355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb07c066f30 msgr2=0x7fb07c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.105+0000 7fb0a07a2700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb07c066f30 0x7fb07c0693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb09806c150 tx=0x7fb094016000 comp rx=0 tx=0).stop 2023-10-06T03:26:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.105+0000 7fb0a07a2700 1 -- 172.21.15.84:0/2061078355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09815d980 msgr2=0x7fb0980af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.105+0000 7fb0a07a2700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09815d980 0x7fb0980af290 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb09000c840 tx=0x7fb090001670 comp rx=0 tx=0).stop 2023-10-06T03:26:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.106+0000 7fb0a07a2700 1 -- 172.21.15.84:0/2061078355 shutdown_connections 2023-10-06T03:26:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.106+0000 7fb0a07a2700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb07c066f30 0x7fb07c0693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.106+0000 7fb0a07a2700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09815d980 0x7fb0980af290 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.106+0000 7fb0a07a2700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0980ad250 0x7fb0980b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.106+0000 7fb0a07a2700 1 --2- 172.21.15.84:0/2061078355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0980ad620 0x7fb09816a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.106+0000 7fb0a07a2700 1 -- 172.21.15.84:0/2061078355 >> 172.21.15.84:0/2061078355 conn(0x7fb098067dd0 msgr2=0x7fb09806c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.106+0000 7fb0a07a2700 1 -- 172.21.15.84:0/2061078355 shutdown_connections 2023-10-06T03:26:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.106+0000 7fb0a07a2700 1 -- 172.21.15.84:0/2061078355 wait complete. 2023-10-06T03:26:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:26:28.119 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:26:28.125 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:26:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.235+0000 7ff954974700 1 Processor -- start 2023-10-06T03:26:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.235+0000 7ff954974700 1 -- start start 2023-10-06T03:26:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff954974700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff9500afc60 0x7ff9500b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff954974700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9500cd300 con 0x7ff950156e50 2023-10-06T03:26:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff954974700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9500cc6f0 con 0x7ff9500ce000 2023-10-06T03:26:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff954974700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9500cc9d0 con 0x7ff9500afc60 2023-10-06T03:26:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff94f59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff950156e50 0x7ff9501572b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34692/0 (socket says 172.21.15.84:34692) 2023-10-06T03:26:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff94f59e700 1 -- 172.21.15.84:0/3442125166 learned_addr learned my addr 172.21.15.84:0/3442125166 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff94ed9d700 1 --2- 172.21.15.84:0/3442125166 >> v2:172.21.15.131:3300/0 conn(0x7ff9500afc60 0x7ff9500b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff94e59c700 1 -- 172.21.15.84:0/3442125166 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310714685 0 0) 0x7ff9500cd300 con 0x7ff950156e50 2023-10-06T03:26:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff94e59c700 1 -- 172.21.15.84:0/3442125166 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff93c003570 con 0x7ff950156e50 2023-10-06T03:26:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff94ed9d700 1 -- 172.21.15.84:0/3442125166 >> v1:172.21.15.131:6789/0 conn(0x7ff9500ce000 legacy=0x7ff9500cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:28.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff94ed9d700 1 -- 172.21.15.84:0/3442125166 >> v1:172.21.15.84:6789/0 conn(0x7ff950156e50 legacy=0x7ff9501572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:28.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.236+0000 7ff94ed9d700 1 -- 172.21.15.84:0/3442125166 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500cccb0 con 0x7ff9500afc60 2023-10-06T03:26:28.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff94ed9d700 1 --2- 172.21.15.84:0/3442125166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500afc60 0x7ff9500b0030 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff9400098e0 tx=0x7ff9400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c63ffe86117cff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:28.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff94e59c700 1 -- 172.21.15.84:0/3442125166 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000b640 con 0x7ff9500afc60 2023-10-06T03:26:28.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff94e59c700 1 -- 172.21.15.84:0/3442125166 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000b7a0 con 0x7ff9500afc60 2023-10-06T03:26:28.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff94e59c700 1 -- 172.21.15.84:0/3442125166 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000bb40 con 0x7ff9500afc60 2023-10-06T03:26:28.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff954974700 1 -- 172.21.15.84:0/3442125166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500afc60 msgr2=0x7ff9500b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:28.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff954974700 1 --2- 172.21.15.84:0/3442125166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500afc60 0x7ff9500b0030 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff9400098e0 tx=0x7ff9400091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:28.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff954974700 1 -- 172.21.15.84:0/3442125166 shutdown_connections 2023-10-06T03:26:28.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff954974700 1 --2- 172.21.15.84:0/3442125166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500afc60 0x7ff9500b0030 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:28.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff954974700 1 -- 172.21.15.84:0/3442125166 >> 172.21.15.84:0/3442125166 conn(0x7ff9500675f0 msgr2=0x7ff9500679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:28.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff954974700 1 -- 172.21.15.84:0/3442125166 shutdown_connections 2023-10-06T03:26:28.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.237+0000 7ff954974700 1 -- 172.21.15.84:0/3442125166 wait complete. 2023-10-06T03:26:28.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.239+0000 7ff954974700 1 Processor -- start 2023-10-06T03:26:28.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.239+0000 7ff954974700 1 -- start start 2023-10-06T03:26:28.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.239+0000 7ff954974700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500afc60 0x7ff9500a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:28.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.239+0000 7ff954974700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9500ce000 0x7ff950148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:28.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.239+0000 7ff954974700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff950156e50 0x7ff9500ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:28.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.239+0000 7ff954974700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500c87a0 con 0x7ff9500ce000 2023-10-06T03:26:28.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.239+0000 7ff954974700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff950069110 con 0x7ff9500afc60 2023-10-06T03:26:28.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.239+0000 7ff954974700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500ca600 con 0x7ff950156e50 2023-10-06T03:26:28.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9500ce000 0x7ff950148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:28.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9500ce000 0x7ff950148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33794/0 (socket says 172.21.15.84:33794) 2023-10-06T03:26:28.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94659c700 1 -- 172.21.15.84:0/1690829258 learned_addr learned my addr 172.21.15.84:0/1690829258 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:28.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94ed9d700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500afc60 0x7ff9500a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:28.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94f59e700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff950156e50 0x7ff9500ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:28.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94659c700 1 -- 172.21.15.84:0/1690829258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff950156e50 msgr2=0x7ff9500ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:28.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94659c700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff950156e50 0x7ff9500ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:28.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94659c700 1 -- 172.21.15.84:0/1690829258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500afc60 msgr2=0x7ff9500a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:28.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94659c700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500afc60 0x7ff9500a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:28.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94659c700 1 -- 172.21.15.84:0/1690829258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940009420 con 0x7ff9500ce000 2023-10-06T03:26:28.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94f59e700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff950156e50 0x7ff9500ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:28.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94ed9d700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500afc60 0x7ff9500a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:28.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff94659c700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9500ce000 0x7ff950148c80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff93800c590 tx=0x7ff93800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:28.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff9477fe700 1 -- 172.21.15.84:0/1690829258 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938011590 con 0x7ff9500ce000 2023-10-06T03:26:28.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff9477fe700 1 -- 172.21.15.84:0/1690829258 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9380116f0 con 0x7ff9500ce000 2023-10-06T03:26:28.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff954974700 1 -- 172.21.15.84:0/1690829258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95006a5f0 con 0x7ff9500ce000 2023-10-06T03:26:28.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff9477fe700 1 -- 172.21.15.84:0/1690829258 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938011ab0 con 0x7ff9500ce000 2023-10-06T03:26:28.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.240+0000 7ff954974700 1 -- 172.21.15.84:0/1690829258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9500a5a10 con 0x7ff9500ce000 2023-10-06T03:26:28.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.241+0000 7ff954974700 1 -- 172.21.15.84:0/1690829258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9500646e0 con 0x7ff9500ce000 2023-10-06T03:26:28.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.242+0000 7ff9477fe700 1 -- 172.21.15.84:0/1690829258 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff93801b3b0 con 0x7ff9500ce000 2023-10-06T03:26:28.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.242+0000 7ff9477fe700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff930066f30 0x7ff9300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:28.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.242+0000 7ff9477fe700 1 -- 172.21.15.84:0/1690829258 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff938083da0 con 0x7ff9500ce000 2023-10-06T03:26:28.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.242+0000 7ff94ed9d700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff930066f30 0x7ff9300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:28.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.242+0000 7ff94ed9d700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff930066f30 0x7ff9300693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff9400093f0 tx=0x7ff940017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:28.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.246+0000 7ff9477fe700 1 -- 172.21.15.84:0/1690829258 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff938050d20 con 0x7ff9500ce000 2023-10-06T03:26:28.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:28.470+0000 7ff954974700 1 -- 172.21.15.84:0/1690829258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff95005f270 con 0x7ff9500ce000 2023-10-06T03:26:29.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.103+0000 7ff9477fe700 1 -- 172.21.15.84:0/1690829258 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff938017020 con 0x7ff9500ce000 2023-10-06T03:26:29.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 -- 172.21.15.84:0/1690829258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff930066f30 msgr2=0x7ff9300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff930066f30 0x7ff9300693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff9400093f0 tx=0x7ff940017000 comp rx=0 tx=0).stop 2023-10-06T03:26:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 -- 172.21.15.84:0/1690829258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9500ce000 msgr2=0x7ff950148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9500ce000 0x7ff950148c80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff93800c590 tx=0x7ff93800c950 comp rx=0 tx=0).stop 2023-10-06T03:26:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 -- 172.21.15.84:0/1690829258 shutdown_connections 2023-10-06T03:26:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff930066f30 0x7ff9300693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500afc60 0x7ff9500a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff950156e50 0x7ff9500ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 --2- 172.21.15.84:0/1690829258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9500ce000 0x7ff950148c80 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 -- 172.21.15.84:0/1690829258 >> 172.21.15.84:0/1690829258 conn(0x7ff9500675f0 msgr2=0x7ff9501597c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 -- 172.21.15.84:0/1690829258 shutdown_connections 2023-10-06T03:26:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.105+0000 7ff954974700 1 -- 172.21.15.84:0/1690829258 wait complete. 2023-10-06T03:26:29.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.280+0000 7fa7bf937700 1 Processor -- start 2023-10-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.280+0000 7fa7bf937700 1 -- start start 2023-10-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.281+0000 7fa7bf937700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7b80c30d0 0x7fa7b80c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.281+0000 7fa7bf937700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b80c4170 con 0x7fa7b80b0760 2023-10-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.281+0000 7fa7bf937700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b80b1800 con 0x7fa7b80c4b40 2023-10-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.281+0000 7fa7bf937700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80c3560 con 0x7fa7b80c30d0 2023-10-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.281+0000 7fa7bd6d3700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa7b80b0760 0x7fa7b80b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34700/0 (socket says 172.21.15.84:34700) 2023-10-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.281+0000 7fa7bd6d3700 1 -- 172.21.15.84:0/255782778 learned_addr learned my addr 172.21.15.84:0/255782778 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7bced2700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7b80c30d0 0x7fa7b80c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677674146 0 0) 0x7fa7b80c4170 con 0x7fa7b80b0760 2023-10-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a4003570 con 0x7fa7b80b0760 2023-10-06T03:26:29.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117473006 0 0) 0x7fa7b80b1800 con 0x7fa7b80c4b40 2023-10-06T03:26:29.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7b80c4170 con 0x7fa7b80c4b40 2023-10-06T03:26:29.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4038427334 0 0) 0x7fa7a4003570 con 0x7fa7b80b0760 2023-10-06T03:26:29.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7b80c30d0 msgr2=0x7fa7b80c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7b80c30d0 0x7fa7b80c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 >> v1:172.21.15.131:6789/0 conn(0x7fa7b80c4b40 legacy=0x7fa7b80cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80c3840 con 0x7fa7b80b0760 2023-10-06T03:26:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fa7b4001970 con 0x7fa7b80b0760 2023-10-06T03:26:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 >> v1:172.21.15.84:6789/0 conn(0x7fa7b80b0760 legacy=0x7fa7b80b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a4003c20 0x7fa7a4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7a4004810 0x7fa7a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7b80c30d0 0x7fa7a4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80c3560 con 0x7fa7a4003c20 2023-10-06T03:26:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a400bbf0 con 0x7fa7a4004810 2023-10-06T03:26:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a400bdb0 con 0x7fa7b80c30d0 2023-10-06T03:26:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7bd6d3700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a4003c20 0x7fa7a4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7bced2700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7a4004810 0x7fa7a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7bded4700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7b80c30d0 0x7fa7a4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7bd6d3700 1 -- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7b80c30d0 msgr2=0x7fa7a4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:29.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7bd6d3700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7b80c30d0 0x7fa7a4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:29.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7bd6d3700 1 -- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7a4004810 msgr2=0x7fa7a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:29.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7bd6d3700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7a4004810 0x7fa7a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:29.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7bd6d3700 1 -- 172.21.15.84:0/255782778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a4003570 con 0x7fa7a4003c20 2023-10-06T03:26:29.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.282+0000 7fa7bced2700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7a4004810 0x7fa7a4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:29.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7bd6d3700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a4003c20 0x7fa7a4004010 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400c5f0 tx=0x7fa7b4007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfcfc2e502cd3ce8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:29.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4007dc0 con 0x7fa7a4003c20 2023-10-06T03:26:29.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4005b70 con 0x7fa7a4003c20 2023-10-06T03:26:29.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7affff700 1 -- 172.21.15.84:0/255782778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40070d0 con 0x7fa7a4003c20 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7bf937700 1 -- 172.21.15.84:0/255782778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a4003c20 msgr2=0x7fa7a4004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7bf937700 1 --2- 172.21.15.84:0/255782778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a4003c20 0x7fa7a4004010 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400c5f0 tx=0x7fa7b4007b90 comp rx=0 tx=0).stop 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7bded4700 1 -- 172.21.15.84:0/255782778 reap_dead start 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7bf937700 1 -- 172.21.15.84:0/255782778 shutdown_connections 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7bf937700 1 -- 172.21.15.84:0/255782778 >> 172.21.15.84:0/255782778 conn(0x7fa7b8088000 msgr2=0x7fa7b80ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7bf937700 1 -- 172.21.15.84:0/255782778 shutdown_connections 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.283+0000 7fa7bf937700 1 -- 172.21.15.84:0/255782778 wait complete. 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.284+0000 7fa7bf937700 1 Processor -- start 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.284+0000 7fa7bf937700 1 -- start start 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bf937700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7a4003c20 0x7fa7b816adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:29.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bf937700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b8167e60 0x7fa7b80c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bf937700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7b80c6350 0x7fa7b80b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bf937700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b81580a0 con 0x7fa7b8167e60 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bf937700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8158380 con 0x7fa7b80c6350 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bf937700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8158660 con 0x7fa7a4003c20 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bced2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b8167e60 0x7fa7b80c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bced2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b8167e60 0x7fa7b80c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33808/0 (socket says 172.21.15.84:33808) 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bced2700 1 -- 172.21.15.84:0/3494010314 learned_addr learned my addr 172.21.15.84:0/3494010314 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bd6d3700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7a4003c20 0x7fa7b816adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.285+0000 7fa7bded4700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7b80c6350 0x7fa7b80b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7bced2700 1 -- 172.21.15.84:0/3494010314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7a4003c20 msgr2=0x7fa7b816adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7bced2700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7a4003c20 0x7fa7b816adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:29.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7bced2700 1 -- 172.21.15.84:0/3494010314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7b80c6350 msgr2=0x7fa7b80b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:29.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7bced2700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7b80c6350 0x7fa7b80b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:29.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7bced2700 1 -- 172.21.15.84:0/3494010314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8158940 con 0x7fa7b8167e60 2023-10-06T03:26:29.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7bced2700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b8167e60 0x7fa7b80c5e10 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80118e0 tx=0x7fa7a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:29.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7ad7fa700 1 -- 172.21.15.84:0/3494010314 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8011e80 con 0x7fa7b8167e60 2023-10-06T03:26:29.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7ad7fa700 1 -- 172.21.15.84:0/3494010314 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a800f8e0 con 0x7fa7b8167e60 2023-10-06T03:26:29.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7bf937700 1 -- 172.21.15.84:0/3494010314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b8158c20 con 0x7fa7b8167e60 2023-10-06T03:26:29.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7ad7fa700 1 -- 172.21.15.84:0/3494010314 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a800fc80 con 0x7fa7b8167e60 2023-10-06T03:26:29.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.286+0000 7fa7bf937700 1 -- 172.21.15.84:0/3494010314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b8157cc0 con 0x7fa7b8167e60 2023-10-06T03:26:29.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.287+0000 7fa7bf937700 1 -- 172.21.15.84:0/3494010314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b80ca1e0 con 0x7fa7b8167e60 2023-10-06T03:26:29.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.287+0000 7fa7ad7fa700 1 -- 172.21.15.84:0/3494010314 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7a8015460 con 0x7fa7b8167e60 2023-10-06T03:26:29.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.288+0000 7fa7ad7fa700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa79c066f30 0x7fa79c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:29.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.288+0000 7fa7bd6d3700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa79c066f30 0x7fa79c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:29.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.288+0000 7fa7ad7fa700 1 -- 172.21.15.84:0/3494010314 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa7a8085100 con 0x7fa7b8167e60 2023-10-06T03:26:29.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.288+0000 7fa7bd6d3700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa79c066f30 0x7fa79c0693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4001270 tx=0x7fa7b4015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:29.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.292+0000 7fa7ad7fa700 1 -- 172.21.15.84:0/3494010314 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7a8055b10 con 0x7fa7b8167e60 2023-10-06T03:26:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:29.474+0000 7fa7bf937700 1 -- 172.21.15.84:0/3494010314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa7b8064ad0 con 0x7fa7b8167e60 2023-10-06T03:26:30.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.107+0000 7fa7ad7fa700 1 -- 172.21.15.84:0/3494010314 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa7a8055700 con 0x7fa7b8167e60 2023-10-06T03:26:30.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.109+0000 7fa7bf937700 1 -- 172.21.15.84:0/3494010314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa79c066f30 msgr2=0x7fa79c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.109+0000 7fa7bf937700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa79c066f30 0x7fa79c0693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4001270 tx=0x7fa7b4015000 comp rx=0 tx=0).stop 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.109+0000 7fa7bf937700 1 -- 172.21.15.84:0/3494010314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b8167e60 msgr2=0x7fa7b80c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.109+0000 7fa7bf937700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b8167e60 0x7fa7b80c5e10 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80118e0 tx=0x7fa7a8008040 comp rx=0 tx=0).stop 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.110+0000 7fa7bf937700 1 -- 172.21.15.84:0/3494010314 shutdown_connections 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.110+0000 7fa7bf937700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa79c066f30 0x7fa79c0693e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.110+0000 7fa7bf937700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7b80c6350 0x7fa7b80b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.110+0000 7fa7bf937700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7a4003c20 0x7fa7b816adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.110+0000 7fa7bf937700 1 --2- 172.21.15.84:0/3494010314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b8167e60 0x7fa7b80c5e10 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.110+0000 7fa7bf937700 1 -- 172.21.15.84:0/3494010314 >> 172.21.15.84:0/3494010314 conn(0x7fa7b8088000 msgr2=0x7fa7b81559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.110+0000 7fa7bf937700 1 -- 172.21.15.84:0/3494010314 shutdown_connections 2023-10-06T03:26:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.110+0000 7fa7bf937700 1 -- 172.21.15.84:0/3494010314 wait complete. 2023-10-06T03:26:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:26:30.123 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:26:30.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.240+0000 7fabb8fab700 1 Processor -- start 2023-10-06T03:26:30.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.240+0000 7fabb8fab700 1 -- start start 2023-10-06T03:26:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb8fab700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabb40b0760 0x7fabb40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb8fab700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40c4d10 0x7fabb40cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb8fab700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb40c4170 con 0x7fabb40c30d0 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb8fab700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb40c3560 con 0x7fabb40b0760 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb8fab700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb40c3840 con 0x7fabb40c4d10 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabb40b0760 0x7fabb40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabb40b0760 0x7fabb40b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33810/0 (socket says 172.21.15.84:33810) 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb259c700 1 -- 172.21.15.84:0/208956407 learned_addr learned my addr 172.21.15.84:0/208956407 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb2d9d700 1 --2- 172.21.15.84:0/208956407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40c4d10 0x7fabb40cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb259c700 1 -- 172.21.15.84:0/208956407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40c4d10 msgr2=0x7fabb40cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb259c700 1 --2- 172.21.15.84:0/208956407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40c4d10 0x7fabb40cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb259c700 1 -- 172.21.15.84:0/208956407 >> v1:172.21.15.131:6789/0 conn(0x7fabb40c30d0 legacy=0x7fabb40c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb259c700 1 -- 172.21.15.84:0/208956407 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb40c3b20 con 0x7fabb40b0760 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.241+0000 7fabb2d9d700 1 --2- 172.21.15.84:0/208956407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40c4d10 0x7fabb40cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb259c700 1 --2- 172.21.15.84:0/208956407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40b0760 0x7fabb40b10f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7faba4009990 tx=0x7faba4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc04f57de3124511 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb1d9b700 1 -- 172.21.15.84:0/208956407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4005c10 con 0x7fabb40b0760 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb1d9b700 1 -- 172.21.15.84:0/208956407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba4005d70 con 0x7fabb40b0760 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb1d9b700 1 -- 172.21.15.84:0/208956407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400b8d0 con 0x7fabb40b0760 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb8fab700 1 -- 172.21.15.84:0/208956407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40b0760 msgr2=0x7fabb40b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb8fab700 1 --2- 172.21.15.84:0/208956407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40b0760 0x7fabb40b10f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7faba4009990 tx=0x7faba4009220 comp rx=0 tx=0).stop 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb8fab700 1 -- 172.21.15.84:0/208956407 shutdown_connections 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb8fab700 1 --2- 172.21.15.84:0/208956407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40c4d10 0x7fabb40cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb8fab700 1 --2- 172.21.15.84:0/208956407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40b0760 0x7fabb40b10f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:30.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb8fab700 1 -- 172.21.15.84:0/208956407 >> 172.21.15.84:0/208956407 conn(0x7fabb4088000 msgr2=0x7fabb40ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:30.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb8fab700 1 -- 172.21.15.84:0/208956407 shutdown_connections 2023-10-06T03:26:30.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.242+0000 7fabb8fab700 1 -- 172.21.15.84:0/208956407 wait complete. 2023-10-06T03:26:30.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb8fab700 1 Processor -- start 2023-10-06T03:26:30.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb8fab700 1 -- start start 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb8fab700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40b0760 0x7fabb40c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb8fab700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40c30d0 0x7fabb40c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb8fab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40c4d10 0x7fabb4168520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb8fab700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb40c7b10 con 0x7fabb40c4d10 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb8fab700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb40c5990 con 0x7fabb40c30d0 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb8fab700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb4168a60 con 0x7fabb40b0760 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40c4d10 0x7fabb4168520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40c4d10 0x7fabb4168520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33822/0 (socket says 172.21.15.84:33822) 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.244+0000 7fabb2d9d700 1 -- 172.21.15.84:0/1556369143 learned_addr learned my addr 172.21.15.84:0/1556369143 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabb259c700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40b0760 0x7fabb40c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7faba9d9b700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40c30d0 0x7fabb40c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabb2d9d700 1 -- 172.21.15.84:0/1556369143 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40b0760 msgr2=0x7fabb40c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabb2d9d700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40b0760 0x7fabb40c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabb2d9d700 1 -- 172.21.15.84:0/1556369143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40c30d0 msgr2=0x7fabb40c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabb2d9d700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40c30d0 0x7fabb40c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabb2d9d700 1 -- 172.21.15.84:0/1556369143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4009480 con 0x7fabb40c4d10 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabb259c700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40b0760 0x7fabb40c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabb2d9d700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40c4d10 0x7fabb4168520 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fabac00a380 tx=0x7fabac007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabaaffd700 1 -- 172.21.15.84:0/1556369143 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac00ae10 con 0x7fabb40c4d10 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabaaffd700 1 -- 172.21.15.84:0/1556369143 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac00d650 con 0x7fabb40c4d10 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabb8fab700 1 -- 172.21.15.84:0/1556369143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb40c7170 con 0x7fabb40c4d10 2023-10-06T03:26:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabaaffd700 1 -- 172.21.15.84:0/1556369143 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac00da10 con 0x7fabb40c4d10 2023-10-06T03:26:30.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.245+0000 7fabb8fab700 1 -- 172.21.15.84:0/1556369143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb40c7730 con 0x7fabb40c4d10 2023-10-06T03:26:30.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.246+0000 7fabb8fab700 1 -- 172.21.15.84:0/1556369143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb40c7c50 con 0x7fabb40c4d10 2023-10-06T03:26:30.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.246+0000 7fabaaffd700 1 -- 172.21.15.84:0/1556369143 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabac01e3b0 con 0x7fabb40c4d10 2023-10-06T03:26:30.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.247+0000 7fabaaffd700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab94066f30 0x7fab940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:30.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.247+0000 7fabaaffd700 1 -- 172.21.15.84:0/1556369143 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6026+0+0 (secure 0 0 0) 0x7fabac0850c0 con 0x7fabb40c4d10 2023-10-06T03:26:30.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.247+0000 7fabb259c700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab94066f30 0x7fab940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:30.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.247+0000 7fabb259c700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab94066f30 0x7fab940693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faba40030c0 tx=0x7faba4015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:30.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.251+0000 7fabaaffd700 1 -- 172.21.15.84:0/1556369143 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabb40c7c50 con 0x7fabb40c4d10 2023-10-06T03:26:30.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:30.432+0000 7fabb8fab700 1 -- 172.21.15.84:0/1556369143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fabb40c7c50 con 0x7fabb40c4d10 2023-10-06T03:26:31.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.118+0000 7fabaaffd700 1 -- 172.21.15.84:0/1556369143 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) v1 ==== 169+0+0 (secure 0 0 0) 0x7fabb40c7c50 con 0x7fabb40c4d10 2023-10-06T03:26:31.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.121+0000 7fabb8fab700 1 -- 172.21.15.84:0/1556369143 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab94066f30 msgr2=0x7fab940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.121+0000 7fabb8fab700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab94066f30 0x7fab940693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faba40030c0 tx=0x7faba4015000 comp rx=0 tx=0).stop 2023-10-06T03:26:31.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.121+0000 7fabb8fab700 1 -- 172.21.15.84:0/1556369143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40c4d10 msgr2=0x7fabb4168520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.121+0000 7fabb8fab700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40c4d10 0x7fabb4168520 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fabac00a380 tx=0x7fabac007900 comp rx=0 tx=0).stop 2023-10-06T03:26:31.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.122+0000 7fabb8fab700 1 -- 172.21.15.84:0/1556369143 shutdown_connections 2023-10-06T03:26:31.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.122+0000 7fabb8fab700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab94066f30 0x7fab940693e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.122+0000 7fabb8fab700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb40c4d10 0x7fabb4168520 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.122+0000 7fabb8fab700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabb40b0760 0x7fabb40c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.122+0000 7fabb8fab700 1 --2- 172.21.15.84:0/1556369143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40c30d0 0x7fabb40c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.122+0000 7fabb8fab700 1 -- 172.21.15.84:0/1556369143 >> 172.21.15.84:0/1556369143 conn(0x7fabb4088000 msgr2=0x7fabb40b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:31.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.122+0000 7fabb8fab700 1 -- 172.21.15.84:0/1556369143 shutdown_connections 2023-10-06T03:26:31.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.122+0000 7fabb8fab700 1 -- 172.21.15.84:0/1556369143 wait complete. 2023-10-06T03:26:31.123 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T03:26:31.137 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2023-10-06T03:26:31.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.251+0000 7f0643578700 1 Processor -- start 2023-10-06T03:26:31.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.251+0000 7f0643578700 1 -- start start 2023-10-06T03:26:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.252+0000 7f0643578700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f063c0b2a90 0x7f063c0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.252+0000 7f0643578700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f063c0cb980 0x7f063c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.252+0000 7f0643578700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0cbdf0 con 0x7f063c0ced90 2023-10-06T03:26:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.252+0000 7f0643578700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0b2e60 con 0x7f063c0cb980 2023-10-06T03:26:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.252+0000 7f0643578700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0cf5d0 con 0x7f063c0b2a90 2023-10-06T03:26:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.252+0000 7f0640b13700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f063c0cb980 0x7f063c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.252+0000 7f0640b13700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f063c0cb980 0x7f063c0ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39576/0 (socket says 172.21.15.84:39576) 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.252+0000 7f0640b13700 1 -- 172.21.15.84:0/125232843 learned_addr learned my addr 172.21.15.84:0/125232843 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0641314700 1 --2- 172.21.15.84:0/125232843 >> v2:172.21.15.131:3300/0 conn(0x7f063c0b2a90 0x7f063c0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0640b13700 1 -- 172.21.15.84:0/125232843 >> v2:172.21.15.131:3300/0 conn(0x7f063c0b2a90 msgr2=0x7f063c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0640b13700 1 --2- 172.21.15.84:0/125232843 >> v2:172.21.15.131:3300/0 conn(0x7f063c0b2a90 0x7f063c0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0640b13700 1 -- 172.21.15.84:0/125232843 >> v1:172.21.15.131:6789/0 conn(0x7f063c0ced90 legacy=0x7f063c0c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0640b13700 1 -- 172.21.15.84:0/125232843 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0cf8b0 con 0x7f063c0cb980 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0640b13700 1 --2- 172.21.15.84:0/125232843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0cb980 0x7f063c0ce850 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f063c0888a0 tx=0x7f062c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428605d24fb96f89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0633fff700 1 -- 172.21.15.84:0/125232843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00b820 con 0x7f063c0cb980 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0633fff700 1 -- 172.21.15.84:0/125232843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c00b980 con 0x7f063c0cb980 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0633fff700 1 -- 172.21.15.84:0/125232843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00bd20 con 0x7f063c0cb980 2023-10-06T03:26:31.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0643578700 1 -- 172.21.15.84:0/125232843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0cb980 msgr2=0x7f063c0ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.253+0000 7f0643578700 1 --2- 172.21.15.84:0/125232843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0cb980 0x7f063c0ce850 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f063c0888a0 tx=0x7f062c009250 comp rx=0 tx=0).stop 2023-10-06T03:26:31.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.254+0000 7f0643578700 1 -- 172.21.15.84:0/125232843 shutdown_connections 2023-10-06T03:26:31.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.254+0000 7f0643578700 1 --2- 172.21.15.84:0/125232843 >> v2:172.21.15.131:3300/0 conn(0x7f063c0b2a90 0x7f063c0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.254+0000 7f0643578700 1 --2- 172.21.15.84:0/125232843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0cb980 0x7f063c0ce850 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.254+0000 7f0643578700 1 -- 172.21.15.84:0/125232843 >> 172.21.15.84:0/125232843 conn(0x7f063c099740 msgr2=0x7f063c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:31.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.254+0000 7f0643578700 1 -- 172.21.15.84:0/125232843 shutdown_connections 2023-10-06T03:26:31.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.254+0000 7f0643578700 1 -- 172.21.15.84:0/125232843 wait complete. 2023-10-06T03:26:31.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.255+0000 7f0643578700 1 Processor -- start 2023-10-06T03:26:31.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.255+0000 7f0643578700 1 -- start start 2023-10-06T03:26:31.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0643578700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c0b2a90 0x7f063c068510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0643578700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0cb980 0x7f063c156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0643578700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0ced90 0x7f063c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0643578700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c16cdd0 con 0x7f063c0ced90 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0643578700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c16d950 con 0x7f063c0cb980 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0643578700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c16d020 con 0x7f063c0b2a90 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0641b15700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0ced90 0x7f063c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0641b15700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0ced90 0x7f063c1571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39588/0 (socket says 172.21.15.84:39588) 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0641b15700 1 -- 172.21.15.84:0/227505498 learned_addr learned my addr 172.21.15.84:0/227505498 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0640b13700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0cb980 0x7f063c156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0641314700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c0b2a90 0x7f063c068510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0641b15700 1 -- 172.21.15.84:0/227505498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c0b2a90 msgr2=0x7f063c068510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0641b15700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c0b2a90 0x7f063c068510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0641b15700 1 -- 172.21.15.84:0/227505498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0cb980 msgr2=0x7f063c156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0641b15700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0cb980 0x7f063c156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0641b15700 1 -- 172.21.15.84:0/227505498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0094f0 con 0x7f063c0ced90 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0640b13700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0cb980 0x7f063c156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0641b15700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0ced90 0x7f063c1571d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f063400bc60 tx=0x7f0634009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f06317fa700 1 -- 172.21.15.84:0/227505498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063400c9c0 con 0x7f063c0ced90 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f06317fa700 1 -- 172.21.15.84:0/227505498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400cb60 con 0x7f063c0ced90 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f06317fa700 1 -- 172.21.15.84:0/227505498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634014410 con 0x7f063c0ced90 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0643578700 1 -- 172.21.15.84:0/227505498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c16d300 con 0x7f063c0ced90 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.256+0000 7f0643578700 1 -- 172.21.15.84:0/227505498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c1697f0 con 0x7f063c0ced90 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.257+0000 7f0643578700 1 -- 172.21.15.84:0/227505498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c16dae0 con 0x7f063c0ced90 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.258+0000 7f06317fa700 1 -- 172.21.15.84:0/227505498 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0634014800 con 0x7f063c0ced90 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.258+0000 7f06317fa700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0620066f30 0x7f06200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.258+0000 7f06317fa700 1 -- 172.21.15.84:0/227505498 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f06340845a0 con 0x7f063c0ced90 2023-10-06T03:26:31.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.258+0000 7f0641314700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0620066f30 0x7f06200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.258+0000 7f0641314700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0620066f30 0x7f06200693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0638006aa0 tx=0x7f0638008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:31.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.262+0000 7f06317fa700 1 -- 172.21.15.84:0/227505498 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0634051870 con 0x7f063c0ced90 2023-10-06T03:26:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.449+0000 7f0643578700 1 -- 172.21.15.84:0/227505498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) v1 -- 0x7f063c064ad0 con 0x7f063c0ced90 2023-10-06T03:26:31.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.455+0000 7f06317fa700 1 -- 172.21.15.84:0/227505498 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v20) v1 ==== 106+0+0 (secure 0 0 0) 0x7f0634054e90 con 0x7f063c0ced90 2023-10-06T03:26:31.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 -- 172.21.15.84:0/227505498 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0620066f30 msgr2=0x7f06200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0620066f30 0x7f06200693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0638006aa0 tx=0x7f0638008040 comp rx=0 tx=0).stop 2023-10-06T03:26:31.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 -- 172.21.15.84:0/227505498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0ced90 msgr2=0x7f063c1571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0ced90 0x7f063c1571d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f063400bc60 tx=0x7f0634009820 comp rx=0 tx=0).stop 2023-10-06T03:26:31.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 -- 172.21.15.84:0/227505498 shutdown_connections 2023-10-06T03:26:31.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0620066f30 0x7f06200693e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0ced90 0x7f063c1571d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c0b2a90 0x7f063c068510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 --2- 172.21.15.84:0/227505498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0cb980 0x7f063c156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 -- 172.21.15.84:0/227505498 >> 172.21.15.84:0/227505498 conn(0x7f063c099740 msgr2=0x7f063c069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 -- 172.21.15.84:0/227505498 shutdown_connections 2023-10-06T03:26:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.457+0000 7f0643578700 1 -- 172.21.15.84:0/227505498 wait complete. 2023-10-06T03:26:31.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:26:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.585+0000 7fe9b7b09700 1 Processor -- start 2023-10-06T03:26:31.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.585+0000 7fe9b7b09700 1 -- start start 2023-10-06T03:26:31.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b7b09700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe9b006d6b0 0x7fe9b015db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b7b09700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9b006ce50 0x7fe9b0159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b7b09700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe9b006da80 0x7fe9b00b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b7b09700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b015ab90 con 0x7fe9b006d6b0 2023-10-06T03:26:31.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b7b09700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b015d690 con 0x7fe9b006da80 2023-10-06T03:26:31.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b7b09700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b015a5d0 con 0x7fe9b006ce50 2023-10-06T03:26:31.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b58a5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe9b006d6b0 0x7fe9b015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b58a5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe9b006d6b0 0x7fe9b015db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39600/0 (socket says 172.21.15.84:39600) 2023-10-06T03:26:31.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b58a5700 1 -- 172.21.15.84:0/685445908 learned_addr learned my addr 172.21.15.84:0/685445908 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:31.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b50a4700 1 --2- 172.21.15.84:0/685445908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9b006ce50 0x7fe9b0159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b60a6700 1 --2- 172.21.15.84:0/685445908 >> v2:172.21.15.131:3300/0 conn(0x7fe9b006da80 0x7fe9b00b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b58a5700 1 -- 172.21.15.84:0/685445908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9b006ce50 msgr2=0x7fe9b0159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b58a5700 1 --2- 172.21.15.84:0/685445908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9b006ce50 0x7fe9b0159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b58a5700 1 -- 172.21.15.84:0/685445908 >> v2:172.21.15.131:3300/0 conn(0x7fe9b006da80 msgr2=0x7fe9b00b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b58a5700 1 --2- 172.21.15.84:0/685445908 >> v2:172.21.15.131:3300/0 conn(0x7fe9b006da80 0x7fe9b00b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b58a5700 1 -- 172.21.15.84:0/685445908 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b015a8b0 con 0x7fe9b006d6b0 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b60a6700 1 --2- 172.21.15.84:0/685445908 >> v2:172.21.15.131:3300/0 conn(0x7fe9b006da80 0x7fe9b00b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b58a5700 1 --2- 172.21.15.84:0/685445908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 0x7fe9b015db20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00ceeb0 tx=0x7fe9ac009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafabde0bba780f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b48a3700 1 -- 172.21.15.84:0/685445908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac005c10 con 0x7fe9b006d6b0 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.586+0000 7fe9b48a3700 1 -- 172.21.15.84:0/685445908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac005d70 con 0x7fe9b006d6b0 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.587+0000 7fe9b48a3700 1 -- 172.21.15.84:0/685445908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00b880 con 0x7fe9b006d6b0 2023-10-06T03:26:31.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.587+0000 7fe9b7b09700 1 -- 172.21.15.84:0/685445908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 msgr2=0x7fe9b015db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.587+0000 7fe9b7b09700 1 --2- 172.21.15.84:0/685445908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 0x7fe9b015db20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00ceeb0 tx=0x7fe9ac009220 comp rx=0 tx=0).stop 2023-10-06T03:26:31.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.587+0000 7fe9b7b09700 1 -- 172.21.15.84:0/685445908 shutdown_connections 2023-10-06T03:26:31.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.587+0000 7fe9b7b09700 1 --2- 172.21.15.84:0/685445908 >> v2:172.21.15.131:3300/0 conn(0x7fe9b006da80 0x7fe9b00b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.587+0000 7fe9b7b09700 1 --2- 172.21.15.84:0/685445908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 0x7fe9b015db20 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.587+0000 7fe9b7b09700 1 --2- 172.21.15.84:0/685445908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9b006ce50 0x7fe9b0159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.587+0000 7fe9b7b09700 1 -- 172.21.15.84:0/685445908 >> 172.21.15.84:0/685445908 conn(0x7fe9b006b640 msgr2=0x7fe9b006ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:31.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.587+0000 7fe9b7b09700 1 -- 172.21.15.84:0/685445908 shutdown_connections 2023-10-06T03:26:31.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.587+0000 7fe9b7b09700 1 -- 172.21.15.84:0/685445908 wait complete. 2023-10-06T03:26:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.588+0000 7fe9b7b09700 1 Processor -- start 2023-10-06T03:26:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.588+0000 7fe9b7b09700 1 -- start start 2023-10-06T03:26:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b7b09700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 0x7fe9b016ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b7b09700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b006da80 0x7fe9b016c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b7b09700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9b00b0150 0x7fe9b00b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b7b09700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00ae370 con 0x7fe9b006d6b0 2023-10-06T03:26:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b7b09700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00b0ae0 con 0x7fe9b006da80 2023-10-06T03:26:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b7b09700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b016a920 con 0x7fe9b00b0150 2023-10-06T03:26:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b58a5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 0x7fe9b016ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b58a5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 0x7fe9b016ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39612/0 (socket says 172.21.15.84:39612) 2023-10-06T03:26:31.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b58a5700 1 -- 172.21.15.84:0/1396715775 learned_addr learned my addr 172.21.15.84:0/1396715775 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:31.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b60a6700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9b00b0150 0x7fe9b00b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b50a4700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b006da80 0x7fe9b016c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b58a5700 1 -- 172.21.15.84:0/1396715775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9b00b0150 msgr2=0x7fe9b00b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b58a5700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9b00b0150 0x7fe9b00b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b58a5700 1 -- 172.21.15.84:0/1396715775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b006da80 msgr2=0x7fe9b016c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b58a5700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b006da80 0x7fe9b016c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b58a5700 1 -- 172.21.15.84:0/1396715775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac009480 con 0x7fe9b006d6b0 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9b58a5700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 0x7fe9b016ad50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009fd0 tx=0x7fe9ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.589+0000 7fe9a5ffb700 1 -- 172.21.15.84:0/1396715775 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac011910 con 0x7fe9b006d6b0 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.590+0000 7fe9a5ffb700 1 -- 172.21.15.84:0/1396715775 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac020070 con 0x7fe9b006d6b0 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.590+0000 7fe9b7b09700 1 -- 172.21.15.84:0/1396715775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b00add20 con 0x7fe9b006d6b0 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.590+0000 7fe9a5ffb700 1 -- 172.21.15.84:0/1396715775 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac011ca0 con 0x7fe9b006d6b0 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.590+0000 7fe9b7b09700 1 -- 172.21.15.84:0/1396715775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b016ce20 con 0x7fe9b006d6b0 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.591+0000 7fe9b7b09700 1 -- 172.21.15.84:0/1396715775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b0064ad0 con 0x7fe9b006d6b0 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.591+0000 7fe9a5ffb700 1 -- 172.21.15.84:0/1396715775 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9ac022030 con 0x7fe9b006d6b0 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.591+0000 7fe9a5ffb700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe994066f30 0x7fe9940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.591+0000 7fe9a5ffb700 1 -- 172.21.15.84:0/1396715775 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fe9ac0860a0 con 0x7fe9b006d6b0 2023-10-06T03:26:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.592+0000 7fe9b50a4700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe994066f30 0x7fe9940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.592+0000 7fe9b50a4700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe994066f30 0x7fe9940693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00ce850 tx=0x7fe9a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:31.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.596+0000 7fe9a5ffb700 1 -- 172.21.15.84:0/1396715775 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9ac053370 con 0x7fe9b006d6b0 2023-10-06T03:26:31.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.779+0000 7fe9b7b09700 1 -- 172.21.15.84:0/1396715775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe9b015d320 con 0x7fe9b006d6b0 2023-10-06T03:26:31.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.785+0000 7fe9a5ffb700 1 -- 172.21.15.84:0/1396715775 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe9ac056990 con 0x7fe9b006d6b0 2023-10-06T03:26:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 -- 172.21.15.84:0/1396715775 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe994066f30 msgr2=0x7fe9940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe994066f30 0x7fe9940693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00ce850 tx=0x7fe9a0008040 comp rx=0 tx=0).stop 2023-10-06T03:26:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 -- 172.21.15.84:0/1396715775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 msgr2=0x7fe9b016ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 0x7fe9b016ad50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009fd0 tx=0x7fe9ac016000 comp rx=0 tx=0).stop 2023-10-06T03:26:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 -- 172.21.15.84:0/1396715775 shutdown_connections 2023-10-06T03:26:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe994066f30 0x7fe9940693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9b00b0150 0x7fe9b00b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b006d6b0 0x7fe9b016ad50 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 --2- 172.21.15.84:0/1396715775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b006da80 0x7fe9b016c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 -- 172.21.15.84:0/1396715775 >> 172.21.15.84:0/1396715775 conn(0x7fe9b006b640 msgr2=0x7fe9b0068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:31.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 -- 172.21.15.84:0/1396715775 shutdown_connections 2023-10-06T03:26:31.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.787+0000 7fe9b7b09700 1 -- 172.21.15.84:0/1396715775 wait complete. 2023-10-06T03:26:31.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2023-10-06T03:26:31.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.912+0000 7fc2aeca0700 1 Processor -- start 2023-10-06T03:26:31.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.912+0000 7fc2aeca0700 1 -- start start 2023-10-06T03:26:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.913+0000 7fc2aeca0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2a8156420 0x7fc2a80c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.913+0000 7fc2aeca0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc2a80b1160 0x7fc2a80b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.913+0000 7fc2aeca0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a815ad90 con 0x7fc2a8156050 2023-10-06T03:26:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.913+0000 7fc2aeca0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a80b1ad0 con 0x7fc2a8156420 2023-10-06T03:26:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.913+0000 7fc2aeca0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a8159ea0 con 0x7fc2a80b1160 2023-10-06T03:26:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.913+0000 7fc2ad49d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2a8156420 0x7fc2a80c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.913+0000 7fc2adc9e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc2a8156050 0x7fc2a80b07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42952/0 (socket says 172.21.15.84:42952) 2023-10-06T03:26:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.913+0000 7fc2adc9e700 1 -- 172.21.15.84:0/320558137 learned_addr learned my addr 172.21.15.84:0/320558137 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.913+0000 7fc2ae49f700 1 --2- 172.21.15.84:0/320558137 >> v2:172.21.15.131:3300/0 conn(0x7fc2a80b1160 0x7fc2a80b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2ad49d700 1 -- 172.21.15.84:0/320558137 >> v2:172.21.15.131:3300/0 conn(0x7fc2a80b1160 msgr2=0x7fc2a80b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2ad49d700 1 --2- 172.21.15.84:0/320558137 >> v2:172.21.15.131:3300/0 conn(0x7fc2a80b1160 0x7fc2a80b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2ad49d700 1 -- 172.21.15.84:0/320558137 >> v1:172.21.15.84:6789/0 conn(0x7fc2a8156050 legacy=0x7fc2a80b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2ad49d700 1 -- 172.21.15.84:0/320558137 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a815a180 con 0x7fc2a8156420 2023-10-06T03:26:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2acc9c700 1 -- 172.21.15.84:0/320558137 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844229255 0 0) 0x7fc2a815ad90 con 0x7fc2a8156050 2023-10-06T03:26:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2ad49d700 1 --2- 172.21.15.84:0/320558137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a8156420 0x7fc2a80c9c40 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc2a806de40 tx=0x7fc2980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11999f6ab335dc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2acc9c700 1 -- 172.21.15.84:0/320558137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800b6b0 con 0x7fc2a8156420 2023-10-06T03:26:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2acc9c700 1 -- 172.21.15.84:0/320558137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29800b810 con 0x7fc2a8156420 2023-10-06T03:26:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2acc9c700 1 -- 172.21.15.84:0/320558137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800bbb0 con 0x7fc2a8156420 2023-10-06T03:26:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2aeca0700 1 -- 172.21.15.84:0/320558137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a8156420 msgr2=0x7fc2a80c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2aeca0700 1 --2- 172.21.15.84:0/320558137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a8156420 0x7fc2a80c9c40 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc2a806de40 tx=0x7fc2980091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2aeca0700 1 -- 172.21.15.84:0/320558137 shutdown_connections 2023-10-06T03:26:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2aeca0700 1 --2- 172.21.15.84:0/320558137 >> v2:172.21.15.131:3300/0 conn(0x7fc2a80b1160 0x7fc2a80b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2aeca0700 1 --2- 172.21.15.84:0/320558137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a8156420 0x7fc2a80c9c40 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.914+0000 7fc2aeca0700 1 -- 172.21.15.84:0/320558137 >> 172.21.15.84:0/320558137 conn(0x7fc2a80691d0 msgr2=0x7fc2a80aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.915+0000 7fc2aeca0700 1 -- 172.21.15.84:0/320558137 shutdown_connections 2023-10-06T03:26:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.915+0000 7fc2aeca0700 1 -- 172.21.15.84:0/320558137 wait complete. 2023-10-06T03:26:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2aeca0700 1 Processor -- start 2023-10-06T03:26:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2aeca0700 1 -- start start 2023-10-06T03:26:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2aeca0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a80b1160 0x7fc2a8141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2aeca0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2a8156050 0x7fc2a8143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2aeca0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8156420 0x7fc2a8145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2aeca0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8144bc0 con 0x7fc2a80b1160 2023-10-06T03:26:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2aeca0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8141980 con 0x7fc2a8156420 2023-10-06T03:26:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2aeca0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8143fb0 con 0x7fc2a8156050 2023-10-06T03:26:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2adc9e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a80b1160 0x7fc2a8141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2adc9e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a80b1160 0x7fc2a8141440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39628/0 (socket says 172.21.15.84:39628) 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.916+0000 7fc2adc9e700 1 -- 172.21.15.84:0/3365655382 learned_addr learned my addr 172.21.15.84:0/3365655382 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2ad49d700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2a8156050 0x7fc2a8143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2ae49f700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8156420 0x7fc2a8145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2adc9e700 1 -- 172.21.15.84:0/3365655382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2a8156050 msgr2=0x7fc2a8143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2adc9e700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2a8156050 0x7fc2a8143610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2adc9e700 1 -- 172.21.15.84:0/3365655382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8156420 msgr2=0x7fc2a8145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2adc9e700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8156420 0x7fc2a8145050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2adc9e700 1 -- 172.21.15.84:0/3365655382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc298009420 con 0x7fc2a80b1160 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2ae49f700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8156420 0x7fc2a8145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2adc9e700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a80b1160 0x7fc2a8141440 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400cd80 tx=0x7fc2a4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc29dffb700 1 -- 172.21.15.84:0/3365655382 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a400ab10 con 0x7fc2a80b1160 2023-10-06T03:26:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc29dffb700 1 -- 172.21.15.84:0/3365655382 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a400ac70 con 0x7fc2a80b1160 2023-10-06T03:26:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc29dffb700 1 -- 172.21.15.84:0/3365655382 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40070f0 con 0x7fc2a80b1160 2023-10-06T03:26:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2aeca0700 1 -- 172.21.15.84:0/3365655382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a8144290 con 0x7fc2a80b1160 2023-10-06T03:26:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.917+0000 7fc2aeca0700 1 -- 172.21.15.84:0/3365655382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a8144850 con 0x7fc2a80b1160 2023-10-06T03:26:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.918+0000 7fc2aeca0700 1 -- 172.21.15.84:0/3365655382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a8144ea0 con 0x7fc2a80b1160 2023-10-06T03:26:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.918+0000 7fc29dffb700 1 -- 172.21.15.84:0/3365655382 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2a40074e0 con 0x7fc2a80b1160 2023-10-06T03:26:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.919+0000 7fc29dffb700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc28c066f30 0x7fc28c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.919+0000 7fc29dffb700 1 -- 172.21.15.84:0/3365655382 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fc2a4084a60 con 0x7fc2a80b1160 2023-10-06T03:26:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.919+0000 7fc2ad49d700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc28c066f30 0x7fc28c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.919+0000 7fc2ad49d700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc28c066f30 0x7fc28c0693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2980093f0 tx=0x7fc298017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:31.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:31.923+0000 7fc29dffb700 1 -- 172.21.15.84:0/3365655382 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2a4051db0 con 0x7fc2a80b1160 2023-10-06T03:26:32.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:32.190+0000 7fc2aeca0700 1 -- 172.21.15.84:0/3365655382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) v1 -- 0x7fc2a805f270 con 0x7fc2a80b1160 2023-10-06T03:26:33.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.118+0000 7fc29dffb700 1 -- 172.21.15.84:0/3365655382 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v173) v1 ==== 143+0+0 (secure 0 0 0) 0x7fc2a40553d0 con 0x7fc2a80b1160 2023-10-06T03:26:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 -- 172.21.15.84:0/3365655382 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc28c066f30 msgr2=0x7fc28c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc28c066f30 0x7fc28c0693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2980093f0 tx=0x7fc298017000 comp rx=0 tx=0).stop 2023-10-06T03:26:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 -- 172.21.15.84:0/3365655382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a80b1160 msgr2=0x7fc2a8141440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a80b1160 0x7fc2a8141440 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400cd80 tx=0x7fc2a4001ae0 comp rx=0 tx=0).stop 2023-10-06T03:26:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 -- 172.21.15.84:0/3365655382 shutdown_connections 2023-10-06T03:26:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc28c066f30 0x7fc28c0693e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8156420 0x7fc2a8145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2a80b1160 0x7fc2a8141440 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 --2- 172.21.15.84:0/3365655382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2a8156050 0x7fc2a8143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:33.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 -- 172.21.15.84:0/3365655382 >> 172.21.15.84:0/3365655382 conn(0x7fc2a80691d0 msgr2=0x7fc2a80caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:33.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 -- 172.21.15.84:0/3365655382 shutdown_connections 2023-10-06T03:26:33.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.121+0000 7fc2aeca0700 1 -- 172.21.15.84:0/3365655382 wait complete. 2023-10-06T03:26:33.136 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2023-10-06T03:26:33.136 INFO:tasks.cephfs_test_runner:Starting test: test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2023-10-06T03:26:33.136 INFO:tasks.cephfs_test_runner:test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T03:26:33.137 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2023-10-06T03:26:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.256+0000 7f3060951700 1 Processor -- start 2023-10-06T03:26:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.256+0000 7f3060951700 1 -- start start 2023-10-06T03:26:33.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.256+0000 7f3060951700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f305c0b49e0 0x7f305c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.256+0000 7f3060951700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c0b0ca0 con 0x7f305c1595a0 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.256+0000 7f3060951700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c0b0f80 con 0x7f305c0b07a0 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.256+0000 7f3060951700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305c0b1260 con 0x7f305c0b49e0 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f3059d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f305c0b49e0 0x7f305c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f305a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f305c1595a0 0x7f305c0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42966/0 (socket says 172.21.15.84:42966) 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f305a59c700 1 -- 172.21.15.84:0/2285892137 learned_addr learned my addr 172.21.15.84:0/2285892137 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f3059d9b700 1 -- 172.21.15.84:0/2285892137 >> v1:172.21.15.131:6789/0 conn(0x7f305c0b07a0 legacy=0x7f305c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f3059d9b700 1 -- 172.21.15.84:0/2285892137 >> v1:172.21.15.84:6789/0 conn(0x7f305c1595a0 legacy=0x7f305c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f3059d9b700 1 -- 172.21.15.84:0/2285892137 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0b1540 con 0x7f305c0b49e0 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f305959a700 1 -- 172.21.15.84:0/2285892137 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28370727 0 0) 0x7f305c0b0ca0 con 0x7f305c1595a0 2023-10-06T03:26:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f3059d9b700 1 --2- 172.21.15.84:0/2285892137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b49e0 0x7f305c0aac80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3050009910 tx=0x7f30500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9ecc9c069d373 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f305959a700 1 -- 172.21.15.84:0/2285892137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305000b7e0 con 0x7f305c0b49e0 2023-10-06T03:26:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f305959a700 1 -- 172.21.15.84:0/2285892137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305000b940 con 0x7f305c0b49e0 2023-10-06T03:26:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.257+0000 7f305959a700 1 -- 172.21.15.84:0/2285892137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305000bce0 con 0x7f305c0b49e0 2023-10-06T03:26:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.258+0000 7f3060951700 1 -- 172.21.15.84:0/2285892137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b49e0 msgr2=0x7f305c0aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.258+0000 7f3060951700 1 --2- 172.21.15.84:0/2285892137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b49e0 0x7f305c0aac80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3050009910 tx=0x7f30500091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.258+0000 7f3060951700 1 -- 172.21.15.84:0/2285892137 shutdown_connections 2023-10-06T03:26:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.258+0000 7f3060951700 1 --2- 172.21.15.84:0/2285892137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b49e0 0x7f305c0aac80 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.258+0000 7f3060951700 1 -- 172.21.15.84:0/2285892137 >> 172.21.15.84:0/2285892137 conn(0x7f305c099830 msgr2=0x7f305c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.258+0000 7f3060951700 1 -- 172.21.15.84:0/2285892137 shutdown_connections 2023-10-06T03:26:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.258+0000 7f3060951700 1 -- 172.21.15.84:0/2285892137 wait complete. 2023-10-06T03:26:33.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.259+0000 7f3060951700 1 Processor -- start 2023-10-06T03:26:33.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.259+0000 7f3060951700 1 -- start start 2023-10-06T03:26:33.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f3060951700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b07a0 0x7f305c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:33.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f3060951700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c0b49e0 0x7f305c15e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:33.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f3060951700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c1595a0 0x7f305c15ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:33.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f3060951700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c09e010 con 0x7f305c0b07a0 2023-10-06T03:26:33.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f3060951700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c16de80 con 0x7f305c0b49e0 2023-10-06T03:26:33.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f3060951700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c16d550 con 0x7f305c1595a0 2023-10-06T03:26:33.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b07a0 0x7f305c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b07a0 0x7f305c0ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39644/0 (socket says 172.21.15.84:39644) 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305a59c700 1 -- 172.21.15.84:0/2940591228 learned_addr learned my addr 172.21.15.84:0/2940591228 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f3059d9b700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c0b49e0 0x7f305c15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305ad9d700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c1595a0 0x7f305c15ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305a59c700 1 -- 172.21.15.84:0/2940591228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c1595a0 msgr2=0x7f305c15ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305a59c700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c1595a0 0x7f305c15ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305a59c700 1 -- 172.21.15.84:0/2940591228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c0b49e0 msgr2=0x7f305c15e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305a59c700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c0b49e0 0x7f305c15e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305a59c700 1 -- 172.21.15.84:0/2940591228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050009420 con 0x7f305c0b07a0 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f3059d9b700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c0b49e0 0x7f305c15e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305ad9d700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c1595a0 0x7f305c15ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:33.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f305a59c700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b07a0 0x7f305c0ae890 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f304c00c910 tx=0x7f304c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f304a7fc700 1 -- 172.21.15.84:0/2940591228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c005d80 con 0x7f305c0b07a0 2023-10-06T03:26:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f304a7fc700 1 -- 172.21.15.84:0/2940591228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c00a590 con 0x7f305c0b07a0 2023-10-06T03:26:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f3060951700 1 -- 172.21.15.84:0/2940591228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c16d830 con 0x7f305c0b07a0 2023-10-06T03:26:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f304a7fc700 1 -- 172.21.15.84:0/2940591228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00a950 con 0x7f305c0b07a0 2023-10-06T03:26:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.260+0000 7f3060951700 1 -- 172.21.15.84:0/2940591228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c15b940 con 0x7f305c0b07a0 2023-10-06T03:26:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.261+0000 7f3060951700 1 -- 172.21.15.84:0/2940591228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c16e160 con 0x7f305c0b07a0 2023-10-06T03:26:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.262+0000 7f304a7fc700 1 -- 172.21.15.84:0/2940591228 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f304c0070f0 con 0x7f305c0b07a0 2023-10-06T03:26:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.262+0000 7f304a7fc700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f303c066f30 0x7f303c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.262+0000 7f304a7fc700 1 -- 172.21.15.84:0/2940591228 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f304c084190 con 0x7f305c0b07a0 2023-10-06T03:26:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.262+0000 7f3059d9b700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f303c066f30 0x7f303c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:33.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.262+0000 7f3059d9b700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f303c066f30 0x7f303c0693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3050009910 tx=0x7f3050016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:33.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.266+0000 7f304a7fc700 1 -- 172.21.15.84:0/2940591228 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f304c0514e0 con 0x7f305c0b07a0 2023-10-06T03:26:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:33.522+0000 7f3060951700 1 -- 172.21.15.84:0/2940591228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) v1 -- 0x7f305c064ad0 con 0x7f305c0b07a0 2023-10-06T03:26:34.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.119+0000 7f304a7fc700 1 -- 172.21.15.84:0/2940591228 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v174) v1 ==== 148+0+0 (secure 0 0 0) 0x7f304c054b00 con 0x7f305c0b07a0 2023-10-06T03:26:34.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 -- 172.21.15.84:0/2940591228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f303c066f30 msgr2=0x7f303c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f303c066f30 0x7f303c0693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3050009910 tx=0x7f3050016000 comp rx=0 tx=0).stop 2023-10-06T03:26:34.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 -- 172.21.15.84:0/2940591228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b07a0 msgr2=0x7f305c0ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b07a0 0x7f305c0ae890 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f304c00c910 tx=0x7f304c0016f0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 -- 172.21.15.84:0/2940591228 shutdown_connections 2023-10-06T03:26:34.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f303c066f30 0x7f303c0693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c1595a0 0x7f305c15ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0b07a0 0x7f305c0ae890 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 --2- 172.21.15.84:0/2940591228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c0b49e0 0x7f305c15e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 -- 172.21.15.84:0/2940591228 >> 172.21.15.84:0/2940591228 conn(0x7f305c099830 msgr2=0x7f305c15d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:34.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 -- 172.21.15.84:0/2940591228 shutdown_connections 2023-10-06T03:26:34.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.122+0000 7f3060951700 1 -- 172.21.15.84:0/2940591228 wait complete. 2023-10-06T03:26:34.135 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:26:34.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.253+0000 7f7885788700 1 Processor -- start 2023-10-06T03:26:34.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.253+0000 7f7885788700 1 -- start start 2023-10-06T03:26:34.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f7885788700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7880153a00 0x7f7880069590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f7885788700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7880069ad0 0x7f788015d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f7885788700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153dd0 0x7f78800cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f7885788700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788015abb0 con 0x7f7880153a00 2023-10-06T03:26:34.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f7885788700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788015dbd0 con 0x7f7880069ad0 2023-10-06T03:26:34.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f7885788700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788015deb0 con 0x7f7880153dd0 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7880153a00 0x7f7880069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7880153a00 0x7f7880069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39650/0 (socket says 172.21.15.84:39650) 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787effd700 1 -- 172.21.15.84:0/1079658458 learned_addr learned my addr 172.21.15.84:0/1079658458 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787e7fc700 1 --2- 172.21.15.84:0/1079658458 >> v2:172.21.15.131:3300/0 conn(0x7f7880069ad0 0x7f788015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787f7fe700 1 --2- 172.21.15.84:0/1079658458 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153dd0 0x7f78800cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787effd700 1 -- 172.21.15.84:0/1079658458 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153dd0 msgr2=0x7f78800cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787effd700 1 --2- 172.21.15.84:0/1079658458 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153dd0 0x7f78800cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787effd700 1 -- 172.21.15.84:0/1079658458 >> v2:172.21.15.131:3300/0 conn(0x7f7880069ad0 msgr2=0x7f788015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787effd700 1 --2- 172.21.15.84:0/1079658458 >> v2:172.21.15.131:3300/0 conn(0x7f7880069ad0 0x7f788015d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787effd700 1 -- 172.21.15.84:0/1079658458 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7880068d90 con 0x7f7880153a00 2023-10-06T03:26:34.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787f7fe700 1 --2- 172.21.15.84:0/1079658458 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153dd0 0x7f78800cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.254+0000 7f787effd700 1 --2- 172.21.15.84:0/1079658458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880153a00 0x7f7880069590 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f788006ded0 tx=0x7f7870009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc36d9e5b979490 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f787dffb700 1 -- 172.21.15.84:0/1079658458 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870009e70 con 0x7f7880153a00 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f787dffb700 1 -- 172.21.15.84:0/1079658458 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787000b860 con 0x7f7880153a00 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f787dffb700 1 -- 172.21.15.84:0/1079658458 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000bc00 con 0x7f7880153a00 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f7885788700 1 -- 172.21.15.84:0/1079658458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880153a00 msgr2=0x7f7880069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f7885788700 1 --2- 172.21.15.84:0/1079658458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880153a00 0x7f7880069590 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f788006ded0 tx=0x7f7870009250 comp rx=0 tx=0).stop 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f7885788700 1 -- 172.21.15.84:0/1079658458 shutdown_connections 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f7885788700 1 --2- 172.21.15.84:0/1079658458 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153dd0 0x7f78800cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f7885788700 1 --2- 172.21.15.84:0/1079658458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880153a00 0x7f7880069590 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f7885788700 1 --2- 172.21.15.84:0/1079658458 >> v2:172.21.15.131:3300/0 conn(0x7f7880069ad0 0x7f788015d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f7885788700 1 -- 172.21.15.84:0/1079658458 >> 172.21.15.84:0/1079658458 conn(0x7f788006b650 msgr2=0x7f788006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:34.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f7885788700 1 -- 172.21.15.84:0/1079658458 shutdown_connections 2023-10-06T03:26:34.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.255+0000 7f7885788700 1 -- 172.21.15.84:0/1079658458 wait complete. 2023-10-06T03:26:34.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.256+0000 7f7885788700 1 Processor -- start 2023-10-06T03:26:34.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.256+0000 7f7885788700 1 -- start start 2023-10-06T03:26:34.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f7885788700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880069ad0 0x7f78800b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f7885788700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153a00 0x7f7880147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f7885788700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7880153dd0 0x7f788014a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f7885788700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788014c0c0 con 0x7f7880069ad0 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f7885788700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78800b37e0 con 0x7f7880153dd0 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f7885788700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78800b1080 con 0x7f7880153a00 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f787effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880069ad0 0x7f78800b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f787effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880069ad0 0x7f78800b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39652/0 (socket says 172.21.15.84:39652) 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f787effd700 1 -- 172.21.15.84:0/991341863 learned_addr learned my addr 172.21.15.84:0/991341863 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f787e7fc700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153a00 0x7f7880147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.257+0000 7f787f7fe700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7880153dd0 0x7f788014a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f787effd700 1 -- 172.21.15.84:0/991341863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153a00 msgr2=0x7f7880147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f787effd700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153a00 0x7f7880147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f787effd700 1 -- 172.21.15.84:0/991341863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7880153dd0 msgr2=0x7f788014a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f787effd700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7880153dd0 0x7f788014a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f787effd700 1 -- 172.21.15.84:0/991341863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78700094f0 con 0x7f7880069ad0 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f787effd700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880069ad0 0x7f78800b3b20 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f7870009290 tx=0x7f7870017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f7866ffd700 1 -- 172.21.15.84:0/991341863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000bbe0 con 0x7f7880069ad0 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f7866ffd700 1 -- 172.21.15.84:0/991341863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787001f070 con 0x7f7880069ad0 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f7866ffd700 1 -- 172.21.15.84:0/991341863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78700266b0 con 0x7f7880069ad0 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f7885788700 1 -- 172.21.15.84:0/991341863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7880149460 con 0x7f7880069ad0 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.258+0000 7f7885788700 1 -- 172.21.15.84:0/991341863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7880149aa0 con 0x7f7880069ad0 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.259+0000 7f7885788700 1 -- 172.21.15.84:0/991341863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7880064ad0 con 0x7f7880069ad0 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.260+0000 7f7866ffd700 1 -- 172.21.15.84:0/991341863 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f787001a430 con 0x7f7880069ad0 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.260+0000 7f7866ffd700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f786c066f30 0x7f786c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.260+0000 7f7866ffd700 1 -- 172.21.15.84:0/991341863 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f7870021070 con 0x7f7880069ad0 2023-10-06T03:26:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.260+0000 7f787e7fc700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f786c066f30 0x7f786c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.260+0000 7f787e7fc700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f786c066f30 0x7f786c0693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7880153780 tx=0x7f78740091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.264+0000 7f7866ffd700 1 -- 172.21.15.84:0/991341863 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7870053490 con 0x7f7880069ad0 2023-10-06T03:26:34.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.446+0000 7f7885788700 1 -- 172.21.15.84:0/991341863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f788004bb80 con 0x7f7880069ad0 2023-10-06T03:26:34.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.450+0000 7f7866ffd700 1 -- 172.21.15.84:0/991341863 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f78700150c0 con 0x7f7880069ad0 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 -- 172.21.15.84:0/991341863 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f786c066f30 msgr2=0x7f786c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f786c066f30 0x7f786c0693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7880153780 tx=0x7f78740091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 -- 172.21.15.84:0/991341863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880069ad0 msgr2=0x7f78800b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880069ad0 0x7f78800b3b20 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f7870009290 tx=0x7f7870017000 comp rx=0 tx=0).stop 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 -- 172.21.15.84:0/991341863 shutdown_connections 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f786c066f30 0x7f786c0693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7880153dd0 0x7f788014a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7880069ad0 0x7f78800b3b20 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 --2- 172.21.15.84:0/991341863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7880153a00 0x7f7880147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 -- 172.21.15.84:0/991341863 >> 172.21.15.84:0/991341863 conn(0x7f788006b650 msgr2=0x7f788015ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 -- 172.21.15.84:0/991341863 shutdown_connections 2023-10-06T03:26:34.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.452+0000 7f7885788700 1 -- 172.21.15.84:0/991341863 wait complete. 2023-10-06T03:26:34.477 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:26:34.477 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:26:34.517 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:26:34.567 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:26:34.568 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:26:34.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:34.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.682+0000 7f9d8d2e4700 1 Processor -- start 2023-10-06T03:26:34.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.682+0000 7f9d8d2e4700 1 -- start start 2023-10-06T03:26:34.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d8d2e4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9d880b07a0 0x7f9d880ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d8d2e4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d880b0ca0 con 0x7f9d880b49e0 2023-10-06T03:26:34.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d8d2e4700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d880b0f80 con 0x7f9d881595a0 2023-10-06T03:26:34.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d8d2e4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d880ab390 con 0x7f9d880b07a0 2023-10-06T03:26:34.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d867fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9d880b49e0 0x7f9d880aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42968/0 (socket says 172.21.15.84:42968) 2023-10-06T03:26:34.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d867fc700 1 -- 172.21.15.84:0/3941786560 learned_addr learned my addr 172.21.15.84:0/3941786560 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:34.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d877fe700 1 --2- 172.21.15.84:0/3941786560 >> v2:172.21.15.131:3300/0 conn(0x7f9d880b07a0 0x7f9d880ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944964244 0 0) 0x7f9d880b0ca0 con 0x7f9d880b49e0 2023-10-06T03:26:34.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d70003570 con 0x7f9d880b49e0 2023-10-06T03:26:34.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513279476 0 0) 0x7f9d70003570 con 0x7f9d880b49e0 2023-10-06T03:26:34.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 >> v2:172.21.15.131:3300/0 conn(0x7f9d880b07a0 msgr2=0x7f9d880ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:34.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 --2- 172.21.15.84:0/3941786560 >> v2:172.21.15.131:3300/0 conn(0x7f9d880b07a0 0x7f9d880ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 >> v1:172.21.15.131:6789/0 conn(0x7f9d881595a0 legacy=0x7f9d880aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d880b1260 con 0x7f9d880b49e0 2023-10-06T03:26:34.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f9d7c001470 con 0x7f9d880b49e0 2023-10-06T03:26:34.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 >> v1:172.21.15.84:6789/0 conn(0x7f9d880b49e0 legacy=0x7f9d880aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d70003a60 0x7f9d70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d70004810 0x7f9d70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d700051c0 0x7f9d7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880ab390 con 0x7f9d70003a60 2023-10-06T03:26:34.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7000c0d0 con 0x7f9d700051c0 2023-10-06T03:26:34.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7000c290 con 0x7f9d70004810 2023-10-06T03:26:34.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.683+0000 7f9d86ffd700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d70003a60 0x7f9d70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d877fe700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d700051c0 0x7f9d7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d867fc700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d70004810 0x7f9d70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d86ffd700 1 -- 172.21.15.84:0/3941786560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d70004810 msgr2=0x7f9d70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:34.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d86ffd700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d70004810 0x7f9d70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d86ffd700 1 -- 172.21.15.84:0/3941786560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d700051c0 msgr2=0x7f9d7000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:34.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d86ffd700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d700051c0 0x7f9d7000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d877fe700 1 -- 172.21.15.84:0/3941786560 reap_dead start 2023-10-06T03:26:34.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d86ffd700 1 -- 172.21.15.84:0/3941786560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d70003570 con 0x7f9d70003a60 2023-10-06T03:26:34.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d86ffd700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d70003a60 0x7f9d70003e70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9d780018d0 tx=0x7f9d78007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc91f0e5d0a241e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:34.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78001290 con 0x7f9d70003a60 2023-10-06T03:26:34.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d78012420 con 0x7f9d70003a60 2023-10-06T03:26:34.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.684+0000 7f9d85ffb700 1 -- 172.21.15.84:0/3941786560 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d780127e0 con 0x7f9d70003a60 2023-10-06T03:26:34.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.685+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3941786560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d70003a60 msgr2=0x7f9d70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.685+0000 7f9d8d2e4700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d70003a60 0x7f9d70003e70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9d780018d0 tx=0x7f9d78007d80 comp rx=0 tx=0).stop 2023-10-06T03:26:34.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.685+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3941786560 shutdown_connections 2023-10-06T03:26:34.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.685+0000 7f9d8d2e4700 1 --2- 172.21.15.84:0/3941786560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d70003a60 0x7f9d70003e70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.685+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3941786560 >> 172.21.15.84:0/3941786560 conn(0x7f9d88099830 msgr2=0x7f9d8806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:34.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.685+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3941786560 shutdown_connections 2023-10-06T03:26:34.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.685+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3941786560 wait complete. 2023-10-06T03:26:34.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.686+0000 7f9d8d2e4700 1 Processor -- start 2023-10-06T03:26:34.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.686+0000 7f9d8d2e4700 1 -- start start 2023-10-06T03:26:34.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d8d2e4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d70003a60 0x7f9d88157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d8d2e4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d880ab4d0 0x7f9d880ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d8d2e4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d88069600 0x7f9d88069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d8d2e4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88069fe0 con 0x7f9d880ab4d0 2023-10-06T03:26:34.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d8d2e4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88099f90 con 0x7f9d88069600 2023-10-06T03:26:34.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d8d2e4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8809a830 con 0x7f9d70003a60 2023-10-06T03:26:34.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d867fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d880ab4d0 0x7f9d880ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d867fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d880ab4d0 0x7f9d880ab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39672/0 (socket says 172.21.15.84:39672) 2023-10-06T03:26:34.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d867fc700 1 -- 172.21.15.84:0/3539072592 learned_addr learned my addr 172.21.15.84:0/3539072592 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:34.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d867fc700 1 -- 172.21.15.84:0/3539072592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d70003a60 msgr2=0x7f9d88157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d867fc700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d70003a60 0x7f9d88157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d867fc700 1 -- 172.21.15.84:0/3539072592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d88069600 msgr2=0x7f9d88069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d877fe700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d88069600 0x7f9d88069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d867fc700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d88069600 0x7f9d88069aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d867fc700 1 -- 172.21.15.84:0/3539072592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88158130 con 0x7f9d880ab4d0 2023-10-06T03:26:34.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d867fc700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d880ab4d0 0x7f9d880ab940 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0073c0 tx=0x7f9d7c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:34.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d6effd700 1 -- 172.21.15.84:0/3539072592 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c018030 con 0x7f9d880ab4d0 2023-10-06T03:26:34.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d6effd700 1 -- 172.21.15.84:0/3539072592 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c00f7f0 con 0x7f9d880ab4d0 2023-10-06T03:26:34.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d6effd700 1 -- 172.21.15.84:0/3539072592 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00fbb0 con 0x7f9d880ab4d0 2023-10-06T03:26:34.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3539072592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d880abf20 con 0x7f9d880ab4d0 2023-10-06T03:26:34.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.687+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3539072592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8809a4c0 con 0x7f9d880ab4d0 2023-10-06T03:26:34.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.688+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3539072592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8809a680 con 0x7f9d880ab4d0 2023-10-06T03:26:34.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.689+0000 7f9d6effd700 1 -- 172.21.15.84:0/3539072592 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d7c01b070 con 0x7f9d880ab4d0 2023-10-06T03:26:34.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.689+0000 7f9d6effd700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d74066f30 0x7f9d740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:34.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.689+0000 7f9d6effd700 1 -- 172.21.15.84:0/3539072592 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f9d7c019070 con 0x7f9d880ab4d0 2023-10-06T03:26:34.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.689+0000 7f9d86ffd700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d74066f30 0x7f9d740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:34.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.689+0000 7f9d86ffd700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d74066f30 0x7f9d740693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d880b5820 tx=0x7f9d78015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:34.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.693+0000 7f9d6effd700 1 -- 172.21.15.84:0/3539072592 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d7c051600 con 0x7f9d880ab4d0 2023-10-06T03:26:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.919+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3539072592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d88064ad0 con 0x7f9d880ab4d0 2023-10-06T03:26:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.919+0000 7f9d6effd700 1 -- 172.21.15.84:0/3539072592 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f9d7c054c20 con 0x7f9d880ab4d0 2023-10-06T03:26:34.920 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:34.920 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5333,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1214313207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1214313207},{"type":"v1","addr":"172.21.15.131:6835","nonce":1214313207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5638,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/63470384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":63470384},{"type":"v1","addr":"172.21.15.84:6837","nonce":63470384}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3440632646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3440632646},{"type":"v1","addr":"172.21.15.131:6834","nonce":3440632646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6534,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3686266434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3686266434},{"type":"v1","addr":"172.21.15.84:6836","nonce":3686266434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[]} 2023-10-06T03:26:34.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3539072592 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d74066f30 msgr2=0x7f9d740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d74066f30 0x7f9d740693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d880b5820 tx=0x7f9d78015000 comp rx=0 tx=0).stop 2023-10-06T03:26:34.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3539072592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d880ab4d0 msgr2=0x7f9d880ab940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:34.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d880ab4d0 0x7f9d880ab940 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0073c0 tx=0x7f9d7c001e50 comp rx=0 tx=0).stop 2023-10-06T03:26:34.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3539072592 shutdown_connections 2023-10-06T03:26:34.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d74066f30 0x7f9d740693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d88069600 0x7f9d88069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d70003a60 0x7f9d88157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 --2- 172.21.15.84:0/3539072592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d880ab4d0 0x7f9d880ab940 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:34.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3539072592 >> 172.21.15.84:0/3539072592 conn(0x7f9d88099830 msgr2=0x7f9d880b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:34.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3539072592 shutdown_connections 2023-10-06T03:26:34.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:34.922+0000 7f9d8d2e4700 1 -- 172.21.15.84:0/3539072592 wait complete. 2023-10-06T03:26:34.926 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 41 2023-10-06T03:26:34.935 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:26:34.935 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:26:34.935 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:26:34.935 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:26:34.935 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:26:34.935 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:26:34.936 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:26:34.936 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:26:34.936 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:26:34.936 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:26:34.936 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:26:34.936 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:26:34.936 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:26:34.936 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:26:34.937 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:26:34.937 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:26:34.944 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:26:34.945 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:26:34.945 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:26:34.946 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:26:34.951 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:26:34.951 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:26:34.951 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:26:34.952 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:26:34.987 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:26:34.987 DEBUG:teuthology.parallel:result is None 2023-10-06T03:26:34.988 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:26:34.988 DEBUG:teuthology.parallel:result is None 2023-10-06T03:26:34.993 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:26:34.993 DEBUG:teuthology.parallel:result is None 2023-10-06T03:26:34.994 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:26:34.994 DEBUG:teuthology.parallel:result is None 2023-10-06T03:26:34.994 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:26:35.060 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:26:35.060 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:26:35.077 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:26:35.077 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:26:35.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.116+0000 7f8463262700 1 Processor -- start 2023-10-06T03:26:35.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.116+0000 7f8463262700 1 -- start start 2023-10-06T03:26:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.116+0000 7f8463262700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f845c0ad360 0x7f845c0ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.116+0000 7f8463262700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f845c0ad730 0x7f845c068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.116+0000 7f8463262700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c068f80 con 0x7f845c068b40 2023-10-06T03:26:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.116+0000 7f8463262700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c159f80 con 0x7f845c0ad360 2023-10-06T03:26:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.116+0000 7f8463262700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c15a260 con 0x7f845c0ad730 2023-10-06T03:26:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f8460ffe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f845c0ad360 0x7f845c0ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f8460ffe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f845c0ad360 0x7f845c0ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39710/0 (socket says 172.21.15.84:39710) 2023-10-06T03:26:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f8460ffe700 1 -- 172.21.15.84:0/3876777744 learned_addr learned my addr 172.21.15.84:0/3876777744 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f845bfff700 1 --2- 172.21.15.84:0/3876777744 >> v2:172.21.15.131:3300/0 conn(0x7f845c0ad730 0x7f845c068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f8460ffe700 1 -- 172.21.15.84:0/3876777744 >> v2:172.21.15.131:3300/0 conn(0x7f845c0ad730 msgr2=0x7f845c068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f8460ffe700 1 --2- 172.21.15.84:0/3876777744 >> v2:172.21.15.131:3300/0 conn(0x7f845c0ad730 0x7f845c068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:35.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f8460ffe700 1 -- 172.21.15.84:0/3876777744 >> v1:172.21.15.131:6789/0 conn(0x7f845c068b40 legacy=0x7f845c15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:35.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f8460ffe700 1 -- 172.21.15.84:0/3876777744 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c15a540 con 0x7f845c0ad360 2023-10-06T03:26:35.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f8460ffe700 1 --2- 172.21.15.84:0/3876777744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad360 0x7f845c0ac270 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f845c06e980 tx=0x7f844c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efefa14f7ad417bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:35.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f845b7fe700 1 -- 172.21.15.84:0/3876777744 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c009e70 con 0x7f845c0ad360 2023-10-06T03:26:35.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f845b7fe700 1 -- 172.21.15.84:0/3876777744 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00b860 con 0x7f845c0ad360 2023-10-06T03:26:35.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.117+0000 7f845b7fe700 1 -- 172.21.15.84:0/3876777744 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00bc00 con 0x7f845c0ad360 2023-10-06T03:26:35.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.118+0000 7f8463262700 1 -- 172.21.15.84:0/3876777744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad360 msgr2=0x7f845c0ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:35.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.118+0000 7f8463262700 1 --2- 172.21.15.84:0/3876777744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad360 0x7f845c0ac270 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f845c06e980 tx=0x7f844c009250 comp rx=0 tx=0).stop 2023-10-06T03:26:35.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.118+0000 7f8463262700 1 -- 172.21.15.84:0/3876777744 shutdown_connections 2023-10-06T03:26:35.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.118+0000 7f8463262700 1 --2- 172.21.15.84:0/3876777744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad360 0x7f845c0ac270 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:35.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.118+0000 7f8463262700 1 --2- 172.21.15.84:0/3876777744 >> v2:172.21.15.131:3300/0 conn(0x7f845c0ad730 0x7f845c068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:35.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.118+0000 7f8463262700 1 -- 172.21.15.84:0/3876777744 >> 172.21.15.84:0/3876777744 conn(0x7f845c06dd10 msgr2=0x7f845c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:35.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.118+0000 7f8463262700 1 -- 172.21.15.84:0/3876777744 shutdown_connections 2023-10-06T03:26:35.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.118+0000 7f8463262700 1 -- 172.21.15.84:0/3876777744 wait complete. 2023-10-06T03:26:35.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.119+0000 7f8463262700 1 Processor -- start 2023-10-06T03:26:35.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.119+0000 7f8463262700 1 -- start start 2023-10-06T03:26:35.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f8463262700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f845c068b40 0x7f845c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:35.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f8463262700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f845c0ad360 0x7f845c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:35.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f8463262700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad730 0x7f845c0a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:35.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f8463262700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0ca530 con 0x7f845c0ad730 2023-10-06T03:26:35.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f8463262700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c169ac0 con 0x7f845c0ad360 2023-10-06T03:26:35.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f8463262700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c169da0 con 0x7f845c068b40 2023-10-06T03:26:35.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f84617ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad730 0x7f845c0a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:35.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f84617ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad730 0x7f845c0a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39714/0 (socket says 172.21.15.84:39714) 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f84617ff700 1 -- 172.21.15.84:0/2593271182 learned_addr learned my addr 172.21.15.84:0/2593271182 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f8460ffe700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f845c068b40 0x7f845c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f84617ff700 1 -- 172.21.15.84:0/2593271182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f845c068b40 msgr2=0x7f845c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.120+0000 7f84617ff700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f845c068b40 0x7f845c0cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.121+0000 7f84617ff700 1 -- 172.21.15.84:0/2593271182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f845c0ad360 msgr2=0x7f845c150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.121+0000 7f84617ff700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f845c0ad360 0x7f845c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.121+0000 7f84617ff700 1 -- 172.21.15.84:0/2593271182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c0094f0 con 0x7f845c0ad730 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.121+0000 7f8460ffe700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f845c068b40 0x7f845c0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.121+0000 7f84617ff700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad730 0x7f845c0a9970 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f845400c8e0 tx=0x7f8454001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.122+0000 7f8458ff9700 1 -- 172.21.15.84:0/2593271182 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845400ce80 con 0x7f845c0ad730 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.122+0000 7f8458ff9700 1 -- 172.21.15.84:0/2593271182 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845400a7e0 con 0x7f845c0ad730 2023-10-06T03:26:35.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.122+0000 7f8463262700 1 -- 172.21.15.84:0/2593271182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c16a080 con 0x7f845c0ad730 2023-10-06T03:26:35.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.122+0000 7f8458ff9700 1 -- 172.21.15.84:0/2593271182 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845400ab80 con 0x7f845c0ad730 2023-10-06T03:26:35.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.122+0000 7f8463262700 1 -- 172.21.15.84:0/2593271182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c1696b0 con 0x7f845c0ad730 2023-10-06T03:26:35.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.123+0000 7f8463262700 1 -- 172.21.15.84:0/2593271182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c0b0c70 con 0x7f845c0ad730 2023-10-06T03:26:35.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.123+0000 7f8458ff9700 1 -- 172.21.15.84:0/2593271182 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8454012420 con 0x7f845c0ad730 2023-10-06T03:26:35.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.124+0000 7f8458ff9700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8448066f30 0x7f84480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:35.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.124+0000 7f8458ff9700 1 -- 172.21.15.84:0/2593271182 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f84540847c0 con 0x7f845c0ad730 2023-10-06T03:26:35.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.124+0000 7f8460ffe700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8448066f30 0x7f84480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:35.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.124+0000 7f8460ffe700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8448066f30 0x7f84480693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f845c06e980 tx=0x7f844c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:35.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.129+0000 7f8458ff9700 1 -- 172.21.15.84:0/2593271182 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8454051a90 con 0x7f845c0ad730 2023-10-06T03:26:35.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:35.327+0000 7f8463262700 1 -- 172.21.15.84:0/2593271182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f845c064ad0 con 0x7f845c0ad730 2023-10-06T03:26:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.136+0000 7f8458ff9700 1 -- 172.21.15.84:0/2593271182 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v82) v1 ==== 97+0+0 (secure 0 0 0) 0x7f84540550b0 con 0x7f845c0ad730 2023-10-06T03:26:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 -- 172.21.15.84:0/2593271182 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8448066f30 msgr2=0x7f84480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8448066f30 0x7f84480693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f845c06e980 tx=0x7f844c017000 comp rx=0 tx=0).stop 2023-10-06T03:26:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 -- 172.21.15.84:0/2593271182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad730 msgr2=0x7f845c0a9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad730 0x7f845c0a9970 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f845400c8e0 tx=0x7f8454001710 comp rx=0 tx=0).stop 2023-10-06T03:26:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 -- 172.21.15.84:0/2593271182 shutdown_connections 2023-10-06T03:26:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8448066f30 0x7f84480693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845c0ad730 0x7f845c0a9970 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f845c068b40 0x7f845c0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 --2- 172.21.15.84:0/2593271182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f845c0ad360 0x7f845c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 -- 172.21.15.84:0/2593271182 >> 172.21.15.84:0/2593271182 conn(0x7f845c06dd10 msgr2=0x7f845c152680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 -- 172.21.15.84:0/2593271182 shutdown_connections 2023-10-06T03:26:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.139+0000 7f8463262700 1 -- 172.21.15.84:0/2593271182 wait complete. 2023-10-06T03:26:36.142 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T03:26:36.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:26:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.274+0000 7f819cf8c700 1 Processor -- start 2023-10-06T03:26:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.274+0000 7f819cf8c700 1 -- start start 2023-10-06T03:26:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f819cf8c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8198159480 0x7f81980b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f819cf8c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f81980b3610 0x7f81980cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f819cf8c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81980cb7e0 con 0x7f81980cc1b0 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f819cf8c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81980b08a0 con 0x7f81980b3610 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f819cf8c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81980cb190 con 0x7f8198159480 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f8196ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f81980b3610 0x7f81980cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f8196ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f81980b3610 0x7f81980cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39724/0 (socket says 172.21.15.84:39724) 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f8196ffd700 1 -- 172.21.15.84:0/358906405 learned_addr learned my addr 172.21.15.84:0/358906405 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f81977fe700 1 --2- 172.21.15.84:0/358906405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8198159480 0x7f81980b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f8196ffd700 1 -- 172.21.15.84:0/358906405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8198159480 msgr2=0x7f81980b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f8196ffd700 1 --2- 172.21.15.84:0/358906405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8198159480 0x7f81980b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f8196ffd700 1 -- 172.21.15.84:0/358906405 >> v1:172.21.15.131:6789/0 conn(0x7f81980cc1b0 legacy=0x7f81980b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.275+0000 7f8196ffd700 1 -- 172.21.15.84:0/358906405 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81980cb470 con 0x7f81980b3610 2023-10-06T03:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f8196ffd700 1 --2- 172.21.15.84:0/358906405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81980b3610 0x7f81980cbc70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f818c0099b0 tx=0x7f818c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af99d6e5fb7291cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f81967fc700 1 -- 172.21.15.84:0/358906405 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c009ea0 con 0x7f81980b3610 2023-10-06T03:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f81967fc700 1 -- 172.21.15.84:0/358906405 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c00b860 con 0x7f81980b3610 2023-10-06T03:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f81967fc700 1 -- 172.21.15.84:0/358906405 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c00bc00 con 0x7f81980b3610 2023-10-06T03:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f819cf8c700 1 -- 172.21.15.84:0/358906405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81980b3610 msgr2=0x7f81980cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f819cf8c700 1 --2- 172.21.15.84:0/358906405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81980b3610 0x7f81980cbc70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f818c0099b0 tx=0x7f818c009250 comp rx=0 tx=0).stop 2023-10-06T03:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f819cf8c700 1 -- 172.21.15.84:0/358906405 shutdown_connections 2023-10-06T03:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f819cf8c700 1 --2- 172.21.15.84:0/358906405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8198159480 0x7f81980b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f819cf8c700 1 --2- 172.21.15.84:0/358906405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81980b3610 0x7f81980cbc70 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f819cf8c700 1 -- 172.21.15.84:0/358906405 >> 172.21.15.84:0/358906405 conn(0x7f819806ed20 msgr2=0x7f819806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.276+0000 7f819cf8c700 1 -- 172.21.15.84:0/358906405 shutdown_connections 2023-10-06T03:26:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.278+0000 7f819cf8c700 1 -- 172.21.15.84:0/358906405 wait complete. 2023-10-06T03:26:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.279+0000 7f819cf8c700 1 Processor -- start 2023-10-06T03:26:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.279+0000 7f819cf8c700 1 -- start start 2023-10-06T03:26:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f819cf8c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81980b3610 0x7f81980d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f819cf8c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81980cc1b0 0x7f81980c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f819cf8c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8198159480 0x7f81980ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f819cf8c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81980cf730 con 0x7f8198159480 2023-10-06T03:26:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f819cf8c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81980cee90 con 0x7f81980cc1b0 2023-10-06T03:26:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f819cf8c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81980cf170 con 0x7f81980b3610 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f8197fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8198159480 0x7f81980ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f8197fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8198159480 0x7f81980ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39732/0 (socket says 172.21.15.84:39732) 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f8197fff700 1 -- 172.21.15.84:0/3170174505 learned_addr learned my addr 172.21.15.84:0/3170174505 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f81977fe700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81980b3610 0x7f81980d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f8196ffd700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81980cc1b0 0x7f81980c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f8197fff700 1 -- 172.21.15.84:0/3170174505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81980b3610 msgr2=0x7f81980d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f8197fff700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81980b3610 0x7f81980d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f8197fff700 1 -- 172.21.15.84:0/3170174505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81980cc1b0 msgr2=0x7f81980c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f8197fff700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81980cc1b0 0x7f81980c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f8197fff700 1 -- 172.21.15.84:0/3170174505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0094f0 con 0x7f8198159480 2023-10-06T03:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f81977fe700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81980b3610 0x7f81980d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.280+0000 7f8197fff700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8198159480 0x7f81980ca070 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f819000c560 tx=0x7f8190007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.281+0000 7f817f7fe700 1 -- 172.21.15.84:0/3170174505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190001120 con 0x7f8198159480 2023-10-06T03:26:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.281+0000 7f817f7fe700 1 -- 172.21.15.84:0/3170174505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8190011590 con 0x7f8198159480 2023-10-06T03:26:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.281+0000 7f819cf8c700 1 -- 172.21.15.84:0/3170174505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81980cf450 con 0x7f8198159480 2023-10-06T03:26:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.281+0000 7f817f7fe700 1 -- 172.21.15.84:0/3170174505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190011950 con 0x7f8198159480 2023-10-06T03:26:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.281+0000 7f819cf8c700 1 -- 172.21.15.84:0/3170174505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81980d05d0 con 0x7f8198159480 2023-10-06T03:26:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.282+0000 7f819cf8c700 1 -- 172.21.15.84:0/3170174505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81980c7b40 con 0x7f8198159480 2023-10-06T03:26:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.282+0000 7f817f7fe700 1 -- 172.21.15.84:0/3170174505 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8190011d00 con 0x7f8198159480 2023-10-06T03:26:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.282+0000 7f817f7fe700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8184066f30 0x7f81840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.283+0000 7f81977fe700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8184066f30 0x7f81840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.283+0000 7f817f7fe700 1 -- 172.21.15.84:0/3170174505 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8190083920 con 0x7f8198159480 2023-10-06T03:26:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.283+0000 7f81977fe700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8184066f30 0x7f81840693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8188007620 tx=0x7f818800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.287+0000 7f817f7fe700 1 -- 172.21.15.84:0/3170174505 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81980c7b40 con 0x7f8198159480 2023-10-06T03:26:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.543+0000 7f819cf8c700 1 -- 172.21.15.84:0/3170174505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f81980c7b40 con 0x7f8198159480 2023-10-06T03:26:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.544+0000 7f817f7fe700 1 -- 172.21.15.84:0/3170174505 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f81980c7b40 con 0x7f8198159480 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lA8KvDxAA2irSaBc/QiMm9oI5GEK1PA==", 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:26:36.545 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lq2TnGhAAOzV6kE1Ji9yvQGuouda9GQ==", 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9l4w54FhAASOElKyXlWzXB7pDJV5TzVQ==", 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.547 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lh/61IRAANVLLVFSkTIhlvAyQkmkbqQ==", 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCVfR9lPd++MRAAikRAaM5HcwQgYYfszDoMzQ==", 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCYfR9l3ovfLxAAkuD96aBKGZX1SQvItQjbmA==", 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCbfR9lsbQpMBAApjEhKZ3RZXIXNFPmGrp3Rg==", 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.550 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCefR9lOhnPMRAAinzeYJrHzI3Laz+kRo7U9w==", 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCkfR9liYL2MhAAVzzPBy1+K4n9a324eCqKSg==", 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.551 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCnfR9lEe8GMBAAgXFWAPLix5BkHtrqQazDqA==", 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCqfR9lcprFMBAA4/ksqag9gsivr9htt3UDBg==", 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.553 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCtfR9leIi9MBAAaco3XMawt8uFNMNRbPQAQQ==", 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lGQaGJRAALZ28ylNKJSf4AhF9KcsrBg==", 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.554 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ls6nPLRAA/94kuDcXCPlYoYcCuqwN2A==", 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:26:36.555 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lY17ZKhAAyLFVSlBM5vWr4LSl+wwWZw==", 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.556 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lPWYyMxAAmgd5iQq7RQp80iK1oBfUww==", 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRfR9loncpLhAA2cZSGjrup5zj13Xtt9k6Xw==", 2023-10-06T03:26:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ltUixDBAAQN/x3iVJcTKF7hTMehPYgQ==", 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:26:36.558 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lFqqSBhAA1km5fSJT2+QAdMBBxBWrXQ==", 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:36.559 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T03:26:36.560 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:26:36.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.545+0000 7f819cf8c700 1 -- 172.21.15.84:0/3170174505 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8184066f30 msgr2=0x7f81840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.545+0000 7f819cf8c700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8184066f30 0x7f81840693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8188007620 tx=0x7f818800b040 comp rx=0 tx=0).stop 2023-10-06T03:26:36.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.546+0000 7f819cf8c700 1 -- 172.21.15.84:0/3170174505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8198159480 msgr2=0x7f81980ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.546+0000 7f819cf8c700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8198159480 0x7f81980ca070 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f819000c560 tx=0x7f8190007ef0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.546+0000 7f819cf8c700 1 -- 172.21.15.84:0/3170174505 shutdown_connections 2023-10-06T03:26:36.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.546+0000 7f819cf8c700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8184066f30 0x7f81840693e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.546+0000 7f819cf8c700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8198159480 0x7f81980ca070 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.546+0000 7f819cf8c700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81980b3610 0x7f81980d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.546+0000 7f819cf8c700 1 --2- 172.21.15.84:0/3170174505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81980cc1b0 0x7f81980c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.546+0000 7f819cf8c700 1 -- 172.21.15.84:0/3170174505 >> 172.21.15.84:0/3170174505 conn(0x7f819806ed20 msgr2=0x7f81980680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:36.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.546+0000 7f819cf8c700 1 -- 172.21.15.84:0/3170174505 shutdown_connections 2023-10-06T03:26:36.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.546+0000 7f819cf8c700 1 -- 172.21.15.84:0/3170174505 wait complete. 2023-10-06T03:26:36.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.677+0000 7f776729c700 1 Processor -- start 2023-10-06T03:26:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.677+0000 7f776729c700 1 -- start start 2023-10-06T03:26:36.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f776729c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77600b49e0 0x7f77600aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f776729c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77600b07a0 0x7f77600b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f776729c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77600b0ca0 con 0x7f77601595a0 2023-10-06T03:26:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f776729c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600b0f80 con 0x7f77600b07a0 2023-10-06T03:26:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f776729c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77600b1260 con 0x7f77600b49e0 2023-10-06T03:26:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f7765038700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f77601595a0 0x7f77600aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42972/0 (socket says 172.21.15.84:42972) 2023-10-06T03:26:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f7765839700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77600b07a0 0x7f77600b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f7765038700 1 -- 172.21.15.84:0/3474038978 learned_addr learned my addr 172.21.15.84:0/3474038978 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f7764837700 1 --2- 172.21.15.84:0/3474038978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77600b49e0 0x7f77600aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f7765839700 1 -- 172.21.15.84:0/3474038978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77600b49e0 msgr2=0x7f77600aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f7765839700 1 --2- 172.21.15.84:0/3474038978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77600b49e0 0x7f77600aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.678+0000 7f7765839700 1 -- 172.21.15.84:0/3474038978 >> v1:172.21.15.84:6789/0 conn(0x7f77601595a0 legacy=0x7f77600aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f7757fff700 1 -- 172.21.15.84:0/3474038978 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932194523 0 0) 0x7f77600b0ca0 con 0x7f77601595a0 2023-10-06T03:26:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f7765839700 1 -- 172.21.15.84:0/3474038978 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77600b1540 con 0x7f77600b07a0 2023-10-06T03:26:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f7765839700 1 --2- 172.21.15.84:0/3474038978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b07a0 0x7f77600b1c00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f77580098e0 tx=0x7f77580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c559d1a0023ed32c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f7757fff700 1 -- 172.21.15.84:0/3474038978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7758009e80 con 0x7f77600b07a0 2023-10-06T03:26:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f7757fff700 1 -- 172.21.15.84:0/3474038978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775800b860 con 0x7f77600b07a0 2023-10-06T03:26:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f7757fff700 1 -- 172.21.15.84:0/3474038978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775800bbe0 con 0x7f77600b07a0 2023-10-06T03:26:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f776729c700 1 -- 172.21.15.84:0/3474038978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b07a0 msgr2=0x7f77600b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f776729c700 1 --2- 172.21.15.84:0/3474038978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b07a0 0x7f77600b1c00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f77580098e0 tx=0x7f77580091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f776729c700 1 -- 172.21.15.84:0/3474038978 shutdown_connections 2023-10-06T03:26:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f776729c700 1 --2- 172.21.15.84:0/3474038978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b07a0 0x7f77600b1c00 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f776729c700 1 --2- 172.21.15.84:0/3474038978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77600b49e0 0x7f77600aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f776729c700 1 -- 172.21.15.84:0/3474038978 >> 172.21.15.84:0/3474038978 conn(0x7f7760099830 msgr2=0x7f776006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.679+0000 7f776729c700 1 -- 172.21.15.84:0/3474038978 shutdown_connections 2023-10-06T03:26:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.680+0000 7f776729c700 1 -- 172.21.15.84:0/3474038978 wait complete. 2023-10-06T03:26:36.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.681+0000 7f776729c700 1 Processor -- start 2023-10-06T03:26:36.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.681+0000 7f776729c700 1 -- start start 2023-10-06T03:26:36.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.681+0000 7f776729c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77600b07a0 0x7f776015b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.681+0000 7f776729c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b49e0 0x7f7760158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.681+0000 7f776729c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77601595a0 0x7f776015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.681+0000 7f776729c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600af1a0 con 0x7f77600b49e0 2023-10-06T03:26:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.681+0000 7f776729c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776015a330 con 0x7f77601595a0 2023-10-06T03:26:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.681+0000 7f776729c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776015ab70 con 0x7f77600b07a0 2023-10-06T03:26:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.681+0000 7f7764837700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b49e0 0x7f7760158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f7764837700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b49e0 0x7f7760158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39754/0 (socket says 172.21.15.84:39754) 2023-10-06T03:26:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f7764837700 1 -- 172.21.15.84:0/2675758503 learned_addr learned my addr 172.21.15.84:0/2675758503 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f7764837700 1 -- 172.21.15.84:0/2675758503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77600b07a0 msgr2=0x7f776015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f7764837700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77600b07a0 0x7f776015b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f7764837700 1 -- 172.21.15.84:0/2675758503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77601595a0 msgr2=0x7f776015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f7765839700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77601595a0 0x7f776015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f7764837700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77601595a0 0x7f776015cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f7764837700 1 -- 172.21.15.84:0/2675758503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7758009420 con 0x7f77600b49e0 2023-10-06T03:26:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f7764837700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b49e0 0x7f7760158af0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f775000d8c0 tx=0x7f7750008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f77557fa700 1 -- 172.21.15.84:0/2675758503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775000de60 con 0x7f77600b49e0 2023-10-06T03:26:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f77557fa700 1 -- 172.21.15.84:0/2675758503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775000b780 con 0x7f77600b49e0 2023-10-06T03:26:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f77557fa700 1 -- 172.21.15.84:0/2675758503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775000bb20 con 0x7f77600b49e0 2023-10-06T03:26:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f776729c700 1 -- 172.21.15.84:0/2675758503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776015d0c0 con 0x7f77600b49e0 2023-10-06T03:26:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.682+0000 7f776729c700 1 -- 172.21.15.84:0/2675758503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776015a520 con 0x7f77600b49e0 2023-10-06T03:26:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.683+0000 7f776729c700 1 -- 172.21.15.84:0/2675758503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7760064ad0 con 0x7f77600b49e0 2023-10-06T03:26:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.683+0000 7f77557fa700 1 -- 172.21.15.84:0/2675758503 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f775001e460 con 0x7f77600b49e0 2023-10-06T03:26:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.684+0000 7f77557fa700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7744066f30 0x7f77440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.684+0000 7f77557fa700 1 -- 172.21.15.84:0/2675758503 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7750084b80 con 0x7f77600b49e0 2023-10-06T03:26:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.684+0000 7f7765038700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7744066f30 0x7f77440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.684+0000 7f7765038700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7744066f30 0x7f77440693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f775c001d40 tx=0x7f775c007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.688+0000 7f77557fa700 1 -- 172.21.15.84:0/2675758503 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7750051ea0 con 0x7f77600b49e0 2023-10-06T03:26:36.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.869+0000 7f776729c700 1 -- 172.21.15.84:0/2675758503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f776015ace0 con 0x7f77600b49e0 2023-10-06T03:26:36.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.870+0000 7f77557fa700 1 -- 172.21.15.84:0/2675758503 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+13856 (secure 0 0 0) 0x7f77500554c0 con 0x7f77600b49e0 2023-10-06T03:26:36.872 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:36.872 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":82,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:36.133794+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:36.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 -- 172.21.15.84:0/2675758503 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7744066f30 msgr2=0x7f77440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7744066f30 0x7f77440693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f775c001d40 tx=0x7f775c007dc0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 -- 172.21.15.84:0/2675758503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b49e0 msgr2=0x7f7760158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:36.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b49e0 0x7f7760158af0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f775000d8c0 tx=0x7f7750008040 comp rx=0 tx=0).stop 2023-10-06T03:26:36.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 -- 172.21.15.84:0/2675758503 shutdown_connections 2023-10-06T03:26:36.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7744066f30 0x7f77440693e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77601595a0 0x7f776015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77600b07a0 0x7f776015b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 --2- 172.21.15.84:0/2675758503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77600b49e0 0x7f7760158af0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:36.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 -- 172.21.15.84:0/2675758503 >> 172.21.15.84:0/2675758503 conn(0x7f7760099830 msgr2=0x7f77600b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:36.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 -- 172.21.15.84:0/2675758503 shutdown_connections 2023-10-06T03:26:36.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:36.872+0000 7f776729c700 1 -- 172.21.15.84:0/2675758503 wait complete. 2023-10-06T03:26:36.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:26:36.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:26:37.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.002+0000 7faae806f700 1 Processor -- start 2023-10-06T03:26:37.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.002+0000 7faae806f700 1 -- start start 2023-10-06T03:26:37.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae806f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faae0159510 0x7faae00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae806f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faae00cbae0 0x7faae00cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae806f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae00cbf00 con 0x7faae01598e0 2023-10-06T03:26:37.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae806f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae00cf610 con 0x7faae00cbae0 2023-10-06T03:26:37.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae806f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae00cf8f0 con 0x7faae0159510 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae660c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faae00cbae0 0x7faae00cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae660c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faae00cbae0 0x7faae00cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39766/0 (socket says 172.21.15.84:39766) 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae660c700 1 -- 172.21.15.84:0/193889007 learned_addr learned my addr 172.21.15.84:0/193889007 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae5e0b700 1 --2- 172.21.15.84:0/193889007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faae0159510 0x7faae00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae660c700 1 -- 172.21.15.84:0/193889007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faae0159510 msgr2=0x7faae00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae660c700 1 --2- 172.21.15.84:0/193889007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faae0159510 0x7faae00cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae660c700 1 -- 172.21.15.84:0/193889007 >> v1:172.21.15.131:6789/0 conn(0x7faae01598e0 legacy=0x7faae00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.003+0000 7faae660c700 1 -- 172.21.15.84:0/193889007 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00cfbd0 con 0x7faae00cbae0 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae660c700 1 --2- 172.21.15.84:0/193889007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00cbae0 0x7faae00cef30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7faad80099b0 tx=0x7faad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d031beeaa3169554 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae4e09700 1 -- 172.21.15.84:0/193889007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad800b860 con 0x7faae00cbae0 2023-10-06T03:26:37.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae4e09700 1 -- 172.21.15.84:0/193889007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad800b9c0 con 0x7faae00cbae0 2023-10-06T03:26:37.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae4e09700 1 -- 172.21.15.84:0/193889007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad800bd60 con 0x7faae00cbae0 2023-10-06T03:26:37.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae806f700 1 -- 172.21.15.84:0/193889007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00cbae0 msgr2=0x7faae00cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae806f700 1 --2- 172.21.15.84:0/193889007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00cbae0 0x7faae00cef30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7faad80099b0 tx=0x7faad8009250 comp rx=0 tx=0).stop 2023-10-06T03:26:37.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae806f700 1 -- 172.21.15.84:0/193889007 shutdown_connections 2023-10-06T03:26:37.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae806f700 1 --2- 172.21.15.84:0/193889007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00cbae0 0x7faae00cef30 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae806f700 1 --2- 172.21.15.84:0/193889007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faae0159510 0x7faae00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae806f700 1 -- 172.21.15.84:0/193889007 >> 172.21.15.84:0/193889007 conn(0x7faae0089e90 msgr2=0x7faae00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:37.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae806f700 1 -- 172.21.15.84:0/193889007 shutdown_connections 2023-10-06T03:26:37.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.004+0000 7faae806f700 1 -- 172.21.15.84:0/193889007 wait complete. 2023-10-06T03:26:37.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.005+0000 7faae806f700 1 Processor -- start 2023-10-06T03:26:37.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.005+0000 7faae806f700 1 -- start start 2023-10-06T03:26:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae806f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faae00cbae0 0x7faae0149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae806f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faae0159510 0x7faae015ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae806f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae01598e0 0x7faae00c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae806f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae015bb20 con 0x7faae01598e0 2023-10-06T03:26:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae806f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae015be00 con 0x7faae0159510 2023-10-06T03:26:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae806f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae015c0e0 con 0x7faae00cbae0 2023-10-06T03:26:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae660c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae01598e0 0x7faae00c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae660c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae01598e0 0x7faae00c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39776/0 (socket says 172.21.15.84:39776) 2023-10-06T03:26:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae660c700 1 -- 172.21.15.84:0/354844658 learned_addr learned my addr 172.21.15.84:0/354844658 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae560a700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faae0159510 0x7faae015ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.006+0000 7faae5e0b700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faae00cbae0 0x7faae0149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faae660c700 1 -- 172.21.15.84:0/354844658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faae00cbae0 msgr2=0x7faae0149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faae660c700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faae00cbae0 0x7faae0149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faae660c700 1 -- 172.21.15.84:0/354844658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faae0159510 msgr2=0x7faae015ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faae660c700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faae0159510 0x7faae015ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faae660c700 1 -- 172.21.15.84:0/354844658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80094f0 con 0x7faae01598e0 2023-10-06T03:26:37.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faae660c700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae01598e0 0x7faae00c5ea0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7faae0067c60 tx=0x7faad8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faad5ffb700 1 -- 172.21.15.84:0/354844658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad800b860 con 0x7faae01598e0 2023-10-06T03:26:37.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faad5ffb700 1 -- 172.21.15.84:0/354844658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad801a630 con 0x7faae01598e0 2023-10-06T03:26:37.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faae806f700 1 -- 172.21.15.84:0/354844658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae015c3c0 con 0x7faae01598e0 2023-10-06T03:26:37.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faad5ffb700 1 -- 172.21.15.84:0/354844658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad801aa10 con 0x7faae01598e0 2023-10-06T03:26:37.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.007+0000 7faae806f700 1 -- 172.21.15.84:0/354844658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae014a4b0 con 0x7faae01598e0 2023-10-06T03:26:37.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.008+0000 7faae806f700 1 -- 172.21.15.84:0/354844658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae015c8e0 con 0x7faae01598e0 2023-10-06T03:26:37.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.009+0000 7faad5ffb700 1 -- 172.21.15.84:0/354844658 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faad802d440 con 0x7faae01598e0 2023-10-06T03:26:37.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.009+0000 7faad5ffb700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac4066f30 0x7faac40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.009+0000 7faad5ffb700 1 -- 172.21.15.84:0/354844658 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5526+0+0 (secure 0 0 0) 0x7faad8085fe0 con 0x7faae01598e0 2023-10-06T03:26:37.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.009+0000 7faae5e0b700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac4066f30 0x7faac40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.009+0000 7faae5e0b700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac4066f30 0x7faac40693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faadc009fd0 tx=0x7faadc009880 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.013+0000 7faad5ffb700 1 -- 172.21.15.84:0/354844658 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faae015c8e0 con 0x7faae01598e0 2023-10-06T03:26:37.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.198+0000 7faae806f700 1 -- 172.21.15.84:0/354844658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faae015c8e0 con 0x7faae01598e0 2023-10-06T03:26:37.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.198+0000 7faad5ffb700 1 -- 172.21.15.84:0/354844658 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v82) v1 ==== 92+0+10 (secure 0 0 0) 0x7faae015c8e0 con 0x7faae01598e0 2023-10-06T03:26:37.200 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:26:37.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.200+0000 7faae806f700 1 -- 172.21.15.84:0/354844658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac4066f30 msgr2=0x7faac40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.200+0000 7faae806f700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac4066f30 0x7faac40693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faadc009fd0 tx=0x7faadc009880 comp rx=0 tx=0).stop 2023-10-06T03:26:37.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.200+0000 7faae806f700 1 -- 172.21.15.84:0/354844658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae01598e0 msgr2=0x7faae00c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.200+0000 7faae806f700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae01598e0 0x7faae00c5ea0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7faae0067c60 tx=0x7faad8017000 comp rx=0 tx=0).stop 2023-10-06T03:26:37.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.200+0000 7faae806f700 1 -- 172.21.15.84:0/354844658 shutdown_connections 2023-10-06T03:26:37.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.200+0000 7faae806f700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac4066f30 0x7faac40693e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.200+0000 7faae806f700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae01598e0 0x7faae00c5ea0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.200+0000 7faae806f700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faae00cbae0 0x7faae0149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.200+0000 7faae806f700 1 --2- 172.21.15.84:0/354844658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faae0159510 0x7faae015ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.201+0000 7faae806f700 1 -- 172.21.15.84:0/354844658 >> 172.21.15.84:0/354844658 conn(0x7faae0089e90 msgr2=0x7faae014af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:37.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.201+0000 7faae806f700 1 -- 172.21.15.84:0/354844658 shutdown_connections 2023-10-06T03:26:37.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.201+0000 7faae806f700 1 -- 172.21.15.84:0/354844658 wait complete. 2023-10-06T03:26:37.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:26:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.329+0000 7f26504cf700 1 Processor -- start 2023-10-06T03:26:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.329+0000 7f26504cf700 1 -- start start 2023-10-06T03:26:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.330+0000 7f26504cf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2648159510 0x7f26480cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.330+0000 7f26504cf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26481598e0 0x7f26480cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.330+0000 7f26504cf700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26480cf350 con 0x7f26480ce820 2023-10-06T03:26:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.330+0000 7f26504cf700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26480cf610 con 0x7f26481598e0 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.330+0000 7f26504cf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26480cf8f0 con 0x7f2648159510 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.330+0000 7f264da6a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26481598e0 0x7f26480cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.330+0000 7f264ea6c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26480ce820 0x7f26480cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42978/0 (socket says 172.21.15.84:42978) 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.330+0000 7f264da6a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26481598e0 0x7f26480cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39780/0 (socket says 172.21.15.84:39780) 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.330+0000 7f264ea6c700 1 -- 172.21.15.84:0/1067869195 learned_addr learned my addr 172.21.15.84:0/1067869195 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.330+0000 7f264e26b700 1 --2- 172.21.15.84:0/1067869195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2648159510 0x7f26480cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f264da6a700 1 -- 172.21.15.84:0/1067869195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2648159510 msgr2=0x7f26480cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f264da6a700 1 --2- 172.21.15.84:0/1067869195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2648159510 0x7f26480cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f264da6a700 1 -- 172.21.15.84:0/1067869195 >> v1:172.21.15.84:6789/0 conn(0x7f26480ce820 legacy=0x7f26480cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f264da6a700 1 -- 172.21.15.84:0/1067869195 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480cfbd0 con 0x7f26481598e0 2023-10-06T03:26:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f264e26b700 1 --2- 172.21.15.84:0/1067869195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2648159510 0x7f26480cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f264d269700 1 -- 172.21.15.84:0/1067869195 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550314297 0 0) 0x7f26480cf350 con 0x7f26480ce820 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f264da6a700 1 --2- 172.21.15.84:0/1067869195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26481598e0 0x7f26480cbae0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f263c0098e0 tx=0x7f263c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2403e816e8e5423e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f264d269700 1 -- 172.21.15.84:0/1067869195 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c009e80 con 0x7f26481598e0 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f264d269700 1 -- 172.21.15.84:0/1067869195 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c00b860 con 0x7f26481598e0 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f264d269700 1 -- 172.21.15.84:0/1067869195 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c00bbe0 con 0x7f26481598e0 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f26504cf700 1 -- 172.21.15.84:0/1067869195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26481598e0 msgr2=0x7f26480cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f26504cf700 1 --2- 172.21.15.84:0/1067869195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26481598e0 0x7f26480cbae0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f263c0098e0 tx=0x7f263c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f26504cf700 1 -- 172.21.15.84:0/1067869195 shutdown_connections 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f26504cf700 1 --2- 172.21.15.84:0/1067869195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2648159510 0x7f26480cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f26504cf700 1 --2- 172.21.15.84:0/1067869195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26481598e0 0x7f26480cbae0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f26504cf700 1 -- 172.21.15.84:0/1067869195 >> 172.21.15.84:0/1067869195 conn(0x7f2648089e90 msgr2=0x7f26480997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f26504cf700 1 -- 172.21.15.84:0/1067869195 shutdown_connections 2023-10-06T03:26:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.331+0000 7f26504cf700 1 -- 172.21.15.84:0/1067869195 wait complete. 2023-10-06T03:26:37.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f26504cf700 1 Processor -- start 2023-10-06T03:26:37.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f26504cf700 1 -- start start 2023-10-06T03:26:37.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f26504cf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26480ce820 0x7f264816b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f26504cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2648159510 0x7f264814a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f26504cf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26481598e0 0x7f264814aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f26504cf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26481580c0 con 0x7f2648159510 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f26504cf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264816ada0 con 0x7f26480ce820 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f26504cf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264816b080 con 0x7f26481598e0 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f264da6a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2648159510 0x7f264814a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f264da6a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2648159510 0x7f264814a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39792/0 (socket says 172.21.15.84:39792) 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.333+0000 7f264da6a700 1 -- 172.21.15.84:0/3519543428 learned_addr learned my addr 172.21.15.84:0/3519543428 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f264ea6c700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26481598e0 0x7f264814aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f264e26b700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26480ce820 0x7f264816b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f264da6a700 1 -- 172.21.15.84:0/3519543428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26481598e0 msgr2=0x7f264814aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f264da6a700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26481598e0 0x7f264814aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f264da6a700 1 -- 172.21.15.84:0/3519543428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26480ce820 msgr2=0x7f264816b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f264da6a700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26480ce820 0x7f264816b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f264da6a700 1 -- 172.21.15.84:0/3519543428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c009420 con 0x7f2648159510 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f264da6a700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2648159510 0x7f264814a990 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f263c013000 tx=0x7f263c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f26467fc700 1 -- 172.21.15.84:0/3519543428 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c00bbe0 con 0x7f2648159510 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f26467fc700 1 -- 172.21.15.84:0/3519543428 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c011420 con 0x7f2648159510 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f26504cf700 1 -- 172.21.15.84:0/3519543428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2648159d00 con 0x7f2648159510 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f26467fc700 1 -- 172.21.15.84:0/3519543428 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c0117e0 con 0x7f2648159510 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.334+0000 7f26504cf700 1 -- 172.21.15.84:0/3519543428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264815a2c0 con 0x7f2648159510 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.335+0000 7f26504cf700 1 -- 172.21.15.84:0/3519543428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26480cf320 con 0x7f2648159510 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.335+0000 7f26467fc700 1 -- 172.21.15.84:0/3519543428 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f263c011bd0 con 0x7f2648159510 2023-10-06T03:26:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.336+0000 7f26467fc700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.336+0000 7f264e26b700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.336+0000 7f26467fc700 1 -- 172.21.15.84:0/3519543428 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f263c085f00 con 0x7f2648159510 2023-10-06T03:26:37.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.336+0000 7f264e26b700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2634066f30 0x7f26340693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f264814b6a0 tx=0x7f2638007710 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.340+0000 7f26467fc700 1 -- 172.21.15.84:0/3519543428 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f263c053220 con 0x7f2648159510 2023-10-06T03:26:37.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.521+0000 7f26504cf700 1 -- 172.21.15.84:0/3519543428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f264806f770 con 0x7f2648159510 2023-10-06T03:26:37.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.521+0000 7f26467fc700 1 -- 172.21.15.84:0/3519543428 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f263c056840 con 0x7f2648159510 2023-10-06T03:26:37.523 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:26:37.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 -- 172.21.15.84:0/3519543428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2634066f30 msgr2=0x7f26340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2634066f30 0x7f26340693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f264814b6a0 tx=0x7f2638007710 comp rx=0 tx=0).stop 2023-10-06T03:26:37.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 -- 172.21.15.84:0/3519543428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2648159510 msgr2=0x7f264814a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2648159510 0x7f264814a990 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f263c013000 tx=0x7f263c017000 comp rx=0 tx=0).stop 2023-10-06T03:26:37.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 -- 172.21.15.84:0/3519543428 shutdown_connections 2023-10-06T03:26:37.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26480ce820 0x7f264816b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26481598e0 0x7f264814aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 --2- 172.21.15.84:0/3519543428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2648159510 0x7f264814a990 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 -- 172.21.15.84:0/3519543428 >> 172.21.15.84:0/3519543428 conn(0x7f2648089e90 msgr2=0x7f26480cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:37.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 -- 172.21.15.84:0/3519543428 shutdown_connections 2023-10-06T03:26:37.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.523+0000 7f26504cf700 1 -- 172.21.15.84:0/3519543428 wait complete. 2023-10-06T03:26:37.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:26:37.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.651+0000 7fa4a5d5c700 1 Processor -- start 2023-10-06T03:26:37.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.651+0000 7fa4a5d5c700 1 -- start start 2023-10-06T03:26:37.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a5d5c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa4a0159480 0x7fa4a00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a5d5c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4a00b3610 0x7fa4a00cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a5d5c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4a00cc1b0 0x7fa4a00b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a5d5c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00cb7e0 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a5d5c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00b08a0 con 0x7fa4a0159480 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a5d5c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00cb190 con 0x7fa4a00b3610 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a555b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4a00cc1b0 0x7fa4a00b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a555b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4a00cc1b0 0x7fa4a00b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39806/0 (socket says 172.21.15.84:39806) 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a555b700 1 -- 172.21.15.84:0/3641218545 learned_addr learned my addr 172.21.15.84:0/3641218545 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa49ffff700 1 --2- 172.21.15.84:0/3641218545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4a00b3610 0x7fa4a00cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a4d5a700 1 --2- 172.21.15.84:0/3641218545 >> v2:172.21.15.131:3300/0 conn(0x7fa4a0159480 0x7fa4a00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a555b700 1 -- 172.21.15.84:0/3641218545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4a00b3610 msgr2=0x7fa4a00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a555b700 1 --2- 172.21.15.84:0/3641218545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4a00b3610 0x7fa4a00cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a555b700 1 -- 172.21.15.84:0/3641218545 >> v2:172.21.15.131:3300/0 conn(0x7fa4a0159480 msgr2=0x7fa4a00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a555b700 1 --2- 172.21.15.84:0/3641218545 >> v2:172.21.15.131:3300/0 conn(0x7fa4a0159480 0x7fa4a00b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a555b700 1 -- 172.21.15.84:0/3641218545 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a00cb470 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a4d5a700 1 --2- 172.21.15.84:0/3641218545 >> v2:172.21.15.131:3300/0 conn(0x7fa4a0159480 0x7fa4a00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.652+0000 7fa4a555b700 1 --2- 172.21.15.84:0/3641218545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 0x7fa4a00b2140 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa4a006fa30 tx=0x7fa498009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab92132f5821566 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa49f7fe700 1 -- 172.21.15.84:0/3641218545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498009e70 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa49f7fe700 1 -- 172.21.15.84:0/3641218545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49800b860 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa49f7fe700 1 -- 172.21.15.84:0/3641218545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49800bc00 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3641218545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 msgr2=0x7fa4a00b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa4a5d5c700 1 --2- 172.21.15.84:0/3641218545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 0x7fa4a00b2140 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa4a006fa30 tx=0x7fa498009250 comp rx=0 tx=0).stop 2023-10-06T03:26:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3641218545 shutdown_connections 2023-10-06T03:26:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa4a5d5c700 1 --2- 172.21.15.84:0/3641218545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 0x7fa4a00b2140 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa4a5d5c700 1 --2- 172.21.15.84:0/3641218545 >> v2:172.21.15.131:3300/0 conn(0x7fa4a0159480 0x7fa4a00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa4a5d5c700 1 --2- 172.21.15.84:0/3641218545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4a00b3610 0x7fa4a00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3641218545 >> 172.21.15.84:0/3641218545 conn(0x7fa4a006ed20 msgr2=0x7fa4a006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3641218545 shutdown_connections 2023-10-06T03:26:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.653+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3641218545 wait complete. 2023-10-06T03:26:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.654+0000 7fa4a5d5c700 1 Processor -- start 2023-10-06T03:26:37.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.654+0000 7fa4a5d5c700 1 -- start start 2023-10-06T03:26:37.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa4a5d5c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4a00b3610 0x7fa4a015df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa4a5d5c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 0x7fa4a015e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa4a5d5c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a0159480 0x7fa4a0168e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa4a5d5c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a015fbc0 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa4a5d5c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a015efb0 con 0x7fa4a0159480 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa4a5d5c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a015f290 con 0x7fa4a00b3610 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa49ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 0x7fa4a015e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa49ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 0x7fa4a015e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39820/0 (socket says 172.21.15.84:39820) 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa49ffff700 1 -- 172.21.15.84:0/3886926565 learned_addr learned my addr 172.21.15.84:0/3886926565 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa4a4d5a700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4a00b3610 0x7fa4a015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.655+0000 7fa4a555b700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a0159480 0x7fa4a0168e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa49ffff700 1 -- 172.21.15.84:0/3886926565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4a00b3610 msgr2=0x7fa4a015df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa49ffff700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4a00b3610 0x7fa4a015df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa49ffff700 1 -- 172.21.15.84:0/3886926565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a0159480 msgr2=0x7fa4a0168e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa49ffff700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a0159480 0x7fa4a0168e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa49ffff700 1 -- 172.21.15.84:0/3886926565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4980094f0 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa49ffff700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 0x7fa4a015e760 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa488009ef0 tx=0x7fa48800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa49cff9700 1 -- 172.21.15.84:0/3886926565 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48800cb70 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa49cff9700 1 -- 172.21.15.84:0/3886926565 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48800f040 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa49cff9700 1 -- 172.21.15.84:0/3886926565 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488014480 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3886926565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a015f570 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.656+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3886926565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a015eca0 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.657+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3886926565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a005f270 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.657+0000 7fa49cff9700 1 -- 172.21.15.84:0/3886926565 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4880147f0 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.658+0000 7fa49cff9700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa480066f30 0x7fa4800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.658+0000 7fa49cff9700 1 -- 172.21.15.84:0/3886926565 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fa488084e00 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.658+0000 7fa4a4d5a700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa480066f30 0x7fa4800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.658+0000 7fa4a4d5a700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa480066f30 0x7fa4800693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa490006f00 tx=0x7fa490008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.662+0000 7fa49cff9700 1 -- 172.21.15.84:0/3886926565 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa488052120 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.847+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3886926565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa4a0159850 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.847+0000 7fa49cff9700 1 -- 172.21.15.84:0/3886926565 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa488055740 con 0x7fa4a00cc1b0 2023-10-06T03:26:37.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:37.849 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T03:26:37.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:37.849 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T03:26:37.850 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T03:26:37.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:26:37.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:26:37.850 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T03:26:37.850 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T03:26:37.850 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:26:37.850 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T03:26:37.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3886926565 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa480066f30 msgr2=0x7fa4800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa480066f30 0x7fa4800693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa490006f00 tx=0x7fa490008040 comp rx=0 tx=0).stop 2023-10-06T03:26:37.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3886926565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 msgr2=0x7fa4a015e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 0x7fa4a015e760 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa488009ef0 tx=0x7fa48800b040 comp rx=0 tx=0).stop 2023-10-06T03:26:37.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3886926565 shutdown_connections 2023-10-06T03:26:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa480066f30 0x7fa4800693e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a0159480 0x7fa4a0168e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4a00b3610 0x7fa4a015df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 --2- 172.21.15.84:0/3886926565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a00cc1b0 0x7fa4a015e760 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3886926565 >> 172.21.15.84:0/3886926565 conn(0x7fa4a006ed20 msgr2=0x7fa4a0157130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3886926565 shutdown_connections 2023-10-06T03:26:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.849+0000 7fa4a5d5c700 1 -- 172.21.15.84:0/3886926565 wait complete. 2023-10-06T03:26:37.862 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:26:37.863 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:26:37.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.978+0000 7fcf235bf700 1 Processor -- start 2023-10-06T03:26:37.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.978+0000 7fcf235bf700 1 -- start start 2023-10-06T03:26:37.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.979+0000 7fcf235bf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c0b23a0 0x7fcf1c0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.979+0000 7fcf235bf700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcf1c0aee20 0x7fcf1c0af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.979+0000 7fcf235bf700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0b2810 con 0x7fcf1c06ed20 2023-10-06T03:26:37.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.979+0000 7fcf235bf700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c06fb80 con 0x7fcf1c0aee20 2023-10-06T03:26:37.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.979+0000 7fcf235bf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0b2d20 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.979+0000 7fcf2135b700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fcf1c06ed20 0x7fcf1c06f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:37780/0 (socket says 172.21.15.84:37780) 2023-10-06T03:26:37.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.979+0000 7fcf2135b700 1 -- 172.21.15.84:0/3315679038 learned_addr learned my addr 172.21.15.84:0/3315679038 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:37.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.979+0000 7fcf21b5c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcf1c0aee20 0x7fcf1c0af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.979+0000 7fcf20b5a700 1 --2- 172.21.15.84:0/3315679038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c0b23a0 0x7fcf1c0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf1bfff700 1 -- 172.21.15.84:0/3315679038 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465728121 0 0) 0x7fcf1c0b2810 con 0x7fcf1c06ed20 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf1bfff700 1 -- 172.21.15.84:0/3315679038 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf04003570 con 0x7fcf1c06ed20 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf20b5a700 1 -- 172.21.15.84:0/3315679038 >> v2:172.21.15.131:3300/0 conn(0x7fcf1c0aee20 msgr2=0x7fcf1c0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf20b5a700 1 --2- 172.21.15.84:0/3315679038 >> v2:172.21.15.131:3300/0 conn(0x7fcf1c0aee20 0x7fcf1c0af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf20b5a700 1 -- 172.21.15.84:0/3315679038 >> v1:172.21.15.131:6789/0 conn(0x7fcf1c06ed20 legacy=0x7fcf1c06f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf20b5a700 1 -- 172.21.15.84:0/3315679038 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0b0450 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf21b5c700 1 --2- 172.21.15.84:0/3315679038 >> v2:172.21.15.131:3300/0 conn(0x7fcf1c0aee20 0x7fcf1c0af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf20b5a700 1 --2- 172.21.15.84:0/3315679038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c0b23a0 0x7fcf1c0b08e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098e0 tx=0x7fcf100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8132b1cfc9a6e48c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf1bfff700 1 -- 172.21.15.84:0/3315679038 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10011630 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf1bfff700 1 -- 172.21.15.84:0/3315679038 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10011790 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.980+0000 7fcf1bfff700 1 -- 172.21.15.84:0/3315679038 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10011b10 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.981+0000 7fcf235bf700 1 -- 172.21.15.84:0/3315679038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c0b23a0 msgr2=0x7fcf1c0b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.981+0000 7fcf235bf700 1 --2- 172.21.15.84:0/3315679038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c0b23a0 0x7fcf1c0b08e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098e0 tx=0x7fcf100091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.981+0000 7fcf235bf700 1 -- 172.21.15.84:0/3315679038 shutdown_connections 2023-10-06T03:26:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.981+0000 7fcf235bf700 1 --2- 172.21.15.84:0/3315679038 >> v2:172.21.15.131:3300/0 conn(0x7fcf1c0aee20 0x7fcf1c0af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.981+0000 7fcf235bf700 1 --2- 172.21.15.84:0/3315679038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c0b23a0 0x7fcf1c0b08e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.981+0000 7fcf235bf700 1 -- 172.21.15.84:0/3315679038 >> 172.21.15.84:0/3315679038 conn(0x7fcf1c068330 msgr2=0x7fcf1c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.981+0000 7fcf235bf700 1 -- 172.21.15.84:0/3315679038 shutdown_connections 2023-10-06T03:26:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.981+0000 7fcf235bf700 1 -- 172.21.15.84:0/3315679038 wait complete. 2023-10-06T03:26:37.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.982+0000 7fcf235bf700 1 Processor -- start 2023-10-06T03:26:37.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.982+0000 7fcf235bf700 1 -- start start 2023-10-06T03:26:37.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf235bf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c06ed20 0x7fcf1c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf235bf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0aee20 0x7fcf1c155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf235bf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c0b23a0 0x7fcf1c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf235bf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c16a4e0 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf235bf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c16a7c0 con 0x7fcf1c0aee20 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf235bf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c16aaa0 con 0x7fcf1c06ed20 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf21b5c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c0b23a0 0x7fcf1c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf21b5c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c0b23a0 0x7fcf1c15b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39828/0 (socket says 172.21.15.84:39828) 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf21b5c700 1 -- 172.21.15.84:0/492182413 learned_addr learned my addr 172.21.15.84:0/492182413 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf2135b700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c06ed20 0x7fcf1c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf20b5a700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0aee20 0x7fcf1c155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf21b5c700 1 -- 172.21.15.84:0/492182413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c06ed20 msgr2=0x7fcf1c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf21b5c700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c06ed20 0x7fcf1c1550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf21b5c700 1 -- 172.21.15.84:0/492182413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0aee20 msgr2=0x7fcf1c155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf21b5c700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0aee20 0x7fcf1c155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf21b5c700 1 -- 172.21.15.84:0/492182413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009420 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf20b5a700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0aee20 0x7fcf1c155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf21b5c700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c0b23a0 0x7fcf1c15b300 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400ec80 tx=0x7fcf140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf197fa700 1 -- 172.21.15.84:0/492182413 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400c850 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.983+0000 7fcf197fa700 1 -- 172.21.15.84:0/492182413 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1400c9b0 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.984+0000 7fcf235bf700 1 -- 172.21.15.84:0/492182413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf10009420 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.984+0000 7fcf197fa700 1 -- 172.21.15.84:0/492182413 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400cd70 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.984+0000 7fcf235bf700 1 -- 172.21.15.84:0/492182413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c16b060 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.984+0000 7fcf235bf700 1 -- 172.21.15.84:0/492182413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c064ad0 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.985+0000 7fcf197fa700 1 -- 172.21.15.84:0/492182413 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf14013680 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.985+0000 7fcf197fa700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf08066f30 0x7fcf080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.985+0000 7fcf2135b700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf08066f30 0x7fcf080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.985+0000 7fcf197fa700 1 -- 172.21.15.84:0/492182413 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fcf14084540 con 0x7fcf1c0b23a0 2023-10-06T03:26:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.986+0000 7fcf2135b700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf08066f30 0x7fcf080693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c002250 tx=0x7fcf0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:37.990+0000 7fcf197fa700 1 -- 172.21.15.84:0/492182413 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf14051860 con 0x7fcf1c0b23a0 2023-10-06T03:26:38.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:38.174+0000 7fcf235bf700 1 -- 172.21.15.84:0/492182413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcf1c04bb80 con 0x7fcf1c0b23a0 2023-10-06T03:26:39.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.142+0000 7fcf197fa700 1 -- 172.21.15.84:0/492182413 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcf14054e80 con 0x7fcf1c0b23a0 2023-10-06T03:26:39.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 -- 172.21.15.84:0/492182413 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf08066f30 msgr2=0x7fcf080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf08066f30 0x7fcf080693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c002250 tx=0x7fcf0c009040 comp rx=0 tx=0).stop 2023-10-06T03:26:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 -- 172.21.15.84:0/492182413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c0b23a0 msgr2=0x7fcf1c15b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c0b23a0 0x7fcf1c15b300 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400ec80 tx=0x7fcf140091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 -- 172.21.15.84:0/492182413 shutdown_connections 2023-10-06T03:26:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcf08066f30 0x7fcf080693e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf1c0b23a0 0x7fcf1c15b300 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf1c06ed20 0x7fcf1c1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 --2- 172.21.15.84:0/492182413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf1c0aee20 0x7fcf1c155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 -- 172.21.15.84:0/492182413 >> 172.21.15.84:0/492182413 conn(0x7fcf1c068330 msgr2=0x7fcf1c0b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 -- 172.21.15.84:0/492182413 shutdown_connections 2023-10-06T03:26:39.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.145+0000 7fcf235bf700 1 -- 172.21.15.84:0/492182413 wait complete. 2023-10-06T03:26:39.152 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T03:26:39.162 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:26:39.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.280+0000 7f6ea14a9700 1 Processor -- start 2023-10-06T03:26:39.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.280+0000 7f6ea14a9700 1 -- start start 2023-10-06T03:26:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.281+0000 7f6ea14a9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6e9c0b2660 0x7f6e9c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.281+0000 7f6ea14a9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0b2a30 0x7f6e9c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.281+0000 7f6ea14a9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c0cc9b0 con 0x7f6e9c0ceae0 2023-10-06T03:26:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.281+0000 7f6ea14a9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c0cbda0 con 0x7f6e9c0b2660 2023-10-06T03:26:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.281+0000 7f6ea14a9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0cc080 con 0x7f6e9c0b2a30 2023-10-06T03:26:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.281+0000 7f6e9bfff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6e9c0b2660 0x7f6e9c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.281+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0b2a30 0x7f6e9c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.281+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0b2a30 0x7f6e9c0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:56828/0 (socket says 172.21.15.84:56828) 2023-10-06T03:26:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.281+0000 7f6e9b7fe700 1 -- 172.21.15.84:0/3161398612 learned_addr learned my addr 172.21.15.84:0/3161398612 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9affd700 1 -- 172.21.15.84:0/3161398612 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427055787 0 0) 0x7f6e9c0cc9b0 con 0x7f6e9c0ceae0 2023-10-06T03:26:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9affd700 1 -- 172.21.15.84:0/3161398612 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e84003570 con 0x7f6e9c0ceae0 2023-10-06T03:26:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9b7fe700 1 -- 172.21.15.84:0/3161398612 >> v2:172.21.15.131:3300/0 conn(0x7f6e9c0b2660 msgr2=0x7f6e9c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9b7fe700 1 --2- 172.21.15.84:0/3161398612 >> v2:172.21.15.131:3300/0 conn(0x7f6e9c0b2660 0x7f6e9c0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9b7fe700 1 -- 172.21.15.84:0/3161398612 >> v1:172.21.15.131:6789/0 conn(0x7f6e9c0ceae0 legacy=0x7f6e9c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9b7fe700 1 -- 172.21.15.84:0/3161398612 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c0cc360 con 0x7f6e9c0b2a30 2023-10-06T03:26:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9bfff700 1 --2- 172.21.15.84:0/3161398612 >> v2:172.21.15.131:3300/0 conn(0x7f6e9c0b2660 0x7f6e9c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9b7fe700 1 --2- 172.21.15.84:0/3161398612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0b2a30 0x7f6e9c0cd230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6e900099b0 tx=0x7f6e90009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ba9661d2e3a01a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9affd700 1 -- 172.21.15.84:0/3161398612 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000b680 con 0x7f6e9c0b2a30 2023-10-06T03:26:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9affd700 1 -- 172.21.15.84:0/3161398612 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9000b7e0 con 0x7f6e9c0b2a30 2023-10-06T03:26:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.282+0000 7f6e9affd700 1 -- 172.21.15.84:0/3161398612 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000bb60 con 0x7f6e9c0b2a30 2023-10-06T03:26:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.283+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3161398612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0b2a30 msgr2=0x7f6e9c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.283+0000 7f6ea14a9700 1 --2- 172.21.15.84:0/3161398612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0b2a30 0x7f6e9c0cd230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6e900099b0 tx=0x7f6e90009250 comp rx=0 tx=0).stop 2023-10-06T03:26:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.283+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3161398612 shutdown_connections 2023-10-06T03:26:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.283+0000 7f6ea14a9700 1 --2- 172.21.15.84:0/3161398612 >> v2:172.21.15.131:3300/0 conn(0x7f6e9c0b2660 0x7f6e9c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.283+0000 7f6ea14a9700 1 --2- 172.21.15.84:0/3161398612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0b2a30 0x7f6e9c0cd230 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.283+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3161398612 >> 172.21.15.84:0/3161398612 conn(0x7f6e9c099560 msgr2=0x7f6e9c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.283+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3161398612 shutdown_connections 2023-10-06T03:26:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.283+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3161398612 wait complete. 2023-10-06T03:26:39.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.284+0000 7f6ea14a9700 1 Processor -- start 2023-10-06T03:26:39.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.284+0000 7f6ea14a9700 1 -- start start 2023-10-06T03:26:39.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6ea14a9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e9c0b2660 0x7f6e9c0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:39.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6ea14a9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e9c0b2a30 0x7f6e9c150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:39.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6ea14a9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0ceae0 0x7f6e9c0c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:39.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6ea14a9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c14e1a0 con 0x7f6e9c0b2660 2023-10-06T03:26:39.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6ea14a9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c14fea0 con 0x7f6e9c0b2a30 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6ea14a9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0ca6a0 con 0x7f6e9c0ceae0 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e9bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e9c0b2660 0x7f6e9c0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e9bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e9c0b2660 0x7f6e9c0ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39838/0 (socket says 172.21.15.84:39838) 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e9bfff700 1 -- 172.21.15.84:0/3259780502 learned_addr learned my addr 172.21.15.84:0/3259780502 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e9b7fe700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e9c0b2a30 0x7f6e9c150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6ea0ca8700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0ceae0 0x7f6e9c0c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e9bfff700 1 -- 172.21.15.84:0/3259780502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0ceae0 msgr2=0x7f6e9c0c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e9bfff700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0ceae0 0x7f6e9c0c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e9bfff700 1 -- 172.21.15.84:0/3259780502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e9c0b2a30 msgr2=0x7f6e9c150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e9bfff700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e9c0b2a30 0x7f6e9c150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:39.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e9bfff700 1 -- 172.21.15.84:0/3259780502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c0093c0 con 0x7f6e9c0b2660 2023-10-06T03:26:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e9bfff700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e9c0b2660 0x7f6e9c0ca160 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00ec80 tx=0x7f6e8c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.285+0000 7f6e83fff700 1 -- 172.21.15.84:0/3259780502 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c005a00 con 0x7f6e9c0b2660 2023-10-06T03:26:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.286+0000 7f6e83fff700 1 -- 172.21.15.84:0/3259780502 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c005b60 con 0x7f6e9c0b2660 2023-10-06T03:26:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.286+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3259780502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e900094f0 con 0x7f6e9c0b2660 2023-10-06T03:26:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.286+0000 7f6e83fff700 1 -- 172.21.15.84:0/3259780502 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c00c9d0 con 0x7f6e9c0b2660 2023-10-06T03:26:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.286+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3259780502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c14f570 con 0x7f6e9c0b2660 2023-10-06T03:26:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.287+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3259780502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9c150180 con 0x7f6e9c0b2660 2023-10-06T03:26:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.287+0000 7f6e83fff700 1 -- 172.21.15.84:0/3259780502 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e8c00cd80 con 0x7f6e9c0b2660 2023-10-06T03:26:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.287+0000 7f6e83fff700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6e88066f30 0x7f6e880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.287+0000 7f6e83fff700 1 -- 172.21.15.84:0/3259780502 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f6e8c084c50 con 0x7f6e9c0b2660 2023-10-06T03:26:39.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.288+0000 7f6e9b7fe700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6e88066f30 0x7f6e880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:39.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.288+0000 7f6e9b7fe700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6e88066f30 0x7f6e880693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6e900099b0 tx=0x7f6e90017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:39.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.292+0000 7f6e83fff700 1 -- 172.21.15.84:0/3259780502 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e8c08a020 con 0x7f6e9c0b2660 2023-10-06T03:26:39.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:39.476+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3259780502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6e9c05f270 con 0x7f6e9c0b2660 2023-10-06T03:26:40.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.144+0000 7f6e83fff700 1 -- 172.21.15.84:0/3259780502 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6e8c020020 con 0x7f6e9c0b2660 2023-10-06T03:26:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3259780502 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6e88066f30 msgr2=0x7f6e880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6e88066f30 0x7f6e880693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6e900099b0 tx=0x7f6e90017000 comp rx=0 tx=0).stop 2023-10-06T03:26:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3259780502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e9c0b2660 msgr2=0x7f6e9c0ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e9c0b2660 0x7f6e9c0ca160 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00ec80 tx=0x7f6e8c009120 comp rx=0 tx=0).stop 2023-10-06T03:26:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3259780502 shutdown_connections 2023-10-06T03:26:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6e88066f30 0x7f6e880693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e9c0ceae0 0x7f6e9c0c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:40.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e9c0b2660 0x7f6e9c0ca160 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:40.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 --2- 172.21.15.84:0/3259780502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e9c0b2a30 0x7f6e9c150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:40.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3259780502 >> 172.21.15.84:0/3259780502 conn(0x7f6e9c099560 msgr2=0x7f6e9c157da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:40.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3259780502 shutdown_connections 2023-10-06T03:26:40.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.154+0000 7f6ea14a9700 1 -- 172.21.15.84:0/3259780502 wait complete. 2023-10-06T03:26:40.163 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T03:26:40.176 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:26:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.291+0000 7fecb6f13700 1 Processor -- start 2023-10-06T03:26:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.291+0000 7fecb6f13700 1 -- start start 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.292+0000 7fecb6f13700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fecb0159510 0x7fecb00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.292+0000 7fecb6f13700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fecb01598e0 0x7fecb00cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.292+0000 7fecb6f13700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb00cf370 con 0x7fecb00ce820 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.292+0000 7fecb6f13700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb00cf610 con 0x7fecb01598e0 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.292+0000 7fecb6f13700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb00cf8f0 con 0x7fecb0159510 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.292+0000 7fecaffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fecb01598e0 0x7fecb00cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.292+0000 7fecaffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fecb01598e0 0x7fecb00cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39850/0 (socket says 172.21.15.84:39850) 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.292+0000 7fecaffff700 1 -- 172.21.15.84:0/3125146632 learned_addr learned my addr 172.21.15.84:0/3125146632 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecb4caf700 1 --2- 172.21.15.84:0/3125146632 >> v2:172.21.15.131:3300/0 conn(0x7fecb0159510 0x7fecb00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecaffff700 1 -- 172.21.15.84:0/3125146632 >> v2:172.21.15.131:3300/0 conn(0x7fecb0159510 msgr2=0x7fecb00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecaffff700 1 --2- 172.21.15.84:0/3125146632 >> v2:172.21.15.131:3300/0 conn(0x7fecb0159510 0x7fecb00cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecaffff700 1 -- 172.21.15.84:0/3125146632 >> v1:172.21.15.131:6789/0 conn(0x7fecb00ce820 legacy=0x7fecb00cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecaffff700 1 -- 172.21.15.84:0/3125146632 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb00cfbd0 con 0x7fecb01598e0 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecb4caf700 1 --2- 172.21.15.84:0/3125146632 >> v2:172.21.15.131:3300/0 conn(0x7fecb0159510 0x7fecb00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecaffff700 1 --2- 172.21.15.84:0/3125146632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb01598e0 0x7fecb00cbae0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fecb0088fb0 tx=0x7feca4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617dfe6e279f820b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecaf7fe700 1 -- 172.21.15.84:0/3125146632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400e070 con 0x7fecb01598e0 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecaf7fe700 1 -- 172.21.15.84:0/3125146632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca400ba10 con 0x7fecb01598e0 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecaf7fe700 1 -- 172.21.15.84:0/3125146632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40092e0 con 0x7fecb01598e0 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecb6f13700 1 -- 172.21.15.84:0/3125146632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb01598e0 msgr2=0x7fecb00cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecb6f13700 1 --2- 172.21.15.84:0/3125146632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb01598e0 0x7fecb00cbae0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fecb0088fb0 tx=0x7feca4009840 comp rx=0 tx=0).stop 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecb6f13700 1 -- 172.21.15.84:0/3125146632 shutdown_connections 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecb6f13700 1 --2- 172.21.15.84:0/3125146632 >> v2:172.21.15.131:3300/0 conn(0x7fecb0159510 0x7fecb00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecb6f13700 1 --2- 172.21.15.84:0/3125146632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb01598e0 0x7fecb00cbae0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecb6f13700 1 -- 172.21.15.84:0/3125146632 >> 172.21.15.84:0/3125146632 conn(0x7fecb0089e90 msgr2=0x7fecb00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.293+0000 7fecb6f13700 1 -- 172.21.15.84:0/3125146632 shutdown_connections 2023-10-06T03:26:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.294+0000 7fecb6f13700 1 -- 172.21.15.84:0/3125146632 wait complete. 2023-10-06T03:26:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.295+0000 7fecb6f13700 1 Processor -- start 2023-10-06T03:26:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.295+0000 7fecb6f13700 1 -- start start 2023-10-06T03:26:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.295+0000 7fecb6f13700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb00ce820 0x7fecb014d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.295+0000 7fecb6f13700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecb0159510 0x7fecb014d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.295+0000 7fecb6f13700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecb01598e0 0x7fecb0153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.295+0000 7fecb6f13700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb015b120 con 0x7fecb00ce820 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.295+0000 7fecb6f13700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb014df10 con 0x7fecb01598e0 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.295+0000 7fecb6f13700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb015b350 con 0x7fecb0159510 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb4caf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb00ce820 0x7fecb014d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb4caf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb00ce820 0x7fecb014d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39864/0 (socket says 172.21.15.84:39864) 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb4caf700 1 -- 172.21.15.84:0/4100006661 learned_addr learned my addr 172.21.15.84:0/4100006661 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecaffff700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecb0159510 0x7fecb014d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb54b0700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecb01598e0 0x7fecb0153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb4caf700 1 -- 172.21.15.84:0/4100006661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecb0159510 msgr2=0x7fecb014d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb4caf700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecb0159510 0x7fecb014d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb4caf700 1 -- 172.21.15.84:0/4100006661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecb01598e0 msgr2=0x7fecb0153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb4caf700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecb01598e0 0x7fecb0153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb4caf700 1 -- 172.21.15.84:0/4100006661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4009ae0 con 0x7fecb00ce820 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb4caf700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb00ce820 0x7fecb014d490 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7feca000c830 tx=0x7feca0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecacff9700 1 -- 172.21.15.84:0/4100006661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0011600 con 0x7fecb00ce820 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecacff9700 1 -- 172.21.15.84:0/4100006661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca0011760 con 0x7fecb00ce820 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb6f13700 1 -- 172.21.15.84:0/4100006661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb015b630 con 0x7fecb00ce820 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecacff9700 1 -- 172.21.15.84:0/4100006661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0011b20 con 0x7fecb00ce820 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.296+0000 7fecb6f13700 1 -- 172.21.15.84:0/4100006661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb015bbf0 con 0x7fecb00ce820 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.297+0000 7fecb6f13700 1 -- 172.21.15.84:0/4100006661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb0064ad0 con 0x7fecb00ce820 2023-10-06T03:26:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.298+0000 7fecacff9700 1 -- 172.21.15.84:0/4100006661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feca000a3e0 con 0x7fecb00ce820 2023-10-06T03:26:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.298+0000 7fecacff9700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec9c066f30 0x7fec9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.298+0000 7fecacff9700 1 -- 172.21.15.84:0/4100006661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6278+0+0 (secure 0 0 0) 0x7feca0084cb0 con 0x7fecb00ce820 2023-10-06T03:26:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.298+0000 7fecaffff700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec9c066f30 0x7fec9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.298+0000 7fecaffff700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec9c066f30 0x7fec9c0693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fecb0088fb0 tx=0x7feca4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.303+0000 7fecacff9700 1 -- 172.21.15.84:0/4100006661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feca0051ce0 con 0x7fecb00ce820 2023-10-06T03:26:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:40.526+0000 7fecb6f13700 1 -- 172.21.15.84:0/4100006661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fecb00cfeb0 con 0x7fecb00ce820 2023-10-06T03:26:41.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.176+0000 7fecacff9700 1 -- 172.21.15.84:0/4100006661 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7feca00150c0 con 0x7fecb00ce820 2023-10-06T03:26:41.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.180+0000 7fecb6f13700 1 -- 172.21.15.84:0/4100006661 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec9c066f30 msgr2=0x7fec9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.181+0000 7fecb6f13700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec9c066f30 0x7fec9c0693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fecb0088fb0 tx=0x7feca4017000 comp rx=0 tx=0).stop 2023-10-06T03:26:41.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.181+0000 7fecb6f13700 1 -- 172.21.15.84:0/4100006661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb00ce820 msgr2=0x7fecb014d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.181+0000 7fecb6f13700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb00ce820 0x7fecb014d490 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7feca000c830 tx=0x7feca0008040 comp rx=0 tx=0).stop 2023-10-06T03:26:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.181+0000 7fecb6f13700 1 -- 172.21.15.84:0/4100006661 shutdown_connections 2023-10-06T03:26:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.181+0000 7fecb6f13700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec9c066f30 0x7fec9c0693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.181+0000 7fecb6f13700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecb01598e0 0x7fecb0153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.181+0000 7fecb6f13700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb00ce820 0x7fecb014d490 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.181+0000 7fecb6f13700 1 --2- 172.21.15.84:0/4100006661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecb0159510 0x7fecb014d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.181+0000 7fecb6f13700 1 -- 172.21.15.84:0/4100006661 >> 172.21.15.84:0/4100006661 conn(0x7fecb0089e90 msgr2=0x7fecb0069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:41.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.184+0000 7fecb6f13700 1 -- 172.21.15.84:0/4100006661 shutdown_connections 2023-10-06T03:26:41.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.184+0000 7fecb6f13700 1 -- 172.21.15.84:0/4100006661 wait complete. 2023-10-06T03:26:41.189 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 14 and data pool 15 2023-10-06T03:26:41.201 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:41.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.313+0000 7fc3aed44700 1 Processor -- start 2023-10-06T03:26:41.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.313+0000 7fc3aed44700 1 -- start start 2023-10-06T03:26:41.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3aed44700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a81595a0 0x7fc3a80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3aed44700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3a80b49e0 0x7fc3a80aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3aed44700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a80b0ca0 con 0x7fc3a80b07a0 2023-10-06T03:26:41.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3aed44700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a80b0f80 con 0x7fc3a80b49e0 2023-10-06T03:26:41.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3aed44700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80b1260 con 0x7fc3a81595a0 2023-10-06T03:26:41.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3a7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3a80b49e0 0x7fc3a80aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3a7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3a80b49e0 0x7fc3a80aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45212/0 (socket says 172.21.15.84:45212) 2023-10-06T03:26:41.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3ad2e1700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc3a80b07a0 0x7fc3a80b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41962/0 (socket says 172.21.15.84:41962) 2023-10-06T03:26:41.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3a7fff700 1 -- 172.21.15.84:0/3073120352 learned_addr learned my addr 172.21.15.84:0/3073120352 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:41.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3a7fff700 1 -- 172.21.15.84:0/3073120352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a81595a0 msgr2=0x7fc3a80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:41.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3acae0700 1 --2- 172.21.15.84:0/3073120352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a81595a0 0x7fc3a80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3a7fff700 1 --2- 172.21.15.84:0/3073120352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a81595a0 0x7fc3a80aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.314+0000 7fc3a77fe700 1 -- 172.21.15.84:0/3073120352 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848929813 0 0) 0x7fc3a80b0ca0 con 0x7fc3a80b07a0 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3a7fff700 1 -- 172.21.15.84:0/3073120352 >> v1:172.21.15.84:6789/0 conn(0x7fc3a80b07a0 legacy=0x7fc3a80b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3a7fff700 1 -- 172.21.15.84:0/3073120352 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a80b1540 con 0x7fc3a80b49e0 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3acae0700 1 --2- 172.21.15.84:0/3073120352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a81595a0 0x7fc3a80aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3a7fff700 1 --2- 172.21.15.84:0/3073120352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b49e0 0x7fc3a80aaab0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0099b0 tx=0x7fc39c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fd03caa0160af7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3a77fe700 1 -- 172.21.15.84:0/3073120352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00b860 con 0x7fc3a80b49e0 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3a77fe700 1 -- 172.21.15.84:0/3073120352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c00b9c0 con 0x7fc3a80b49e0 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3a77fe700 1 -- 172.21.15.84:0/3073120352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00bd60 con 0x7fc3a80b49e0 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3aed44700 1 -- 172.21.15.84:0/3073120352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b49e0 msgr2=0x7fc3a80aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3aed44700 1 --2- 172.21.15.84:0/3073120352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b49e0 0x7fc3a80aaab0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0099b0 tx=0x7fc39c009250 comp rx=0 tx=0).stop 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3aed44700 1 -- 172.21.15.84:0/3073120352 shutdown_connections 2023-10-06T03:26:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3aed44700 1 --2- 172.21.15.84:0/3073120352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a81595a0 0x7fc3a80aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3aed44700 1 --2- 172.21.15.84:0/3073120352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b49e0 0x7fc3a80aaab0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3aed44700 1 -- 172.21.15.84:0/3073120352 >> 172.21.15.84:0/3073120352 conn(0x7fc3a8099830 msgr2=0x7fc3a806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3aed44700 1 -- 172.21.15.84:0/3073120352 shutdown_connections 2023-10-06T03:26:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.315+0000 7fc3aed44700 1 -- 172.21.15.84:0/3073120352 wait complete. 2023-10-06T03:26:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.316+0000 7fc3aed44700 1 Processor -- start 2023-10-06T03:26:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.317+0000 7fc3aed44700 1 -- start start 2023-10-06T03:26:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.317+0000 7fc3aed44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b07a0 0x7fc3a815d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.317+0000 7fc3aed44700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a80b49e0 0x7fc3a8158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.317+0000 7fc3aed44700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3a81595a0 0x7fc3a81696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.317+0000 7fc3aed44700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a809ae40 con 0x7fc3a80b07a0 2023-10-06T03:26:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.317+0000 7fc3aed44700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a815dc90 con 0x7fc3a81595a0 2023-10-06T03:26:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.317+0000 7fc3aed44700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a809a230 con 0x7fc3a80b49e0 2023-10-06T03:26:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.317+0000 7fc3acae0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b07a0 0x7fc3a815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3acae0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b07a0 0x7fc3a815d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45226/0 (socket says 172.21.15.84:45226) 2023-10-06T03:26:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3acae0700 1 -- 172.21.15.84:0/3066255908 learned_addr learned my addr 172.21.15.84:0/3066255908 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3a7fff700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a80b49e0 0x7fc3a8158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3ad2e1700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3a81595a0 0x7fc3a81696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3acae0700 1 -- 172.21.15.84:0/3066255908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a80b49e0 msgr2=0x7fc3a8158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3acae0700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a80b49e0 0x7fc3a8158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3acae0700 1 -- 172.21.15.84:0/3066255908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3a81595a0 msgr2=0x7fc3a81696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3acae0700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3a81595a0 0x7fc3a81696c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3acae0700 1 -- 172.21.15.84:0/3066255908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c0094f0 con 0x7fc3a80b07a0 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3ad2e1700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3a81595a0 0x7fc3a81696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3acae0700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b07a0 0x7fc3a815d750 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc39800a300 tx=0x7fc3980078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3a4ff9700 1 -- 172.21.15.84:0/3066255908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398015440 con 0x7fc3a80b07a0 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3a4ff9700 1 -- 172.21.15.84:0/3066255908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3980155a0 con 0x7fc3a80b07a0 2023-10-06T03:26:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3aed44700 1 -- 172.21.15.84:0/3066255908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a809a510 con 0x7fc3a80b07a0 2023-10-06T03:26:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3a4ff9700 1 -- 172.21.15.84:0/3066255908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398015940 con 0x7fc3a80b07a0 2023-10-06T03:26:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.318+0000 7fc3aed44700 1 -- 172.21.15.84:0/3066255908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a809aad0 con 0x7fc3a80b07a0 2023-10-06T03:26:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.319+0000 7fc3aed44700 1 -- 172.21.15.84:0/3066255908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a8064ad0 con 0x7fc3a80b07a0 2023-10-06T03:26:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.320+0000 7fc3a4ff9700 1 -- 172.21.15.84:0/3066255908 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc398015cf0 con 0x7fc3a80b07a0 2023-10-06T03:26:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.320+0000 7fc3a4ff9700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc394066f30 0x7fc3940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.320+0000 7fc3a4ff9700 1 -- 172.21.15.84:0/3066255908 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc398084eb0 con 0x7fc3a80b07a0 2023-10-06T03:26:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.320+0000 7fc3a7fff700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc394066f30 0x7fc3940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.320+0000 7fc3a7fff700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc394066f30 0x7fc3940693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0099b0 tx=0x7fc39c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:41.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.324+0000 7fc3a4ff9700 1 -- 172.21.15.84:0/3066255908 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc39804e5a0 con 0x7fc3a80b07a0 2023-10-06T03:26:41.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.509+0000 7fc3aed44700 1 -- 172.21.15.84:0/3066255908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3a80b1820 con 0x7fc3a80b07a0 2023-10-06T03:26:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.510+0000 7fc3a4ff9700 1 -- 172.21.15.84:0/3066255908 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+17087 (secure 0 0 0) 0x7fc39801a020 con 0x7fc3a80b07a0 2023-10-06T03:26:41.512 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:41.512 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":85,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:40.528524+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:38.193214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:39.494528+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 -- 172.21.15.84:0/3066255908 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc394066f30 msgr2=0x7fc3940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc394066f30 0x7fc3940693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0099b0 tx=0x7fc39c017000 comp rx=0 tx=0).stop 2023-10-06T03:26:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 -- 172.21.15.84:0/3066255908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b07a0 msgr2=0x7fc3a815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b07a0 0x7fc3a815d750 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc39800a300 tx=0x7fc3980078c0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 -- 172.21.15.84:0/3066255908 shutdown_connections 2023-10-06T03:26:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc394066f30 0x7fc3940693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3a81595a0 0x7fc3a81696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a80b07a0 0x7fc3a815d750 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 --2- 172.21.15.84:0/3066255908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3a80b49e0 0x7fc3a8158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 -- 172.21.15.84:0/3066255908 >> 172.21.15.84:0/3066255908 conn(0x7fc3a8099830 msgr2=0x7fc3a80cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:41.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 -- 172.21.15.84:0/3066255908 shutdown_connections 2023-10-06T03:26:41.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.512+0000 7fc3aed44700 1 -- 172.21.15.84:0/3066255908 wait complete. 2023-10-06T03:26:41.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.639+0000 7f6c89584700 1 Processor -- start 2023-10-06T03:26:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.639+0000 7f6c89584700 1 -- start start 2023-10-06T03:26:41.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.640+0000 7f6c89584700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6c841595a0 0x7f6c840aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.640+0000 7f6c89584700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c840b0ca0 con 0x7f6c840b49e0 2023-10-06T03:26:41.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.640+0000 7f6c89584700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c840b0f80 con 0x7f6c840b07a0 2023-10-06T03:26:41.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.640+0000 7f6c89584700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c840b1260 con 0x7f6c841595a0 2023-10-06T03:26:41.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.640+0000 7f6c827fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6c840b49e0 0x7f6c840aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41972/0 (socket says 172.21.15.84:41972) 2023-10-06T03:26:41.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.640+0000 7f6c827fc700 1 -- 172.21.15.84:0/3236167596 learned_addr learned my addr 172.21.15.84:0/3236167596 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:41.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.640+0000 7f6c82ffd700 1 --2- 172.21.15.84:0/3236167596 >> v2:172.21.15.131:3300/0 conn(0x7f6c841595a0 0x7f6c840aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.640+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293392544 0 0) 0x7f6c840b0ca0 con 0x7f6c840b49e0 2023-10-06T03:26:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.640+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c70003570 con 0x7f6c840b49e0 2023-10-06T03:26:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3380846339 0 0) 0x7f6c70003570 con 0x7f6c840b49e0 2023-10-06T03:26:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 >> v2:172.21.15.131:3300/0 conn(0x7f6c841595a0 msgr2=0x7f6c840aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 --2- 172.21.15.84:0/3236167596 >> v2:172.21.15.131:3300/0 conn(0x7f6c841595a0 0x7f6c840aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 >> v1:172.21.15.131:6789/0 conn(0x7f6c840b07a0 legacy=0x7f6c840b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c840b1540 con 0x7f6c840b49e0 2023-10-06T03:26:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f6c6c001470 con 0x7f6c840b49e0 2023-10-06T03:26:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 >> v1:172.21.15.84:6789/0 conn(0x7f6c840b49e0 legacy=0x7f6c840aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c70003a60 0x7f6c70003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c70004810 0x7f6c70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c700051c0 0x7f6c7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c840b1260 con 0x7f6c70003a60 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7000c050 con 0x7f6c70004810 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7000c210 con 0x7f6c700051c0 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c82ffd700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c70003a60 0x7f6c70003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c827fc700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c70004810 0x7f6c70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c837fe700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c700051c0 0x7f6c7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c82ffd700 1 -- 172.21.15.84:0/3236167596 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c700051c0 msgr2=0x7f6c7000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c82ffd700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c700051c0 0x7f6c7000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c82ffd700 1 -- 172.21.15.84:0/3236167596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c70004810 msgr2=0x7f6c70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c82ffd700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c70004810 0x7f6c70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c82ffd700 1 -- 172.21.15.84:0/3236167596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c70003570 con 0x7f6c70003a60 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c837fe700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c700051c0 0x7f6c7000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c837fe700 1 -- 172.21.15.84:0/3236167596 reap_dead start 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c82ffd700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c70003a60 0x7f6c70003e30 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009bf0 tx=0x7f6c74009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96724490f6206ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74005a00 con 0x7f6c70003a60 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c74005b60 con 0x7f6c70003a60 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.641+0000 7f6c81ffb700 1 -- 172.21.15.84:0/3236167596 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7400e710 con 0x7f6c70003a60 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.642+0000 7f6c89584700 1 -- 172.21.15.84:0/3236167596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c70003a60 msgr2=0x7f6c70003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.642+0000 7f6c89584700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c70003a60 0x7f6c70003e30 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009bf0 tx=0x7f6c74009120 comp rx=0 tx=0).stop 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.642+0000 7f6c89584700 1 -- 172.21.15.84:0/3236167596 shutdown_connections 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.642+0000 7f6c89584700 1 --2- 172.21.15.84:0/3236167596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c70003a60 0x7f6c70003e30 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.642+0000 7f6c89584700 1 -- 172.21.15.84:0/3236167596 >> 172.21.15.84:0/3236167596 conn(0x7f6c84099830 msgr2=0x7f6c8406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:41.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.642+0000 7f6c89584700 1 -- 172.21.15.84:0/3236167596 shutdown_connections 2023-10-06T03:26:41.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.642+0000 7f6c89584700 1 -- 172.21.15.84:0/3236167596 wait complete. 2023-10-06T03:26:41.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.643+0000 7f6c89584700 1 Processor -- start 2023-10-06T03:26:41.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.643+0000 7f6c89584700 1 -- start start 2023-10-06T03:26:41.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c89584700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c70003a60 0x7f6c8416a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c89584700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8415d300 0x7f6c8409c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c89584700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8414a420 0x7f6c8414a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c89584700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8409a090 con 0x7f6c8415d300 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c89584700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8415d850 con 0x7f6c8414a420 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c89584700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8415db30 con 0x7f6c70003a60 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c827fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8415d300 0x7f6c8409c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c827fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8415d300 0x7f6c8409c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45246/0 (socket says 172.21.15.84:45246) 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c827fc700 1 -- 172.21.15.84:0/3708913660 learned_addr learned my addr 172.21.15.84:0/3708913660 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c837fe700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8414a420 0x7f6c8414a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c82ffd700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c70003a60 0x7f6c8416a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c827fc700 1 -- 172.21.15.84:0/3708913660 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c70003a60 msgr2=0x7f6c8416a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c827fc700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c70003a60 0x7f6c8416a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c827fc700 1 -- 172.21.15.84:0/3708913660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8414a420 msgr2=0x7f6c8414a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c827fc700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8414a420 0x7f6c8414a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.644+0000 7f6c827fc700 1 -- 172.21.15.84:0/3708913660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8415de10 con 0x7f6c8415d300 2023-10-06T03:26:41.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.645+0000 7f6c827fc700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8415d300 0x7f6c8409c3e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0073c0 tx=0x7f6c6c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:41.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.645+0000 7f6c7affd700 1 -- 172.21.15.84:0/3708913660 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c018030 con 0x7f6c8415d300 2023-10-06T03:26:41.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.645+0000 7f6c7affd700 1 -- 172.21.15.84:0/3708913660 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c00f870 con 0x7f6c8415d300 2023-10-06T03:26:41.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.645+0000 7f6c89584700 1 -- 172.21.15.84:0/3708913660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8415e0f0 con 0x7f6c8415d300 2023-10-06T03:26:41.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.645+0000 7f6c7affd700 1 -- 172.21.15.84:0/3708913660 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00fc30 con 0x7f6c8415d300 2023-10-06T03:26:41.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.645+0000 7f6c89584700 1 -- 172.21.15.84:0/3708913660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8416a930 con 0x7f6c8415d300 2023-10-06T03:26:41.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.646+0000 7f6c89584700 1 -- 172.21.15.84:0/3708913660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c84064ad0 con 0x7f6c8415d300 2023-10-06T03:26:41.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.646+0000 7f6c7affd700 1 -- 172.21.15.84:0/3708913660 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c6c01b070 con 0x7f6c8415d300 2023-10-06T03:26:41.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.646+0000 7f6c7affd700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c64066f30 0x7f6c640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.646+0000 7f6c7affd700 1 -- 172.21.15.84:0/3708913660 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6c6c019070 con 0x7f6c8415d300 2023-10-06T03:26:41.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.646+0000 7f6c82ffd700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c64066f30 0x7f6c640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.647+0000 7f6c82ffd700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c64066f30 0x7f6c640693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009160 tx=0x7f6c74019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:41.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.651+0000 7f6c7affd700 1 -- 172.21.15.84:0/3708913660 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c6c051740 con 0x7f6c8415d300 2023-10-06T03:26:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.837+0000 7f6c89584700 1 -- 172.21.15.84:0/3708913660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c840b1820 con 0x7f6c8415d300 2023-10-06T03:26:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.838+0000 7f6c7affd700 1 -- 172.21.15.84:0/3708913660 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f6c6c054d60 con 0x7f6c8415d300 2023-10-06T03:26:41.840 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:41.840 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":85,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:40.528524+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:38.193214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:39.494528+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:41.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 -- 172.21.15.84:0/3708913660 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c64066f30 msgr2=0x7f6c640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c64066f30 0x7f6c640693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009160 tx=0x7f6c74019000 comp rx=0 tx=0).stop 2023-10-06T03:26:41.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 -- 172.21.15.84:0/3708913660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8415d300 msgr2=0x7f6c8409c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8415d300 0x7f6c8409c3e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0073c0 tx=0x7f6c6c001e70 comp rx=0 tx=0).stop 2023-10-06T03:26:41.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 -- 172.21.15.84:0/3708913660 shutdown_connections 2023-10-06T03:26:41.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6c64066f30 0x7f6c640693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c8414a420 0x7f6c8414a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c70003a60 0x7f6c8416a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 --2- 172.21.15.84:0/3708913660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8415d300 0x7f6c8409c3e0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 -- 172.21.15.84:0/3708913660 >> 172.21.15.84:0/3708913660 conn(0x7f6c84099830 msgr2=0x7f6c840cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:41.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 -- 172.21.15.84:0/3708913660 shutdown_connections 2023-10-06T03:26:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.840+0000 7f6c89584700 1 -- 172.21.15.84:0/3708913660 wait complete. 2023-10-06T03:26:41.854 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:26:41.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.969+0000 7f4fed87d700 1 Processor -- start 2023-10-06T03:26:41.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.969+0000 7f4fed87d700 1 -- start start 2023-10-06T03:26:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fed87d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4fe80b2660 0x7f4fe80cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fed87d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4fe80cf1f0 0x7f4fe80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fed87d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe80cc9b0 con 0x7f4fe80b2a30 2023-10-06T03:26:41.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fed87d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe80cbda0 con 0x7f4fe80b2660 2023-10-06T03:26:41.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fed87d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe80cc080 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fec87b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4fe80b2660 0x7f4fe80cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fe7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4fe80b2a30 0x7f4fe80ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41978/0 (socket says 172.21.15.84:41978) 2023-10-06T03:26:41.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fe7fff700 1 -- 172.21.15.84:0/2616275627 learned_addr learned my addr 172.21.15.84:0/2616275627 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:41.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fed07c700 1 --2- 172.21.15.84:0/2616275627 >> v2:172.21.15.131:3300/0 conn(0x7f4fe80cf1f0 0x7f4fe80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fec87b700 1 -- 172.21.15.84:0/2616275627 >> v2:172.21.15.131:3300/0 conn(0x7f4fe80cf1f0 msgr2=0x7f4fe80cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:41.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fec87b700 1 --2- 172.21.15.84:0/2616275627 >> v2:172.21.15.131:3300/0 conn(0x7f4fe80cf1f0 0x7f4fe80cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fec87b700 1 -- 172.21.15.84:0/2616275627 >> v1:172.21.15.84:6789/0 conn(0x7f4fe80b2a30 legacy=0x7f4fe80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fec87b700 1 -- 172.21.15.84:0/2616275627 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe80cc360 con 0x7f4fe80b2660 2023-10-06T03:26:41.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.970+0000 7f4fe77fe700 1 -- 172.21.15.84:0/2616275627 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357951234 0 0) 0x7f4fe80cc9b0 con 0x7f4fe80b2a30 2023-10-06T03:26:41.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fec87b700 1 --2- 172.21.15.84:0/2616275627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80b2660 0x7f4fe80cccf0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4fe80894b0 tx=0x7f4fd8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24392a89b94b50b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:41.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fe77fe700 1 -- 172.21.15.84:0/2616275627 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8005c10 con 0x7f4fe80b2660 2023-10-06T03:26:41.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fe77fe700 1 -- 172.21.15.84:0/2616275627 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd8005d70 con 0x7f4fe80b2660 2023-10-06T03:26:41.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fe77fe700 1 -- 172.21.15.84:0/2616275627 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8006260 con 0x7f4fe80b2660 2023-10-06T03:26:41.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fed87d700 1 -- 172.21.15.84:0/2616275627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80b2660 msgr2=0x7f4fe80cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fed87d700 1 --2- 172.21.15.84:0/2616275627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80b2660 0x7f4fe80cccf0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4fe80894b0 tx=0x7f4fd8009120 comp rx=0 tx=0).stop 2023-10-06T03:26:41.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fed87d700 1 -- 172.21.15.84:0/2616275627 shutdown_connections 2023-10-06T03:26:41.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fed87d700 1 --2- 172.21.15.84:0/2616275627 >> v2:172.21.15.131:3300/0 conn(0x7f4fe80cf1f0 0x7f4fe80cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fed87d700 1 --2- 172.21.15.84:0/2616275627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80b2660 0x7f4fe80cccf0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fed87d700 1 -- 172.21.15.84:0/2616275627 >> 172.21.15.84:0/2616275627 conn(0x7f4fe8099560 msgr2=0x7f4fe806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:41.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fed87d700 1 -- 172.21.15.84:0/2616275627 shutdown_connections 2023-10-06T03:26:41.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.971+0000 7f4fed87d700 1 -- 172.21.15.84:0/2616275627 wait complete. 2023-10-06T03:26:41.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.972+0000 7f4fed87d700 1 Processor -- start 2023-10-06T03:26:41.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.973+0000 7f4fed87d700 1 -- start start 2023-10-06T03:26:41.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.973+0000 7f4fed87d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fe80b2660 0x7f4fe8154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.973+0000 7f4fed87d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fe80b2a30 0x7f4fe80b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.973+0000 7f4fed87d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80cf1f0 0x7f4fe80c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.973+0000 7f4fed87d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe80b3a80 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.973+0000 7f4fed87d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe80b4890 con 0x7f4fe80b2660 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.973+0000 7f4fed87d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe80b4d20 con 0x7f4fe80b2a30 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.973+0000 7f4fed07c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80cf1f0 0x7f4fe80c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.973+0000 7f4fed07c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80cf1f0 0x7f4fe80c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45256/0 (socket says 172.21.15.84:45256) 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.973+0000 7f4fed07c700 1 -- 172.21.15.84:0/3867854964 learned_addr learned my addr 172.21.15.84:0/3867854964 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fec87b700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fe80b2660 0x7f4fe8154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fe7fff700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fe80b2a30 0x7f4fe80b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fed07c700 1 -- 172.21.15.84:0/3867854964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fe80b2a30 msgr2=0x7f4fe80b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fed07c700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fe80b2a30 0x7f4fe80b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fed07c700 1 -- 172.21.15.84:0/3867854964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fe80b2660 msgr2=0x7f4fe8154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fed07c700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fe80b2660 0x7f4fe8154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fed07c700 1 -- 172.21.15.84:0/3867854964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80093c0 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fed07c700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80cf1f0 0x7f4fe80c91f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009fd0 tx=0x7f4fe0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fe4ff9700 1 -- 172.21.15.84:0/3867854964 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000ebf0 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fe4ff9700 1 -- 172.21.15.84:0/3867854964 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe000ed50 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fed87d700 1 -- 172.21.15.84:0/3867854964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe80b3c80 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fe4ff9700 1 -- 172.21.15.84:0/3867854964 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0014670 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.974+0000 7f4fed87d700 1 -- 172.21.15.84:0/3867854964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe80b4240 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.975+0000 7f4fed87d700 1 -- 172.21.15.84:0/3867854964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe805f270 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.975+0000 7f4fe4ff9700 1 -- 172.21.15.84:0/3867854964 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fe00149e0 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.976+0000 7f4fe4ff9700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4fd4066f30 0x7f4fd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.976+0000 7f4fe4ff9700 1 -- 172.21.15.84:0/3867854964 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4fe0084e70 con 0x7f4fe80cf1f0 2023-10-06T03:26:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.976+0000 7f4fec87b700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4fd4066f30 0x7f4fd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.976+0000 7f4fec87b700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4fd4066f30 0x7f4fd40693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8089bd0 tx=0x7f4fd8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:41.980+0000 7f4fe4ff9700 1 -- 172.21.15.84:0/3867854964 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fe0051e40 con 0x7f4fe80cf1f0 2023-10-06T03:26:42.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:42.207+0000 7f4fed87d700 1 -- 172.21.15.84:0/3867854964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4fe80cc640 con 0x7f4fe80cf1f0 2023-10-06T03:26:43.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.182+0000 7f4fe4ff9700 1 -- 172.21.15.84:0/3867854964 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4fe0055460 con 0x7f4fe80cf1f0 2023-10-06T03:26:43.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 -- 172.21.15.84:0/3867854964 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4fd4066f30 msgr2=0x7f4fd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:43.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4fd4066f30 0x7f4fd40693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8089bd0 tx=0x7f4fd8016000 comp rx=0 tx=0).stop 2023-10-06T03:26:43.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 -- 172.21.15.84:0/3867854964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80cf1f0 msgr2=0x7f4fe80c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:43.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80cf1f0 0x7f4fe80c91f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009fd0 tx=0x7f4fe0009900 comp rx=0 tx=0).stop 2023-10-06T03:26:43.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 -- 172.21.15.84:0/3867854964 shutdown_connections 2023-10-06T03:26:43.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4fd4066f30 0x7f4fd40693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:43.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fe80b2660 0x7f4fe8154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:43.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe80cf1f0 0x7f4fe80c91f0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:43.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 --2- 172.21.15.84:0/3867854964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fe80b2a30 0x7f4fe80b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:43.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 -- 172.21.15.84:0/3867854964 >> 172.21.15.84:0/3867854964 conn(0x7f4fe8099560 msgr2=0x7f4fe8157950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:43.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 -- 172.21.15.84:0/3867854964 shutdown_connections 2023-10-06T03:26:43.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.184+0000 7f4fed87d700 1 -- 172.21.15.84:0/3867854964 wait complete. 2023-10-06T03:26:43.199 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:26:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.317+0000 7f5a72c53700 1 Processor -- start 2023-10-06T03:26:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.317+0000 7f5a72c53700 1 -- start start 2023-10-06T03:26:43.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a72c53700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5a6c159510 0x7f5a6c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a72c53700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a6c0cbae0 0x7f5a6c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a72c53700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c0cbf20 con 0x7f5a6c1598e0 2023-10-06T03:26:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a72c53700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c0cf610 con 0x7f5a6c0cbae0 2023-10-06T03:26:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a72c53700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c0cf8f0 con 0x7f5a6c159510 2023-10-06T03:26:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a711f0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a6c0cbae0 0x7f5a6c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a6bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5a6c1598e0 0x7f5a6c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41994/0 (socket says 172.21.15.84:41994) 2023-10-06T03:26:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a6bfff700 1 -- 172.21.15.84:0/1945700605 learned_addr learned my addr 172.21.15.84:0/1945700605 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a711f0700 1 -- 172.21.15.84:0/1945700605 >> v2:172.21.15.131:3300/0 conn(0x7f5a6c159510 msgr2=0x7f5a6c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a709ef700 1 --2- 172.21.15.84:0/1945700605 >> v2:172.21.15.131:3300/0 conn(0x7f5a6c159510 0x7f5a6c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a711f0700 1 --2- 172.21.15.84:0/1945700605 >> v2:172.21.15.131:3300/0 conn(0x7f5a6c159510 0x7f5a6c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.318+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1945700605 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393718861 0 0) 0x7f5a6c0cbf20 con 0x7f5a6c1598e0 2023-10-06T03:26:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a711f0700 1 -- 172.21.15.84:0/1945700605 >> v1:172.21.15.84:6789/0 conn(0x7f5a6c1598e0 legacy=0x7f5a6c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a711f0700 1 -- 172.21.15.84:0/1945700605 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0cfbd0 con 0x7f5a6c0cbae0 2023-10-06T03:26:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a709ef700 1 --2- 172.21.15.84:0/1945700605 >> v2:172.21.15.131:3300/0 conn(0x7f5a6c159510 0x7f5a6c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a711f0700 1 --2- 172.21.15.84:0/1945700605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c0cbae0 0x7f5a6c0cef30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c088fb0 tx=0x7f5a64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12cbe1d9c3acff4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1945700605 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400e070 con 0x7f5a6c0cbae0 2023-10-06T03:26:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1945700605 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6400bc30 con 0x7f5a6c0cbae0 2023-10-06T03:26:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1945700605 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64012430 con 0x7f5a6c0cbae0 2023-10-06T03:26:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a72c53700 1 -- 172.21.15.84:0/1945700605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c0cbae0 msgr2=0x7f5a6c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a72c53700 1 --2- 172.21.15.84:0/1945700605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c0cbae0 0x7f5a6c0cef30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c088fb0 tx=0x7f5a64009780 comp rx=0 tx=0).stop 2023-10-06T03:26:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a72c53700 1 -- 172.21.15.84:0/1945700605 shutdown_connections 2023-10-06T03:26:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a72c53700 1 --2- 172.21.15.84:0/1945700605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c0cbae0 0x7f5a6c0cef30 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a72c53700 1 --2- 172.21.15.84:0/1945700605 >> v2:172.21.15.131:3300/0 conn(0x7f5a6c159510 0x7f5a6c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a72c53700 1 -- 172.21.15.84:0/1945700605 >> 172.21.15.84:0/1945700605 conn(0x7f5a6c089e90 msgr2=0x7f5a6c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a72c53700 1 -- 172.21.15.84:0/1945700605 shutdown_connections 2023-10-06T03:26:43.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.319+0000 7f5a72c53700 1 -- 172.21.15.84:0/1945700605 wait complete. 2023-10-06T03:26:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.320+0000 7f5a72c53700 1 Processor -- start 2023-10-06T03:26:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.321+0000 7f5a72c53700 1 -- start start 2023-10-06T03:26:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.321+0000 7f5a72c53700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a6c0cbae0 0x7f5a6c156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.321+0000 7f5a72c53700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c159510 0x7f5a6c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.321+0000 7f5a72c53700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a6c1598e0 0x7f5a6c16cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.321+0000 7f5a72c53700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c15ac60 con 0x7f5a6c159510 2023-10-06T03:26:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.321+0000 7f5a72c53700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c16d2d0 con 0x7f5a6c0cbae0 2023-10-06T03:26:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.321+0000 7f5a72c53700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0b4d90 con 0x7f5a6c1598e0 2023-10-06T03:26:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a6bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c159510 0x7f5a6c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a6bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c159510 0x7f5a6c15a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45270/0 (socket says 172.21.15.84:45270) 2023-10-06T03:26:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a6bfff700 1 -- 172.21.15.84:0/4252109670 learned_addr learned my addr 172.21.15.84:0/4252109670 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a709ef700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a6c0cbae0 0x7f5a6c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a711f0700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a6c1598e0 0x7f5a6c16cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a6bfff700 1 -- 172.21.15.84:0/4252109670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a6c1598e0 msgr2=0x7f5a6c16cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a6bfff700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a6c1598e0 0x7f5a6c16cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a6bfff700 1 -- 172.21.15.84:0/4252109670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a6c0cbae0 msgr2=0x7f5a6c156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a6bfff700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a6c0cbae0 0x7f5a6c156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a6bfff700 1 -- 172.21.15.84:0/4252109670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a64009a20 con 0x7f5a6c159510 2023-10-06T03:26:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a709ef700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a6c0cbae0 0x7f5a6c156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a711f0700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a6c1598e0 0x7f5a6c16cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a6bfff700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c159510 0x7f5a6c15a720 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800c510 tx=0x7f5a5800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a68ff9700 1 -- 172.21.15.84:0/4252109670 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58005b30 con 0x7f5a6c159510 2023-10-06T03:26:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a68ff9700 1 -- 172.21.15.84:0/4252109670 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a58005c90 con 0x7f5a6c159510 2023-10-06T03:26:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a72c53700 1 -- 172.21.15.84:0/4252109670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c0b4460 con 0x7f5a6c159510 2023-10-06T03:26:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a68ff9700 1 -- 172.21.15.84:0/4252109670 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58007300 con 0x7f5a6c159510 2023-10-06T03:26:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.322+0000 7f5a72c53700 1 -- 172.21.15.84:0/4252109670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c0b4a20 con 0x7f5a6c159510 2023-10-06T03:26:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.323+0000 7f5a72c53700 1 -- 172.21.15.84:0/4252109670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6c089540 con 0x7f5a6c159510 2023-10-06T03:26:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.324+0000 7f5a68ff9700 1 -- 172.21.15.84:0/4252109670 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a5801b3b0 con 0x7f5a6c159510 2023-10-06T03:26:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.324+0000 7f5a68ff9700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a50066f30 0x7f5a500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.324+0000 7f5a709ef700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a50066f30 0x7f5a500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.324+0000 7f5a68ff9700 1 -- 172.21.15.84:0/4252109670 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5a58083d00 con 0x7f5a6c159510 2023-10-06T03:26:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.324+0000 7f5a709ef700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a50066f30 0x7f5a500693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5a60008b20 tx=0x7f5a60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.328+0000 7f5a68ff9700 1 -- 172.21.15.84:0/4252109670 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a58050cd0 con 0x7f5a6c159510 2023-10-06T03:26:43.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:43.555+0000 7f5a72c53700 1 -- 172.21.15.84:0/4252109670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5a6c0b4f00 con 0x7f5a6c159510 2023-10-06T03:26:44.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.183+0000 7f5a68ff9700 1 -- 172.21.15.84:0/4252109670 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5a58017020 con 0x7f5a6c159510 2023-10-06T03:26:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 -- 172.21.15.84:0/4252109670 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a50066f30 msgr2=0x7f5a500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a50066f30 0x7f5a500693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5a60008b20 tx=0x7f5a60008040 comp rx=0 tx=0).stop 2023-10-06T03:26:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 -- 172.21.15.84:0/4252109670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c159510 msgr2=0x7f5a6c15a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c159510 0x7f5a6c15a720 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800c510 tx=0x7f5a5800c8d0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 -- 172.21.15.84:0/4252109670 shutdown_connections 2023-10-06T03:26:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5a50066f30 0x7f5a500693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a6c0cbae0 0x7f5a6c156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a6c1598e0 0x7f5a6c16cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 --2- 172.21.15.84:0/4252109670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c159510 0x7f5a6c15a720 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 -- 172.21.15.84:0/4252109670 >> 172.21.15.84:0/4252109670 conn(0x7f5a6c089e90 msgr2=0x7f5a6c14b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 -- 172.21.15.84:0/4252109670 shutdown_connections 2023-10-06T03:26:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.185+0000 7f5a72c53700 1 -- 172.21.15.84:0/4252109670 wait complete. 2023-10-06T03:26:44.200 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:44.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.313+0000 7ff5ea55e700 1 Processor -- start 2023-10-06T03:26:44.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.313+0000 7ff5ea55e700 1 -- start start 2023-10-06T03:26:44.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5ea55e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff5e41595a0 0x7ff5e40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5ea55e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 0x7ff5e40aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5ea55e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff5e40b07a0 0x7ff5e40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5ea55e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e40b0ca0 con 0x7ff5e40b07a0 2023-10-06T03:26:44.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5ea55e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e40b0f80 con 0x7ff5e41595a0 2023-10-06T03:26:44.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5ea55e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40b1260 con 0x7ff5e40b49e0 2023-10-06T03:26:44.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e8afb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff5e40b07a0 0x7ff5e40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e8afb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff5e40b07a0 0x7ff5e40b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45286/0 (socket says 172.21.15.84:45286) 2023-10-06T03:26:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e8afb700 1 -- 172.21.15.84:0/3410124128 learned_addr learned my addr 172.21.15.84:0/3410124128 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e37fe700 1 --2- 172.21.15.84:0/3410124128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 0x7ff5e40aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e3fff700 1 --2- 172.21.15.84:0/3410124128 >> v2:172.21.15.131:3300/0 conn(0x7ff5e41595a0 0x7ff5e40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e8afb700 1 -- 172.21.15.84:0/3410124128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 msgr2=0x7ff5e40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e8afb700 1 --2- 172.21.15.84:0/3410124128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 0x7ff5e40aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e8afb700 1 -- 172.21.15.84:0/3410124128 >> v2:172.21.15.131:3300/0 conn(0x7ff5e41595a0 msgr2=0x7ff5e40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e8afb700 1 --2- 172.21.15.84:0/3410124128 >> v2:172.21.15.131:3300/0 conn(0x7ff5e41595a0 0x7ff5e40aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e8afb700 1 -- 172.21.15.84:0/3410124128 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e40b1540 con 0x7ff5e40b07a0 2023-10-06T03:26:44.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e3fff700 1 --2- 172.21.15.84:0/3410124128 >> v2:172.21.15.131:3300/0 conn(0x7ff5e41595a0 0x7ff5e40aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:44.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e8afb700 1 --2- 172.21.15.84:0/3410124128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e40b07a0 0x7ff5e40b38d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4088cc0 tx=0x7ff5dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324a46848b8ee6af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:44.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e2ffd700 1 -- 172.21.15.84:0/3410124128 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc00e070 con 0x7ff5e40b07a0 2023-10-06T03:26:44.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e2ffd700 1 -- 172.21.15.84:0/3410124128 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc00ba50 con 0x7ff5e40b07a0 2023-10-06T03:26:44.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.314+0000 7ff5e2ffd700 1 -- 172.21.15.84:0/3410124128 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0092e0 con 0x7ff5e40b07a0 2023-10-06T03:26:44.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.315+0000 7ff5ea55e700 1 -- 172.21.15.84:0/3410124128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e40b07a0 msgr2=0x7ff5e40b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.315+0000 7ff5ea55e700 1 --2- 172.21.15.84:0/3410124128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e40b07a0 0x7ff5e40b38d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4088cc0 tx=0x7ff5dc009840 comp rx=0 tx=0).stop 2023-10-06T03:26:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.315+0000 7ff5ea55e700 1 -- 172.21.15.84:0/3410124128 shutdown_connections 2023-10-06T03:26:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.315+0000 7ff5ea55e700 1 --2- 172.21.15.84:0/3410124128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e40b07a0 0x7ff5e40b38d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.315+0000 7ff5ea55e700 1 --2- 172.21.15.84:0/3410124128 >> v2:172.21.15.131:3300/0 conn(0x7ff5e41595a0 0x7ff5e40aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.315+0000 7ff5ea55e700 1 --2- 172.21.15.84:0/3410124128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 0x7ff5e40aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.315+0000 7ff5ea55e700 1 -- 172.21.15.84:0/3410124128 >> 172.21.15.84:0/3410124128 conn(0x7ff5e4099830 msgr2=0x7ff5e406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:44.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.315+0000 7ff5ea55e700 1 -- 172.21.15.84:0/3410124128 shutdown_connections 2023-10-06T03:26:44.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.315+0000 7ff5ea55e700 1 -- 172.21.15.84:0/3410124128 wait complete. 2023-10-06T03:26:44.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.316+0000 7ff5ea55e700 1 Processor -- start 2023-10-06T03:26:44.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.316+0000 7ff5ea55e700 1 -- start start 2023-10-06T03:26:44.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5ea55e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5e40b07a0 0x7ff5e4149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5ea55e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 0x7ff5e409c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5ea55e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e41595a0 0x7ff5e409cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5ea55e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40c5270 con 0x7ff5e41595a0 2023-10-06T03:26:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5ea55e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e409d530 con 0x7ff5e40b07a0 2023-10-06T03:26:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5ea55e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e409d810 con 0x7ff5e40b49e0 2023-10-06T03:26:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e8afb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e41595a0 0x7ff5e409cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e8afb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e41595a0 0x7ff5e409cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45300/0 (socket says 172.21.15.84:45300) 2023-10-06T03:26:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e8afb700 1 -- 172.21.15.84:0/420221249 learned_addr learned my addr 172.21.15.84:0/420221249 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e3fff700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5e40b07a0 0x7ff5e4149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e37fe700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 0x7ff5e409c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e8afb700 1 -- 172.21.15.84:0/420221249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 msgr2=0x7ff5e409c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e8afb700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 0x7ff5e409c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e8afb700 1 -- 172.21.15.84:0/420221249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5e40b07a0 msgr2=0x7ff5e4149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e8afb700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5e40b07a0 0x7ff5e4149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e8afb700 1 -- 172.21.15.84:0/420221249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc009ae0 con 0x7ff5e41595a0 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e3fff700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5e40b07a0 0x7ff5e4149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e37fe700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 0x7ff5e409c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.317+0000 7ff5e8afb700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e41595a0 0x7ff5e409cf20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4067c60 tx=0x7ff5dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.318+0000 7ff5cbfff700 1 -- 172.21.15.84:0/420221249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0032f0 con 0x7ff5e41595a0 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.318+0000 7ff5cbfff700 1 -- 172.21.15.84:0/420221249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc008e40 con 0x7ff5e41595a0 2023-10-06T03:26:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.318+0000 7ff5ea55e700 1 -- 172.21.15.84:0/420221249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e409daf0 con 0x7ff5e41595a0 2023-10-06T03:26:44.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.318+0000 7ff5cbfff700 1 -- 172.21.15.84:0/420221249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc01d670 con 0x7ff5e41595a0 2023-10-06T03:26:44.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.318+0000 7ff5ea55e700 1 -- 172.21.15.84:0/420221249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e4157720 con 0x7ff5e41595a0 2023-10-06T03:26:44.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.319+0000 7ff5ea55e700 1 -- 172.21.15.84:0/420221249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e40c5420 con 0x7ff5e41595a0 2023-10-06T03:26:44.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.319+0000 7ff5cbfff700 1 -- 172.21.15.84:0/420221249 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5dc003040 con 0x7ff5e41595a0 2023-10-06T03:26:44.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.319+0000 7ff5cbfff700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff5d0066f30 0x7ff5d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.319+0000 7ff5cbfff700 1 -- 172.21.15.84:0/420221249 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff5dc086340 con 0x7ff5e41595a0 2023-10-06T03:26:44.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.319+0000 7ff5e3fff700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff5d0066f30 0x7ff5d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.320+0000 7ff5e3fff700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff5d0066f30 0x7ff5d00693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4006ea0 tx=0x7ff5d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:44.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.324+0000 7ff5cbfff700 1 -- 172.21.15.84:0/420221249 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5e40c5420 con 0x7ff5e41595a0 2023-10-06T03:26:44.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.547+0000 7ff5ea55e700 1 -- 172.21.15.84:0/420221249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5e4064ad0 con 0x7ff5e41595a0 2023-10-06T03:26:44.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.548+0000 7ff5cbfff700 1 -- 172.21.15.84:0/420221249 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4602 (secure 0 0 0) 0x7ff5dc053310 con 0x7ff5e41595a0 2023-10-06T03:26:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:44.550 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3563307477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3563307477},{"type":"v1","addr":"172.21.15.84:6837","nonce":3563307477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":5923,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1010130826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1010130826},{"type":"v1","addr":"172.21.15.131:6834","nonce":1010130826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/569291567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":569291567},{"type":"v1","addr":"172.21.15.84:6836","nonce":569291567}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:40.528842+0000","modified":"2023-10-06T03:26:44.181991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6615},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6615":{"gid":6615,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/1003867498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1003867498},{"type":"v1","addr":"172.21.15.131:6835","nonce":1003867498}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:26:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 -- 172.21.15.84:0/420221249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff5d0066f30 msgr2=0x7ff5d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff5d0066f30 0x7ff5d00693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4006ea0 tx=0x7ff5d4008040 comp rx=0 tx=0).stop 2023-10-06T03:26:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 -- 172.21.15.84:0/420221249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e41595a0 msgr2=0x7ff5e409cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e41595a0 0x7ff5e409cf20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4067c60 tx=0x7ff5dc018000 comp rx=0 tx=0).stop 2023-10-06T03:26:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 -- 172.21.15.84:0/420221249 shutdown_connections 2023-10-06T03:26:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff5d0066f30 0x7ff5d00693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5e40b07a0 0x7ff5e4149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e41595a0 0x7ff5e409cf20 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 --2- 172.21.15.84:0/420221249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5e40b49e0 0x7ff5e409c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 -- 172.21.15.84:0/420221249 >> 172.21.15.84:0/420221249 conn(0x7ff5e4099830 msgr2=0x7ff5e40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:44.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 -- 172.21.15.84:0/420221249 shutdown_connections 2023-10-06T03:26:44.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.550+0000 7ff5ea55e700 1 -- 172.21.15.84:0/420221249 wait complete. 2023-10-06T03:26:44.553 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-10-06T03:26:44.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.676+0000 7f773c8ec700 1 Processor -- start 2023-10-06T03:26:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.676+0000 7f773c8ec700 1 -- start start 2023-10-06T03:26:44.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f773c8ec700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7738159480 0x7f77380b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f773c8ec700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77380b3610 0x7f77380cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f773c8ec700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f77380cc1b0 0x7f77380b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f773c8ec700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77380cb7e0 con 0x7f7738159480 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f773c8ec700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77380b08a0 con 0x7f77380cc1b0 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f773c8ec700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77380cb190 con 0x7f77380b3610 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f77377fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7738159480 0x7f77380b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f77377fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7738159480 0x7f77380b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45302/0 (socket says 172.21.15.84:45302) 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f77377fe700 1 -- 172.21.15.84:0/1623913291 learned_addr learned my addr 172.21.15.84:0/1623913291 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f7737fff700 1 --2- 172.21.15.84:0/1623913291 >> v2:172.21.15.131:3300/0 conn(0x7f77380cc1b0 0x7f77380b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f7736ffd700 1 --2- 172.21.15.84:0/1623913291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77380b3610 0x7f77380cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f77377fe700 1 -- 172.21.15.84:0/1623913291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77380b3610 msgr2=0x7f77380cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f77377fe700 1 --2- 172.21.15.84:0/1623913291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77380b3610 0x7f77380cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f77377fe700 1 -- 172.21.15.84:0/1623913291 >> v2:172.21.15.131:3300/0 conn(0x7f77380cc1b0 msgr2=0x7f77380b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f77377fe700 1 --2- 172.21.15.84:0/1623913291 >> v2:172.21.15.131:3300/0 conn(0x7f77380cc1b0 0x7f77380b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.677+0000 7f77377fe700 1 -- 172.21.15.84:0/1623913291 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77380cb470 con 0x7f7738159480 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f77377fe700 1 --2- 172.21.15.84:0/1623913291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 0x7f77380b30d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f773815cf30 tx=0x7f7728009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ef03da0412136e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f77367fc700 1 -- 172.21.15.84:0/1623913291 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800e070 con 0x7f7738159480 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f77367fc700 1 -- 172.21.15.84:0/1623913291 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772800ba50 con 0x7f7738159480 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f77367fc700 1 -- 172.21.15.84:0/1623913291 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280092e0 con 0x7f7738159480 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f773c8ec700 1 -- 172.21.15.84:0/1623913291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 msgr2=0x7f77380b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f773c8ec700 1 --2- 172.21.15.84:0/1623913291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 0x7f77380b30d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f773815cf30 tx=0x7f7728009840 comp rx=0 tx=0).stop 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f773c8ec700 1 -- 172.21.15.84:0/1623913291 shutdown_connections 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f773c8ec700 1 --2- 172.21.15.84:0/1623913291 >> v2:172.21.15.131:3300/0 conn(0x7f77380cc1b0 0x7f77380b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f773c8ec700 1 --2- 172.21.15.84:0/1623913291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 0x7f77380b30d0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f773c8ec700 1 --2- 172.21.15.84:0/1623913291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77380b3610 0x7f77380cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f773c8ec700 1 -- 172.21.15.84:0/1623913291 >> 172.21.15.84:0/1623913291 conn(0x7f773806ed20 msgr2=0x7f773806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f773c8ec700 1 -- 172.21.15.84:0/1623913291 shutdown_connections 2023-10-06T03:26:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.678+0000 7f773c8ec700 1 -- 172.21.15.84:0/1623913291 wait complete. 2023-10-06T03:26:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.679+0000 7f773c8ec700 1 Processor -- start 2023-10-06T03:26:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f773c8ec700 1 -- start start 2023-10-06T03:26:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f773c8ec700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77380b3610 0x7f77380ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f773c8ec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77380cc1b0 0x7f7738157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f773c8ec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 0x7f7738157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f773c8ec700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77380cde30 con 0x7f7738159480 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f773c8ec700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77380c4b70 con 0x7f77380cc1b0 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f773c8ec700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77380ce040 con 0x7f77380b3610 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f7737fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 0x7f7738157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f7737fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 0x7f7738157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45318/0 (socket says 172.21.15.84:45318) 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f7737fff700 1 -- 172.21.15.84:0/858057755 learned_addr learned my addr 172.21.15.84:0/858057755 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f77377fe700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77380b3610 0x7f77380ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.680+0000 7f7736ffd700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77380cc1b0 0x7f7738157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f7737fff700 1 -- 172.21.15.84:0/858057755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77380b3610 msgr2=0x7f77380ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f7737fff700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77380b3610 0x7f77380ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f7737fff700 1 -- 172.21.15.84:0/858057755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77380cc1b0 msgr2=0x7f7738157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f7737fff700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77380cc1b0 0x7f7738157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f7737fff700 1 -- 172.21.15.84:0/858057755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7728009ae0 con 0x7f7738159480 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f7737fff700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 0x7f7738157f80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f773000d890 tx=0x7f7730008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f771f7fe700 1 -- 172.21.15.84:0/858057755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300125f0 con 0x7f7738159480 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f771f7fe700 1 -- 172.21.15.84:0/858057755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730012770 con 0x7f7738159480 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f773c8ec700 1 -- 172.21.15.84:0/858057755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77380ce320 con 0x7f7738159480 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f771f7fe700 1 -- 172.21.15.84:0/858057755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730012b30 con 0x7f7738159480 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.681+0000 7f773c8ec700 1 -- 172.21.15.84:0/858057755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77380ce8e0 con 0x7f7738159480 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.682+0000 7f773c8ec700 1 -- 172.21.15.84:0/858057755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77380c4d20 con 0x7f7738159480 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.682+0000 7f771f7fe700 1 -- 172.21.15.84:0/858057755 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f773001e460 con 0x7f7738159480 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.683+0000 7f771f7fe700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7724066f30 0x7f77240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.683+0000 7f771f7fe700 1 -- 172.21.15.84:0/858057755 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7730084cd0 con 0x7f7738159480 2023-10-06T03:26:44.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.683+0000 7f77377fe700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7724066f30 0x7f77240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:44.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.683+0000 7f77377fe700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7724066f30 0x7f77240693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7728009880 tx=0x7f7728018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:44.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.687+0000 7f771f7fe700 1 -- 172.21.15.84:0/858057755 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77380c4d20 con 0x7f7738159480 2023-10-06T03:26:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.871+0000 7f773c8ec700 1 -- 172.21.15.84:0/858057755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77380b61b0 con 0x7f7738159480 2023-10-06T03:26:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.872+0000 7f771f7fe700 1 -- 172.21.15.84:0/858057755 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f7730055730 con 0x7f7738159480 2023-10-06T03:26:44.874 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:44.874 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":86,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:42.158139+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:38.193214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:39.494528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 -- 172.21.15.84:0/858057755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7724066f30 msgr2=0x7f77240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7724066f30 0x7f77240693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7728009880 tx=0x7f7728018000 comp rx=0 tx=0).stop 2023-10-06T03:26:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 -- 172.21.15.84:0/858057755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 msgr2=0x7f7738157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 0x7f7738157f80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f773000d890 tx=0x7f7730008040 comp rx=0 tx=0).stop 2023-10-06T03:26:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 -- 172.21.15.84:0/858057755 shutdown_connections 2023-10-06T03:26:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7724066f30 0x7f77240693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7738159480 0x7f7738157f80 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77380b3610 0x7f77380ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 --2- 172.21.15.84:0/858057755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77380cc1b0 0x7f7738157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 -- 172.21.15.84:0/858057755 >> 172.21.15.84:0/858057755 conn(0x7f773806ed20 msgr2=0x7f773815c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 -- 172.21.15.84:0/858057755 shutdown_connections 2023-10-06T03:26:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:44.874+0000 7f773c8ec700 1 -- 172.21.15.84:0/858057755 wait complete. 2023-10-06T03:26:44.888 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:26:44.888 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:26:45.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.000+0000 7f459c8bd700 1 Processor -- start 2023-10-06T03:26:45.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.000+0000 7f459c8bd700 1 -- start start 2023-10-06T03:26:45.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.001+0000 7f459c8bd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f45980b07a0 0x7f45980ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.001+0000 7f459c8bd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45980b0ca0 con 0x7f45980b49e0 2023-10-06T03:26:45.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.001+0000 7f459c8bd700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45980b0f80 con 0x7f45981595a0 2023-10-06T03:26:45.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.001+0000 7f459c8bd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45980ab390 con 0x7f45980b07a0 2023-10-06T03:26:45.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.001+0000 7f4595d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f45980b49e0 0x7f45980aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42006/0 (socket says 172.21.15.84:42006) 2023-10-06T03:26:45.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.001+0000 7f4595d9b700 1 -- 172.21.15.84:0/2353508683 learned_addr learned my addr 172.21.15.84:0/2353508683 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f4596d9d700 1 --2- 172.21.15.84:0/2353508683 >> v2:172.21.15.131:3300/0 conn(0x7f45980b07a0 0x7f45980ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194312347 0 0) 0x7f45980b0ca0 con 0x7f45980b49e0 2023-10-06T03:26:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4580003570 con 0x7f45980b49e0 2023-10-06T03:26:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3063122902 0 0) 0x7f4580003570 con 0x7f45980b49e0 2023-10-06T03:26:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 >> v2:172.21.15.131:3300/0 conn(0x7f45980b07a0 msgr2=0x7f45980ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 --2- 172.21.15.84:0/2353508683 >> v2:172.21.15.131:3300/0 conn(0x7f45980b07a0 0x7f45980ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 >> v1:172.21.15.131:6789/0 conn(0x7f45981595a0 legacy=0x7f45980aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45980b1260 con 0x7f45980b49e0 2023-10-06T03:26:45.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f458c001470 con 0x7f45980b49e0 2023-10-06T03:26:45.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 >> v1:172.21.15.84:6789/0 conn(0x7f45980b49e0 legacy=0x7f45980aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f4580003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4580004810 0x7f4580004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45800051c0 0x7f458000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45980ab390 con 0x7f4580003a60 2023-10-06T03:26:45.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458000c0d0 con 0x7f4580004810 2023-10-06T03:26:45.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458000c290 con 0x7f45800051c0 2023-10-06T03:26:45.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459659c700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f4580003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f4595d9b700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4580004810 0x7f4580004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f4596d9d700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45800051c0 0x7f458000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459659c700 1 -- 172.21.15.84:0/2353508683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45800051c0 msgr2=0x7f458000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459659c700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45800051c0 0x7f458000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459659c700 1 -- 172.21.15.84:0/2353508683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4580004810 msgr2=0x7f4580004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459659c700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4580004810 0x7f4580004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459659c700 1 -- 172.21.15.84:0/2353508683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4580003570 con 0x7f4580003a60 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f4596d9d700 1 -- 172.21.15.84:0/2353508683 reap_dead start 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.002+0000 7f459659c700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f4580003e70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f458800c2d0 tx=0x7f4588001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f32fd355c505617 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.003+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588001d80 con 0x7f4580003a60 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.003+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458800cba0 con 0x7f4580003a60 2023-10-06T03:26:45.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.003+0000 7f459559a700 1 -- 172.21.15.84:0/2353508683 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588012400 con 0x7f4580003a60 2023-10-06T03:26:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.003+0000 7f459c8bd700 1 -- 172.21.15.84:0/2353508683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 msgr2=0x7f4580003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.003+0000 7f459c8bd700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f4580003e70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f458800c2d0 tx=0x7f4588001a70 comp rx=0 tx=0).stop 2023-10-06T03:26:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.003+0000 7f459c8bd700 1 -- 172.21.15.84:0/2353508683 shutdown_connections 2023-10-06T03:26:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.003+0000 7f459c8bd700 1 --2- 172.21.15.84:0/2353508683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f4580003e70 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.003+0000 7f459c8bd700 1 -- 172.21.15.84:0/2353508683 >> 172.21.15.84:0/2353508683 conn(0x7f4598099830 msgr2=0x7f459806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.003+0000 7f459c8bd700 1 -- 172.21.15.84:0/2353508683 shutdown_connections 2023-10-06T03:26:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.003+0000 7f459c8bd700 1 -- 172.21.15.84:0/2353508683 wait complete. 2023-10-06T03:26:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.004+0000 7f459c8bd700 1 Processor -- start 2023-10-06T03:26:45.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.004+0000 7f459c8bd700 1 -- start start 2023-10-06T03:26:45.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459c8bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f45980aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459c8bd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45980adec0 0x7f459815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459c8bd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45980ae330 0x7f459815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459c8bd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45980af290 con 0x7f4580003a60 2023-10-06T03:26:45.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459c8bd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459816a340 con 0x7f45980adec0 2023-10-06T03:26:45.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459c8bd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459816a620 con 0x7f45980ae330 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f45980aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f45980aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45330/0 (socket says 172.21.15.84:45330) 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459659c700 1 -- 172.21.15.84:0/2948373690 learned_addr learned my addr 172.21.15.84:0/2948373690 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f4596d9d700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45980ae330 0x7f459815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f4595d9b700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45980adec0 0x7f459815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459659c700 1 -- 172.21.15.84:0/2948373690 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45980ae330 msgr2=0x7f459815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459659c700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45980ae330 0x7f459815bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459659c700 1 -- 172.21.15.84:0/2948373690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45980adec0 msgr2=0x7f459815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459659c700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45980adec0 0x7f459815b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.005+0000 7f459659c700 1 -- 172.21.15.84:0/2948373690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459816a900 con 0x7f4580003a60 2023-10-06T03:26:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.006+0000 7f459659c700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f45980aed50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f458000c0a0 tx=0x7f4588016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.006+0000 7f45867fc700 1 -- 172.21.15.84:0/2948373690 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458800cde0 con 0x7f4580003a60 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.006+0000 7f45867fc700 1 -- 172.21.15.84:0/2948373690 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4588021070 con 0x7f4580003a60 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.006+0000 7f459c8bd700 1 -- 172.21.15.84:0/2948373690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459816abe0 con 0x7f4580003a60 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.006+0000 7f45867fc700 1 -- 172.21.15.84:0/2948373690 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588026680 con 0x7f4580003a60 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.006+0000 7f459c8bd700 1 -- 172.21.15.84:0/2948373690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459816a0b0 con 0x7f4580003a60 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.007+0000 7f459c8bd700 1 -- 172.21.15.84:0/2948373690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459816b280 con 0x7f4580003a60 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.007+0000 7f45867fc700 1 -- 172.21.15.84:0/2948373690 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4588023030 con 0x7f4580003a60 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.007+0000 7f45867fc700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4578066f30 0x7f45780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.007+0000 7f45867fc700 1 -- 172.21.15.84:0/2948373690 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f45880868e0 con 0x7f4580003a60 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.007+0000 7f4595d9b700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4578066f30 0x7f45780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.008+0000 7f4595d9b700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4578066f30 0x7f45780693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f458c000fd0 tx=0x7f458c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.011+0000 7f45867fc700 1 -- 172.21.15.84:0/2948373690 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45880538b0 con 0x7f4580003a60 2023-10-06T03:26:45.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.191+0000 7f459c8bd700 1 -- 172.21.15.84:0/2948373690 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4598064ad0 con 0x7f4578066f30 2023-10-06T03:26:45.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.200+0000 7f45867fc700 1 -- 172.21.15.84:0/2948373690 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311902 (secure 0 0 0) 0x7f4598064ad0 con 0x7f4578066f30 2023-10-06T03:26:45.206 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 -- 172.21.15.84:0/2948373690 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4578066f30 msgr2=0x7f45780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4578066f30 0x7f45780693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f458c000fd0 tx=0x7f458c009040 comp rx=0 tx=0).stop 2023-10-06T03:26:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 -- 172.21.15.84:0/2948373690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 msgr2=0x7f45980aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f45980aed50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f458000c0a0 tx=0x7f4588016000 comp rx=0 tx=0).stop 2023-10-06T03:26:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 -- 172.21.15.84:0/2948373690 shutdown_connections 2023-10-06T03:26:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4578066f30 0x7f45780693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45980ae330 0x7f459815bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4580003a60 0x7f45980aed50 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 --2- 172.21.15.84:0/2948373690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45980adec0 0x7f459815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 -- 172.21.15.84:0/2948373690 >> 172.21.15.84:0/2948373690 conn(0x7f4598099830 msgr2=0x7f45980cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 -- 172.21.15.84:0/2948373690 shutdown_connections 2023-10-06T03:26:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.203+0000 7f459c8bd700 1 -- 172.21.15.84:0/2948373690 wait complete. 2023-10-06T03:26:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:26:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2023-10-06T03:26:45.075974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387764,"kb_used_data":9460,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586956,"statfs":{"total":773094113280,"available":770649042944,"internally_reserved":0,"allocated":9687040,"data_stored":5169815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.934325"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181643+0000","last_change":"2023-10-06T03:26:41.181643+0000","last_active":"2023-10-06T03:26:41.181643+0000","last_peered":"2023-10-06T03:26:41.181643+0000","last_clean":"2023-10-06T03:26:41.181643+0000","last_became_active":"2023-10-06T03:26:41.181394+0000","last_became_peered":"2023-10-06T03:26:41.181394+0000","last_unstale":"2023-10-06T03:26:41.181643+0000","last_undegraded":"2023-10-06T03:26:41.181643+0000","last_fullsized":"2023-10-06T03:26:41.181643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:20.673510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190060+0000","last_change":"2023-10-06T03:26:41.186638+0000","last_active":"2023-10-06T03:26:41.190060+0000","last_peered":"2023-10-06T03:26:41.190060+0000","last_clean":"2023-10-06T03:26:41.190060+0000","last_became_active":"2023-10-06T03:26:41.186199+0000","last_became_peered":"2023-10-06T03:26:41.186199+0000","last_unstale":"2023-10-06T03:26:41.190060+0000","last_undegraded":"2023-10-06T03:26:41.190060+0000","last_fullsized":"2023-10-06T03:26:41.190060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:51.819006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181759+0000","last_change":"2023-10-06T03:26:41.181759+0000","last_active":"2023-10-06T03:26:41.181759+0000","last_peered":"2023-10-06T03:26:41.181759+0000","last_clean":"2023-10-06T03:26:41.181759+0000","last_became_active":"2023-10-06T03:26:41.181487+0000","last_became_peered":"2023-10-06T03:26:41.181487+0000","last_unstale":"2023-10-06T03:26:41.181759+0000","last_undegraded":"2023-10-06T03:26:41.181759+0000","last_fullsized":"2023-10-06T03:26:41.181759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:58.524932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.176589+0000","last_change":"2023-10-06T03:26:41.172634+0000","last_active":"2023-10-06T03:26:41.176589+0000","last_peered":"2023-10-06T03:26:41.176589+0000","last_clean":"2023-10-06T03:26:41.176589+0000","last_became_active":"2023-10-06T03:26:41.172267+0000","last_became_peered":"2023-10-06T03:26:41.172267+0000","last_unstale":"2023-10-06T03:26:41.176589+0000","last_undegraded":"2023-10-06T03:26:41.176589+0000","last_fullsized":"2023-10-06T03:26:41.176589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:32.844768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182696+0000","last_change":"2023-10-06T03:26:41.175742+0000","last_active":"2023-10-06T03:26:41.182696+0000","last_peered":"2023-10-06T03:26:41.182696+0000","last_clean":"2023-10-06T03:26:41.182696+0000","last_became_active":"2023-10-06T03:26:41.175435+0000","last_became_peered":"2023-10-06T03:26:41.175435+0000","last_unstale":"2023-10-06T03:26:41.182696+0000","last_undegraded":"2023-10-06T03:26:41.182696+0000","last_fullsized":"2023-10-06T03:26:41.182696+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:29.499328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191222+0000","last_change":"2023-10-06T03:26:41.187442+0000","last_active":"2023-10-06T03:26:41.191222+0000","last_peered":"2023-10-06T03:26:41.191222+0000","last_clean":"2023-10-06T03:26:41.191222+0000","last_became_active":"2023-10-06T03:26:41.187203+0000","last_became_peered":"2023-10-06T03:26:41.187203+0000","last_unstale":"2023-10-06T03:26:41.191222+0000","last_undegraded":"2023-10-06T03:26:41.191222+0000","last_fullsized":"2023-10-06T03:26:41.191222+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:53.378472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191174+0000","last_change":"2023-10-06T03:26:41.186585+0000","last_active":"2023-10-06T03:26:41.191174+0000","last_peered":"2023-10-06T03:26:41.191174+0000","last_clean":"2023-10-06T03:26:41.191174+0000","last_became_active":"2023-10-06T03:26:41.186336+0000","last_became_peered":"2023-10-06T03:26:41.186336+0000","last_unstale":"2023-10-06T03:26:41.191174+0000","last_undegraded":"2023-10-06T03:26:41.191174+0000","last_fullsized":"2023-10-06T03:26:41.191174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:38.695262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.179108+0000","last_change":"2023-10-06T03:26:41.175572+0000","last_active":"2023-10-06T03:26:41.179108+0000","last_peered":"2023-10-06T03:26:41.179108+0000","last_clean":"2023-10-06T03:26:41.179108+0000","last_became_active":"2023-10-06T03:26:41.175293+0000","last_became_peered":"2023-10-06T03:26:41.175293+0000","last_unstale":"2023-10-06T03:26:41.179108+0000","last_undegraded":"2023-10-06T03:26:41.179108+0000","last_fullsized":"2023-10-06T03:26:41.179108+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:08.919442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.185248+0000","last_change":"2023-10-06T03:26:41.173364+0000","last_active":"2023-10-06T03:26:41.185248+0000","last_peered":"2023-10-06T03:26:41.185248+0000","last_clean":"2023-10-06T03:26:41.185248+0000","last_became_active":"2023-10-06T03:26:41.173111+0000","last_became_peered":"2023-10-06T03:26:41.173111+0000","last_unstale":"2023-10-06T03:26:41.185248+0000","last_undegraded":"2023-10-06T03:26:41.185248+0000","last_fullsized":"2023-10-06T03:26:41.185248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:00.991567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182672+0000","last_change":"2023-10-06T03:26:41.180186+0000","last_active":"2023-10-06T03:26:41.182672+0000","last_peered":"2023-10-06T03:26:41.182672+0000","last_clean":"2023-10-06T03:26:41.182672+0000","last_became_active":"2023-10-06T03:26:41.179917+0000","last_became_peered":"2023-10-06T03:26:41.179917+0000","last_unstale":"2023-10-06T03:26:41.182672+0000","last_undegraded":"2023-10-06T03:26:41.182672+0000","last_fullsized":"2023-10-06T03:26:41.182672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:38.745211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191111+0000","last_change":"2023-10-06T03:26:41.187089+0000","last_active":"2023-10-06T03:26:41.191111+0000","last_peered":"2023-10-06T03:26:41.191111+0000","last_clean":"2023-10-06T03:26:41.191111+0000","last_became_active":"2023-10-06T03:26:41.185737+0000","last_became_peered":"2023-10-06T03:26:41.185737+0000","last_unstale":"2023-10-06T03:26:41.191111+0000","last_undegraded":"2023-10-06T03:26:41.191111+0000","last_fullsized":"2023-10-06T03:26:41.191111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:33.910699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.188423+0000","last_change":"2023-10-06T03:26:41.181934+0000","last_active":"2023-10-06T03:26:41.188423+0000","last_peered":"2023-10-06T03:26:41.188423+0000","last_clean":"2023-10-06T03:26:41.188423+0000","last_became_active":"2023-10-06T03:26:41.181684+0000","last_became_peered":"2023-10-06T03:26:41.181684+0000","last_unstale":"2023-10-06T03:26:41.188423+0000","last_undegraded":"2023-10-06T03:26:41.188423+0000","last_fullsized":"2023-10-06T03:26:41.188423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:28.221258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187082+0000","last_change":"2023-10-06T03:26:41.178948+0000","last_active":"2023-10-06T03:26:41.187082+0000","last_peered":"2023-10-06T03:26:41.187082+0000","last_clean":"2023-10-06T03:26:41.187082+0000","last_became_active":"2023-10-06T03:26:41.178697+0000","last_became_peered":"2023-10-06T03:26:41.178697+0000","last_unstale":"2023-10-06T03:26:41.187082+0000","last_undegraded":"2023-10-06T03:26:41.187082+0000","last_fullsized":"2023-10-06T03:26:41.187082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:47.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181213+0000","last_change":"2023-10-06T03:26:41.171938+0000","last_active":"2023-10-06T03:26:41.181213+0000","last_peered":"2023-10-06T03:26:41.181213+0000","last_clean":"2023-10-06T03:26:41.181213+0000","last_became_active":"2023-10-06T03:26:41.171342+0000","last_became_peered":"2023-10-06T03:26:41.171342+0000","last_unstale":"2023-10-06T03:26:41.181213+0000","last_undegraded":"2023-10-06T03:26:41.181213+0000","last_fullsized":"2023-10-06T03:26:41.181213+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:40.191253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187657+0000","last_change":"2023-10-06T03:26:41.179878+0000","last_active":"2023-10-06T03:26:41.187657+0000","last_peered":"2023-10-06T03:26:41.187657+0000","last_clean":"2023-10-06T03:26:41.187657+0000","last_became_active":"2023-10-06T03:26:41.179657+0000","last_became_peered":"2023-10-06T03:26:41.179657+0000","last_unstale":"2023-10-06T03:26:41.187657+0000","last_undegraded":"2023-10-06T03:26:41.187657+0000","last_fullsized":"2023-10-06T03:26:41.187657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:53.378472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182939+0000","last_change":"2023-10-06T03:26:41.175750+0000","last_active":"2023-10-06T03:26:41.182939+0000","last_peered":"2023-10-06T03:26:41.182939+0000","last_clean":"2023-10-06T03:26:41.182939+0000","last_became_active":"2023-10-06T03:26:41.175531+0000","last_became_peered":"2023-10-06T03:26:41.175531+0000","last_unstale":"2023-10-06T03:26:41.182939+0000","last_undegraded":"2023-10-06T03:26:41.182939+0000","last_fullsized":"2023-10-06T03:26:41.182939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:38.745211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181327+0000","last_change":"2023-10-06T03:26:41.174432+0000","last_active":"2023-10-06T03:26:41.181327+0000","last_peered":"2023-10-06T03:26:41.181327+0000","last_clean":"2023-10-06T03:26:41.181327+0000","last_became_active":"2023-10-06T03:26:41.174188+0000","last_became_peered":"2023-10-06T03:26:41.174188+0000","last_unstale":"2023-10-06T03:26:41.181327+0000","last_undegraded":"2023-10-06T03:26:41.181327+0000","last_fullsized":"2023-10-06T03:26:41.181327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:23.165895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.176597+0000","last_change":"2023-10-06T03:26:41.172487+0000","last_active":"2023-10-06T03:26:41.176597+0000","last_peered":"2023-10-06T03:26:41.176597+0000","last_clean":"2023-10-06T03:26:41.176597+0000","last_became_active":"2023-10-06T03:26:41.172244+0000","last_became_peered":"2023-10-06T03:26:41.172244+0000","last_unstale":"2023-10-06T03:26:41.176597+0000","last_undegraded":"2023-10-06T03:26:41.176597+0000","last_fullsized":"2023-10-06T03:26:41.176597+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:38.745211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191486+0000","last_change":"2023-10-06T03:26:41.182960+0000","last_active":"2023-10-06T03:26:41.191486+0000","last_peered":"2023-10-06T03:26:41.191486+0000","last_clean":"2023-10-06T03:26:41.191486+0000","last_became_active":"2023-10-06T03:26:41.182687+0000","last_became_peered":"2023-10-06T03:26:41.182687+0000","last_unstale":"2023-10-06T03:26:41.191486+0000","last_undegraded":"2023-10-06T03:26:41.191486+0000","last_fullsized":"2023-10-06T03:26:41.191486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:39:20.244342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.185349+0000","last_change":"2023-10-06T03:26:41.171899+0000","last_active":"2023-10-06T03:26:41.185349+0000","last_peered":"2023-10-06T03:26:41.185349+0000","last_clean":"2023-10-06T03:26:41.185349+0000","last_became_active":"2023-10-06T03:26:41.171607+0000","last_became_peered":"2023-10-06T03:26:41.171607+0000","last_unstale":"2023-10-06T03:26:41.185349+0000","last_undegraded":"2023-10-06T03:26:41.185349+0000","last_fullsized":"2023-10-06T03:26:41.185349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:57.775060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191487+0000","last_change":"2023-10-06T03:26:41.183046+0000","last_active":"2023-10-06T03:26:41.191487+0000","last_peered":"2023-10-06T03:26:41.191487+0000","last_clean":"2023-10-06T03:26:41.191487+0000","last_became_active":"2023-10-06T03:26:41.182807+0000","last_became_peered":"2023-10-06T03:26:41.182807+0000","last_unstale":"2023-10-06T03:26:41.191487+0000","last_undegraded":"2023-10-06T03:26:41.191487+0000","last_fullsized":"2023-10-06T03:26:41.191487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:58.524932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.196371+0000","last_change":"2023-10-06T03:26:41.187561+0000","last_active":"2023-10-06T03:26:41.196371+0000","last_peered":"2023-10-06T03:26:41.196371+0000","last_clean":"2023-10-06T03:26:41.196371+0000","last_became_active":"2023-10-06T03:26:41.187326+0000","last_became_peered":"2023-10-06T03:26:41.187326+0000","last_unstale":"2023-10-06T03:26:41.196371+0000","last_undegraded":"2023-10-06T03:26:41.196371+0000","last_fullsized":"2023-10-06T03:26:41.196371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:15.869340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187834+0000","last_change":"2023-10-06T03:26:41.183448+0000","last_active":"2023-10-06T03:26:41.187834+0000","last_peered":"2023-10-06T03:26:41.187834+0000","last_clean":"2023-10-06T03:26:41.187834+0000","last_became_active":"2023-10-06T03:26:41.183186+0000","last_became_peered":"2023-10-06T03:26:41.183186+0000","last_unstale":"2023-10-06T03:26:41.187834+0000","last_undegraded":"2023-10-06T03:26:41.187834+0000","last_fullsized":"2023-10-06T03:26:41.187834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:14.064568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182957+0000","last_change":"2023-10-06T03:26:41.181008+0000","last_active":"2023-10-06T03:26:41.182957+0000","last_peered":"2023-10-06T03:26:41.182957+0000","last_clean":"2023-10-06T03:26:41.182957+0000","last_became_active":"2023-10-06T03:26:41.180774+0000","last_became_peered":"2023-10-06T03:26:41.180774+0000","last_unstale":"2023-10-06T03:26:41.182957+0000","last_undegraded":"2023-10-06T03:26:41.182957+0000","last_fullsized":"2023-10-06T03:26:41.182957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:17.895762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.183250+0000","last_change":"2023-10-06T03:26:41.175485+0000","last_active":"2023-10-06T03:26:41.183250+0000","last_peered":"2023-10-06T03:26:41.183250+0000","last_clean":"2023-10-06T03:26:41.183250+0000","last_became_active":"2023-10-06T03:26:41.175188+0000","last_became_peered":"2023-10-06T03:26:41.175188+0000","last_unstale":"2023-10-06T03:26:41.183250+0000","last_undegraded":"2023-10-06T03:26:41.183250+0000","last_fullsized":"2023-10-06T03:26:41.183250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:33.910699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.184580+0000","last_change":"2023-10-06T03:26:41.179800+0000","last_active":"2023-10-06T03:26:41.184580+0000","last_peered":"2023-10-06T03:26:41.184580+0000","last_clean":"2023-10-06T03:26:41.184580+0000","last_became_active":"2023-10-06T03:26:41.179551+0000","last_became_peered":"2023-10-06T03:26:41.179551+0000","last_unstale":"2023-10-06T03:26:41.184580+0000","last_undegraded":"2023-10-06T03:26:41.184580+0000","last_fullsized":"2023-10-06T03:26:41.184580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:12.478235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.180748+0000","last_change":"2023-10-06T03:26:41.178550+0000","last_active":"2023-10-06T03:26:41.180748+0000","last_peered":"2023-10-06T03:26:41.180748+0000","last_clean":"2023-10-06T03:26:41.180748+0000","last_became_active":"2023-10-06T03:26:41.178295+0000","last_became_peered":"2023-10-06T03:26:41.178295+0000","last_unstale":"2023-10-06T03:26:41.180748+0000","last_undegraded":"2023-10-06T03:26:41.180748+0000","last_fullsized":"2023-10-06T03:26:41.180748+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:32.844768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182727+0000","last_change":"2023-10-06T03:26:41.178027+0000","last_active":"2023-10-06T03:26:41.182727+0000","last_peered":"2023-10-06T03:26:41.182727+0000","last_clean":"2023-10-06T03:26:41.182727+0000","last_became_active":"2023-10-06T03:26:41.177560+0000","last_became_peered":"2023-10-06T03:26:41.177560+0000","last_unstale":"2023-10-06T03:26:41.182727+0000","last_undegraded":"2023-10-06T03:26:41.182727+0000","last_fullsized":"2023-10-06T03:26:41.182727+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:53.378472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187910+0000","last_change":"2023-10-06T03:26:41.182944+0000","last_active":"2023-10-06T03:26:41.187910+0000","last_peered":"2023-10-06T03:26:41.187910+0000","last_clean":"2023-10-06T03:26:41.187910+0000","last_became_active":"2023-10-06T03:26:41.182683+0000","last_became_peered":"2023-10-06T03:26:41.182683+0000","last_unstale":"2023-10-06T03:26:41.187910+0000","last_undegraded":"2023-10-06T03:26:41.187910+0000","last_fullsized":"2023-10-06T03:26:41.187910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:02.127389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181768+0000","last_change":"2023-10-06T03:26:41.175823+0000","last_active":"2023-10-06T03:26:41.181768+0000","last_peered":"2023-10-06T03:26:41.181768+0000","last_clean":"2023-10-06T03:26:41.181768+0000","last_became_active":"2023-10-06T03:26:41.175588+0000","last_became_peered":"2023-10-06T03:26:41.175588+0000","last_unstale":"2023-10-06T03:26:41.181768+0000","last_undegraded":"2023-10-06T03:26:41.181768+0000","last_fullsized":"2023-10-06T03:26:41.181768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:35.154764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.193366+0000","last_change":"2023-10-06T03:26:41.186003+0000","last_active":"2023-10-06T03:26:41.193366+0000","last_peered":"2023-10-06T03:26:41.193366+0000","last_clean":"2023-10-06T03:26:41.193366+0000","last_became_active":"2023-10-06T03:26:41.185764+0000","last_became_peered":"2023-10-06T03:26:41.185764+0000","last_unstale":"2023-10-06T03:26:41.193366+0000","last_undegraded":"2023-10-06T03:26:41.193366+0000","last_fullsized":"2023-10-06T03:26:41.193366+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:29.478142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.178895+0000","last_change":"2023-10-06T03:26:41.178895+0000","last_active":"2023-10-06T03:26:41.178895+0000","last_peered":"2023-10-06T03:26:41.178895+0000","last_clean":"2023-10-06T03:26:41.178895+0000","last_became_active":"2023-10-06T03:26:41.174832+0000","last_became_peered":"2023-10-06T03:26:41.174832+0000","last_unstale":"2023-10-06T03:26:41.178895+0000","last_undegraded":"2023-10-06T03:26:41.178895+0000","last_fullsized":"2023-10-06T03:26:41.178895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:36.795883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181435+0000","last_change":"2023-10-06T03:26:41.172496+0000","last_active":"2023-10-06T03:26:41.181435+0000","last_peered":"2023-10-06T03:26:41.181435+0000","last_clean":"2023-10-06T03:26:41.181435+0000","last_became_active":"2023-10-06T03:26:41.172066+0000","last_became_peered":"2023-10-06T03:26:41.172066+0000","last_unstale":"2023-10-06T03:26:41.181435+0000","last_undegraded":"2023-10-06T03:26:41.181435+0000","last_fullsized":"2023-10-06T03:26:41.181435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:36.795883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"85'4","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.196378+0000","last_change":"2023-10-06T03:26:40.159203+0000","last_active":"2023-10-06T03:26:41.196378+0000","last_peered":"2023-10-06T03:26:41.196378+0000","last_clean":"2023-10-06T03:26:41.196378+0000","last_became_active":"2023-10-06T03:26:40.158916+0000","last_became_peered":"2023-10-06T03:26:40.158916+0000","last_unstale":"2023-10-06T03:26:41.196378+0000","last_undegraded":"2023-10-06T03:26:41.196378+0000","last_fullsized":"2023-10-06T03:26:41.196378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:37.741322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.184172+0000","last_change":"2023-10-06T03:26:41.175680+0000","last_active":"2023-10-06T03:26:41.184172+0000","last_peered":"2023-10-06T03:26:41.184172+0000","last_clean":"2023-10-06T03:26:41.184172+0000","last_became_active":"2023-10-06T03:26:41.175458+0000","last_became_peered":"2023-10-06T03:26:41.175458+0000","last_unstale":"2023-10-06T03:26:41.184172+0000","last_undegraded":"2023-10-06T03:26:41.184172+0000","last_fullsized":"2023-10-06T03:26:41.184172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:33.910699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"85'1","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191102+0000","last_change":"2023-10-06T03:26:40.168715+0000","last_active":"2023-10-06T03:26:41.191102+0000","last_peered":"2023-10-06T03:26:41.191102+0000","last_clean":"2023-10-06T03:26:41.191102+0000","last_became_active":"2023-10-06T03:26:40.168493+0000","last_became_peered":"2023-10-06T03:26:40.168493+0000","last_unstale":"2023-10-06T03:26:41.191102+0000","last_undegraded":"2023-10-06T03:26:41.191102+0000","last_fullsized":"2023-10-06T03:26:41.191102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:53.090658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.186414+0000","last_change":"2023-10-06T03:26:41.186414+0000","last_active":"2023-10-06T03:26:41.186414+0000","last_peered":"2023-10-06T03:26:41.186414+0000","last_clean":"2023-10-06T03:26:41.186414+0000","last_became_active":"2023-10-06T03:26:41.186107+0000","last_became_peered":"2023-10-06T03:26:41.186107+0000","last_unstale":"2023-10-06T03:26:41.186414+0000","last_undegraded":"2023-10-06T03:26:41.186414+0000","last_fullsized":"2023-10-06T03:26:41.186414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:40.191253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"85'2","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191865+0000","last_change":"2023-10-06T03:26:40.165879+0000","last_active":"2023-10-06T03:26:41.191865+0000","last_peered":"2023-10-06T03:26:41.191865+0000","last_clean":"2023-10-06T03:26:41.191865+0000","last_became_active":"2023-10-06T03:26:40.165602+0000","last_became_peered":"2023-10-06T03:26:40.165602+0000","last_unstale":"2023-10-06T03:26:41.191865+0000","last_undegraded":"2023-10-06T03:26:41.191865+0000","last_fullsized":"2023-10-06T03:26:41.191865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:09:46.506885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.189280+0000","last_change":"2023-10-06T03:26:41.181778+0000","last_active":"2023-10-06T03:26:41.189280+0000","last_peered":"2023-10-06T03:26:41.189280+0000","last_clean":"2023-10-06T03:26:41.189280+0000","last_became_active":"2023-10-06T03:26:41.181482+0000","last_became_peered":"2023-10-06T03:26:41.181482+0000","last_unstale":"2023-10-06T03:26:41.189280+0000","last_undegraded":"2023-10-06T03:26:41.189280+0000","last_fullsized":"2023-10-06T03:26:41.189280+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:11.728284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"85'2","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.188946+0000","last_change":"2023-10-06T03:26:40.165607+0000","last_active":"2023-10-06T03:26:41.188946+0000","last_peered":"2023-10-06T03:26:41.188946+0000","last_clean":"2023-10-06T03:26:41.188946+0000","last_became_active":"2023-10-06T03:26:40.165304+0000","last_became_peered":"2023-10-06T03:26:40.165304+0000","last_unstale":"2023-10-06T03:26:41.188946+0000","last_undegraded":"2023-10-06T03:26:41.188946+0000","last_fullsized":"2023-10-06T03:26:41.188946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:57.304763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.189533+0000","last_change":"2023-10-06T03:26:41.189533+0000","last_active":"2023-10-06T03:26:41.189533+0000","last_peered":"2023-10-06T03:26:41.189533+0000","last_clean":"2023-10-06T03:26:41.189533+0000","last_became_active":"2023-10-06T03:26:41.186767+0000","last_became_peered":"2023-10-06T03:26:41.186767+0000","last_unstale":"2023-10-06T03:26:41.189533+0000","last_undegraded":"2023-10-06T03:26:41.189533+0000","last_fullsized":"2023-10-06T03:26:41.189533+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:16.006272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"85'1","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.174973+0000","last_change":"2023-10-06T03:26:40.156968+0000","last_active":"2023-10-06T03:26:41.174973+0000","last_peered":"2023-10-06T03:26:41.174973+0000","last_clean":"2023-10-06T03:26:41.174973+0000","last_became_active":"2023-10-06T03:26:40.156714+0000","last_became_peered":"2023-10-06T03:26:40.156714+0000","last_unstale":"2023-10-06T03:26:41.174973+0000","last_undegraded":"2023-10-06T03:26:41.174973+0000","last_fullsized":"2023-10-06T03:26:41.174973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:33.992954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.184535+0000","last_change":"2023-10-06T03:26:41.182465+0000","last_active":"2023-10-06T03:26:41.184535+0000","last_peered":"2023-10-06T03:26:41.184535+0000","last_clean":"2023-10-06T03:26:41.184535+0000","last_became_active":"2023-10-06T03:26:41.182159+0000","last_became_peered":"2023-10-06T03:26:41.182159+0000","last_unstale":"2023-10-06T03:26:41.184535+0000","last_undegraded":"2023-10-06T03:26:41.184535+0000","last_fullsized":"2023-10-06T03:26:41.184535+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:50.828962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"85'1","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190304+0000","last_change":"2023-10-06T03:26:40.160522+0000","last_active":"2023-10-06T03:26:41.190304+0000","last_peered":"2023-10-06T03:26:41.190304+0000","last_clean":"2023-10-06T03:26:41.190304+0000","last_became_active":"2023-10-06T03:26:40.160250+0000","last_became_peered":"2023-10-06T03:26:40.160250+0000","last_unstale":"2023-10-06T03:26:41.190304+0000","last_undegraded":"2023-10-06T03:26:41.190304+0000","last_fullsized":"2023-10-06T03:26:41.190304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:46.879068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187140+0000","last_change":"2023-10-06T03:26:41.180588+0000","last_active":"2023-10-06T03:26:41.187140+0000","last_peered":"2023-10-06T03:26:41.187140+0000","last_clean":"2023-10-06T03:26:41.187140+0000","last_became_active":"2023-10-06T03:26:41.180425+0000","last_became_peered":"2023-10-06T03:26:41.180425+0000","last_unstale":"2023-10-06T03:26:41.187140+0000","last_undegraded":"2023-10-06T03:26:41.187140+0000","last_fullsized":"2023-10-06T03:26:41.187140+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:38.695262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.168042+0000","last_change":"2023-10-06T03:26:40.166184+0000","last_active":"2023-10-06T03:26:41.168042+0000","last_peered":"2023-10-06T03:26:41.168042+0000","last_clean":"2023-10-06T03:26:41.168042+0000","last_became_active":"2023-10-06T03:26:40.165916+0000","last_became_peered":"2023-10-06T03:26:40.165916+0000","last_unstale":"2023-10-06T03:26:41.168042+0000","last_undegraded":"2023-10-06T03:26:41.168042+0000","last_fullsized":"2023-10-06T03:26:41.168042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:47.927968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190150+0000","last_change":"2023-10-06T03:26:41.188870+0000","last_active":"2023-10-06T03:26:41.190150+0000","last_peered":"2023-10-06T03:26:41.190150+0000","last_clean":"2023-10-06T03:26:41.190150+0000","last_became_active":"2023-10-06T03:26:41.188596+0000","last_became_peered":"2023-10-06T03:26:41.188596+0000","last_unstale":"2023-10-06T03:26:41.190150+0000","last_undegraded":"2023-10-06T03:26:41.190150+0000","last_fullsized":"2023-10-06T03:26:41.190150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:14.080974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.157371+0000","last_change":"2023-10-06T03:26:40.153974+0000","last_active":"2023-10-06T03:26:40.157371+0000","last_peered":"2023-10-06T03:26:40.157371+0000","last_clean":"2023-10-06T03:26:40.157371+0000","last_became_active":"2023-10-06T03:26:40.153748+0000","last_became_peered":"2023-10-06T03:26:40.153748+0000","last_unstale":"2023-10-06T03:26:40.157371+0000","last_undegraded":"2023-10-06T03:26:40.157371+0000","last_fullsized":"2023-10-06T03:26:40.157371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:21.114105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187781+0000","last_change":"2023-10-06T03:26:41.182832+0000","last_active":"2023-10-06T03:26:41.187781+0000","last_peered":"2023-10-06T03:26:41.187781+0000","last_clean":"2023-10-06T03:26:41.187781+0000","last_became_active":"2023-10-06T03:26:41.182539+0000","last_became_peered":"2023-10-06T03:26:41.182539+0000","last_unstale":"2023-10-06T03:26:41.187781+0000","last_undegraded":"2023-10-06T03:26:41.187781+0000","last_fullsized":"2023-10-06T03:26:41.187781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:33.176297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.168039+0000","last_change":"2023-10-06T03:26:40.165068+0000","last_active":"2023-10-06T03:26:40.168039+0000","last_peered":"2023-10-06T03:26:40.168039+0000","last_clean":"2023-10-06T03:26:40.168039+0000","last_became_active":"2023-10-06T03:26:40.164658+0000","last_became_peered":"2023-10-06T03:26:40.164658+0000","last_unstale":"2023-10-06T03:26:40.168039+0000","last_undegraded":"2023-10-06T03:26:40.168039+0000","last_fullsized":"2023-10-06T03:26:40.168039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:36.915288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.188435+0000","last_change":"2023-10-06T03:26:41.182131+0000","last_active":"2023-10-06T03:26:41.188435+0000","last_peered":"2023-10-06T03:26:41.188435+0000","last_clean":"2023-10-06T03:26:41.188435+0000","last_became_active":"2023-10-06T03:26:41.181780+0000","last_became_peered":"2023-10-06T03:26:41.181780+0000","last_unstale":"2023-10-06T03:26:41.188435+0000","last_undegraded":"2023-10-06T03:26:41.188435+0000","last_fullsized":"2023-10-06T03:26:41.188435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:36.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167554+0000","last_change":"2023-10-06T03:26:40.166836+0000","last_active":"2023-10-06T03:26:41.167554+0000","last_peered":"2023-10-06T03:26:41.167554+0000","last_clean":"2023-10-06T03:26:41.167554+0000","last_became_active":"2023-10-06T03:26:40.166582+0000","last_became_peered":"2023-10-06T03:26:40.166582+0000","last_unstale":"2023-10-06T03:26:41.167554+0000","last_undegraded":"2023-10-06T03:26:41.167554+0000","last_fullsized":"2023-10-06T03:26:41.167554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:10.712556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182706+0000","last_change":"2023-10-06T03:26:41.177852+0000","last_active":"2023-10-06T03:26:41.182706+0000","last_peered":"2023-10-06T03:26:41.182706+0000","last_clean":"2023-10-06T03:26:41.182706+0000","last_became_active":"2023-10-06T03:26:41.177213+0000","last_became_peered":"2023-10-06T03:26:41.177213+0000","last_unstale":"2023-10-06T03:26:41.182706+0000","last_undegraded":"2023-10-06T03:26:41.182706+0000","last_fullsized":"2023-10-06T03:26:41.182706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:32.844768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"85'3","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191789+0000","last_change":"2023-10-06T03:26:40.167620+0000","last_active":"2023-10-06T03:26:41.191789+0000","last_peered":"2023-10-06T03:26:41.191789+0000","last_clean":"2023-10-06T03:26:41.191789+0000","last_became_active":"2023-10-06T03:26:40.167339+0000","last_became_peered":"2023-10-06T03:26:40.167339+0000","last_unstale":"2023-10-06T03:26:41.191789+0000","last_undegraded":"2023-10-06T03:26:41.191789+0000","last_fullsized":"2023-10-06T03:26:41.191789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:11.883121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.180703+0000","last_change":"2023-10-06T03:26:41.174484+0000","last_active":"2023-10-06T03:26:41.180703+0000","last_peered":"2023-10-06T03:26:41.180703+0000","last_clean":"2023-10-06T03:26:41.180703+0000","last_became_active":"2023-10-06T03:26:41.174160+0000","last_became_peered":"2023-10-06T03:26:41.174160+0000","last_unstale":"2023-10-06T03:26:41.180703+0000","last_undegraded":"2023-10-06T03:26:41.180703+0000","last_fullsized":"2023-10-06T03:26:41.180703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:29.499328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"85'6","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.195154+0000","last_change":"2023-10-06T03:26:40.164899+0000","last_active":"2023-10-06T03:26:41.195154+0000","last_peered":"2023-10-06T03:26:41.195154+0000","last_clean":"2023-10-06T03:26:41.195154+0000","last_became_active":"2023-10-06T03:26:40.164593+0000","last_became_peered":"2023-10-06T03:26:40.164593+0000","last_unstale":"2023-10-06T03:26:41.195154+0000","last_undegraded":"2023-10-06T03:26:41.195154+0000","last_fullsized":"2023-10-06T03:26:41.195154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:16.891872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.176449+0000","last_change":"2023-10-06T03:26:41.171882+0000","last_active":"2023-10-06T03:26:41.176449+0000","last_peered":"2023-10-06T03:26:41.176449+0000","last_clean":"2023-10-06T03:26:41.176449+0000","last_became_active":"2023-10-06T03:26:41.171640+0000","last_became_peered":"2023-10-06T03:26:41.171640+0000","last_unstale":"2023-10-06T03:26:41.176449+0000","last_undegraded":"2023-10-06T03:26:41.176449+0000","last_fullsized":"2023-10-06T03:26:41.176449+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:29.499328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"85'2","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.188597+0000","last_change":"2023-10-06T03:26:40.160544+0000","last_active":"2023-10-06T03:26:41.188597+0000","last_peered":"2023-10-06T03:26:41.188597+0000","last_clean":"2023-10-06T03:26:41.188597+0000","last_became_active":"2023-10-06T03:26:40.160310+0000","last_became_peered":"2023-10-06T03:26:40.160310+0000","last_unstale":"2023-10-06T03:26:41.188597+0000","last_undegraded":"2023-10-06T03:26:41.188597+0000","last_fullsized":"2023-10-06T03:26:41.188597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:05.415293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.183486+0000","last_change":"2023-10-06T03:26:41.183486+0000","last_active":"2023-10-06T03:26:41.183486+0000","last_peered":"2023-10-06T03:26:41.183486+0000","last_clean":"2023-10-06T03:26:41.183486+0000","last_became_active":"2023-10-06T03:26:41.183228+0000","last_became_peered":"2023-10-06T03:26:41.183228+0000","last_unstale":"2023-10-06T03:26:41.183486+0000","last_undegraded":"2023-10-06T03:26:41.183486+0000","last_fullsized":"2023-10-06T03:26:41.183486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:15.624034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.160445+0000","last_change":"2023-10-06T03:26:40.155421+0000","last_active":"2023-10-06T03:26:41.160445+0000","last_peered":"2023-10-06T03:26:41.160445+0000","last_clean":"2023-10-06T03:26:41.160445+0000","last_became_active":"2023-10-06T03:26:40.155161+0000","last_became_peered":"2023-10-06T03:26:40.155161+0000","last_unstale":"2023-10-06T03:26:41.160445+0000","last_undegraded":"2023-10-06T03:26:41.160445+0000","last_fullsized":"2023-10-06T03:26:41.160445+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:20.244680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190138+0000","last_change":"2023-10-06T03:26:41.189034+0000","last_active":"2023-10-06T03:26:41.190138+0000","last_peered":"2023-10-06T03:26:41.190138+0000","last_clean":"2023-10-06T03:26:41.190138+0000","last_became_active":"2023-10-06T03:26:41.188738+0000","last_became_peered":"2023-10-06T03:26:41.188738+0000","last_unstale":"2023-10-06T03:26:41.190138+0000","last_undegraded":"2023-10-06T03:26:41.190138+0000","last_fullsized":"2023-10-06T03:26:41.190138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:04.940860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.163889+0000","last_change":"2023-10-06T03:26:40.158729+0000","last_active":"2023-10-06T03:26:41.163889+0000","last_peered":"2023-10-06T03:26:41.163889+0000","last_clean":"2023-10-06T03:26:41.163889+0000","last_became_active":"2023-10-06T03:26:40.158441+0000","last_became_peered":"2023-10-06T03:26:40.158441+0000","last_unstale":"2023-10-06T03:26:41.163889+0000","last_undegraded":"2023-10-06T03:26:41.163889+0000","last_fullsized":"2023-10-06T03:26:41.163889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:52.374583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.171865+0000","last_change":"2023-10-06T03:26:41.165812+0000","last_active":"2023-10-06T03:26:41.171865+0000","last_peered":"2023-10-06T03:26:41.171865+0000","last_clean":"2023-10-06T03:26:41.171865+0000","last_became_active":"2023-10-06T03:26:41.165391+0000","last_became_peered":"2023-10-06T03:26:41.165391+0000","last_unstale":"2023-10-06T03:26:41.171865+0000","last_undegraded":"2023-10-06T03:26:41.171865+0000","last_fullsized":"2023-10-06T03:26:41.171865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:20.673510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"85'8","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.192731+0000","last_change":"2023-10-06T03:26:40.160897+0000","last_active":"2023-10-06T03:26:41.192731+0000","last_peered":"2023-10-06T03:26:41.192731+0000","last_clean":"2023-10-06T03:26:41.192731+0000","last_became_active":"2023-10-06T03:26:40.160516+0000","last_became_peered":"2023-10-06T03:26:40.160516+0000","last_unstale":"2023-10-06T03:26:41.192731+0000","last_undegraded":"2023-10-06T03:26:41.192731+0000","last_fullsized":"2023-10-06T03:26:41.192731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:19.481133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190042+0000","last_change":"2023-10-06T03:26:41.186444+0000","last_active":"2023-10-06T03:26:41.190042+0000","last_peered":"2023-10-06T03:26:41.190042+0000","last_clean":"2023-10-06T03:26:41.190042+0000","last_became_active":"2023-10-06T03:26:41.185887+0000","last_became_peered":"2023-10-06T03:26:41.185887+0000","last_unstale":"2023-10-06T03:26:41.190042+0000","last_undegraded":"2023-10-06T03:26:41.190042+0000","last_fullsized":"2023-10-06T03:26:41.190042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:55.814554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"85'2","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187979+0000","last_change":"2023-10-06T03:26:40.166885+0000","last_active":"2023-10-06T03:26:41.187979+0000","last_peered":"2023-10-06T03:26:41.187979+0000","last_clean":"2023-10-06T03:26:41.187979+0000","last_became_active":"2023-10-06T03:26:40.166642+0000","last_became_peered":"2023-10-06T03:26:40.166642+0000","last_unstale":"2023-10-06T03:26:41.187979+0000","last_undegraded":"2023-10-06T03:26:41.187979+0000","last_fullsized":"2023-10-06T03:26:41.187979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:39.187363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.178388+0000","last_change":"2023-10-06T03:26:41.178388+0000","last_active":"2023-10-06T03:26:41.178388+0000","last_peered":"2023-10-06T03:26:41.178388+0000","last_clean":"2023-10-06T03:26:41.178388+0000","last_became_active":"2023-10-06T03:26:41.178101+0000","last_became_peered":"2023-10-06T03:26:41.178101+0000","last_unstale":"2023-10-06T03:26:41.178388+0000","last_undegraded":"2023-10-06T03:26:41.178388+0000","last_fullsized":"2023-10-06T03:26:41.178388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:22.157109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167560+0000","last_change":"2023-10-06T03:26:40.166089+0000","last_active":"2023-10-06T03:26:41.167560+0000","last_peered":"2023-10-06T03:26:41.167560+0000","last_clean":"2023-10-06T03:26:41.167560+0000","last_became_active":"2023-10-06T03:26:40.165848+0000","last_became_peered":"2023-10-06T03:26:40.165848+0000","last_unstale":"2023-10-06T03:26:41.167560+0000","last_undegraded":"2023-10-06T03:26:41.167560+0000","last_fullsized":"2023-10-06T03:26:41.167560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:37.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.183819+0000","last_change":"2023-10-06T03:26:41.183819+0000","last_active":"2023-10-06T03:26:41.183819+0000","last_peered":"2023-10-06T03:26:41.183819+0000","last_clean":"2023-10-06T03:26:41.183819+0000","last_became_active":"2023-10-06T03:26:41.183547+0000","last_became_peered":"2023-10-06T03:26:41.183547+0000","last_unstale":"2023-10-06T03:26:41.183819+0000","last_undegraded":"2023-10-06T03:26:41.183819+0000","last_fullsized":"2023-10-06T03:26:41.183819+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:51.800170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167577+0000","last_change":"2023-10-06T03:26:40.161111+0000","last_active":"2023-10-06T03:26:41.167577+0000","last_peered":"2023-10-06T03:26:41.167577+0000","last_clean":"2023-10-06T03:26:41.167577+0000","last_became_active":"2023-10-06T03:26:40.160879+0000","last_became_peered":"2023-10-06T03:26:40.160879+0000","last_unstale":"2023-10-06T03:26:41.167577+0000","last_undegraded":"2023-10-06T03:26:41.167577+0000","last_fullsized":"2023-10-06T03:26:41.167577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:28.474253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182598+0000","last_change":"2023-10-06T03:26:41.176123+0000","last_active":"2023-10-06T03:26:41.182598+0000","last_peered":"2023-10-06T03:26:41.182598+0000","last_clean":"2023-10-06T03:26:41.182598+0000","last_became_active":"2023-10-06T03:26:41.175813+0000","last_became_peered":"2023-10-06T03:26:41.175813+0000","last_unstale":"2023-10-06T03:26:41.182598+0000","last_undegraded":"2023-10-06T03:26:41.182598+0000","last_fullsized":"2023-10-06T03:26:41.182598+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:38.695262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166409+0000","last_change":"2023-10-06T03:26:40.163889+0000","last_active":"2023-10-06T03:26:41.166409+0000","last_peered":"2023-10-06T03:26:41.166409+0000","last_clean":"2023-10-06T03:26:41.166409+0000","last_became_active":"2023-10-06T03:26:40.163611+0000","last_became_peered":"2023-10-06T03:26:40.163611+0000","last_unstale":"2023-10-06T03:26:41.166409+0000","last_undegraded":"2023-10-06T03:26:41.166409+0000","last_fullsized":"2023-10-06T03:26:41.166409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:11.883121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.176633+0000","last_change":"2023-10-06T03:26:41.170557+0000","last_active":"2023-10-06T03:26:41.176633+0000","last_peered":"2023-10-06T03:26:41.176633+0000","last_clean":"2023-10-06T03:26:41.176633+0000","last_became_active":"2023-10-06T03:26:41.170341+0000","last_became_peered":"2023-10-06T03:26:41.170341+0000","last_unstale":"2023-10-06T03:26:41.176633+0000","last_undegraded":"2023-10-06T03:26:41.176633+0000","last_fullsized":"2023-10-06T03:26:41.176633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:15.624034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166269+0000","last_change":"2023-10-06T03:26:40.164740+0000","last_active":"2023-10-06T03:26:41.166269+0000","last_peered":"2023-10-06T03:26:41.166269+0000","last_clean":"2023-10-06T03:26:41.166269+0000","last_became_active":"2023-10-06T03:26:40.164485+0000","last_became_peered":"2023-10-06T03:26:40.164485+0000","last_unstale":"2023-10-06T03:26:41.166269+0000","last_undegraded":"2023-10-06T03:26:41.166269+0000","last_fullsized":"2023-10-06T03:26:41.166269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:31.840879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.185011+0000","last_change":"2023-10-06T03:26:41.169997+0000","last_active":"2023-10-06T03:26:41.185011+0000","last_peered":"2023-10-06T03:26:41.185011+0000","last_clean":"2023-10-06T03:26:41.185011+0000","last_became_active":"2023-10-06T03:26:41.169684+0000","last_became_peered":"2023-10-06T03:26:41.169684+0000","last_unstale":"2023-10-06T03:26:41.185011+0000","last_undegraded":"2023-10-06T03:26:41.185011+0000","last_fullsized":"2023-10-06T03:26:41.185011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:48.984505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.165745+0000","last_change":"2023-10-06T03:26:40.158736+0000","last_active":"2023-10-06T03:26:41.165745+0000","last_peered":"2023-10-06T03:26:41.165745+0000","last_clean":"2023-10-06T03:26:41.165745+0000","last_became_active":"2023-10-06T03:26:40.158057+0000","last_became_peered":"2023-10-06T03:26:40.158057+0000","last_unstale":"2023-10-06T03:26:41.165745+0000","last_undegraded":"2023-10-06T03:26:41.165745+0000","last_fullsized":"2023-10-06T03:26:41.165745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:15.857016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.176511+0000","last_change":"2023-10-06T03:26:41.170440+0000","last_active":"2023-10-06T03:26:41.176511+0000","last_peered":"2023-10-06T03:26:41.176511+0000","last_clean":"2023-10-06T03:26:41.176511+0000","last_became_active":"2023-10-06T03:26:41.170185+0000","last_became_peered":"2023-10-06T03:26:41.170185+0000","last_unstale":"2023-10-06T03:26:41.176511+0000","last_undegraded":"2023-10-06T03:26:41.176511+0000","last_fullsized":"2023-10-06T03:26:41.176511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:51.800170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167139+0000","last_change":"2023-10-06T03:26:40.153843+0000","last_active":"2023-10-06T03:26:41.167139+0000","last_peered":"2023-10-06T03:26:41.167139+0000","last_clean":"2023-10-06T03:26:41.167139+0000","last_became_active":"2023-10-06T03:26:40.153572+0000","last_became_peered":"2023-10-06T03:26:40.153572+0000","last_unstale":"2023-10-06T03:26:41.167139+0000","last_undegraded":"2023-10-06T03:26:41.167139+0000","last_fullsized":"2023-10-06T03:26:41.167139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:35.067349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182623+0000","last_change":"2023-10-06T03:26:41.175608+0000","last_active":"2023-10-06T03:26:41.182623+0000","last_peered":"2023-10-06T03:26:41.182623+0000","last_clean":"2023-10-06T03:26:41.182623+0000","last_became_active":"2023-10-06T03:26:41.175402+0000","last_became_peered":"2023-10-06T03:26:41.175402+0000","last_unstale":"2023-10-06T03:26:41.182623+0000","last_undegraded":"2023-10-06T03:26:41.182623+0000","last_fullsized":"2023-10-06T03:26:41.182623+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:55.815521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.160332+0000","last_change":"2023-10-06T03:26:40.159588+0000","last_active":"2023-10-06T03:26:41.160332+0000","last_peered":"2023-10-06T03:26:41.160332+0000","last_clean":"2023-10-06T03:26:41.160332+0000","last_became_active":"2023-10-06T03:26:40.159357+0000","last_became_peered":"2023-10-06T03:26:40.159357+0000","last_unstale":"2023-10-06T03:26:41.160332+0000","last_undegraded":"2023-10-06T03:26:41.160332+0000","last_fullsized":"2023-10-06T03:26:41.160332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:24.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181361+0000","last_change":"2023-10-06T03:26:41.173922+0000","last_active":"2023-10-06T03:26:41.181361+0000","last_peered":"2023-10-06T03:26:41.181361+0000","last_clean":"2023-10-06T03:26:41.181361+0000","last_became_active":"2023-10-06T03:26:41.173680+0000","last_became_peered":"2023-10-06T03:26:41.173680+0000","last_unstale":"2023-10-06T03:26:41.181361+0000","last_undegraded":"2023-10-06T03:26:41.181361+0000","last_fullsized":"2023-10-06T03:26:41.181361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:22.157109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.170959+0000","last_change":"2023-10-06T03:26:40.168766+0000","last_active":"2023-10-06T03:26:40.170959+0000","last_peered":"2023-10-06T03:26:40.170959+0000","last_clean":"2023-10-06T03:26:40.170959+0000","last_became_active":"2023-10-06T03:26:40.168448+0000","last_became_peered":"2023-10-06T03:26:40.168448+0000","last_unstale":"2023-10-06T03:26:40.170959+0000","last_undegraded":"2023-10-06T03:26:40.170959+0000","last_fullsized":"2023-10-06T03:26:40.170959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:35.791993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":72,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.163866+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:26:41.163866+0000","last_peered":"2023-10-06T03:26:41.163866+0000","last_clean":"2023-10-06T03:26:41.163866+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:26:41.163866+0000","last_undegraded":"2023-10-06T03:26:41.163866+0000","last_fullsized":"2023-10-06T03:26:41.163866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181233+0000","last_change":"2023-10-06T03:26:41.171984+0000","last_active":"2023-10-06T03:26:41.181233+0000","last_peered":"2023-10-06T03:26:41.181233+0000","last_clean":"2023-10-06T03:26:41.181233+0000","last_became_active":"2023-10-06T03:26:41.171648+0000","last_became_peered":"2023-10-06T03:26:41.171648+0000","last_unstale":"2023-10-06T03:26:41.181233+0000","last_undegraded":"2023-10-06T03:26:41.181233+0000","last_fullsized":"2023-10-06T03:26:41.181233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:12.801493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"85'2","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191733+0000","last_change":"2023-10-06T03:26:40.166131+0000","last_active":"2023-10-06T03:26:41.191733+0000","last_peered":"2023-10-06T03:26:41.191733+0000","last_clean":"2023-10-06T03:26:41.191733+0000","last_became_active":"2023-10-06T03:26:40.165860+0000","last_became_peered":"2023-10-06T03:26:40.165860+0000","last_unstale":"2023-10-06T03:26:41.191733+0000","last_undegraded":"2023-10-06T03:26:41.191733+0000","last_fullsized":"2023-10-06T03:26:41.191733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:47.980616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":66,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167158+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:26:41.167158+0000","last_peered":"2023-10-06T03:26:41.167158+0000","last_clean":"2023-10-06T03:26:41.167158+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:26:41.167158+0000","last_undegraded":"2023-10-06T03:26:41.167158+0000","last_fullsized":"2023-10-06T03:26:41.167158+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191129+0000","last_change":"2023-10-06T03:26:41.187343+0000","last_active":"2023-10-06T03:26:41.191129+0000","last_peered":"2023-10-06T03:26:41.191129+0000","last_clean":"2023-10-06T03:26:41.191129+0000","last_became_active":"2023-10-06T03:26:41.186782+0000","last_became_peered":"2023-10-06T03:26:41.186782+0000","last_unstale":"2023-10-06T03:26:41.191129+0000","last_undegraded":"2023-10-06T03:26:41.191129+0000","last_fullsized":"2023-10-06T03:26:41.191129+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:27.036395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167675+0000","last_change":"2023-10-06T03:26:40.165590+0000","last_active":"2023-10-06T03:26:41.167675+0000","last_peered":"2023-10-06T03:26:41.167675+0000","last_clean":"2023-10-06T03:26:41.167675+0000","last_became_active":"2023-10-06T03:26:40.164986+0000","last_became_peered":"2023-10-06T03:26:40.164986+0000","last_unstale":"2023-10-06T03:26:41.167675+0000","last_undegraded":"2023-10-06T03:26:41.167675+0000","last_fullsized":"2023-10-06T03:26:41.167675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:32.906810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":64,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.147953+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:26:40.147953+0000","last_peered":"2023-10-06T03:26:40.147953+0000","last_clean":"2023-10-06T03:26:40.147953+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:26:40.147953+0000","last_undegraded":"2023-10-06T03:26:40.147953+0000","last_fullsized":"2023-10-06T03:26:40.147953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166737+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:26:41.166737+0000","last_peered":"2023-10-06T03:26:41.166737+0000","last_clean":"2023-10-06T03:26:41.166737+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:26:41.166737+0000","last_undegraded":"2023-10-06T03:26:41.166737+0000","last_fullsized":"2023-10-06T03:26:41.166737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.192127+0000","last_change":"2023-10-06T03:26:41.192127+0000","last_active":"2023-10-06T03:26:41.192127+0000","last_peered":"2023-10-06T03:26:41.192127+0000","last_clean":"2023-10-06T03:26:41.192127+0000","last_became_active":"2023-10-06T03:26:41.186868+0000","last_became_peered":"2023-10-06T03:26:41.186868+0000","last_unstale":"2023-10-06T03:26:41.192127+0000","last_undegraded":"2023-10-06T03:26:41.192127+0000","last_fullsized":"2023-10-06T03:26:41.192127+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:04.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"85'1","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190735+0000","last_change":"2023-10-06T03:26:40.164418+0000","last_active":"2023-10-06T03:26:41.190735+0000","last_peered":"2023-10-06T03:26:41.190735+0000","last_clean":"2023-10-06T03:26:41.190735+0000","last_became_active":"2023-10-06T03:26:40.164137+0000","last_became_peered":"2023-10-06T03:26:40.164137+0000","last_unstale":"2023-10-06T03:26:41.190735+0000","last_undegraded":"2023-10-06T03:26:41.190735+0000","last_fullsized":"2023-10-06T03:26:41.190735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:53.090658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167141+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:26:41.167141+0000","last_peered":"2023-10-06T03:26:41.167141+0000","last_clean":"2023-10-06T03:26:41.167141+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:26:41.167141+0000","last_undegraded":"2023-10-06T03:26:41.167141+0000","last_fullsized":"2023-10-06T03:26:41.167141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181416+0000","last_change":"2023-10-06T03:26:41.172342+0000","last_active":"2023-10-06T03:26:41.181416+0000","last_peered":"2023-10-06T03:26:41.181416+0000","last_clean":"2023-10-06T03:26:41.181416+0000","last_became_active":"2023-10-06T03:26:41.171714+0000","last_became_peered":"2023-10-06T03:26:41.171714+0000","last_unstale":"2023-10-06T03:26:41.181416+0000","last_undegraded":"2023-10-06T03:26:41.181416+0000","last_fullsized":"2023-10-06T03:26:41.181416+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:37.007531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"85'1","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.192479+0000","last_change":"2023-10-06T03:26:40.164762+0000","last_active":"2023-10-06T03:26:41.192479+0000","last_peered":"2023-10-06T03:26:41.192479+0000","last_clean":"2023-10-06T03:26:41.192479+0000","last_became_active":"2023-10-06T03:26:40.164445+0000","last_became_peered":"2023-10-06T03:26:40.164445+0000","last_unstale":"2023-10-06T03:26:41.192479+0000","last_undegraded":"2023-10-06T03:26:41.192479+0000","last_fullsized":"2023-10-06T03:26:41.192479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:15.857016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166551+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:26:41.166551+0000","last_peered":"2023-10-06T03:26:41.166551+0000","last_clean":"2023-10-06T03:26:41.166551+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:26:41.166551+0000","last_undegraded":"2023-10-06T03:26:41.166551+0000","last_fullsized":"2023-10-06T03:26:41.166551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.183271+0000","last_change":"2023-10-06T03:26:41.179522+0000","last_active":"2023-10-06T03:26:41.183271+0000","last_peered":"2023-10-06T03:26:41.183271+0000","last_clean":"2023-10-06T03:26:41.183271+0000","last_became_active":"2023-10-06T03:26:41.179222+0000","last_became_peered":"2023-10-06T03:26:41.179222+0000","last_unstale":"2023-10-06T03:26:41.183271+0000","last_undegraded":"2023-10-06T03:26:41.183271+0000","last_fullsized":"2023-10-06T03:26:41.183271+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:47.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"85'2","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.192064+0000","last_change":"2023-10-06T03:26:40.164913+0000","last_active":"2023-10-06T03:26:41.192064+0000","last_peered":"2023-10-06T03:26:41.192064+0000","last_clean":"2023-10-06T03:26:41.192064+0000","last_became_active":"2023-10-06T03:26:40.164628+0000","last_became_peered":"2023-10-06T03:26:40.164628+0000","last_unstale":"2023-10-06T03:26:41.192064+0000","last_undegraded":"2023-10-06T03:26:41.192064+0000","last_fullsized":"2023-10-06T03:26:41.192064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:37.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":63,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.159699+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:26:40.159699+0000","last_peered":"2023-10-06T03:26:40.159699+0000","last_clean":"2023-10-06T03:26:40.159699+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:26:40.159699+0000","last_undegraded":"2023-10-06T03:26:40.159699+0000","last_fullsized":"2023-10-06T03:26:40.159699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181109+0000","last_change":"2023-10-06T03:26:41.171726+0000","last_active":"2023-10-06T03:26:41.181109+0000","last_peered":"2023-10-06T03:26:41.181109+0000","last_clean":"2023-10-06T03:26:41.181109+0000","last_became_active":"2023-10-06T03:26:41.171453+0000","last_became_peered":"2023-10-06T03:26:41.171453+0000","last_unstale":"2023-10-06T03:26:41.181109+0000","last_undegraded":"2023-10-06T03:26:41.181109+0000","last_fullsized":"2023-10-06T03:26:41.181109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:37.919178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.170754+0000","last_change":"2023-10-06T03:26:40.166282+0000","last_active":"2023-10-06T03:26:40.170754+0000","last_peered":"2023-10-06T03:26:40.170754+0000","last_clean":"2023-10-06T03:26:40.170754+0000","last_became_active":"2023-10-06T03:26:40.166034+0000","last_became_peered":"2023-10-06T03:26:40.166034+0000","last_unstale":"2023-10-06T03:26:40.170754+0000","last_undegraded":"2023-10-06T03:26:40.170754+0000","last_fullsized":"2023-10-06T03:26:40.170754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:14.620144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166865+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:26:41.166865+0000","last_peered":"2023-10-06T03:26:41.166865+0000","last_clean":"2023-10-06T03:26:41.166865+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:26:41.166865+0000","last_undegraded":"2023-10-06T03:26:41.166865+0000","last_fullsized":"2023-10-06T03:26:41.166865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182645+0000","last_change":"2023-10-06T03:26:41.179387+0000","last_active":"2023-10-06T03:26:41.182645+0000","last_peered":"2023-10-06T03:26:41.182645+0000","last_clean":"2023-10-06T03:26:41.182645+0000","last_became_active":"2023-10-06T03:26:41.179103+0000","last_became_peered":"2023-10-06T03:26:41.179103+0000","last_unstale":"2023-10-06T03:26:41.182645+0000","last_undegraded":"2023-10-06T03:26:41.182645+0000","last_fullsized":"2023-10-06T03:26:41.182645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:46.933356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167065+0000","last_change":"2023-10-06T03:26:40.162473+0000","last_active":"2023-10-06T03:26:41.167065+0000","last_peered":"2023-10-06T03:26:41.167065+0000","last_clean":"2023-10-06T03:26:41.167065+0000","last_became_active":"2023-10-06T03:26:40.162225+0000","last_became_peered":"2023-10-06T03:26:40.162225+0000","last_unstale":"2023-10-06T03:26:41.167065+0000","last_undegraded":"2023-10-06T03:26:41.167065+0000","last_fullsized":"2023-10-06T03:26:41.167065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:04.339222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166741+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:26:41.166741+0000","last_peered":"2023-10-06T03:26:41.166741+0000","last_clean":"2023-10-06T03:26:41.166741+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:26:41.166741+0000","last_undegraded":"2023-10-06T03:26:41.166741+0000","last_fullsized":"2023-10-06T03:26:41.166741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298900,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072940,"statfs":{"total":96636764160,"available":96330690560,"internally_reserved":0,"allocated":1650688,"data_stored":1085227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69199999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.72999999999999998,"15min":0.76300000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66200000000000003,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.752,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67100000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81699999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73599999999999999,"5min":1.103,"15min":1.103},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81799999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.878,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298332,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073508,"statfs":{"total":96636764160,"available":96331272192,"internally_reserved":0,"allocated":1069056,"data_stored":502332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.343,"15min":1.343},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.329,"15min":1.329},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.76400000000000001,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80400000000000005,"15min":0.83999999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.042,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.80600000000000005,"15min":0.84199999999999997},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.496},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.626,"15min":0.625},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298892,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072948,"statfs":{"total":96636764160,"available":96330698752,"internally_reserved":0,"allocated":1642496,"data_stored":1085115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.38700000000000001,"15min":0.40300000000000002},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.38500000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.41199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.215},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.40600000000000003,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.19400000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.44800000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.44600000000000001,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.41699999999999998,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.252}]},{"osd":4,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.626},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.745,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.504},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80100000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.70899999999999996,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298324,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073516,"statfs":{"total":96636764160,"available":96331280384,"internally_reserved":0,"allocated":1060864,"data_stored":500909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.435,"5min":12.19,"15min":12.19},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.64000000000000001,"15min":0.68799999999999994},"min":{"1min":0.28599999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46800000000000003,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50800000000000001,"5min":1.357,"15min":1.357},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.92000000000000004,"15min":1.02},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.495,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.29099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.49099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.089,"15min":1.179},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":16.919,"15min":16.919},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.503},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.1000000000000001,"15min":1.1930000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79700000000000004,"5min":16.948,"15min":16.948},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67700000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56899999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.1140000000000001,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":16.881,"15min":16.881},"last":0.52900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298316,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073524,"statfs":{"total":96636764160,"available":96331288576,"internally_reserved":0,"allocated":1052672,"data_stored":494781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33800000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.51500000000000001,"5min":0.62,"15min":0.62},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.48599999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.375},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.42799999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.35299999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52100000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.38700000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.875,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47999999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.432},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1077248,"data_stored":503266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.253},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.28199999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32400000000000001,"15min":0.32600000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42699999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.29799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49199999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77100000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75700000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54600000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.504},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.45200000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.44}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298344,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073496,"statfs":{"total":96636764160,"available":96331259904,"internally_reserved":0,"allocated":1081344,"data_stored":503368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2709999999999999,"5min":4.758,"15min":4.758},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.88900000000000001,"15min":0.95299999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.434}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.502},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84399999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298316,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073524,"statfs":{"total":96636764160,"available":96331288576,"internally_reserved":0,"allocated":1052672,"data_stored":494817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60699999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.64700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.496}]},{"osd":2,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69399999999999995,"5min":0.999,"15min":0.999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68500000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73399999999999999,"5min":0.746,"15min":0.746},"last":0.437},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":1.04,"15min":1.04},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.378,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":1.284,"15min":1.284},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:26:45.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:26:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.370+0000 7f493eace700 1 Processor -- start 2023-10-06T03:26:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.370+0000 7f493eace700 1 -- start start 2023-10-06T03:26:45.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493eace700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4938159480 0x7f49380b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493eace700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49380cb7e0 con 0x7f49380b2140 2023-10-06T03:26:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493eace700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49380b08a0 con 0x7f49380b3610 2023-10-06T03:26:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493eace700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49380cb190 con 0x7f4938159480 2023-10-06T03:26:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493dacc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4938159480 0x7f49380b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493e2cd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f49380b2140 0x7f49380b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42018/0 (socket says 172.21.15.84:42018) 2023-10-06T03:26:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493dacc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4938159480 0x7f49380b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45332/0 (socket says 172.21.15.84:45332) 2023-10-06T03:26:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493e2cd700 1 -- 172.21.15.84:0/1596076076 learned_addr learned my addr 172.21.15.84:0/1596076076 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493dacc700 1 -- 172.21.15.84:0/1596076076 >> v1:172.21.15.131:6789/0 conn(0x7f49380b3610 legacy=0x7f49380cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493dacc700 1 -- 172.21.15.84:0/1596076076 >> v1:172.21.15.84:6789/0 conn(0x7f49380b2140 legacy=0x7f49380b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493dacc700 1 -- 172.21.15.84:0/1596076076 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380cb470 con 0x7f4938159480 2023-10-06T03:26:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.371+0000 7f493caca700 1 -- 172.21.15.84:0/1596076076 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495421629 0 0) 0x7f49380cb7e0 con 0x7f49380b2140 2023-10-06T03:26:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493dacc700 1 --2- 172.21.15.84:0/1596076076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 0x7f49380b30d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f49340098e0 tx=0x7f49340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa76cc5211254d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493caca700 1 -- 172.21.15.84:0/1596076076 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934009e80 con 0x7f4938159480 2023-10-06T03:26:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493caca700 1 -- 172.21.15.84:0/1596076076 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400b860 con 0x7f4938159480 2023-10-06T03:26:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493caca700 1 -- 172.21.15.84:0/1596076076 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400bbe0 con 0x7f4938159480 2023-10-06T03:26:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493eace700 1 -- 172.21.15.84:0/1596076076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 msgr2=0x7f49380b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493eace700 1 --2- 172.21.15.84:0/1596076076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 0x7f49380b30d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f49340098e0 tx=0x7f49340091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493eace700 1 -- 172.21.15.84:0/1596076076 shutdown_connections 2023-10-06T03:26:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493eace700 1 --2- 172.21.15.84:0/1596076076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 0x7f49380b30d0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493eace700 1 -- 172.21.15.84:0/1596076076 >> 172.21.15.84:0/1596076076 conn(0x7f493806ed20 msgr2=0x7f493806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493eace700 1 -- 172.21.15.84:0/1596076076 shutdown_connections 2023-10-06T03:26:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.372+0000 7f493eace700 1 -- 172.21.15.84:0/1596076076 wait complete. 2023-10-06T03:26:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.373+0000 7f493eace700 1 Processor -- start 2023-10-06T03:26:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.373+0000 7f493eace700 1 -- start start 2023-10-06T03:26:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493eace700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49380b2140 0x7f49381539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493eace700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49380b3610 0x7f49380b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493eace700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 0x7f49380b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493eace700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493815a290 con 0x7f4938159480 2023-10-06T03:26:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493eace700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380cf6e0 con 0x7f49380b2140 2023-10-06T03:26:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493eace700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49380cf9c0 con 0x7f49380b3610 2023-10-06T03:26:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493e2cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 0x7f49380b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493e2cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 0x7f49380b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45334/0 (socket says 172.21.15.84:45334) 2023-10-06T03:26:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493e2cd700 1 -- 172.21.15.84:0/161683688 learned_addr learned my addr 172.21.15.84:0/161683688 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493dacc700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49380b2140 0x7f49381539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.374+0000 7f493d2cb700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49380b3610 0x7f49380b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f493e2cd700 1 -- 172.21.15.84:0/161683688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49380b3610 msgr2=0x7f49380b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f493e2cd700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49380b3610 0x7f49380b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f493e2cd700 1 -- 172.21.15.84:0/161683688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49380b2140 msgr2=0x7f49381539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f493e2cd700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49380b2140 0x7f49381539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f493e2cd700 1 -- 172.21.15.84:0/161683688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934009420 con 0x7f4938159480 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f493e2cd700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 0x7f49380b4cc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f493000cc90 tx=0x7f4930001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f492dffb700 1 -- 172.21.15.84:0/161683688 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000a8b0 con 0x7f4938159480 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f492dffb700 1 -- 172.21.15.84:0/161683688 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493000aa10 con 0x7f4938159480 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f492dffb700 1 -- 172.21.15.84:0/161683688 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000add0 con 0x7f4938159480 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f493eace700 1 -- 172.21.15.84:0/161683688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49380cfca0 con 0x7f4938159480 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.375+0000 7f493eace700 1 -- 172.21.15.84:0/161683688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4938153f10 con 0x7f4938159480 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.376+0000 7f493eace700 1 -- 172.21.15.84:0/161683688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493815a060 con 0x7f4938159480 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.376+0000 7f492dffb700 1 -- 172.21.15.84:0/161683688 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4930007300 con 0x7f4938159480 2023-10-06T03:26:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.377+0000 7f492dffb700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f491c066f30 0x7f491c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.377+0000 7f492dffb700 1 -- 172.21.15.84:0/161683688 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4930084ab0 con 0x7f4938159480 2023-10-06T03:26:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.377+0000 7f493dacc700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f491c066f30 0x7f491c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.377+0000 7f493dacc700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f491c066f30 0x7f491c0693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f49340091e0 tx=0x7f4934016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.381+0000 7f492dffb700 1 -- 172.21.15.84:0/161683688 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f493815a060 con 0x7f4938159480 2023-10-06T03:26:45.457 INFO:tasks.ceph.mds.b.smithi131.stderr:2023-10-06T03:26:45.455+0000 7fa792b98700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.558+0000 7f493eace700 1 -- 172.21.15.84:0/161683688 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f493815a060 con 0x7f491c066f30 2023-10-06T03:26:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.567+0000 7f492dffb700 1 -- 172.21.15.84:0/161683688 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311902 (secure 0 0 0) 0x7f493815a060 con 0x7f491c066f30 2023-10-06T03:26:45.572 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 -- 172.21.15.84:0/161683688 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f491c066f30 msgr2=0x7f491c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f491c066f30 0x7f491c0693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f49340091e0 tx=0x7f4934016000 comp rx=0 tx=0).stop 2023-10-06T03:26:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 -- 172.21.15.84:0/161683688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 msgr2=0x7f49380b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 0x7f49380b4cc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f493000cc90 tx=0x7f4930001a80 comp rx=0 tx=0).stop 2023-10-06T03:26:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 -- 172.21.15.84:0/161683688 shutdown_connections 2023-10-06T03:26:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f491c066f30 0x7f491c0693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49380b2140 0x7f49381539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159480 0x7f49380b4cc0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 --2- 172.21.15.84:0/161683688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49380b3610 0x7f49380b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 -- 172.21.15.84:0/161683688 >> 172.21.15.84:0/161683688 conn(0x7f493806ed20 msgr2=0x7f49380b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 -- 172.21.15.84:0/161683688 shutdown_connections 2023-10-06T03:26:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.570+0000 7f493eace700 1 -- 172.21.15.84:0/161683688 wait complete. 2023-10-06T03:26:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:26:45.584 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2023-10-06T03:26:45.075974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387764,"kb_used_data":9460,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586956,"statfs":{"total":773094113280,"available":770649042944,"internally_reserved":0,"allocated":9687040,"data_stored":5169815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.934325"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181643+0000","last_change":"2023-10-06T03:26:41.181643+0000","last_active":"2023-10-06T03:26:41.181643+0000","last_peered":"2023-10-06T03:26:41.181643+0000","last_clean":"2023-10-06T03:26:41.181643+0000","last_became_active":"2023-10-06T03:26:41.181394+0000","last_became_peered":"2023-10-06T03:26:41.181394+0000","last_unstale":"2023-10-06T03:26:41.181643+0000","last_undegraded":"2023-10-06T03:26:41.181643+0000","last_fullsized":"2023-10-06T03:26:41.181643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:20.673510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190060+0000","last_change":"2023-10-06T03:26:41.186638+0000","last_active":"2023-10-06T03:26:41.190060+0000","last_peered":"2023-10-06T03:26:41.190060+0000","last_clean":"2023-10-06T03:26:41.190060+0000","last_became_active":"2023-10-06T03:26:41.186199+0000","last_became_peered":"2023-10-06T03:26:41.186199+0000","last_unstale":"2023-10-06T03:26:41.190060+0000","last_undegraded":"2023-10-06T03:26:41.190060+0000","last_fullsized":"2023-10-06T03:26:41.190060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:51.819006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181759+0000","last_change":"2023-10-06T03:26:41.181759+0000","last_active":"2023-10-06T03:26:41.181759+0000","last_peered":"2023-10-06T03:26:41.181759+0000","last_clean":"2023-10-06T03:26:41.181759+0000","last_became_active":"2023-10-06T03:26:41.181487+0000","last_became_peered":"2023-10-06T03:26:41.181487+0000","last_unstale":"2023-10-06T03:26:41.181759+0000","last_undegraded":"2023-10-06T03:26:41.181759+0000","last_fullsized":"2023-10-06T03:26:41.181759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:58.524932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.176589+0000","last_change":"2023-10-06T03:26:41.172634+0000","last_active":"2023-10-06T03:26:41.176589+0000","last_peered":"2023-10-06T03:26:41.176589+0000","last_clean":"2023-10-06T03:26:41.176589+0000","last_became_active":"2023-10-06T03:26:41.172267+0000","last_became_peered":"2023-10-06T03:26:41.172267+0000","last_unstale":"2023-10-06T03:26:41.176589+0000","last_undegraded":"2023-10-06T03:26:41.176589+0000","last_fullsized":"2023-10-06T03:26:41.176589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:32.844768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182696+0000","last_change":"2023-10-06T03:26:41.175742+0000","last_active":"2023-10-06T03:26:41.182696+0000","last_peered":"2023-10-06T03:26:41.182696+0000","last_clean":"2023-10-06T03:26:41.182696+0000","last_became_active":"2023-10-06T03:26:41.175435+0000","last_became_peered":"2023-10-06T03:26:41.175435+0000","last_unstale":"2023-10-06T03:26:41.182696+0000","last_undegraded":"2023-10-06T03:26:41.182696+0000","last_fullsized":"2023-10-06T03:26:41.182696+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:29.499328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191222+0000","last_change":"2023-10-06T03:26:41.187442+0000","last_active":"2023-10-06T03:26:41.191222+0000","last_peered":"2023-10-06T03:26:41.191222+0000","last_clean":"2023-10-06T03:26:41.191222+0000","last_became_active":"2023-10-06T03:26:41.187203+0000","last_became_peered":"2023-10-06T03:26:41.187203+0000","last_unstale":"2023-10-06T03:26:41.191222+0000","last_undegraded":"2023-10-06T03:26:41.191222+0000","last_fullsized":"2023-10-06T03:26:41.191222+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:53.378472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191174+0000","last_change":"2023-10-06T03:26:41.186585+0000","last_active":"2023-10-06T03:26:41.191174+0000","last_peered":"2023-10-06T03:26:41.191174+0000","last_clean":"2023-10-06T03:26:41.191174+0000","last_became_active":"2023-10-06T03:26:41.186336+0000","last_became_peered":"2023-10-06T03:26:41.186336+0000","last_unstale":"2023-10-06T03:26:41.191174+0000","last_undegraded":"2023-10-06T03:26:41.191174+0000","last_fullsized":"2023-10-06T03:26:41.191174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:38.695262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.179108+0000","last_change":"2023-10-06T03:26:41.175572+0000","last_active":"2023-10-06T03:26:41.179108+0000","last_peered":"2023-10-06T03:26:41.179108+0000","last_clean":"2023-10-06T03:26:41.179108+0000","last_became_active":"2023-10-06T03:26:41.175293+0000","last_became_peered":"2023-10-06T03:26:41.175293+0000","last_unstale":"2023-10-06T03:26:41.179108+0000","last_undegraded":"2023-10-06T03:26:41.179108+0000","last_fullsized":"2023-10-06T03:26:41.179108+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:08.919442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.185248+0000","last_change":"2023-10-06T03:26:41.173364+0000","last_active":"2023-10-06T03:26:41.185248+0000","last_peered":"2023-10-06T03:26:41.185248+0000","last_clean":"2023-10-06T03:26:41.185248+0000","last_became_active":"2023-10-06T03:26:41.173111+0000","last_became_peered":"2023-10-06T03:26:41.173111+0000","last_unstale":"2023-10-06T03:26:41.185248+0000","last_undegraded":"2023-10-06T03:26:41.185248+0000","last_fullsized":"2023-10-06T03:26:41.185248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:00.991567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182672+0000","last_change":"2023-10-06T03:26:41.180186+0000","last_active":"2023-10-06T03:26:41.182672+0000","last_peered":"2023-10-06T03:26:41.182672+0000","last_clean":"2023-10-06T03:26:41.182672+0000","last_became_active":"2023-10-06T03:26:41.179917+0000","last_became_peered":"2023-10-06T03:26:41.179917+0000","last_unstale":"2023-10-06T03:26:41.182672+0000","last_undegraded":"2023-10-06T03:26:41.182672+0000","last_fullsized":"2023-10-06T03:26:41.182672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:38.745211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191111+0000","last_change":"2023-10-06T03:26:41.187089+0000","last_active":"2023-10-06T03:26:41.191111+0000","last_peered":"2023-10-06T03:26:41.191111+0000","last_clean":"2023-10-06T03:26:41.191111+0000","last_became_active":"2023-10-06T03:26:41.185737+0000","last_became_peered":"2023-10-06T03:26:41.185737+0000","last_unstale":"2023-10-06T03:26:41.191111+0000","last_undegraded":"2023-10-06T03:26:41.191111+0000","last_fullsized":"2023-10-06T03:26:41.191111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:33.910699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.188423+0000","last_change":"2023-10-06T03:26:41.181934+0000","last_active":"2023-10-06T03:26:41.188423+0000","last_peered":"2023-10-06T03:26:41.188423+0000","last_clean":"2023-10-06T03:26:41.188423+0000","last_became_active":"2023-10-06T03:26:41.181684+0000","last_became_peered":"2023-10-06T03:26:41.181684+0000","last_unstale":"2023-10-06T03:26:41.188423+0000","last_undegraded":"2023-10-06T03:26:41.188423+0000","last_fullsized":"2023-10-06T03:26:41.188423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:28.221258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187082+0000","last_change":"2023-10-06T03:26:41.178948+0000","last_active":"2023-10-06T03:26:41.187082+0000","last_peered":"2023-10-06T03:26:41.187082+0000","last_clean":"2023-10-06T03:26:41.187082+0000","last_became_active":"2023-10-06T03:26:41.178697+0000","last_became_peered":"2023-10-06T03:26:41.178697+0000","last_unstale":"2023-10-06T03:26:41.187082+0000","last_undegraded":"2023-10-06T03:26:41.187082+0000","last_fullsized":"2023-10-06T03:26:41.187082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:47.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181213+0000","last_change":"2023-10-06T03:26:41.171938+0000","last_active":"2023-10-06T03:26:41.181213+0000","last_peered":"2023-10-06T03:26:41.181213+0000","last_clean":"2023-10-06T03:26:41.181213+0000","last_became_active":"2023-10-06T03:26:41.171342+0000","last_became_peered":"2023-10-06T03:26:41.171342+0000","last_unstale":"2023-10-06T03:26:41.181213+0000","last_undegraded":"2023-10-06T03:26:41.181213+0000","last_fullsized":"2023-10-06T03:26:41.181213+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:40.191253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187657+0000","last_change":"2023-10-06T03:26:41.179878+0000","last_active":"2023-10-06T03:26:41.187657+0000","last_peered":"2023-10-06T03:26:41.187657+0000","last_clean":"2023-10-06T03:26:41.187657+0000","last_became_active":"2023-10-06T03:26:41.179657+0000","last_became_peered":"2023-10-06T03:26:41.179657+0000","last_unstale":"2023-10-06T03:26:41.187657+0000","last_undegraded":"2023-10-06T03:26:41.187657+0000","last_fullsized":"2023-10-06T03:26:41.187657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:53.378472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182939+0000","last_change":"2023-10-06T03:26:41.175750+0000","last_active":"2023-10-06T03:26:41.182939+0000","last_peered":"2023-10-06T03:26:41.182939+0000","last_clean":"2023-10-06T03:26:41.182939+0000","last_became_active":"2023-10-06T03:26:41.175531+0000","last_became_peered":"2023-10-06T03:26:41.175531+0000","last_unstale":"2023-10-06T03:26:41.182939+0000","last_undegraded":"2023-10-06T03:26:41.182939+0000","last_fullsized":"2023-10-06T03:26:41.182939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:38.745211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181327+0000","last_change":"2023-10-06T03:26:41.174432+0000","last_active":"2023-10-06T03:26:41.181327+0000","last_peered":"2023-10-06T03:26:41.181327+0000","last_clean":"2023-10-06T03:26:41.181327+0000","last_became_active":"2023-10-06T03:26:41.174188+0000","last_became_peered":"2023-10-06T03:26:41.174188+0000","last_unstale":"2023-10-06T03:26:41.181327+0000","last_undegraded":"2023-10-06T03:26:41.181327+0000","last_fullsized":"2023-10-06T03:26:41.181327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:23.165895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.176597+0000","last_change":"2023-10-06T03:26:41.172487+0000","last_active":"2023-10-06T03:26:41.176597+0000","last_peered":"2023-10-06T03:26:41.176597+0000","last_clean":"2023-10-06T03:26:41.176597+0000","last_became_active":"2023-10-06T03:26:41.172244+0000","last_became_peered":"2023-10-06T03:26:41.172244+0000","last_unstale":"2023-10-06T03:26:41.176597+0000","last_undegraded":"2023-10-06T03:26:41.176597+0000","last_fullsized":"2023-10-06T03:26:41.176597+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:38.745211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191486+0000","last_change":"2023-10-06T03:26:41.182960+0000","last_active":"2023-10-06T03:26:41.191486+0000","last_peered":"2023-10-06T03:26:41.191486+0000","last_clean":"2023-10-06T03:26:41.191486+0000","last_became_active":"2023-10-06T03:26:41.182687+0000","last_became_peered":"2023-10-06T03:26:41.182687+0000","last_unstale":"2023-10-06T03:26:41.191486+0000","last_undegraded":"2023-10-06T03:26:41.191486+0000","last_fullsized":"2023-10-06T03:26:41.191486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:39:20.244342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.185349+0000","last_change":"2023-10-06T03:26:41.171899+0000","last_active":"2023-10-06T03:26:41.185349+0000","last_peered":"2023-10-06T03:26:41.185349+0000","last_clean":"2023-10-06T03:26:41.185349+0000","last_became_active":"2023-10-06T03:26:41.171607+0000","last_became_peered":"2023-10-06T03:26:41.171607+0000","last_unstale":"2023-10-06T03:26:41.185349+0000","last_undegraded":"2023-10-06T03:26:41.185349+0000","last_fullsized":"2023-10-06T03:26:41.185349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:57.775060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191487+0000","last_change":"2023-10-06T03:26:41.183046+0000","last_active":"2023-10-06T03:26:41.191487+0000","last_peered":"2023-10-06T03:26:41.191487+0000","last_clean":"2023-10-06T03:26:41.191487+0000","last_became_active":"2023-10-06T03:26:41.182807+0000","last_became_peered":"2023-10-06T03:26:41.182807+0000","last_unstale":"2023-10-06T03:26:41.191487+0000","last_undegraded":"2023-10-06T03:26:41.191487+0000","last_fullsized":"2023-10-06T03:26:41.191487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:58.524932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.196371+0000","last_change":"2023-10-06T03:26:41.187561+0000","last_active":"2023-10-06T03:26:41.196371+0000","last_peered":"2023-10-06T03:26:41.196371+0000","last_clean":"2023-10-06T03:26:41.196371+0000","last_became_active":"2023-10-06T03:26:41.187326+0000","last_became_peered":"2023-10-06T03:26:41.187326+0000","last_unstale":"2023-10-06T03:26:41.196371+0000","last_undegraded":"2023-10-06T03:26:41.196371+0000","last_fullsized":"2023-10-06T03:26:41.196371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:15.869340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187834+0000","last_change":"2023-10-06T03:26:41.183448+0000","last_active":"2023-10-06T03:26:41.187834+0000","last_peered":"2023-10-06T03:26:41.187834+0000","last_clean":"2023-10-06T03:26:41.187834+0000","last_became_active":"2023-10-06T03:26:41.183186+0000","last_became_peered":"2023-10-06T03:26:41.183186+0000","last_unstale":"2023-10-06T03:26:41.187834+0000","last_undegraded":"2023-10-06T03:26:41.187834+0000","last_fullsized":"2023-10-06T03:26:41.187834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:14.064568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182957+0000","last_change":"2023-10-06T03:26:41.181008+0000","last_active":"2023-10-06T03:26:41.182957+0000","last_peered":"2023-10-06T03:26:41.182957+0000","last_clean":"2023-10-06T03:26:41.182957+0000","last_became_active":"2023-10-06T03:26:41.180774+0000","last_became_peered":"2023-10-06T03:26:41.180774+0000","last_unstale":"2023-10-06T03:26:41.182957+0000","last_undegraded":"2023-10-06T03:26:41.182957+0000","last_fullsized":"2023-10-06T03:26:41.182957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:17.895762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.183250+0000","last_change":"2023-10-06T03:26:41.175485+0000","last_active":"2023-10-06T03:26:41.183250+0000","last_peered":"2023-10-06T03:26:41.183250+0000","last_clean":"2023-10-06T03:26:41.183250+0000","last_became_active":"2023-10-06T03:26:41.175188+0000","last_became_peered":"2023-10-06T03:26:41.175188+0000","last_unstale":"2023-10-06T03:26:41.183250+0000","last_undegraded":"2023-10-06T03:26:41.183250+0000","last_fullsized":"2023-10-06T03:26:41.183250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:33.910699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.184580+0000","last_change":"2023-10-06T03:26:41.179800+0000","last_active":"2023-10-06T03:26:41.184580+0000","last_peered":"2023-10-06T03:26:41.184580+0000","last_clean":"2023-10-06T03:26:41.184580+0000","last_became_active":"2023-10-06T03:26:41.179551+0000","last_became_peered":"2023-10-06T03:26:41.179551+0000","last_unstale":"2023-10-06T03:26:41.184580+0000","last_undegraded":"2023-10-06T03:26:41.184580+0000","last_fullsized":"2023-10-06T03:26:41.184580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:12.478235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.180748+0000","last_change":"2023-10-06T03:26:41.178550+0000","last_active":"2023-10-06T03:26:41.180748+0000","last_peered":"2023-10-06T03:26:41.180748+0000","last_clean":"2023-10-06T03:26:41.180748+0000","last_became_active":"2023-10-06T03:26:41.178295+0000","last_became_peered":"2023-10-06T03:26:41.178295+0000","last_unstale":"2023-10-06T03:26:41.180748+0000","last_undegraded":"2023-10-06T03:26:41.180748+0000","last_fullsized":"2023-10-06T03:26:41.180748+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:32.844768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182727+0000","last_change":"2023-10-06T03:26:41.178027+0000","last_active":"2023-10-06T03:26:41.182727+0000","last_peered":"2023-10-06T03:26:41.182727+0000","last_clean":"2023-10-06T03:26:41.182727+0000","last_became_active":"2023-10-06T03:26:41.177560+0000","last_became_peered":"2023-10-06T03:26:41.177560+0000","last_unstale":"2023-10-06T03:26:41.182727+0000","last_undegraded":"2023-10-06T03:26:41.182727+0000","last_fullsized":"2023-10-06T03:26:41.182727+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:53.378472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187910+0000","last_change":"2023-10-06T03:26:41.182944+0000","last_active":"2023-10-06T03:26:41.187910+0000","last_peered":"2023-10-06T03:26:41.187910+0000","last_clean":"2023-10-06T03:26:41.187910+0000","last_became_active":"2023-10-06T03:26:41.182683+0000","last_became_peered":"2023-10-06T03:26:41.182683+0000","last_unstale":"2023-10-06T03:26:41.187910+0000","last_undegraded":"2023-10-06T03:26:41.187910+0000","last_fullsized":"2023-10-06T03:26:41.187910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:02.127389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181768+0000","last_change":"2023-10-06T03:26:41.175823+0000","last_active":"2023-10-06T03:26:41.181768+0000","last_peered":"2023-10-06T03:26:41.181768+0000","last_clean":"2023-10-06T03:26:41.181768+0000","last_became_active":"2023-10-06T03:26:41.175588+0000","last_became_peered":"2023-10-06T03:26:41.175588+0000","last_unstale":"2023-10-06T03:26:41.181768+0000","last_undegraded":"2023-10-06T03:26:41.181768+0000","last_fullsized":"2023-10-06T03:26:41.181768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:35.154764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.193366+0000","last_change":"2023-10-06T03:26:41.186003+0000","last_active":"2023-10-06T03:26:41.193366+0000","last_peered":"2023-10-06T03:26:41.193366+0000","last_clean":"2023-10-06T03:26:41.193366+0000","last_became_active":"2023-10-06T03:26:41.185764+0000","last_became_peered":"2023-10-06T03:26:41.185764+0000","last_unstale":"2023-10-06T03:26:41.193366+0000","last_undegraded":"2023-10-06T03:26:41.193366+0000","last_fullsized":"2023-10-06T03:26:41.193366+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:29.478142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.178895+0000","last_change":"2023-10-06T03:26:41.178895+0000","last_active":"2023-10-06T03:26:41.178895+0000","last_peered":"2023-10-06T03:26:41.178895+0000","last_clean":"2023-10-06T03:26:41.178895+0000","last_became_active":"2023-10-06T03:26:41.174832+0000","last_became_peered":"2023-10-06T03:26:41.174832+0000","last_unstale":"2023-10-06T03:26:41.178895+0000","last_undegraded":"2023-10-06T03:26:41.178895+0000","last_fullsized":"2023-10-06T03:26:41.178895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:36.795883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181435+0000","last_change":"2023-10-06T03:26:41.172496+0000","last_active":"2023-10-06T03:26:41.181435+0000","last_peered":"2023-10-06T03:26:41.181435+0000","last_clean":"2023-10-06T03:26:41.181435+0000","last_became_active":"2023-10-06T03:26:41.172066+0000","last_became_peered":"2023-10-06T03:26:41.172066+0000","last_unstale":"2023-10-06T03:26:41.181435+0000","last_undegraded":"2023-10-06T03:26:41.181435+0000","last_fullsized":"2023-10-06T03:26:41.181435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:36.795883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"85'4","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.196378+0000","last_change":"2023-10-06T03:26:40.159203+0000","last_active":"2023-10-06T03:26:41.196378+0000","last_peered":"2023-10-06T03:26:41.196378+0000","last_clean":"2023-10-06T03:26:41.196378+0000","last_became_active":"2023-10-06T03:26:40.158916+0000","last_became_peered":"2023-10-06T03:26:40.158916+0000","last_unstale":"2023-10-06T03:26:41.196378+0000","last_undegraded":"2023-10-06T03:26:41.196378+0000","last_fullsized":"2023-10-06T03:26:41.196378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:37.741322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.184172+0000","last_change":"2023-10-06T03:26:41.175680+0000","last_active":"2023-10-06T03:26:41.184172+0000","last_peered":"2023-10-06T03:26:41.184172+0000","last_clean":"2023-10-06T03:26:41.184172+0000","last_became_active":"2023-10-06T03:26:41.175458+0000","last_became_peered":"2023-10-06T03:26:41.175458+0000","last_unstale":"2023-10-06T03:26:41.184172+0000","last_undegraded":"2023-10-06T03:26:41.184172+0000","last_fullsized":"2023-10-06T03:26:41.184172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:33.910699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"85'1","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191102+0000","last_change":"2023-10-06T03:26:40.168715+0000","last_active":"2023-10-06T03:26:41.191102+0000","last_peered":"2023-10-06T03:26:41.191102+0000","last_clean":"2023-10-06T03:26:41.191102+0000","last_became_active":"2023-10-06T03:26:40.168493+0000","last_became_peered":"2023-10-06T03:26:40.168493+0000","last_unstale":"2023-10-06T03:26:41.191102+0000","last_undegraded":"2023-10-06T03:26:41.191102+0000","last_fullsized":"2023-10-06T03:26:41.191102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:53.090658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.186414+0000","last_change":"2023-10-06T03:26:41.186414+0000","last_active":"2023-10-06T03:26:41.186414+0000","last_peered":"2023-10-06T03:26:41.186414+0000","last_clean":"2023-10-06T03:26:41.186414+0000","last_became_active":"2023-10-06T03:26:41.186107+0000","last_became_peered":"2023-10-06T03:26:41.186107+0000","last_unstale":"2023-10-06T03:26:41.186414+0000","last_undegraded":"2023-10-06T03:26:41.186414+0000","last_fullsized":"2023-10-06T03:26:41.186414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:40.191253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"85'2","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191865+0000","last_change":"2023-10-06T03:26:40.165879+0000","last_active":"2023-10-06T03:26:41.191865+0000","last_peered":"2023-10-06T03:26:41.191865+0000","last_clean":"2023-10-06T03:26:41.191865+0000","last_became_active":"2023-10-06T03:26:40.165602+0000","last_became_peered":"2023-10-06T03:26:40.165602+0000","last_unstale":"2023-10-06T03:26:41.191865+0000","last_undegraded":"2023-10-06T03:26:41.191865+0000","last_fullsized":"2023-10-06T03:26:41.191865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:09:46.506885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.189280+0000","last_change":"2023-10-06T03:26:41.181778+0000","last_active":"2023-10-06T03:26:41.189280+0000","last_peered":"2023-10-06T03:26:41.189280+0000","last_clean":"2023-10-06T03:26:41.189280+0000","last_became_active":"2023-10-06T03:26:41.181482+0000","last_became_peered":"2023-10-06T03:26:41.181482+0000","last_unstale":"2023-10-06T03:26:41.189280+0000","last_undegraded":"2023-10-06T03:26:41.189280+0000","last_fullsized":"2023-10-06T03:26:41.189280+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:11.728284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"85'2","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.188946+0000","last_change":"2023-10-06T03:26:40.165607+0000","last_active":"2023-10-06T03:26:41.188946+0000","last_peered":"2023-10-06T03:26:41.188946+0000","last_clean":"2023-10-06T03:26:41.188946+0000","last_became_active":"2023-10-06T03:26:40.165304+0000","last_became_peered":"2023-10-06T03:26:40.165304+0000","last_unstale":"2023-10-06T03:26:41.188946+0000","last_undegraded":"2023-10-06T03:26:41.188946+0000","last_fullsized":"2023-10-06T03:26:41.188946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:57.304763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.189533+0000","last_change":"2023-10-06T03:26:41.189533+0000","last_active":"2023-10-06T03:26:41.189533+0000","last_peered":"2023-10-06T03:26:41.189533+0000","last_clean":"2023-10-06T03:26:41.189533+0000","last_became_active":"2023-10-06T03:26:41.186767+0000","last_became_peered":"2023-10-06T03:26:41.186767+0000","last_unstale":"2023-10-06T03:26:41.189533+0000","last_undegraded":"2023-10-06T03:26:41.189533+0000","last_fullsized":"2023-10-06T03:26:41.189533+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:16.006272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"85'1","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.174973+0000","last_change":"2023-10-06T03:26:40.156968+0000","last_active":"2023-10-06T03:26:41.174973+0000","last_peered":"2023-10-06T03:26:41.174973+0000","last_clean":"2023-10-06T03:26:41.174973+0000","last_became_active":"2023-10-06T03:26:40.156714+0000","last_became_peered":"2023-10-06T03:26:40.156714+0000","last_unstale":"2023-10-06T03:26:41.174973+0000","last_undegraded":"2023-10-06T03:26:41.174973+0000","last_fullsized":"2023-10-06T03:26:41.174973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:33.992954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.184535+0000","last_change":"2023-10-06T03:26:41.182465+0000","last_active":"2023-10-06T03:26:41.184535+0000","last_peered":"2023-10-06T03:26:41.184535+0000","last_clean":"2023-10-06T03:26:41.184535+0000","last_became_active":"2023-10-06T03:26:41.182159+0000","last_became_peered":"2023-10-06T03:26:41.182159+0000","last_unstale":"2023-10-06T03:26:41.184535+0000","last_undegraded":"2023-10-06T03:26:41.184535+0000","last_fullsized":"2023-10-06T03:26:41.184535+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:50.828962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"85'1","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190304+0000","last_change":"2023-10-06T03:26:40.160522+0000","last_active":"2023-10-06T03:26:41.190304+0000","last_peered":"2023-10-06T03:26:41.190304+0000","last_clean":"2023-10-06T03:26:41.190304+0000","last_became_active":"2023-10-06T03:26:40.160250+0000","last_became_peered":"2023-10-06T03:26:40.160250+0000","last_unstale":"2023-10-06T03:26:41.190304+0000","last_undegraded":"2023-10-06T03:26:41.190304+0000","last_fullsized":"2023-10-06T03:26:41.190304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:46.879068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187140+0000","last_change":"2023-10-06T03:26:41.180588+0000","last_active":"2023-10-06T03:26:41.187140+0000","last_peered":"2023-10-06T03:26:41.187140+0000","last_clean":"2023-10-06T03:26:41.187140+0000","last_became_active":"2023-10-06T03:26:41.180425+0000","last_became_peered":"2023-10-06T03:26:41.180425+0000","last_unstale":"2023-10-06T03:26:41.187140+0000","last_undegraded":"2023-10-06T03:26:41.187140+0000","last_fullsized":"2023-10-06T03:26:41.187140+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:38.695262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.168042+0000","last_change":"2023-10-06T03:26:40.166184+0000","last_active":"2023-10-06T03:26:41.168042+0000","last_peered":"2023-10-06T03:26:41.168042+0000","last_clean":"2023-10-06T03:26:41.168042+0000","last_became_active":"2023-10-06T03:26:40.165916+0000","last_became_peered":"2023-10-06T03:26:40.165916+0000","last_unstale":"2023-10-06T03:26:41.168042+0000","last_undegraded":"2023-10-06T03:26:41.168042+0000","last_fullsized":"2023-10-06T03:26:41.168042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:47.927968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190150+0000","last_change":"2023-10-06T03:26:41.188870+0000","last_active":"2023-10-06T03:26:41.190150+0000","last_peered":"2023-10-06T03:26:41.190150+0000","last_clean":"2023-10-06T03:26:41.190150+0000","last_became_active":"2023-10-06T03:26:41.188596+0000","last_became_peered":"2023-10-06T03:26:41.188596+0000","last_unstale":"2023-10-06T03:26:41.190150+0000","last_undegraded":"2023-10-06T03:26:41.190150+0000","last_fullsized":"2023-10-06T03:26:41.190150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:14.080974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.157371+0000","last_change":"2023-10-06T03:26:40.153974+0000","last_active":"2023-10-06T03:26:40.157371+0000","last_peered":"2023-10-06T03:26:40.157371+0000","last_clean":"2023-10-06T03:26:40.157371+0000","last_became_active":"2023-10-06T03:26:40.153748+0000","last_became_peered":"2023-10-06T03:26:40.153748+0000","last_unstale":"2023-10-06T03:26:40.157371+0000","last_undegraded":"2023-10-06T03:26:40.157371+0000","last_fullsized":"2023-10-06T03:26:40.157371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:21.114105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187781+0000","last_change":"2023-10-06T03:26:41.182832+0000","last_active":"2023-10-06T03:26:41.187781+0000","last_peered":"2023-10-06T03:26:41.187781+0000","last_clean":"2023-10-06T03:26:41.187781+0000","last_became_active":"2023-10-06T03:26:41.182539+0000","last_became_peered":"2023-10-06T03:26:41.182539+0000","last_unstale":"2023-10-06T03:26:41.187781+0000","last_undegraded":"2023-10-06T03:26:41.187781+0000","last_fullsized":"2023-10-06T03:26:41.187781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:33.176297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.168039+0000","last_change":"2023-10-06T03:26:40.165068+0000","last_active":"2023-10-06T03:26:40.168039+0000","last_peered":"2023-10-06T03:26:40.168039+0000","last_clean":"2023-10-06T03:26:40.168039+0000","last_became_active":"2023-10-06T03:26:40.164658+0000","last_became_peered":"2023-10-06T03:26:40.164658+0000","last_unstale":"2023-10-06T03:26:40.168039+0000","last_undegraded":"2023-10-06T03:26:40.168039+0000","last_fullsized":"2023-10-06T03:26:40.168039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:36.915288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.188435+0000","last_change":"2023-10-06T03:26:41.182131+0000","last_active":"2023-10-06T03:26:41.188435+0000","last_peered":"2023-10-06T03:26:41.188435+0000","last_clean":"2023-10-06T03:26:41.188435+0000","last_became_active":"2023-10-06T03:26:41.181780+0000","last_became_peered":"2023-10-06T03:26:41.181780+0000","last_unstale":"2023-10-06T03:26:41.188435+0000","last_undegraded":"2023-10-06T03:26:41.188435+0000","last_fullsized":"2023-10-06T03:26:41.188435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:36.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167554+0000","last_change":"2023-10-06T03:26:40.166836+0000","last_active":"2023-10-06T03:26:41.167554+0000","last_peered":"2023-10-06T03:26:41.167554+0000","last_clean":"2023-10-06T03:26:41.167554+0000","last_became_active":"2023-10-06T03:26:40.166582+0000","last_became_peered":"2023-10-06T03:26:40.166582+0000","last_unstale":"2023-10-06T03:26:41.167554+0000","last_undegraded":"2023-10-06T03:26:41.167554+0000","last_fullsized":"2023-10-06T03:26:41.167554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:10.712556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182706+0000","last_change":"2023-10-06T03:26:41.177852+0000","last_active":"2023-10-06T03:26:41.182706+0000","last_peered":"2023-10-06T03:26:41.182706+0000","last_clean":"2023-10-06T03:26:41.182706+0000","last_became_active":"2023-10-06T03:26:41.177213+0000","last_became_peered":"2023-10-06T03:26:41.177213+0000","last_unstale":"2023-10-06T03:26:41.182706+0000","last_undegraded":"2023-10-06T03:26:41.182706+0000","last_fullsized":"2023-10-06T03:26:41.182706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:32.844768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"85'3","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191789+0000","last_change":"2023-10-06T03:26:40.167620+0000","last_active":"2023-10-06T03:26:41.191789+0000","last_peered":"2023-10-06T03:26:41.191789+0000","last_clean":"2023-10-06T03:26:41.191789+0000","last_became_active":"2023-10-06T03:26:40.167339+0000","last_became_peered":"2023-10-06T03:26:40.167339+0000","last_unstale":"2023-10-06T03:26:41.191789+0000","last_undegraded":"2023-10-06T03:26:41.191789+0000","last_fullsized":"2023-10-06T03:26:41.191789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:11.883121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.180703+0000","last_change":"2023-10-06T03:26:41.174484+0000","last_active":"2023-10-06T03:26:41.180703+0000","last_peered":"2023-10-06T03:26:41.180703+0000","last_clean":"2023-10-06T03:26:41.180703+0000","last_became_active":"2023-10-06T03:26:41.174160+0000","last_became_peered":"2023-10-06T03:26:41.174160+0000","last_unstale":"2023-10-06T03:26:41.180703+0000","last_undegraded":"2023-10-06T03:26:41.180703+0000","last_fullsized":"2023-10-06T03:26:41.180703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:29.499328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"85'6","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.195154+0000","last_change":"2023-10-06T03:26:40.164899+0000","last_active":"2023-10-06T03:26:41.195154+0000","last_peered":"2023-10-06T03:26:41.195154+0000","last_clean":"2023-10-06T03:26:41.195154+0000","last_became_active":"2023-10-06T03:26:40.164593+0000","last_became_peered":"2023-10-06T03:26:40.164593+0000","last_unstale":"2023-10-06T03:26:41.195154+0000","last_undegraded":"2023-10-06T03:26:41.195154+0000","last_fullsized":"2023-10-06T03:26:41.195154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:16.891872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.176449+0000","last_change":"2023-10-06T03:26:41.171882+0000","last_active":"2023-10-06T03:26:41.176449+0000","last_peered":"2023-10-06T03:26:41.176449+0000","last_clean":"2023-10-06T03:26:41.176449+0000","last_became_active":"2023-10-06T03:26:41.171640+0000","last_became_peered":"2023-10-06T03:26:41.171640+0000","last_unstale":"2023-10-06T03:26:41.176449+0000","last_undegraded":"2023-10-06T03:26:41.176449+0000","last_fullsized":"2023-10-06T03:26:41.176449+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:29.499328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"85'2","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.188597+0000","last_change":"2023-10-06T03:26:40.160544+0000","last_active":"2023-10-06T03:26:41.188597+0000","last_peered":"2023-10-06T03:26:41.188597+0000","last_clean":"2023-10-06T03:26:41.188597+0000","last_became_active":"2023-10-06T03:26:40.160310+0000","last_became_peered":"2023-10-06T03:26:40.160310+0000","last_unstale":"2023-10-06T03:26:41.188597+0000","last_undegraded":"2023-10-06T03:26:41.188597+0000","last_fullsized":"2023-10-06T03:26:41.188597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:05.415293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.183486+0000","last_change":"2023-10-06T03:26:41.183486+0000","last_active":"2023-10-06T03:26:41.183486+0000","last_peered":"2023-10-06T03:26:41.183486+0000","last_clean":"2023-10-06T03:26:41.183486+0000","last_became_active":"2023-10-06T03:26:41.183228+0000","last_became_peered":"2023-10-06T03:26:41.183228+0000","last_unstale":"2023-10-06T03:26:41.183486+0000","last_undegraded":"2023-10-06T03:26:41.183486+0000","last_fullsized":"2023-10-06T03:26:41.183486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:15.624034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.160445+0000","last_change":"2023-10-06T03:26:40.155421+0000","last_active":"2023-10-06T03:26:41.160445+0000","last_peered":"2023-10-06T03:26:41.160445+0000","last_clean":"2023-10-06T03:26:41.160445+0000","last_became_active":"2023-10-06T03:26:40.155161+0000","last_became_peered":"2023-10-06T03:26:40.155161+0000","last_unstale":"2023-10-06T03:26:41.160445+0000","last_undegraded":"2023-10-06T03:26:41.160445+0000","last_fullsized":"2023-10-06T03:26:41.160445+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:20.244680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190138+0000","last_change":"2023-10-06T03:26:41.189034+0000","last_active":"2023-10-06T03:26:41.190138+0000","last_peered":"2023-10-06T03:26:41.190138+0000","last_clean":"2023-10-06T03:26:41.190138+0000","last_became_active":"2023-10-06T03:26:41.188738+0000","last_became_peered":"2023-10-06T03:26:41.188738+0000","last_unstale":"2023-10-06T03:26:41.190138+0000","last_undegraded":"2023-10-06T03:26:41.190138+0000","last_fullsized":"2023-10-06T03:26:41.190138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:04.940860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.163889+0000","last_change":"2023-10-06T03:26:40.158729+0000","last_active":"2023-10-06T03:26:41.163889+0000","last_peered":"2023-10-06T03:26:41.163889+0000","last_clean":"2023-10-06T03:26:41.163889+0000","last_became_active":"2023-10-06T03:26:40.158441+0000","last_became_peered":"2023-10-06T03:26:40.158441+0000","last_unstale":"2023-10-06T03:26:41.163889+0000","last_undegraded":"2023-10-06T03:26:41.163889+0000","last_fullsized":"2023-10-06T03:26:41.163889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:52.374583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.171865+0000","last_change":"2023-10-06T03:26:41.165812+0000","last_active":"2023-10-06T03:26:41.171865+0000","last_peered":"2023-10-06T03:26:41.171865+0000","last_clean":"2023-10-06T03:26:41.171865+0000","last_became_active":"2023-10-06T03:26:41.165391+0000","last_became_peered":"2023-10-06T03:26:41.165391+0000","last_unstale":"2023-10-06T03:26:41.171865+0000","last_undegraded":"2023-10-06T03:26:41.171865+0000","last_fullsized":"2023-10-06T03:26:41.171865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:20.673510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"85'8","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.192731+0000","last_change":"2023-10-06T03:26:40.160897+0000","last_active":"2023-10-06T03:26:41.192731+0000","last_peered":"2023-10-06T03:26:41.192731+0000","last_clean":"2023-10-06T03:26:41.192731+0000","last_became_active":"2023-10-06T03:26:40.160516+0000","last_became_peered":"2023-10-06T03:26:40.160516+0000","last_unstale":"2023-10-06T03:26:41.192731+0000","last_undegraded":"2023-10-06T03:26:41.192731+0000","last_fullsized":"2023-10-06T03:26:41.192731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:19.481133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190042+0000","last_change":"2023-10-06T03:26:41.186444+0000","last_active":"2023-10-06T03:26:41.190042+0000","last_peered":"2023-10-06T03:26:41.190042+0000","last_clean":"2023-10-06T03:26:41.190042+0000","last_became_active":"2023-10-06T03:26:41.185887+0000","last_became_peered":"2023-10-06T03:26:41.185887+0000","last_unstale":"2023-10-06T03:26:41.190042+0000","last_undegraded":"2023-10-06T03:26:41.190042+0000","last_fullsized":"2023-10-06T03:26:41.190042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:55.814554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"85'2","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.187979+0000","last_change":"2023-10-06T03:26:40.166885+0000","last_active":"2023-10-06T03:26:41.187979+0000","last_peered":"2023-10-06T03:26:41.187979+0000","last_clean":"2023-10-06T03:26:41.187979+0000","last_became_active":"2023-10-06T03:26:40.166642+0000","last_became_peered":"2023-10-06T03:26:40.166642+0000","last_unstale":"2023-10-06T03:26:41.187979+0000","last_undegraded":"2023-10-06T03:26:41.187979+0000","last_fullsized":"2023-10-06T03:26:41.187979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:39.187363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.178388+0000","last_change":"2023-10-06T03:26:41.178388+0000","last_active":"2023-10-06T03:26:41.178388+0000","last_peered":"2023-10-06T03:26:41.178388+0000","last_clean":"2023-10-06T03:26:41.178388+0000","last_became_active":"2023-10-06T03:26:41.178101+0000","last_became_peered":"2023-10-06T03:26:41.178101+0000","last_unstale":"2023-10-06T03:26:41.178388+0000","last_undegraded":"2023-10-06T03:26:41.178388+0000","last_fullsized":"2023-10-06T03:26:41.178388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:22.157109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167560+0000","last_change":"2023-10-06T03:26:40.166089+0000","last_active":"2023-10-06T03:26:41.167560+0000","last_peered":"2023-10-06T03:26:41.167560+0000","last_clean":"2023-10-06T03:26:41.167560+0000","last_became_active":"2023-10-06T03:26:40.165848+0000","last_became_peered":"2023-10-06T03:26:40.165848+0000","last_unstale":"2023-10-06T03:26:41.167560+0000","last_undegraded":"2023-10-06T03:26:41.167560+0000","last_fullsized":"2023-10-06T03:26:41.167560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:37.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.183819+0000","last_change":"2023-10-06T03:26:41.183819+0000","last_active":"2023-10-06T03:26:41.183819+0000","last_peered":"2023-10-06T03:26:41.183819+0000","last_clean":"2023-10-06T03:26:41.183819+0000","last_became_active":"2023-10-06T03:26:41.183547+0000","last_became_peered":"2023-10-06T03:26:41.183547+0000","last_unstale":"2023-10-06T03:26:41.183819+0000","last_undegraded":"2023-10-06T03:26:41.183819+0000","last_fullsized":"2023-10-06T03:26:41.183819+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:51.800170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167577+0000","last_change":"2023-10-06T03:26:40.161111+0000","last_active":"2023-10-06T03:26:41.167577+0000","last_peered":"2023-10-06T03:26:41.167577+0000","last_clean":"2023-10-06T03:26:41.167577+0000","last_became_active":"2023-10-06T03:26:40.160879+0000","last_became_peered":"2023-10-06T03:26:40.160879+0000","last_unstale":"2023-10-06T03:26:41.167577+0000","last_undegraded":"2023-10-06T03:26:41.167577+0000","last_fullsized":"2023-10-06T03:26:41.167577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:28.474253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182598+0000","last_change":"2023-10-06T03:26:41.176123+0000","last_active":"2023-10-06T03:26:41.182598+0000","last_peered":"2023-10-06T03:26:41.182598+0000","last_clean":"2023-10-06T03:26:41.182598+0000","last_became_active":"2023-10-06T03:26:41.175813+0000","last_became_peered":"2023-10-06T03:26:41.175813+0000","last_unstale":"2023-10-06T03:26:41.182598+0000","last_undegraded":"2023-10-06T03:26:41.182598+0000","last_fullsized":"2023-10-06T03:26:41.182598+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:38.695262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166409+0000","last_change":"2023-10-06T03:26:40.163889+0000","last_active":"2023-10-06T03:26:41.166409+0000","last_peered":"2023-10-06T03:26:41.166409+0000","last_clean":"2023-10-06T03:26:41.166409+0000","last_became_active":"2023-10-06T03:26:40.163611+0000","last_became_peered":"2023-10-06T03:26:40.163611+0000","last_unstale":"2023-10-06T03:26:41.166409+0000","last_undegraded":"2023-10-06T03:26:41.166409+0000","last_fullsized":"2023-10-06T03:26:41.166409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:11.883121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.176633+0000","last_change":"2023-10-06T03:26:41.170557+0000","last_active":"2023-10-06T03:26:41.176633+0000","last_peered":"2023-10-06T03:26:41.176633+0000","last_clean":"2023-10-06T03:26:41.176633+0000","last_became_active":"2023-10-06T03:26:41.170341+0000","last_became_peered":"2023-10-06T03:26:41.170341+0000","last_unstale":"2023-10-06T03:26:41.176633+0000","last_undegraded":"2023-10-06T03:26:41.176633+0000","last_fullsized":"2023-10-06T03:26:41.176633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:15.624034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166269+0000","last_change":"2023-10-06T03:26:40.164740+0000","last_active":"2023-10-06T03:26:41.166269+0000","last_peered":"2023-10-06T03:26:41.166269+0000","last_clean":"2023-10-06T03:26:41.166269+0000","last_became_active":"2023-10-06T03:26:40.164485+0000","last_became_peered":"2023-10-06T03:26:40.164485+0000","last_unstale":"2023-10-06T03:26:41.166269+0000","last_undegraded":"2023-10-06T03:26:41.166269+0000","last_fullsized":"2023-10-06T03:26:41.166269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:31.840879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.185011+0000","last_change":"2023-10-06T03:26:41.169997+0000","last_active":"2023-10-06T03:26:41.185011+0000","last_peered":"2023-10-06T03:26:41.185011+0000","last_clean":"2023-10-06T03:26:41.185011+0000","last_became_active":"2023-10-06T03:26:41.169684+0000","last_became_peered":"2023-10-06T03:26:41.169684+0000","last_unstale":"2023-10-06T03:26:41.185011+0000","last_undegraded":"2023-10-06T03:26:41.185011+0000","last_fullsized":"2023-10-06T03:26:41.185011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:48.984505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.165745+0000","last_change":"2023-10-06T03:26:40.158736+0000","last_active":"2023-10-06T03:26:41.165745+0000","last_peered":"2023-10-06T03:26:41.165745+0000","last_clean":"2023-10-06T03:26:41.165745+0000","last_became_active":"2023-10-06T03:26:40.158057+0000","last_became_peered":"2023-10-06T03:26:40.158057+0000","last_unstale":"2023-10-06T03:26:41.165745+0000","last_undegraded":"2023-10-06T03:26:41.165745+0000","last_fullsized":"2023-10-06T03:26:41.165745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:15.857016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.176511+0000","last_change":"2023-10-06T03:26:41.170440+0000","last_active":"2023-10-06T03:26:41.176511+0000","last_peered":"2023-10-06T03:26:41.176511+0000","last_clean":"2023-10-06T03:26:41.176511+0000","last_became_active":"2023-10-06T03:26:41.170185+0000","last_became_peered":"2023-10-06T03:26:41.170185+0000","last_unstale":"2023-10-06T03:26:41.176511+0000","last_undegraded":"2023-10-06T03:26:41.176511+0000","last_fullsized":"2023-10-06T03:26:41.176511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:51.800170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167139+0000","last_change":"2023-10-06T03:26:40.153843+0000","last_active":"2023-10-06T03:26:41.167139+0000","last_peered":"2023-10-06T03:26:41.167139+0000","last_clean":"2023-10-06T03:26:41.167139+0000","last_became_active":"2023-10-06T03:26:40.153572+0000","last_became_peered":"2023-10-06T03:26:40.153572+0000","last_unstale":"2023-10-06T03:26:41.167139+0000","last_undegraded":"2023-10-06T03:26:41.167139+0000","last_fullsized":"2023-10-06T03:26:41.167139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:35.067349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182623+0000","last_change":"2023-10-06T03:26:41.175608+0000","last_active":"2023-10-06T03:26:41.182623+0000","last_peered":"2023-10-06T03:26:41.182623+0000","last_clean":"2023-10-06T03:26:41.182623+0000","last_became_active":"2023-10-06T03:26:41.175402+0000","last_became_peered":"2023-10-06T03:26:41.175402+0000","last_unstale":"2023-10-06T03:26:41.182623+0000","last_undegraded":"2023-10-06T03:26:41.182623+0000","last_fullsized":"2023-10-06T03:26:41.182623+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:55.815521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.160332+0000","last_change":"2023-10-06T03:26:40.159588+0000","last_active":"2023-10-06T03:26:41.160332+0000","last_peered":"2023-10-06T03:26:41.160332+0000","last_clean":"2023-10-06T03:26:41.160332+0000","last_became_active":"2023-10-06T03:26:40.159357+0000","last_became_peered":"2023-10-06T03:26:40.159357+0000","last_unstale":"2023-10-06T03:26:41.160332+0000","last_undegraded":"2023-10-06T03:26:41.160332+0000","last_fullsized":"2023-10-06T03:26:41.160332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:24.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181361+0000","last_change":"2023-10-06T03:26:41.173922+0000","last_active":"2023-10-06T03:26:41.181361+0000","last_peered":"2023-10-06T03:26:41.181361+0000","last_clean":"2023-10-06T03:26:41.181361+0000","last_became_active":"2023-10-06T03:26:41.173680+0000","last_became_peered":"2023-10-06T03:26:41.173680+0000","last_unstale":"2023-10-06T03:26:41.181361+0000","last_undegraded":"2023-10-06T03:26:41.181361+0000","last_fullsized":"2023-10-06T03:26:41.181361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:22.157109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.170959+0000","last_change":"2023-10-06T03:26:40.168766+0000","last_active":"2023-10-06T03:26:40.170959+0000","last_peered":"2023-10-06T03:26:40.170959+0000","last_clean":"2023-10-06T03:26:40.170959+0000","last_became_active":"2023-10-06T03:26:40.168448+0000","last_became_peered":"2023-10-06T03:26:40.168448+0000","last_unstale":"2023-10-06T03:26:40.170959+0000","last_undegraded":"2023-10-06T03:26:40.170959+0000","last_fullsized":"2023-10-06T03:26:40.170959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:35.791993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":72,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.163866+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:26:41.163866+0000","last_peered":"2023-10-06T03:26:41.163866+0000","last_clean":"2023-10-06T03:26:41.163866+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:26:41.163866+0000","last_undegraded":"2023-10-06T03:26:41.163866+0000","last_fullsized":"2023-10-06T03:26:41.163866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181233+0000","last_change":"2023-10-06T03:26:41.171984+0000","last_active":"2023-10-06T03:26:41.181233+0000","last_peered":"2023-10-06T03:26:41.181233+0000","last_clean":"2023-10-06T03:26:41.181233+0000","last_became_active":"2023-10-06T03:26:41.171648+0000","last_became_peered":"2023-10-06T03:26:41.171648+0000","last_unstale":"2023-10-06T03:26:41.181233+0000","last_undegraded":"2023-10-06T03:26:41.181233+0000","last_fullsized":"2023-10-06T03:26:41.181233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:12.801493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"85'2","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191733+0000","last_change":"2023-10-06T03:26:40.166131+0000","last_active":"2023-10-06T03:26:41.191733+0000","last_peered":"2023-10-06T03:26:41.191733+0000","last_clean":"2023-10-06T03:26:41.191733+0000","last_became_active":"2023-10-06T03:26:40.165860+0000","last_became_peered":"2023-10-06T03:26:40.165860+0000","last_unstale":"2023-10-06T03:26:41.191733+0000","last_undegraded":"2023-10-06T03:26:41.191733+0000","last_fullsized":"2023-10-06T03:26:41.191733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:47.980616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":66,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167158+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:26:41.167158+0000","last_peered":"2023-10-06T03:26:41.167158+0000","last_clean":"2023-10-06T03:26:41.167158+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:26:41.167158+0000","last_undegraded":"2023-10-06T03:26:41.167158+0000","last_fullsized":"2023-10-06T03:26:41.167158+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.191129+0000","last_change":"2023-10-06T03:26:41.187343+0000","last_active":"2023-10-06T03:26:41.191129+0000","last_peered":"2023-10-06T03:26:41.191129+0000","last_clean":"2023-10-06T03:26:41.191129+0000","last_became_active":"2023-10-06T03:26:41.186782+0000","last_became_peered":"2023-10-06T03:26:41.186782+0000","last_unstale":"2023-10-06T03:26:41.191129+0000","last_undegraded":"2023-10-06T03:26:41.191129+0000","last_fullsized":"2023-10-06T03:26:41.191129+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:27.036395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167675+0000","last_change":"2023-10-06T03:26:40.165590+0000","last_active":"2023-10-06T03:26:41.167675+0000","last_peered":"2023-10-06T03:26:41.167675+0000","last_clean":"2023-10-06T03:26:41.167675+0000","last_became_active":"2023-10-06T03:26:40.164986+0000","last_became_peered":"2023-10-06T03:26:40.164986+0000","last_unstale":"2023-10-06T03:26:41.167675+0000","last_undegraded":"2023-10-06T03:26:41.167675+0000","last_fullsized":"2023-10-06T03:26:41.167675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:32.906810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":64,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.147953+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:26:40.147953+0000","last_peered":"2023-10-06T03:26:40.147953+0000","last_clean":"2023-10-06T03:26:40.147953+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:26:40.147953+0000","last_undegraded":"2023-10-06T03:26:40.147953+0000","last_fullsized":"2023-10-06T03:26:40.147953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166737+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:26:41.166737+0000","last_peered":"2023-10-06T03:26:41.166737+0000","last_clean":"2023-10-06T03:26:41.166737+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:26:41.166737+0000","last_undegraded":"2023-10-06T03:26:41.166737+0000","last_fullsized":"2023-10-06T03:26:41.166737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.192127+0000","last_change":"2023-10-06T03:26:41.192127+0000","last_active":"2023-10-06T03:26:41.192127+0000","last_peered":"2023-10-06T03:26:41.192127+0000","last_clean":"2023-10-06T03:26:41.192127+0000","last_became_active":"2023-10-06T03:26:41.186868+0000","last_became_peered":"2023-10-06T03:26:41.186868+0000","last_unstale":"2023-10-06T03:26:41.192127+0000","last_undegraded":"2023-10-06T03:26:41.192127+0000","last_fullsized":"2023-10-06T03:26:41.192127+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:04.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"85'1","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.190735+0000","last_change":"2023-10-06T03:26:40.164418+0000","last_active":"2023-10-06T03:26:41.190735+0000","last_peered":"2023-10-06T03:26:41.190735+0000","last_clean":"2023-10-06T03:26:41.190735+0000","last_became_active":"2023-10-06T03:26:40.164137+0000","last_became_peered":"2023-10-06T03:26:40.164137+0000","last_unstale":"2023-10-06T03:26:41.190735+0000","last_undegraded":"2023-10-06T03:26:41.190735+0000","last_fullsized":"2023-10-06T03:26:41.190735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:53.090658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167141+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:26:41.167141+0000","last_peered":"2023-10-06T03:26:41.167141+0000","last_clean":"2023-10-06T03:26:41.167141+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:26:41.167141+0000","last_undegraded":"2023-10-06T03:26:41.167141+0000","last_fullsized":"2023-10-06T03:26:41.167141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181416+0000","last_change":"2023-10-06T03:26:41.172342+0000","last_active":"2023-10-06T03:26:41.181416+0000","last_peered":"2023-10-06T03:26:41.181416+0000","last_clean":"2023-10-06T03:26:41.181416+0000","last_became_active":"2023-10-06T03:26:41.171714+0000","last_became_peered":"2023-10-06T03:26:41.171714+0000","last_unstale":"2023-10-06T03:26:41.181416+0000","last_undegraded":"2023-10-06T03:26:41.181416+0000","last_fullsized":"2023-10-06T03:26:41.181416+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:37.007531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"85'1","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.192479+0000","last_change":"2023-10-06T03:26:40.164762+0000","last_active":"2023-10-06T03:26:41.192479+0000","last_peered":"2023-10-06T03:26:41.192479+0000","last_clean":"2023-10-06T03:26:41.192479+0000","last_became_active":"2023-10-06T03:26:40.164445+0000","last_became_peered":"2023-10-06T03:26:40.164445+0000","last_unstale":"2023-10-06T03:26:41.192479+0000","last_undegraded":"2023-10-06T03:26:41.192479+0000","last_fullsized":"2023-10-06T03:26:41.192479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:15.857016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166551+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:26:41.166551+0000","last_peered":"2023-10-06T03:26:41.166551+0000","last_clean":"2023-10-06T03:26:41.166551+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:26:41.166551+0000","last_undegraded":"2023-10-06T03:26:41.166551+0000","last_fullsized":"2023-10-06T03:26:41.166551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.183271+0000","last_change":"2023-10-06T03:26:41.179522+0000","last_active":"2023-10-06T03:26:41.183271+0000","last_peered":"2023-10-06T03:26:41.183271+0000","last_clean":"2023-10-06T03:26:41.183271+0000","last_became_active":"2023-10-06T03:26:41.179222+0000","last_became_peered":"2023-10-06T03:26:41.179222+0000","last_unstale":"2023-10-06T03:26:41.183271+0000","last_undegraded":"2023-10-06T03:26:41.183271+0000","last_fullsized":"2023-10-06T03:26:41.183271+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:47.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"85'2","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.192064+0000","last_change":"2023-10-06T03:26:40.164913+0000","last_active":"2023-10-06T03:26:41.192064+0000","last_peered":"2023-10-06T03:26:41.192064+0000","last_clean":"2023-10-06T03:26:41.192064+0000","last_became_active":"2023-10-06T03:26:40.164628+0000","last_became_peered":"2023-10-06T03:26:40.164628+0000","last_unstale":"2023-10-06T03:26:41.192064+0000","last_undegraded":"2023-10-06T03:26:41.192064+0000","last_fullsized":"2023-10-06T03:26:41.192064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:37.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":63,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.159699+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:26:40.159699+0000","last_peered":"2023-10-06T03:26:40.159699+0000","last_clean":"2023-10-06T03:26:40.159699+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:26:40.159699+0000","last_undegraded":"2023-10-06T03:26:40.159699+0000","last_fullsized":"2023-10-06T03:26:40.159699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.181109+0000","last_change":"2023-10-06T03:26:41.171726+0000","last_active":"2023-10-06T03:26:41.181109+0000","last_peered":"2023-10-06T03:26:41.181109+0000","last_clean":"2023-10-06T03:26:41.181109+0000","last_became_active":"2023-10-06T03:26:41.171453+0000","last_became_peered":"2023-10-06T03:26:41.171453+0000","last_unstale":"2023-10-06T03:26:41.181109+0000","last_undegraded":"2023-10-06T03:26:41.181109+0000","last_fullsized":"2023-10-06T03:26:41.181109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:37.919178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T03:26:40.170754+0000","last_change":"2023-10-06T03:26:40.166282+0000","last_active":"2023-10-06T03:26:40.170754+0000","last_peered":"2023-10-06T03:26:40.170754+0000","last_clean":"2023-10-06T03:26:40.170754+0000","last_became_active":"2023-10-06T03:26:40.166034+0000","last_became_peered":"2023-10-06T03:26:40.166034+0000","last_unstale":"2023-10-06T03:26:40.170754+0000","last_undegraded":"2023-10-06T03:26:40.170754+0000","last_fullsized":"2023-10-06T03:26:40.170754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:14.620144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166865+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:26:41.166865+0000","last_peered":"2023-10-06T03:26:41.166865+0000","last_clean":"2023-10-06T03:26:41.166865+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:26:41.166865+0000","last_undegraded":"2023-10-06T03:26:41.166865+0000","last_fullsized":"2023-10-06T03:26:41.166865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.182645+0000","last_change":"2023-10-06T03:26:41.179387+0000","last_active":"2023-10-06T03:26:41.182645+0000","last_peered":"2023-10-06T03:26:41.182645+0000","last_clean":"2023-10-06T03:26:41.182645+0000","last_became_active":"2023-10-06T03:26:41.179103+0000","last_became_peered":"2023-10-06T03:26:41.179103+0000","last_unstale":"2023-10-06T03:26:41.182645+0000","last_undegraded":"2023-10-06T03:26:41.182645+0000","last_fullsized":"2023-10-06T03:26:41.182645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:40.141303+0000","last_clean_scrub_stamp":"2023-10-06T03:26:40.141303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:46.933356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.167065+0000","last_change":"2023-10-06T03:26:40.162473+0000","last_active":"2023-10-06T03:26:41.167065+0000","last_peered":"2023-10-06T03:26:41.167065+0000","last_clean":"2023-10-06T03:26:41.167065+0000","last_became_active":"2023-10-06T03:26:40.162225+0000","last_became_peered":"2023-10-06T03:26:40.162225+0000","last_unstale":"2023-10-06T03:26:41.167065+0000","last_undegraded":"2023-10-06T03:26:41.167065+0000","last_fullsized":"2023-10-06T03:26:41.167065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:26:39.137414+0000","last_clean_scrub_stamp":"2023-10-06T03:26:39.137414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:04.339222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T03:26:41.166741+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:26:41.166741+0000","last_peered":"2023-10-06T03:26:41.166741+0000","last_clean":"2023-10-06T03:26:41.166741+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:26:41.166741+0000","last_undegraded":"2023-10-06T03:26:41.166741+0000","last_fullsized":"2023-10-06T03:26:41.166741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298900,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072940,"statfs":{"total":96636764160,"available":96330690560,"internally_reserved":0,"allocated":1650688,"data_stored":1085227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69199999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.72999999999999998,"15min":0.76300000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66200000000000003,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.752,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67100000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81699999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73599999999999999,"5min":1.103,"15min":1.103},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81799999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.878,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298332,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073508,"statfs":{"total":96636764160,"available":96331272192,"internally_reserved":0,"allocated":1069056,"data_stored":502332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.343,"15min":1.343},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.329,"15min":1.329},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.76400000000000001,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80400000000000005,"15min":0.83999999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.042,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.80600000000000005,"15min":0.84199999999999997},"min":{"1min":0.46500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.496},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.626,"15min":0.625},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298892,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072948,"statfs":{"total":96636764160,"available":96330698752,"internally_reserved":0,"allocated":1642496,"data_stored":1085115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.38700000000000001,"15min":0.40300000000000002},"min":{"1min":0.219,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.38500000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.41199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.215},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.40600000000000003,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.19400000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.44800000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.44600000000000001,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.41699999999999998,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.252}]},{"osd":4,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.626},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.745,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.504},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80100000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.70899999999999996,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298324,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073516,"statfs":{"total":96636764160,"available":96331280384,"internally_reserved":0,"allocated":1060864,"data_stored":500909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.435,"5min":12.19,"15min":12.19},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.64000000000000001,"15min":0.68799999999999994},"min":{"1min":0.28599999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46800000000000003,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50800000000000001,"5min":1.357,"15min":1.357},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.92000000000000004,"15min":1.02},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.495,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.29099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.49099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.089,"15min":1.179},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":16.919,"15min":16.919},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.503},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.1000000000000001,"15min":1.1930000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79700000000000004,"5min":16.948,"15min":16.948},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67700000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56899999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.1140000000000001,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":16.881,"15min":16.881},"last":0.52900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298316,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073524,"statfs":{"total":96636764160,"available":96331288576,"internally_reserved":0,"allocated":1052672,"data_stored":494781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33800000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.51500000000000001,"5min":0.62,"15min":0.62},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.27000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.48599999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.375},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.42799999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.35299999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52100000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.38700000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.875,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47999999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.432},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1077248,"data_stored":503266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.253},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.28199999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32400000000000001,"15min":0.32600000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42699999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.29799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49199999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77100000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75700000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54600000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.504},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.45200000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.44}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298344,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073496,"statfs":{"total":96636764160,"available":96331259904,"internally_reserved":0,"allocated":1081344,"data_stored":503368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.2709999999999999,"5min":4.758,"15min":4.758},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.88900000000000001,"15min":0.95299999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.434}]},{"osd":2,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.502},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84399999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298316,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073524,"statfs":{"total":96636764160,"available":96331288576,"internally_reserved":0,"allocated":1052672,"data_stored":494817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60699999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.64700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.496}]},{"osd":2,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69399999999999995,"5min":0.999,"15min":0.999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68500000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73399999999999999,"5min":0.746,"15min":0.746},"last":0.437},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":1.04,"15min":1.04},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.378,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":1.284,"15min":1.284},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:26:45.592 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:26:45.592 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:26:45.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.744+0000 7f55570be700 1 Processor -- start 2023-10-06T03:26:45.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.744+0000 7f55570be700 1 -- start start 2023-10-06T03:26:45.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f55570be700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55500cbcb0 0x7f55500cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f55570be700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55500cf610 con 0x7f55501598e0 2023-10-06T03:26:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f55570be700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55500cf8f0 con 0x7f5550159510 2023-10-06T03:26:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f55570be700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55500cfbd0 con 0x7f55500cbcb0 2023-10-06T03:26:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f555565b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55500cbcb0 0x7f55500cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f554ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f55501598e0 0x7f55500ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42032/0 (socket says 172.21.15.84:42032) 2023-10-06T03:26:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f554ffff700 1 -- 172.21.15.84:0/748200335 learned_addr learned my addr 172.21.15.84:0/748200335 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f555565b700 1 -- 172.21.15.84:0/748200335 >> v1:172.21.15.131:6789/0 conn(0x7f5550159510 legacy=0x7f55500cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f555565b700 1 -- 172.21.15.84:0/748200335 >> v1:172.21.15.84:6789/0 conn(0x7f55501598e0 legacy=0x7f55500ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f555565b700 1 -- 172.21.15.84:0/748200335 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55500cfeb0 con 0x7f55500cbcb0 2023-10-06T03:26:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f554f7fe700 1 -- 172.21.15.84:0/748200335 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248969468 0 0) 0x7f55500cf610 con 0x7f55501598e0 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f555565b700 1 --2- 172.21.15.84:0/748200335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55500cbcb0 0x7f55500cef30 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f55480098e0 tx=0x7f55480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a320c73b6d6f7c92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f554f7fe700 1 -- 172.21.15.84:0/748200335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548009e80 con 0x7f55500cbcb0 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f554f7fe700 1 -- 172.21.15.84:0/748200335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554800b820 con 0x7f55500cbcb0 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.745+0000 7f554f7fe700 1 -- 172.21.15.84:0/748200335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800bbe0 con 0x7f55500cbcb0 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.746+0000 7f55570be700 1 -- 172.21.15.84:0/748200335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55500cbcb0 msgr2=0x7f55500cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.746+0000 7f55570be700 1 --2- 172.21.15.84:0/748200335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55500cbcb0 0x7f55500cef30 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f55480098e0 tx=0x7f55480091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.746+0000 7f55570be700 1 -- 172.21.15.84:0/748200335 shutdown_connections 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.746+0000 7f55570be700 1 --2- 172.21.15.84:0/748200335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55500cbcb0 0x7f55500cef30 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.746+0000 7f55570be700 1 -- 172.21.15.84:0/748200335 >> 172.21.15.84:0/748200335 conn(0x7f5550089e90 msgr2=0x7f55500997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.746+0000 7f55570be700 1 -- 172.21.15.84:0/748200335 shutdown_connections 2023-10-06T03:26:45.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.746+0000 7f55570be700 1 -- 172.21.15.84:0/748200335 wait complete. 2023-10-06T03:26:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.747+0000 7f55570be700 1 Processor -- start 2023-10-06T03:26:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.747+0000 7f55570be700 1 -- start start 2023-10-06T03:26:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f55570be700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55500cbcb0 0x7f5550149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f55570be700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5550159510 0x7f555015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f55570be700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55501598e0 0x7f55500c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f55570be700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555015ac60 con 0x7f5550159510 2023-10-06T03:26:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f55570be700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5550149870 con 0x7f55501598e0 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f55570be700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555015a050 con 0x7f55500cbcb0 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f554ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5550159510 0x7f555015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f554ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5550159510 0x7f555015b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45362/0 (socket says 172.21.15.84:45362) 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f554ffff700 1 -- 172.21.15.84:0/941674755 learned_addr learned my addr 172.21.15.84:0/941674755 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f555565b700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55501598e0 0x7f55500c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f5554e5a700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55500cbcb0 0x7f5550149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f554ffff700 1 -- 172.21.15.84:0/941674755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55500cbcb0 msgr2=0x7f5550149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f554ffff700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55500cbcb0 0x7f5550149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f554ffff700 1 -- 172.21.15.84:0/941674755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55501598e0 msgr2=0x7f55500c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f554ffff700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55501598e0 0x7f55500c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f554ffff700 1 -- 172.21.15.84:0/941674755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548009420 con 0x7f5550159510 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.748+0000 7f554ffff700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5550159510 0x7f555015b910 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f554400c510 tx=0x7f554400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.749+0000 7f554cff9700 1 -- 172.21.15.84:0/941674755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544005b30 con 0x7f5550159510 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.749+0000 7f554cff9700 1 -- 172.21.15.84:0/941674755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5544005cb0 con 0x7f5550159510 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.749+0000 7f55570be700 1 -- 172.21.15.84:0/941674755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555015a330 con 0x7f5550159510 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.749+0000 7f554cff9700 1 -- 172.21.15.84:0/941674755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544007320 con 0x7f5550159510 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.749+0000 7f55570be700 1 -- 172.21.15.84:0/941674755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555015a6c0 con 0x7f5550159510 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.750+0000 7f55570be700 1 -- 172.21.15.84:0/941674755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555015ae10 con 0x7f5550159510 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.750+0000 7f554cff9700 1 -- 172.21.15.84:0/941674755 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f554401b3b0 con 0x7f5550159510 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.750+0000 7f554cff9700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f553c066f30 0x7f553c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.750+0000 7f554cff9700 1 -- 172.21.15.84:0/941674755 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5544083aa0 con 0x7f5550159510 2023-10-06T03:26:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.751+0000 7f5554e5a700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f553c066f30 0x7f553c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:45.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.751+0000 7f5554e5a700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f553c066f30 0x7f553c0693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5540007fd0 tx=0x7f55400026a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:45.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:45.755+0000 7f554cff9700 1 -- 172.21.15.84:0/941674755 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f555015ae10 con 0x7f5550159510 2023-10-06T03:26:46.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.008+0000 7f55570be700 1 -- 172.21.15.84:0/941674755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5550064ad0 con 0x7f5550159510 2023-10-06T03:26:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.012+0000 7f554cff9700 1 -- 172.21.15.84:0/941674755 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f55440170e0 con 0x7f5550159510 2023-10-06T03:26:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 -- 172.21.15.84:0/941674755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f553c066f30 msgr2=0x7f553c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f553c066f30 0x7f553c0693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5540007fd0 tx=0x7f55400026a0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 -- 172.21.15.84:0/941674755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5550159510 msgr2=0x7f555015b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5550159510 0x7f555015b910 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f554400c510 tx=0x7f554400c820 comp rx=0 tx=0).stop 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 -- 172.21.15.84:0/941674755 shutdown_connections 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f553c066f30 0x7f553c0693e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55501598e0 0x7f55500c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55500cbcb0 0x7f5550149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 --2- 172.21.15.84:0/941674755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5550159510 0x7f555015b910 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 -- 172.21.15.84:0/941674755 >> 172.21.15.84:0/941674755 conn(0x7f5550089e90 msgr2=0x7f555014a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 -- 172.21.15.84:0/941674755 shutdown_connections 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.014+0000 7f55570be700 1 -- 172.21.15.84:0/941674755 wait complete. 2023-10-06T03:26:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T03:26:46.176 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:46.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.289+0000 7fb694d7d700 1 Processor -- start 2023-10-06T03:26:46.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.289+0000 7fb694d7d700 1 -- start start 2023-10-06T03:26:46.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb694d7d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb6900b07a0 0x7fb6900ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:46.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb694d7d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900b0ca0 con 0x7fb6900b49e0 2023-10-06T03:26:46.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb694d7d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900b0f80 con 0x7fb6901595a0 2023-10-06T03:26:46.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb694d7d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900ab390 con 0x7fb6900b07a0 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb68ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb6900b07a0 0x7fb6900ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb68dd9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb6900b49e0 0x7fb6900aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42042/0 (socket says 172.21.15.84:42042) 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb68dd9b700 1 -- 172.21.15.84:0/2186322602 learned_addr learned my addr 172.21.15.84:0/2186322602 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb68ed9d700 1 -- 172.21.15.84:0/2186322602 >> v1:172.21.15.131:6789/0 conn(0x7fb6901595a0 legacy=0x7fb6900aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb68ed9d700 1 -- 172.21.15.84:0/2186322602 >> v1:172.21.15.84:6789/0 conn(0x7fb6900b49e0 legacy=0x7fb6900aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb68d59a700 1 -- 172.21.15.84:0/2186322602 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231044566 0 0) 0x7fb6900b0ca0 con 0x7fb6900b49e0 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb68ed9d700 1 -- 172.21.15.84:0/2186322602 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900b1260 con 0x7fb6900b07a0 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb68ed9d700 1 --2- 172.21.15.84:0/2186322602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 0x7fb6900ccfd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb688009910 tx=0x7fb6880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4e6f98c5cb74b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.290+0000 7fb68d59a700 1 -- 172.21.15.84:0/2186322602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800b820 con 0x7fb6900b07a0 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.291+0000 7fb68d59a700 1 -- 172.21.15.84:0/2186322602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68800b980 con 0x7fb6900b07a0 2023-10-06T03:26:46.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.291+0000 7fb68d59a700 1 -- 172.21.15.84:0/2186322602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800bd20 con 0x7fb6900b07a0 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.291+0000 7fb694d7d700 1 -- 172.21.15.84:0/2186322602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 msgr2=0x7fb6900ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.291+0000 7fb694d7d700 1 --2- 172.21.15.84:0/2186322602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 0x7fb6900ccfd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb688009910 tx=0x7fb6880091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.291+0000 7fb694d7d700 1 -- 172.21.15.84:0/2186322602 shutdown_connections 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.291+0000 7fb694d7d700 1 --2- 172.21.15.84:0/2186322602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 0x7fb6900ccfd0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.291+0000 7fb694d7d700 1 -- 172.21.15.84:0/2186322602 >> 172.21.15.84:0/2186322602 conn(0x7fb690099830 msgr2=0x7fb69006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.291+0000 7fb694d7d700 1 -- 172.21.15.84:0/2186322602 shutdown_connections 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.291+0000 7fb694d7d700 1 -- 172.21.15.84:0/2186322602 wait complete. 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.292+0000 7fb694d7d700 1 Processor -- start 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.292+0000 7fb694d7d700 1 -- start start 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb694d7d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 0x7fb6900ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb694d7d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6900b49e0 0x7fb69009b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb694d7d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6901595a0 0x7fb69015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb694d7d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015ae20 con 0x7fb6900b07a0 2023-10-06T03:26:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb694d7d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015b100 con 0x7fb6901595a0 2023-10-06T03:26:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb694d7d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015b3e0 con 0x7fb6900b49e0 2023-10-06T03:26:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 0x7fb6900ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 0x7fb6900ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45374/0 (socket says 172.21.15.84:45374) 2023-10-06T03:26:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68e59c700 1 -- 172.21.15.84:0/3377694283 learned_addr learned my addr 172.21.15.84:0/3377694283 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68ed9d700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6901595a0 0x7fb69015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68dd9b700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6900b49e0 0x7fb69009b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68e59c700 1 -- 172.21.15.84:0/3377694283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6900b49e0 msgr2=0x7fb69009b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68e59c700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6900b49e0 0x7fb69009b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68e59c700 1 -- 172.21.15.84:0/3377694283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6901595a0 msgr2=0x7fb69015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68e59c700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6901595a0 0x7fb69015bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68e59c700 1 -- 172.21.15.84:0/3377694283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb688009420 con 0x7fb6900b07a0 2023-10-06T03:26:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68ed9d700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6901595a0 0x7fb69015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68dd9b700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6900b49e0 0x7fb69009b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.293+0000 7fb68e59c700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 0x7fb6900ae880 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb68000cd30 tx=0x7fb680001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.294+0000 7fb67e7fc700 1 -- 172.21.15.84:0/3377694283 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000ab70 con 0x7fb6900b07a0 2023-10-06T03:26:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.294+0000 7fb67e7fc700 1 -- 172.21.15.84:0/3377694283 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68000acd0 con 0x7fb6900b07a0 2023-10-06T03:26:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.294+0000 7fb694d7d700 1 -- 172.21.15.84:0/3377694283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69015b6c0 con 0x7fb6900b07a0 2023-10-06T03:26:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.294+0000 7fb67e7fc700 1 -- 172.21.15.84:0/3377694283 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680012670 con 0x7fb6900b07a0 2023-10-06T03:26:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.294+0000 7fb694d7d700 1 -- 172.21.15.84:0/3377694283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6900aedc0 con 0x7fb6900b07a0 2023-10-06T03:26:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.295+0000 7fb694d7d700 1 -- 172.21.15.84:0/3377694283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb690064ad0 con 0x7fb6900b07a0 2023-10-06T03:26:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.295+0000 7fb67e7fc700 1 -- 172.21.15.84:0/3377694283 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb680012a60 con 0x7fb6900b07a0 2023-10-06T03:26:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.295+0000 7fb67e7fc700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb670066f30 0x7fb6700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.296+0000 7fb68dd9b700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb670066f30 0x7fb6700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.296+0000 7fb67e7fc700 1 -- 172.21.15.84:0/3377694283 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb680084f30 con 0x7fb6900b07a0 2023-10-06T03:26:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.296+0000 7fb68dd9b700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb670066f30 0x7fb6700693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb6840011e0 tx=0x7fb684009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.300+0000 7fb67e7fc700 1 -- 172.21.15.84:0/3377694283 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb680051f00 con 0x7fb6900b07a0 2023-10-06T03:26:46.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.524+0000 7fb694d7d700 1 -- 172.21.15.84:0/3377694283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6900b1540 con 0x7fb6900b07a0 2023-10-06T03:26:46.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.525+0000 7fb67e7fc700 1 -- 172.21.15.84:0/3377694283 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fb680055520 con 0x7fb6900b07a0 2023-10-06T03:26:46.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:46.654 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3563307477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3563307477},{"type":"v1","addr":"172.21.15.84:6837","nonce":3563307477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":5923,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1010130826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1010130826},{"type":"v1","addr":"172.21.15.131:6834","nonce":1010130826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/569291567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":569291567},{"type":"v1","addr":"172.21.15.84:6836","nonce":569291567}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:40.528842+0000","modified":"2023-10-06T03:26:44.181991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6615},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6615":{"gid":6615,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/1003867498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1003867498},{"type":"v1","addr":"172.21.15.131:6835","nonce":1003867498}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:26:46.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 -- 172.21.15.84:0/3377694283 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb670066f30 msgr2=0x7fb6700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:46.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb670066f30 0x7fb6700693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb6840011e0 tx=0x7fb684009040 comp rx=0 tx=0).stop 2023-10-06T03:26:46.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 -- 172.21.15.84:0/3377694283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 msgr2=0x7fb6900ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:46.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 0x7fb6900ae880 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb68000cd30 tx=0x7fb680001b40 comp rx=0 tx=0).stop 2023-10-06T03:26:46.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 -- 172.21.15.84:0/3377694283 shutdown_connections 2023-10-06T03:26:46.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb670066f30 0x7fb6700693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6901595a0 0x7fb69015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6900b07a0 0x7fb6900ae880 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 --2- 172.21.15.84:0/3377694283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6900b49e0 0x7fb69009b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:46.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 -- 172.21.15.84:0/3377694283 >> 172.21.15.84:0/3377694283 conn(0x7fb690099830 msgr2=0x7fb690158930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:46.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 -- 172.21.15.84:0/3377694283 shutdown_connections 2023-10-06T03:26:46.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:46.527+0000 7fb694d7d700 1 -- 172.21.15.84:0/3377694283 wait complete. 2023-10-06T03:26:46.657 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-10-06T03:26:47.060 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:26:40.528842+0000', 'modified': '2023-10-06T03:26:44.181991+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6615}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6615': {'gid': 6615, 'name': 'b', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6835/1003867498', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 1003867498}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 1003867498}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:26:47.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:26:47.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:26:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.179+0000 7f959d153700 1 Processor -- start 2023-10-06T03:26:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.179+0000 7f959d153700 1 -- start start 2023-10-06T03:26:47.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.180+0000 7f959d153700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95980ce8e0 0x7f959815af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.180+0000 7f959d153700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9598157e20 con 0x7f95980ca3b0 2023-10-06T03:26:47.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.180+0000 7f959d153700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95980cb610 con 0x7f95980adba0 2023-10-06T03:26:47.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.180+0000 7f959d153700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95980cbbd0 con 0x7f95980ce8e0 2023-10-06T03:26:47.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.180+0000 7f959759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95980ce8e0 0x7f959815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.180+0000 7f9596d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f95980ca3b0 0x7f95981582b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42048/0 (socket says 172.21.15.84:42048) 2023-10-06T03:26:47.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.180+0000 7f9596d9d700 1 -- 172.21.15.84:0/4229775187 learned_addr learned my addr 172.21.15.84:0/4229775187 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959759e700 1 -- 172.21.15.84:0/4229775187 >> v1:172.21.15.131:6789/0 conn(0x7f95980adba0 legacy=0x7f95980ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959759e700 1 -- 172.21.15.84:0/4229775187 >> v1:172.21.15.84:6789/0 conn(0x7f95980ca3b0 legacy=0x7f95981582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959659c700 1 -- 172.21.15.84:0/4229775187 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175585051 0 0) 0x7f9598157e20 con 0x7f95980ca3b0 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959759e700 1 -- 172.21.15.84:0/4229775187 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95980cb8f0 con 0x7f95980ce8e0 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959759e700 1 --2- 172.21.15.84:0/4229775187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 0x7f959815af10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9590009e60 tx=0x7f9590009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1312cd1e2265f9e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959659c700 1 -- 172.21.15.84:0/4229775187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959000e070 con 0x7f95980ce8e0 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959659c700 1 -- 172.21.15.84:0/4229775187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959000bc30 con 0x7f95980ce8e0 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959659c700 1 -- 172.21.15.84:0/4229775187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590012430 con 0x7f95980ce8e0 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959d153700 1 -- 172.21.15.84:0/4229775187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 msgr2=0x7f959815af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959d153700 1 --2- 172.21.15.84:0/4229775187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 0x7f959815af10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9590009e60 tx=0x7f9590009780 comp rx=0 tx=0).stop 2023-10-06T03:26:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959d153700 1 -- 172.21.15.84:0/4229775187 shutdown_connections 2023-10-06T03:26:47.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959d153700 1 --2- 172.21.15.84:0/4229775187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 0x7f959815af10 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959d153700 1 -- 172.21.15.84:0/4229775187 >> 172.21.15.84:0/4229775187 conn(0x7f9598070810 msgr2=0x7f9598070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:47.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.181+0000 7f959d153700 1 -- 172.21.15.84:0/4229775187 shutdown_connections 2023-10-06T03:26:47.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.182+0000 7f959d153700 1 -- 172.21.15.84:0/4229775187 wait complete. 2023-10-06T03:26:47.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.183+0000 7f959d153700 1 Processor -- start 2023-10-06T03:26:47.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.183+0000 7f959d153700 1 -- start start 2023-10-06T03:26:47.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.183+0000 7f959d153700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95980adba0 0x7f95980c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.183+0000 7f959d153700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95980ca3b0 0x7f95980b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.183+0000 7f959d153700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 0x7f95980b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.183+0000 7f959d153700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95980c2320 con 0x7f95980ce8e0 2023-10-06T03:26:47.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.183+0000 7f959d153700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95980c4f60 con 0x7f95980ca3b0 2023-10-06T03:26:47.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.183+0000 7f959d153700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959815c1d0 con 0x7f95980adba0 2023-10-06T03:26:47.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 0x7f95980b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 0x7f95980b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45384/0 (socket says 172.21.15.84:45384) 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959759e700 1 -- 172.21.15.84:0/2068607940 learned_addr learned my addr 172.21.15.84:0/2068607940 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f958e59c700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95980ca3b0 0x7f95980b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f9596d9d700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95980adba0 0x7f95980c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959759e700 1 -- 172.21.15.84:0/2068607940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95980adba0 msgr2=0x7f95980c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959759e700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95980adba0 0x7f95980c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959759e700 1 -- 172.21.15.84:0/2068607940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95980ca3b0 msgr2=0x7f95980b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959759e700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95980ca3b0 0x7f95980b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959759e700 1 -- 172.21.15.84:0/2068607940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9590009a20 con 0x7f95980ce8e0 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959759e700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 0x7f95980b1600 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f95980cdfe0 tx=0x7f9590019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f958f7fe700 1 -- 172.21.15.84:0/2068607940 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959001b420 con 0x7f95980ce8e0 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f958f7fe700 1 -- 172.21.15.84:0/2068607940 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959001b580 con 0x7f95980ce8e0 2023-10-06T03:26:47.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959d153700 1 -- 172.21.15.84:0/2068607940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959815c4b0 con 0x7f95980ce8e0 2023-10-06T03:26:47.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f958f7fe700 1 -- 172.21.15.84:0/2068607940 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959001b940 con 0x7f95980ce8e0 2023-10-06T03:26:47.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.184+0000 7f959d153700 1 -- 172.21.15.84:0/2068607940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959815bf40 con 0x7f95980ce8e0 2023-10-06T03:26:47.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.186+0000 7f958f7fe700 1 -- 172.21.15.84:0/2068607940 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f959001bcb0 con 0x7f95980ce8e0 2023-10-06T03:26:47.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.186+0000 7f958f7fe700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9578066f30 0x7f95780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.186+0000 7f958f7fe700 1 -- 172.21.15.84:0/2068607940 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f95900865b0 con 0x7f95980ce8e0 2023-10-06T03:26:47.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.186+0000 7f9596d9d700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9578066f30 0x7f95780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.186+0000 7f9596d9d700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9578066f30 0x7f95780693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9588007160 tx=0x7f9588007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:47.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.188+0000 7f95a644bb80 1 Processor -- start 2023-10-06T03:26:47.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.188+0000 7f95a644bb80 1 -- start start 2023-10-06T03:26:47.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15a26c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a766c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a77050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f95a644bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e1597da70 con 0x560e15a76c00 2023-10-06T03:26:47.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f95a644bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e1597b270 con 0x560e15a26840 2023-10-06T03:26:47.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f95a644bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e15977060 con 0x560e15a27cc0 2023-10-06T03:26:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f959759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a77050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f959759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a77050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45390/0 (socket says 172.21.15.84:45390) 2023-10-06T03:26:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f959759e700 1 -- 172.21.15.84:0/3387403213 learned_addr learned my addr 172.21.15.84:0/3387403213 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f9596d9d700 1 --2- 172.21.15.84:0/3387403213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15a26c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f958e59c700 1 --2- 172.21.15.84:0/3387403213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f959759e700 1 -- 172.21.15.84:0/3387403213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 msgr2=0x560e15a766c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f959759e700 1 --2- 172.21.15.84:0/3387403213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a766c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f959759e700 1 -- 172.21.15.84:0/3387403213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 msgr2=0x560e15a26c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f959759e700 1 --2- 172.21.15.84:0/3387403213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15a26c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f959759e700 1 -- 172.21.15.84:0/3387403213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e15811270 con 0x560e15a76c00 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f959759e700 1 --2- 172.21.15.84:0/3387403213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a77050 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f9590084860 tx=0x7f9590084790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17ca7031781931d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f9577fff700 1 -- 172.21.15.84:0/3387403213 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959000e040 con 0x560e15a76c00 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f9577fff700 1 -- 172.21.15.84:0/3387403213 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590057240 con 0x560e15a76c00 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.189+0000 7f9577fff700 1 -- 172.21.15.84:0/3387403213 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900579c0 con 0x560e15a76c00 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.190+0000 7f95a644bb80 1 -- 172.21.15.84:0/3387403213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 msgr2=0x560e15a77050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.190+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3387403213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a77050 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f9590084860 tx=0x7f9590084790 comp rx=0 tx=0).stop 2023-10-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.190+0000 7f95a644bb80 1 -- 172.21.15.84:0/3387403213 shutdown_connections 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.190+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3387403213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15a26c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.190+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3387403213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a77050 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.190+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3387403213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a766c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.190+0000 7f95a644bb80 1 -- 172.21.15.84:0/3387403213 >> 172.21.15.84:0/3387403213 conn(0x560e15a28160 msgr2=0x560e15a28530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.190+0000 7f95a644bb80 1 -- 172.21.15.84:0/3387403213 shutdown_connections 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.190+0000 7f95a644bb80 1 -- 172.21.15.84:0/3387403213 wait complete. 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.191+0000 7f95a644bb80 1 -- start start 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.191+0000 7f95a644bb80 1 Processor -- start 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a26840 0x560e15a53b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a27cc0 0x560e15a4fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a76c00 0x560e15a80550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f95a644bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e15922890 con 0x560e15a26840 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f95a644bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e1593dea0 con 0x560e15a27cc0 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f95a644bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e157f9e30 con 0x560e15a76c00 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f95a644bb80 10 client.0 _ll_register_callbacks cb 0x560e159e9e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f9596d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a26840 0x560e15a53b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f9596d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a26840 0x560e15a53b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45394/0 (socket says 172.21.15.84:45394) 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f9596d9d700 1 -- 172.21.15.84:0/3928340161 learned_addr learned my addr 172.21.15.84:0/3928340161 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f958e59c700 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a27cc0 0x560e15a4fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f959759e700 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a76c00 0x560e15a80550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f9596d9d700 1 -- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a76c00 msgr2=0x560e15a80550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f9596d9d700 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a76c00 0x560e15a80550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f9596d9d700 1 -- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a27cc0 msgr2=0x560e15a4fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f9596d9d700 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a27cc0 0x560e15a4fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f9596d9d700 1 -- 172.21.15.84:0/3928340161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959815bf40 con 0x560e15a26840 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f958e59c700 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a27cc0 0x560e15a4fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f959759e700 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a76c00 0x560e15a80550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f9596d9d700 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a26840 0x560e15a53b40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f9588006710 tx=0x7f9588014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7d2243a2b5159c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f95757fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f95757fa700 1 -- 172.21.15.84:0/3928340161 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588001a00 con 0x560e15a26840 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.192+0000 7f95757fa700 1 -- 172.21.15.84:0/3928340161 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f958801b070 con 0x560e15a26840 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95a644bb80 1 -- 172.21.15.84:0/3928340161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e15a1b940 con 0x560e15a26840 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95757fa700 1 -- 172.21.15.84:0/3928340161 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9588001b60 con 0x560e15a26840 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95a644bb80 10 client.6765 fetch_fsmap learned FSMap version 46 2023-10-06T03:26:47.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95a644bb80 1 -- 172.21.15.84:0/3928340161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x560e157b3fe0 con 0x560e15a26840 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95757fa700 1 -- 172.21.15.84:0/3928340161 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560e15a1b940 con 0x560e15a26840 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95757fa700 1 -- 172.21.15.84:0/3928340161 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f95880133f0 con 0x560e15a26840 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95a644bb80 10 client.6765 fetch_fsmap finished waiting for FSMap version 46 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95a644bb80 10 client.6765 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95a644bb80 20 client.6765 populate_metadata read hostname 'smithi084' 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x560e15a52cf0 0x560e15a8a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95a644bb80 4 client.6765 mds_command: new command op to 6615 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f95a644bb80 1 -- 172.21.15.84:0/3928340161 --> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e159f8870 con 0x560e15a52cf0 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.193+0000 7f958e59c700 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x560e15a52cf0 0x560e15a8a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.194+0000 7f95757fa700 10 client.6765 ms_handle_connect on v2:172.21.15.131:6833/1003867498 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.194+0000 7f958e59c700 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x560e15a52cf0 0x560e15a8a810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fb5a23c1c884a5b server_cookie=aba8aa10edca992f in_seq=0 out_seq=0 2023-10-06T03:26:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.194+0000 7f95757fa700 1 -- 172.21.15.84:0/3928340161 <== mds.0 v2:172.21.15.131:6833/1003867498 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560e159f8870 con 0x560e15a52cf0 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.194+0000 7f95757fa700 10 client.6765 handle_command_reply: tid=0 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.194+0000 7f95a644bb80 1 client.6765 shutdown 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.194+0000 7f95a644bb80 1 -- 172.21.15.84:0/3928340161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a26840 msgr2=0x560e15a53b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.194+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a26840 0x560e15a53b40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f9588006710 tx=0x7f9588014000 comp rx=0 tx=0).stop 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.195+0000 7f95a644bb80 1 -- 172.21.15.84:0/3928340161 shutdown_connections 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.195+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x560e15a52cf0 0x560e15a8a810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.195+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a76c00 0x560e15a80550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.195+0000 7f95757fa700 0 client.6765 ms_handle_reset on v2:172.21.15.131:6833/1003867498 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.195+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a26840 0x560e15a53b40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.195+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3928340161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a27cc0 0x560e15a4fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.195+0000 7f95a644bb80 1 -- 172.21.15.84:0/3928340161 >> 172.21.15.84:0/3928340161 conn(0x560e15a28160 msgr2=0x560e15a6a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:47.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.195+0000 7f95a644bb80 1 -- 172.21.15.84:0/3928340161 shutdown_connections 2023-10-06T03:26:47.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.195+0000 7f95a644bb80 1 -- 172.21.15.84:0/3928340161 wait complete. 2023-10-06T03:26:47.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.195+0000 7f95a644bb80 20 client.6765 trim_cache size 0 max 16384 2023-10-06T03:26:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.211+0000 7f95a644bb80 1 Processor -- start 2023-10-06T03:26:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.211+0000 7f95a644bb80 1 -- start start 2023-10-06T03:26:47.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15a676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a870c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a21be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f95a644bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e15a654e0 con 0x560e15a76c00 2023-10-06T03:26:47.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f95a644bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e15a24350 con 0x560e15a26840 2023-10-06T03:26:47.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f95a644bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e15a27430 con 0x560e15a27cc0 2023-10-06T03:26:47.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f959759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a21be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f959759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a21be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45402/0 (socket says 172.21.15.84:45402) 2023-10-06T03:26:47.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f959759e700 1 -- 172.21.15.84:0/1995244586 learned_addr learned my addr 172.21.15.84:0/1995244586 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f9596d9d700 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15a676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f958e59c700 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f959759e700 1 -- 172.21.15.84:0/1995244586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 msgr2=0x560e15a870c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f959759e700 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a870c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f959759e700 1 -- 172.21.15.84:0/1995244586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 msgr2=0x560e15a676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f959759e700 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15a676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f959759e700 1 -- 172.21.15.84:0/1995244586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e15945780 con 0x560e15a76c00 2023-10-06T03:26:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f9596d9d700 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15a676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.212+0000 7f958e59c700 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a870c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f959759e700 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a21be0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9590053740 tx=0x7f959006a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71da3d8196bad75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f958cd99700 1 -- 172.21.15.84:0/1995244586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959000e040 con 0x560e15a76c00 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f958cd99700 1 -- 172.21.15.84:0/1995244586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590053580 con 0x560e15a76c00 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f958cd99700 1 -- 172.21.15.84:0/1995244586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900579c0 con 0x560e15a76c00 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f95a644bb80 1 -- 172.21.15.84:0/1995244586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 msgr2=0x560e15a21be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f95a644bb80 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a21be0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9590053740 tx=0x7f959006a000 comp rx=0 tx=0).stop 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f95a644bb80 1 -- 172.21.15.84:0/1995244586 shutdown_connections 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f95a644bb80 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15a676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f95a644bb80 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a21be0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f95a644bb80 1 --2- 172.21.15.84:0/1995244586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a870c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f95a644bb80 1 -- 172.21.15.84:0/1995244586 >> 172.21.15.84:0/1995244586 conn(0x560e15a28160 msgr2=0x560e15a51b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:47.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f95a644bb80 1 -- 172.21.15.84:0/1995244586 shutdown_connections 2023-10-06T03:26:47.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.213+0000 7f95a644bb80 1 -- 172.21.15.84:0/1995244586 wait complete. 2023-10-06T03:26:47.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.214+0000 7f95a644bb80 1 -- start start 2023-10-06T03:26:47.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.214+0000 7f95a644bb80 1 Processor -- start 2023-10-06T03:26:47.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15abcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a71520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f95a644bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a7f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f95a644bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e15a710d0 con 0x560e15a76c00 2023-10-06T03:26:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f95a644bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e15abd8c0 con 0x560e15a26840 2023-10-06T03:26:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f95a644bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e15a64b10 con 0x560e15a27cc0 2023-10-06T03:26:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f95a644bb80 10 client.0 _ll_register_callbacks cb 0x560e159e9e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:26:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f959759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a7f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f959759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a7f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45418/0 (socket says 172.21.15.84:45418) 2023-10-06T03:26:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f959759e700 1 -- 172.21.15.84:0/3712556309 learned_addr learned my addr 172.21.15.84:0/3712556309 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f9596d9d700 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15abcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f958e59c700 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a71520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f959759e700 1 -- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 msgr2=0x560e15a71520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f959759e700 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a71520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f959759e700 1 -- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 msgr2=0x560e15abcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f959759e700 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15abcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f959759e700 1 -- 172.21.15.84:0/3712556309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959006d040 con 0x560e15a76c00 2023-10-06T03:26:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f958e59c700 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a71520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f959759e700 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a7f6e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f9590055590 tx=0x7f959006f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf1a613bbd8a949 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f95757fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:26:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f95757fa700 1 -- 172.21.15.84:0/3712556309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590062070 con 0x560e15a76c00 2023-10-06T03:26:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.215+0000 7f95757fa700 1 -- 172.21.15.84:0/3712556309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f959005a490 con 0x560e15a76c00 2023-10-06T03:26:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95a644bb80 1 -- 172.21.15.84:0/3712556309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e15919e00 con 0x560e15a76c00 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95757fa700 1 -- 172.21.15.84:0/3712556309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f959000e070 con 0x560e15a76c00 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95a644bb80 10 client.6771 fetch_fsmap learned FSMap version 46 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95a644bb80 1 -- 172.21.15.84:0/3712556309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x560e1592c470 con 0x560e15a76c00 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95757fa700 1 -- 172.21.15.84:0/3712556309 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560e15919e00 con 0x560e15a76c00 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95757fa700 1 -- 172.21.15.84:0/3712556309 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9590065080 con 0x560e15a76c00 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95a644bb80 10 client.6771 fetch_fsmap finished waiting for FSMap version 46 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95a644bb80 10 client.6771 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95a644bb80 20 client.6771 populate_metadata read hostname 'smithi084' 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x560e15a71a60 0x560e15a7fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95a644bb80 4 client.6771 mds_command: new command op to 6615 tid=0[{"prefix": "status"}] 2023-10-06T03:26:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95a644bb80 1 -- 172.21.15.84:0/3712556309 --> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560e15919b20 con 0x560e15a71a60 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f9596d9d700 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x560e15a71a60 0x560e15a7fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f95757fa700 10 client.6771 ms_handle_connect on v2:172.21.15.131:6833/1003867498 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.216+0000 7f9596d9d700 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x560e15a71a60 0x560e15a7fc20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cada9b2a009ab8b5 server_cookie=8af61a4a1a99d179 in_seq=0 out_seq=0 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95757fa700 1 -- 172.21.15.84:0/3712556309 <== mds.0 v2:172.21.15.131:6833/1003867498 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x560e15919b20 con 0x560e15a71a60 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95757fa700 10 client.6771 handle_command_reply: tid=0 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 client.6771 shutdown 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 -- 172.21.15.84:0/3712556309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 msgr2=0x560e15a7f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a7f6e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f9590055590 tx=0x7f959006f070 comp rx=0 tx=0).stop 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 -- 172.21.15.84:0/3712556309 shutdown_connections 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x560e15a71a60 0x560e15a7fc20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e15a26840 0x560e15abcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95757fa700 0 client.6771 ms_handle_reset on v2:172.21.15.131:6833/1003867498 2023-10-06T03:26:47.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e15a76c00 0x560e15a7f6e0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 --2- 172.21.15.84:0/3712556309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e15a27cc0 0x560e15a71520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 -- 172.21.15.84:0/3712556309 >> 172.21.15.84:0/3712556309 conn(0x560e15a28160 msgr2=0x560e15a21be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:47.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 -- 172.21.15.84:0/3712556309 shutdown_connections 2023-10-06T03:26:47.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 1 -- 172.21.15.84:0/3712556309 wait complete. 2023-10-06T03:26:47.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f95a644bb80 20 client.6771 trim_cache size 0 max 16384 2023-10-06T03:26:47.229 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:26:47.229 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6615, 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 6.0473545450000001, 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 46, 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 86, 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 12.140233767 2023-10-06T03:26:47.230 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:26:47.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f959d153700 1 -- 172.21.15.84:0/2068607940 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9578066f30 msgr2=0x7f95780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f959d153700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9578066f30 0x7f95780693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9588007160 tx=0x7f9588007f50 comp rx=0 tx=0).stop 2023-10-06T03:26:47.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f959d153700 1 -- 172.21.15.84:0/2068607940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 msgr2=0x7f95980b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f959d153700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 0x7f95980b1600 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f95980cdfe0 tx=0x7f9590019000 comp rx=0 tx=0).stop 2023-10-06T03:26:47.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f959d153700 1 -- 172.21.15.84:0/2068607940 shutdown_connections 2023-10-06T03:26:47.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f959d153700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9578066f30 0x7f95780693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f959d153700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95980ce8e0 0x7f95980b1600 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f959d153700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95980adba0 0x7f95980c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f959d153700 1 --2- 172.21.15.84:0/2068607940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95980ca3b0 0x7f95980b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.217+0000 7f959d153700 1 -- 172.21.15.84:0/2068607940 >> 172.21.15.84:0/2068607940 conn(0x7f9598070810 msgr2=0x7f95980ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:47.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.218+0000 7f959d153700 1 -- 172.21.15.84:0/2068607940 shutdown_connections 2023-10-06T03:26:47.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.218+0000 7f959d153700 1 -- 172.21.15.84:0/2068607940 wait complete. 2023-10-06T03:26:47.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:26:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.345+0000 7fc58eccc700 1 Processor -- start 2023-10-06T03:26:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.345+0000 7fc58eccc700 1 -- start start 2023-10-06T03:26:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.346+0000 7fc58eccc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc5881595a0 0x7fc5880aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.346+0000 7fc58eccc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5880b07a0 0x7fc5880b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.346+0000 7fc58eccc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5880b0ca0 con 0x7fc5880b49e0 2023-10-06T03:26:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.346+0000 7fc58eccc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5880b0f80 con 0x7fc5880b07a0 2023-10-06T03:26:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.346+0000 7fc58eccc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5880b1260 con 0x7fc5881595a0 2023-10-06T03:26:47.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.346+0000 7fc58d269700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5880b07a0 0x7fc5880b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.346+0000 7fc58d269700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5880b07a0 0x7fc5880b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45432/0 (socket says 172.21.15.84:45432) 2023-10-06T03:26:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.346+0000 7fc58d269700 1 -- 172.21.15.84:0/449587793 learned_addr learned my addr 172.21.15.84:0/449587793 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.346+0000 7fc58ca68700 1 --2- 172.21.15.84:0/449587793 >> v2:172.21.15.131:3300/0 conn(0x7fc5881595a0 0x7fc5880aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc58d269700 1 -- 172.21.15.84:0/449587793 >> v2:172.21.15.131:3300/0 conn(0x7fc5881595a0 msgr2=0x7fc5880aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc58d269700 1 --2- 172.21.15.84:0/449587793 >> v2:172.21.15.131:3300/0 conn(0x7fc5881595a0 0x7fc5880aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc58d269700 1 -- 172.21.15.84:0/449587793 >> v1:172.21.15.131:6789/0 conn(0x7fc5880b49e0 legacy=0x7fc5880aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc58d269700 1 -- 172.21.15.84:0/449587793 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5880b1540 con 0x7fc5880b07a0 2023-10-06T03:26:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc58d269700 1 --2- 172.21.15.84:0/449587793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5880b07a0 0x7fc5880b1c00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc5800099b0 tx=0x7fc580009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68dc2448f66a1de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc57f7fe700 1 -- 172.21.15.84:0/449587793 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000b7e0 con 0x7fc5880b07a0 2023-10-06T03:26:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc57f7fe700 1 -- 172.21.15.84:0/449587793 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58000b940 con 0x7fc5880b07a0 2023-10-06T03:26:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc57f7fe700 1 -- 172.21.15.84:0/449587793 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000bce0 con 0x7fc5880b07a0 2023-10-06T03:26:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc58eccc700 1 -- 172.21.15.84:0/449587793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5880b07a0 msgr2=0x7fc5880b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc58eccc700 1 --2- 172.21.15.84:0/449587793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5880b07a0 0x7fc5880b1c00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc5800099b0 tx=0x7fc580009250 comp rx=0 tx=0).stop 2023-10-06T03:26:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.347+0000 7fc58eccc700 1 -- 172.21.15.84:0/449587793 shutdown_connections 2023-10-06T03:26:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.348+0000 7fc58eccc700 1 --2- 172.21.15.84:0/449587793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5880b07a0 0x7fc5880b1c00 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.348+0000 7fc58eccc700 1 --2- 172.21.15.84:0/449587793 >> v2:172.21.15.131:3300/0 conn(0x7fc5881595a0 0x7fc5880aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.348+0000 7fc58eccc700 1 -- 172.21.15.84:0/449587793 >> 172.21.15.84:0/449587793 conn(0x7fc588099830 msgr2=0x7fc58806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.348+0000 7fc58eccc700 1 -- 172.21.15.84:0/449587793 shutdown_connections 2023-10-06T03:26:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.348+0000 7fc58eccc700 1 -- 172.21.15.84:0/449587793 wait complete. 2023-10-06T03:26:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.349+0000 7fc58eccc700 1 Processor -- start 2023-10-06T03:26:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.349+0000 7fc58eccc700 1 -- start start 2023-10-06T03:26:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.349+0000 7fc58eccc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5880b07a0 0x7fc58809c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.349+0000 7fc58eccc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5880b49e0 0x7fc5880ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.349+0000 7fc58eccc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5881595a0 0x7fc5880ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.349+0000 7fc58eccc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58809de90 con 0x7fc5881595a0 2023-10-06T03:26:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.349+0000 7fc58eccc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58809cdf0 con 0x7fc5880b49e0 2023-10-06T03:26:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58eccc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58809d0d0 con 0x7fc5880b07a0 2023-10-06T03:26:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58d269700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5881595a0 0x7fc5880ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58d269700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5881595a0 0x7fc5880ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45440/0 (socket says 172.21.15.84:45440) 2023-10-06T03:26:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58d269700 1 -- 172.21.15.84:0/825215709 learned_addr learned my addr 172.21.15.84:0/825215709 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58ca68700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5880b07a0 0x7fc58809c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc57ffff700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5880b49e0 0x7fc5880ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58d269700 1 -- 172.21.15.84:0/825215709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5880b07a0 msgr2=0x7fc58809c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58d269700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5880b07a0 0x7fc58809c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58d269700 1 -- 172.21.15.84:0/825215709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5880b49e0 msgr2=0x7fc5880ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58d269700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5880b49e0 0x7fc5880ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58d269700 1 -- 172.21.15.84:0/825215709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5800094f0 con 0x7fc5881595a0 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc57ffff700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5880b49e0 0x7fc5880ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58ca68700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5880b07a0 0x7fc58809c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58d269700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5881595a0 0x7fc5880ce7d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc588067c60 tx=0x7fc580016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc57cff9700 1 -- 172.21.15.84:0/825215709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58001b450 con 0x7fc5881595a0 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc57cff9700 1 -- 172.21.15.84:0/825215709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc580020070 con 0x7fc5881595a0 2023-10-06T03:26:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58eccc700 1 -- 172.21.15.84:0/825215709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58809d3b0 con 0x7fc5881595a0 2023-10-06T03:26:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc57cff9700 1 -- 172.21.15.84:0/825215709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58001b820 con 0x7fc5881595a0 2023-10-06T03:26:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.350+0000 7fc58eccc700 1 -- 172.21.15.84:0/825215709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58809d970 con 0x7fc5881595a0 2023-10-06T03:26:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.351+0000 7fc58eccc700 1 -- 172.21.15.84:0/825215709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58809db60 con 0x7fc5881595a0 2023-10-06T03:26:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.352+0000 7fc57cff9700 1 -- 172.21.15.84:0/825215709 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc580022030 con 0x7fc5881595a0 2023-10-06T03:26:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.352+0000 7fc57cff9700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc574066f30 0x7fc5740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.352+0000 7fc57cff9700 1 -- 172.21.15.84:0/825215709 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc580086890 con 0x7fc5881595a0 2023-10-06T03:26:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.352+0000 7fc58ca68700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc574066f30 0x7fc5740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.353+0000 7fc58ca68700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc574066f30 0x7fc5740693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc58816d1f0 tx=0x7fc58400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:47.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.358+0000 7fc57cff9700 1 -- 172.21.15.84:0/825215709 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc580053860 con 0x7fc5881595a0 2023-10-06T03:26:47.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.582+0000 7fc58eccc700 1 -- 172.21.15.84:0/825215709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc58809db60 con 0x7fc5881595a0 2023-10-06T03:26:47.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.583+0000 7fc57cff9700 1 -- 172.21.15.84:0/825215709 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc580056e80 con 0x7fc5881595a0 2023-10-06T03:26:47.584 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:26:47.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.584+0000 7fc58eccc700 1 -- 172.21.15.84:0/825215709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc574066f30 msgr2=0x7fc5740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.584+0000 7fc58eccc700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc574066f30 0x7fc5740693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc58816d1f0 tx=0x7fc58400b040 comp rx=0 tx=0).stop 2023-10-06T03:26:47.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.584+0000 7fc58eccc700 1 -- 172.21.15.84:0/825215709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5881595a0 msgr2=0x7fc5880ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.584+0000 7fc58eccc700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5881595a0 0x7fc5880ce7d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc588067c60 tx=0x7fc580016000 comp rx=0 tx=0).stop 2023-10-06T03:26:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.584+0000 7fc58eccc700 1 -- 172.21.15.84:0/825215709 shutdown_connections 2023-10-06T03:26:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.584+0000 7fc58eccc700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc574066f30 0x7fc5740693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.584+0000 7fc58eccc700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5881595a0 0x7fc5880ce7d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.584+0000 7fc58eccc700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5880b07a0 0x7fc58809c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.584+0000 7fc58eccc700 1 --2- 172.21.15.84:0/825215709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5880b49e0 0x7fc5880ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.584+0000 7fc58eccc700 1 -- 172.21.15.84:0/825215709 >> 172.21.15.84:0/825215709 conn(0x7fc588099830 msgr2=0x7fc5880cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.585+0000 7fc58eccc700 1 -- 172.21.15.84:0/825215709 shutdown_connections 2023-10-06T03:26:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:47.585+0000 7fc58eccc700 1 -- 172.21.15.84:0/825215709 wait complete. 2023-10-06T03:26:47.598 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:26:47.598 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:26:47.598 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:26:47.598 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:26:47.598 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:26:47.598 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:26:47.599 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:26:47.599 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:26:47.599 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:26:47.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:47.599 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:26:47.614 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:26:47.614 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:26:47.614 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:26:47.614 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:47.614 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:26:47.614 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:26:47.615 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42347sec preferred_lft 42347sec 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9c01:bbff:fec1:72ce/64 scope link 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::74a6:25ff:fe2a:c673/64 scope link 2023-10-06T03:26:47.616 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:47.617 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:26:47.617 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether de:34:c5:3f:21:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:26:47.617 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc34:c5ff:fe3f:21c3/64 scope link 2023-10-06T03:26:47.617 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:47.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:47.617 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:26:47.677 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:26:47.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:47.679 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:26:47.734 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:26:47.735 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:26:47.735 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:26:47.735 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:26:47.735 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:26:47.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:47.735 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:26:47.736 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:26:47.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:26:47.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:26:47.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:26:47.736 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:26:47.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:47.835 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:26:47.849 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:26:47.849 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:26:47.850 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:26:47.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:47.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:26:47.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:26:47.914 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:26:47.969 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:26:47.969 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:26:47.969 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:26:48.023 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:26:48.024 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:26:48.024 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:48.103 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:48.103 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:48.121 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:26:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:26:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:26:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:26:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:26:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:26:48.144 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:48.144 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:48.144 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:26:48.144 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:26:48.144 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:26:48.144 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:26:48.144 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:26:48.144 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:26:48.145 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:26:48.145 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:26:48.145 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:26:48.146 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:26:48.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:48.146 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:26:48.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:26:48.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.365+0000 7f0af425b700 1 Processor -- start 2023-10-06T03:26:48.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.366+0000 7f0af425b700 1 -- start start 2023-10-06T03:26:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.366+0000 7f0af425b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0aec157010 0x7f0aec1573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.366+0000 7f0af425b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec0ab930 0x7f0aec0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.366+0000 7f0af425b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec15aff0 con 0x7f0aec0ca610 2023-10-06T03:26:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.366+0000 7f0af425b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec15bc70 con 0x7f0aec157010 2023-10-06T03:26:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.366+0000 7f0af425b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec15b2d0 con 0x7f0aec0ab930 2023-10-06T03:26:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.366+0000 7f0af27f8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0aec0ca610 0x7f0aec068600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42056/0 (socket says 172.21.15.84:42056) 2023-10-06T03:26:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.366+0000 7f0af27f8700 1 -- 172.21.15.84:0/1942113024 learned_addr learned my addr 172.21.15.84:0/1942113024 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122683645 0 0) 0x7f0aec15aff0 con 0x7f0aec0ca610 2023-10-06T03:26:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad8003570 con 0x7f0aec0ca610 2023-10-06T03:26:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af17f6700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec0ab930 0x7f0aec0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af1ff7700 1 --2- 172.21.15.84:0/1942113024 >> v2:172.21.15.131:3300/0 conn(0x7f0aec157010 0x7f0aec1573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1585370581 0 0) 0x7f0ad8003570 con 0x7f0aec0ca610 2023-10-06T03:26:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec0ab930 msgr2=0x7f0aec0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec0ab930 0x7f0aec0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 >> v2:172.21.15.131:3300/0 conn(0x7f0aec157010 msgr2=0x7f0aec1573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 --2- 172.21.15.84:0/1942113024 >> v2:172.21.15.131:3300/0 conn(0x7f0aec157010 0x7f0aec1573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec15b5b0 con 0x7f0aec0ca610 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f0ae4001470 con 0x7f0aec0ca610 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af1ff7700 1 --2- 172.21.15.84:0/1942113024 >> v2:172.21.15.131:3300/0 conn(0x7f0aec157010 0x7f0aec1573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 >> v1:172.21.15.84:6789/0 conn(0x7f0aec0ca610 legacy=0x7f0aec068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 0x7f0ad8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ad8004810 0x7f0ad8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec0ab930 0x7f0ad80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec15bc70 con 0x7f0ad8003a60 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec15b2d0 con 0x7f0ad8004810 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad800bb90 con 0x7f0aec0ab930 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af1ff7700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 0x7f0ad8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:48.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af17f6700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ad8004810 0x7f0ad8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af27f8700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec0ab930 0x7f0ad80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af1ff7700 1 -- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec0ab930 msgr2=0x7f0ad80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af1ff7700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec0ab930 0x7f0ad80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af1ff7700 1 -- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ad8004810 msgr2=0x7f0ad8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af1ff7700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ad8004810 0x7f0ad8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.367+0000 7f0af1ff7700 1 -- 172.21.15.84:0/1942113024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad8003570 con 0x7f0ad8003a60 2023-10-06T03:26:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af1ff7700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 0x7f0ad8003e70 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8007580 tx=0x7f0ae80097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676edb97a06bb2a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8009ae0 con 0x7f0ad8003a60 2023-10-06T03:26:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae8007dd0 con 0x7f0ad8003a60 2023-10-06T03:26:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af0ff5700 1 -- 172.21.15.84:0/1942113024 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8014610 con 0x7f0ad8003a60 2023-10-06T03:26:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af425b700 1 -- 172.21.15.84:0/1942113024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 msgr2=0x7f0ad8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af425b700 1 --2- 172.21.15.84:0/1942113024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 0x7f0ad8003e70 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8007580 tx=0x7f0ae80097d0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af27f8700 1 -- 172.21.15.84:0/1942113024 reap_dead start 2023-10-06T03:26:48.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af425b700 1 -- 172.21.15.84:0/1942113024 shutdown_connections 2023-10-06T03:26:48.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af425b700 1 -- 172.21.15.84:0/1942113024 >> 172.21.15.84:0/1942113024 conn(0x7f0aec06dd10 msgr2=0x7f0aec06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:48.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af425b700 1 -- 172.21.15.84:0/1942113024 shutdown_connections 2023-10-06T03:26:48.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.368+0000 7f0af425b700 1 -- 172.21.15.84:0/1942113024 wait complete. 2023-10-06T03:26:48.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.369+0000 7f0af425b700 1 Processor -- start 2023-10-06T03:26:48.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.369+0000 7f0af425b700 1 -- start start 2023-10-06T03:26:48.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af425b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 0x7f0aec14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:48.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af425b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec155f40 0x7f0aec154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:48.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af425b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aec154980 0x7f0aec168e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:48.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af425b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec153fb0 con 0x7f0ad8003a60 2023-10-06T03:26:48.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af425b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec150260 con 0x7f0aec154980 2023-10-06T03:26:48.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af425b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec1533a0 con 0x7f0aec155f40 2023-10-06T03:26:48.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af1ff7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 0x7f0aec14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:48.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af1ff7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 0x7f0aec14fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45452/0 (socket says 172.21.15.84:45452) 2023-10-06T03:26:48.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af1ff7700 1 -- 172.21.15.84:0/4138269183 learned_addr learned my addr 172.21.15.84:0/4138269183 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:48.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af17f6700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec155f40 0x7f0aec154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:48.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.370+0000 7f0af27f8700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aec154980 0x7f0aec168e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:48.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0af1ff7700 1 -- 172.21.15.84:0/4138269183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec155f40 msgr2=0x7f0aec154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:48.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0af1ff7700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec155f40 0x7f0aec154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0af1ff7700 1 -- 172.21.15.84:0/4138269183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aec154980 msgr2=0x7f0aec168e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:48.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0af1ff7700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aec154980 0x7f0aec168e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0af1ff7700 1 -- 172.21.15.84:0/4138269183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec153680 con 0x7f0ad8003a60 2023-10-06T03:26:48.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0af1ff7700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 0x7f0aec14fd20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8008010 tx=0x7f0ae8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:48.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0ae1ffb700 1 -- 172.21.15.84:0/4138269183 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8009ae0 con 0x7f0ad8003a60 2023-10-06T03:26:48.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0ae1ffb700 1 -- 172.21.15.84:0/4138269183 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae801f630 con 0x7f0ad8003a60 2023-10-06T03:26:48.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0af425b700 1 -- 172.21.15.84:0/4138269183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec153960 con 0x7f0ad8003a60 2023-10-06T03:26:48.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0ae1ffb700 1 -- 172.21.15.84:0/4138269183 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae801fa30 con 0x7f0ad8003a60 2023-10-06T03:26:48.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.371+0000 7f0af425b700 1 -- 172.21.15.84:0/4138269183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec1563b0 con 0x7f0ad8003a60 2023-10-06T03:26:48.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.372+0000 7f0af425b700 1 -- 172.21.15.84:0/4138269183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec064ad0 con 0x7f0ad8003a60 2023-10-06T03:26:48.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.372+0000 7f0ae1ffb700 1 -- 172.21.15.84:0/4138269183 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ae8003040 con 0x7f0ad8003a60 2023-10-06T03:26:48.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.373+0000 7f0ae1ffb700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ad0066f30 0x7f0ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:48.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.373+0000 7f0ae1ffb700 1 -- 172.21.15.84:0/4138269183 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0ae8086a10 con 0x7f0ad8003a60 2023-10-06T03:26:48.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.373+0000 7f0af17f6700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ad0066f30 0x7f0ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:48.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.373+0000 7f0af17f6700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ad0066f30 0x7f0ad00693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0aec16b1b0 tx=0x7f0adc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:48.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.377+0000 7f0ae1ffb700 1 -- 172.21.15.84:0/4138269183 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ae8053a90 con 0x7f0ad8003a60 2023-10-06T03:26:48.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.603+0000 7f0af425b700 1 -- 172.21.15.84:0/4138269183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0aec15b890 con 0x7f0ad8003a60 2023-10-06T03:26:48.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.604+0000 7f0ae1ffb700 1 -- 172.21.15.84:0/4138269183 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0ae801fe60 con 0x7f0ad8003a60 2023-10-06T03:26:48.605 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:26:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 -- 172.21.15.84:0/4138269183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ad0066f30 msgr2=0x7f0ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ad0066f30 0x7f0ad00693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0aec16b1b0 tx=0x7f0adc008040 comp rx=0 tx=0).stop 2023-10-06T03:26:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 -- 172.21.15.84:0/4138269183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 msgr2=0x7f0aec14fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 0x7f0aec14fd20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8008010 tx=0x7f0ae8018000 comp rx=0 tx=0).stop 2023-10-06T03:26:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 -- 172.21.15.84:0/4138269183 shutdown_connections 2023-10-06T03:26:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0ad0066f30 0x7f0ad00693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aec154980 0x7f0aec168e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8003a60 0x7f0aec14fd20 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 --2- 172.21.15.84:0/4138269183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aec155f40 0x7f0aec154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 -- 172.21.15.84:0/4138269183 >> 172.21.15.84:0/4138269183 conn(0x7f0aec06dd10 msgr2=0x7f0aec0cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:48.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 -- 172.21.15.84:0/4138269183 shutdown_connections 2023-10-06T03:26:48.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:48.606+0000 7f0af425b700 1 -- 172.21.15.84:0/4138269183 wait complete. 2023-10-06T03:26:48.619 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:26:48.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:26:48.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T03:26:48.620 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:26:48.620 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:26:48.620 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:26:48.620 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:26:48.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:26:48.621 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:26:48.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:48.621 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T03:26:48.642 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:26:48.643 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:26:48.643 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:26:48.643 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:48.643 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:26:48.643 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:48.643 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:48.644 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:48.644 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T03:26:48.644 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:48.645 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:48.645 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T03:26:48.645 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:26:48.645 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:48.645 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:26:48.645 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:48.646 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:26:48.646 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42344sec preferred_lft 42344sec 2023-10-06T03:26:48.646 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T03:26:48.646 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:48.646 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:26:48.646 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T03:26:48.646 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:26:48.646 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:48.647 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::a0d2:65ff:fe0e:962d/64 scope link 2023-10-06T03:26:48.647 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:48.647 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:26:48.647 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether e6:c9:c5:59:18:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:26:48.647 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::e4c9:c5ff:fe59:18bb/64 scope link 2023-10-06T03:26:48.647 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:48.647 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:26:48.647 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:26:48.647 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4f1:c0ff:fe85:853d/64 scope link 2023-10-06T03:26:48.647 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:26:48.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:48.648 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:26:48.711 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T03:26:48.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:48.713 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T03:26:48.773 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T03:26:48.774 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:26:48.774 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:26:48.774 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:26:48.774 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:26:48.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:48.775 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:26:48.775 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:26:48.775 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:26:48.775 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:26:48.775 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:26:48.775 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:26:48.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:48.880 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:26:48.895 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:26:48.895 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:26:48.896 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:26:48.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:48.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-10-06T03:26:48.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:26:48.967 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:26:49.022 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:26:49.022 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:26:49.023 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:26:49.078 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T03:26:49.078 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:26:49.078 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:49.157 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:49.158 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:49.176 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:49.177 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:49.177 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:26:49.177 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:26:49.177 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:26:49.177 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:26:49.177 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:26:49.177 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:26:49.198 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:26:49.199 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:26:49.199 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:26:49.199 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:26:49.199 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:26:49.199 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:26:49.199 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:26:49.199 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:26:49.199 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:26:49.199 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:26:49.199 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:26:49.201 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:26:49.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:49.201 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:26:49.265 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:26:49.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:26:49.266 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:26:49.309 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:26:49.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:49.309 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:26:49.364 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:26:49.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:26:49.365 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:26:49.402 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:26:49.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:26:49.402 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:26:49.457 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:49.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.570+0000 7f068810b700 1 Processor -- start 2023-10-06T03:26:49.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.570+0000 7f068810b700 1 -- start start 2023-10-06T03:26:49.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f068810b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f06801595a0 0x7f06800aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f068810b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06800b07a0 0x7f06800b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f068810b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06800b0ca0 con 0x7f06800b49e0 2023-10-06T03:26:49.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f068810b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06800b0f80 con 0x7f06801595a0 2023-10-06T03:26:49.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f068810b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800b1260 con 0x7f06800b07a0 2023-10-06T03:26:49.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f06856a6700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f06800b49e0 0x7f06800aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42058/0 (socket says 172.21.15.84:42058) 2023-10-06T03:26:49.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f06856a6700 1 -- 172.21.15.84:0/1228215454 learned_addr learned my addr 172.21.15.84:0/1228215454 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:49.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f06866a8700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06800b07a0 0x7f06800b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0685ea7700 1 --2- 172.21.15.84:0/1228215454 >> v2:172.21.15.131:3300/0 conn(0x7f06801595a0 0x7f06800aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099004422 0 0) 0x7f06800b0ca0 con 0x7f06800b49e0 2023-10-06T03:26:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0668003570 con 0x7f06800b49e0 2023-10-06T03:26:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513556715 0 0) 0x7f0668003570 con 0x7f06800b49e0 2023-10-06T03:26:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06800b07a0 msgr2=0x7f06800b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06800b07a0 0x7f06800b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 >> v2:172.21.15.131:3300/0 conn(0x7f06801595a0 msgr2=0x7f06800aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 --2- 172.21.15.84:0/1228215454 >> v2:172.21.15.131:3300/0 conn(0x7f06801595a0 0x7f06800aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800b1540 con 0x7f06800b49e0 2023-10-06T03:26:49.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f0674001470 con 0x7f06800b49e0 2023-10-06T03:26:49.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 >> v1:172.21.15.84:6789/0 conn(0x7f06800b49e0 legacy=0x7f06800aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0668003a60 0x7f0668003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0668004810 0x7f0668004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06680051c0 0x7f066800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800b0f80 con 0x7f06680051c0 2023-10-06T03:26:49.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800b1260 con 0x7f0668004810 2023-10-06T03:26:49.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066800bfa0 con 0x7f0668003a60 2023-10-06T03:26:49.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f06866a8700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06800b07a0 0x7f06800b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:49.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.571+0000 7f0685ea7700 1 --2- 172.21.15.84:0/1228215454 >> v2:172.21.15.131:3300/0 conn(0x7f06801595a0 0x7f06800aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f06866a8700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06680051c0 0x7f066800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f06856a6700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0668004810 0x7f0668004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f0685ea7700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0668003a60 0x7f0668003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f06866a8700 1 -- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0668003a60 msgr2=0x7f0668003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f06866a8700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0668003a60 0x7f0668003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f06866a8700 1 -- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0668004810 msgr2=0x7f0668004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f06866a8700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0668004810 0x7f0668004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f06866a8700 1 -- 172.21.15.84:0/1228215454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0668003570 con 0x7f06680051c0 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f06856a6700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0668004810 0x7f0668004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f06866a8700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06680051c0 0x7f066800ba60 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f06800b0b70 tx=0x7f06780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88d4d2b07580983 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800e6e0 con 0x7f06680051c0 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067800e840 con 0x7f06680051c0 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.572+0000 7f0684ea5700 1 -- 172.21.15.84:0/1228215454 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800ebe0 con 0x7f06680051c0 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.573+0000 7f068810b700 1 -- 172.21.15.84:0/1228215454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06680051c0 msgr2=0x7f066800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.573+0000 7f068810b700 1 --2- 172.21.15.84:0/1228215454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06680051c0 0x7f066800ba60 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f06800b0b70 tx=0x7f06780091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.573+0000 7f06866a8700 1 -- 172.21.15.84:0/1228215454 reap_dead start 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.573+0000 7f068810b700 1 -- 172.21.15.84:0/1228215454 shutdown_connections 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.573+0000 7f068810b700 1 -- 172.21.15.84:0/1228215454 >> 172.21.15.84:0/1228215454 conn(0x7f0680099830 msgr2=0x7f068006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.573+0000 7f068810b700 1 -- 172.21.15.84:0/1228215454 shutdown_connections 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.573+0000 7f068810b700 1 -- 172.21.15.84:0/1228215454 wait complete. 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.574+0000 7f068810b700 1 Processor -- start 2023-10-06T03:26:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.574+0000 7f068810b700 1 -- start start 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.574+0000 7f068810b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f068016cbe0 0x7f0680169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.574+0000 7f068810b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06800ac120 0x7f06800ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.574+0000 7f068810b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06800c5c80 0x7f06800c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.574+0000 7f068810b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800acc20 con 0x7f06800ac120 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.574+0000 7f068810b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800c6630 con 0x7f06800c5c80 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.574+0000 7f068810b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800ae730 con 0x7f068016cbe0 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f06856a6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06800ac120 0x7f06800ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f06856a6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06800ac120 0x7f06800ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45478/0 (socket says 172.21.15.84:45478) 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f06856a6700 1 -- 172.21.15.84:0/571476541 learned_addr learned my addr 172.21.15.84:0/571476541 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f06856a6700 1 -- 172.21.15.84:0/571476541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f068016cbe0 msgr2=0x7f0680169db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f06856a6700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f068016cbe0 0x7f0680169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f06856a6700 1 -- 172.21.15.84:0/571476541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06800c5c80 msgr2=0x7f06800c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f06866a8700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06800c5c80 0x7f06800c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f06856a6700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06800c5c80 0x7f06800c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f06856a6700 1 -- 172.21.15.84:0/571476541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800ade00 con 0x7f06800ac120 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f06856a6700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06800ac120 0x7f06800ac590 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0674007710 tx=0x7f0674001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f067dffb700 1 -- 172.21.15.84:0/571476541 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740077f0 con 0x7f06800ac120 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f067dffb700 1 -- 172.21.15.84:0/571476541 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067400fc60 con 0x7f06800ac120 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f068810b700 1 -- 172.21.15.84:0/571476541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06800ae0e0 con 0x7f06800ac120 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f067dffb700 1 -- 172.21.15.84:0/571476541 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740133f0 con 0x7f06800ac120 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.575+0000 7f068810b700 1 -- 172.21.15.84:0/571476541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06800ab440 con 0x7f06800ac120 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.576+0000 7f068810b700 1 -- 172.21.15.84:0/571476541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0680064ad0 con 0x7f06800ac120 2023-10-06T03:26:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.577+0000 7f067dffb700 1 -- 172.21.15.84:0/571476541 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0674013760 con 0x7f06800ac120 2023-10-06T03:26:49.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.577+0000 7f067dffb700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f066c066f30 0x7f066c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.577+0000 7f067dffb700 1 -- 172.21.15.84:0/571476541 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0674084c30 con 0x7f06800ac120 2023-10-06T03:26:49.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.577+0000 7f0685ea7700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f066c066f30 0x7f066c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.578+0000 7f0685ea7700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f066c066f30 0x7f066c0693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0670009fd0 tx=0x7f067000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:49.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.581+0000 7f067dffb700 1 -- 172.21.15.84:0/571476541 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0674051c00 con 0x7f06800ac120 2023-10-06T03:26:49.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.806+0000 7f068810b700 1 -- 172.21.15.84:0/571476541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06800ae870 con 0x7f06800ac120 2023-10-06T03:26:49.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.806+0000 7f067dffb700 1 -- 172.21.15.84:0/571476541 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f0674055220 con 0x7f06800ac120 2023-10-06T03:26:49.808 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:49.808 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3563307477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3563307477},{"type":"v1","addr":"172.21.15.84:6837","nonce":3563307477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":5923,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1010130826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1010130826},{"type":"v1","addr":"172.21.15.131:6834","nonce":1010130826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/569291567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":569291567},{"type":"v1","addr":"172.21.15.84:6836","nonce":569291567}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:40.528842+0000","modified":"2023-10-06T03:26:44.181991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6615},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6615":{"gid":6615,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/1003867498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1003867498},{"type":"v1","addr":"172.21.15.131:6835","nonce":1003867498}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:26:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 -- 172.21.15.84:0/571476541 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f066c066f30 msgr2=0x7f066c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f066c066f30 0x7f066c0693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0670009fd0 tx=0x7f067000b040 comp rx=0 tx=0).stop 2023-10-06T03:26:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 -- 172.21.15.84:0/571476541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06800ac120 msgr2=0x7f06800ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06800ac120 0x7f06800ac590 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0674007710 tx=0x7f0674001e50 comp rx=0 tx=0).stop 2023-10-06T03:26:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 -- 172.21.15.84:0/571476541 shutdown_connections 2023-10-06T03:26:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f066c066f30 0x7f066c0693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06800c5c80 0x7f06800c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f068016cbe0 0x7f0680169db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 --2- 172.21.15.84:0/571476541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06800ac120 0x7f06800ac590 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 -- 172.21.15.84:0/571476541 >> 172.21.15.84:0/571476541 conn(0x7f0680099830 msgr2=0x7f0680068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:49.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 -- 172.21.15.84:0/571476541 shutdown_connections 2023-10-06T03:26:49.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.808+0000 7f068810b700 1 -- 172.21.15.84:0/571476541 wait complete. 2023-10-06T03:26:49.812 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-10-06T03:26:49.822 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 session ls 2023-10-06T03:26:49.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.938+0000 7ff48a942700 1 Processor -- start 2023-10-06T03:26:49.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.938+0000 7ff48a942700 1 -- start start 2023-10-06T03:26:49.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff48a942700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff4840b2a90 0x7ff4840cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff48a942700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4840c6610 0x7ff4840cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff48a942700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4840cbdf0 con 0x7ff4840cb980 2023-10-06T03:26:49.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff48a942700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4840b2e60 con 0x7ff4840b2a90 2023-10-06T03:26:49.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff48a942700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840cf5d0 con 0x7ff4840c6610 2023-10-06T03:26:49.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff483fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff4840b2a90 0x7ff4840cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff483fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff4840b2a90 0x7ff4840cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45482/0 (socket says 172.21.15.84:45482) 2023-10-06T03:26:49.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff483fff700 1 -- 172.21.15.84:0/1364607649 learned_addr learned my addr 172.21.15.84:0/1364607649 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:49.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff488edf700 1 --2- 172.21.15.84:0/1364607649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4840c6610 0x7ff4840cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff483fff700 1 -- 172.21.15.84:0/1364607649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4840c6610 msgr2=0x7ff4840cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff483fff700 1 --2- 172.21.15.84:0/1364607649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4840c6610 0x7ff4840cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff483fff700 1 -- 172.21.15.84:0/1364607649 >> v1:172.21.15.131:6789/0 conn(0x7ff4840cb980 legacy=0x7ff4840ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff483fff700 1 -- 172.21.15.84:0/1364607649 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4840cf8b0 con 0x7ff4840b2a90 2023-10-06T03:26:49.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff483fff700 1 --2- 172.21.15.84:0/1364607649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 0x7ff4840cb440 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff474009990 tx=0x7ff474009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05ba241fe87c13b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:49.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff482ffd700 1 -- 172.21.15.84:0/1364607649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474005c10 con 0x7ff4840b2a90 2023-10-06T03:26:49.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff482ffd700 1 -- 172.21.15.84:0/1364607649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff474005d70 con 0x7ff4840b2a90 2023-10-06T03:26:49.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.939+0000 7ff482ffd700 1 -- 172.21.15.84:0/1364607649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47400b8a0 con 0x7ff4840b2a90 2023-10-06T03:26:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.940+0000 7ff48a942700 1 -- 172.21.15.84:0/1364607649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 msgr2=0x7ff4840cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.940+0000 7ff48a942700 1 --2- 172.21.15.84:0/1364607649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 0x7ff4840cb440 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff474009990 tx=0x7ff474009220 comp rx=0 tx=0).stop 2023-10-06T03:26:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.940+0000 7ff48a942700 1 -- 172.21.15.84:0/1364607649 shutdown_connections 2023-10-06T03:26:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.940+0000 7ff48a942700 1 --2- 172.21.15.84:0/1364607649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4840c6610 0x7ff4840cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.940+0000 7ff48a942700 1 --2- 172.21.15.84:0/1364607649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 0x7ff4840cb440 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.940+0000 7ff48a942700 1 -- 172.21.15.84:0/1364607649 >> 172.21.15.84:0/1364607649 conn(0x7ff484099740 msgr2=0x7ff48406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.940+0000 7ff48a942700 1 -- 172.21.15.84:0/1364607649 shutdown_connections 2023-10-06T03:26:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.940+0000 7ff48a942700 1 -- 172.21.15.84:0/1364607649 wait complete. 2023-10-06T03:26:49.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.941+0000 7ff48a942700 1 Processor -- start 2023-10-06T03:26:49.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.941+0000 7ff48a942700 1 -- start start 2023-10-06T03:26:49.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff48a942700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 0x7ff4840c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff48a942700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4840c6610 0x7ff484156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff48a942700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4840cb980 0x7ff48415df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff48a942700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff484157480 con 0x7ff4840b2a90 2023-10-06T03:26:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff48a942700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840c8790 con 0x7ff4840c6610 2023-10-06T03:26:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff48a942700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48415e4b0 con 0x7ff4840cb980 2023-10-06T03:26:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff483fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 0x7ff4840c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff483fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 0x7ff4840c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45498/0 (socket says 172.21.15.84:45498) 2023-10-06T03:26:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff483fff700 1 -- 172.21.15.84:0/3825186282 learned_addr learned my addr 172.21.15.84:0/3825186282 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff488edf700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4840cb980 0x7ff48415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff4837fe700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4840c6610 0x7ff484156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff483fff700 1 -- 172.21.15.84:0/3825186282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4840cb980 msgr2=0x7ff48415df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff483fff700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4840cb980 0x7ff48415df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff483fff700 1 -- 172.21.15.84:0/3825186282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4840c6610 msgr2=0x7ff484156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff483fff700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4840c6610 0x7ff484156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff483fff700 1 -- 172.21.15.84:0/3825186282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474009480 con 0x7ff4840b2a90 2023-10-06T03:26:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff4837fe700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4840c6610 0x7ff484156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.942+0000 7ff483fff700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 0x7ff4840c75a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff47400b3c0 tx=0x7ff474016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.943+0000 7ff46bfff700 1 -- 172.21.15.84:0/3825186282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47401a420 con 0x7ff4840b2a90 2023-10-06T03:26:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.943+0000 7ff46bfff700 1 -- 172.21.15.84:0/3825186282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47401a5a0 con 0x7ff4840b2a90 2023-10-06T03:26:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.943+0000 7ff48a942700 1 -- 172.21.15.84:0/3825186282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4840c7b80 con 0x7ff4840b2a90 2023-10-06T03:26:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.943+0000 7ff46bfff700 1 -- 172.21.15.84:0/3825186282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47401a960 con 0x7ff4840b2a90 2023-10-06T03:26:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.943+0000 7ff48a942700 1 -- 172.21.15.84:0/3825186282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4840c8140 con 0x7ff4840b2a90 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.944+0000 7ff46bfff700 1 -- 172.21.15.84:0/3825186282 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff474011420 con 0x7ff4840b2a90 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.944+0000 7ff46bfff700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff470066f30 0x7ff4700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.945+0000 7ff46bfff700 1 -- 172.21.15.84:0/3825186282 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff474085c30 con 0x7ff4840b2a90 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.945+0000 7ff4837fe700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff470066f30 0x7ff4700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.945+0000 7ff4837fe700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff470066f30 0x7ff4700693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff478007fd0 tx=0x7ff478009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.946+0000 7ff493c3ab80 1 Processor -- start 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.946+0000 7ff493c3ab80 1 -- start start 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fc890 0x5652d19fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fdd10 0x5652d1a4c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d1a4cc50 0x5652d1a4d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d1953ac0 con 0x5652d19fdd10 2023-10-06T03:26:49.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d19512c0 con 0x5652d19fc890 2023-10-06T03:26:49.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652d194d0b0 con 0x5652d1a4cc50 2023-10-06T03:26:49.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff4837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fdd10 0x5652d1a4c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff4837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fdd10 0x5652d1a4c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45508/0 (socket says 172.21.15.84:45508) 2023-10-06T03:26:49.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff4837fe700 1 -- 172.21.15.84:0/903464805 learned_addr learned my addr 172.21.15.84:0/903464805 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:49.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff488edf700 1 --2- 172.21.15.84:0/903464805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d1a4cc50 0x5652d1a4d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff4837fe700 1 -- 172.21.15.84:0/903464805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d1a4cc50 msgr2=0x5652d1a4d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff4837fe700 1 --2- 172.21.15.84:0/903464805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d1a4cc50 0x5652d1a4d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff483fff700 1 --2- 172.21.15.84:0/903464805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fc890 0x5652d19fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.947+0000 7ff4837fe700 1 -- 172.21.15.84:0/903464805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fc890 msgr2=0x5652d19fcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.948+0000 7ff4837fe700 1 --2- 172.21.15.84:0/903464805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fc890 0x5652d19fcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.948+0000 7ff4837fe700 1 -- 172.21.15.84:0/903464805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652d17e72c0 con 0x5652d19fdd10 2023-10-06T03:26:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.948+0000 7ff488edf700 1 --2- 172.21.15.84:0/903464805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d1a4cc50 0x5652d1a4d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.948+0000 7ff4837fe700 1 --2- 172.21.15.84:0/903464805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fdd10 0x5652d1a4c710 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff47800e940 tx=0x7ff478013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150cd33725ca8a24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.948+0000 7ff4697fa700 1 -- 172.21.15.84:0/903464805 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478015110 con 0x5652d19fdd10 2023-10-06T03:26:49.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.948+0000 7ff4697fa700 1 -- 172.21.15.84:0/903464805 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478015270 con 0x5652d19fdd10 2023-10-06T03:26:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.948+0000 7ff4697fa700 1 -- 172.21.15.84:0/903464805 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478015ae0 con 0x5652d19fdd10 2023-10-06T03:26:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.948+0000 7ff493c3ab80 1 -- 172.21.15.84:0/903464805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fdd10 msgr2=0x5652d1a4c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.948+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/903464805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fdd10 0x5652d1a4c710 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff47800e940 tx=0x7ff478013000 comp rx=0 tx=0).stop 2023-10-06T03:26:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.949+0000 7ff493c3ab80 1 -- 172.21.15.84:0/903464805 shutdown_connections 2023-10-06T03:26:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.949+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/903464805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fc890 0x5652d19fcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.949+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/903464805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d1a4cc50 0x5652d1a4d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.949+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/903464805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fdd10 0x5652d1a4c710 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.949+0000 7ff493c3ab80 1 -- 172.21.15.84:0/903464805 >> 172.21.15.84:0/903464805 conn(0x5652d19fe1b0 msgr2=0x5652d19fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.949+0000 7ff493c3ab80 1 -- 172.21.15.84:0/903464805 shutdown_connections 2023-10-06T03:26:49.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.949+0000 7ff493c3ab80 1 -- 172.21.15.84:0/903464805 wait complete. 2023-10-06T03:26:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.949+0000 7ff493c3ab80 1 -- start start 2023-10-06T03:26:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.949+0000 7ff493c3ab80 1 Processor -- start 2023-10-06T03:26:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fc890 0x5652d1a48370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fdd10 0x5652d1a3cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d1a4cc50 0x5652d1a253e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d18f88e0 con 0x5652d19fc890 2023-10-06T03:26:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d1913ef0 con 0x5652d1a4cc50 2023-10-06T03:26:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652d17cfe80 con 0x5652d19fdd10 2023-10-06T03:26:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff493c3ab80 10 client.0 _ll_register_callbacks cb 0x5652d19bfec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:26:49.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff483fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fc890 0x5652d1a48370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff483fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fc890 0x5652d1a48370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45512/0 (socket says 172.21.15.84:45512) 2023-10-06T03:26:49.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff483fff700 1 -- 172.21.15.84:0/1160212266 learned_addr learned my addr 172.21.15.84:0/1160212266 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:49.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff488edf700 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d1a4cc50 0x5652d1a253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff4837fe700 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fdd10 0x5652d1a3cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff483fff700 1 -- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fdd10 msgr2=0x5652d1a3cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff483fff700 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fdd10 0x5652d1a3cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff483fff700 1 -- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d1a4cc50 msgr2=0x5652d1a253e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff483fff700 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d1a4cc50 0x5652d1a253e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff483fff700 1 -- 172.21.15.84:0/1160212266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47800f040 con 0x5652d19fc890 2023-10-06T03:26:49.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff483fff700 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fc890 0x5652d1a48370 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ff474083f40 tx=0x7ff474083e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55ceff15ba96c11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:49.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.950+0000 7ff4627fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:26:49.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff4627fc700 1 -- 172.21.15.84:0/1160212266 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474057040 con 0x5652d19fc890 2023-10-06T03:26:49.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff4627fc700 1 -- 172.21.15.84:0/1160212266 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff4740568c0 con 0x5652d19fc890 2023-10-06T03:26:49.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff493c3ab80 1 -- 172.21.15.84:0/1160212266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652d19f1990 con 0x5652d19fc890 2023-10-06T03:26:49.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff4627fc700 1 -- 172.21.15.84:0/1160212266 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff474059b10 con 0x5652d19fc890 2023-10-06T03:26:49.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff493c3ab80 10 client.6804 fetch_fsmap learned FSMap version 46 2023-10-06T03:26:49.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff493c3ab80 1 -- 172.21.15.84:0/1160212266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x5652d178a030 con 0x5652d19fc890 2023-10-06T03:26:49.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff4627fc700 1 -- 172.21.15.84:0/1160212266 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5652d19f1990 con 0x5652d19fc890 2023-10-06T03:26:49.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff4627fc700 1 -- 172.21.15.84:0/1160212266 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff474055db0 con 0x5652d19fc890 2023-10-06T03:26:49.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff493c3ab80 10 client.6804 fetch_fsmap finished waiting for FSMap version 46 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff493c3ab80 10 client.6804 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff493c3ab80 20 client.6804 populate_metadata read hostname 'smithi084' 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x5652d1a564b0 0x5652d1a56880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff493c3ab80 4 client.6804 mds_command: new command op to 6615 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff493c3ab80 1 -- 172.21.15.84:0/1160212266 --> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652d19ce8c0 con 0x5652d1a564b0 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.951+0000 7ff4837fe700 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x5652d1a564b0 0x5652d1a56880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff4627fc700 10 client.6804 ms_handle_connect on v2:172.21.15.131:6833/1003867498 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff4837fe700 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x5652d1a564b0 0x5652d1a56880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67cb35217cef32e5 server_cookie=5d4a404d765fa531 in_seq=0 out_seq=0 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff4627fc700 1 -- 172.21.15.84:0/1160212266 <== mds.0 v2:172.21.15.131:6833/1003867498 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5652d19ce8c0 con 0x5652d1a564b0 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff4627fc700 10 client.6804 handle_command_reply: tid=0 2023-10-06T03:26:49.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 client.6804 shutdown 2023-10-06T03:26:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 -- 172.21.15.84:0/1160212266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fc890 msgr2=0x5652d1a48370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fc890 0x5652d1a48370 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ff474083f40 tx=0x7ff474083e10 comp rx=0 tx=0).stop 2023-10-06T03:26:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 -- 172.21.15.84:0/1160212266 shutdown_connections 2023-10-06T03:26:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x5652d1a564b0 0x5652d1a56880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d1a4cc50 0x5652d1a253e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff4627fc700 0 client.6804 ms_handle_reset on v2:172.21.15.131:6833/1003867498 2023-10-06T03:26:49.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d19fc890 0x5652d1a48370 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/1160212266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fdd10 0x5652d1a3cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 -- 172.21.15.84:0/1160212266 >> 172.21.15.84:0/1160212266 conn(0x5652d19fe1b0 msgr2=0x5652d1a46450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:49.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 -- 172.21.15.84:0/1160212266 shutdown_connections 2023-10-06T03:26:49.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 1 -- 172.21.15.84:0/1160212266 wait complete. 2023-10-06T03:26:49.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.952+0000 7ff493c3ab80 20 client.6804 trim_cache size 0 max 16384 2023-10-06T03:26:49.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.969+0000 7ff493c3ab80 1 Processor -- start 2023-10-06T03:26:49.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.969+0000 7ff493c3ab80 1 -- start start 2023-10-06T03:26:49.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fc890 0x5652d1a3ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fdd10 0x5652d1a3b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a55060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d1a3c330 con 0x5652d1a4cc50 2023-10-06T03:26:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d19ff140 con 0x5652d19fdd10 2023-10-06T03:26:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652d1a41c70 con 0x5652d19fc890 2023-10-06T03:26:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff488edf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a55060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff488edf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a55060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45524/0 (socket says 172.21.15.84:45524) 2023-10-06T03:26:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff488edf700 1 -- 172.21.15.84:0/4238333194 learned_addr learned my addr 172.21.15.84:0/4238333194 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:49.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff483fff700 1 --2- 172.21.15.84:0/4238333194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fc890 0x5652d1a3ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff488edf700 1 -- 172.21.15.84:0/4238333194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fc890 msgr2=0x5652d1a3ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff4837fe700 1 --2- 172.21.15.84:0/4238333194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fdd10 0x5652d1a3b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff488edf700 1 --2- 172.21.15.84:0/4238333194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fc890 0x5652d1a3ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff488edf700 1 -- 172.21.15.84:0/4238333194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fdd10 msgr2=0x5652d1a3b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff488edf700 1 --2- 172.21.15.84:0/4238333194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fdd10 0x5652d1a3b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.970+0000 7ff488edf700 1 -- 172.21.15.84:0/4238333194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652d191b7d0 con 0x5652d1a4cc50 2023-10-06T03:26:49.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff488edf700 1 --2- 172.21.15.84:0/4238333194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a55060 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0077e0 tx=0x7ff47c009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9039b5643882fa63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:49.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff469ffb700 1 -- 172.21.15.84:0/4238333194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c007340 con 0x5652d1a4cc50 2023-10-06T03:26:49.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff469ffb700 1 -- 172.21.15.84:0/4238333194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c0146e0 con 0x5652d1a4cc50 2023-10-06T03:26:49.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff469ffb700 1 -- 172.21.15.84:0/4238333194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c014a60 con 0x5652d1a4cc50 2023-10-06T03:26:49.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff493c3ab80 1 -- 172.21.15.84:0/4238333194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 msgr2=0x5652d1a55060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/4238333194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a55060 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0077e0 tx=0x7ff47c009850 comp rx=0 tx=0).stop 2023-10-06T03:26:49.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff493c3ab80 1 -- 172.21.15.84:0/4238333194 shutdown_connections 2023-10-06T03:26:49.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/4238333194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a55060 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/4238333194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fc890 0x5652d1a3ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/4238333194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fdd10 0x5652d1a3b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff493c3ab80 1 -- 172.21.15.84:0/4238333194 >> 172.21.15.84:0/4238333194 conn(0x5652d19fe1b0 msgr2=0x5652d1a42420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:49.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff493c3ab80 1 -- 172.21.15.84:0/4238333194 shutdown_connections 2023-10-06T03:26:49.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.971+0000 7ff493c3ab80 1 -- 172.21.15.84:0/4238333194 wait complete. 2023-10-06T03:26:49.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.972+0000 7ff493c3ab80 1 -- start start 2023-10-06T03:26:49.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.972+0000 7ff493c3ab80 1 Processor -- start 2023-10-06T03:26:49.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fc890 0x5652d1a3f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fdd10 0x5652d19f8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff493c3ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a43740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d19f9040 con 0x5652d1a4cc50 2023-10-06T03:26:49.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d1a3fed0 con 0x5652d19fc890 2023-10-06T03:26:49.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff493c3ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652d19f8b70 con 0x5652d19fdd10 2023-10-06T03:26:49.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff493c3ab80 10 client.0 _ll_register_callbacks cb 0x5652d19bfec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:26:49.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff488edf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a43740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff488edf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a43740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45538/0 (socket says 172.21.15.84:45538) 2023-10-06T03:26:49.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff488edf700 1 -- 172.21.15.84:0/763340893 learned_addr learned my addr 172.21.15.84:0/763340893 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:49.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff4837fe700 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fdd10 0x5652d19f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff483fff700 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fc890 0x5652d1a3f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff488edf700 1 -- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fdd10 msgr2=0x5652d19f8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff488edf700 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fdd10 0x5652d19f8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff488edf700 1 -- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fc890 msgr2=0x5652d1a3f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:49.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff488edf700 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fc890 0x5652d1a3f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff488edf700 1 -- 172.21.15.84:0/763340893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c007510 con 0x5652d1a4cc50 2023-10-06T03:26:49.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff488edf700 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a43740 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ff47c007f30 tx=0x7ff47c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39134c2d5f90d08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:49.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff4627fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:26:49.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff4627fc700 1 -- 172.21.15.84:0/763340893 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c026070 con 0x5652d1a4cc50 2023-10-06T03:26:49.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff493c3ab80 1 -- 172.21.15.84:0/763340893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff478015270 con 0x5652d1a4cc50 2023-10-06T03:26:49.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.973+0000 7ff4627fc700 1 -- 172.21.15.84:0/763340893 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff47c01b030 con 0x5652d1a4cc50 2023-10-06T03:26:49.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff4627fc700 1 -- 172.21.15.84:0/763340893 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff47c014a60 con 0x5652d1a4cc50 2023-10-06T03:26:49.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff493c3ab80 10 client.6810 fetch_fsmap learned FSMap version 46 2023-10-06T03:26:49.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff493c3ab80 1 -- 172.21.15.84:0/763340893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x5652d19024c0 con 0x5652d1a4cc50 2023-10-06T03:26:49.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff4627fc700 1 -- 172.21.15.84:0/763340893 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478015270 con 0x5652d1a4cc50 2023-10-06T03:26:49.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff4627fc700 1 -- 172.21.15.84:0/763340893 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff47c017440 con 0x5652d1a4cc50 2023-10-06T03:26:49.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff493c3ab80 10 client.6810 fetch_fsmap finished waiting for FSMap version 46 2023-10-06T03:26:49.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff493c3ab80 10 client.6810 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2023-10-06T03:26:49.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff493c3ab80 20 client.6810 populate_metadata read hostname 'smithi084' 2023-10-06T03:26:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x5652d1a43c80 0x5652d1a393a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff493c3ab80 4 client.6810 mds_command: new command op to 6615 tid=0[{"prefix": "session ls"}] 2023-10-06T03:26:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff493c3ab80 1 -- 172.21.15.84:0/763340893 --> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] -- command(tid 0: {"prefix": "session ls"}) v1 -- 0x5652d18efe50 con 0x5652d1a43c80 2023-10-06T03:26:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff483fff700 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x5652d1a43c80 0x5652d1a393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff4627fc700 10 client.6810 ms_handle_connect on v2:172.21.15.131:6833/1003867498 2023-10-06T03:26:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff483fff700 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x5652d1a43c80 0x5652d1a393a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cf2fe7536740dd0 server_cookie=c677fbbb4482d11f in_seq=0 out_seq=0 2023-10-06T03:26:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff4627fc700 1 -- 172.21.15.84:0/763340893 <== mds.0 v2:172.21.15.131:6833/1003867498 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5652d18efe50 con 0x5652d1a43c80 2023-10-06T03:26:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.974+0000 7ff4627fc700 10 client.6810 handle_command_reply: tid=0 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 client.6810 shutdown 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 -- 172.21.15.84:0/763340893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 msgr2=0x5652d1a43740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a43740 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ff47c007f30 tx=0x7ff47c01f000 comp rx=0 tx=0).stop 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 -- 172.21.15.84:0/763340893 shutdown_connections 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:6833/1003867498,v1:172.21.15.131:6835/1003867498] conn(0x5652d1a43c80 0x5652d1a393a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652d19fc890 0x5652d1a3f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652d1a4cc50 0x5652d1a43740 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff4627fc700 0 client.6810 ms_handle_reset on v2:172.21.15.131:6833/1003867498 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 --2- 172.21.15.84:0/763340893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5652d19fdd10 0x5652d19f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 -- 172.21.15.84:0/763340893 >> 172.21.15.84:0/763340893 conn(0x5652d19fe1b0 msgr2=0x5652d1a42420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:49.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 -- 172.21.15.84:0/763340893 shutdown_connections 2023-10-06T03:26:49.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 1 -- 172.21.15.84:0/763340893 wait complete. 2023-10-06T03:26:49.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff493c3ab80 20 client.6810 trim_cache size 0 max 16384 2023-10-06T03:26:49.993 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2023-10-06T03:26:49.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 -- 172.21.15.84:0/3825186282 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff470066f30 msgr2=0x7ff4700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff470066f30 0x7ff4700693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff478007fd0 tx=0x7ff478009040 comp rx=0 tx=0).stop 2023-10-06T03:26:49.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 -- 172.21.15.84:0/3825186282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 msgr2=0x7ff4840c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:49.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 0x7ff4840c75a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff47400b3c0 tx=0x7ff474016000 comp rx=0 tx=0).stop 2023-10-06T03:26:49.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 -- 172.21.15.84:0/3825186282 shutdown_connections 2023-10-06T03:26:49.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff470066f30 0x7ff4700693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4840cb980 0x7ff48415df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4840b2a90 0x7ff4840c75a0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 --2- 172.21.15.84:0/3825186282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4840c6610 0x7ff484156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:49.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 -- 172.21.15.84:0/3825186282 >> 172.21.15.84:0/3825186282 conn(0x7ff484099740 msgr2=0x7ff484159ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:49.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 -- 172.21.15.84:0/3825186282 shutdown_connections 2023-10-06T03:26:49.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:49.975+0000 7ff48a942700 1 -- 172.21.15.84:0/3825186282 wait complete. 2023-10-06T03:26:49.996 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-10-06T03:26:50.130 INFO:teuthology.orchestra.run.smithi131.stdout:[] 2023-10-06T03:26:50.131 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-10-06T03:26:50.131 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:26:50.131 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:26:50.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:26:50.214 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:26:50.215 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.328+0000 7f907759e700 1 Processor -- start 2023-10-06T03:26:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.328+0000 7f907759e700 1 -- start start 2023-10-06T03:26:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f907759e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9078159480 0x7f90780b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f907759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f90780b3610 0x7f90780cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f907759e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90780cb7e0 con 0x7f90780cc1b0 2023-10-06T03:26:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f907759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90780b08a0 con 0x7f90780b3610 2023-10-06T03:26:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f907759e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90780cb190 con 0x7f9078159480 2023-10-06T03:26:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f9075d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f90780b3610 0x7f90780cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f9075d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f90780b3610 0x7f90780cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45554/0 (socket says 172.21.15.84:45554) 2023-10-06T03:26:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f9075d9b700 1 -- 172.21.15.84:0/137947545 learned_addr learned my addr 172.21.15.84:0/137947545 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f907659c700 1 --2- 172.21.15.84:0/137947545 >> v2:172.21.15.131:3300/0 conn(0x7f9078159480 0x7f90780b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f9075d9b700 1 -- 172.21.15.84:0/137947545 >> v2:172.21.15.131:3300/0 conn(0x7f9078159480 msgr2=0x7f90780b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f9075d9b700 1 --2- 172.21.15.84:0/137947545 >> v2:172.21.15.131:3300/0 conn(0x7f9078159480 0x7f90780b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f9075d9b700 1 -- 172.21.15.84:0/137947545 >> v1:172.21.15.131:6789/0 conn(0x7f90780cc1b0 legacy=0x7f90780b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.329+0000 7f9075d9b700 1 -- 172.21.15.84:0/137947545 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780cb470 con 0x7f90780b3610 2023-10-06T03:26:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f9075d9b700 1 --2- 172.21.15.84:0/137947545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 0x7f90780cbc70 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f907806fa30 tx=0x7f906c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf82a007d3c1daa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907559a700 1 -- 172.21.15.84:0/137947545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c00b860 con 0x7f90780b3610 2023-10-06T03:26:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907559a700 1 -- 172.21.15.84:0/137947545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c00b9c0 con 0x7f90780b3610 2023-10-06T03:26:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907559a700 1 -- 172.21.15.84:0/137947545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c00bd60 con 0x7f90780b3610 2023-10-06T03:26:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907759e700 1 -- 172.21.15.84:0/137947545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 msgr2=0x7f90780cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907759e700 1 --2- 172.21.15.84:0/137947545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 0x7f90780cbc70 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f907806fa30 tx=0x7f906c009250 comp rx=0 tx=0).stop 2023-10-06T03:26:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907759e700 1 -- 172.21.15.84:0/137947545 shutdown_connections 2023-10-06T03:26:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907759e700 1 --2- 172.21.15.84:0/137947545 >> v2:172.21.15.131:3300/0 conn(0x7f9078159480 0x7f90780b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907759e700 1 --2- 172.21.15.84:0/137947545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 0x7f90780cbc70 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907759e700 1 -- 172.21.15.84:0/137947545 >> 172.21.15.84:0/137947545 conn(0x7f907806ed20 msgr2=0x7f907806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907759e700 1 -- 172.21.15.84:0/137947545 shutdown_connections 2023-10-06T03:26:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.330+0000 7f907759e700 1 -- 172.21.15.84:0/137947545 wait complete. 2023-10-06T03:26:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.331+0000 7f907759e700 1 Processor -- start 2023-10-06T03:26:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.331+0000 7f907759e700 1 -- start start 2023-10-06T03:26:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f907759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 0x7f9078153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f907759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90780cc1b0 0x7f90780c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f907759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9078159480 0x7f90780b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f907759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780ce480 con 0x7f90780b3610 2023-10-06T03:26:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f907759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780c9770 con 0x7f90780cc1b0 2023-10-06T03:26:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f907759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90780c9a50 con 0x7f9078159480 2023-10-06T03:26:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f907659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 0x7f9078153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f907659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 0x7f9078153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45568/0 (socket says 172.21.15.84:45568) 2023-10-06T03:26:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f907659c700 1 -- 172.21.15.84:0/827406014 learned_addr learned my addr 172.21.15.84:0/827406014 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f9076d9d700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9078159480 0x7f90780b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.332+0000 7f9075d9b700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90780cc1b0 0x7f90780c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f907659c700 1 -- 172.21.15.84:0/827406014 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9078159480 msgr2=0x7f90780b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f907659c700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9078159480 0x7f90780b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f907659c700 1 -- 172.21.15.84:0/827406014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90780cc1b0 msgr2=0x7f90780c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f907659c700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90780cc1b0 0x7f90780c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f907659c700 1 -- 172.21.15.84:0/827406014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c0094f0 con 0x7f90780b3610 2023-10-06T03:26:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f907659c700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 0x7f9078153a70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f906800d860 tx=0x7f9068008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f90667fc700 1 -- 172.21.15.84:0/827406014 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680125f0 con 0x7f90780b3610 2023-10-06T03:26:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f90667fc700 1 -- 172.21.15.84:0/827406014 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068012750 con 0x7f90780b3610 2023-10-06T03:26:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f907759e700 1 -- 172.21.15.84:0/827406014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90780cde30 con 0x7f90780b3610 2023-10-06T03:26:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f90667fc700 1 -- 172.21.15.84:0/827406014 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068012b10 con 0x7f90780b3610 2023-10-06T03:26:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.333+0000 7f907759e700 1 -- 172.21.15.84:0/827406014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9078153fb0 con 0x7f90780b3610 2023-10-06T03:26:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.334+0000 7f907759e700 1 -- 172.21.15.84:0/827406014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90780ce760 con 0x7f90780b3610 2023-10-06T03:26:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.334+0000 7f90667fc700 1 -- 172.21.15.84:0/827406014 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f906801e460 con 0x7f90780b3610 2023-10-06T03:26:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.334+0000 7f90667fc700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9058066f30 0x7f90580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.335+0000 7f90667fc700 1 -- 172.21.15.84:0/827406014 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9068084d00 con 0x7f90780b3610 2023-10-06T03:26:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.335+0000 7f9075d9b700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9058066f30 0x7f90580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.335+0000 7f9075d9b700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9058066f30 0x7f90580693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f907806fa30 tx=0x7f906c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.339+0000 7f90667fc700 1 -- 172.21.15.84:0/827406014 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9068051cd0 con 0x7f90780b3610 2023-10-06T03:26:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.564+0000 7f907759e700 1 -- 172.21.15.84:0/827406014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f907805f270 con 0x7f90780b3610 2023-10-06T03:26:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.565+0000 7f90667fc700 1 -- 172.21.15.84:0/827406014 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f90680552f0 con 0x7f90780b3610 2023-10-06T03:26:50.567 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:50.567 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3563307477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3563307477},{"type":"v1","addr":"172.21.15.84:6837","nonce":3563307477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":5923,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1010130826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1010130826},{"type":"v1","addr":"172.21.15.131:6834","nonce":1010130826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/569291567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":569291567},{"type":"v1","addr":"172.21.15.84:6836","nonce":569291567}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:40.528842+0000","modified":"2023-10-06T03:26:44.181991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6615},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6615":{"gid":6615,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/1003867498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1003867498},{"type":"v1","addr":"172.21.15.131:6835","nonce":1003867498}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:26:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 -- 172.21.15.84:0/827406014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9058066f30 msgr2=0x7f90580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9058066f30 0x7f90580693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f907806fa30 tx=0x7f906c017000 comp rx=0 tx=0).stop 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 -- 172.21.15.84:0/827406014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 msgr2=0x7f9078153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 0x7f9078153a70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f906800d860 tx=0x7f9068008040 comp rx=0 tx=0).stop 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 -- 172.21.15.84:0/827406014 shutdown_connections 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9058066f30 0x7f90580693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9078159480 0x7f90780b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90780b3610 0x7f9078153a70 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 --2- 172.21.15.84:0/827406014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90780cc1b0 0x7f90780c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 -- 172.21.15.84:0/827406014 >> 172.21.15.84:0/827406014 conn(0x7f907806ed20 msgr2=0x7f90780b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 -- 172.21.15.84:0/827406014 shutdown_connections 2023-10-06T03:26:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.567+0000 7f907759e700 1 -- 172.21.15.84:0/827406014 wait complete. 2023-10-06T03:26:50.570 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-10-06T03:26:50.581 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.693+0000 7efe8bfff700 1 Processor -- start 2023-10-06T03:26:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.693+0000 7efe8bfff700 1 -- start start 2023-10-06T03:26:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe8bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe8c0cbc70 0x7efe8c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe8bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe8c0b2140 0x7efe8c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe8bfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8c0cb7e0 con 0x7efe8c159480 2023-10-06T03:26:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe8bfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8c0b08a0 con 0x7efe8c0cbc70 2023-10-06T03:26:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe8bfff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c0cb190 con 0x7efe8c0b2140 2023-10-06T03:26:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe827fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe8c0cbc70 0x7efe8c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe827fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe8c0cbc70 0x7efe8c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41202/0 (socket says 172.21.15.84:41202) 2023-10-06T03:26:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe8affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efe8c159480 0x7efe8c0b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54246/0 (socket says 172.21.15.84:54246) 2023-10-06T03:26:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe827fc700 1 -- 172.21.15.84:0/2158917978 learned_addr learned my addr 172.21.15.84:0/2158917978 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:50.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe8b7fe700 1 --2- 172.21.15.84:0/2158917978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe8c0b2140 0x7efe8c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe827fc700 1 -- 172.21.15.84:0/2158917978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe8c0b2140 msgr2=0x7efe8c0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe827fc700 1 --2- 172.21.15.84:0/2158917978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe8c0b2140 0x7efe8c0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe827fc700 1 -- 172.21.15.84:0/2158917978 >> v1:172.21.15.84:6789/0 conn(0x7efe8c159480 legacy=0x7efe8c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe827fc700 1 -- 172.21.15.84:0/2158917978 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c0cb470 con 0x7efe8c0cbc70 2023-10-06T03:26:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe8a7fc700 1 -- 172.21.15.84:0/2158917978 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447185056 0 0) 0x7efe8c0cb7e0 con 0x7efe8c159480 2023-10-06T03:26:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.694+0000 7efe827fc700 1 --2- 172.21.15.84:0/2158917978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0cbc70 0x7efe8c0cc0c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7efe740099b0 tx=0x7efe74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4c97eeb5e4acbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:50.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8a7fc700 1 -- 172.21.15.84:0/2158917978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7400b860 con 0x7efe8c0cbc70 2023-10-06T03:26:50.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8a7fc700 1 -- 172.21.15.84:0/2158917978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7400b9c0 con 0x7efe8c0cbc70 2023-10-06T03:26:50.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8a7fc700 1 -- 172.21.15.84:0/2158917978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7400bd60 con 0x7efe8c0cbc70 2023-10-06T03:26:50.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8bfff700 1 -- 172.21.15.84:0/2158917978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0cbc70 msgr2=0x7efe8c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8bfff700 1 --2- 172.21.15.84:0/2158917978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0cbc70 0x7efe8c0cc0c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7efe740099b0 tx=0x7efe74009250 comp rx=0 tx=0).stop 2023-10-06T03:26:50.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8bfff700 1 -- 172.21.15.84:0/2158917978 shutdown_connections 2023-10-06T03:26:50.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8bfff700 1 --2- 172.21.15.84:0/2158917978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe8c0b2140 0x7efe8c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8bfff700 1 --2- 172.21.15.84:0/2158917978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0cbc70 0x7efe8c0cc0c0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8bfff700 1 -- 172.21.15.84:0/2158917978 >> 172.21.15.84:0/2158917978 conn(0x7efe8c06ed20 msgr2=0x7efe8c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8bfff700 1 -- 172.21.15.84:0/2158917978 shutdown_connections 2023-10-06T03:26:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.695+0000 7efe8bfff700 1 -- 172.21.15.84:0/2158917978 wait complete. 2023-10-06T03:26:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.696+0000 7efe8bfff700 1 Processor -- start 2023-10-06T03:26:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.697+0000 7efe8bfff700 1 -- start start 2023-10-06T03:26:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.697+0000 7efe8bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0b2140 0x7efe8c0c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.697+0000 7efe8bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe8c0cbc70 0x7efe8c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.697+0000 7efe8bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe8c159480 0x7efe8c0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.697+0000 7efe8bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c0c4600 con 0x7efe8c0b2140 2023-10-06T03:26:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.697+0000 7efe8bfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c0c5120 con 0x7efe8c0cbc70 2023-10-06T03:26:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.697+0000 7efe8bfff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c0c68d0 con 0x7efe8c159480 2023-10-06T03:26:50.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.697+0000 7efe8affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0b2140 0x7efe8c0c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.697+0000 7efe8affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0b2140 0x7efe8c0c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41210/0 (socket says 172.21.15.84:41210) 2023-10-06T03:26:50.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.697+0000 7efe8affd700 1 -- 172.21.15.84:0/3872528137 learned_addr learned my addr 172.21.15.84:0/3872528137 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:50.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe8b7fe700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe8c159480 0x7efe8c0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe827fc700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe8c0cbc70 0x7efe8c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe8affd700 1 -- 172.21.15.84:0/3872528137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe8c159480 msgr2=0x7efe8c0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe8affd700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe8c159480 0x7efe8c0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe8affd700 1 -- 172.21.15.84:0/3872528137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe8c0cbc70 msgr2=0x7efe8c153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe8affd700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe8c0cbc70 0x7efe8c153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe8affd700 1 -- 172.21.15.84:0/3872528137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740094f0 con 0x7efe8c0b2140 2023-10-06T03:26:50.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe8affd700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0b2140 0x7efe8c0c6390 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00c5b0 tx=0x7efe7c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:50.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe837fe700 1 -- 172.21.15.84:0/3872528137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c005a70 con 0x7efe8c0b2140 2023-10-06T03:26:50.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe837fe700 1 -- 172.21.15.84:0/3872528137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c005bd0 con 0x7efe8c0b2140 2023-10-06T03:26:50.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe837fe700 1 -- 172.21.15.84:0/3872528137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0070d0 con 0x7efe8c0b2140 2023-10-06T03:26:50.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe8bfff700 1 -- 172.21.15.84:0/3872528137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8c0c47f0 con 0x7efe8c0b2140 2023-10-06T03:26:50.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.698+0000 7efe8bfff700 1 -- 172.21.15.84:0/3872528137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c0c4db0 con 0x7efe8c0b2140 2023-10-06T03:26:50.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.699+0000 7efe8bfff700 1 -- 172.21.15.84:0/3872528137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8c05f270 con 0x7efe8c0b2140 2023-10-06T03:26:50.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.699+0000 7efe837fe700 1 -- 172.21.15.84:0/3872528137 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe7c007480 con 0x7efe8c0b2140 2023-10-06T03:26:50.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.700+0000 7efe837fe700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe6c066f30 0x7efe6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:50.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.700+0000 7efe837fe700 1 -- 172.21.15.84:0/3872528137 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7efe7c083cf0 con 0x7efe8c0b2140 2023-10-06T03:26:50.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.700+0000 7efe827fc700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe6c066f30 0x7efe6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.700+0000 7efe827fc700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe6c066f30 0x7efe6c0693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efe740099b0 tx=0x7efe74017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.704+0000 7efe837fe700 1 -- 172.21.15.84:0/3872528137 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe7c088070 con 0x7efe8c0b2140 2023-10-06T03:26:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.886+0000 7efe8bfff700 1 -- 172.21.15.84:0/3872528137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe8c0cc300 con 0x7efe8c0b2140 2023-10-06T03:26:50.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.887+0000 7efe837fe700 1 -- 172.21.15.84:0/3872528137 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17074 (secure 0 0 0) 0x7efe7c017020 con 0x7efe8c0b2140 2023-10-06T03:26:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:50.890 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":86,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:42.158139+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:38.193214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:39.494528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:50.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.889+0000 7efe8bfff700 1 -- 172.21.15.84:0/3872528137 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe6c066f30 msgr2=0x7efe6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.889+0000 7efe8bfff700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe6c066f30 0x7efe6c0693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efe740099b0 tx=0x7efe74017000 comp rx=0 tx=0).stop 2023-10-06T03:26:50.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.889+0000 7efe8bfff700 1 -- 172.21.15.84:0/3872528137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0b2140 msgr2=0x7efe8c0c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:50.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.889+0000 7efe8bfff700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0b2140 0x7efe8c0c6390 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00c5b0 tx=0x7efe7c001040 comp rx=0 tx=0).stop 2023-10-06T03:26:50.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.890+0000 7efe8bfff700 1 -- 172.21.15.84:0/3872528137 shutdown_connections 2023-10-06T03:26:50.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.890+0000 7efe8bfff700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efe6c066f30 0x7efe6c0693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.890+0000 7efe8bfff700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe8c159480 0x7efe8c0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.890+0000 7efe8bfff700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8c0b2140 0x7efe8c0c6390 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.890+0000 7efe8bfff700 1 --2- 172.21.15.84:0/3872528137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe8c0cbc70 0x7efe8c153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:50.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.890+0000 7efe8bfff700 1 -- 172.21.15.84:0/3872528137 >> 172.21.15.84:0/3872528137 conn(0x7efe8c06ed20 msgr2=0x7efe8c1587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:50.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.890+0000 7efe8bfff700 1 -- 172.21.15.84:0/3872528137 shutdown_connections 2023-10-06T03:26:50.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:50.890+0000 7efe8bfff700 1 -- 172.21.15.84:0/3872528137 wait complete. 2023-10-06T03:26:50.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:26:38.193214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:26:39.494528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:26:50.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:26:51.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.019+0000 7fa2af59e700 1 Processor -- start 2023-10-06T03:26:51.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.019+0000 7fa2af59e700 1 -- start start 2023-10-06T03:26:51.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2af59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa2b00cd400 0x7fa2b00ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2af59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2b00b2a30 0x7fa2b00cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2af59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b00cc9b0 con 0x7fa2b00b2660 2023-10-06T03:26:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2af59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b00cf560 con 0x7fa2b00b2a30 2023-10-06T03:26:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2af59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b00cbda0 con 0x7fa2b00cd400 2023-10-06T03:26:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2aed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2b00b2a30 0x7fa2b00cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2aed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2b00b2a30 0x7fa2b00cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41212/0 (socket says 172.21.15.84:41212) 2023-10-06T03:26:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2aed9d700 1 -- 172.21.15.84:0/1299734906 learned_addr learned my addr 172.21.15.84:0/1299734906 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2add9b700 1 --2- 172.21.15.84:0/1299734906 >> v2:172.21.15.131:3300/0 conn(0x7fa2b00cd400 0x7fa2b00ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2aed9d700 1 -- 172.21.15.84:0/1299734906 >> v2:172.21.15.131:3300/0 conn(0x7fa2b00cd400 msgr2=0x7fa2b00ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2aed9d700 1 --2- 172.21.15.84:0/1299734906 >> v2:172.21.15.131:3300/0 conn(0x7fa2b00cd400 0x7fa2b00ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2aed9d700 1 -- 172.21.15.84:0/1299734906 >> v1:172.21.15.131:6789/0 conn(0x7fa2b00b2660 legacy=0x7fa2b00cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.020+0000 7fa2aed9d700 1 -- 172.21.15.84:0/1299734906 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b00cc080 con 0x7fa2b00b2a30 2023-10-06T03:26:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2aed9d700 1 --2- 172.21.15.84:0/1299734906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2a30 0x7fa2b00cf020 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00b6310 tx=0x7fa2a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cdc32070577097 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2ad59a700 1 -- 172.21.15.84:0/1299734906 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000e070 con 0x7fa2b00b2a30 2023-10-06T03:26:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2ad59a700 1 -- 172.21.15.84:0/1299734906 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000ba10 con 0x7fa2b00b2a30 2023-10-06T03:26:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2ad59a700 1 -- 172.21.15.84:0/1299734906 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00092e0 con 0x7fa2b00b2a30 2023-10-06T03:26:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2af59e700 1 -- 172.21.15.84:0/1299734906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2a30 msgr2=0x7fa2b00cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2af59e700 1 --2- 172.21.15.84:0/1299734906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2a30 0x7fa2b00cf020 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00b6310 tx=0x7fa2a0009840 comp rx=0 tx=0).stop 2023-10-06T03:26:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2af59e700 1 -- 172.21.15.84:0/1299734906 shutdown_connections 2023-10-06T03:26:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2af59e700 1 --2- 172.21.15.84:0/1299734906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2a30 0x7fa2b00cf020 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2af59e700 1 --2- 172.21.15.84:0/1299734906 >> v2:172.21.15.131:3300/0 conn(0x7fa2b00cd400 0x7fa2b00ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2af59e700 1 -- 172.21.15.84:0/1299734906 >> 172.21.15.84:0/1299734906 conn(0x7fa2b0099560 msgr2=0x7fa2b006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:51.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2af59e700 1 -- 172.21.15.84:0/1299734906 shutdown_connections 2023-10-06T03:26:51.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.021+0000 7fa2af59e700 1 -- 172.21.15.84:0/1299734906 wait complete. 2023-10-06T03:26:51.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.022+0000 7fa2af59e700 1 Processor -- start 2023-10-06T03:26:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.022+0000 7fa2af59e700 1 -- start start 2023-10-06T03:26:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2af59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2660 0x7fa2b0153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2af59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b00b2a30 0x7fa2b016a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2af59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b00cd400 0x7fa2b015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2af59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b015c4a0 con 0x7fa2b00b2660 2023-10-06T03:26:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2af59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0159c00 con 0x7fa2b00b2a30 2023-10-06T03:26:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2af59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b015bcb0 con 0x7fa2b00cd400 2023-10-06T03:26:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2ae59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2660 0x7fa2b0153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2ae59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2660 0x7fa2b0153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41214/0 (socket says 172.21.15.84:41214) 2023-10-06T03:26:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2ae59c700 1 -- 172.21.15.84:0/3994766270 learned_addr learned my addr 172.21.15.84:0/3994766270 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:51.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2aed9d700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b00cd400 0x7fa2b015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2add9b700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b00b2a30 0x7fa2b016a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.023+0000 7fa2ae59c700 1 -- 172.21.15.84:0/3994766270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b00cd400 msgr2=0x7fa2b015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.024+0000 7fa2ae59c700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b00cd400 0x7fa2b015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.024+0000 7fa2ae59c700 1 -- 172.21.15.84:0/3994766270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b00b2a30 msgr2=0x7fa2b016a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.024+0000 7fa2ae59c700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b00b2a30 0x7fa2b016a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.024+0000 7fa2ae59c700 1 -- 172.21.15.84:0/3994766270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a0009ae0 con 0x7fa2b00b2660 2023-10-06T03:26:51.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.024+0000 7fa2ae59c700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2660 0x7fa2b0153440 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800b5e0 tx=0x7fa2a80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:51.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.024+0000 7fa29e7fc700 1 -- 172.21.15.84:0/3994766270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800f510 con 0x7fa2b00b2660 2023-10-06T03:26:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.024+0000 7fa29e7fc700 1 -- 172.21.15.84:0/3994766270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a800f670 con 0x7fa2b00b2660 2023-10-06T03:26:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.024+0000 7fa2af59e700 1 -- 172.21.15.84:0/3994766270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b015bee0 con 0x7fa2b00b2660 2023-10-06T03:26:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.024+0000 7fa29e7fc700 1 -- 172.21.15.84:0/3994766270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800fa30 con 0x7fa2b00b2660 2023-10-06T03:26:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.024+0000 7fa2af59e700 1 -- 172.21.15.84:0/3994766270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b0159e10 con 0x7fa2b00b2660 2023-10-06T03:26:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.025+0000 7fa2af59e700 1 -- 172.21.15.84:0/3994766270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b005f270 con 0x7fa2b00b2660 2023-10-06T03:26:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.025+0000 7fa29e7fc700 1 -- 172.21.15.84:0/3994766270 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2a801a400 con 0x7fa2b00b2660 2023-10-06T03:26:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.025+0000 7fa29e7fc700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa290066f30 0x7fa2900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.026+0000 7fa29e7fc700 1 -- 172.21.15.84:0/3994766270 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa2a8084120 con 0x7fa2b00b2660 2023-10-06T03:26:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.026+0000 7fa2add9b700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa290066f30 0x7fa2900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.026+0000 7fa2add9b700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa290066f30 0x7fa2900693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa2b015fcd0 tx=0x7fa2a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:51.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.030+0000 7fa29e7fc700 1 -- 172.21.15.84:0/3994766270 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2a8051170 con 0x7fa2b00b2660 2023-10-06T03:26:51.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.213+0000 7fa2af59e700 1 -- 172.21.15.84:0/3994766270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa2b00cc360 con 0x7fa2b00b2660 2023-10-06T03:26:51.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.213+0000 7fa29e7fc700 1 -- 172.21.15.84:0/3994766270 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa2a8054790 con 0x7fa2b00b2660 2023-10-06T03:26:51.215 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:26:51.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 -- 172.21.15.84:0/3994766270 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa290066f30 msgr2=0x7fa2900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa290066f30 0x7fa2900693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa2b015fcd0 tx=0x7fa2a4008040 comp rx=0 tx=0).stop 2023-10-06T03:26:51.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 -- 172.21.15.84:0/3994766270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2660 msgr2=0x7fa2b0153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2660 0x7fa2b0153440 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800b5e0 tx=0x7fa2a80090f0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 -- 172.21.15.84:0/3994766270 shutdown_connections 2023-10-06T03:26:51.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa290066f30 0x7fa2900693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b00cd400 0x7fa2b015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b2660 0x7fa2b0153440 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 --2- 172.21.15.84:0/3994766270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b00b2a30 0x7fa2b016a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 -- 172.21.15.84:0/3994766270 >> 172.21.15.84:0/3994766270 conn(0x7fa2b0099560 msgr2=0x7fa2b00d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:51.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 -- 172.21.15.84:0/3994766270 shutdown_connections 2023-10-06T03:26:51.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.215+0000 7fa2af59e700 1 -- 172.21.15.84:0/3994766270 wait complete. 2023-10-06T03:26:51.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:26:51.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.343+0000 7f3d3dc53700 1 Processor -- start 2023-10-06T03:26:51.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.343+0000 7f3d3dc53700 1 -- start start 2023-10-06T03:26:51.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d3dc53700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3d38159510 0x7f3d380cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d3dc53700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d380cbf20 con 0x7f3d381598e0 2023-10-06T03:26:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d3dc53700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d380cf610 con 0x7f3d380cbae0 2023-10-06T03:26:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d3dc53700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d380cf8f0 con 0x7f3d38159510 2023-10-06T03:26:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d36ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3d381598e0 0x7f3d380ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54252/0 (socket says 172.21.15.84:54252) 2023-10-06T03:26:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d36ffd700 1 -- 172.21.15.84:0/1685801712 learned_addr learned my addr 172.21.15.84:0/1685801712 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666774829 0 0) 0x7f3d380cbf20 con 0x7f3d381598e0 2023-10-06T03:26:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d377fe700 1 --2- 172.21.15.84:0/1685801712 >> v2:172.21.15.131:3300/0 conn(0x7f3d38159510 0x7f3d380cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d20003570 con 0x7f3d381598e0 2023-10-06T03:26:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 788280079 0 0) 0x7f3d20003570 con 0x7f3d381598e0 2023-10-06T03:26:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 >> v2:172.21.15.131:3300/0 conn(0x7f3d38159510 msgr2=0x7f3d380cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d367fc700 1 --2- 172.21.15.84:0/1685801712 >> v2:172.21.15.131:3300/0 conn(0x7f3d38159510 0x7f3d380cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 >> v1:172.21.15.131:6789/0 conn(0x7f3d380cbae0 legacy=0x7f3d380c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d380cfbd0 con 0x7f3d381598e0 2023-10-06T03:26:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.344+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f3d28001470 con 0x7f3d381598e0 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 >> v1:172.21.15.84:6789/0 conn(0x7f3d381598e0 legacy=0x7f3d380ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d367fc700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d20003a60 0x7f3d20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d367fc700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20004810 0x7f3d20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d367fc700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d200051c0 0x7f3d2000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d380cf8f0 con 0x7f3d20003a60 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2000c0d0 con 0x7f3d20004810 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2000c290 con 0x7f3d200051c0 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d377fe700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d20003a60 0x7f3d20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d36ffd700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20004810 0x7f3d20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d37fff700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d200051c0 0x7f3d2000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d377fe700 1 -- 172.21.15.84:0/1685801712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d200051c0 msgr2=0x7f3d2000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:51.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d377fe700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d200051c0 0x7f3d2000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d377fe700 1 -- 172.21.15.84:0/1685801712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20004810 msgr2=0x7f3d20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:51.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d377fe700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20004810 0x7f3d20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d377fe700 1 -- 172.21.15.84:0/1685801712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d20003570 con 0x7f3d20003a60 2023-10-06T03:26:51.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d36ffd700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20004810 0x7f3d20004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:51.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d37fff700 1 -- 172.21.15.84:0/1685801712 reap_dead start 2023-10-06T03:26:51.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d377fe700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d20003a60 0x7f3d20003e70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009c00 tx=0x7f3d2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545a030ef196ec75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:51.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00e710 con 0x7f3d20003a60 2023-10-06T03:26:51.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c00e870 con 0x7f3d20003a60 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.345+0000 7f3d367fc700 1 -- 172.21.15.84:0/1685801712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00ec30 con 0x7f3d20003a60 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.346+0000 7f3d3dc53700 1 -- 172.21.15.84:0/1685801712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d20003a60 msgr2=0x7f3d20003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.346+0000 7f3d3dc53700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d20003a60 0x7f3d20003e70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009c00 tx=0x7f3d2c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.346+0000 7f3d3dc53700 1 -- 172.21.15.84:0/1685801712 shutdown_connections 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.346+0000 7f3d3dc53700 1 --2- 172.21.15.84:0/1685801712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d20003a60 0x7f3d20003e70 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.346+0000 7f3d3dc53700 1 -- 172.21.15.84:0/1685801712 >> 172.21.15.84:0/1685801712 conn(0x7f3d38089e90 msgr2=0x7f3d380997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.346+0000 7f3d3dc53700 1 -- 172.21.15.84:0/1685801712 shutdown_connections 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.346+0000 7f3d3dc53700 1 -- 172.21.15.84:0/1685801712 wait complete. 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.347+0000 7f3d3dc53700 1 Processor -- start 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.347+0000 7f3d3dc53700 1 -- start start 2023-10-06T03:26:51.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d3dc53700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20003a60 0x7f3d3816a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d3dc53700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d380b4850 0x7f3d3816d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d3dc53700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d380b4cc0 0x7f3d380696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d3dc53700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3816aed0 con 0x7f3d380b4cc0 2023-10-06T03:26:51.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d3dc53700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3816a500 con 0x7f3d20003a60 2023-10-06T03:26:51.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d3dc53700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3816df20 con 0x7f3d380b4850 2023-10-06T03:26:51.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d37fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d380b4cc0 0x7f3d380696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d37fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d380b4cc0 0x7f3d380696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41232/0 (socket says 172.21.15.84:41232) 2023-10-06T03:26:51.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d37fff700 1 -- 172.21.15.84:0/2631636755 learned_addr learned my addr 172.21.15.84:0/2631636755 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:51.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d36ffd700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d380b4850 0x7f3d3816d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d377fe700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20003a60 0x7f3d3816a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d37fff700 1 -- 172.21.15.84:0/2631636755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d380b4850 msgr2=0x7f3d3816d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d37fff700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d380b4850 0x7f3d3816d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d37fff700 1 -- 172.21.15.84:0/2631636755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20003a60 msgr2=0x7f3d3816a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d37fff700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20003a60 0x7f3d3816a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d37fff700 1 -- 172.21.15.84:0/2631636755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3816e200 con 0x7f3d380b4cc0 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d36ffd700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d380b4850 0x7f3d3816d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d377fe700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20003a60 0x7f3d3816a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d37fff700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d380b4cc0 0x7f3d380696a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f3d38159cb0 tx=0x7f3d30009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d1f7fe700 1 -- 172.21.15.84:0/2631636755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d300032e0 con 0x7f3d380b4cc0 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d1f7fe700 1 -- 172.21.15.84:0/2631636755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d30001580 con 0x7f3d380b4cc0 2023-10-06T03:26:51.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d3dc53700 1 -- 172.21.15.84:0/2631636755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d38169eb0 con 0x7f3d380b4cc0 2023-10-06T03:26:51.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.348+0000 7f3d1f7fe700 1 -- 172.21.15.84:0/2631636755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30003440 con 0x7f3d380b4cc0 2023-10-06T03:26:51.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.349+0000 7f3d3dc53700 1 -- 172.21.15.84:0/2631636755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d380ca070 con 0x7f3d380b4cc0 2023-10-06T03:26:51.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.350+0000 7f3d3dc53700 1 -- 172.21.15.84:0/2631636755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3816e420 con 0x7f3d380b4cc0 2023-10-06T03:26:51.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.350+0000 7f3d1f7fe700 1 -- 172.21.15.84:0/2631636755 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d30001bd0 con 0x7f3d380b4cc0 2023-10-06T03:26:51.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.350+0000 7f3d1f7fe700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3d24066f30 0x7f3d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.350+0000 7f3d377fe700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3d24066f30 0x7f3d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.350+0000 7f3d1f7fe700 1 -- 172.21.15.84:0/2631636755 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3d30084640 con 0x7f3d380b4cc0 2023-10-06T03:26:51.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.351+0000 7f3d377fe700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3d24066f30 0x7f3d240693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0091e0 tx=0x7f3d2c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:51.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.355+0000 7f3d1f7fe700 1 -- 172.21.15.84:0/2631636755 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d30051610 con 0x7f3d380b4cc0 2023-10-06T03:26:51.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.538+0000 7f3d3dc53700 1 -- 172.21.15.84:0/2631636755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d380ca200 con 0x7f3d380b4cc0 2023-10-06T03:26:51.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.538+0000 7f3d1f7fe700 1 -- 172.21.15.84:0/2631636755 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d30054c30 con 0x7f3d380b4cc0 2023-10-06T03:26:51.540 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:26:51.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 -- 172.21.15.84:0/2631636755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3d24066f30 msgr2=0x7f3d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3d24066f30 0x7f3d240693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0091e0 tx=0x7f3d2c01a000 comp rx=0 tx=0).stop 2023-10-06T03:26:51.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 -- 172.21.15.84:0/2631636755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d380b4cc0 msgr2=0x7f3d380696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d380b4cc0 0x7f3d380696a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f3d38159cb0 tx=0x7f3d30009040 comp rx=0 tx=0).stop 2023-10-06T03:26:51.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 -- 172.21.15.84:0/2631636755 shutdown_connections 2023-10-06T03:26:51.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3d24066f30 0x7f3d240693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d20003a60 0x7f3d3816a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d380b4cc0 0x7f3d380696a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 --2- 172.21.15.84:0/2631636755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d380b4850 0x7f3d3816d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 -- 172.21.15.84:0/2631636755 >> 172.21.15.84:0/2631636755 conn(0x7f3d38089e90 msgr2=0x7f3d3815c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:51.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 -- 172.21.15.84:0/2631636755 shutdown_connections 2023-10-06T03:26:51.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.541+0000 7f3d3dc53700 1 -- 172.21.15.84:0/2631636755 wait complete. 2023-10-06T03:26:51.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:26:51.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.671+0000 7f1019a66700 1 Processor -- start 2023-10-06T03:26:51.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.671+0000 7f1019a66700 1 -- start start 2023-10-06T03:26:51.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.672+0000 7f1019a66700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f10140b2660 0x7f10140cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.672+0000 7f1019a66700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f10140cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.672+0000 7f1019a66700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10140cc9b0 con 0x7f10140b2a30 2023-10-06T03:26:51.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.672+0000 7f1019a66700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140cbda0 con 0x7f10140b2660 2023-10-06T03:26:51.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.672+0000 7f1019a66700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140cc080 con 0x7f10140cf1f0 2023-10-06T03:26:51.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.672+0000 7f1019265700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f10140cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.672+0000 7f1018a64700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f10140b2660 0x7f10140cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.672+0000 7f1019265700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f10140cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:50762/0 (socket says 172.21.15.84:50762) 2023-10-06T03:26:51.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.672+0000 7f1019265700 1 -- 172.21.15.84:0/3340282902 learned_addr learned my addr 172.21.15.84:0/3340282902 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.672+0000 7f1013fff700 1 --1- 172.21.15.84:0/3340282902 >> v1:172.21.15.131:6789/0 conn(0x7f10140b2a30 0x7f10140ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:49226/0 (socket says 172.21.15.84:49226) 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.673+0000 7f1019265700 1 -- 172.21.15.84:0/3340282902 >> v2:172.21.15.131:3300/0 conn(0x7f10140b2660 msgr2=0x7f10140cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.673+0000 7f1019265700 1 --2- 172.21.15.84:0/3340282902 >> v2:172.21.15.131:3300/0 conn(0x7f10140b2660 0x7f10140cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.673+0000 7f1019265700 1 -- 172.21.15.84:0/3340282902 >> v1:172.21.15.131:6789/0 conn(0x7f10140b2a30 legacy=0x7f10140ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.673+0000 7f10137fe700 1 -- 172.21.15.84:0/3340282902 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006212106 0 0) 0x7f10140cc9b0 con 0x7f10140b2a30 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.673+0000 7f1019265700 1 -- 172.21.15.84:0/3340282902 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140cc360 con 0x7f10140cf1f0 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.673+0000 7f1018a64700 1 --2- 172.21.15.84:0/3340282902 >> v2:172.21.15.131:3300/0 conn(0x7f10140b2660 0x7f10140cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.673+0000 7f1019265700 1 --2- 172.21.15.84:0/3340282902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f10140cd230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f100c0099b0 tx=0x7f100c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eea199bc2c656b41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.673+0000 7f10137fe700 1 -- 172.21.15.84:0/3340282902 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c009ea0 con 0x7f10140cf1f0 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.673+0000 7f10137fe700 1 -- 172.21.15.84:0/3340282902 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c00b860 con 0x7f10140cf1f0 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.673+0000 7f10137fe700 1 -- 172.21.15.84:0/3340282902 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00bc00 con 0x7f10140cf1f0 2023-10-06T03:26:51.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.674+0000 7f1019a66700 1 -- 172.21.15.84:0/3340282902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 msgr2=0x7f10140cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.674+0000 7f1019a66700 1 --2- 172.21.15.84:0/3340282902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f10140cd230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f100c0099b0 tx=0x7f100c009250 comp rx=0 tx=0).stop 2023-10-06T03:26:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.674+0000 7f1019a66700 1 -- 172.21.15.84:0/3340282902 shutdown_connections 2023-10-06T03:26:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.674+0000 7f1019a66700 1 --2- 172.21.15.84:0/3340282902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f10140cd230 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.674+0000 7f1019a66700 1 --2- 172.21.15.84:0/3340282902 >> v2:172.21.15.131:3300/0 conn(0x7f10140b2660 0x7f10140cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.674+0000 7f1019a66700 1 -- 172.21.15.84:0/3340282902 >> 172.21.15.84:0/3340282902 conn(0x7f1014099560 msgr2=0x7f101406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.674+0000 7f1019a66700 1 -- 172.21.15.84:0/3340282902 shutdown_connections 2023-10-06T03:26:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.674+0000 7f1019a66700 1 -- 172.21.15.84:0/3340282902 wait complete. 2023-10-06T03:26:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.675+0000 7f1019a66700 1 Processor -- start 2023-10-06T03:26:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.675+0000 7f1019a66700 1 -- start start 2023-10-06T03:26:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1019a66700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10140b2660 0x7f10140b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1019a66700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10140b2a30 0x7f1014154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1019a66700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f1014155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1019a66700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140b57b0 con 0x7f10140b2660 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1019a66700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140b3fd0 con 0x7f10140b2a30 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1019a66700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140ca160 con 0x7f10140cf1f0 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1018a64700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10140b2660 0x7f10140b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1018a64700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10140b2660 0x7f10140b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41236/0 (socket says 172.21.15.84:41236) 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1018a64700 1 -- 172.21.15.84:0/164523135 learned_addr learned my addr 172.21.15.84:0/164523135 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1013fff700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10140b2a30 0x7f1014154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1018a64700 1 -- 172.21.15.84:0/164523135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 msgr2=0x7f1014155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1019265700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f1014155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1018a64700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f1014155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1018a64700 1 -- 172.21.15.84:0/164523135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10140b2a30 msgr2=0x7f1014154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1018a64700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10140b2a30 0x7f1014154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1018a64700 1 -- 172.21.15.84:0/164523135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1004009a20 con 0x7f10140b2660 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1013fff700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10140b2a30 0x7f1014154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1019265700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f1014155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1018a64700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10140b2660 0x7f10140b3a90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f100400c170 tx=0x7f100400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1010ff9700 1 -- 172.21.15.84:0/164523135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400cdb0 con 0x7f10140b2660 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1010ff9700 1 -- 172.21.15.84:0/164523135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100400f040 con 0x7f10140b2660 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1019a66700 1 -- 172.21.15.84:0/164523135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c0094f0 con 0x7f10140b2660 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1010ff9700 1 -- 172.21.15.84:0/164523135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004014690 con 0x7f10140b2660 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.676+0000 7f1019a66700 1 -- 172.21.15.84:0/164523135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10140b5160 con 0x7f10140b2660 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.677+0000 7f1019a66700 1 -- 172.21.15.84:0/164523135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10140b5a90 con 0x7f10140b2660 2023-10-06T03:26:51.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.678+0000 7f1010ff9700 1 -- 172.21.15.84:0/164523135 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1004014a00 con 0x7f10140b2660 2023-10-06T03:26:51.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.678+0000 7f1010ff9700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1000066f30 0x7f10000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:51.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.678+0000 7f1013fff700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1000066f30 0x7f10000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:51.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.678+0000 7f1010ff9700 1 -- 172.21.15.84:0/164523135 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1004085740 con 0x7f10140b2660 2023-10-06T03:26:51.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.678+0000 7f1013fff700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1000066f30 0x7f10000693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f10140b42b0 tx=0x7f1008009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:51.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.682+0000 7f1010ff9700 1 -- 172.21.15.84:0/164523135 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1004052710 con 0x7f10140b2660 2023-10-06T03:26:51.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.864+0000 7f1019a66700 1 -- 172.21.15.84:0/164523135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f101405f270 con 0x7f10140b2660 2023-10-06T03:26:51.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.865+0000 7f1010ff9700 1 -- 172.21.15.84:0/164523135 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1004014cb0 con 0x7f10140b2660 2023-10-06T03:26:51.867 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:26:51.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 -- 172.21.15.84:0/164523135 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1000066f30 msgr2=0x7f10000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1000066f30 0x7f10000693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f10140b42b0 tx=0x7f1008009040 comp rx=0 tx=0).stop 2023-10-06T03:26:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 -- 172.21.15.84:0/164523135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10140b2660 msgr2=0x7f10140b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10140b2660 0x7f10140b3a90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f100400c170 tx=0x7f100400b040 comp rx=0 tx=0).stop 2023-10-06T03:26:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 -- 172.21.15.84:0/164523135 shutdown_connections 2023-10-06T03:26:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1000066f30 0x7f10000693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10140cf1f0 0x7f1014155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10140b2660 0x7f10140b3a90 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 --2- 172.21.15.84:0/164523135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10140b2a30 0x7f1014154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 -- 172.21.15.84:0/164523135 >> 172.21.15.84:0/164523135 conn(0x7f1014099560 msgr2=0x7f1014156c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 -- 172.21.15.84:0/164523135 shutdown_connections 2023-10-06T03:26:51.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.867+0000 7f1019a66700 1 -- 172.21.15.84:0/164523135 wait complete. 2023-10-06T03:26:51.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:26:51.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.995+0000 7fd8ce9c6700 1 Processor -- start 2023-10-06T03:26:51.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.995+0000 7fd8ce9c6700 1 -- start start 2023-10-06T03:26:51.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8ce9c6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8c80b2660 0x7fd8c80cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8ce9c6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd8c80b2a30 0x7fd8c80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8ce9c6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd8c80ceae0 0x7fd8c80cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8ce9c6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c80cc9b0 con 0x7fd8c80b2a30 2023-10-06T03:26:52.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8ce9c6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c80cf4c0 con 0x7fd8c80ceae0 2023-10-06T03:26:52.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8ce9c6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80cbda0 con 0x7fd8c80b2660 2023-10-06T03:26:52.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8cd1c3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd8c80b2a30 0x7fd8c80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8cd1c3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd8c80b2a30 0x7fd8c80cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41248/0 (socket says 172.21.15.84:41248) 2023-10-06T03:26:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8cd1c3700 1 -- 172.21.15.84:0/2466054200 learned_addr learned my addr 172.21.15.84:0/2466054200 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8cd9c4700 1 --2- 172.21.15.84:0/2466054200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8c80b2660 0x7fd8c80cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.996+0000 7fd8ce1c5700 1 --2- 172.21.15.84:0/2466054200 >> v2:172.21.15.131:3300/0 conn(0x7fd8c80ceae0 0x7fd8c80cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8cd1c3700 1 -- 172.21.15.84:0/2466054200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8c80b2660 msgr2=0x7fd8c80cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8cd1c3700 1 --2- 172.21.15.84:0/2466054200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8c80b2660 0x7fd8c80cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8cd1c3700 1 -- 172.21.15.84:0/2466054200 >> v2:172.21.15.131:3300/0 conn(0x7fd8c80ceae0 msgr2=0x7fd8c80cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8cd1c3700 1 --2- 172.21.15.84:0/2466054200 >> v2:172.21.15.131:3300/0 conn(0x7fd8c80ceae0 0x7fd8c80cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8cd1c3700 1 -- 172.21.15.84:0/2466054200 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80cc080 con 0x7fd8c80b2a30 2023-10-06T03:26:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8cd1c3700 1 --2- 172.21.15.84:0/2466054200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2a30 0x7fd8c80cd230 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8089690 tx=0x7fd8b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d440c0a6fd508f7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8cc9c2700 1 -- 172.21.15.84:0/2466054200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800b860 con 0x7fd8c80b2a30 2023-10-06T03:26:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8cc9c2700 1 -- 172.21.15.84:0/2466054200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b800b9c0 con 0x7fd8c80b2a30 2023-10-06T03:26:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8cc9c2700 1 -- 172.21.15.84:0/2466054200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800bd60 con 0x7fd8c80b2a30 2023-10-06T03:26:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2466054200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2a30 msgr2=0x7fd8c80cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8ce9c6700 1 --2- 172.21.15.84:0/2466054200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2a30 0x7fd8c80cd230 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8089690 tx=0x7fd8b8009250 comp rx=0 tx=0).stop 2023-10-06T03:26:52.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2466054200 shutdown_connections 2023-10-06T03:26:52.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8ce9c6700 1 --2- 172.21.15.84:0/2466054200 >> v2:172.21.15.131:3300/0 conn(0x7fd8c80ceae0 0x7fd8c80cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8ce9c6700 1 --2- 172.21.15.84:0/2466054200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8c80b2660 0x7fd8c80cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8ce9c6700 1 --2- 172.21.15.84:0/2466054200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2a30 0x7fd8c80cd230 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2466054200 >> 172.21.15.84:0/2466054200 conn(0x7fd8c8099560 msgr2=0x7fd8c806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:52.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2466054200 shutdown_connections 2023-10-06T03:26:52.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.997+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2466054200 wait complete. 2023-10-06T03:26:52.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.998+0000 7fd8ce9c6700 1 Processor -- start 2023-10-06T03:26:52.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8ce9c6700 1 -- start start 2023-10-06T03:26:52.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8ce9c6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2660 0x7fd8c80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8ce9c6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8c80b2a30 0x7fd8c80c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8ce9c6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8c80ceae0 0x7fd8c80c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8ce9c6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c816aec0 con 0x7fd8c80b2660 2023-10-06T03:26:52.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8ce9c6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80b5ee0 con 0x7fd8c80b2a30 2023-10-06T03:26:52.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8ce9c6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c816a260 con 0x7fd8c80ceae0 2023-10-06T03:26:52.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8cd9c4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2660 0x7fd8c80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8cd9c4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2660 0x7fd8c80b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41250/0 (socket says 172.21.15.84:41250) 2023-10-06T03:26:52.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8cd9c4700 1 -- 172.21.15.84:0/2307683659 learned_addr learned my addr 172.21.15.84:0/2307683659 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:52.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8cd1c3700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8c80b2a30 0x7fd8c80c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:51.999+0000 7fd8ce1c5700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8c80ceae0 0x7fd8c80c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8cd9c4700 1 -- 172.21.15.84:0/2307683659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8c80ceae0 msgr2=0x7fd8c80c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8cd9c4700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8c80ceae0 0x7fd8c80c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8cd9c4700 1 -- 172.21.15.84:0/2307683659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8c80b2a30 msgr2=0x7fd8c80c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8cd9c4700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8c80b2a30 0x7fd8c80c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8cd9c4700 1 -- 172.21.15.84:0/2307683659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80094f0 con 0x7fd8c80b2660 2023-10-06T03:26:52.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8cd1c3700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8c80b2a30 0x7fd8c80c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:52.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8cd9c4700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2660 0x7fd8c80b59a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400d840 tx=0x7fd8c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:52.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8bdffb700 1 -- 172.21.15.84:0/2307683659 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4014620 con 0x7fd8c80b2660 2023-10-06T03:26:52.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8bdffb700 1 -- 172.21.15.84:0/2307683659 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c4014780 con 0x7fd8c80b2660 2023-10-06T03:26:52.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2307683659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c816a540 con 0x7fd8c80b2660 2023-10-06T03:26:52.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8bdffb700 1 -- 172.21.15.84:0/2307683659 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4014b40 con 0x7fd8c80b2660 2023-10-06T03:26:52.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.000+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2307683659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c816ab00 con 0x7fd8c80b2660 2023-10-06T03:26:52.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.001+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2307683659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c816b1a0 con 0x7fd8c80b2660 2023-10-06T03:26:52.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.001+0000 7fd8bdffb700 1 -- 172.21.15.84:0/2307683659 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8c401d400 con 0x7fd8c80b2660 2023-10-06T03:26:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.002+0000 7fd8bdffb700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd8ac066f30 0x7fd8ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.002+0000 7fd8bdffb700 1 -- 172.21.15.84:0/2307683659 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd8c4085070 con 0x7fd8c80b2660 2023-10-06T03:26:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.002+0000 7fd8cd1c3700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd8ac066f30 0x7fd8ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.002+0000 7fd8cd1c3700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd8ac066f30 0x7fd8ac0693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8089690 tx=0x7fd8b8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.006+0000 7fd8bdffb700 1 -- 172.21.15.84:0/2307683659 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8c4052040 con 0x7fd8c80b2660 2023-10-06T03:26:52.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.189+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2307683659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8c805f270 con 0x7fd8c80b2660 2023-10-06T03:26:52.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.189+0000 7fd8bdffb700 1 -- 172.21.15.84:0/2307683659 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8c4055660 con 0x7fd8c80b2660 2023-10-06T03:26:52.191 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:26:52.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2307683659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd8ac066f30 msgr2=0x7fd8ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd8ac066f30 0x7fd8ac0693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8089690 tx=0x7fd8b8017000 comp rx=0 tx=0).stop 2023-10-06T03:26:52.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2307683659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2660 msgr2=0x7fd8c80b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2660 0x7fd8c80b59a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400d840 tx=0x7fd8c4008040 comp rx=0 tx=0).stop 2023-10-06T03:26:52.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2307683659 shutdown_connections 2023-10-06T03:26:52.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd8ac066f30 0x7fd8ac0693e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8c80ceae0 0x7fd8c80c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8c80b2660 0x7fd8c80b59a0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 --2- 172.21.15.84:0/2307683659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8c80b2a30 0x7fd8c80c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2307683659 >> 172.21.15.84:0/2307683659 conn(0x7fd8c8099560 msgr2=0x7fd8c8068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:52.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2307683659 shutdown_connections 2023-10-06T03:26:52.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.191+0000 7fd8ce9c6700 1 -- 172.21.15.84:0/2307683659 wait complete. 2023-10-06T03:26:52.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:52.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.317+0000 7fc839247700 1 Processor -- start 2023-10-06T03:26:52.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.317+0000 7fc839247700 1 -- start start 2023-10-06T03:26:52.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.318+0000 7fc839247700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc8340b07a0 0x7fc8340ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.318+0000 7fc839247700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8340b0ca0 con 0x7fc8340b49e0 2023-10-06T03:26:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.318+0000 7fc839247700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8340b0f80 con 0x7fc8341595a0 2023-10-06T03:26:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.318+0000 7fc839247700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8340ab390 con 0x7fc8340b07a0 2023-10-06T03:26:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.318+0000 7fc82a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc8340b49e0 0x7fc8340aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54266/0 (socket says 172.21.15.84:54266) 2023-10-06T03:26:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.318+0000 7fc82a59c700 1 -- 172.21.15.84:0/92604810 learned_addr learned my addr 172.21.15.84:0/92604810 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.318+0000 7fc83359e700 1 --2- 172.21.15.84:0/92604810 >> v2:172.21.15.131:3300/0 conn(0x7fc8340b07a0 0x7fc8340ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.318+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353564986 0 0) 0x7fc8340b0ca0 con 0x7fc8340b49e0 2023-10-06T03:26:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.318+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc820003570 con 0x7fc8340b49e0 2023-10-06T03:26:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1402493653 0 0) 0x7fc820003570 con 0x7fc8340b49e0 2023-10-06T03:26:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 >> v2:172.21.15.131:3300/0 conn(0x7fc8340b07a0 msgr2=0x7fc8340ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 --2- 172.21.15.84:0/92604810 >> v2:172.21.15.131:3300/0 conn(0x7fc8340b07a0 0x7fc8340ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 >> v1:172.21.15.131:6789/0 conn(0x7fc8341595a0 legacy=0x7fc8340aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340b1260 con 0x7fc8340b49e0 2023-10-06T03:26:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fc81c001470 con 0x7fc8340b49e0 2023-10-06T03:26:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 >> v1:172.21.15.84:6789/0 conn(0x7fc8340b49e0 legacy=0x7fc8340aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc820003a60 0x7fc820003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc820004810 0x7fc820004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8200051c0 0x7fc82000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340ab390 con 0x7fc820004810 2023-10-06T03:26:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82000c0d0 con 0x7fc8200051c0 2023-10-06T03:26:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82000c290 con 0x7fc820003a60 2023-10-06T03:26:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc82a59c700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc820004810 0x7fc820004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc832d9d700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc820003a60 0x7fc820003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83359e700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8200051c0 0x7fc82000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc82a59c700 1 -- 172.21.15.84:0/92604810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc820003a60 msgr2=0x7fc820003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc82a59c700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc820003a60 0x7fc820003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc82a59c700 1 -- 172.21.15.84:0/92604810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8200051c0 msgr2=0x7fc82000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc82a59c700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8200051c0 0x7fc82000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83359e700 1 -- 172.21.15.84:0/92604810 reap_dead start 2023-10-06T03:26:52.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc82a59c700 1 -- 172.21.15.84:0/92604810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc820003570 con 0x7fc820004810 2023-10-06T03:26:52.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc82a59c700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc820004810 0x7fc820004c80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fc834088e20 tx=0x7fc81c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70098879c3999c6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:52.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00cbb0 con 0x7fc820004810 2023-10-06T03:26:52.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c00cd10 con 0x7fc820004810 2023-10-06T03:26:52.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.319+0000 7fc83259c700 1 -- 172.21.15.84:0/92604810 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c005b50 con 0x7fc820004810 2023-10-06T03:26:52.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.320+0000 7fc839247700 1 -- 172.21.15.84:0/92604810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc820004810 msgr2=0x7fc820004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.320+0000 7fc839247700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc820004810 0x7fc820004c80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fc834088e20 tx=0x7fc81c001e50 comp rx=0 tx=0).stop 2023-10-06T03:26:52.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.320+0000 7fc839247700 1 -- 172.21.15.84:0/92604810 shutdown_connections 2023-10-06T03:26:52.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.320+0000 7fc839247700 1 --2- 172.21.15.84:0/92604810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc820004810 0x7fc820004c80 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.320+0000 7fc839247700 1 -- 172.21.15.84:0/92604810 >> 172.21.15.84:0/92604810 conn(0x7fc834099830 msgr2=0x7fc83406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:52.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.320+0000 7fc839247700 1 -- 172.21.15.84:0/92604810 shutdown_connections 2023-10-06T03:26:52.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.320+0000 7fc839247700 1 -- 172.21.15.84:0/92604810 wait complete. 2023-10-06T03:26:52.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.321+0000 7fc839247700 1 Processor -- start 2023-10-06T03:26:52.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.321+0000 7fc839247700 1 -- start start 2023-10-06T03:26:52.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc839247700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc820004810 0x7fc83414d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc839247700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8340ab4d0 0x7fc8340aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc839247700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8340af190 0x7fc8340cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc839247700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834157ea0 con 0x7fc8340af190 2023-10-06T03:26:52.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc839247700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83409c250 con 0x7fc820004810 2023-10-06T03:26:52.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc839247700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83409c500 con 0x7fc8340ab4d0 2023-10-06T03:26:52.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc83359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8340af190 0x7fc8340cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc83359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8340af190 0x7fc8340cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41274/0 (socket says 172.21.15.84:41274) 2023-10-06T03:26:52.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc83359e700 1 -- 172.21.15.84:0/3738353745 learned_addr learned my addr 172.21.15.84:0/3738353745 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:52.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc82a59c700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8340ab4d0 0x7fc8340aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc832d9d700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc820004810 0x7fc83414d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc83359e700 1 -- 172.21.15.84:0/3738353745 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8340ab4d0 msgr2=0x7fc8340aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc83359e700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8340ab4d0 0x7fc8340aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc83359e700 1 -- 172.21.15.84:0/3738353745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc820004810 msgr2=0x7fc83414d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc83359e700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc820004810 0x7fc83414d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc83359e700 1 -- 172.21.15.84:0/3738353745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83409c7e0 con 0x7fc8340af190 2023-10-06T03:26:52.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.322+0000 7fc82a59c700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8340ab4d0 0x7fc8340aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.323+0000 7fc83359e700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8340af190 0x7fc8340cd7b0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc8340b5650 tx=0x7fc82c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.323+0000 7fc82b7fe700 1 -- 172.21.15.84:0/3738353745 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00e040 con 0x7fc8340af190 2023-10-06T03:26:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.323+0000 7fc82b7fe700 1 -- 172.21.15.84:0/3738353745 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00f040 con 0x7fc8340af190 2023-10-06T03:26:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.323+0000 7fc839247700 1 -- 172.21.15.84:0/3738353745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83409cac0 con 0x7fc8340af190 2023-10-06T03:26:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.323+0000 7fc82b7fe700 1 -- 172.21.15.84:0/3738353745 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00fe20 con 0x7fc8340af190 2023-10-06T03:26:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.323+0000 7fc839247700 1 -- 172.21.15.84:0/3738353745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83409d080 con 0x7fc8340af190 2023-10-06T03:26:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.324+0000 7fc839247700 1 -- 172.21.15.84:0/3738353745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83408aa60 con 0x7fc8340af190 2023-10-06T03:26:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.324+0000 7fc82b7fe700 1 -- 172.21.15.84:0/3738353745 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc82c015640 con 0x7fc8340af190 2023-10-06T03:26:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.324+0000 7fc82b7fe700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc814066f30 0x7fc8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.324+0000 7fc82b7fe700 1 -- 172.21.15.84:0/3738353745 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc82c085060 con 0x7fc8340af190 2023-10-06T03:26:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.325+0000 7fc832d9d700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc814066f30 0x7fc8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.325+0000 7fc832d9d700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc814066f30 0x7fc8140693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc834069f90 tx=0x7fc824007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.329+0000 7fc82b7fe700 1 -- 172.21.15.84:0/3738353745 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc82c052030 con 0x7fc8340af190 2023-10-06T03:26:52.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.552+0000 7fc839247700 1 -- 172.21.15.84:0/3738353745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc83409d2a0 con 0x7fc8340af190 2023-10-06T03:26:52.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.553+0000 7fc82b7fe700 1 -- 172.21.15.84:0/3738353745 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fc82c055650 con 0x7fc8340af190 2023-10-06T03:26:52.555 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:52.555 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3563307477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3563307477},{"type":"v1","addr":"172.21.15.84:6837","nonce":3563307477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":5923,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1010130826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1010130826},{"type":"v1","addr":"172.21.15.131:6834","nonce":1010130826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/569291567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":569291567},{"type":"v1","addr":"172.21.15.84:6836","nonce":569291567}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:40.528842+0000","modified":"2023-10-06T03:26:44.181991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6615},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6615":{"gid":6615,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/1003867498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1003867498},{"type":"v1","addr":"172.21.15.131:6835","nonce":1003867498}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:26:52.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 -- 172.21.15.84:0/3738353745 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc814066f30 msgr2=0x7fc8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc814066f30 0x7fc8140693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc834069f90 tx=0x7fc824007d80 comp rx=0 tx=0).stop 2023-10-06T03:26:52.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 -- 172.21.15.84:0/3738353745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8340af190 msgr2=0x7fc8340cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8340af190 0x7fc8340cd7b0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc8340b5650 tx=0x7fc82c00b040 comp rx=0 tx=0).stop 2023-10-06T03:26:52.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 -- 172.21.15.84:0/3738353745 shutdown_connections 2023-10-06T03:26:52.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc814066f30 0x7fc8140693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc820004810 0x7fc83414d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8340af190 0x7fc8340cd7b0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 --2- 172.21.15.84:0/3738353745 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8340ab4d0 0x7fc8340aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 -- 172.21.15.84:0/3738353745 >> 172.21.15.84:0/3738353745 conn(0x7fc834099830 msgr2=0x7fc834158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:52.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 -- 172.21.15.84:0/3738353745 shutdown_connections 2023-10-06T03:26:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.555+0000 7fc839247700 1 -- 172.21.15.84:0/3738353745 wait complete. 2023-10-06T03:26:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-10-06T03:26:52.569 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.681+0000 7f1fbcbe5700 1 Processor -- start 2023-10-06T03:26:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.681+0000 7f1fbcbe5700 1 -- start start 2023-10-06T03:26:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.682+0000 7f1fbcbe5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1fb80b49e0 0x7f1fb80aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.682+0000 7f1fbcbe5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80b0ca0 con 0x7f1fb80b07a0 2023-10-06T03:26:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.682+0000 7f1fbcbe5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80b0f80 con 0x7f1fb81595a0 2023-10-06T03:26:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.682+0000 7f1fbcbe5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb80b1260 con 0x7f1fb80b49e0 2023-10-06T03:26:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.682+0000 7f1fb6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1fb80b07a0 0x7f1fb80b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54278/0 (socket says 172.21.15.84:54278) 2023-10-06T03:26:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.682+0000 7f1fb6d9d700 1 -- 172.21.15.84:0/1853300387 learned_addr learned my addr 172.21.15.84:0/1853300387 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.682+0000 7f1fb5d9b700 1 --2- 172.21.15.84:0/1853300387 >> v2:172.21.15.131:3300/0 conn(0x7f1fb80b49e0 0x7f1fb80aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.683+0000 7f1fb559a700 1 -- 172.21.15.84:0/1853300387 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897965765 0 0) 0x7f1fb80b0ca0 con 0x7f1fb80b07a0 2023-10-06T03:26:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.683+0000 7f1fb559a700 1 -- 172.21.15.84:0/1853300387 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa4003570 con 0x7f1fb80b07a0 2023-10-06T03:26:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.683+0000 7f1fb5d9b700 1 -- 172.21.15.84:0/1853300387 >> v1:172.21.15.131:6789/0 conn(0x7f1fb81595a0 legacy=0x7f1fb80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.683+0000 7f1fb559a700 1 -- 172.21.15.84:0/1853300387 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2378039439 0 0) 0x7f1fa4003570 con 0x7f1fb80b07a0 2023-10-06T03:26:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.683+0000 7f1fb5d9b700 1 -- 172.21.15.84:0/1853300387 >> v1:172.21.15.84:6789/0 conn(0x7f1fb80b07a0 legacy=0x7f1fb80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.683+0000 7f1fb5d9b700 1 -- 172.21.15.84:0/1853300387 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb80b1540 con 0x7f1fb80b49e0 2023-10-06T03:26:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.683+0000 7f1fb5d9b700 1 --2- 172.21.15.84:0/1853300387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb80b49e0 0x7f1fb80aac80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009910 tx=0x7f1fa00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7914bdc49d43aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.683+0000 7f1fb559a700 1 -- 172.21.15.84:0/1853300387 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0001470 con 0x7f1fb80b49e0 2023-10-06T03:26:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.683+0000 7f1fb559a700 1 -- 172.21.15.84:0/1853300387 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa0011420 con 0x7f1fb80b49e0 2023-10-06T03:26:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.683+0000 7f1fb559a700 1 -- 172.21.15.84:0/1853300387 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00117a0 con 0x7f1fb80b49e0 2023-10-06T03:26:52.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.684+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/1853300387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb80b49e0 msgr2=0x7f1fb80aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.684+0000 7f1fbcbe5700 1 --2- 172.21.15.84:0/1853300387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb80b49e0 0x7f1fb80aac80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009910 tx=0x7f1fa00091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.684+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/1853300387 shutdown_connections 2023-10-06T03:26:52.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.684+0000 7f1fbcbe5700 1 --2- 172.21.15.84:0/1853300387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb80b49e0 0x7f1fb80aac80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.684+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/1853300387 >> 172.21.15.84:0/1853300387 conn(0x7f1fb8099830 msgr2=0x7f1fb806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:52.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.684+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/1853300387 shutdown_connections 2023-10-06T03:26:52.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.684+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/1853300387 wait complete. 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.685+0000 7f1fbcbe5700 1 Processor -- start 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.685+0000 7f1fbcbe5700 1 -- start start 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fbcbe5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb80b07a0 0x7f1fb814a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fbcbe5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b49e0 0x7f1fb8069400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fbcbe5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb81595a0 0x7f1fb8069940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fbcbe5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8156ab0 con 0x7f1fb80b07a0 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fbcbe5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb815b1f0 con 0x7f1fb81595a0 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fbcbe5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb809d5f0 con 0x7f1fb80b49e0 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb80b07a0 0x7f1fb814a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb80b07a0 0x7f1fb814a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41288/0 (socket says 172.21.15.84:41288) 2023-10-06T03:26:52.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb659c700 1 -- 172.21.15.84:0/2669036289 learned_addr learned my addr 172.21.15.84:0/2669036289 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb659c700 1 -- 172.21.15.84:0/2669036289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b49e0 msgr2=0x7f1fb8069400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb5d9b700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b49e0 0x7f1fb8069400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb659c700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b49e0 0x7f1fb8069400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb659c700 1 -- 172.21.15.84:0/2669036289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb81595a0 msgr2=0x7f1fb8069940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb6d9d700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb81595a0 0x7f1fb8069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb659c700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb81595a0 0x7f1fb8069940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb659c700 1 -- 172.21.15.84:0/2669036289 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0009420 con 0x7f1fb80b07a0 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fb659c700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb80b07a0 0x7f1fb814a880 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800cd30 tx=0x7f1fa8001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fae7fc700 1 -- 172.21.15.84:0/2669036289 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800ab70 con 0x7f1fb80b07a0 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fae7fc700 1 -- 172.21.15.84:0/2669036289 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa800acd0 con 0x7f1fb80b07a0 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/2669036289 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb809d8d0 con 0x7f1fb80b07a0 2023-10-06T03:26:52.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fae7fc700 1 -- 172.21.15.84:0/2669036289 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8012670 con 0x7f1fb80b07a0 2023-10-06T03:26:52.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.686+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/2669036289 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb814adc0 con 0x7f1fb80b07a0 2023-10-06T03:26:52.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.687+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/2669036289 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb8064ad0 con 0x7f1fb80b07a0 2023-10-06T03:26:52.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.688+0000 7f1fae7fc700 1 -- 172.21.15.84:0/2669036289 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fa8012a60 con 0x7f1fb80b07a0 2023-10-06T03:26:52.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.688+0000 7f1fae7fc700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1f98066f30 0x7f1f980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:52.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.688+0000 7f1fae7fc700 1 -- 172.21.15.84:0/2669036289 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1fa8084f30 con 0x7f1fb80b07a0 2023-10-06T03:26:52.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.688+0000 7f1fb5d9b700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1f98066f30 0x7f1f980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:52.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.689+0000 7f1fb5d9b700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1f98066f30 0x7f1f980693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009910 tx=0x7f1fa0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:52.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.692+0000 7f1fae7fc700 1 -- 172.21.15.84:0/2669036289 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fa8051f00 con 0x7f1fb80b07a0 2023-10-06T03:26:52.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.875+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/2669036289 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fb80b1820 con 0x7f1fb80b07a0 2023-10-06T03:26:52.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.875+0000 7f1fae7fc700 1 -- 172.21.15.84:0/2669036289 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f1fa8055520 con 0x7f1fb80b07a0 2023-10-06T03:26:52.877 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":86,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:42.158139+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:38.193214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:39.494528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.877+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/2669036289 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1f98066f30 msgr2=0x7f1f980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.877+0000 7f1fbcbe5700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1f98066f30 0x7f1f980693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009910 tx=0x7f1fa0016000 comp rx=0 tx=0).stop 2023-10-06T03:26:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.877+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/2669036289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb80b07a0 msgr2=0x7f1fb814a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.877+0000 7f1fbcbe5700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb80b07a0 0x7f1fb814a880 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800cd30 tx=0x7f1fa8001b40 comp rx=0 tx=0).stop 2023-10-06T03:26:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.877+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/2669036289 shutdown_connections 2023-10-06T03:26:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.877+0000 7f1fbcbe5700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1f98066f30 0x7f1f980693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.877+0000 7f1fbcbe5700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb81595a0 0x7f1fb8069940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.877+0000 7f1fbcbe5700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb80b07a0 0x7f1fb814a880 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.877+0000 7f1fbcbe5700 1 --2- 172.21.15.84:0/2669036289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b49e0 0x7f1fb8069400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.878+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/2669036289 >> 172.21.15.84:0/2669036289 conn(0x7f1fb8099830 msgr2=0x7f1fb81588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.878+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/2669036289 shutdown_connections 2023-10-06T03:26:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:52.878+0000 7f1fbcbe5700 1 -- 172.21.15.84:0/2669036289 wait complete. 2023-10-06T03:26:52.891 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:26:52.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:53.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.004+0000 7f0bd42f3700 1 Processor -- start 2023-10-06T03:26:53.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.004+0000 7f0bd42f3700 1 -- start start 2023-10-06T03:26:53.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd42f3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bcc1595a0 0x7f0bcc0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd42f3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b07a0 0x7f0bcc0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd42f3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0b0ca0 con 0x7f0bcc0b49e0 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd42f3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b0f80 con 0x7f0bcc1595a0 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd42f3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b1260 con 0x7f0bcc0b07a0 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd208f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bcc1595a0 0x7f0bcc0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd208f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bcc1595a0 0x7f0bcc0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41298/0 (socket says 172.21.15.84:41298) 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd208f700 1 -- 172.21.15.84:0/3112698236 learned_addr learned my addr 172.21.15.84:0/3112698236 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd2890700 1 --2- 172.21.15.84:0/3112698236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b07a0 0x7f0bcc0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd208f700 1 -- 172.21.15.84:0/3112698236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b07a0 msgr2=0x7f0bcc0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd208f700 1 --2- 172.21.15.84:0/3112698236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b07a0 0x7f0bcc0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd208f700 1 -- 172.21.15.84:0/3112698236 >> v1:172.21.15.131:6789/0 conn(0x7f0bcc0b49e0 legacy=0x7f0bcc0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd208f700 1 -- 172.21.15.84:0/3112698236 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0b1540 con 0x7f0bcc1595a0 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd208f700 1 --2- 172.21.15.84:0/3112698236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 0x7f0bcc0aa570 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80099c0 tx=0x7f0bc8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76527054637e166 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.005+0000 7f0bd108d700 1 -- 172.21.15.84:0/3112698236 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8005c10 con 0x7f0bcc1595a0 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.006+0000 7f0bd108d700 1 -- 172.21.15.84:0/3112698236 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8005d70 con 0x7f0bcc1595a0 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.006+0000 7f0bd108d700 1 -- 172.21.15.84:0/3112698236 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800b800 con 0x7f0bcc1595a0 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.006+0000 7f0bd42f3700 1 -- 172.21.15.84:0/3112698236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 msgr2=0x7f0bcc0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.006+0000 7f0bd42f3700 1 --2- 172.21.15.84:0/3112698236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 0x7f0bcc0aa570 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80099c0 tx=0x7f0bc8009220 comp rx=0 tx=0).stop 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.006+0000 7f0bd42f3700 1 -- 172.21.15.84:0/3112698236 shutdown_connections 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.006+0000 7f0bd42f3700 1 --2- 172.21.15.84:0/3112698236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b07a0 0x7f0bcc0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.006+0000 7f0bd42f3700 1 --2- 172.21.15.84:0/3112698236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 0x7f0bcc0aa570 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.006+0000 7f0bd42f3700 1 -- 172.21.15.84:0/3112698236 >> 172.21.15.84:0/3112698236 conn(0x7f0bcc099830 msgr2=0x7f0bcc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.006+0000 7f0bd42f3700 1 -- 172.21.15.84:0/3112698236 shutdown_connections 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.006+0000 7f0bd42f3700 1 -- 172.21.15.84:0/3112698236 wait complete. 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.007+0000 7f0bd42f3700 1 Processor -- start 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.007+0000 7f0bd42f3700 1 -- start start 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd42f3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b07a0 0x7f0bcc0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd42f3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b49e0 0x7f0bcc16ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd42f3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 0x7f0bcc157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd42f3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0adc80 con 0x7f0bcc1595a0 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd42f3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc158020 con 0x7f0bcc0b07a0 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd42f3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0abc50 con 0x7f0bcc0b49e0 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd2890700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 0x7f0bcc157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd2890700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 0x7f0bcc157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41308/0 (socket says 172.21.15.84:41308) 2023-10-06T03:26:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd2890700 1 -- 172.21.15.84:0/2570608868 learned_addr learned my addr 172.21.15.84:0/2570608868 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd208f700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b07a0 0x7f0bcc0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd188e700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b49e0 0x7f0bcc16ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd2890700 1 -- 172.21.15.84:0/2570608868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b49e0 msgr2=0x7f0bcc16ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd2890700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b49e0 0x7f0bcc16ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd2890700 1 -- 172.21.15.84:0/2570608868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b07a0 msgr2=0x7f0bcc0af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd2890700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b07a0 0x7f0bcc0af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd2890700 1 -- 172.21.15.84:0/2570608868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8009480 con 0x7f0bcc1595a0 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.008+0000 7f0bd188e700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b49e0 0x7f0bcc16ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.009+0000 7f0bd2890700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 0x7f0bcc157ae0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400ce80 tx=0x7f0bc4007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.009+0000 7f0bc27fc700 1 -- 172.21.15.84:0/2570608868 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400ad70 con 0x7f0bcc1595a0 2023-10-06T03:26:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.009+0000 7f0bc27fc700 1 -- 172.21.15.84:0/2570608868 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc4016430 con 0x7f0bcc1595a0 2023-10-06T03:26:53.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.009+0000 7f0bd42f3700 1 -- 172.21.15.84:0/2570608868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc0abf30 con 0x7f0bcc1595a0 2023-10-06T03:26:53.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.009+0000 7f0bc27fc700 1 -- 172.21.15.84:0/2570608868 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40167f0 con 0x7f0bcc1595a0 2023-10-06T03:26:53.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.009+0000 7f0bd42f3700 1 -- 172.21.15.84:0/2570608868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc0ad850 con 0x7f0bcc1595a0 2023-10-06T03:26:53.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.010+0000 7f0bd42f3700 1 -- 172.21.15.84:0/2570608868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc0ac430 con 0x7f0bcc1595a0 2023-10-06T03:26:53.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.010+0000 7f0bc27fc700 1 -- 172.21.15.84:0/2570608868 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bc4003020 con 0x7f0bcc1595a0 2023-10-06T03:26:53.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.010+0000 7f0bc27fc700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0bb0066f30 0x7f0bb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.010+0000 7f0bc27fc700 1 -- 172.21.15.84:0/2570608868 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0bc4012070 con 0x7f0bcc1595a0 2023-10-06T03:26:53.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.010+0000 7f0bd208f700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0bb0066f30 0x7f0bb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.011+0000 7f0bd208f700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0bb0066f30 0x7f0bb00693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8007fd0 tx=0x7f0bc8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:53.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.014+0000 7f0bc27fc700 1 -- 172.21.15.84:0/2570608868 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bcc0ac430 con 0x7f0bcc1595a0 2023-10-06T03:26:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.238+0000 7f0bd42f3700 1 -- 172.21.15.84:0/2570608868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bcc0ac430 con 0x7f0bcc1595a0 2023-10-06T03:26:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.238+0000 7f0bc27fc700 1 -- 172.21.15.84:0/2570608868 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f0bcc0ac430 con 0x7f0bcc1595a0 2023-10-06T03:26:53.240 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:53.240 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3563307477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3563307477},{"type":"v1","addr":"172.21.15.84:6837","nonce":3563307477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":5923,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1010130826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1010130826},{"type":"v1","addr":"172.21.15.131:6834","nonce":1010130826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/569291567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":569291567},{"type":"v1","addr":"172.21.15.84:6836","nonce":569291567}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:40.528842+0000","modified":"2023-10-06T03:26:44.181991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6615},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6615":{"gid":6615,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/1003867498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1003867498},{"type":"v1","addr":"172.21.15.131:6835","nonce":1003867498}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:26:53.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 -- 172.21.15.84:0/2570608868 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0bb0066f30 msgr2=0x7f0bb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0bb0066f30 0x7f0bb00693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8007fd0 tx=0x7f0bc8015000 comp rx=0 tx=0).stop 2023-10-06T03:26:53.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 -- 172.21.15.84:0/2570608868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 msgr2=0x7f0bcc157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 0x7f0bcc157ae0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400ce80 tx=0x7f0bc4007840 comp rx=0 tx=0).stop 2023-10-06T03:26:53.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 -- 172.21.15.84:0/2570608868 shutdown_connections 2023-10-06T03:26:53.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0bb0066f30 0x7f0bb00693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b07a0 0x7f0bcc0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc1595a0 0x7f0bcc157ae0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 --2- 172.21.15.84:0/2570608868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc0b49e0 0x7f0bcc16ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 -- 172.21.15.84:0/2570608868 >> 172.21.15.84:0/2570608868 conn(0x7f0bcc099830 msgr2=0x7f0bcc1589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 -- 172.21.15.84:0/2570608868 shutdown_connections 2023-10-06T03:26:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.240+0000 7f0bd42f3700 1 -- 172.21.15.84:0/2570608868 wait complete. 2023-10-06T03:26:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-10-06T03:26:53.254 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:53.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.366+0000 7faba4c43700 1 Processor -- start 2023-10-06T03:26:53.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.366+0000 7faba4c43700 1 -- start start 2023-10-06T03:26:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.367+0000 7faba4c43700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faba00b2620 0x7faba00b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.367+0000 7faba4c43700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faba00b29f0 0x7faba0159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.367+0000 7faba4c43700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba00cbfe0 con 0x7faba01596a0 2023-10-06T03:26:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.367+0000 7faba4c43700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba00cb3d0 con 0x7faba00b2620 2023-10-06T03:26:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.367+0000 7faba4c43700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba00cb6b0 con 0x7faba00b29f0 2023-10-06T03:26:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.367+0000 7fab9e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faba00b2620 0x7faba00b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.367+0000 7fab9e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faba00b2620 0x7faba00b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41324/0 (socket says 172.21.15.84:41324) 2023-10-06T03:26:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.367+0000 7fab9e59c700 1 -- 172.21.15.84:0/2997084475 learned_addr learned my addr 172.21.15.84:0/2997084475 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7fab95d9b700 1 --2- 172.21.15.84:0/2997084475 >> v2:172.21.15.131:3300/0 conn(0x7faba00b29f0 0x7faba0159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7fab9e59c700 1 -- 172.21.15.84:0/2997084475 >> v2:172.21.15.131:3300/0 conn(0x7faba00b29f0 msgr2=0x7faba0159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:53.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7fab9e59c700 1 --2- 172.21.15.84:0/2997084475 >> v2:172.21.15.131:3300/0 conn(0x7faba00b29f0 0x7faba0159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7fab9e59c700 1 -- 172.21.15.84:0/2997084475 >> v1:172.21.15.131:6789/0 conn(0x7faba01596a0 legacy=0x7faba0068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:53.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7fab9e59c700 1 -- 172.21.15.84:0/2997084475 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba00cb990 con 0x7faba00b2620 2023-10-06T03:26:53.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7fab9e59c700 1 --2- 172.21.15.84:0/2997084475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 0x7faba00b06d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7faba00cab50 tx=0x7fab90009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7ff31c56648caf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:53.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7fab9dd9b700 1 -- 172.21.15.84:0/2997084475 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90005c10 con 0x7faba00b2620 2023-10-06T03:26:53.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7fab9dd9b700 1 -- 172.21.15.84:0/2997084475 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab90005d70 con 0x7faba00b2620 2023-10-06T03:26:53.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7fab9dd9b700 1 -- 172.21.15.84:0/2997084475 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9000b840 con 0x7faba00b2620 2023-10-06T03:26:53.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7faba4c43700 1 -- 172.21.15.84:0/2997084475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 msgr2=0x7faba00b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7faba4c43700 1 --2- 172.21.15.84:0/2997084475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 0x7faba00b06d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7faba00cab50 tx=0x7fab90009220 comp rx=0 tx=0).stop 2023-10-06T03:26:53.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7faba4c43700 1 -- 172.21.15.84:0/2997084475 shutdown_connections 2023-10-06T03:26:53.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7faba4c43700 1 --2- 172.21.15.84:0/2997084475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 0x7faba00b06d0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7faba4c43700 1 --2- 172.21.15.84:0/2997084475 >> v2:172.21.15.131:3300/0 conn(0x7faba00b29f0 0x7faba0159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7faba4c43700 1 -- 172.21.15.84:0/2997084475 >> 172.21.15.84:0/2997084475 conn(0x7faba006ed20 msgr2=0x7faba006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:53.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.368+0000 7faba4c43700 1 -- 172.21.15.84:0/2997084475 shutdown_connections 2023-10-06T03:26:53.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.369+0000 7faba4c43700 1 -- 172.21.15.84:0/2997084475 wait complete. 2023-10-06T03:26:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.370+0000 7faba4c43700 1 Processor -- start 2023-10-06T03:26:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.370+0000 7faba4c43700 1 -- start start 2023-10-06T03:26:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.370+0000 7faba4c43700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 0x7faba00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.370+0000 7faba4c43700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba00b29f0 0x7faba0169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.370+0000 7faba4c43700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba01596a0 0x7faba016a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.370+0000 7faba4c43700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba00ce570 con 0x7faba00b2620 2023-10-06T03:26:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.370+0000 7faba4c43700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba00ce7f0 con 0x7faba00b29f0 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.370+0000 7faba4c43700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba00cead0 con 0x7faba01596a0 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.370+0000 7fab9e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 0x7faba00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.370+0000 7fab9e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 0x7faba00ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41328/0 (socket says 172.21.15.84:41328) 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab9e59c700 1 -- 172.21.15.84:0/2766864874 learned_addr learned my addr 172.21.15.84:0/2766864874 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab95d9b700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba00b29f0 0x7faba0169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab9ed9d700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba01596a0 0x7faba016a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab9e59c700 1 -- 172.21.15.84:0/2766864874 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba01596a0 msgr2=0x7faba016a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab9e59c700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba01596a0 0x7faba016a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab9e59c700 1 -- 172.21.15.84:0/2766864874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba00b29f0 msgr2=0x7faba0169e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab9e59c700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba00b29f0 0x7faba0169e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab9e59c700 1 -- 172.21.15.84:0/2766864874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90009480 con 0x7faba00b2620 2023-10-06T03:26:53.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab9e59c700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 0x7faba00ce030 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fab900030c0 tx=0x7fab90015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab96ffd700 1 -- 172.21.15.84:0/2766864874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90011a10 con 0x7faba00b2620 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab96ffd700 1 -- 172.21.15.84:0/2766864874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab90011b70 con 0x7faba00b2620 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7faba4c43700 1 -- 172.21.15.84:0/2766864874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba00cedb0 con 0x7faba00b2620 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7fab96ffd700 1 -- 172.21.15.84:0/2766864874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9001d430 con 0x7faba00b2620 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.371+0000 7faba4c43700 1 -- 172.21.15.84:0/2766864874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba00cf370 con 0x7faba00b2620 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.372+0000 7faba4c43700 1 -- 172.21.15.84:0/2766864874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba0064ad0 con 0x7faba00b2620 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.373+0000 7fab96ffd700 1 -- 172.21.15.84:0/2766864874 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab9001d820 con 0x7faba00b2620 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.374+0000 7fab96ffd700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab80066f30 0x7fab800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.374+0000 7fab96ffd700 1 -- 172.21.15.84:0/2766864874 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fab90086f40 con 0x7faba00b2620 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.374+0000 7fab95d9b700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab80066f30 0x7fab800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.374+0000 7fab95d9b700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab80066f30 0x7fab800693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fab88006fd0 tx=0x7fab88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:53.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.377+0000 7fab96ffd700 1 -- 172.21.15.84:0/2766864874 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab90053f90 con 0x7faba00b2620 2023-10-06T03:26:53.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.604+0000 7faba4c43700 1 -- 172.21.15.84:0/2766864874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faba00cbc70 con 0x7faba00b2620 2023-10-06T03:26:53.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.604+0000 7fab96ffd700 1 -- 172.21.15.84:0/2766864874 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fab900575b0 con 0x7faba00b2620 2023-10-06T03:26:53.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:53.606 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3563307477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3563307477},{"type":"v1","addr":"172.21.15.84:6837","nonce":3563307477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":5923,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1010130826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1010130826},{"type":"v1","addr":"172.21.15.131:6834","nonce":1010130826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/569291567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":569291567},{"type":"v1","addr":"172.21.15.84:6836","nonce":569291567}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:26:40.528842+0000","modified":"2023-10-06T03:26:44.181991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6615},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6615":{"gid":6615,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/1003867498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1003867498},{"type":"v1","addr":"172.21.15.131:6835","nonce":1003867498}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:26:53.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 -- 172.21.15.84:0/2766864874 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab80066f30 msgr2=0x7fab800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab80066f30 0x7fab800693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fab88006fd0 tx=0x7fab88008040 comp rx=0 tx=0).stop 2023-10-06T03:26:53.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 -- 172.21.15.84:0/2766864874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 msgr2=0x7faba00ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 0x7faba00ce030 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fab900030c0 tx=0x7fab90015000 comp rx=0 tx=0).stop 2023-10-06T03:26:53.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 -- 172.21.15.84:0/2766864874 shutdown_connections 2023-10-06T03:26:53.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fab80066f30 0x7fab800693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faba01596a0 0x7faba016a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faba00b2620 0x7faba00ce030 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 --2- 172.21.15.84:0/2766864874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba00b29f0 0x7faba0169e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 -- 172.21.15.84:0/2766864874 >> 172.21.15.84:0/2766864874 conn(0x7faba006ed20 msgr2=0x7faba0153bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:53.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 -- 172.21.15.84:0/2766864874 shutdown_connections 2023-10-06T03:26:53.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.606+0000 7faba4c43700 1 -- 172.21.15.84:0/2766864874 wait complete. 2023-10-06T03:26:53.610 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-10-06T03:26:53.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:26:53.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.733+0000 7f4286d46700 1 Processor -- start 2023-10-06T03:26:53.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.733+0000 7f4286d46700 1 -- start start 2023-10-06T03:26:53.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4286d46700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f42800b2850 0x7f42800cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4286d46700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800cb7e0 con 0x7f42800cbc70 2023-10-06T03:26:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4286d46700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800b08a0 con 0x7f4280159480 2023-10-06T03:26:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4286d46700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42800cb190 con 0x7f42800b2850 2023-10-06T03:26:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4285543700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f42800cbc70 0x7f42800b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54294/0 (socket says 172.21.15.84:54294) 2023-10-06T03:26:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4285543700 1 -- 172.21.15.84:0/4275108696 learned_addr learned my addr 172.21.15.84:0/4275108696 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4286545700 1 --2- 172.21.15.84:0/4275108696 >> v2:172.21.15.131:3300/0 conn(0x7f42800b2850 0x7f42800cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888215304 0 0) 0x7f42800cb7e0 con 0x7f42800cbc70 2023-10-06T03:26:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f426c003570 con 0x7f42800cbc70 2023-10-06T03:26:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4063733857 0 0) 0x7f426c003570 con 0x7f42800cbc70 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 >> v2:172.21.15.131:3300/0 conn(0x7f42800b2850 msgr2=0x7f42800cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 --2- 172.21.15.84:0/4275108696 >> v2:172.21.15.131:3300/0 conn(0x7f42800b2850 0x7f42800cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 >> v1:172.21.15.131:6789/0 conn(0x7f4280159480 legacy=0x7f42800b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800cb470 con 0x7f42800cbc70 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f4270001470 con 0x7f42800cbc70 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 >> v1:172.21.15.84:6789/0 conn(0x7f42800cbc70 legacy=0x7f42800b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f426c003a60 0x7f426c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.734+0000 7f4284d42700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c004810 0x7f426c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4284d42700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c0051c0 0x7f426c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800cb190 con 0x7f426c004810 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c00c0d0 con 0x7f426c0051c0 2023-10-06T03:26:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c00c290 con 0x7f426c003a60 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4285543700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c004810 0x7f426c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4286545700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c0051c0 0x7f426c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4285d44700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f426c003a60 0x7f426c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4285543700 1 -- 172.21.15.84:0/4275108696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f426c003a60 msgr2=0x7f426c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4285543700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f426c003a60 0x7f426c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4285543700 1 -- 172.21.15.84:0/4275108696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c0051c0 msgr2=0x7f426c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4285543700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c0051c0 0x7f426c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4286545700 1 -- 172.21.15.84:0/4275108696 reap_dead start 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4285543700 1 -- 172.21.15.84:0/4275108696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c003570 con 0x7f426c004810 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4285d44700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f426c003a60 0x7f426c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4285543700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c004810 0x7f426c004c80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f427000c3c0 tx=0x7f4270001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cd593a4a067f98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000cc10 con 0x7f426c004810 2023-10-06T03:26:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427000cd70 con 0x7f426c004810 2023-10-06T03:26:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.735+0000 7f4284d42700 1 -- 172.21.15.84:0/4275108696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270005b50 con 0x7f426c004810 2023-10-06T03:26:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.736+0000 7f4286d46700 1 -- 172.21.15.84:0/4275108696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c004810 msgr2=0x7f426c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.736+0000 7f4286d46700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c004810 0x7f426c004c80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f427000c3c0 tx=0x7f4270001e50 comp rx=0 tx=0).stop 2023-10-06T03:26:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.736+0000 7f4286d46700 1 -- 172.21.15.84:0/4275108696 shutdown_connections 2023-10-06T03:26:53.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.736+0000 7f4286d46700 1 --2- 172.21.15.84:0/4275108696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c004810 0x7f426c004c80 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.736+0000 7f4286d46700 1 -- 172.21.15.84:0/4275108696 >> 172.21.15.84:0/4275108696 conn(0x7f428006ed20 msgr2=0x7f428006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:53.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.736+0000 7f4286d46700 1 -- 172.21.15.84:0/4275108696 shutdown_connections 2023-10-06T03:26:53.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.736+0000 7f4286d46700 1 -- 172.21.15.84:0/4275108696 wait complete. 2023-10-06T03:26:53.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.737+0000 7f4286d46700 1 Processor -- start 2023-10-06T03:26:53.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.737+0000 7f4286d46700 1 -- start start 2023-10-06T03:26:53.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286d46700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f426c004810 0x7f42800af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286d46700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42800cfd40 0x7f42800c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286d46700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800c9470 0x7f42800cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286d46700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42801550b0 con 0x7f42800c9470 2023-10-06T03:26:53.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286d46700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800c7ca0 con 0x7f42800cfd40 2023-10-06T03:26:53.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286d46700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800c4140 con 0x7f426c004810 2023-10-06T03:26:53.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286545700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800c9470 0x7f42800cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286545700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800c9470 0x7f42800cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41354/0 (socket says 172.21.15.84:41354) 2023-10-06T03:26:53.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286545700 1 -- 172.21.15.84:0/1320757816 learned_addr learned my addr 172.21.15.84:0/1320757816 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:53.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4285d44700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f426c004810 0x7f42800af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4285543700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42800cfd40 0x7f42800c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286545700 1 -- 172.21.15.84:0/1320757816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f426c004810 msgr2=0x7f42800af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286545700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f426c004810 0x7f42800af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286545700 1 -- 172.21.15.84:0/1320757816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42800cfd40 msgr2=0x7f42800c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286545700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42800cfd40 0x7f42800c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286545700 1 -- 172.21.15.84:0/1320757816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800c73b0 con 0x7f42800c9470 2023-10-06T03:26:53.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286545700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800c9470 0x7f42800cde30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f42780094d0 tx=0x7f427800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:53.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4275ffb700 1 -- 172.21.15.84:0/1320757816 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800e040 con 0x7f42800c9470 2023-10-06T03:26:53.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4275ffb700 1 -- 172.21.15.84:0/1320757816 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800f040 con 0x7f42800c9470 2023-10-06T03:26:53.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286d46700 1 -- 172.21.15.84:0/1320757816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42800c7650 con 0x7f42800c9470 2023-10-06T03:26:53.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4275ffb700 1 -- 172.21.15.84:0/1320757816 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800fe50 con 0x7f42800c9470 2023-10-06T03:26:53.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.738+0000 7f4286d46700 1 -- 172.21.15.84:0/1320757816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42800c98e0 con 0x7f42800c9470 2023-10-06T03:26:53.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.739+0000 7f4286d46700 1 -- 172.21.15.84:0/1320757816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42800c7e30 con 0x7f42800c9470 2023-10-06T03:26:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.740+0000 7f4275ffb700 1 -- 172.21.15.84:0/1320757816 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4278015640 con 0x7f42800c9470 2023-10-06T03:26:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.740+0000 7f4275ffb700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4264066f30 0x7f42640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.740+0000 7f4275ffb700 1 -- 172.21.15.84:0/1320757816 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4278085220 con 0x7f42800c9470 2023-10-06T03:26:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.740+0000 7f4285d44700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4264066f30 0x7f42640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.741+0000 7f4285d44700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4264066f30 0x7f42640693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f427c007bc0 tx=0x7f427c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.744+0000 7f4275ffb700 1 -- 172.21.15.84:0/1320757816 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4278055c80 con 0x7f42800c9470 2023-10-06T03:26:53.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.928+0000 7f4286d46700 1 -- 172.21.15.84:0/1320757816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f428005f270 con 0x7f42800c9470 2023-10-06T03:26:53.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.929+0000 7f4275ffb700 1 -- 172.21.15.84:0/1320757816 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f4278055810 con 0x7f42800c9470 2023-10-06T03:26:53.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:26:53.931 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":86,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:26:42.158139+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:26:38.193214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:26:39.494528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:26:53.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 -- 172.21.15.84:0/1320757816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4264066f30 msgr2=0x7f42640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4264066f30 0x7f42640693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f427c007bc0 tx=0x7f427c009040 comp rx=0 tx=0).stop 2023-10-06T03:26:53.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 -- 172.21.15.84:0/1320757816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800c9470 msgr2=0x7f42800cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:53.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800c9470 0x7f42800cde30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f42780094d0 tx=0x7f427800b040 comp rx=0 tx=0).stop 2023-10-06T03:26:53.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 -- 172.21.15.84:0/1320757816 shutdown_connections 2023-10-06T03:26:53.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4264066f30 0x7f42640693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800c9470 0x7f42800cde30 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f426c004810 0x7f42800af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 --2- 172.21.15.84:0/1320757816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42800cfd40 0x7f42800c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:53.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 -- 172.21.15.84:0/1320757816 >> 172.21.15.84:0/1320757816 conn(0x7f428006ed20 msgr2=0x7f42800b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:53.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 -- 172.21.15.84:0/1320757816 shutdown_connections 2023-10-06T03:26:53.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:53.931+0000 7f4286d46700 1 -- 172.21.15.84:0/1320757816 wait complete. 2023-10-06T03:26:53.945 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:26:54.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.058+0000 7fbd25026700 1 Processor -- start 2023-10-06T03:26:54.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.058+0000 7fbd25026700 1 -- start start 2023-10-06T03:26:54.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.059+0000 7fbd25026700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbd201595a0 0x7fbd200aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.059+0000 7fbd25026700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbd200b49e0 0x7fbd200aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.059+0000 7fbd25026700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd200b0ca0 con 0x7fbd200b07a0 2023-10-06T03:26:54.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.059+0000 7fbd25026700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200b0f80 con 0x7fbd201595a0 2023-10-06T03:26:54.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.059+0000 7fbd25026700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200b1260 con 0x7fbd200b49e0 2023-10-06T03:26:54.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.059+0000 7fbd1ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbd201595a0 0x7fbd200aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.059+0000 7fbd1ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbd201595a0 0x7fbd200aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41368/0 (socket says 172.21.15.84:41368) 2023-10-06T03:26:54.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.059+0000 7fbd1ed9d700 1 -- 172.21.15.84:0/2625358830 learned_addr learned my addr 172.21.15.84:0/2625358830 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:54.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.059+0000 7fbd1e59c700 1 --2- 172.21.15.84:0/2625358830 >> v2:172.21.15.131:3300/0 conn(0x7fbd200b49e0 0x7fbd200aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd1ed9d700 1 -- 172.21.15.84:0/2625358830 >> v2:172.21.15.131:3300/0 conn(0x7fbd200b49e0 msgr2=0x7fbd200aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd1ed9d700 1 --2- 172.21.15.84:0/2625358830 >> v2:172.21.15.131:3300/0 conn(0x7fbd200b49e0 0x7fbd200aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd1ed9d700 1 -- 172.21.15.84:0/2625358830 >> v1:172.21.15.131:6789/0 conn(0x7fbd200b07a0 legacy=0x7fbd200b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd1ed9d700 1 -- 172.21.15.84:0/2625358830 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd200b1540 con 0x7fbd201595a0 2023-10-06T03:26:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd1ed9d700 1 --2- 172.21.15.84:0/2625358830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd201595a0 0x7fbd200aa570 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009f70 tx=0x7fbd10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4851a93cb1737bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd1dd9b700 1 -- 172.21.15.84:0/2625358830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1000e070 con 0x7fbd201595a0 2023-10-06T03:26:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd1dd9b700 1 -- 172.21.15.84:0/2625358830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1000ba50 con 0x7fbd201595a0 2023-10-06T03:26:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd1dd9b700 1 -- 172.21.15.84:0/2625358830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100092e0 con 0x7fbd201595a0 2023-10-06T03:26:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd25026700 1 -- 172.21.15.84:0/2625358830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd201595a0 msgr2=0x7fbd200aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd25026700 1 --2- 172.21.15.84:0/2625358830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd201595a0 0x7fbd200aa570 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009f70 tx=0x7fbd10009840 comp rx=0 tx=0).stop 2023-10-06T03:26:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd25026700 1 -- 172.21.15.84:0/2625358830 shutdown_connections 2023-10-06T03:26:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd25026700 1 --2- 172.21.15.84:0/2625358830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd201595a0 0x7fbd200aa570 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd25026700 1 --2- 172.21.15.84:0/2625358830 >> v2:172.21.15.131:3300/0 conn(0x7fbd200b49e0 0x7fbd200aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd25026700 1 -- 172.21.15.84:0/2625358830 >> 172.21.15.84:0/2625358830 conn(0x7fbd20099830 msgr2=0x7fbd2006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd25026700 1 -- 172.21.15.84:0/2625358830 shutdown_connections 2023-10-06T03:26:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.060+0000 7fbd25026700 1 -- 172.21.15.84:0/2625358830 wait complete. 2023-10-06T03:26:54.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.062+0000 7fbd25026700 1 Processor -- start 2023-10-06T03:26:54.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.062+0000 7fbd25026700 1 -- start start 2023-10-06T03:26:54.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.062+0000 7fbd25026700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd200b07a0 0x7fbd20154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.062+0000 7fbd25026700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd200b49e0 0x7fbd201534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.062+0000 7fbd25026700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd201595a0 0x7fbd20153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.062+0000 7fbd25026700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015ad30 con 0x7fbd200b07a0 2023-10-06T03:26:54.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.062+0000 7fbd25026700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20153f50 con 0x7fbd200b49e0 2023-10-06T03:26:54.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.062+0000 7fbd25026700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2014e0d0 con 0x7fbd201595a0 2023-10-06T03:26:54.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.062+0000 7fbd1ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd200b07a0 0x7fbd20154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd200b07a0 0x7fbd20154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41376/0 (socket says 172.21.15.84:41376) 2023-10-06T03:26:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1ed9d700 1 -- 172.21.15.84:0/2809052325 learned_addr learned my addr 172.21.15.84:0/2809052325 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1e59c700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd200b49e0 0x7fbd201534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1f59e700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd201595a0 0x7fbd20153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1ed9d700 1 -- 172.21.15.84:0/2809052325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd201595a0 msgr2=0x7fbd20153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1ed9d700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd201595a0 0x7fbd20153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1ed9d700 1 -- 172.21.15.84:0/2809052325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd200b49e0 msgr2=0x7fbd201534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1ed9d700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd200b49e0 0x7fbd201534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1ed9d700 1 -- 172.21.15.84:0/2809052325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10009ae0 con 0x7fbd200b07a0 2023-10-06T03:26:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1e59c700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd200b49e0 0x7fbd201534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:26:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd1ed9d700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd200b07a0 0x7fbd20154dc0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000b770 tx=0x7fbd10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd16ffd700 1 -- 172.21.15.84:0/2809052325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10012af0 con 0x7fbd200b07a0 2023-10-06T03:26:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd16ffd700 1 -- 172.21.15.84:0/2809052325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd10012c50 con 0x7fbd200b07a0 2023-10-06T03:26:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd16ffd700 1 -- 172.21.15.84:0/2809052325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1001d420 con 0x7fbd200b07a0 2023-10-06T03:26:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd25026700 1 -- 172.21.15.84:0/2809052325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2015b360 con 0x7fbd200b07a0 2023-10-06T03:26:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.063+0000 7fbd25026700 1 -- 172.21.15.84:0/2809052325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2015bc00 con 0x7fbd200b07a0 2023-10-06T03:26:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.064+0000 7fbd25026700 1 -- 172.21.15.84:0/2809052325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd20064ad0 con 0x7fbd200b07a0 2023-10-06T03:26:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.064+0000 7fbd16ffd700 1 -- 172.21.15.84:0/2809052325 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd1001d7f0 con 0x7fbd200b07a0 2023-10-06T03:26:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.065+0000 7fbd16ffd700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd00066f30 0x7fbd000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.065+0000 7fbd16ffd700 1 -- 172.21.15.84:0/2809052325 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbd10086000 con 0x7fbd200b07a0 2023-10-06T03:26:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.065+0000 7fbd1e59c700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd00066f30 0x7fbd000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.065+0000 7fbd1e59c700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd00066f30 0x7fbd000693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbd20154b60 tx=0x7fbd08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.069+0000 7fbd16ffd700 1 -- 172.21.15.84:0/2809052325 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd10052fd0 con 0x7fbd200b07a0 2023-10-06T03:26:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.293+0000 7fbd25026700 1 -- 172.21.15.84:0/2809052325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbd200b1820 con 0x7fbd200b07a0 2023-10-06T03:26:54.295 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:26:54.293+0000 7f573ff98700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:26:54.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.298+0000 7fbd16ffd700 1 -- 172.21.15.84:0/2809052325 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbd100565f0 con 0x7fbd200b07a0 2023-10-06T03:26:54.301 INFO:tasks.ceph.mds.b.smithi131.stderr: -606> 2023-10-06T03:26:45.455+0000 7fa792b98700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:26:54.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 -- 172.21.15.84:0/2809052325 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd00066f30 msgr2=0x7fbd000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:54.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd00066f30 0x7fbd000693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbd20154b60 tx=0x7fbd08008040 comp rx=0 tx=0).stop 2023-10-06T03:26:54.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 -- 172.21.15.84:0/2809052325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd200b07a0 msgr2=0x7fbd20154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:54.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd200b07a0 0x7fbd20154dc0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000b770 tx=0x7fbd10017000 comp rx=0 tx=0).stop 2023-10-06T03:26:54.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 -- 172.21.15.84:0/2809052325 shutdown_connections 2023-10-06T03:26:54.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbd00066f30 0x7fbd000693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd201595a0 0x7fbd20153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd200b07a0 0x7fbd20154dc0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 --2- 172.21.15.84:0/2809052325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd200b49e0 0x7fbd201534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 -- 172.21.15.84:0/2809052325 >> 172.21.15.84:0/2809052325 conn(0x7fbd20099830 msgr2=0x7fbd20069b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:54.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 -- 172.21.15.84:0/2809052325 shutdown_connections 2023-10-06T03:26:54.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.300+0000 7fbd25026700 1 -- 172.21.15.84:0/2809052325 wait complete. 2023-10-06T03:26:54.303 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:26:54.313 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:26:54.323 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:26:54.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.429+0000 7fe8284cc700 1 Processor -- start 2023-10-06T03:26:54.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.429+0000 7fe8284cc700 1 -- start start 2023-10-06T03:26:54.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.430+0000 7fe8284cc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe8200b2a90 0x7fe8200cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.430+0000 7fe8284cc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8200cb980 0x7fe8200ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.430+0000 7fe8284cc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8200cbdf0 con 0x7fe8200ced90 2023-10-06T03:26:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.430+0000 7fe8284cc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8200b2e60 con 0x7fe8200cb980 2023-10-06T03:26:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.430+0000 7fe8284cc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8200cf5d0 con 0x7fe8200b2a90 2023-10-06T03:26:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.430+0000 7fe825a67700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8200cb980 0x7fe8200ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.430+0000 7fe826a69700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe8200ced90 0x7fe8200c5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54306/0 (socket says 172.21.15.84:54306) 2023-10-06T03:26:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.430+0000 7fe825a67700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8200cb980 0x7fe8200ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41378/0 (socket says 172.21.15.84:41378) 2023-10-06T03:26:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.430+0000 7fe826a69700 1 -- 172.21.15.84:0/1760690308 learned_addr learned my addr 172.21.15.84:0/1760690308 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.430+0000 7fe826268700 1 --2- 172.21.15.84:0/1760690308 >> v2:172.21.15.131:3300/0 conn(0x7fe8200b2a90 0x7fe8200cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe825a67700 1 -- 172.21.15.84:0/1760690308 >> v2:172.21.15.131:3300/0 conn(0x7fe8200b2a90 msgr2=0x7fe8200cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe825a67700 1 --2- 172.21.15.84:0/1760690308 >> v2:172.21.15.131:3300/0 conn(0x7fe8200b2a90 0x7fe8200cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe825a67700 1 -- 172.21.15.84:0/1760690308 >> v1:172.21.15.84:6789/0 conn(0x7fe8200ced90 legacy=0x7fe8200c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:54.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe825266700 1 -- 172.21.15.84:0/1760690308 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039978452 0 0) 0x7fe8200cbdf0 con 0x7fe8200ced90 2023-10-06T03:26:54.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe825a67700 1 -- 172.21.15.84:0/1760690308 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8200cf8b0 con 0x7fe8200cb980 2023-10-06T03:26:54.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe825a67700 1 --2- 172.21.15.84:0/1760690308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200cb980 0x7fe8200ce850 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe8200888a0 tx=0x7fe8100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd574b6ba6d784c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:54.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe825266700 1 -- 172.21.15.84:0/1760690308 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81000b6b0 con 0x7fe8200cb980 2023-10-06T03:26:54.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe825266700 1 -- 172.21.15.84:0/1760690308 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81000b810 con 0x7fe8200cb980 2023-10-06T03:26:54.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe825266700 1 -- 172.21.15.84:0/1760690308 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81000bbb0 con 0x7fe8200cb980 2023-10-06T03:26:54.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe8284cc700 1 -- 172.21.15.84:0/1760690308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200cb980 msgr2=0x7fe8200ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:54.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe8284cc700 1 --2- 172.21.15.84:0/1760690308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200cb980 0x7fe8200ce850 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe8200888a0 tx=0x7fe8100091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe8284cc700 1 -- 172.21.15.84:0/1760690308 shutdown_connections 2023-10-06T03:26:54.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe8284cc700 1 --2- 172.21.15.84:0/1760690308 >> v2:172.21.15.131:3300/0 conn(0x7fe8200b2a90 0x7fe8200cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe8284cc700 1 --2- 172.21.15.84:0/1760690308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200cb980 0x7fe8200ce850 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe8284cc700 1 -- 172.21.15.84:0/1760690308 >> 172.21.15.84:0/1760690308 conn(0x7fe820099740 msgr2=0x7fe82006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:54.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.431+0000 7fe8284cc700 1 -- 172.21.15.84:0/1760690308 shutdown_connections 2023-10-06T03:26:54.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.432+0000 7fe8284cc700 1 -- 172.21.15.84:0/1760690308 wait complete. 2023-10-06T03:26:54.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe8284cc700 1 Processor -- start 2023-10-06T03:26:54.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe8284cc700 1 -- start start 2023-10-06T03:26:54.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe8284cc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200b2a90 0x7fe820169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe8284cc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8200cb980 0x7fe82016c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe8284cc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8200ced90 0x7fe8200c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe8284cc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8200c8a40 con 0x7fe8200b2a90 2023-10-06T03:26:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe8284cc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82015c590 con 0x7fe8200ced90 2023-10-06T03:26:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe8284cc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe820169f40 con 0x7fe8200cb980 2023-10-06T03:26:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe826268700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200b2a90 0x7fe820169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe826268700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200b2a90 0x7fe820169a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41388/0 (socket says 172.21.15.84:41388) 2023-10-06T03:26:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.433+0000 7fe826268700 1 -- 172.21.15.84:0/1468848068 learned_addr learned my addr 172.21.15.84:0/1468848068 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe826a69700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8200ced90 0x7fe8200c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe825a67700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8200cb980 0x7fe82016c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe826268700 1 -- 172.21.15.84:0/1468848068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8200cb980 msgr2=0x7fe82016c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe826268700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8200cb980 0x7fe82016c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe826268700 1 -- 172.21.15.84:0/1468848068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8200ced90 msgr2=0x7fe8200c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe826268700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8200ced90 0x7fe8200c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe826268700 1 -- 172.21.15.84:0/1468848068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe810009420 con 0x7fe8200b2a90 2023-10-06T03:26:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe825a67700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8200cb980 0x7fe82016c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe826268700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200b2a90 0x7fe820169a00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe81800d810 tx=0x7fe818008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe8167fc700 1 -- 172.21.15.84:0/1468848068 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180125f0 con 0x7fe8200b2a90 2023-10-06T03:26:54.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe8167fc700 1 -- 172.21.15.84:0/1468848068 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe818012750 con 0x7fe8200b2a90 2023-10-06T03:26:54.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe8284cc700 1 -- 172.21.15.84:0/1468848068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82015ddd0 con 0x7fe8200b2a90 2023-10-06T03:26:54.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe8167fc700 1 -- 172.21.15.84:0/1468848068 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818012af0 con 0x7fe8200b2a90 2023-10-06T03:26:54.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.434+0000 7fe8284cc700 1 -- 172.21.15.84:0/1468848068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82015bed0 con 0x7fe8200b2a90 2023-10-06T03:26:54.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.435+0000 7fe8284cc700 1 -- 172.21.15.84:0/1468848068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82015c800 con 0x7fe8200b2a90 2023-10-06T03:26:54.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.435+0000 7fe8167fc700 1 -- 172.21.15.84:0/1468848068 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe81801e460 con 0x7fe8200b2a90 2023-10-06T03:26:54.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.436+0000 7fe8167fc700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe804066f30 0x7fe8040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:54.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.436+0000 7fe8167fc700 1 -- 172.21.15.84:0/1468848068 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe818084de0 con 0x7fe8200b2a90 2023-10-06T03:26:54.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.436+0000 7fe825a67700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe804066f30 0x7fe8040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:54.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.436+0000 7fe825a67700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe804066f30 0x7fe8040693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe8100093f0 tx=0x7fe810017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:54.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.440+0000 7fe8167fc700 1 -- 172.21.15.84:0/1468848068 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe818051d60 con 0x7fe8200b2a90 2023-10-06T03:26:54.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:54.664+0000 7fe8284cc700 1 -- 172.21.15.84:0/1468848068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe82015bd30 con 0x7fe8200b2a90 2023-10-06T03:26:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.298+0000 7fe8167fc700 1 -- 172.21.15.84:0/1468848068 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe82015bd30 con 0x7fe8200b2a90 2023-10-06T03:26:55.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.300+0000 7fe8284cc700 1 -- 172.21.15.84:0/1468848068 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe804066f30 msgr2=0x7fe8040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.300+0000 7fe8284cc700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe804066f30 0x7fe8040693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe8100093f0 tx=0x7fe810017000 comp rx=0 tx=0).stop 2023-10-06T03:26:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.300+0000 7fe8284cc700 1 -- 172.21.15.84:0/1468848068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200b2a90 msgr2=0x7fe820169a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.300+0000 7fe8284cc700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200b2a90 0x7fe820169a00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe81800d810 tx=0x7fe818008040 comp rx=0 tx=0).stop 2023-10-06T03:26:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.301+0000 7fe8284cc700 1 -- 172.21.15.84:0/1468848068 shutdown_connections 2023-10-06T03:26:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.301+0000 7fe8284cc700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe804066f30 0x7fe8040693e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.301+0000 7fe8284cc700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8200ced90 0x7fe8200c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.301+0000 7fe8284cc700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8200b2a90 0x7fe820169a00 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.301+0000 7fe8284cc700 1 --2- 172.21.15.84:0/1468848068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8200cb980 0x7fe82016c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.301+0000 7fe8284cc700 1 -- 172.21.15.84:0/1468848068 >> 172.21.15.84:0/1468848068 conn(0x7fe820099740 msgr2=0x7fe820069780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.301+0000 7fe8284cc700 1 -- 172.21.15.84:0/1468848068 shutdown_connections 2023-10-06T03:26:55.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.301+0000 7fe8284cc700 1 -- 172.21.15.84:0/1468848068 wait complete. 2023-10-06T03:26:55.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:26:55.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.434+0000 7fe32d77c700 1 Processor -- start 2023-10-06T03:26:55.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.434+0000 7fe32d77c700 1 -- start start 2023-10-06T03:26:55.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.435+0000 7fe32d77c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe328153a20 0x7fe328068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:55.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.435+0000 7fe32d77c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe328068b40 0x7fe3280c8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:55.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.435+0000 7fe32d77c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3280c8960 0x7fe3280c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:55.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.435+0000 7fe32d77c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3280c9070 con 0x7fe3280c8960 2023-10-06T03:26:55.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.435+0000 7fe32d77c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32815df20 con 0x7fe328153a20 2023-10-06T03:26:55.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.435+0000 7fe32d77c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281599d0 con 0x7fe328068b40 2023-10-06T03:26:55.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.435+0000 7fe3277fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3280c8960 0x7fe3280c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.435+0000 7fe3277fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3280c8960 0x7fe3280c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41400/0 (socket says 172.21.15.84:41400) 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.435+0000 7fe3277fe700 1 -- 172.21.15.84:0/1926713900 learned_addr learned my addr 172.21.15.84:0/1926713900 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe31e7fc700 1 --2- 172.21.15.84:0/1926713900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe328068b40 0x7fe3280c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe326ffd700 1 --2- 172.21.15.84:0/1926713900 >> v2:172.21.15.131:3300/0 conn(0x7fe328153a20 0x7fe328068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe3277fe700 1 -- 172.21.15.84:0/1926713900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe328068b40 msgr2=0x7fe3280c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe3277fe700 1 --2- 172.21.15.84:0/1926713900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe328068b40 0x7fe3280c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe3277fe700 1 -- 172.21.15.84:0/1926713900 >> v2:172.21.15.131:3300/0 conn(0x7fe328153a20 msgr2=0x7fe328068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe3277fe700 1 --2- 172.21.15.84:0/1926713900 >> v2:172.21.15.131:3300/0 conn(0x7fe328153a20 0x7fe328068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe3277fe700 1 -- 172.21.15.84:0/1926713900 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328068fb0 con 0x7fe3280c8960 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe326ffd700 1 --2- 172.21.15.84:0/1926713900 >> v2:172.21.15.131:3300/0 conn(0x7fe328153a20 0x7fe328068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:55.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe3277fe700 1 --2- 172.21.15.84:0/1926713900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 0x7fe3280c5a70 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe32806f2b0 tx=0x7fe320009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2f2c9ed57bc3aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe3267fc700 1 -- 172.21.15.84:0/1926713900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000e070 con 0x7fe3280c8960 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe3267fc700 1 -- 172.21.15.84:0/1926713900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32000ba50 con 0x7fe3280c8960 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe3267fc700 1 -- 172.21.15.84:0/1926713900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3200092e0 con 0x7fe3280c8960 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe32d77c700 1 -- 172.21.15.84:0/1926713900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 msgr2=0x7fe3280c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe32d77c700 1 --2- 172.21.15.84:0/1926713900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 0x7fe3280c5a70 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe32806f2b0 tx=0x7fe320009840 comp rx=0 tx=0).stop 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe32d77c700 1 -- 172.21.15.84:0/1926713900 shutdown_connections 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe32d77c700 1 --2- 172.21.15.84:0/1926713900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 0x7fe3280c5a70 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe32d77c700 1 --2- 172.21.15.84:0/1926713900 >> v2:172.21.15.131:3300/0 conn(0x7fe328153a20 0x7fe328068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.436+0000 7fe32d77c700 1 --2- 172.21.15.84:0/1926713900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe328068b40 0x7fe3280c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.437+0000 7fe32d77c700 1 -- 172.21.15.84:0/1926713900 >> 172.21.15.84:0/1926713900 conn(0x7fe3280c9cd0 msgr2=0x7fe32806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.437+0000 7fe32d77c700 1 -- 172.21.15.84:0/1926713900 shutdown_connections 2023-10-06T03:26:55.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.437+0000 7fe32d77c700 1 -- 172.21.15.84:0/1926713900 wait complete. 2023-10-06T03:26:55.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.438+0000 7fe32d77c700 1 Processor -- start 2023-10-06T03:26:55.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.438+0000 7fe32d77c700 1 -- start start 2023-10-06T03:26:55.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe32d77c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe328068b40 0x7fe3281541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:55.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe32d77c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 0x7fe32814fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:55.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe32d77c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe328153a20 0x7fe3280cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:55.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe32d77c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe328151410 con 0x7fe3280c8960 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe32d77c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe328150730 con 0x7fe328153a20 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe32d77c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe328150a10 con 0x7fe328068b40 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 0x7fe32814fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 0x7fe32814fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41406/0 (socket says 172.21.15.84:41406) 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31e7fc700 1 -- 172.21.15.84:0/1403417280 learned_addr learned my addr 172.21.15.84:0/1403417280 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe3277fe700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe328153a20 0x7fe3280cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe326ffd700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe328068b40 0x7fe3281541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31e7fc700 1 -- 172.21.15.84:0/1403417280 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe328068b40 msgr2=0x7fe3281541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31e7fc700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe328068b40 0x7fe3281541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31e7fc700 1 -- 172.21.15.84:0/1403417280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe328153a20 msgr2=0x7fe3280cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:55.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31e7fc700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe328153a20 0x7fe3280cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31e7fc700 1 -- 172.21.15.84:0/1403417280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe320009ae0 con 0x7fe3280c8960 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31e7fc700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 0x7fe32814fd20 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fe31000d890 tx=0x7fe310008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31f7fe700 1 -- 172.21.15.84:0/1403417280 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31000b600 con 0x7fe3280c8960 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31f7fe700 1 -- 172.21.15.84:0/1403417280 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31000b760 con 0x7fe3280c8960 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe32d77c700 1 -- 172.21.15.84:0/1403417280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe328150cf0 con 0x7fe3280c8960 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe31f7fe700 1 -- 172.21.15.84:0/1403417280 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31000bae0 con 0x7fe3280c8960 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.439+0000 7fe32d77c700 1 -- 172.21.15.84:0/1403417280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32814f2c0 con 0x7fe3280c8960 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.440+0000 7fe32d77c700 1 -- 172.21.15.84:0/1403417280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe328151580 con 0x7fe3280c8960 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.441+0000 7fe31f7fe700 1 -- 172.21.15.84:0/1403417280 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe31001e460 con 0x7fe3280c8960 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.441+0000 7fe31f7fe700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe308066f30 0x7fe3080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:55.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.441+0000 7fe31f7fe700 1 -- 172.21.15.84:0/1403417280 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe310084ed0 con 0x7fe3280c8960 2023-10-06T03:26:55.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.441+0000 7fe326ffd700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe308066f30 0x7fe3080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:55.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.441+0000 7fe326ffd700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe308066f30 0x7fe3080693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe318006f00 tx=0x7fe318008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:55.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.445+0000 7fe31f7fe700 1 -- 172.21.15.84:0/1403417280 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe310051e50 con 0x7fe3280c8960 2023-10-06T03:26:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:55.629+0000 7fe32d77c700 1 -- 172.21.15.84:0/1403417280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe32805f270 con 0x7fe3280c8960 2023-10-06T03:26:56.303 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:26:56.305 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:26:56.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.400+0000 7fe31f7fe700 1 -- 172.21.15.84:0/1403417280 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe310055470 con 0x7fe3280c8960 2023-10-06T03:26:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 -- 172.21.15.84:0/1403417280 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe308066f30 msgr2=0x7fe3080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe308066f30 0x7fe3080693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe318006f00 tx=0x7fe318008040 comp rx=0 tx=0).stop 2023-10-06T03:26:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 -- 172.21.15.84:0/1403417280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 msgr2=0x7fe32814fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 0x7fe32814fd20 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fe31000d890 tx=0x7fe310008040 comp rx=0 tx=0).stop 2023-10-06T03:26:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 -- 172.21.15.84:0/1403417280 shutdown_connections 2023-10-06T03:26:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe308066f30 0x7fe3080693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe328153a20 0x7fe3280cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:56.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe328068b40 0x7fe3281541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:56.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 --2- 172.21.15.84:0/1403417280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3280c8960 0x7fe32814fd20 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:56.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 -- 172.21.15.84:0/1403417280 >> 172.21.15.84:0/1403417280 conn(0x7fe3280c9cd0 msgr2=0x7fe3280aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:56.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 -- 172.21.15.84:0/1403417280 shutdown_connections 2023-10-06T03:26:56.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.403+0000 7fe32d77c700 1 -- 172.21.15.84:0/1403417280 wait complete. 2023-10-06T03:26:56.406 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:26:56.419 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:26:56.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.535+0000 7fbc84374700 1 Processor -- start 2023-10-06T03:26:56.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.535+0000 7fbc84374700 1 -- start start 2023-10-06T03:26:56.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.536+0000 7fbc84374700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbc7c0d08f0 0x7fbc7c142a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:56.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.536+0000 7fbc84374700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c142f90 0x7fbc7c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:56.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.536+0000 7fbc84374700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c0b63b0 con 0x7fbc7c0d0520 2023-10-06T03:26:56.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.536+0000 7fbc84374700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c0b35f0 con 0x7fbc7c0d08f0 2023-10-06T03:26:56.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.536+0000 7fbc84374700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0b5500 con 0x7fbc7c142f90 2023-10-06T03:26:56.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.536+0000 7fbc8190f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbc7c0d08f0 0x7fbc7c142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:56.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.536+0000 7fbc82110700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbc7c0d0520 0x7fbc7c0b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54316/0 (socket says 172.21.15.84:54316) 2023-10-06T03:26:56.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.536+0000 7fbc82110700 1 -- 172.21.15.84:0/2559675317 learned_addr learned my addr 172.21.15.84:0/2559675317 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:56.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.536+0000 7fbc82911700 1 --2- 172.21.15.84:0/2559675317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c142f90 0x7fbc7c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:56.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc8190f700 1 -- 172.21.15.84:0/2559675317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c142f90 msgr2=0x7fbc7c0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:56.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc8190f700 1 --2- 172.21.15.84:0/2559675317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c142f90 0x7fbc7c0cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:56.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc8190f700 1 -- 172.21.15.84:0/2559675317 >> v1:172.21.15.84:6789/0 conn(0x7fbc7c0d0520 legacy=0x7fbc7c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:56.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc8190f700 1 -- 172.21.15.84:0/2559675317 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0b57a0 con 0x7fbc7c0d08f0 2023-10-06T03:26:56.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc82911700 1 --2- 172.21.15.84:0/2559675317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c142f90 0x7fbc7c0cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:56.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc8110e700 1 -- 172.21.15.84:0/2559675317 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743074979 0 0) 0x7fbc7c0b63b0 con 0x7fbc7c0d0520 2023-10-06T03:26:56.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc8190f700 1 --2- 172.21.15.84:0/2559675317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c0d08f0 0x7fbc7c142a50 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0098e0 tx=0x7fbc6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd70ce457c3683b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc8110e700 1 -- 172.21.15.84:0/2559675317 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c009e80 con 0x7fbc7c0d08f0 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc8110e700 1 -- 172.21.15.84:0/2559675317 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00b860 con 0x7fbc7c0d08f0 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc8110e700 1 -- 172.21.15.84:0/2559675317 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00bbe0 con 0x7fbc7c0d08f0 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc84374700 1 -- 172.21.15.84:0/2559675317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c0d08f0 msgr2=0x7fbc7c142a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc84374700 1 --2- 172.21.15.84:0/2559675317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c0d08f0 0x7fbc7c142a50 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0098e0 tx=0x7fbc6c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc84374700 1 -- 172.21.15.84:0/2559675317 shutdown_connections 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc84374700 1 --2- 172.21.15.84:0/2559675317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c142f90 0x7fbc7c0cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc84374700 1 --2- 172.21.15.84:0/2559675317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c0d08f0 0x7fbc7c142a50 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc84374700 1 -- 172.21.15.84:0/2559675317 >> 172.21.15.84:0/2559675317 conn(0x7fbc7c06ed20 msgr2=0x7fbc7c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.537+0000 7fbc84374700 1 -- 172.21.15.84:0/2559675317 shutdown_connections 2023-10-06T03:26:56.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.538+0000 7fbc84374700 1 -- 172.21.15.84:0/2559675317 wait complete. 2023-10-06T03:26:56.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc84374700 1 Processor -- start 2023-10-06T03:26:56.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc84374700 1 -- start start 2023-10-06T03:26:56.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc84374700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c0d0520 0x7fbc7c15af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc84374700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc7c0d08f0 0x7fbc7c0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc84374700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c142f90 0x7fbc7c0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc84374700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0cd690 con 0x7fbc7c142f90 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc84374700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c15b480 con 0x7fbc7c0d08f0 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc84374700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0cca80 con 0x7fbc7c0d0520 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc82911700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c142f90 0x7fbc7c0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc82911700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c142f90 0x7fbc7c0cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41434/0 (socket says 172.21.15.84:41434) 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.539+0000 7fbc82911700 1 -- 172.21.15.84:0/3375020168 learned_addr learned my addr 172.21.15.84:0/3375020168 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc8190f700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc7c0d08f0 0x7fbc7c0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc82110700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c0d0520 0x7fbc7c15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc82911700 1 -- 172.21.15.84:0/3375020168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c0d0520 msgr2=0x7fbc7c15af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc82911700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c0d0520 0x7fbc7c15af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc82911700 1 -- 172.21.15.84:0/3375020168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc7c0d08f0 msgr2=0x7fbc7c0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc82911700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc7c0d08f0 0x7fbc7c0c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc82911700 1 -- 172.21.15.84:0/3375020168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c009420 con 0x7fbc7c142f90 2023-10-06T03:26:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc82911700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c142f90 0x7fbc7c0cdb20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009fc0 tx=0x7fbc740099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc727fc700 1 -- 172.21.15.84:0/3375020168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400dbe0 con 0x7fbc7c142f90 2023-10-06T03:26:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc727fc700 1 -- 172.21.15.84:0/3375020168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400f040 con 0x7fbc7c142f90 2023-10-06T03:26:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc727fc700 1 -- 172.21.15.84:0/3375020168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74015440 con 0x7fbc7c142f90 2023-10-06T03:26:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc84374700 1 -- 172.21.15.84:0/3375020168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c0ccd60 con 0x7fbc7c142f90 2023-10-06T03:26:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.540+0000 7fbc84374700 1 -- 172.21.15.84:0/3375020168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c0cd320 con 0x7fbc7c142f90 2023-10-06T03:26:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.541+0000 7fbc84374700 1 -- 172.21.15.84:0/3375020168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c0cd800 con 0x7fbc7c142f90 2023-10-06T03:26:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.541+0000 7fbc727fc700 1 -- 172.21.15.84:0/3375020168 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc7401e3b0 con 0x7fbc7c142f90 2023-10-06T03:26:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.542+0000 7fbc727fc700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc60066f30 0x7fbc600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.542+0000 7fbc727fc700 1 -- 172.21.15.84:0/3375020168 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6026+0+0 (secure 0 0 0) 0x7fbc74084a50 con 0x7fbc7c142f90 2023-10-06T03:26:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.542+0000 7fbc82110700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc60066f30 0x7fbc600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.542+0000 7fbc82110700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc60066f30 0x7fbc600693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbc78007fd0 tx=0x7fbc78007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.546+0000 7fbc727fc700 1 -- 172.21.15.84:0/3375020168 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc74051b80 con 0x7fbc7c142f90 2023-10-06T03:26:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:56.731+0000 7fbc84374700 1 -- 172.21.15.84:0/3375020168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbc7c064ad0 con 0x7fbc7c142f90 2023-10-06T03:26:57.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.413+0000 7fbc727fc700 1 -- 172.21.15.84:0/3375020168 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbc7401a0d0 con 0x7fbc7c142f90 2023-10-06T03:26:57.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 -- 172.21.15.84:0/3375020168 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc60066f30 msgr2=0x7fbc600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc60066f30 0x7fbc600693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbc78007fd0 tx=0x7fbc78007d30 comp rx=0 tx=0).stop 2023-10-06T03:26:57.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 -- 172.21.15.84:0/3375020168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c142f90 msgr2=0x7fbc7c0cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c142f90 0x7fbc7c0cdb20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009fc0 tx=0x7fbc740099b0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 -- 172.21.15.84:0/3375020168 shutdown_connections 2023-10-06T03:26:57.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fbc60066f30 0x7fbc600693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc7c142f90 0x7fbc7c0cdb20 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc7c0d0520 0x7fbc7c15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 --2- 172.21.15.84:0/3375020168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc7c0d08f0 0x7fbc7c0c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 -- 172.21.15.84:0/3375020168 >> 172.21.15.84:0/3375020168 conn(0x7fbc7c06ed20 msgr2=0x7fbc7c13f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:57.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 -- 172.21.15.84:0/3375020168 shutdown_connections 2023-10-06T03:26:57.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.418+0000 7fbc84374700 1 -- 172.21.15.84:0/3375020168 wait complete. 2023-10-06T03:26:57.421 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T03:26:57.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:26:57.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.547+0000 7f5ac3fff700 1 Processor -- start 2023-10-06T03:26:57.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.547+0000 7f5ac3fff700 1 -- start start 2023-10-06T03:26:57.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.548+0000 7f5ac3fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ac40b2a30 0x7f5ac4164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.548+0000 7f5ac3fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac40cc9b0 con 0x7f5ac40b2660 2023-10-06T03:26:57.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.548+0000 7f5ac3fff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac40cbda0 con 0x7f5ac40cd400 2023-10-06T03:26:57.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.548+0000 7f5ac3fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac40cc080 con 0x7f5ac40b2a30 2023-10-06T03:26:57.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.548+0000 7f5ac2ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5ac40b2660 0x7f5ac40cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54330/0 (socket says 172.21.15.84:54330) 2023-10-06T03:26:57.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.548+0000 7f5ac2ffd700 1 -- 172.21.15.84:0/3835849970 learned_addr learned my addr 172.21.15.84:0/3835849970 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:57.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.548+0000 7f5ac37fe700 1 --2- 172.21.15.84:0/3835849970 >> v2:172.21.15.131:3300/0 conn(0x7f5ac40b2a30 0x7f5ac4164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.548+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789638973 0 0) 0x7f5ac40cc9b0 con 0x7f5ac40b2660 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.548+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ab0003570 con 0x7f5ac40b2660 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1709524441 0 0) 0x7f5ab0003570 con 0x7f5ac40b2660 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 >> v2:172.21.15.131:3300/0 conn(0x7f5ac40b2a30 msgr2=0x7f5ac4164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 --2- 172.21.15.84:0/3835849970 >> v2:172.21.15.131:3300/0 conn(0x7f5ac40b2a30 0x7f5ac4164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 >> v1:172.21.15.131:6789/0 conn(0x7f5ac40cd400 legacy=0x7f5ac40ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40cc360 con 0x7f5ac40b2660 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f5ab40015f0 con 0x7f5ac40b2660 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 >> v1:172.21.15.84:6789/0 conn(0x7f5ac40b2660 legacy=0x7f5ac40cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ab0003a60 0x7f5ab0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab0004810 0x7f5ab0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ab00051c0 0x7f5ab000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40cc080 con 0x7f5ab0004810 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab000c0d0 con 0x7f5ab0003a60 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab000c290 con 0x7f5ab00051c0 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5aba7fc700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab0004810 0x7f5ab0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac2ffd700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ab0003a60 0x7f5ab0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac37fe700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ab00051c0 0x7f5ab000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5aba7fc700 1 -- 172.21.15.84:0/3835849970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ab00051c0 msgr2=0x7f5ab000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5aba7fc700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ab00051c0 0x7f5ab000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5aba7fc700 1 -- 172.21.15.84:0/3835849970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ab0003a60 msgr2=0x7f5ab0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5aba7fc700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ab0003a60 0x7f5ab0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5aba7fc700 1 -- 172.21.15.84:0/3835849970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0003570 con 0x7f5ab0004810 2023-10-06T03:26:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac37fe700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ab00051c0 0x7f5ab000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac2ffd700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ab0003a60 0x7f5ab0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac37fe700 1 -- 172.21.15.84:0/3835849970 reap_dead start 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5aba7fc700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab0004810 0x7f5ab0004c80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5aac001880 tx=0x7f5aac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aaa87c978c7b9c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac012420 con 0x7f5ab0004810 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac0125a0 con 0x7f5ab0004810 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.549+0000 7f5ac27fc700 1 -- 172.21.15.84:0/3835849970 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac012960 con 0x7f5ab0004810 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.550+0000 7f5ac3fff700 1 -- 172.21.15.84:0/3835849970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab0004810 msgr2=0x7f5ab0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.550+0000 7f5ac3fff700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab0004810 0x7f5ab0004c80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5aac001880 tx=0x7f5aac007d30 comp rx=0 tx=0).stop 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.550+0000 7f5ac3fff700 1 -- 172.21.15.84:0/3835849970 shutdown_connections 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.550+0000 7f5ac3fff700 1 --2- 172.21.15.84:0/3835849970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab0004810 0x7f5ab0004c80 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.550+0000 7f5ac3fff700 1 -- 172.21.15.84:0/3835849970 >> 172.21.15.84:0/3835849970 conn(0x7f5ac4099560 msgr2=0x7f5ac406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:57.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.550+0000 7f5ac3fff700 1 -- 172.21.15.84:0/3835849970 shutdown_connections 2023-10-06T03:26:57.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.550+0000 7f5ac3fff700 1 -- 172.21.15.84:0/3835849970 wait complete. 2023-10-06T03:26:57.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.551+0000 7f5ac3fff700 1 Processor -- start 2023-10-06T03:26:57.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.551+0000 7f5ac3fff700 1 -- start start 2023-10-06T03:26:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5ac3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ab0004810 0x7f5ac4154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5ac3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac40c7880 0x7f5ac40b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5ac3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ac415a5c0 0x7f5ac415b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5ac3fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40b6150 con 0x7f5ac40c7880 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5ac3fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac415ab20 con 0x7f5ab0004810 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5ac3fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac415ae00 con 0x7f5ac415a5c0 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5aba7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac40c7880 0x7f5ac40b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5aba7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac40c7880 0x7f5ac40b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41456/0 (socket says 172.21.15.84:41456) 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5aba7fc700 1 -- 172.21.15.84:0/299743001 learned_addr learned my addr 172.21.15.84:0/299743001 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5ac37fe700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ac415a5c0 0x7f5ac415b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5ac2ffd700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ab0004810 0x7f5ac4154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5aba7fc700 1 -- 172.21.15.84:0/299743001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ac415a5c0 msgr2=0x7f5ac415b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5aba7fc700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ac415a5c0 0x7f5ac415b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5aba7fc700 1 -- 172.21.15.84:0/299743001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ab0004810 msgr2=0x7f5ac4154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5aba7fc700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ab0004810 0x7f5ac4154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5aba7fc700 1 -- 172.21.15.84:0/299743001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40b3170 con 0x7f5ac40c7880 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5aba7fc700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac40c7880 0x7f5ac40b5c10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c0a0 tx=0x7f5aac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.552+0000 7f5abb7fe700 1 -- 172.21.15.84:0/299743001 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac001200 con 0x7f5ac40c7880 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.553+0000 7f5abb7fe700 1 -- 172.21.15.84:0/299743001 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac012cd0 con 0x7f5ac40c7880 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.553+0000 7f5ac3fff700 1 -- 172.21.15.84:0/299743001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac40b3450 con 0x7f5ac40c7880 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.553+0000 7f5abb7fe700 1 -- 172.21.15.84:0/299743001 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac012960 con 0x7f5ac40c7880 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.553+0000 7f5ac3fff700 1 -- 172.21.15.84:0/299743001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac415ba80 con 0x7f5ac40c7880 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.554+0000 7f5ac3fff700 1 -- 172.21.15.84:0/299743001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac40b3aa0 con 0x7f5ac40c7880 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.554+0000 7f5abb7fe700 1 -- 172.21.15.84:0/299743001 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5aac019070 con 0x7f5ac40c7880 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.554+0000 7f5abb7fe700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5aa4066f30 0x7f5aa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.554+0000 7f5abb7fe700 1 -- 172.21.15.84:0/299743001 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f5aac085680 con 0x7f5ac40c7880 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.554+0000 7f5ac2ffd700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5aa4066f30 0x7f5aa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.555+0000 7f5ac2ffd700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5aa4066f30 0x7f5aa40693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4000ef0 tx=0x7f5ab4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:57.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.559+0000 7f5abb7fe700 1 -- 172.21.15.84:0/299743001 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5aac052950 con 0x7f5ac40c7880 2023-10-06T03:26:57.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.749+0000 7f5ac3fff700 1 -- 172.21.15.84:0/299743001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5ac405f270 con 0x7f5ac40c7880 2023-10-06T03:26:57.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.752+0000 7f5abb7fe700 1 -- 172.21.15.84:0/299743001 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5aac0170a0 con 0x7f5ac40c7880 2023-10-06T03:26:57.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 -- 172.21.15.84:0/299743001 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5aa4066f30 msgr2=0x7f5aa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5aa4066f30 0x7f5aa40693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4000ef0 tx=0x7f5ab4009040 comp rx=0 tx=0).stop 2023-10-06T03:26:57.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 -- 172.21.15.84:0/299743001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac40c7880 msgr2=0x7f5ac40b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac40c7880 0x7f5ac40b5c10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c0a0 tx=0x7f5aac015000 comp rx=0 tx=0).stop 2023-10-06T03:26:57.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 -- 172.21.15.84:0/299743001 shutdown_connections 2023-10-06T03:26:57.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5aa4066f30 0x7f5aa40693e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ab0004810 0x7f5ac4154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ac415a5c0 0x7f5ac415b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 --2- 172.21.15.84:0/299743001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac40c7880 0x7f5ac40b5c10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 -- 172.21.15.84:0/299743001 >> 172.21.15.84:0/299743001 conn(0x7f5ac4099560 msgr2=0x7f5ac4156660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:57.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 -- 172.21.15.84:0/299743001 shutdown_connections 2023-10-06T03:26:57.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.754+0000 7f5ac3fff700 1 -- 172.21.15.84:0/299743001 wait complete. 2023-10-06T03:26:57.768 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2023-10-06T03:26:57.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.880+0000 7f0011714700 1 Processor -- start 2023-10-06T03:26:57.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.880+0000 7f0011714700 1 -- start start 2023-10-06T03:26:57.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.881+0000 7f0011714700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0cbc70 0x7f000c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.881+0000 7f0011714700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0cb7e0 con 0x7f000c159480 2023-10-06T03:26:57.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.881+0000 7f0011714700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0b08a0 con 0x7f000c0b2140 2023-10-06T03:26:57.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.881+0000 7f0011714700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0cb190 con 0x7f000c0cbc70 2023-10-06T03:26:57.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.881+0000 7f000bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f000c159480 0x7f000c0b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54334/0 (socket says 172.21.15.84:54334) 2023-10-06T03:26:57.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.881+0000 7f000bfff700 1 -- 172.21.15.84:0/2278936044 learned_addr learned my addr 172.21.15.84:0/2278936044 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:57.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f0003fff700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0cbc70 0x7f000c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016110621 0 0) 0x7f000c0cb7e0 con 0x7f000c159480 2023-10-06T03:26:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff8003570 con 0x7f000c159480 2023-10-06T03:26:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492215937 0 0) 0x7f000c0b08a0 con 0x7f000c0b2140 2023-10-06T03:26:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f000c0cb7e0 con 0x7f000c0b2140 2023-10-06T03:26:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1280951652 0 0) 0x7efff8003570 con 0x7f000c159480 2023-10-06T03:26:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0cbc70 msgr2=0x7f000c0cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0cbc70 0x7f000c0cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 >> v1:172.21.15.131:6789/0 conn(0x7f000c0b2140 legacy=0x7f000c0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c0cb470 con 0x7f000c159480 2023-10-06T03:26:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7efffc001470 con 0x7f000c159480 2023-10-06T03:26:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 >> v1:172.21.15.84:6789/0 conn(0x7f000c159480 legacy=0x7f000c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8003c20 0x7efff8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0cbc70 0x7efff8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff8004d50 0x7efff80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0cb190 con 0x7efff8003c20 2023-10-06T03:26:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff800bb40 con 0x7efff8004d50 2023-10-06T03:26:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff800bd00 con 0x7f000c0cbc70 2023-10-06T03:26:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000bfff700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8003c20 0x7efff8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f0003fff700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0cbc70 0x7efff8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f0010f13700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff8004d50 0x7efff80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000bfff700 1 -- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0cbc70 msgr2=0x7efff8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000bfff700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0cbc70 0x7efff8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000bfff700 1 -- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff8004d50 msgr2=0x7efff80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000bfff700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff8004d50 0x7efff80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000bfff700 1 -- 172.21.15.84:0/2278936044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff8003570 con 0x7efff8003c20 2023-10-06T03:26:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f0003fff700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0cbc70 0x7efff8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.882+0000 7f000bfff700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8003c20 0x7efff8004010 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c2d0 tx=0x7efffc001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6669f275d1e5245 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.883+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00cba0 con 0x7efff8003c20 2023-10-06T03:26:57.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.883+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc00cd00 con 0x7efff8003c20 2023-10-06T03:26:57.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.883+0000 7f000b7fe700 1 -- 172.21.15.84:0/2278936044 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc005b70 con 0x7efff8003c20 2023-10-06T03:26:57.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.883+0000 7f0011714700 1 -- 172.21.15.84:0/2278936044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8003c20 msgr2=0x7efff8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.883+0000 7f0011714700 1 --2- 172.21.15.84:0/2278936044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8003c20 0x7efff8004010 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c2d0 tx=0x7efffc001e10 comp rx=0 tx=0).stop 2023-10-06T03:26:57.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.883+0000 7f0010f13700 1 -- 172.21.15.84:0/2278936044 reap_dead start 2023-10-06T03:26:57.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.883+0000 7f0011714700 1 -- 172.21.15.84:0/2278936044 shutdown_connections 2023-10-06T03:26:57.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.883+0000 7f0011714700 1 -- 172.21.15.84:0/2278936044 >> 172.21.15.84:0/2278936044 conn(0x7f000c06ed20 msgr2=0x7f000c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:57.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.883+0000 7f0011714700 1 -- 172.21.15.84:0/2278936044 shutdown_connections 2023-10-06T03:26:57.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.883+0000 7f0011714700 1 -- 172.21.15.84:0/2278936044 wait complete. 2023-10-06T03:26:57.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.884+0000 7f0011714700 1 Processor -- start 2023-10-06T03:26:57.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.884+0000 7f0011714700 1 -- start start 2023-10-06T03:26:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0011714700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff8003c20 0x7f000c1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0011714700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0c7310 0x7f000c0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0011714700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0c53b0 0x7f000c0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0011714700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0c5d70 con 0x7f000c0c53b0 2023-10-06T03:26:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0011714700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0c7d60 con 0x7efff8003c20 2023-10-06T03:26:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0011714700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0c8040 con 0x7f000c0c7310 2023-10-06T03:26:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0010f13700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0c53b0 0x7f000c0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0010f13700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0c53b0 0x7f000c0c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41478/0 (socket says 172.21.15.84:41478) 2023-10-06T03:26:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0010f13700 1 -- 172.21.15.84:0/451014334 learned_addr learned my addr 172.21.15.84:0/451014334 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f000bfff700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff8003c20 0x7f000c1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0003fff700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0c7310 0x7f000c0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0010f13700 1 -- 172.21.15.84:0/451014334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0c7310 msgr2=0x7f000c0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0010f13700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0c7310 0x7f000c0c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0010f13700 1 -- 172.21.15.84:0/451014334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff8003c20 msgr2=0x7f000c1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0010f13700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff8003c20 0x7f000c1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.885+0000 7f0010f13700 1 -- 172.21.15.84:0/451014334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c0c8320 con 0x7f000c0c53b0 2023-10-06T03:26:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.886+0000 7f0010f13700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0c53b0 0x7f000c0c5830 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0004000f80 tx=0x7f0004009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.886+0000 7f0008ff9700 1 -- 172.21.15.84:0/451014334 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004006db0 con 0x7f000c0c53b0 2023-10-06T03:26:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.886+0000 7f0008ff9700 1 -- 172.21.15.84:0/451014334 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0004003070 con 0x7f000c0c53b0 2023-10-06T03:26:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.886+0000 7f0008ff9700 1 -- 172.21.15.84:0/451014334 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004003430 con 0x7f000c0c53b0 2023-10-06T03:26:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.886+0000 7f0011714700 1 -- 172.21.15.84:0/451014334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c0c8600 con 0x7f000c0c53b0 2023-10-06T03:26:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.886+0000 7f0011714700 1 -- 172.21.15.84:0/451014334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c1557e0 con 0x7f000c0c53b0 2023-10-06T03:26:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.887+0000 7f0011714700 1 -- 172.21.15.84:0/451014334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000c0c8b20 con 0x7f000c0c53b0 2023-10-06T03:26:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.887+0000 7f0008ff9700 1 -- 172.21.15.84:0/451014334 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00040018f0 con 0x7f000c0c53b0 2023-10-06T03:26:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.887+0000 7f0008ff9700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7effec066f30 0x7effec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.888+0000 7f0008ff9700 1 -- 172.21.15.84:0/451014334 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f00040838d0 con 0x7f000c0c53b0 2023-10-06T03:26:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.888+0000 7f000bfff700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7effec066f30 0x7effec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.888+0000 7f000bfff700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7effec066f30 0x7effec0693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f000c15cd80 tx=0x7efffc015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:57.892+0000 7f0008ff9700 1 -- 172.21.15.84:0/451014334 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f000c0c8b20 con 0x7f000c0c53b0 2023-10-06T03:26:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.146+0000 7f0011714700 1 -- 172.21.15.84:0/451014334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) v1 -- 0x7f000c0c8b20 con 0x7f000c0c53b0 2023-10-06T03:26:58.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.412+0000 7f0008ff9700 1 -- 172.21.15.84:0/451014334 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v198) v1 ==== 145+0+0 (secure 0 0 0) 0x7f000c0c8b20 con 0x7f000c0c53b0 2023-10-06T03:26:58.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 -- 172.21.15.84:0/451014334 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7effec066f30 msgr2=0x7effec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:58.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7effec066f30 0x7effec0693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f000c15cd80 tx=0x7efffc015000 comp rx=0 tx=0).stop 2023-10-06T03:26:58.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 -- 172.21.15.84:0/451014334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0c53b0 msgr2=0x7f000c0c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:58.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0c53b0 0x7f000c0c5830 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0004000f80 tx=0x7f0004009040 comp rx=0 tx=0).stop 2023-10-06T03:26:58.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 -- 172.21.15.84:0/451014334 shutdown_connections 2023-10-06T03:26:58.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7effec066f30 0x7effec0693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:58.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff8003c20 0x7f000c1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:58.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0c53b0 0x7f000c0c5830 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:58.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 --2- 172.21.15.84:0/451014334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f000c0c7310 0x7f000c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:58.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 -- 172.21.15.84:0/451014334 >> 172.21.15.84:0/451014334 conn(0x7f000c06ed20 msgr2=0x7f000c0b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:58.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 -- 172.21.15.84:0/451014334 shutdown_connections 2023-10-06T03:26:58.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.414+0000 7f0011714700 1 -- 172.21.15.84:0/451014334 wait complete. 2023-10-06T03:26:58.428 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2023-10-06T03:26:58.428 INFO:tasks.cephfs_test_runner:Starting test: test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) That when many sessions are updated, they are correctly 2023-10-06T03:26:58.428 INFO:tasks.cephfs_test_runner:test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T03:26:58.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2023-10-06T03:26:58.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.541+0000 7f6ff0b8d700 1 Processor -- start 2023-10-06T03:26:58.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.541+0000 7f6ff0b8d700 1 -- start start 2023-10-06T03:26:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6ff0b8d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6fec1595a0 0x7f6fec0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6ff0b8d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fec0b07a0 0x7f6fec0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6ff0b8d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fec0b0ca0 con 0x7f6fec0b49e0 2023-10-06T03:26:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6ff0b8d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec0b0f80 con 0x7f6fec1595a0 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6ff0b8d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0b1260 con 0x7f6fec0b07a0 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6fe9d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6fec0b49e0 0x7f6fec0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54336/0 (socket says 172.21.15.84:54336) 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6fe9d9b700 1 -- 172.21.15.84:0/3446899671 learned_addr learned my addr 172.21.15.84:0/3446899671 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6fea59c700 1 --2- 172.21.15.84:0/3446899671 >> v2:172.21.15.131:3300/0 conn(0x7f6fec1595a0 0x7f6fec0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6fead9d700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fec0b07a0 0x7f6fec0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411874296 0 0) 0x7f6fec0b0ca0 con 0x7f6fec0b49e0 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.542+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd4003570 con 0x7f6fec0b49e0 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 954107778 0 0) 0x7f6fd4003570 con 0x7f6fec0b49e0 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fec0b07a0 msgr2=0x7f6fec0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fec0b07a0 0x7f6fec0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 >> v2:172.21.15.131:3300/0 conn(0x7f6fec1595a0 msgr2=0x7f6fec0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 --2- 172.21.15.84:0/3446899671 >> v2:172.21.15.131:3300/0 conn(0x7f6fec1595a0 0x7f6fec0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0b1540 con 0x7f6fec0b49e0 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f6fe0001470 con 0x7f6fec0b49e0 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 >> v1:172.21.15.84:6789/0 conn(0x7f6fec0b49e0 legacy=0x7f6fec0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd4003a60 0x7f6fd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fd4004810 0x7f6fd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 0x7f6fd400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0b0f80 con 0x7f6fd40051c0 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0b1260 con 0x7f6fd4003a60 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd400bfa0 con 0x7f6fd4004810 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fea59c700 1 --2- 172.21.15.84:0/3446899671 >> v2:172.21.15.131:3300/0 conn(0x7f6fec1595a0 0x7f6fec0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fead9d700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fec0b07a0 0x7f6fec0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe9d9b700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fd4004810 0x7f6fd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fead9d700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 0x7f6fd400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fea59c700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd4003a60 0x7f6fd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fead9d700 1 -- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fd4004810 msgr2=0x7f6fd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fead9d700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fd4004810 0x7f6fd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fead9d700 1 -- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd4003a60 msgr2=0x7f6fd4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fead9d700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd4003a60 0x7f6fd4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fead9d700 1 -- 172.21.15.84:0/3446899671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd4003570 con 0x7f6fd40051c0 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fead9d700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 0x7f6fd400ba60 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0b0b70 tx=0x7f6fe400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5b281dcde2b973 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.543+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400ea70 con 0x7f6fd40051c0 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.544+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe400f040 con 0x7f6fd40051c0 2023-10-06T03:26:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.544+0000 7f6fe959a700 1 -- 172.21.15.84:0/3446899671 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400ee00 con 0x7f6fd40051c0 2023-10-06T03:26:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.544+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/3446899671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 msgr2=0x7f6fd400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.544+0000 7f6ff0b8d700 1 --2- 172.21.15.84:0/3446899671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 0x7f6fd400ba60 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0b0b70 tx=0x7f6fe400b040 comp rx=0 tx=0).stop 2023-10-06T03:26:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.544+0000 7f6fead9d700 1 -- 172.21.15.84:0/3446899671 reap_dead start 2023-10-06T03:26:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.544+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/3446899671 shutdown_connections 2023-10-06T03:26:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.544+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/3446899671 >> 172.21.15.84:0/3446899671 conn(0x7f6fec099830 msgr2=0x7f6fec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.544+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/3446899671 shutdown_connections 2023-10-06T03:26:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.544+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/3446899671 wait complete. 2023-10-06T03:26:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.545+0000 7f6ff0b8d700 1 Processor -- start 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.545+0000 7f6ff0b8d700 1 -- start start 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6ff0b8d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 0x7f6fec168f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6ff0b8d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fec1694c0 0x7f6fec09d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6ff0b8d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fec09dac0 0x7f6fec0ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6ff0b8d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec09df30 con 0x7f6fd40051c0 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6ff0b8d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0ae190 con 0x7f6fec1694c0 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6ff0b8d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0ae470 con 0x7f6fec09dac0 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fea59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 0x7f6fec168f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fea59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 0x7f6fec168f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41500/0 (socket says 172.21.15.84:41500) 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fea59c700 1 -- 172.21.15.84:0/1626253439 learned_addr learned my addr 172.21.15.84:0/1626253439 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fead9d700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fec09dac0 0x7f6fec0ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fe9d9b700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fec1694c0 0x7f6fec09d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fea59c700 1 -- 172.21.15.84:0/1626253439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fec09dac0 msgr2=0x7f6fec0ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fea59c700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fec09dac0 0x7f6fec0ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fea59c700 1 -- 172.21.15.84:0/1626253439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fec1694c0 msgr2=0x7f6fec09d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fea59c700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fec1694c0 0x7f6fec09d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fea59c700 1 -- 172.21.15.84:0/1626253439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0ae750 con 0x7f6fd40051c0 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fe9d9b700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fec1694c0 0x7f6fec09d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.546+0000 7f6fea59c700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 0x7f6fec168f80 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc011d70 tx=0x7f6fdc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.547+0000 7f6fda7fc700 1 -- 172.21.15.84:0/1626253439 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc011e70 con 0x7f6fd40051c0 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.547+0000 7f6fda7fc700 1 -- 172.21.15.84:0/1626253439 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc00fcd0 con 0x7f6fd40051c0 2023-10-06T03:26:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.547+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/1626253439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec0aea30 con 0x7f6fd40051c0 2023-10-06T03:26:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.547+0000 7f6fda7fc700 1 -- 172.21.15.84:0/1626253439 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc01d6b0 con 0x7f6fd40051c0 2023-10-06T03:26:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.547+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/1626253439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec0adc20 con 0x7f6fd40051c0 2023-10-06T03:26:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.547+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/1626253439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec169ad0 con 0x7f6fd40051c0 2023-10-06T03:26:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.548+0000 7f6fda7fc700 1 -- 172.21.15.84:0/1626253439 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fdc01daa0 con 0x7f6fd40051c0 2023-10-06T03:26:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.548+0000 7f6fda7fc700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6fcc066f30 0x7f6fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.548+0000 7f6fda7fc700 1 -- 172.21.15.84:0/1626253439 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f6fdc018070 con 0x7f6fd40051c0 2023-10-06T03:26:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.548+0000 7f6fe9d9b700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6fcc066f30 0x7f6fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.549+0000 7f6fe9d9b700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6fcc066f30 0x7f6fcc0693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0001ce0 tx=0x7f6fe0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.552+0000 7f6fda7fc700 1 -- 172.21.15.84:0/1626253439 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fdc0525b0 con 0x7f6fd40051c0 2023-10-06T03:26:58.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:58.808+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/1626253439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) v1 -- 0x7f6fec0adf00 con 0x7f6fd40051c0 2023-10-06T03:26:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.415+0000 7f6fda7fc700 1 -- 172.21.15.84:0/1626253439 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v199) v1 ==== 148+0+0 (secure 0 0 0) 0x7f6fdc055bd0 con 0x7f6fd40051c0 2023-10-06T03:26:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/1626253439 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6fcc066f30 msgr2=0x7f6fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6fcc066f30 0x7f6fcc0693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0001ce0 tx=0x7f6fe0009040 comp rx=0 tx=0).stop 2023-10-06T03:26:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/1626253439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 msgr2=0x7f6fec168f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 0x7f6fec168f80 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc011d70 tx=0x7f6fdc009120 comp rx=0 tx=0).stop 2023-10-06T03:26:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/1626253439 shutdown_connections 2023-10-06T03:26:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6fcc066f30 0x7f6fcc0693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fec09dac0 0x7f6fec0ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd40051c0 0x7f6fec168f80 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 --2- 172.21.15.84:0/1626253439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fec1694c0 0x7f6fec09d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/1626253439 >> 172.21.15.84:0/1626253439 conn(0x7f6fec099830 msgr2=0x7f6fec068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/1626253439 shutdown_connections 2023-10-06T03:26:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.418+0000 7f6ff0b8d700 1 -- 172.21.15.84:0/1626253439 wait complete. 2023-10-06T03:26:59.432 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:26:59.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.551+0000 7f6facead700 1 Processor -- start 2023-10-06T03:26:59.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.551+0000 7f6facead700 1 -- start start 2023-10-06T03:26:59.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.552+0000 7f6facead700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6fa8159570 0x7f6fa8069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.552+0000 7f6facead700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 0x7f6fa8155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.552+0000 7f6facead700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa806f080 con 0x7f6fa81558e0 2023-10-06T03:26:59.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.552+0000 7f6facead700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa806a7b0 con 0x7f6fa8159570 2023-10-06T03:26:59.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.552+0000 7f6facead700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8159ae0 con 0x7f6fa806a330 2023-10-06T03:26:59.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.552+0000 7f6fa6d9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 0x7f6fa8155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.552+0000 7f6fa5d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6fa8159570 0x7f6fa8069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.552+0000 7f6fa659c700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6fa81558e0 0x7f6fa806b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:49314/0 (socket says 172.21.15.84:49314) 2023-10-06T03:26:59.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.552+0000 7f6fa659c700 1 -- 172.21.15.84:0/3319830545 learned_addr learned my addr 172.21.15.84:0/3319830545 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:59.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6fa5d9b700 1 -- 172.21.15.84:0/3319830545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 msgr2=0x7f6fa8155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:59.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6fa5d9b700 1 --2- 172.21.15.84:0/3319830545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 0x7f6fa8155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6fa5d9b700 1 -- 172.21.15.84:0/3319830545 >> v1:172.21.15.131:6789/0 conn(0x7f6fa81558e0 legacy=0x7f6fa806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6fa5d9b700 1 -- 172.21.15.84:0/3319830545 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa8159dc0 con 0x7f6fa8159570 2023-10-06T03:26:59.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6fa6d9d700 1 --2- 172.21.15.84:0/3319830545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 0x7f6fa8155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:26:59.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6fa5d9b700 1 --2- 172.21.15.84:0/3319830545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa8159570 0x7f6fa8069df0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009910 tx=0x7f6f9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=156bd89c6106945 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:59.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6fa559a700 1 -- 172.21.15.84:0/3319830545 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00b640 con 0x7f6fa8159570 2023-10-06T03:26:59.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6fa559a700 1 -- 172.21.15.84:0/3319830545 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c00b7a0 con 0x7f6fa8159570 2023-10-06T03:26:59.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6fa559a700 1 -- 172.21.15.84:0/3319830545 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00bb60 con 0x7f6fa8159570 2023-10-06T03:26:59.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6facead700 1 -- 172.21.15.84:0/3319830545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa8159570 msgr2=0x7f6fa8069df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.553+0000 7f6facead700 1 --2- 172.21.15.84:0/3319830545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa8159570 0x7f6fa8069df0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009910 tx=0x7f6f9c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.554+0000 7f6facead700 1 -- 172.21.15.84:0/3319830545 shutdown_connections 2023-10-06T03:26:59.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.554+0000 7f6facead700 1 --2- 172.21.15.84:0/3319830545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 0x7f6fa8155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.554+0000 7f6facead700 1 --2- 172.21.15.84:0/3319830545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa8159570 0x7f6fa8069df0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.554+0000 7f6facead700 1 -- 172.21.15.84:0/3319830545 >> 172.21.15.84:0/3319830545 conn(0x7f6fa80cc0e0 msgr2=0x7f6fa80cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:59.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.554+0000 7f6facead700 1 -- 172.21.15.84:0/3319830545 shutdown_connections 2023-10-06T03:26:59.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.554+0000 7f6facead700 1 -- 172.21.15.84:0/3319830545 wait complete. 2023-10-06T03:26:59.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.555+0000 7f6facead700 1 Processor -- start 2023-10-06T03:26:59.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.555+0000 7f6facead700 1 -- start start 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.555+0000 7f6facead700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 0x7f6fa8141720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.555+0000 7f6facead700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa81558e0 0x7f6fa80b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.555+0000 7f6facead700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa8159570 0x7f6fa8157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.555+0000 7f6facead700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80c6070 con 0x7f6fa81558e0 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.555+0000 7f6facead700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80c5be0 con 0x7f6fa8159570 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.555+0000 7f6facead700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80c4fd0 con 0x7f6fa806a330 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.555+0000 7f6fa5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa81558e0 0x7f6fa80b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6fa5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa81558e0 0x7f6fa80b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41508/0 (socket says 172.21.15.84:41508) 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6fa5d9b700 1 -- 172.21.15.84:0/2691995145 learned_addr learned my addr 172.21.15.84:0/2691995145 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6fa6d9d700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa8159570 0x7f6fa8157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6fa659c700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 0x7f6fa8141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6fa5d9b700 1 -- 172.21.15.84:0/2691995145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 msgr2=0x7f6fa8141720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6fa5d9b700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 0x7f6fa8141720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6fa5d9b700 1 -- 172.21.15.84:0/2691995145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa8159570 msgr2=0x7f6fa8157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6fa5d9b700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa8159570 0x7f6fa8157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6fa5d9b700 1 -- 172.21.15.84:0/2691995145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98009420 con 0x7f6fa81558e0 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6fa5d9b700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa81558e0 0x7f6fa80b08a0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c013000 tx=0x7f6f9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6f967fc700 1 -- 172.21.15.84:0/2691995145 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c01f070 con 0x7f6fa81558e0 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6f967fc700 1 -- 172.21.15.84:0/2691995145 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c00bb20 con 0x7f6fa81558e0 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6facead700 1 -- 172.21.15.84:0/2691995145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c009420 con 0x7f6fa81558e0 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6f967fc700 1 -- 172.21.15.84:0/2691995145 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c011650 con 0x7f6fa81558e0 2023-10-06T03:26:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.556+0000 7f6facead700 1 -- 172.21.15.84:0/2691995145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa80c5590 con 0x7f6fa81558e0 2023-10-06T03:26:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.557+0000 7f6facead700 1 -- 172.21.15.84:0/2691995145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa80c5d90 con 0x7f6fa81558e0 2023-10-06T03:26:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.557+0000 7f6f967fc700 1 -- 172.21.15.84:0/2691995145 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f9c011a40 con 0x7f6fa81558e0 2023-10-06T03:26:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.558+0000 7f6f967fc700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6f88066f30 0x7f6f880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.558+0000 7f6f967fc700 1 -- 172.21.15.84:0/2691995145 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f6f9c085800 con 0x7f6fa81558e0 2023-10-06T03:26:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.558+0000 7f6fa659c700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6f88066f30 0x7f6f880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.558+0000 7f6fa659c700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6f88066f30 0x7f6f880693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6fa814ab10 tx=0x7f6fa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.562+0000 7f6f967fc700 1 -- 172.21.15.84:0/2691995145 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fa80c5d90 con 0x7f6fa81558e0 2023-10-06T03:26:59.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.743+0000 7f6facead700 1 -- 172.21.15.84:0/2691995145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6fa80c5d50 con 0x7f6fa81558e0 2023-10-06T03:26:59.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.747+0000 7f6f967fc700 1 -- 172.21.15.84:0/2691995145 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f9c052ad0 con 0x7f6fa81558e0 2023-10-06T03:26:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 -- 172.21.15.84:0/2691995145 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6f88066f30 msgr2=0x7f6f880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6f88066f30 0x7f6f880693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6fa814ab10 tx=0x7f6fa0009040 comp rx=0 tx=0).stop 2023-10-06T03:26:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 -- 172.21.15.84:0/2691995145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa81558e0 msgr2=0x7f6fa80b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa81558e0 0x7f6fa80b08a0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c013000 tx=0x7f6f9c017000 comp rx=0 tx=0).stop 2023-10-06T03:26:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 -- 172.21.15.84:0/2691995145 shutdown_connections 2023-10-06T03:26:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6f88066f30 0x7f6f880693e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa8159570 0x7f6fa8157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa806a330 0x7f6fa8141720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 --2- 172.21.15.84:0/2691995145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa81558e0 0x7f6fa80b08a0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 -- 172.21.15.84:0/2691995145 >> 172.21.15.84:0/2691995145 conn(0x7f6fa80cc0e0 msgr2=0x7f6fa806b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:59.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 -- 172.21.15.84:0/2691995145 shutdown_connections 2023-10-06T03:26:59.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.749+0000 7f6facead700 1 -- 172.21.15.84:0/2691995145 wait complete. 2023-10-06T03:26:59.763 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:26:59.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:26:59.809 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:26:59.849 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:26:59.850 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:26:59.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:26:59.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.963+0000 7efdf09a7700 1 Processor -- start 2023-10-06T03:26:59.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.963+0000 7efdf09a7700 1 -- start start 2023-10-06T03:26:59.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.964+0000 7efdf09a7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdec159480 0x7efdec0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.964+0000 7efdf09a7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec0cb7e0 con 0x7efdec0b3610 2023-10-06T03:26:59.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.964+0000 7efdf09a7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec0b08a0 con 0x7efdec0b2140 2023-10-06T03:26:59.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.964+0000 7efdf09a7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0cb190 con 0x7efdec159480 2023-10-06T03:26:59.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.964+0000 7efdeaffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efdec0b3610 0x7efdec0cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54340/0 (socket says 172.21.15.84:54340) 2023-10-06T03:26:59.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.964+0000 7efdeaffd700 1 -- 172.21.15.84:0/2100359571 learned_addr learned my addr 172.21.15.84:0/2100359571 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:26:59.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.964+0000 7efdeb7fe700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdec159480 0x7efdec0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.964+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975545989 0 0) 0x7efdec0cb7e0 con 0x7efdec0b3610 2023-10-06T03:26:59.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.964+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd4003570 con 0x7efdec0b3610 2023-10-06T03:26:59.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1128266779 0 0) 0x7efdd4003570 con 0x7efdec0b3610 2023-10-06T03:26:59.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdec159480 msgr2=0x7efdec0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:59.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdec159480 0x7efdec0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 >> v1:172.21.15.131:6789/0 conn(0x7efdec0b2140 legacy=0x7efdec0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0cb470 con 0x7efdec0b3610 2023-10-06T03:26:59.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7efde0001470 con 0x7efdec0b3610 2023-10-06T03:26:59.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 >> v1:172.21.15.84:6789/0 conn(0x7efdec0b3610 legacy=0x7efdec0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd4003a90 0x7efdd4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4004810 0x7efdd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdec159480 0x7efdd4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0cb190 con 0x7efdd4003a90 2023-10-06T03:26:59.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd400bb90 con 0x7efdd4004810 2023-10-06T03:26:59.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd400bd50 con 0x7efdec159480 2023-10-06T03:26:59.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdeb7fe700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd4003a90 0x7efdd4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdeaffd700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4004810 0x7efdd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdebfff700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdec159480 0x7efdd4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdeb7fe700 1 -- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdec159480 msgr2=0x7efdd4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:59.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdeb7fe700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdec159480 0x7efdd4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdeb7fe700 1 -- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4004810 msgr2=0x7efdd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:26:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdeb7fe700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4004810 0x7efdd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdeb7fe700 1 -- 172.21.15.84:0/2100359571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd4003570 con 0x7efdd4003a90 2023-10-06T03:26:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdeaffd700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4004810 0x7efdd4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdebfff700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdec159480 0x7efdd4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdeb7fe700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd4003a90 0x7efdd4003e60 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7efddc00e210 tx=0x7efddc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baeea682a833f7ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc00eac0 con 0x7efdd4003a90 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc00f040 con 0x7efdd4003a90 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.965+0000 7efdea7fc700 1 -- 172.21.15.84:0/2100359571 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc00ee70 con 0x7efdd4003a90 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.966+0000 7efdf09a7700 1 -- 172.21.15.84:0/2100359571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd4003a90 msgr2=0x7efdd4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.966+0000 7efdf09a7700 1 --2- 172.21.15.84:0/2100359571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd4003a90 0x7efdd4003e60 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7efddc00e210 tx=0x7efddc00b040 comp rx=0 tx=0).stop 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.966+0000 7efdebfff700 1 -- 172.21.15.84:0/2100359571 reap_dead start 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.966+0000 7efdf09a7700 1 -- 172.21.15.84:0/2100359571 shutdown_connections 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.966+0000 7efdf09a7700 1 -- 172.21.15.84:0/2100359571 >> 172.21.15.84:0/2100359571 conn(0x7efdec06ed20 msgr2=0x7efdec06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.966+0000 7efdf09a7700 1 -- 172.21.15.84:0/2100359571 shutdown_connections 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.966+0000 7efdf09a7700 1 -- 172.21.15.84:0/2100359571 wait complete. 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.967+0000 7efdf09a7700 1 Processor -- start 2023-10-06T03:26:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.967+0000 7efdf09a7700 1 -- start start 2023-10-06T03:26:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdf09a7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdd4003a90 0x7efdec169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdf09a7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0c4840 0x7efdec0c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdf09a7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdec0c6750 0x7efdec0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdf09a7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0c7100 con 0x7efdec0c6750 2023-10-06T03:26:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdf09a7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0c8860 con 0x7efdec0c4840 2023-10-06T03:26:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdf09a7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0c8ab0 con 0x7efdd4003a90 2023-10-06T03:26:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdebfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdec0c6750 0x7efdec0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdebfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdec0c6750 0x7efdec0c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41526/0 (socket says 172.21.15.84:41526) 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdebfff700 1 -- 172.21.15.84:0/1749820245 learned_addr learned my addr 172.21.15.84:0/1749820245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdeb7fe700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdd4003a90 0x7efdec169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdeaffd700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0c4840 0x7efdec0c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdebfff700 1 -- 172.21.15.84:0/1749820245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdd4003a90 msgr2=0x7efdec169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdebfff700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdd4003a90 0x7efdec169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdebfff700 1 -- 172.21.15.84:0/1749820245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0c4840 msgr2=0x7efdec0c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdebfff700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0c4840 0x7efdec0c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdebfff700 1 -- 172.21.15.84:0/1749820245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0c8d90 con 0x7efdec0c6750 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdeb7fe700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdd4003a90 0x7efdec169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdeaffd700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0c4840 0x7efdec0c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:26:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdebfff700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdec0c6750 0x7efdec0c6bc0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7efde40010e0 tx=0x7efde4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdd37fe700 1 -- 172.21.15.84:0/1749820245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400ee60 con 0x7efdec0c6750 2023-10-06T03:26:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.968+0000 7efdd37fe700 1 -- 172.21.15.84:0/1749820245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4006820 con 0x7efdec0c6750 2023-10-06T03:26:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.969+0000 7efdf09a7700 1 -- 172.21.15.84:0/1749820245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec0c9070 con 0x7efdec0c6750 2023-10-06T03:26:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.969+0000 7efdd37fe700 1 -- 172.21.15.84:0/1749820245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4006be0 con 0x7efdec0c6750 2023-10-06T03:26:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.969+0000 7efdf09a7700 1 -- 172.21.15.84:0/1749820245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec0c9630 con 0x7efdec0c6750 2023-10-06T03:26:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.970+0000 7efdf09a7700 1 -- 172.21.15.84:0/1749820245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec0c9820 con 0x7efdec0c6750 2023-10-06T03:26:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.970+0000 7efdd37fe700 1 -- 172.21.15.84:0/1749820245 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efde4007030 con 0x7efdec0c6750 2023-10-06T03:26:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.970+0000 7efdd37fe700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efdd8066fb0 0x7efdd8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:26:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.971+0000 7efdd37fe700 1 -- 172.21.15.84:0/1749820245 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5612+0+0 (secure 0 0 0) 0x7efde4083620 con 0x7efdec0c6750 2023-10-06T03:26:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.971+0000 7efdeb7fe700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efdd8066fb0 0x7efdd8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:26:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.971+0000 7efdeb7fe700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efdd8066fb0 0x7efdd8069460 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efddc00afd0 tx=0x7efddc01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:26:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:26:59.975+0000 7efdd37fe700 1 -- 172.21.15.84:0/1749820245 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efde4050850 con 0x7efdec0c6750 2023-10-06T03:27:00.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.198+0000 7efdf09a7700 1 -- 172.21.15.84:0/1749820245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdec05f270 con 0x7efdec0c6750 2023-10-06T03:27:00.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.198+0000 7efdd37fe700 1 -- 172.21.15.84:0/1749820245 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+3532 (secure 0 0 0) 0x7efde4019090 con 0x7efdec0c6750 2023-10-06T03:27:00.201 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:00.201 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3968412983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3968412983},{"type":"v1","addr":"172.21.15.131:6835","nonce":3968412983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3563307477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3563307477},{"type":"v1","addr":"172.21.15.84:6837","nonce":3563307477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":5923,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1010130826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1010130826},{"type":"v1","addr":"172.21.15.131:6834","nonce":1010130826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/569291567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":569291567},{"type":"v1","addr":"172.21.15.84:6836","nonce":569291567}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2023-10-06T03:27:00.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 -- 172.21.15.84:0/1749820245 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efdd8066fb0 msgr2=0x7efdd8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efdd8066fb0 0x7efdd8069460 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efddc00afd0 tx=0x7efddc01a000 comp rx=0 tx=0).stop 2023-10-06T03:27:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 -- 172.21.15.84:0/1749820245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdec0c6750 msgr2=0x7efdec0c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdec0c6750 0x7efdec0c6bc0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7efde40010e0 tx=0x7efde4009040 comp rx=0 tx=0).stop 2023-10-06T03:27:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 -- 172.21.15.84:0/1749820245 shutdown_connections 2023-10-06T03:27:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7efdd8066fb0 0x7efdd8069460 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdec0c6750 0x7efdec0c6bc0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdd4003a90 0x7efdec169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 --2- 172.21.15.84:0/1749820245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0c4840 0x7efdec0c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 -- 172.21.15.84:0/1749820245 >> 172.21.15.84:0/1749820245 conn(0x7efdec06ed20 msgr2=0x7efdec0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:00.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 -- 172.21.15.84:0/1749820245 shutdown_connections 2023-10-06T03:27:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.200+0000 7efdf09a7700 1 -- 172.21.15.84:0/1749820245 wait complete. 2023-10-06T03:27:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 48 2023-10-06T03:27:00.214 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:27:00.214 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:27:00.214 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:27:00.214 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:27:00.214 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:27:00.215 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:27:00.215 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:27:00.215 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:27:00.215 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:27:00.215 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:27:00.215 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:27:00.215 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:27:00.216 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:27:00.216 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:27:00.216 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:27:00.216 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:27:00.223 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:27:00.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:27:00.225 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:27:00.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:27:00.231 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:27:00.231 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:27:00.232 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:27:00.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:27:00.268 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:27:00.268 DEBUG:teuthology.parallel:result is None 2023-10-06T03:27:00.275 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:27:00.275 DEBUG:teuthology.parallel:result is None 2023-10-06T03:27:00.277 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:27:00.277 DEBUG:teuthology.parallel:result is None 2023-10-06T03:27:00.278 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:27:00.279 DEBUG:teuthology.parallel:result is None 2023-10-06T03:27:00.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:27:00.342 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:27:00.345 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:27:00.356 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:27:00.357 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:27:00.359 INFO:tasks.ceph.mds.d.smithi131.stderr:2023-10-06T03:27:00.355+0000 7fdb4166a700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-06T03:27:00.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.408+0000 7faae2e6d700 1 Processor -- start 2023-10-06T03:27:00.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.408+0000 7faae2e6d700 1 -- start start 2023-10-06T03:27:00.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae2e6d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faadc0cbc70 0x7faadc0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae2e6d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faadc0b2140 0x7faadc0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae2e6d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc0cb7e0 con 0x7faadc159480 2023-10-06T03:27:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae2e6d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0b08a0 con 0x7faadc0cbc70 2023-10-06T03:27:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae2e6d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0cb190 con 0x7faadc0b2140 2023-10-06T03:27:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae166a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faadc0cbc70 0x7faadc0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae1e6b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faadc159480 0x7faadc0b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54368/0 (socket says 172.21.15.84:54368) 2023-10-06T03:27:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae1e6b700 1 -- 172.21.15.84:0/876310627 learned_addr learned my addr 172.21.15.84:0/876310627 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae166a700 1 -- 172.21.15.84:0/876310627 >> v2:172.21.15.131:3300/0 conn(0x7faadc0b2140 msgr2=0x7faadc0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae266c700 1 --2- 172.21.15.84:0/876310627 >> v2:172.21.15.131:3300/0 conn(0x7faadc0b2140 0x7faadc0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae166a700 1 --2- 172.21.15.84:0/876310627 >> v2:172.21.15.131:3300/0 conn(0x7faadc0b2140 0x7faadc0b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae0e69700 1 -- 172.21.15.84:0/876310627 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434188233 0 0) 0x7faadc0cb7e0 con 0x7faadc159480 2023-10-06T03:27:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae166a700 1 -- 172.21.15.84:0/876310627 >> v1:172.21.15.84:6789/0 conn(0x7faadc159480 legacy=0x7faadc0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.409+0000 7faae166a700 1 -- 172.21.15.84:0/876310627 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0cb470 con 0x7faadc0cbc70 2023-10-06T03:27:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae166a700 1 --2- 172.21.15.84:0/876310627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc0cbc70 0x7faadc0cc0c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7faadc0ca830 tx=0x7faacc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9362923e0b8af4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae0e69700 1 -- 172.21.15.84:0/876310627 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc00b6b0 con 0x7faadc0cbc70 2023-10-06T03:27:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae0e69700 1 -- 172.21.15.84:0/876310627 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc00b810 con 0x7faadc0cbc70 2023-10-06T03:27:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae0e69700 1 -- 172.21.15.84:0/876310627 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc00bbb0 con 0x7faadc0cbc70 2023-10-06T03:27:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae2e6d700 1 -- 172.21.15.84:0/876310627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc0cbc70 msgr2=0x7faadc0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae2e6d700 1 --2- 172.21.15.84:0/876310627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc0cbc70 0x7faadc0cc0c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7faadc0ca830 tx=0x7faacc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae2e6d700 1 -- 172.21.15.84:0/876310627 shutdown_connections 2023-10-06T03:27:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae2e6d700 1 --2- 172.21.15.84:0/876310627 >> v2:172.21.15.131:3300/0 conn(0x7faadc0b2140 0x7faadc0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae2e6d700 1 --2- 172.21.15.84:0/876310627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc0cbc70 0x7faadc0cc0c0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae2e6d700 1 -- 172.21.15.84:0/876310627 >> 172.21.15.84:0/876310627 conn(0x7faadc06ed20 msgr2=0x7faadc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae2e6d700 1 -- 172.21.15.84:0/876310627 shutdown_connections 2023-10-06T03:27:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.410+0000 7faae2e6d700 1 -- 172.21.15.84:0/876310627 wait complete. 2023-10-06T03:27:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.411+0000 7faae2e6d700 1 Processor -- start 2023-10-06T03:27:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.411+0000 7faae2e6d700 1 -- start start 2023-10-06T03:27:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae2e6d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc0b2140 0x7faadc0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae2e6d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faadc0cbc70 0x7faadc159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae2e6d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc159480 0x7faadc1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:00.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae2e6d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0c7310 con 0x7faadc159480 2023-10-06T03:27:00.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae2e6d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0c75b0 con 0x7faadc0b2140 2023-10-06T03:27:00.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae2e6d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0c99d0 con 0x7faadc0cbc70 2023-10-06T03:27:00.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae266c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc159480 0x7faadc1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:00.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae266c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc159480 0x7faadc1548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41556/0 (socket says 172.21.15.84:41556) 2023-10-06T03:27:00.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae266c700 1 -- 172.21.15.84:0/2985969972 learned_addr learned my addr 172.21.15.84:0/2985969972 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:00.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae1e6b700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc0b2140 0x7faadc0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:00.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.412+0000 7faae166a700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faadc0cbc70 0x7faadc159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:00.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faae266c700 1 -- 172.21.15.84:0/2985969972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faadc0cbc70 msgr2=0x7faadc159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:00.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faae266c700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faadc0cbc70 0x7faadc159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:00.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faae266c700 1 -- 172.21.15.84:0/2985969972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc0b2140 msgr2=0x7faadc0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:00.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faae266c700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc0b2140 0x7faadc0c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:00.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faae266c700 1 -- 172.21.15.84:0/2985969972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc009420 con 0x7faadc159480 2023-10-06T03:27:00.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faae266c700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc159480 0x7faadc1548f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7faad400ceb0 tx=0x7faad4007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:00.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faad1ffb700 1 -- 172.21.15.84:0/2985969972 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400ae40 con 0x7faadc159480 2023-10-06T03:27:00.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faad1ffb700 1 -- 172.21.15.84:0/2985969972 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad4016430 con 0x7faadc159480 2023-10-06T03:27:00.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faae2e6d700 1 -- 172.21.15.84:0/2985969972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc0c9cb0 con 0x7faadc159480 2023-10-06T03:27:00.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faad1ffb700 1 -- 172.21.15.84:0/2985969972 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40167d0 con 0x7faadc159480 2023-10-06T03:27:00.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.413+0000 7faae2e6d700 1 -- 172.21.15.84:0/2985969972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc0c9610 con 0x7faadc159480 2023-10-06T03:27:00.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.414+0000 7faae2e6d700 1 -- 172.21.15.84:0/2985969972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc0c7720 con 0x7faadc159480 2023-10-06T03:27:00.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.415+0000 7faad1ffb700 1 -- 172.21.15.84:0/2985969972 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faad4003020 con 0x7faadc159480 2023-10-06T03:27:00.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.415+0000 7faad1ffb700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:00.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.415+0000 7faad1ffb700 1 -- 172.21.15.84:0/2985969972 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5612+0+0 (secure 0 0 0) 0x7faad4012070 con 0x7faadc159480 2023-10-06T03:27:00.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.415+0000 7faae1e6b700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:00.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.416+0000 7faae1e6b700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac0066f30 0x7faac00693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faad800c8f0 tx=0x7faad8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:00.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.423+0000 7faad1ffb700 1 -- 172.21.15.84:0/2985969972 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faad4056160 con 0x7faadc159480 2023-10-06T03:27:00.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:00.625+0000 7faae2e6d700 1 -- 172.21.15.84:0/2985969972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7faadc05f270 con 0x7faadc159480 2023-10-06T03:27:01.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.432+0000 7faad1ffb700 1 -- 172.21.15.84:0/2985969972 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) v1 ==== 97+0+0 (secure 0 0 0) 0x7faad4055cf0 con 0x7faadc159480 2023-10-06T03:27:01.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.434+0000 7faae2e6d700 1 -- 172.21.15.84:0/2985969972 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac0066f30 msgr2=0x7faac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.434+0000 7faae2e6d700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac0066f30 0x7faac00693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faad800c8f0 tx=0x7faad8009040 comp rx=0 tx=0).stop 2023-10-06T03:27:01.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.434+0000 7faae2e6d700 1 -- 172.21.15.84:0/2985969972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc159480 msgr2=0x7faadc1548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.434+0000 7faae2e6d700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc159480 0x7faadc1548f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7faad400ceb0 tx=0x7faad4007870 comp rx=0 tx=0).stop 2023-10-06T03:27:01.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.434+0000 7faae2e6d700 1 -- 172.21.15.84:0/2985969972 shutdown_connections 2023-10-06T03:27:01.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.434+0000 7faae2e6d700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.434+0000 7faae2e6d700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc0b2140 0x7faadc0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.434+0000 7faae2e6d700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faadc159480 0x7faadc1548f0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.434+0000 7faae2e6d700 1 --2- 172.21.15.84:0/2985969972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faadc0cbc70 0x7faadc159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.434+0000 7faae2e6d700 1 -- 172.21.15.84:0/2985969972 >> 172.21.15.84:0/2985969972 conn(0x7faadc06ed20 msgr2=0x7faadc0b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:01.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.435+0000 7faae2e6d700 1 -- 172.21.15.84:0/2985969972 shutdown_connections 2023-10-06T03:27:01.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.435+0000 7faae2e6d700 1 -- 172.21.15.84:0/2985969972 wait complete. 2023-10-06T03:27:01.438 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T03:27:01.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:27:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.562+0000 7f60927b5700 1 Processor -- start 2023-10-06T03:27:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.563+0000 7f60927b5700 1 -- start start 2023-10-06T03:27:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.563+0000 7f60927b5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 0x7f608c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.563+0000 7f60927b5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f608c0b07a0 0x7f608c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.563+0000 7f60927b5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c0b0ca0 con 0x7f608c0b49e0 2023-10-06T03:27:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.563+0000 7f60927b5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c0b0f80 con 0x7f608c0b07a0 2023-10-06T03:27:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.563+0000 7f60927b5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0b1260 con 0x7f608c1595a0 2023-10-06T03:27:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.563+0000 7f6090d52700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f608c0b07a0 0x7f608c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.563+0000 7f6090d52700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f608c0b07a0 0x7f608c0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34086/0 (socket says 172.21.15.84:34086) 2023-10-06T03:27:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.563+0000 7f6090d52700 1 -- 172.21.15.84:0/3162505739 learned_addr learned my addr 172.21.15.84:0/3162505739 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.564+0000 7f608bfff700 1 --2- 172.21.15.84:0/3162505739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 0x7f608c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.564+0000 7f6090d52700 1 -- 172.21.15.84:0/3162505739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 msgr2=0x7f608c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.564+0000 7f6090d52700 1 --2- 172.21.15.84:0/3162505739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 0x7f608c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.564+0000 7f6090d52700 1 -- 172.21.15.84:0/3162505739 >> v1:172.21.15.131:6789/0 conn(0x7f608c0b49e0 legacy=0x7f608c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.564+0000 7f6090d52700 1 -- 172.21.15.84:0/3162505739 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0b1540 con 0x7f608c0b07a0 2023-10-06T03:27:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.564+0000 7f608bfff700 1 --2- 172.21.15.84:0/3162505739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 0x7f608c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.564+0000 7f6090d52700 1 --2- 172.21.15.84:0/3162505739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 0x7f608c0b1c00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f6084009f20 tx=0x7f6084009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e87cc51b0d121cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:01.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.564+0000 7f608affd700 1 -- 172.21.15.84:0/3162505739 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608400e070 con 0x7f608c0b07a0 2023-10-06T03:27:01.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.564+0000 7f608affd700 1 -- 172.21.15.84:0/3162505739 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608400ba80 con 0x7f608c0b07a0 2023-10-06T03:27:01.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.564+0000 7f608affd700 1 -- 172.21.15.84:0/3162505739 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60840092e0 con 0x7f608c0b07a0 2023-10-06T03:27:01.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.565+0000 7f60927b5700 1 -- 172.21.15.84:0/3162505739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 msgr2=0x7f608c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.565+0000 7f60927b5700 1 --2- 172.21.15.84:0/3162505739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 0x7f608c0b1c00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f6084009f20 tx=0x7f6084009840 comp rx=0 tx=0).stop 2023-10-06T03:27:01.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.565+0000 7f60927b5700 1 -- 172.21.15.84:0/3162505739 shutdown_connections 2023-10-06T03:27:01.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.565+0000 7f60927b5700 1 --2- 172.21.15.84:0/3162505739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 0x7f608c0b1c00 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.565+0000 7f60927b5700 1 --2- 172.21.15.84:0/3162505739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 0x7f608c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.565+0000 7f60927b5700 1 -- 172.21.15.84:0/3162505739 >> 172.21.15.84:0/3162505739 conn(0x7f608c099830 msgr2=0x7f608c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:01.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.565+0000 7f60927b5700 1 -- 172.21.15.84:0/3162505739 shutdown_connections 2023-10-06T03:27:01.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.565+0000 7f60927b5700 1 -- 172.21.15.84:0/3162505739 wait complete. 2023-10-06T03:27:01.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.566+0000 7f60927b5700 1 Processor -- start 2023-10-06T03:27:01.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.566+0000 7f60927b5700 1 -- start start 2023-10-06T03:27:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f60927b5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 0x7f608c0ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f60927b5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c0b49e0 0x7f608c09abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f60927b5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 0x7f608c09bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f60927b5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0ad630 con 0x7f608c0b07a0 2023-10-06T03:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f60927b5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0ad910 con 0x7f608c0b49e0 2023-10-06T03:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f60927b5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0adbf0 con 0x7f608c1595a0 2023-10-06T03:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f608bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 0x7f608c0ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f608bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 0x7f608c0ae6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34092/0 (socket says 172.21.15.84:34092) 2023-10-06T03:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f608bfff700 1 -- 172.21.15.84:0/3326619933 learned_addr learned my addr 172.21.15.84:0/3326619933 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f608b7fe700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c0b49e0 0x7f608c09abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f6090d52700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 0x7f608c09bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f608bfff700 1 -- 172.21.15.84:0/3326619933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 msgr2=0x7f608c09bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f608bfff700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 0x7f608c09bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f608bfff700 1 -- 172.21.15.84:0/3326619933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c0b49e0 msgr2=0x7f608c09abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f608bfff700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c0b49e0 0x7f608c09abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f608bfff700 1 -- 172.21.15.84:0/3326619933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6084009ae0 con 0x7f608c0b07a0 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f6090d52700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 0x7f608c09bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f608bfff700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 0x7f608c0ae6d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f607c00d890 tx=0x7f607c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f6073fff700 1 -- 172.21.15.84:0/3326619933 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c005a00 con 0x7f608c0b07a0 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f6073fff700 1 -- 172.21.15.84:0/3326619933 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c005b60 con 0x7f608c0b07a0 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f6073fff700 1 -- 172.21.15.84:0/3326619933 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0125f0 con 0x7f608c0b07a0 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.567+0000 7f60927b5700 1 -- 172.21.15.84:0/3326619933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608c0aded0 con 0x7f608c0b07a0 2023-10-06T03:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.568+0000 7f60927b5700 1 -- 172.21.15.84:0/3326619933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c0ad250 con 0x7f608c0b07a0 2023-10-06T03:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.568+0000 7f60927b5700 1 -- 172.21.15.84:0/3326619933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c0aec10 con 0x7f608c0b07a0 2023-10-06T03:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.569+0000 7f6073fff700 1 -- 172.21.15.84:0/3326619933 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f607c0129a0 con 0x7f608c0b07a0 2023-10-06T03:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.569+0000 7f6073fff700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6078066f30 0x7f60780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.569+0000 7f608b7fe700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6078066f30 0x7f60780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.569+0000 7f6073fff700 1 -- 172.21.15.84:0/3326619933 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f607c084110 con 0x7f608c0b07a0 2023-10-06T03:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.570+0000 7f608b7fe700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6078066f30 0x7f60780693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f608c0cf5d0 tx=0x7f6080007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.574+0000 7f6073fff700 1 -- 172.21.15.84:0/3326619933 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f607c04d5a0 con 0x7f608c0b07a0 2023-10-06T03:27:01.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.829+0000 7f60927b5700 1 -- 172.21.15.84:0/3326619933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f608c064ad0 con 0x7f608c0b07a0 2023-10-06T03:27:01.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.830+0000 7f6073fff700 1 -- 172.21.15.84:0/3326619933 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f607c054ec0 con 0x7f608c0b07a0 2023-10-06T03:27:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:01.832 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T03:27:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T03:27:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lA8KvDxAA2irSaBc/QiMm9oI5GEK1PA==", 2023-10-06T03:27:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:27:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:27:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:27:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T03:27:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lq2TnGhAAOzV6kE1Ji9yvQGuouda9GQ==", 2023-10-06T03:27:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:27:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:27:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:27:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T03:27:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9l4w54FhAASOElKyXlWzXB7pDJV5TzVQ==", 2023-10-06T03:27:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:27:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:27:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:27:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T03:27:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lh/61IRAANVLLVFSkTIhlvAyQkmkbqQ==", 2023-10-06T03:27:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:27:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:27:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:27:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T03:27:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCVfR9lPd++MRAAikRAaM5HcwQgYYfszDoMzQ==", 2023-10-06T03:27:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:27:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:27:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T03:27:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCYfR9l3ovfLxAAkuD96aBKGZX1SQvItQjbmA==", 2023-10-06T03:27:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:27:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:27:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T03:27:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCbfR9lsbQpMBAApjEhKZ3RZXIXNFPmGrp3Rg==", 2023-10-06T03:27:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:27:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:27:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCefR9lOhnPMRAAinzeYJrHzI3Laz+kRo7U9w==", 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T03:27:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCkfR9liYL2MhAAVzzPBy1+K4n9a324eCqKSg==", 2023-10-06T03:27:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:27:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:27:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T03:27:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCnfR9lEe8GMBAAgXFWAPLix5BkHtrqQazDqA==", 2023-10-06T03:27:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:27:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:27:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T03:27:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCqfR9lcprFMBAA4/ksqag9gsivr9htt3UDBg==", 2023-10-06T03:27:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:27:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:27:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T03:27:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCtfR9leIi9MBAAaco3XMawt8uFNMNRbPQAQQ==", 2023-10-06T03:27:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:27:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:27:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T03:27:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lGQaGJRAALZ28ylNKJSf4AhF9KcsrBg==", 2023-10-06T03:27:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:27:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-10-06T03:27:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T03:27:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T03:27:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ls6nPLRAA/94kuDcXCPlYoYcCuqwN2A==", 2023-10-06T03:27:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:27:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:27:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:27:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:27:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T03:27:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lY17ZKhAAyLFVSlBM5vWr4LSl+wwWZw==", 2023-10-06T03:27:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:27:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:27:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:27:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:27:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T03:27:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lPWYyMxAAmgd5iQq7RQp80iK1oBfUww==", 2023-10-06T03:27:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:27:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:27:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:27:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:27:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T03:27:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRfR9loncpLhAA2cZSGjrup5zj13Xtt9k6Xw==", 2023-10-06T03:27:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:27:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:27:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:27:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T03:27:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9ltUixDBAAQN/x3iVJcTKF7hTMehPYgQ==", 2023-10-06T03:27:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:27:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:27:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T03:27:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCSfR9lFqqSBhAA1km5fSJT2+QAdMBBxBWrXQ==", 2023-10-06T03:27:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:27:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:27:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:27:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:27:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T03:27:01.852 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:01.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 -- 172.21.15.84:0/3326619933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6078066f30 msgr2=0x7f60780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6078066f30 0x7f60780693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f608c0cf5d0 tx=0x7f6080007ec0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 -- 172.21.15.84:0/3326619933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 msgr2=0x7f608c0ae6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 0x7f608c0ae6d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f607c00d890 tx=0x7f607c008040 comp rx=0 tx=0).stop 2023-10-06T03:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 -- 172.21.15.84:0/3326619933 shutdown_connections 2023-10-06T03:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6078066f30 0x7f60780693e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c1595a0 0x7f608c09bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c0b07a0 0x7f608c0ae6d0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 --2- 172.21.15.84:0/3326619933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c0b49e0 0x7f608c09abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 -- 172.21.15.84:0/3326619933 >> 172.21.15.84:0/3326619933 conn(0x7f608c099830 msgr2=0x7f608c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 -- 172.21.15.84:0/3326619933 shutdown_connections 2023-10-06T03:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.832+0000 7f60927b5700 1 -- 172.21.15.84:0/3326619933 wait complete. 2023-10-06T03:27:01.855 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:27:01.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.967+0000 7f5da9ba8700 1 Processor -- start 2023-10-06T03:27:01.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.967+0000 7f5da9ba8700 1 -- start start 2023-10-06T03:27:01.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da9ba8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5da41595a0 0x7f5da40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da9ba8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 0x7f5da40aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da9ba8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5da40b07a0 0x7f5da40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da9ba8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da40b0ca0 con 0x7f5da40b07a0 2023-10-06T03:27:01.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da9ba8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da40b0f80 con 0x7f5da41595a0 2023-10-06T03:27:01.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da9ba8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40b1260 con 0x7f5da40b49e0 2023-10-06T03:27:01.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5da40b07a0 0x7f5da40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5da40b07a0 0x7f5da40b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34100/0 (socket says 172.21.15.84:34100) 2023-10-06T03:27:01.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da3fff700 1 -- 172.21.15.84:0/3623335012 learned_addr learned my addr 172.21.15.84:0/3623335012 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da2ffd700 1 --2- 172.21.15.84:0/3623335012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 0x7f5da40aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.968+0000 7f5da37fe700 1 --2- 172.21.15.84:0/3623335012 >> v2:172.21.15.131:3300/0 conn(0x7f5da41595a0 0x7f5da40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da3fff700 1 -- 172.21.15.84:0/3623335012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 msgr2=0x7f5da40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da3fff700 1 --2- 172.21.15.84:0/3623335012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 0x7f5da40aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da3fff700 1 -- 172.21.15.84:0/3623335012 >> v2:172.21.15.131:3300/0 conn(0x7f5da41595a0 msgr2=0x7f5da40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da3fff700 1 --2- 172.21.15.84:0/3623335012 >> v2:172.21.15.131:3300/0 conn(0x7f5da41595a0 0x7f5da40aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da3fff700 1 -- 172.21.15.84:0/3623335012 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da40b1540 con 0x7f5da40b07a0 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da37fe700 1 --2- 172.21.15.84:0/3623335012 >> v2:172.21.15.131:3300/0 conn(0x7f5da41595a0 0x7f5da40aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da3fff700 1 --2- 172.21.15.84:0/3623335012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da40b07a0 0x7f5da40b38d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5da4088cc0 tx=0x7f5d9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1c0a12994417fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da27fc700 1 -- 172.21.15.84:0/3623335012 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c009e70 con 0x7f5da40b07a0 2023-10-06T03:27:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da27fc700 1 -- 172.21.15.84:0/3623335012 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c00b860 con 0x7f5da40b07a0 2023-10-06T03:27:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da27fc700 1 -- 172.21.15.84:0/3623335012 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00bc00 con 0x7f5da40b07a0 2023-10-06T03:27:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da9ba8700 1 -- 172.21.15.84:0/3623335012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da40b07a0 msgr2=0x7f5da40b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da9ba8700 1 --2- 172.21.15.84:0/3623335012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da40b07a0 0x7f5da40b38d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5da4088cc0 tx=0x7f5d9c009250 comp rx=0 tx=0).stop 2023-10-06T03:27:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da9ba8700 1 -- 172.21.15.84:0/3623335012 shutdown_connections 2023-10-06T03:27:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da9ba8700 1 --2- 172.21.15.84:0/3623335012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da40b07a0 0x7f5da40b38d0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da9ba8700 1 --2- 172.21.15.84:0/3623335012 >> v2:172.21.15.131:3300/0 conn(0x7f5da41595a0 0x7f5da40aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da9ba8700 1 --2- 172.21.15.84:0/3623335012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 0x7f5da40aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da9ba8700 1 -- 172.21.15.84:0/3623335012 >> 172.21.15.84:0/3623335012 conn(0x7f5da4099830 msgr2=0x7f5da406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.969+0000 7f5da9ba8700 1 -- 172.21.15.84:0/3623335012 shutdown_connections 2023-10-06T03:27:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.970+0000 7f5da9ba8700 1 -- 172.21.15.84:0/3623335012 wait complete. 2023-10-06T03:27:01.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.971+0000 7f5da9ba8700 1 Processor -- start 2023-10-06T03:27:01.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.971+0000 7f5da9ba8700 1 -- start start 2023-10-06T03:27:01.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.971+0000 7f5da9ba8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da40b07a0 0x7f5da4149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.971+0000 7f5da9ba8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 0x7f5da409c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.971+0000 7f5da9ba8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da41595a0 0x7f5da409cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.971+0000 7f5da9ba8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40c5270 con 0x7f5da41595a0 2023-10-06T03:27:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.971+0000 7f5da9ba8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da409d530 con 0x7f5da40b07a0 2023-10-06T03:27:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.971+0000 7f5da9ba8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da409d810 con 0x7f5da40b49e0 2023-10-06T03:27:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da41595a0 0x7f5da409cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da41595a0 0x7f5da409cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34102/0 (socket says 172.21.15.84:34102) 2023-10-06T03:27:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da3fff700 1 -- 172.21.15.84:0/2400805140 learned_addr learned my addr 172.21.15.84:0/2400805140 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da37fe700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da40b07a0 0x7f5da4149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da2ffd700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 0x7f5da409c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da3fff700 1 -- 172.21.15.84:0/2400805140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 msgr2=0x7f5da409c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da3fff700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 0x7f5da409c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da3fff700 1 -- 172.21.15.84:0/2400805140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da40b07a0 msgr2=0x7f5da4149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da3fff700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da40b07a0 0x7f5da4149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da3fff700 1 -- 172.21.15.84:0/2400805140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c0094f0 con 0x7f5da41595a0 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da37fe700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da40b07a0 0x7f5da4149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da2ffd700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 0x7f5da409c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da3fff700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da41595a0 0x7f5da409cf20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0094c0 tx=0x7f5d9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5d8b7fe700 1 -- 172.21.15.84:0/2400805140 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c026480 con 0x7f5da41595a0 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5d8b7fe700 1 -- 172.21.15.84:0/2400805140 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c01f070 con 0x7f5da41595a0 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5d8b7fe700 1 -- 172.21.15.84:0/2400805140 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c026810 con 0x7f5da41595a0 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da9ba8700 1 -- 172.21.15.84:0/2400805140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da409daf0 con 0x7f5da41595a0 2023-10-06T03:27:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.972+0000 7f5da9ba8700 1 -- 172.21.15.84:0/2400805140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da4157720 con 0x7f5da41595a0 2023-10-06T03:27:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.973+0000 7f5da9ba8700 1 -- 172.21.15.84:0/2400805140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da40c5420 con 0x7f5da41595a0 2023-10-06T03:27:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.973+0000 7f5d8b7fe700 1 -- 172.21.15.84:0/2400805140 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d9c01a430 con 0x7f5da41595a0 2023-10-06T03:27:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.974+0000 7f5d8b7fe700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5d90066f30 0x7f5d900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.974+0000 7f5d8b7fe700 1 -- 172.21.15.84:0/2400805140 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5d9c021070 con 0x7f5da41595a0 2023-10-06T03:27:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.974+0000 7f5da37fe700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5d90066f30 0x7f5d900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.974+0000 7f5da37fe700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5d90066f30 0x7f5d900693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009fd0 tx=0x7f5d940098a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:01.978+0000 7f5d8b7fe700 1 -- 172.21.15.84:0/2400805140 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5da40c5420 con 0x7f5da41595a0 2023-10-06T03:27:02.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.162+0000 7f5da9ba8700 1 -- 172.21.15.84:0/2400805140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5da4064ad0 con 0x7f5da41595a0 2023-10-06T03:27:02.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.163+0000 7f5d8b7fe700 1 -- 172.21.15.84:0/2400805140 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+13856 (secure 0 0 0) 0x7f5d9c015090 con 0x7f5da41595a0 2023-10-06T03:27:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:02.165 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":94,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:27:01.430776+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:27:02.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 -- 172.21.15.84:0/2400805140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5d90066f30 msgr2=0x7f5d900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5d90066f30 0x7f5d900693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009fd0 tx=0x7f5d940098a0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 -- 172.21.15.84:0/2400805140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da41595a0 msgr2=0x7f5da409cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da41595a0 0x7f5da409cf20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0094c0 tx=0x7f5d9c017000 comp rx=0 tx=0).stop 2023-10-06T03:27:02.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 -- 172.21.15.84:0/2400805140 shutdown_connections 2023-10-06T03:27:02.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5d90066f30 0x7f5d900693e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da40b07a0 0x7f5da4149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da41595a0 0x7f5da409cf20 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 --2- 172.21.15.84:0/2400805140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da40b49e0 0x7f5da409c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 -- 172.21.15.84:0/2400805140 >> 172.21.15.84:0/2400805140 conn(0x7f5da4099830 msgr2=0x7f5da40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:02.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 -- 172.21.15.84:0/2400805140 shutdown_connections 2023-10-06T03:27:02.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.165+0000 7f5da9ba8700 1 -- 172.21.15.84:0/2400805140 wait complete. 2023-10-06T03:27:02.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:27:02.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:27:02.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.295+0000 7f410dd5b700 1 Processor -- start 2023-10-06T03:27:02.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.295+0000 7f410dd5b700 1 -- start start 2023-10-06T03:27:02.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410dd5b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41081539b0 0x7f41080b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410dd5b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 0x7f41080b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410dd5b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410815a640 con 0x7f41080af1c0 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410dd5b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4108157640 con 0x7f41081539b0 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410dd5b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41080b0d10 con 0x7f41080b0800 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410cd59700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41081539b0 0x7f41080b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410cd59700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41081539b0 0x7f41080b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34110/0 (socket says 172.21.15.84:34110) 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410cd59700 1 -- 172.21.15.84:0/544267887 learned_addr learned my addr 172.21.15.84:0/544267887 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f40fffff700 1 --2- 172.21.15.84:0/544267887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 0x7f41080b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410cd59700 1 -- 172.21.15.84:0/544267887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 msgr2=0x7f41080b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410cd59700 1 --2- 172.21.15.84:0/544267887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 0x7f41080b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410cd59700 1 -- 172.21.15.84:0/544267887 >> v1:172.21.15.131:6789/0 conn(0x7f41080af1c0 legacy=0x7f410806a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.296+0000 7f410cd59700 1 -- 172.21.15.84:0/544267887 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108159d10 con 0x7f41081539b0 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f410cd59700 1 --2- 172.21.15.84:0/544267887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41081539b0 0x7f41080b1160 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f41040099b0 tx=0x7f4104009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ac3b253c0db09c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f40ff7fe700 1 -- 172.21.15.84:0/544267887 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410400b820 con 0x7f41081539b0 2023-10-06T03:27:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f40ff7fe700 1 -- 172.21.15.84:0/544267887 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410400b980 con 0x7f41081539b0 2023-10-06T03:27:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f40ff7fe700 1 -- 172.21.15.84:0/544267887 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410400bd20 con 0x7f41081539b0 2023-10-06T03:27:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f410dd5b700 1 -- 172.21.15.84:0/544267887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41081539b0 msgr2=0x7f41080b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f410dd5b700 1 --2- 172.21.15.84:0/544267887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41081539b0 0x7f41080b1160 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f41040099b0 tx=0x7f4104009250 comp rx=0 tx=0).stop 2023-10-06T03:27:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f410dd5b700 1 -- 172.21.15.84:0/544267887 shutdown_connections 2023-10-06T03:27:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f410dd5b700 1 --2- 172.21.15.84:0/544267887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41081539b0 0x7f41080b1160 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f410dd5b700 1 --2- 172.21.15.84:0/544267887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 0x7f41080b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f410dd5b700 1 -- 172.21.15.84:0/544267887 >> 172.21.15.84:0/544267887 conn(0x7f4108069180 msgr2=0x7f41080aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f410dd5b700 1 -- 172.21.15.84:0/544267887 shutdown_connections 2023-10-06T03:27:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.297+0000 7f410dd5b700 1 -- 172.21.15.84:0/544267887 wait complete. 2023-10-06T03:27:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.298+0000 7f410dd5b700 1 Processor -- start 2023-10-06T03:27:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410dd5b700 1 -- start start 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410dd5b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41080af1c0 0x7f4108142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410dd5b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 0x7f41080b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410dd5b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41081539b0 0x7f41080b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410dd5b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080c9c50 con 0x7f41080af1c0 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410dd5b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108142f90 con 0x7f41081539b0 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410dd5b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4108143270 con 0x7f41080b0800 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410cd59700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41080af1c0 0x7f4108142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410cd59700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41080af1c0 0x7f4108142570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34116/0 (socket says 172.21.15.84:34116) 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410cd59700 1 -- 172.21.15.84:0/3828888418 learned_addr learned my addr 172.21.15.84:0/3828888418 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f410d55a700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41081539b0 0x7f41080b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.299+0000 7f40fffff700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 0x7f41080b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f410cd59700 1 -- 172.21.15.84:0/3828888418 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 msgr2=0x7f41080b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f410cd59700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 0x7f41080b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f410cd59700 1 -- 172.21.15.84:0/3828888418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41081539b0 msgr2=0x7f41080b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f410cd59700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41081539b0 0x7f41080b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f410cd59700 1 -- 172.21.15.84:0/3828888418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040094f0 con 0x7f41080af1c0 2023-10-06T03:27:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f410d55a700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41081539b0 0x7f41080b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f40fffff700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 0x7f41080b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f410cd59700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41080af1c0 0x7f4108142570 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f4104009290 tx=0x7f4104016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f40fcff9700 1 -- 172.21.15.84:0/3828888418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104011d90 con 0x7f41080af1c0 2023-10-06T03:27:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f40fcff9700 1 -- 172.21.15.84:0/3828888418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4104020070 con 0x7f41080af1c0 2023-10-06T03:27:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f410dd5b700 1 -- 172.21.15.84:0/3828888418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4108143550 con 0x7f41080af1c0 2023-10-06T03:27:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f40fcff9700 1 -- 172.21.15.84:0/3828888418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410401b6a0 con 0x7f41080af1c0 2023-10-06T03:27:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.300+0000 7f410dd5b700 1 -- 172.21.15.84:0/3828888418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4108143b10 con 0x7f41080af1c0 2023-10-06T03:27:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.301+0000 7f410dd5b700 1 -- 172.21.15.84:0/3828888418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410805f270 con 0x7f41080af1c0 2023-10-06T03:27:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.301+0000 7f40fcff9700 1 -- 172.21.15.84:0/3828888418 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4104022030 con 0x7f41080af1c0 2023-10-06T03:27:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.302+0000 7f40fcff9700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f40f4066f30 0x7f40f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.302+0000 7f40fffff700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f40f4066f30 0x7f40f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.302+0000 7f40fcff9700 1 -- 172.21.15.84:0/3828888418 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f41040862e0 con 0x7f41080af1c0 2023-10-06T03:27:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.302+0000 7f40fffff700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f40f4066f30 0x7f40f40693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4108159920 tx=0x7f40f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:02.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.306+0000 7f40fcff9700 1 -- 172.21.15.84:0/3828888418 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4104053600 con 0x7f41080af1c0 2023-10-06T03:27:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.487+0000 7f410dd5b700 1 -- 172.21.15.84:0/3828888418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f410805f270 con 0x7f41080af1c0 2023-10-06T03:27:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.488+0000 7f40fcff9700 1 -- 172.21.15.84:0/3828888418 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4104056c20 con 0x7f41080af1c0 2023-10-06T03:27:02.489 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:27:02.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 -- 172.21.15.84:0/3828888418 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f40f4066f30 msgr2=0x7f40f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f40f4066f30 0x7f40f40693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4108159920 tx=0x7f40f8008040 comp rx=0 tx=0).stop 2023-10-06T03:27:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 -- 172.21.15.84:0/3828888418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41080af1c0 msgr2=0x7f4108142570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41080af1c0 0x7f4108142570 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f4104009290 tx=0x7f4104016000 comp rx=0 tx=0).stop 2023-10-06T03:27:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 -- 172.21.15.84:0/3828888418 shutdown_connections 2023-10-06T03:27:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f40f4066f30 0x7f40f40693e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41081539b0 0x7f41080b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41080af1c0 0x7f4108142570 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 --2- 172.21.15.84:0/3828888418 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41080b0800 0x7f41080b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 -- 172.21.15.84:0/3828888418 >> 172.21.15.84:0/3828888418 conn(0x7f4108069180 msgr2=0x7f410806e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 -- 172.21.15.84:0/3828888418 shutdown_connections 2023-10-06T03:27:02.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.490+0000 7f410dd5b700 1 -- 172.21.15.84:0/3828888418 wait complete. 2023-10-06T03:27:02.503 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:27:02.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.619+0000 7f0a70d85700 1 Processor -- start 2023-10-06T03:27:02.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.619+0000 7f0a70d85700 1 -- start start 2023-10-06T03:27:02.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a70d85700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a6c0b0680 0x7f0a6c0ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a70d85700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a6c0b0a50 0x7f0a6c0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a70d85700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a6c0cc460 0x7f0a6c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a70d85700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c0ca7d0 con 0x7f0a6c0cc460 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a70d85700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c0c5400 con 0x7f0a6c0b0680 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a70d85700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0ccd40 con 0x7f0a6c0b0a50 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a6ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a6c0cc460 0x7f0a6c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a6ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a6c0cc460 0x7f0a6c0c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34118/0 (socket says 172.21.15.84:34118) 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a6ad9d700 1 -- 172.21.15.84:0/878943995 learned_addr learned my addr 172.21.15.84:0/878943995 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a6a59c700 1 --2- 172.21.15.84:0/878943995 >> v2:172.21.15.131:3300/0 conn(0x7f0a6c0b0680 0x7f0a6c0ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a63fff700 1 --2- 172.21.15.84:0/878943995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a6c0b0a50 0x7f0a6c0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a6ad9d700 1 -- 172.21.15.84:0/878943995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a6c0b0a50 msgr2=0x7f0a6c0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a6ad9d700 1 --2- 172.21.15.84:0/878943995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a6c0b0a50 0x7f0a6c0cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a6ad9d700 1 -- 172.21.15.84:0/878943995 >> v2:172.21.15.131:3300/0 conn(0x7f0a6c0b0680 msgr2=0x7f0a6c0ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:02.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a6ad9d700 1 --2- 172.21.15.84:0/878943995 >> v2:172.21.15.131:3300/0 conn(0x7f0a6c0b0680 0x7f0a6c0ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a6ad9d700 1 -- 172.21.15.84:0/878943995 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c0cd020 con 0x7f0a6c0cc460 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.620+0000 7f0a6ad9d700 1 --2- 172.21.15.84:0/878943995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0cc460 0x7f0a6c0c3b90 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c06d970 tx=0x7f0a64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad4900a4729cf5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a69d9b700 1 -- 172.21.15.84:0/878943995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400e070 con 0x7f0a6c0cc460 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a69d9b700 1 -- 172.21.15.84:0/878943995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6400ba50 con 0x7f0a6c0cc460 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a69d9b700 1 -- 172.21.15.84:0/878943995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640092e0 con 0x7f0a6c0cc460 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a70d85700 1 -- 172.21.15.84:0/878943995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0cc460 msgr2=0x7f0a6c0c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a70d85700 1 --2- 172.21.15.84:0/878943995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0cc460 0x7f0a6c0c3b90 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c06d970 tx=0x7f0a64009840 comp rx=0 tx=0).stop 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a70d85700 1 -- 172.21.15.84:0/878943995 shutdown_connections 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a70d85700 1 --2- 172.21.15.84:0/878943995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0cc460 0x7f0a6c0c3b90 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a70d85700 1 --2- 172.21.15.84:0/878943995 >> v2:172.21.15.131:3300/0 conn(0x7f0a6c0b0680 0x7f0a6c0ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a70d85700 1 --2- 172.21.15.84:0/878943995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a6c0b0a50 0x7f0a6c0cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a70d85700 1 -- 172.21.15.84:0/878943995 >> 172.21.15.84:0/878943995 conn(0x7f0a6c088000 msgr2=0x7f0a6c0ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:02.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a70d85700 1 -- 172.21.15.84:0/878943995 shutdown_connections 2023-10-06T03:27:02.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.621+0000 7f0a70d85700 1 -- 172.21.15.84:0/878943995 wait complete. 2023-10-06T03:27:02.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.622+0000 7f0a70d85700 1 Processor -- start 2023-10-06T03:27:02.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.622+0000 7f0a70d85700 1 -- start start 2023-10-06T03:27:02.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a70d85700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0b0680 0x7f0a6c0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a70d85700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a6c0b0a50 0x7f0a6c155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a70d85700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a6c0cc460 0x7f0a6c154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a70d85700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c156450 con 0x7f0a6c0b0680 2023-10-06T03:27:02.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a70d85700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0b2e10 con 0x7f0a6c0b0a50 2023-10-06T03:27:02.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a70d85700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0b2200 con 0x7f0a6c0cc460 2023-10-06T03:27:02.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a6a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0b0680 0x7f0a6c0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a6a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0b0680 0x7f0a6c0b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34124/0 (socket says 172.21.15.84:34124) 2023-10-06T03:27:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a6a59c700 1 -- 172.21.15.84:0/476110301 learned_addr learned my addr 172.21.15.84:0/476110301 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a63fff700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a6c0b0a50 0x7f0a6c155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a6ad9d700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a6c0cc460 0x7f0a6c154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a6a59c700 1 -- 172.21.15.84:0/476110301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a6c0cc460 msgr2=0x7f0a6c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a6a59c700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a6c0cc460 0x7f0a6c154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a6a59c700 1 -- 172.21.15.84:0/476110301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a6c0b0a50 msgr2=0x7f0a6c155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a6a59c700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a6c0b0a50 0x7f0a6c155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a6a59c700 1 -- 172.21.15.84:0/476110301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64009ae0 con 0x7f0a6c0b0680 2023-10-06T03:27:02.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a63fff700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a6c0b0a50 0x7f0a6c155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:02.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a6a59c700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0b0680 0x7f0a6c0b1b00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00d840 tx=0x7f0a5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:02.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.623+0000 7f0a627fc700 1 -- 172.21.15.84:0/476110301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c014620 con 0x7f0a6c0b0680 2023-10-06T03:27:02.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.624+0000 7f0a627fc700 1 -- 172.21.15.84:0/476110301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c014780 con 0x7f0a6c0b0680 2023-10-06T03:27:02.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.624+0000 7f0a70d85700 1 -- 172.21.15.84:0/476110301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c0b24e0 con 0x7f0a6c0b0680 2023-10-06T03:27:02.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.624+0000 7f0a627fc700 1 -- 172.21.15.84:0/476110301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c014b40 con 0x7f0a6c0b0680 2023-10-06T03:27:02.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.624+0000 7f0a70d85700 1 -- 172.21.15.84:0/476110301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c0b2aa0 con 0x7f0a6c0b0680 2023-10-06T03:27:02.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.625+0000 7f0a70d85700 1 -- 172.21.15.84:0/476110301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c064ad0 con 0x7f0a6c0b0680 2023-10-06T03:27:02.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.625+0000 7f0a627fc700 1 -- 172.21.15.84:0/476110301 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a5c01d400 con 0x7f0a6c0b0680 2023-10-06T03:27:02.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.625+0000 7f0a627fc700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a4c066f30 0x7f0a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.625+0000 7f0a627fc700 1 -- 172.21.15.84:0/476110301 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f0a5c084db0 con 0x7f0a6c0b0680 2023-10-06T03:27:02.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.625+0000 7f0a63fff700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a4c066f30 0x7f0a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.626+0000 7f0a63fff700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a4c066f30 0x7f0a4c0693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c15a170 tx=0x7f0a54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:02.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.629+0000 7f0a627fc700 1 -- 172.21.15.84:0/476110301 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a5c0520d0 con 0x7f0a6c0b0680 2023-10-06T03:27:02.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.810+0000 7f0a70d85700 1 -- 172.21.15.84:0/476110301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a6c0ca3f0 con 0x7f0a6c0b0680 2023-10-06T03:27:02.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.810+0000 7f0a627fc700 1 -- 172.21.15.84:0/476110301 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a5c0556f0 con 0x7f0a6c0b0680 2023-10-06T03:27:02.812 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:27:02.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 -- 172.21.15.84:0/476110301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a4c066f30 msgr2=0x7f0a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a4c066f30 0x7f0a4c0693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c15a170 tx=0x7f0a54008040 comp rx=0 tx=0).stop 2023-10-06T03:27:02.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 -- 172.21.15.84:0/476110301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0b0680 msgr2=0x7f0a6c0b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0b0680 0x7f0a6c0b1b00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00d840 tx=0x7f0a5c008040 comp rx=0 tx=0).stop 2023-10-06T03:27:02.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 -- 172.21.15.84:0/476110301 shutdown_connections 2023-10-06T03:27:02.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a4c066f30 0x7f0a4c0693e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a6c0cc460 0x7f0a6c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a6c0b0680 0x7f0a6c0b1b00 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 --2- 172.21.15.84:0/476110301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a6c0b0a50 0x7f0a6c155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 -- 172.21.15.84:0/476110301 >> 172.21.15.84:0/476110301 conn(0x7f0a6c088000 msgr2=0x7f0a6c06b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:02.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 -- 172.21.15.84:0/476110301 shutdown_connections 2023-10-06T03:27:02.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.812+0000 7f0a70d85700 1 -- 172.21.15.84:0/476110301 wait complete. 2023-10-06T03:27:02.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:27:02.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.938+0000 7fce7b3cf700 1 Processor -- start 2023-10-06T03:27:02.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.938+0000 7fce7b3cf700 1 -- start start 2023-10-06T03:27:02.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce7b3cf700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fce740cbc70 0x7fce740cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce7b3cf700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce740cb7e0 con 0x7fce74159480 2023-10-06T03:27:02.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce7b3cf700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce740b08a0 con 0x7fce740b2140 2023-10-06T03:27:02.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce7b3cf700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce740cb190 con 0x7fce740cbc70 2023-10-06T03:27:02.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce7a3cd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fce74159480 0x7fce740b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57868/0 (socket says 172.21.15.84:57868) 2023-10-06T03:27:02.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce7a3cd700 1 -- 172.21.15.84:0/3031979627 learned_addr learned my addr 172.21.15.84:0/3031979627 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:02.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce79bcc700 1 --2- 172.21.15.84:0/3031979627 >> v2:172.21.15.131:3300/0 conn(0x7fce740cbc70 0x7fce740cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce793cb700 1 -- 172.21.15.84:0/3031979627 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173893168 0 0) 0x7fce740cb7e0 con 0x7fce74159480 2023-10-06T03:27:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce793cb700 1 -- 172.21.15.84:0/3031979627 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce60003570 con 0x7fce74159480 2023-10-06T03:27:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce793cb700 1 -- 172.21.15.84:0/3031979627 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835591041 0 0) 0x7fce740b08a0 con 0x7fce740b2140 2023-10-06T03:27:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.939+0000 7fce793cb700 1 -- 172.21.15.84:0/3031979627 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce740cb7e0 con 0x7fce740b2140 2023-10-06T03:27:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.940+0000 7fce793cb700 1 -- 172.21.15.84:0/3031979627 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2751295971 0 0) 0x7fce60003570 con 0x7fce74159480 2023-10-06T03:27:02.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.940+0000 7fce79bcc700 1 -- 172.21.15.84:0/3031979627 >> v1:172.21.15.131:6789/0 conn(0x7fce740b2140 legacy=0x7fce740b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.940+0000 7fce79bcc700 1 -- 172.21.15.84:0/3031979627 >> v1:172.21.15.84:6789/0 conn(0x7fce74159480 legacy=0x7fce740b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.940+0000 7fce79bcc700 1 -- 172.21.15.84:0/3031979627 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740cb470 con 0x7fce740cbc70 2023-10-06T03:27:02.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.940+0000 7fce79bcc700 1 --2- 172.21.15.84:0/3031979627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce740cbc70 0x7fce740cc0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fce640098e0 tx=0x7fce640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cffa4ed334b427d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:02.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.940+0000 7fce793cb700 1 -- 172.21.15.84:0/3031979627 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700017f0 con 0x7fce740cbc70 2023-10-06T03:27:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.940+0000 7fce793cb700 1 -- 172.21.15.84:0/3031979627 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64011420 con 0x7fce740cbc70 2023-10-06T03:27:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.940+0000 7fce793cb700 1 -- 172.21.15.84:0/3031979627 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640117c0 con 0x7fce740cbc70 2023-10-06T03:27:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.940+0000 7fce7b3cf700 1 -- 172.21.15.84:0/3031979627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce740cbc70 msgr2=0x7fce740cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.940+0000 7fce7b3cf700 1 --2- 172.21.15.84:0/3031979627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce740cbc70 0x7fce740cc0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fce640098e0 tx=0x7fce640091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.941+0000 7fce7b3cf700 1 -- 172.21.15.84:0/3031979627 shutdown_connections 2023-10-06T03:27:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.941+0000 7fce7b3cf700 1 --2- 172.21.15.84:0/3031979627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce740cbc70 0x7fce740cc0c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.941+0000 7fce7b3cf700 1 -- 172.21.15.84:0/3031979627 >> 172.21.15.84:0/3031979627 conn(0x7fce7406ed20 msgr2=0x7fce7406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.941+0000 7fce7b3cf700 1 -- 172.21.15.84:0/3031979627 shutdown_connections 2023-10-06T03:27:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.941+0000 7fce7b3cf700 1 -- 172.21.15.84:0/3031979627 wait complete. 2023-10-06T03:27:02.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.942+0000 7fce7b3cf700 1 Processor -- start 2023-10-06T03:27:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.942+0000 7fce7b3cf700 1 -- start start 2023-10-06T03:27:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.942+0000 7fce7b3cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce740b2140 0x7fce740c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.942+0000 7fce7b3cf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fce740cbc70 0x7fce741538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.942+0000 7fce7b3cf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce74159480 0x7fce740b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.942+0000 7fce7b3cf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740c5f40 con 0x7fce740b2140 2023-10-06T03:27:02.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.942+0000 7fce7b3cf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740d0a40 con 0x7fce74159480 2023-10-06T03:27:02.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.942+0000 7fce7b3cf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce740c49f0 con 0x7fce740cbc70 2023-10-06T03:27:02.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7a3cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce740b2140 0x7fce740c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7a3cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce740b2140 0x7fce740c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34128/0 (socket says 172.21.15.84:34128) 2023-10-06T03:27:02.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7a3cd700 1 -- 172.21.15.84:0/1366772672 learned_addr learned my addr 172.21.15.84:0/1366772672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:02.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7abce700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce74159480 0x7fce740b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce79bcc700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fce740cbc70 0x7fce741538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7a3cd700 1 -- 172.21.15.84:0/1366772672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fce740cbc70 msgr2=0x7fce741538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7a3cd700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fce740cbc70 0x7fce741538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7a3cd700 1 -- 172.21.15.84:0/1366772672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce74159480 msgr2=0x7fce740b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7a3cd700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce74159480 0x7fce740b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7a3cd700 1 -- 172.21.15.84:0/1366772672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64009420 con 0x7fce740b2140 2023-10-06T03:27:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7a3cd700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce740b2140 0x7fce740c44b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fce7000cc20 tx=0x7fce70007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce6a7fc700 1 -- 172.21.15.84:0/1366772672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70004e90 con 0x7fce740b2140 2023-10-06T03:27:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce6a7fc700 1 -- 172.21.15.84:0/1366772672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7000a730 con 0x7fce740b2140 2023-10-06T03:27:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7b3cf700 1 -- 172.21.15.84:0/1366772672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce740c5330 con 0x7fce740b2140 2023-10-06T03:27:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce6a7fc700 1 -- 172.21.15.84:0/1366772672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7000aad0 con 0x7fce740b2140 2023-10-06T03:27:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.943+0000 7fce7b3cf700 1 -- 172.21.15.84:0/1366772672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce740c58f0 con 0x7fce740b2140 2023-10-06T03:27:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.944+0000 7fce7b3cf700 1 -- 172.21.15.84:0/1366772672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7405f270 con 0x7fce740b2140 2023-10-06T03:27:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.945+0000 7fce6a7fc700 1 -- 172.21.15.84:0/1366772672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce70007150 con 0x7fce740b2140 2023-10-06T03:27:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.945+0000 7fce6a7fc700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce58066f30 0x7fce580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:02.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.945+0000 7fce79bcc700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce58066f30 0x7fce580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:02.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.945+0000 7fce6a7fc700 1 -- 172.21.15.84:0/1366772672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fce70083f50 con 0x7fce740b2140 2023-10-06T03:27:02.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.945+0000 7fce79bcc700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce58066f30 0x7fce580693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce640093f0 tx=0x7fce64016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:02.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:02.949+0000 7fce6a7fc700 1 -- 172.21.15.84:0/1366772672 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce700512f0 con 0x7fce740b2140 2023-10-06T03:27:03.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.134+0000 7fce7b3cf700 1 -- 172.21.15.84:0/1366772672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fce74159850 con 0x7fce740b2140 2023-10-06T03:27:03.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.135+0000 7fce6a7fc700 1 -- 172.21.15.84:0/1366772672 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) v1 ==== 84+0+126 (secure 0 0 0) 0x7fce70018090 con 0x7fce740b2140 2023-10-06T03:27:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T03:27:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T03:27:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T03:27:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T03:27:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T03:27:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T03:27:03.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 -- 172.21.15.84:0/1366772672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce58066f30 msgr2=0x7fce580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:03.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce58066f30 0x7fce580693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce640093f0 tx=0x7fce64016000 comp rx=0 tx=0).stop 2023-10-06T03:27:03.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 -- 172.21.15.84:0/1366772672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce740b2140 msgr2=0x7fce740c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:03.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce740b2140 0x7fce740c44b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fce7000cc20 tx=0x7fce70007da0 comp rx=0 tx=0).stop 2023-10-06T03:27:03.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 -- 172.21.15.84:0/1366772672 shutdown_connections 2023-10-06T03:27:03.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fce58066f30 0x7fce580693e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:03.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce74159480 0x7fce740b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:03.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce740b2140 0x7fce740c44b0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:03.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 --2- 172.21.15.84:0/1366772672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fce740cbc70 0x7fce741538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:03.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 -- 172.21.15.84:0/1366772672 >> 172.21.15.84:0/1366772672 conn(0x7fce7406ed20 msgr2=0x7fce741558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:03.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 -- 172.21.15.84:0/1366772672 shutdown_connections 2023-10-06T03:27:03.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.137+0000 7fce7b3cf700 1 -- 172.21.15.84:0/1366772672 wait complete. 2023-10-06T03:27:03.151 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:27:03.151 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:27:03.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.267+0000 7f903a77d700 1 Processor -- start 2023-10-06T03:27:03.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.267+0000 7f903a77d700 1 -- start start 2023-10-06T03:27:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f903a77d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f903406ed20 0x7f90340b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f903a77d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f90340aee20 0x7f90340af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f903a77d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90340b2d20 con 0x7f903406f0f0 2023-10-06T03:27:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f903a77d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903406fb80 con 0x7f903406ed20 2023-10-06T03:27:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f903a77d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90340b0450 con 0x7f90340aee20 2023-10-06T03:27:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f9033fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f903406ed20 0x7f90340b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f9033fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f903406ed20 0x7f90340b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34142/0 (socket says 172.21.15.84:34142) 2023-10-06T03:27:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f9033fff700 1 -- 172.21.15.84:0/3929036316 learned_addr learned my addr 172.21.15.84:0/3929036316 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f9038d1a700 1 --2- 172.21.15.84:0/3929036316 >> v2:172.21.15.131:3300/0 conn(0x7f90340aee20 0x7f90340af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f9033fff700 1 -- 172.21.15.84:0/3929036316 >> v2:172.21.15.131:3300/0 conn(0x7f90340aee20 msgr2=0x7f90340af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f9033fff700 1 --2- 172.21.15.84:0/3929036316 >> v2:172.21.15.131:3300/0 conn(0x7f90340aee20 0x7f90340af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f9033fff700 1 -- 172.21.15.84:0/3929036316 >> v1:172.21.15.131:6789/0 conn(0x7f903406f0f0 legacy=0x7f90340b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.268+0000 7f9033fff700 1 -- 172.21.15.84:0/3929036316 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340af7c0 con 0x7f903406ed20 2023-10-06T03:27:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f9033fff700 1 --2- 172.21.15.84:0/3929036316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903406ed20 0x7f90340b23a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f90341576c0 tx=0x7f9024009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cd0f1a6803b2c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f9032ffd700 1 -- 172.21.15.84:0/3929036316 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400b820 con 0x7f903406ed20 2023-10-06T03:27:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f9032ffd700 1 -- 172.21.15.84:0/3929036316 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902400b980 con 0x7f903406ed20 2023-10-06T03:27:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f9032ffd700 1 -- 172.21.15.84:0/3929036316 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400bd20 con 0x7f903406ed20 2023-10-06T03:27:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f903a77d700 1 -- 172.21.15.84:0/3929036316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903406ed20 msgr2=0x7f90340b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f903a77d700 1 --2- 172.21.15.84:0/3929036316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903406ed20 0x7f90340b23a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f90341576c0 tx=0x7f9024009250 comp rx=0 tx=0).stop 2023-10-06T03:27:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f903a77d700 1 -- 172.21.15.84:0/3929036316 shutdown_connections 2023-10-06T03:27:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f903a77d700 1 --2- 172.21.15.84:0/3929036316 >> v2:172.21.15.131:3300/0 conn(0x7f90340aee20 0x7f90340af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f903a77d700 1 --2- 172.21.15.84:0/3929036316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903406ed20 0x7f90340b23a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f903a77d700 1 -- 172.21.15.84:0/3929036316 >> 172.21.15.84:0/3929036316 conn(0x7f9034068330 msgr2=0x7f9034068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f903a77d700 1 -- 172.21.15.84:0/3929036316 shutdown_connections 2023-10-06T03:27:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.269+0000 7f903a77d700 1 -- 172.21.15.84:0/3929036316 wait complete. 2023-10-06T03:27:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.270+0000 7f903a77d700 1 Processor -- start 2023-10-06T03:27:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.271+0000 7f903a77d700 1 -- start start 2023-10-06T03:27:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.271+0000 7f903a77d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f903406ed20 0x7f90340ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.271+0000 7f903a77d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f903406f0f0 0x7f90340aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.271+0000 7f903a77d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90340aee20 0x7f903416d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.271+0000 7f903a77d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9034156550 con 0x7f90340aee20 2023-10-06T03:27:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.271+0000 7f903a77d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90340a98e0 con 0x7f903406ed20 2023-10-06T03:27:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.271+0000 7f903a77d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903416d5f0 con 0x7f903406f0f0 2023-10-06T03:27:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.271+0000 7f9038d1a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90340aee20 0x7f903416d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.271+0000 7f9038d1a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90340aee20 0x7f903416d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34152/0 (socket says 172.21.15.84:34152) 2023-10-06T03:27:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.271+0000 7f9038d1a700 1 -- 172.21.15.84:0/3232540201 learned_addr learned my addr 172.21.15.84:0/3232540201 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f9033fff700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f903406ed20 0x7f90340ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f90337fe700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f903406f0f0 0x7f90340aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f9038d1a700 1 -- 172.21.15.84:0/3232540201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f903406f0f0 msgr2=0x7f90340aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f9038d1a700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f903406f0f0 0x7f90340aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f9038d1a700 1 -- 172.21.15.84:0/3232540201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f903406ed20 msgr2=0x7f90340ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f9038d1a700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f903406ed20 0x7f90340ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f9038d1a700 1 -- 172.21.15.84:0/3232540201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90240094f0 con 0x7f90340aee20 2023-10-06T03:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f9038d1a700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90340aee20 0x7f903416d870 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f902c00ceb0 tx=0x7f902c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f901bfff700 1 -- 172.21.15.84:0/3232540201 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00ad90 con 0x7f90340aee20 2023-10-06T03:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f901bfff700 1 -- 172.21.15.84:0/3232540201 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c016430 con 0x7f90340aee20 2023-10-06T03:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f903a77d700 1 -- 172.21.15.84:0/3232540201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90340a8cd0 con 0x7f90340aee20 2023-10-06T03:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f901bfff700 1 -- 172.21.15.84:0/3232540201 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c0167d0 con 0x7f90340aee20 2023-10-06T03:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.272+0000 7f903a77d700 1 -- 172.21.15.84:0/3232540201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90340a9570 con 0x7f90340aee20 2023-10-06T03:27:03.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.273+0000 7f903a77d700 1 -- 172.21.15.84:0/3232540201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9034064ad0 con 0x7f90340aee20 2023-10-06T03:27:03.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.273+0000 7f901bfff700 1 -- 172.21.15.84:0/3232540201 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f902c003020 con 0x7f90340aee20 2023-10-06T03:27:03.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.274+0000 7f901bfff700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9020066f30 0x7f90200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:03.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.274+0000 7f901bfff700 1 -- 172.21.15.84:0/3232540201 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f902c012070 con 0x7f90340aee20 2023-10-06T03:27:03.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.274+0000 7f9033fff700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9020066f30 0x7f90200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:03.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.274+0000 7f9033fff700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9020066f30 0x7f90200693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90341576c0 tx=0x7f9024016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:03.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.278+0000 7f901bfff700 1 -- 172.21.15.84:0/3232540201 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f902c052580 con 0x7f90340aee20 2023-10-06T03:27:03.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:03.461+0000 7f903a77d700 1 -- 172.21.15.84:0/3232540201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f903404bb80 con 0x7f90340aee20 2023-10-06T03:27:04.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.445+0000 7f901bfff700 1 -- 172.21.15.84:0/3232540201 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) v1 ==== 138+0+0 (secure 0 0 0) 0x7f902c055ba0 con 0x7f90340aee20 2023-10-06T03:27:04.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 -- 172.21.15.84:0/3232540201 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9020066f30 msgr2=0x7f90200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:04.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9020066f30 0x7f90200693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90341576c0 tx=0x7f9024016000 comp rx=0 tx=0).stop 2023-10-06T03:27:04.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 -- 172.21.15.84:0/3232540201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90340aee20 msgr2=0x7f903416d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:04.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90340aee20 0x7f903416d870 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f902c00ceb0 tx=0x7f902c007870 comp rx=0 tx=0).stop 2023-10-06T03:27:04.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 -- 172.21.15.84:0/3232540201 shutdown_connections 2023-10-06T03:27:04.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9020066f30 0x7f90200693e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:04.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f903406ed20 0x7f90340ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:04.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90340aee20 0x7f903416d870 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:04.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 --2- 172.21.15.84:0/3232540201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f903406f0f0 0x7f90340aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:04.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 -- 172.21.15.84:0/3232540201 >> 172.21.15.84:0/3232540201 conn(0x7f9034068330 msgr2=0x7f90340b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:04.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 -- 172.21.15.84:0/3232540201 shutdown_connections 2023-10-06T03:27:04.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.448+0000 7f903a77d700 1 -- 172.21.15.84:0/3232540201 wait complete. 2023-10-06T03:27:04.454 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T03:27:04.465 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:27:04.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.588+0000 7f1107e32700 1 Processor -- start 2023-10-06T03:27:04.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.588+0000 7f1107e32700 1 -- start start 2023-10-06T03:27:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f1107e32700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11000cbcb0 0x7f11000cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f1107e32700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11000cf610 con 0x7f11001598e0 2023-10-06T03:27:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f1107e32700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11000cf8f0 con 0x7f1100159510 2023-10-06T03:27:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f1107e32700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11000cfbd0 con 0x7f11000cbcb0 2023-10-06T03:27:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f11063cf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11000cbcb0 0x7f11000cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f11053cd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f11001598e0 0x7f11000ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57874/0 (socket says 172.21.15.84:57874) 2023-10-06T03:27:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f11053cd700 1 -- 172.21.15.84:0/3933229099 learned_addr learned my addr 172.21.15.84:0/3933229099 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f11063cf700 1 -- 172.21.15.84:0/3933229099 >> v1:172.21.15.131:6789/0 conn(0x7f1100159510 legacy=0x7f11000cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f11063cf700 1 -- 172.21.15.84:0/3933229099 >> v1:172.21.15.84:6789/0 conn(0x7f11001598e0 legacy=0x7f11000ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f11063cf700 1 -- 172.21.15.84:0/3933229099 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000cfeb0 con 0x7f11000cbcb0 2023-10-06T03:27:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.589+0000 7f1104bcc700 1 -- 172.21.15.84:0/3933229099 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392884652 0 0) 0x7f11000cf610 con 0x7f11001598e0 2023-10-06T03:27:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f11063cf700 1 --2- 172.21.15.84:0/3933229099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11000cbcb0 0x7f11000cef30 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f10f80098e0 tx=0x7f10f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdbb3b8fa7c09e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f1104bcc700 1 -- 172.21.15.84:0/3933229099 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8009e80 con 0x7f11000cbcb0 2023-10-06T03:27:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f1104bcc700 1 -- 172.21.15.84:0/3933229099 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f800b820 con 0x7f11000cbcb0 2023-10-06T03:27:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f1104bcc700 1 -- 172.21.15.84:0/3933229099 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f800bbe0 con 0x7f11000cbcb0 2023-10-06T03:27:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f1107e32700 1 -- 172.21.15.84:0/3933229099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11000cbcb0 msgr2=0x7f11000cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f1107e32700 1 --2- 172.21.15.84:0/3933229099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11000cbcb0 0x7f11000cef30 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f10f80098e0 tx=0x7f10f80091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f1107e32700 1 -- 172.21.15.84:0/3933229099 shutdown_connections 2023-10-06T03:27:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f1107e32700 1 --2- 172.21.15.84:0/3933229099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11000cbcb0 0x7f11000cef30 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f1107e32700 1 -- 172.21.15.84:0/3933229099 >> 172.21.15.84:0/3933229099 conn(0x7f1100089e90 msgr2=0x7f11000997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f1107e32700 1 -- 172.21.15.84:0/3933229099 shutdown_connections 2023-10-06T03:27:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.590+0000 7f1107e32700 1 -- 172.21.15.84:0/3933229099 wait complete. 2023-10-06T03:27:04.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.591+0000 7f1107e32700 1 Processor -- start 2023-10-06T03:27:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.591+0000 7f1107e32700 1 -- start start 2023-10-06T03:27:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.592+0000 7f1107e32700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11000cbcb0 0x7f110015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.592+0000 7f1107e32700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1100159510 0x7f11000b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.592+0000 7f1107e32700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11001598e0 0x7f110014f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.592+0000 7f1107e32700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110015a790 con 0x7f1100159510 2023-10-06T03:27:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.592+0000 7f1107e32700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110015aa70 con 0x7f11001598e0 2023-10-06T03:27:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.592+0000 7f1107e32700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110015ad50 con 0x7f11000cbcb0 2023-10-06T03:27:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.592+0000 7f11053cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1100159510 0x7f11000b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.592+0000 7f11053cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1100159510 0x7f11000b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34160/0 (socket says 172.21.15.84:34160) 2023-10-06T03:27:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.592+0000 7f11053cd700 1 -- 172.21.15.84:0/3327550344 learned_addr learned my addr 172.21.15.84:0/3327550344 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.592+0000 7f1105bce700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11000cbcb0 0x7f110015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f11063cf700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11001598e0 0x7f110014f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f11053cd700 1 -- 172.21.15.84:0/3327550344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11000cbcb0 msgr2=0x7f110015bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f11053cd700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11000cbcb0 0x7f110015bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f11053cd700 1 -- 172.21.15.84:0/3327550344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11001598e0 msgr2=0x7f110014f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f11053cd700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11001598e0 0x7f110014f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f11053cd700 1 -- 172.21.15.84:0/3327550344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f8009420 con 0x7f1100159510 2023-10-06T03:27:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f11063cf700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11001598e0 0x7f110014f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f11053cd700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1100159510 0x7f11000b34b0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f10f400c510 tx=0x7f10f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f10fdffb700 1 -- 172.21.15.84:0/3327550344 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4005b30 con 0x7f1100159510 2023-10-06T03:27:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f10fdffb700 1 -- 172.21.15.84:0/3327550344 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4005c90 con 0x7f1100159510 2023-10-06T03:27:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f1107e32700 1 -- 172.21.15.84:0/3327550344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110015b030 con 0x7f1100159510 2023-10-06T03:27:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f10fdffb700 1 -- 172.21.15.84:0/3327550344 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4007300 con 0x7f1100159510 2023-10-06T03:27:04.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.593+0000 7f1107e32700 1 -- 172.21.15.84:0/3327550344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110015c480 con 0x7f1100159510 2023-10-06T03:27:04.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.594+0000 7f1107e32700 1 -- 172.21.15.84:0/3327550344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1100064ad0 con 0x7f1100159510 2023-10-06T03:27:04.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.594+0000 7f10fdffb700 1 -- 172.21.15.84:0/3327550344 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10f401b3b0 con 0x7f1100159510 2023-10-06T03:27:04.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.595+0000 7f10fdffb700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f10ec066f30 0x7f10ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:04.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.595+0000 7f10fdffb700 1 -- 172.21.15.84:0/3327550344 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f10f4083b20 con 0x7f1100159510 2023-10-06T03:27:04.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.595+0000 7f1105bce700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f10ec066f30 0x7f10ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:04.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.595+0000 7f1105bce700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f10ec066f30 0x7f10ec0693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1100156a40 tx=0x7f10f0009620 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:04.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.599+0000 7f10fdffb700 1 -- 172.21.15.84:0/3327550344 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10f4050cd0 con 0x7f1100159510 2023-10-06T03:27:04.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:04.782+0000 7f1107e32700 1 -- 172.21.15.84:0/3327550344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f11000c66e0 con 0x7f1100159510 2023-10-06T03:27:05.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.452+0000 7f10fdffb700 1 -- 172.21.15.84:0/3327550344 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) v1 ==== 170+0+0 (secure 0 0 0) 0x7f10f4017020 con 0x7f1100159510 2023-10-06T03:27:05.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.456+0000 7f1107e32700 1 -- 172.21.15.84:0/3327550344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f10ec066f30 msgr2=0x7f10ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:05.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.456+0000 7f1107e32700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f10ec066f30 0x7f10ec0693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1100156a40 tx=0x7f10f0009620 comp rx=0 tx=0).stop 2023-10-06T03:27:05.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.456+0000 7f1107e32700 1 -- 172.21.15.84:0/3327550344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1100159510 msgr2=0x7f11000b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.456+0000 7f1107e32700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1100159510 0x7f11000b34b0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f10f400c510 tx=0x7f10f400c8d0 comp rx=0 tx=0).stop 2023-10-06T03:27:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.458+0000 7f1107e32700 1 -- 172.21.15.84:0/3327550344 shutdown_connections 2023-10-06T03:27:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.458+0000 7f1107e32700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f10ec066f30 0x7f10ec0693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.458+0000 7f1107e32700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11001598e0 0x7f110014f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.458+0000 7f1107e32700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11000cbcb0 0x7f110015bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.458+0000 7f1107e32700 1 --2- 172.21.15.84:0/3327550344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1100159510 0x7f11000b34b0 secure :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f10f400c510 tx=0x7f10f400c8d0 comp rx=0 tx=0).stop 2023-10-06T03:27:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.458+0000 7f1107e32700 1 -- 172.21.15.84:0/3327550344 >> 172.21.15.84:0/3327550344 conn(0x7f1100089e90 msgr2=0x7f11000ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:05.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.462+0000 7f1107e32700 1 -- 172.21.15.84:0/3327550344 shutdown_connections 2023-10-06T03:27:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.462+0000 7f1107e32700 1 -- 172.21.15.84:0/3327550344 wait complete. 2023-10-06T03:27:05.471 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T03:27:05.483 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:27:05.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.599+0000 7f9d66f83700 1 Processor -- start 2023-10-06T03:27:05.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.599+0000 7f9d66f83700 1 -- start start 2023-10-06T03:27:05.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d66f83700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9d600cce90 0x7f9d60068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:05.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d66f83700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d600c96b0 con 0x7f9d600b0860 2023-10-06T03:27:05.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d66f83700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d60159c40 con 0x7f9d600c4490 2023-10-06T03:27:05.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d66f83700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d600c8aa0 con 0x7f9d600cce90 2023-10-06T03:27:05.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d64d1f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9d600b0860 0x7f9d600cec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57888/0 (socket says 172.21.15.84:57888) 2023-10-06T03:27:05.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d64d1f700 1 -- 172.21.15.84:0/3175180350 learned_addr learned my addr 172.21.15.84:0/3175180350 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:05.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d65520700 1 --2- 172.21.15.84:0/3175180350 >> v2:172.21.15.131:3300/0 conn(0x7f9d600cce90 0x7f9d60068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:05.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d5f7fe700 1 -- 172.21.15.84:0/3175180350 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340533097 0 0) 0x7f9d600c96b0 con 0x7f9d600b0860 2023-10-06T03:27:05.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d5f7fe700 1 -- 172.21.15.84:0/3175180350 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d4c003570 con 0x7f9d600b0860 2023-10-06T03:27:05.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d5f7fe700 1 -- 172.21.15.84:0/3175180350 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916119809 0 0) 0x7f9d60159c40 con 0x7f9d600c4490 2023-10-06T03:27:05.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d5f7fe700 1 -- 172.21.15.84:0/3175180350 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d600c96b0 con 0x7f9d600c4490 2023-10-06T03:27:05.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d5f7fe700 1 -- 172.21.15.84:0/3175180350 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2869298578 0 0) 0x7f9d4c003570 con 0x7f9d600b0860 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d65520700 1 -- 172.21.15.84:0/3175180350 >> v1:172.21.15.131:6789/0 conn(0x7f9d600c4490 legacy=0x7f9d600cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d65520700 1 -- 172.21.15.84:0/3175180350 >> v1:172.21.15.84:6789/0 conn(0x7f9d600b0860 legacy=0x7f9d600cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.600+0000 7f9d65520700 1 -- 172.21.15.84:0/3175180350 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600c8d80 con 0x7f9d600cce90 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d65520700 1 --2- 172.21.15.84:0/3175180350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d600cce90 0x7f9d60068700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9d480098e0 tx=0x7f9d480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53cf954e7369b0c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d5f7fe700 1 -- 172.21.15.84:0/3175180350 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d580015f0 con 0x7f9d600cce90 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d5f7fe700 1 -- 172.21.15.84:0/3175180350 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48011420 con 0x7f9d600cce90 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d5f7fe700 1 -- 172.21.15.84:0/3175180350 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d480117a0 con 0x7f9d600cce90 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d66f83700 1 -- 172.21.15.84:0/3175180350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d600cce90 msgr2=0x7f9d60068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d66f83700 1 --2- 172.21.15.84:0/3175180350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d600cce90 0x7f9d60068700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9d480098e0 tx=0x7f9d480091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d66f83700 1 -- 172.21.15.84:0/3175180350 shutdown_connections 2023-10-06T03:27:05.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d66f83700 1 --2- 172.21.15.84:0/3175180350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d600cce90 0x7f9d60068700 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d66f83700 1 -- 172.21.15.84:0/3175180350 >> 172.21.15.84:0/3175180350 conn(0x7f9d60088000 msgr2=0x7f9d600ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d66f83700 1 -- 172.21.15.84:0/3175180350 shutdown_connections 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.601+0000 7f9d66f83700 1 -- 172.21.15.84:0/3175180350 wait complete. 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.602+0000 7f9d66f83700 1 Processor -- start 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.603+0000 7f9d66f83700 1 -- start start 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.603+0000 7f9d66f83700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d600b0860 0x7f9d6015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.603+0000 7f9d66f83700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d600c4490 0x7f9d600c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.603+0000 7f9d66f83700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d600cce90 0x7f9d60157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.603+0000 7f9d66f83700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015ba80 con 0x7f9d600cce90 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.603+0000 7f9d66f83700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600c72d0 con 0x7f9d600c4490 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.603+0000 7f9d66f83700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6016d080 con 0x7f9d600b0860 2023-10-06T03:27:05.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.603+0000 7f9d65520700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d600cce90 0x7f9d60157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.603+0000 7f9d65520700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d600cce90 0x7f9d60157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34162/0 (socket says 172.21.15.84:34162) 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d65520700 1 -- 172.21.15.84:0/4071979554 learned_addr learned my addr 172.21.15.84:0/4071979554 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d5ffff700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d600c4490 0x7f9d600c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d64d1f700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d600b0860 0x7f9d6015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d65520700 1 -- 172.21.15.84:0/4071979554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d600b0860 msgr2=0x7f9d6015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d65520700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d600b0860 0x7f9d6015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d65520700 1 -- 172.21.15.84:0/4071979554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d600c4490 msgr2=0x7f9d600c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d65520700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d600c4490 0x7f9d600c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d65520700 1 -- 172.21.15.84:0/4071979554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48009420 con 0x7f9d600cce90 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d65520700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d600cce90 0x7f9d60157ca0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9d6006e630 tx=0x7f9d48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:05.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d5cff9700 1 -- 172.21.15.84:0/4071979554 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48011780 con 0x7f9d600cce90 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d5cff9700 1 -- 172.21.15.84:0/4071979554 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4801ce30 con 0x7f9d600cce90 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d66f83700 1 -- 172.21.15.84:0/4071979554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6016d360 con 0x7f9d600cce90 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d5cff9700 1 -- 172.21.15.84:0/4071979554 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4801a660 con 0x7f9d600cce90 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.604+0000 7f9d66f83700 1 -- 172.21.15.84:0/4071979554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6016d920 con 0x7f9d600cce90 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.605+0000 7f9d66f83700 1 -- 172.21.15.84:0/4071979554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d60064ad0 con 0x7f9d600cce90 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.605+0000 7f9d5cff9700 1 -- 172.21.15.84:0/4071979554 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d4801a9d0 con 0x7f9d600cce90 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.606+0000 7f9d5cff9700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d40066f30 0x7f9d400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.606+0000 7f9d5cff9700 1 -- 172.21.15.84:0/4071979554 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f9d48086490 con 0x7f9d600cce90 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.606+0000 7f9d64d1f700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d40066f30 0x7f9d400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.606+0000 7f9d64d1f700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d40066f30 0x7f9d400693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9d58000c00 tx=0x7f9d58001660 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.610+0000 7f9d5cff9700 1 -- 172.21.15.84:0/4071979554 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d480534c0 con 0x7f9d600cce90 2023-10-06T03:27:05.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:05.836+0000 7f9d66f83700 1 -- 172.21.15.84:0/4071979554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9d6004bb80 con 0x7f9d600cce90 2023-10-06T03:27:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.452+0000 7f9d5cff9700 1 -- 172.21.15.84:0/4071979554 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v50) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9d48056ae0 con 0x7f9d600cce90 2023-10-06T03:27:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.457+0000 7f9d66f83700 1 -- 172.21.15.84:0/4071979554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d40066f30 msgr2=0x7f9d400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.457+0000 7f9d66f83700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d40066f30 0x7f9d400693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9d58000c00 tx=0x7f9d58001660 comp rx=0 tx=0).stop 2023-10-06T03:27:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.457+0000 7f9d66f83700 1 -- 172.21.15.84:0/4071979554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d600cce90 msgr2=0x7f9d60157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.457+0000 7f9d66f83700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d600cce90 0x7f9d60157ca0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9d6006e630 tx=0x7f9d48016000 comp rx=0 tx=0).stop 2023-10-06T03:27:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.457+0000 7f9d66f83700 1 -- 172.21.15.84:0/4071979554 shutdown_connections 2023-10-06T03:27:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.457+0000 7f9d66f83700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9d40066f30 0x7f9d400693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.457+0000 7f9d66f83700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d600cce90 0x7f9d60157ca0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.457+0000 7f9d66f83700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d600b0860 0x7f9d6015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.457+0000 7f9d66f83700 1 --2- 172.21.15.84:0/4071979554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d600c4490 0x7f9d600c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.457+0000 7f9d66f83700 1 -- 172.21.15.84:0/4071979554 >> 172.21.15.84:0/4071979554 conn(0x7f9d60088000 msgr2=0x7f9d600c30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.458+0000 7f9d66f83700 1 -- 172.21.15.84:0/4071979554 shutdown_connections 2023-10-06T03:27:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.458+0000 7f9d66f83700 1 -- 172.21.15.84:0/4071979554 wait complete. 2023-10-06T03:27:06.463 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 16 and data pool 17 2023-10-06T03:27:06.476 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:27:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.588+0000 7f7896018700 1 Processor -- start 2023-10-06T03:27:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.588+0000 7f7896018700 1 -- start start 2023-10-06T03:27:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.589+0000 7f7896018700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f78900b49e0 0x7f78900aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.589+0000 7f7896018700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78900b07a0 0x7f78900b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.589+0000 7f7896018700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78900b0ca0 con 0x7f78901595a0 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.589+0000 7f7896018700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78900b0f80 con 0x7f78900b49e0 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.589+0000 7f7896018700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b1260 con 0x7f78900b07a0 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.589+0000 7f788effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f78900b49e0 0x7f78900aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.589+0000 7f788effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f78900b49e0 0x7f78900aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34164/0 (socket says 172.21.15.84:34164) 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.589+0000 7f788effd700 1 -- 172.21.15.84:0/1180047424 learned_addr learned my addr 172.21.15.84:0/1180047424 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.589+0000 7f788ffff700 1 --2- 172.21.15.84:0/1180047424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78900b07a0 0x7f78900b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.589+0000 7f788effd700 1 -- 172.21.15.84:0/1180047424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78900b07a0 msgr2=0x7f78900b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f788effd700 1 --2- 172.21.15.84:0/1180047424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78900b07a0 0x7f78900b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f788effd700 1 -- 172.21.15.84:0/1180047424 >> v1:172.21.15.131:6789/0 conn(0x7f78901595a0 legacy=0x7f78900aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f788effd700 1 -- 172.21.15.84:0/1180047424 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900b1540 con 0x7f78900b49e0 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f788ffff700 1 --2- 172.21.15.84:0/1180047424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78900b07a0 0x7f78900b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f788effd700 1 --2- 172.21.15.84:0/1180047424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 0x7f78900aac80 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f78840099e0 tx=0x7f7884009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0e625ace7d6d1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f788e7fc700 1 -- 172.21.15.84:0/1180047424 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400b820 con 0x7f78900b49e0 2023-10-06T03:27:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f788e7fc700 1 -- 172.21.15.84:0/1180047424 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788400b980 con 0x7f78900b49e0 2023-10-06T03:27:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f788e7fc700 1 -- 172.21.15.84:0/1180047424 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400bd20 con 0x7f78900b49e0 2023-10-06T03:27:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f7896018700 1 -- 172.21.15.84:0/1180047424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 msgr2=0x7f78900aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f7896018700 1 --2- 172.21.15.84:0/1180047424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 0x7f78900aac80 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f78840099e0 tx=0x7f7884009250 comp rx=0 tx=0).stop 2023-10-06T03:27:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f7896018700 1 -- 172.21.15.84:0/1180047424 shutdown_connections 2023-10-06T03:27:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f7896018700 1 --2- 172.21.15.84:0/1180047424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78900b07a0 0x7f78900b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f7896018700 1 --2- 172.21.15.84:0/1180047424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 0x7f78900aac80 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f7896018700 1 -- 172.21.15.84:0/1180047424 >> 172.21.15.84:0/1180047424 conn(0x7f7890099830 msgr2=0x7f789006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f7896018700 1 -- 172.21.15.84:0/1180047424 shutdown_connections 2023-10-06T03:27:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.590+0000 7f7896018700 1 -- 172.21.15.84:0/1180047424 wait complete. 2023-10-06T03:27:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f7896018700 1 Processor -- start 2023-10-06T03:27:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f7896018700 1 -- start start 2023-10-06T03:27:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f7896018700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78900b07a0 0x7f789009aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f7896018700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 0x7f789015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f7896018700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78901595a0 0x7f78901567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f7896018700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789009c420 con 0x7f78900b49e0 2023-10-06T03:27:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f7896018700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789009b3a0 con 0x7f78900b07a0 2023-10-06T03:27:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f7896018700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789009b680 con 0x7f78901595a0 2023-10-06T03:27:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f788effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 0x7f789015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f788effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 0x7f789015bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34176/0 (socket says 172.21.15.84:34176) 2023-10-06T03:27:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.592+0000 7f788effd700 1 -- 172.21.15.84:0/3185377641 learned_addr learned my addr 172.21.15.84:0/3185377641 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f788ffff700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78901595a0 0x7f78901567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f788f7fe700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78900b07a0 0x7f789009aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f788effd700 1 -- 172.21.15.84:0/3185377641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78901595a0 msgr2=0x7f78901567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f788effd700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78901595a0 0x7f78901567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f788effd700 1 -- 172.21.15.84:0/3185377641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78900b07a0 msgr2=0x7f789009aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f788effd700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78900b07a0 0x7f789009aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f788effd700 1 -- 172.21.15.84:0/3185377641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78840094f0 con 0x7f78900b49e0 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f788ffff700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78901595a0 0x7f78901567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f788f7fe700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78900b07a0 0x7f789009aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f788effd700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 0x7f789015bb40 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f78840090b0 tx=0x7f7884017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f78777fe700 1 -- 172.21.15.84:0/3185377641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884011e90 con 0x7f78900b49e0 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f78777fe700 1 -- 172.21.15.84:0/3185377641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788401f070 con 0x7f78900b49e0 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f7896018700 1 -- 172.21.15.84:0/3185377641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789009b960 con 0x7f78900b49e0 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f78777fe700 1 -- 172.21.15.84:0/3185377641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840266d0 con 0x7f78900b49e0 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.593+0000 7f7896018700 1 -- 172.21.15.84:0/3185377641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789009bf20 con 0x7f78900b49e0 2023-10-06T03:27:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.594+0000 7f7896018700 1 -- 172.21.15.84:0/3185377641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7890064ad0 con 0x7f78900b49e0 2023-10-06T03:27:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.595+0000 7f78777fe700 1 -- 172.21.15.84:0/3185377641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7884026ac0 con 0x7f78900b49e0 2023-10-06T03:27:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.595+0000 7f78777fe700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f787c066f30 0x7f787c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.595+0000 7f78777fe700 1 -- 172.21.15.84:0/3185377641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7884021070 con 0x7f78900b49e0 2023-10-06T03:27:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.595+0000 7f788f7fe700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f787c066f30 0x7f787c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.595+0000 7f788f7fe700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f787c066f30 0x7f787c0693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f788000d220 tx=0x7f7880009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.599+0000 7f78777fe700 1 -- 172.21.15.84:0/3185377641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7884053680 con 0x7f78900b49e0 2023-10-06T03:27:06.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.782+0000 7f7896018700 1 -- 172.21.15.84:0/3185377641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78900b1820 con 0x7f78900b49e0 2023-10-06T03:27:06.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.783+0000 7f78777fe700 1 -- 172.21.15.84:0/3185377641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f7884056ca0 con 0x7f78900b49e0 2023-10-06T03:27:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:06.785 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":97,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:27:05.838392+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:27:03.480044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:27:04.800908+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:27:06.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 -- 172.21.15.84:0/3185377641 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f787c066f30 msgr2=0x7f787c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f787c066f30 0x7f787c0693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f788000d220 tx=0x7f7880009040 comp rx=0 tx=0).stop 2023-10-06T03:27:06.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 -- 172.21.15.84:0/3185377641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 msgr2=0x7f789015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 0x7f789015bb40 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f78840090b0 tx=0x7f7884017000 comp rx=0 tx=0).stop 2023-10-06T03:27:06.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 -- 172.21.15.84:0/3185377641 shutdown_connections 2023-10-06T03:27:06.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f787c066f30 0x7f787c0693e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78900b07a0 0x7f789009aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78901595a0 0x7f78901567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 --2- 172.21.15.84:0/3185377641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78900b49e0 0x7f789015bb40 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 -- 172.21.15.84:0/3185377641 >> 172.21.15.84:0/3185377641 conn(0x7f7890099830 msgr2=0x7f78900694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:06.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 -- 172.21.15.84:0/3185377641 shutdown_connections 2023-10-06T03:27:06.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.785+0000 7f7896018700 1 -- 172.21.15.84:0/3185377641 wait complete. 2023-10-06T03:27:06.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:27:06.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.911+0000 7eff9a9f8700 1 Processor -- start 2023-10-06T03:27:06.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.911+0000 7eff9a9f8700 1 -- start start 2023-10-06T03:27:06.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff9a9f8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff94159480 0x7eff940b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff9a9f8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7eff940b3610 0x7eff940cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff9a9f8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff940cb7e0 con 0x7eff940cc1b0 2023-10-06T03:27:06.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff9a9f8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff940b08a0 con 0x7eff94159480 2023-10-06T03:27:06.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff9a9f8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff940cb190 con 0x7eff940b3610 2023-10-06T03:27:06.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff999f6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff94159480 0x7eff940b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff999f6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff94159480 0x7eff940b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34192/0 (socket says 172.21.15.84:34192) 2023-10-06T03:27:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff9a1f7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7eff940cc1b0 0x7eff940b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57890/0 (socket says 172.21.15.84:57890) 2023-10-06T03:27:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff999f6700 1 -- 172.21.15.84:0/570830104 learned_addr learned my addr 172.21.15.84:0/570830104 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff991f5700 1 --2- 172.21.15.84:0/570830104 >> v2:172.21.15.131:3300/0 conn(0x7eff940b3610 0x7eff940cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff999f6700 1 -- 172.21.15.84:0/570830104 >> v2:172.21.15.131:3300/0 conn(0x7eff940b3610 msgr2=0x7eff940cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff999f6700 1 --2- 172.21.15.84:0/570830104 >> v2:172.21.15.131:3300/0 conn(0x7eff940b3610 0x7eff940cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff999f6700 1 -- 172.21.15.84:0/570830104 >> v1:172.21.15.84:6789/0 conn(0x7eff940cc1b0 legacy=0x7eff940b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.912+0000 7eff989f4700 1 -- 172.21.15.84:0/570830104 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354485269 0 0) 0x7eff940cb7e0 con 0x7eff940cc1b0 2023-10-06T03:27:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff999f6700 1 -- 172.21.15.84:0/570830104 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940cb470 con 0x7eff94159480 2023-10-06T03:27:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff999f6700 1 --2- 172.21.15.84:0/570830104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff94159480 0x7eff940b30d0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7eff940d0260 tx=0x7eff90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c574002d6fc75c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff989f4700 1 -- 172.21.15.84:0/570830104 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9000b860 con 0x7eff94159480 2023-10-06T03:27:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff989f4700 1 -- 172.21.15.84:0/570830104 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9000b9c0 con 0x7eff94159480 2023-10-06T03:27:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff989f4700 1 -- 172.21.15.84:0/570830104 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9000bd60 con 0x7eff94159480 2023-10-06T03:27:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff9a9f8700 1 -- 172.21.15.84:0/570830104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff94159480 msgr2=0x7eff940b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff9a9f8700 1 --2- 172.21.15.84:0/570830104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff94159480 0x7eff940b30d0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7eff940d0260 tx=0x7eff90009250 comp rx=0 tx=0).stop 2023-10-06T03:27:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff9a9f8700 1 -- 172.21.15.84:0/570830104 shutdown_connections 2023-10-06T03:27:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff9a9f8700 1 --2- 172.21.15.84:0/570830104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff94159480 0x7eff940b30d0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff9a9f8700 1 --2- 172.21.15.84:0/570830104 >> v2:172.21.15.131:3300/0 conn(0x7eff940b3610 0x7eff940cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff9a9f8700 1 -- 172.21.15.84:0/570830104 >> 172.21.15.84:0/570830104 conn(0x7eff9406ed20 msgr2=0x7eff9406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff9a9f8700 1 -- 172.21.15.84:0/570830104 shutdown_connections 2023-10-06T03:27:06.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.913+0000 7eff9a9f8700 1 -- 172.21.15.84:0/570830104 wait complete. 2023-10-06T03:27:06.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.914+0000 7eff9a9f8700 1 Processor -- start 2023-10-06T03:27:06.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff9a9f8700 1 -- start start 2023-10-06T03:27:06.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff9a9f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff940b3610 0x7eff940c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff9a9f8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff940cc1b0 0x7eff94159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff9a9f8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff94159480 0x7eff9415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff9a9f8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff940c75b0 con 0x7eff940b3610 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff9a9f8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff940c9f30 con 0x7eff940cc1b0 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff9a9f8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940c9320 con 0x7eff94159480 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff999f6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff940b3610 0x7eff940c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff999f6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff940b3610 0x7eff940c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34208/0 (socket says 172.21.15.84:34208) 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff999f6700 1 -- 172.21.15.84:0/2815873192 learned_addr learned my addr 172.21.15.84:0/2815873192 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff991f5700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff940cc1b0 0x7eff94159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.915+0000 7eff9a1f7700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff94159480 0x7eff9415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff999f6700 1 -- 172.21.15.84:0/2815873192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff94159480 msgr2=0x7eff9415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff999f6700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff94159480 0x7eff9415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff999f6700 1 -- 172.21.15.84:0/2815873192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff940cc1b0 msgr2=0x7eff94159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff999f6700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff940cc1b0 0x7eff94159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff999f6700 1 -- 172.21.15.84:0/2815873192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff900094f0 con 0x7eff940b3610 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff991f5700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff940cc1b0 0x7eff94159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff999f6700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff940b3610 0x7eff940c8ab0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7eff90009290 tx=0x7eff90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff89ffb700 1 -- 172.21.15.84:0/2815873192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90026450 con 0x7eff940b3610 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff89ffb700 1 -- 172.21.15.84:0/2815873192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff900265b0 con 0x7eff940b3610 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff9a9f8700 1 -- 172.21.15.84:0/2815873192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff940c9600 con 0x7eff940b3610 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff89ffb700 1 -- 172.21.15.84:0/2815873192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90026970 con 0x7eff940b3610 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.916+0000 7eff9a9f8700 1 -- 172.21.15.84:0/2815873192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff940c8ff0 con 0x7eff940b3610 2023-10-06T03:27:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.917+0000 7eff9a9f8700 1 -- 172.21.15.84:0/2815873192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff940c9810 con 0x7eff940b3610 2023-10-06T03:27:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.917+0000 7eff89ffb700 1 -- 172.21.15.84:0/2815873192 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff900303f0 con 0x7eff940b3610 2023-10-06T03:27:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.918+0000 7eff89ffb700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff78066f30 0x7eff780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.918+0000 7eff991f5700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff78066f30 0x7eff780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.918+0000 7eff89ffb700 1 -- 172.21.15.84:0/2815873192 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6378+0+0 (secure 0 0 0) 0x7eff90086470 con 0x7eff940b3610 2023-10-06T03:27:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.918+0000 7eff991f5700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff78066f30 0x7eff780693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7eff9415d090 tx=0x7eff84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:06.922+0000 7eff89ffb700 1 -- 172.21.15.84:0/2815873192 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff900534c0 con 0x7eff940b3610 2023-10-06T03:27:07.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.104+0000 7eff9a9f8700 1 -- 172.21.15.84:0/2815873192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff9405f270 con 0x7eff940b3610 2023-10-06T03:27:07.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.105+0000 7eff89ffb700 1 -- 172.21.15.84:0/2815873192 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17087 (secure 0 0 0) 0x7eff90056ae0 con 0x7eff940b3610 2023-10-06T03:27:07.107 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:07.107 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":97,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:27:05.838392+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:27:03.480044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:27:04.800908+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:27:07.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 -- 172.21.15.84:0/2815873192 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff78066f30 msgr2=0x7eff780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:07.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff78066f30 0x7eff780693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7eff9415d090 tx=0x7eff84008040 comp rx=0 tx=0).stop 2023-10-06T03:27:07.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 -- 172.21.15.84:0/2815873192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff940b3610 msgr2=0x7eff940c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:07.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff940b3610 0x7eff940c8ab0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7eff90009290 tx=0x7eff90017000 comp rx=0 tx=0).stop 2023-10-06T03:27:07.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 -- 172.21.15.84:0/2815873192 shutdown_connections 2023-10-06T03:27:07.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7eff78066f30 0x7eff780693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:07.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff94159480 0x7eff9415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:07.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff940b3610 0x7eff940c8ab0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:07.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 --2- 172.21.15.84:0/2815873192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff940cc1b0 0x7eff94159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:07.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 -- 172.21.15.84:0/2815873192 >> 172.21.15.84:0/2815873192 conn(0x7eff9406ed20 msgr2=0x7eff940cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:07.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 -- 172.21.15.84:0/2815873192 shutdown_connections 2023-10-06T03:27:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.108+0000 7eff9a9f8700 1 -- 172.21.15.84:0/2815873192 wait complete. 2023-10-06T03:27:07.122 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:27:07.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.237+0000 7ff45ee7c700 1 Processor -- start 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.237+0000 7ff45ee7c700 1 -- start start 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45ee7c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff458159510 0x7ff4580cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45ee7c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4580cbae0 0x7ff4580cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45ee7c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4580cbef0 con 0x7ff4581598e0 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45ee7c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4580cf610 con 0x7ff458159510 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45ee7c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580cf8f0 con 0x7ff4580cbae0 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45cc18700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff458159510 0x7ff4580cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45cc18700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff458159510 0x7ff4580cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34220/0 (socket says 172.21.15.84:34220) 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45cc18700 1 -- 172.21.15.84:0/2933691430 learned_addr learned my addr 172.21.15.84:0/2933691430 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45cc18700 1 -- 172.21.15.84:0/2933691430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4580cbae0 msgr2=0x7ff4580cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:07.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45d419700 1 --2- 172.21.15.84:0/2933691430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4580cbae0 0x7ff4580cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:07.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45cc18700 1 --2- 172.21.15.84:0/2933691430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4580cbae0 0x7ff4580cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:07.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45cc18700 1 -- 172.21.15.84:0/2933691430 >> v1:172.21.15.131:6789/0 conn(0x7ff4581598e0 legacy=0x7ff4580ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:07.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.238+0000 7ff45cc18700 1 -- 172.21.15.84:0/2933691430 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580cfbd0 con 0x7ff458159510 2023-10-06T03:27:07.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff45d419700 1 --2- 172.21.15.84:0/2933691430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4580cbae0 0x7ff4580cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:07.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff45cc18700 1 --2- 172.21.15.84:0/2933691430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458159510 0x7ff4580cb5a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff4540099b0 tx=0x7ff454009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac0c8656247c4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:07.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff44f7fe700 1 -- 172.21.15.84:0/2933691430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45400b820 con 0x7ff458159510 2023-10-06T03:27:07.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff44f7fe700 1 -- 172.21.15.84:0/2933691430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45400b980 con 0x7ff458159510 2023-10-06T03:27:07.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff44f7fe700 1 -- 172.21.15.84:0/2933691430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45400bd20 con 0x7ff458159510 2023-10-06T03:27:07.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff45ee7c700 1 -- 172.21.15.84:0/2933691430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458159510 msgr2=0x7ff4580cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:07.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff45ee7c700 1 --2- 172.21.15.84:0/2933691430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458159510 0x7ff4580cb5a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff4540099b0 tx=0x7ff454009250 comp rx=0 tx=0).stop 2023-10-06T03:27:07.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff45ee7c700 1 -- 172.21.15.84:0/2933691430 shutdown_connections 2023-10-06T03:27:07.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff45ee7c700 1 --2- 172.21.15.84:0/2933691430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4580cbae0 0x7ff4580cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:07.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff45ee7c700 1 --2- 172.21.15.84:0/2933691430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458159510 0x7ff4580cb5a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:07.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff45ee7c700 1 -- 172.21.15.84:0/2933691430 >> 172.21.15.84:0/2933691430 conn(0x7ff458089e90 msgr2=0x7ff4580997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:07.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff45ee7c700 1 -- 172.21.15.84:0/2933691430 shutdown_connections 2023-10-06T03:27:07.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.239+0000 7ff45ee7c700 1 -- 172.21.15.84:0/2933691430 wait complete. 2023-10-06T03:27:07.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.240+0000 7ff45ee7c700 1 Processor -- start 2023-10-06T03:27:07.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.241+0000 7ff45ee7c700 1 -- start start 2023-10-06T03:27:07.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.241+0000 7ff45ee7c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4580cbae0 0x7ff458146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:07.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.241+0000 7ff45ee7c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff458159510 0x7ff458068400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:07.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.241+0000 7ff45ee7c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4581598e0 0x7ff458068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:07.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.241+0000 7ff45ee7c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580c89a0 con 0x7ff4580cbae0 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.241+0000 7ff45ee7c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580c8c80 con 0x7ff458159510 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.241+0000 7ff45ee7c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580c8f60 con 0x7ff4581598e0 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.241+0000 7ff45cc18700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4580cbae0 0x7ff458146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.241+0000 7ff45cc18700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4580cbae0 0x7ff458146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34226/0 (socket says 172.21.15.84:34226) 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.241+0000 7ff45cc18700 1 -- 172.21.15.84:0/3976877594 learned_addr learned my addr 172.21.15.84:0/3976877594 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff45d419700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4581598e0 0x7ff458068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff44ffff700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff458159510 0x7ff458068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff45cc18700 1 -- 172.21.15.84:0/3976877594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4581598e0 msgr2=0x7ff458068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff45cc18700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4581598e0 0x7ff458068940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff45cc18700 1 -- 172.21.15.84:0/3976877594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff458159510 msgr2=0x7ff458068400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:07.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff45cc18700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff458159510 0x7ff458068400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff45cc18700 1 -- 172.21.15.84:0/3976877594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540094f0 con 0x7ff4580cbae0 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff45cc18700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4580cbae0 0x7ff458146fe0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ff454009290 tx=0x7ff454016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff44cff9700 1 -- 172.21.15.84:0/3976877594 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454011d70 con 0x7ff4580cbae0 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff44cff9700 1 -- 172.21.15.84:0/3976877594 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff454020070 con 0x7ff4580cbae0 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff45ee7c700 1 -- 172.21.15.84:0/3976877594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4580c9240 con 0x7ff4580cbae0 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff44cff9700 1 -- 172.21.15.84:0/3976877594 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45401b6a0 con 0x7ff4580cbae0 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.242+0000 7ff45ee7c700 1 -- 172.21.15.84:0/3976877594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff458147520 con 0x7ff4580cbae0 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.243+0000 7ff45ee7c700 1 -- 172.21.15.84:0/3976877594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff458064ad0 con 0x7ff4580cbae0 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.243+0000 7ff44cff9700 1 -- 172.21.15.84:0/3976877594 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff454022030 con 0x7ff4580cbae0 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.244+0000 7ff44cff9700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff444066f30 0x7ff4440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:07.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.244+0000 7ff44cff9700 1 -- 172.21.15.84:0/3976877594 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff454086720 con 0x7ff4580cbae0 2023-10-06T03:27:07.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.244+0000 7ff44ffff700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff444066f30 0x7ff4440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:07.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.244+0000 7ff44ffff700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff444066f30 0x7ff4440693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff448006fd0 tx=0x7ff448008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:07.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.248+0000 7ff44cff9700 1 -- 172.21.15.84:0/3976877594 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4540536f0 con 0x7ff4580cbae0 2023-10-06T03:27:07.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:07.475+0000 7ff45ee7c700 1 -- 172.21.15.84:0/3976877594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff458064ad0 con 0x7ff4580cbae0 2023-10-06T03:27:08.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.465+0000 7ff44cff9700 1 -- 172.21.15.84:0/3976877594 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff454056d10 con 0x7ff4580cbae0 2023-10-06T03:27:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 -- 172.21.15.84:0/3976877594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff444066f30 msgr2=0x7ff4440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff444066f30 0x7ff4440693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff448006fd0 tx=0x7ff448008040 comp rx=0 tx=0).stop 2023-10-06T03:27:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 -- 172.21.15.84:0/3976877594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4580cbae0 msgr2=0x7ff458146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4580cbae0 0x7ff458146fe0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ff454009290 tx=0x7ff454016000 comp rx=0 tx=0).stop 2023-10-06T03:27:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 -- 172.21.15.84:0/3976877594 shutdown_connections 2023-10-06T03:27:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff444066f30 0x7ff4440693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4581598e0 0x7ff458068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4580cbae0 0x7ff458146fe0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 --2- 172.21.15.84:0/3976877594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff458159510 0x7ff458068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 -- 172.21.15.84:0/3976877594 >> 172.21.15.84:0/3976877594 conn(0x7ff458089e90 msgr2=0x7ff4580997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 -- 172.21.15.84:0/3976877594 shutdown_connections 2023-10-06T03:27:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.468+0000 7ff45ee7c700 1 -- 172.21.15.84:0/3976877594 wait complete. 2023-10-06T03:27:08.483 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:27:08.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.600+0000 7fdc9bf4a700 1 Processor -- start 2023-10-06T03:27:08.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.600+0000 7fdc9bf4a700 1 -- start start 2023-10-06T03:27:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.601+0000 7fdc9bf4a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc940cbc40 0x7fdc94164180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.601+0000 7fdc9bf4a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc940afbe0 con 0x7fdc94159710 2023-10-06T03:27:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.601+0000 7fdc9bf4a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc940cf820 con 0x7fdc94159340 2023-10-06T03:27:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.601+0000 7fdc9bf4a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc940cfb00 con 0x7fdc940cbc40 2023-10-06T03:27:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.601+0000 7fdc994e5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdc94159710 0x7fdc940cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57900/0 (socket says 172.21.15.84:57900) 2023-10-06T03:27:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.601+0000 7fdc994e5700 1 -- 172.21.15.84:0/4226600099 learned_addr learned my addr 172.21.15.84:0/4226600099 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.601+0000 7fdc9a4e7700 1 --2- 172.21.15.84:0/4226600099 >> v2:172.21.15.131:3300/0 conn(0x7fdc940cbc40 0x7fdc94164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.601+0000 7fdc98ce4700 1 -- 172.21.15.84:0/4226600099 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689300833 0 0) 0x7fdc84001110 con 0x7fdc94159710 2023-10-06T03:27:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.601+0000 7fdc98ce4700 1 -- 172.21.15.84:0/4226600099 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc80003570 con 0x7fdc94159710 2023-10-06T03:27:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.602+0000 7fdc98ce4700 1 -- 172.21.15.84:0/4226600099 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628054262 0 0) 0x7fdc940cf820 con 0x7fdc94159340 2023-10-06T03:27:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.602+0000 7fdc98ce4700 1 -- 172.21.15.84:0/4226600099 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc84001110 con 0x7fdc94159340 2023-10-06T03:27:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.602+0000 7fdc98ce4700 1 -- 172.21.15.84:0/4226600099 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2708225037 0 0) 0x7fdc80003570 con 0x7fdc94159710 2023-10-06T03:27:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.602+0000 7fdc9a4e7700 1 -- 172.21.15.84:0/4226600099 >> v1:172.21.15.131:6789/0 conn(0x7fdc94159340 legacy=0x7fdc940af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.602+0000 7fdc9a4e7700 1 -- 172.21.15.84:0/4226600099 >> v1:172.21.15.84:6789/0 conn(0x7fdc94159710 legacy=0x7fdc940cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.602+0000 7fdc9a4e7700 1 -- 172.21.15.84:0/4226600099 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940cfde0 con 0x7fdc940cbc40 2023-10-06T03:27:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.602+0000 7fdc9a4e7700 1 --2- 172.21.15.84:0/4226600099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc940cbc40 0x7fdc94164180 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009e90 tx=0x7fdc8c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=948a7e344e9fbc96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.602+0000 7fdc98ce4700 1 -- 172.21.15.84:0/4226600099 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00e070 con 0x7fdc940cbc40 2023-10-06T03:27:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.602+0000 7fdc98ce4700 1 -- 172.21.15.84:0/4226600099 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00b870 con 0x7fdc940cbc40 2023-10-06T03:27:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.602+0000 7fdc98ce4700 1 -- 172.21.15.84:0/4226600099 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84001600 con 0x7fdc940cbc40 2023-10-06T03:27:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.603+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/4226600099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc940cbc40 msgr2=0x7fdc94164180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.603+0000 7fdc9bf4a700 1 --2- 172.21.15.84:0/4226600099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc940cbc40 0x7fdc94164180 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009e90 tx=0x7fdc8c009780 comp rx=0 tx=0).stop 2023-10-06T03:27:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.603+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/4226600099 shutdown_connections 2023-10-06T03:27:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.603+0000 7fdc9bf4a700 1 --2- 172.21.15.84:0/4226600099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc940cbc40 0x7fdc94164180 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.603+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/4226600099 >> 172.21.15.84:0/4226600099 conn(0x7fdc94099720 msgr2=0x7fdc9406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.603+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/4226600099 shutdown_connections 2023-10-06T03:27:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.603+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/4226600099 wait complete. 2023-10-06T03:27:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.604+0000 7fdc9bf4a700 1 Processor -- start 2023-10-06T03:27:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.604+0000 7fdc9bf4a700 1 -- start start 2023-10-06T03:27:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.604+0000 7fdc9bf4a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc940cbc40 0x7fdc9414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.604+0000 7fdc9bf4a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc94159340 0x7fdc94153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.604+0000 7fdc9bf4a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94159710 0x7fdc94153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.604+0000 7fdc9bf4a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9414b680 con 0x7fdc94159710 2023-10-06T03:27:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.604+0000 7fdc9bf4a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94154e30 con 0x7fdc94159340 2023-10-06T03:27:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.604+0000 7fdc9bf4a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940ae2f0 con 0x7fdc940cbc40 2023-10-06T03:27:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9a4e7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94159710 0x7fdc94153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9a4e7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94159710 0x7fdc94153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34228/0 (socket says 172.21.15.84:34228) 2023-10-06T03:27:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9a4e7700 1 -- 172.21.15.84:0/2851081701 learned_addr learned my addr 172.21.15.84:0/2851081701 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc994e5700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc94159340 0x7fdc94153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc99ce6700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc940cbc40 0x7fdc9414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9a4e7700 1 -- 172.21.15.84:0/2851081701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc940cbc40 msgr2=0x7fdc9414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9a4e7700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc940cbc40 0x7fdc9414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9a4e7700 1 -- 172.21.15.84:0/2851081701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc94159340 msgr2=0x7fdc94153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9a4e7700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc94159340 0x7fdc94153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9a4e7700 1 -- 172.21.15.84:0/2851081701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c009a20 con 0x7fdc94159710 2023-10-06T03:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9a4e7700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94159710 0x7fdc94153b80 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c003000 tx=0x7fdc8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc89ffb700 1 -- 172.21.15.84:0/2851081701 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c012cd0 con 0x7fdc94159710 2023-10-06T03:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc89ffb700 1 -- 172.21.15.84:0/2851081701 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c012e50 con 0x7fdc94159710 2023-10-06T03:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/2851081701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc94154220 con 0x7fdc94159710 2023-10-06T03:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc89ffb700 1 -- 172.21.15.84:0/2851081701 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c01e6a0 con 0x7fdc94159710 2023-10-06T03:27:08.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.605+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/2851081701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc941547e0 con 0x7fdc94159710 2023-10-06T03:27:08.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.607+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/2851081701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc94154fc0 con 0x7fdc94159710 2023-10-06T03:27:08.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.607+0000 7fdc89ffb700 1 -- 172.21.15.84:0/2851081701 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc8c01ea10 con 0x7fdc94159710 2023-10-06T03:27:08.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.607+0000 7fdc89ffb700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc78066f30 0x7fdc780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:08.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.607+0000 7fdc89ffb700 1 -- 172.21.15.84:0/2851081701 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdc8c086610 con 0x7fdc94159710 2023-10-06T03:27:08.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.607+0000 7fdc99ce6700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc78066f30 0x7fdc780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:08.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.608+0000 7fdc99ce6700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc78066f30 0x7fdc780693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdc94155480 tx=0x7fdc90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:08.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.611+0000 7fdc89ffb700 1 -- 172.21.15.84:0/2851081701 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc8c0535e0 con 0x7fdc94159710 2023-10-06T03:27:08.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:08.836+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/2851081701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc94064b00 con 0x7fdc94159710 2023-10-06T03:27:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.474+0000 7fdc89ffb700 1 -- 172.21.15.84:0/2851081701 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc8c056c00 con 0x7fdc94159710 2023-10-06T03:27:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/2851081701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc78066f30 msgr2=0x7fdc780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc78066f30 0x7fdc780693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdc94155480 tx=0x7fdc90009040 comp rx=0 tx=0).stop 2023-10-06T03:27:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/2851081701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94159710 msgr2=0x7fdc94153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94159710 0x7fdc94153b80 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c003000 tx=0x7fdc8c017000 comp rx=0 tx=0).stop 2023-10-06T03:27:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/2851081701 shutdown_connections 2023-10-06T03:27:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc78066f30 0x7fdc780693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94159710 0x7fdc94153b80 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc940cbc40 0x7fdc9414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 --2- 172.21.15.84:0/2851081701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc94159340 0x7fdc94153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/2851081701 >> 172.21.15.84:0/2851081701 conn(0x7fdc94099720 msgr2=0x7fdc94069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.476+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/2851081701 shutdown_connections 2023-10-06T03:27:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.477+0000 7fdc9bf4a700 1 -- 172.21.15.84:0/2851081701 wait complete. 2023-10-06T03:27:09.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.607+0000 7f658ae4a700 1 Processor -- start 2023-10-06T03:27:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.607+0000 7f658ae4a700 1 -- start start 2023-10-06T03:27:09.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.608+0000 7f658ae4a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6584159480 0x7f65840b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.608+0000 7f658ae4a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65840cb7e0 con 0x7f65840b2140 2023-10-06T03:27:09.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.608+0000 7f658ae4a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65840b08a0 con 0x7f65840b3610 2023-10-06T03:27:09.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.608+0000 7f658ae4a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65840cb190 con 0x7f6584159480 2023-10-06T03:27:09.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.608+0000 7f658a649700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f65840b2140 0x7f65840b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57916/0 (socket says 172.21.15.84:57916) 2023-10-06T03:27:09.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.608+0000 7f658a649700 1 -- 172.21.15.84:0/4110769680 learned_addr learned my addr 172.21.15.84:0/4110769680 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:09.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648089679 0 0) 0x7f65840cb7e0 con 0x7f65840b2140 2023-10-06T03:27:09.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6589e48700 1 --2- 172.21.15.84:0/4110769680 >> v2:172.21.15.131:3300/0 conn(0x7f6584159480 0x7f65840b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6570003570 con 0x7f65840b2140 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3002758376 0 0) 0x7f6570003570 con 0x7f65840b2140 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 >> v2:172.21.15.131:3300/0 conn(0x7f6584159480 msgr2=0x7f65840b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 --2- 172.21.15.84:0/4110769680 >> v2:172.21.15.131:3300/0 conn(0x7f6584159480 0x7f65840b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 >> v1:172.21.15.131:6789/0 conn(0x7f65840b3610 legacy=0x7f65840cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840cb470 con 0x7f65840b2140 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f657c001470 con 0x7f65840b2140 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 >> v1:172.21.15.84:6789/0 conn(0x7f65840b2140 legacy=0x7f65840b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f6570003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6570004810 0x7f6570004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65700051c0 0x7f657000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65840cb190 con 0x7f6570003a60 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657000c160 con 0x7f6570004810 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657000c320 con 0x7f65700051c0 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6589e48700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f6570003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f658a649700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65700051c0 0x7f657000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6589647700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6570004810 0x7f6570004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6589e48700 1 -- 172.21.15.84:0/4110769680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65700051c0 msgr2=0x7f657000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6589e48700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65700051c0 0x7f657000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6589e48700 1 -- 172.21.15.84:0/4110769680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6570004810 msgr2=0x7f6570004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6589e48700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6570004810 0x7f6570004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6589e48700 1 -- 172.21.15.84:0/4110769680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6570003570 con 0x7f6570003a60 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f658a649700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65700051c0 0x7f657000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:09.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6589647700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6570004810 0x7f6570004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f658a649700 1 -- 172.21.15.84:0/4110769680 reap_dead start 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.609+0000 7f6589e48700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f6570003e70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f658000e210 tx=0x7f658000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a558cc48bc36dd40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.610+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000eac0 con 0x7f6570003a60 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.610+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658000f040 con 0x7f6570003a60 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.610+0000 7f6588e46700 1 -- 172.21.15.84:0/4110769680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000ee70 con 0x7f6570003a60 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.610+0000 7f658ae4a700 1 -- 172.21.15.84:0/4110769680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 msgr2=0x7f6570003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.610+0000 7f658ae4a700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f6570003e70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f658000e210 tx=0x7f658000b040 comp rx=0 tx=0).stop 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.610+0000 7f658ae4a700 1 -- 172.21.15.84:0/4110769680 shutdown_connections 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.610+0000 7f658ae4a700 1 --2- 172.21.15.84:0/4110769680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f6570003e70 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.610+0000 7f658ae4a700 1 -- 172.21.15.84:0/4110769680 >> 172.21.15.84:0/4110769680 conn(0x7f658406ed20 msgr2=0x7f658406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.610+0000 7f658ae4a700 1 -- 172.21.15.84:0/4110769680 shutdown_connections 2023-10-06T03:27:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.610+0000 7f658ae4a700 1 -- 172.21.15.84:0/4110769680 wait complete. 2023-10-06T03:27:09.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.611+0000 7f658ae4a700 1 Processor -- start 2023-10-06T03:27:09.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.611+0000 7f658ae4a700 1 -- start start 2023-10-06T03:27:09.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f658ae4a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f65840c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f658ae4a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65840c9400 0x7f65840cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f658ae4a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65840cfe70 0x7f6584154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f658ae4a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6584159ad0 con 0x7f6570003a60 2023-10-06T03:27:09.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f658ae4a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65840c9b70 con 0x7f65840c9400 2023-10-06T03:27:09.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f658ae4a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65840c9e50 con 0x7f65840cfe70 2023-10-06T03:27:09.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f6589e48700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f65840c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f6589e48700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f65840c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34258/0 (socket says 172.21.15.84:34258) 2023-10-06T03:27:09.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f6589e48700 1 -- 172.21.15.84:0/412088808 learned_addr learned my addr 172.21.15.84:0/412088808 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f6589647700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65840c9400 0x7f65840cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f658a649700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65840cfe70 0x7f6584154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f6589e48700 1 -- 172.21.15.84:0/412088808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65840cfe70 msgr2=0x7f6584154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f6589e48700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65840cfe70 0x7f6584154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f6589e48700 1 -- 172.21.15.84:0/412088808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65840c9400 msgr2=0x7f65840cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f6589e48700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65840c9400 0x7f65840cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f6589e48700 1 -- 172.21.15.84:0/412088808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840ca130 con 0x7f6570003a60 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.612+0000 7f658a649700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65840cfe70 0x7f6584154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.613+0000 7f6589e48700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f65840c7e50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f658000afd0 tx=0x7f658001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.613+0000 7f6579ffb700 1 -- 172.21.15.84:0/412088808 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580029450 con 0x7f6570003a60 2023-10-06T03:27:09.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.613+0000 7f6579ffb700 1 -- 172.21.15.84:0/412088808 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800295b0 con 0x7f6570003a60 2023-10-06T03:27:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.613+0000 7f658ae4a700 1 -- 172.21.15.84:0/412088808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6584159d20 con 0x7f6570003a60 2023-10-06T03:27:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.613+0000 7f6579ffb700 1 -- 172.21.15.84:0/412088808 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800299b0 con 0x7f6570003a60 2023-10-06T03:27:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.613+0000 7f658ae4a700 1 -- 172.21.15.84:0/412088808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6584154b60 con 0x7f6570003a60 2023-10-06T03:27:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.614+0000 7f658ae4a700 1 -- 172.21.15.84:0/412088808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658415a090 con 0x7f6570003a60 2023-10-06T03:27:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.614+0000 7f6579ffb700 1 -- 172.21.15.84:0/412088808 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6580003040 con 0x7f6570003a60 2023-10-06T03:27:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.615+0000 7f6579ffb700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6568066f30 0x7f65680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.615+0000 7f6579ffb700 1 -- 172.21.15.84:0/412088808 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6580086960 con 0x7f6570003a60 2023-10-06T03:27:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.615+0000 7f6589647700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6568066f30 0x7f65680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.615+0000 7f6589647700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6568066f30 0x7f65680693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6574007fd0 tx=0x7f6574009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.619+0000 7f6579ffb700 1 -- 172.21.15.84:0/412088808 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65800539f0 con 0x7f6570003a60 2023-10-06T03:27:09.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.842+0000 7f658ae4a700 1 -- 172.21.15.84:0/412088808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f658405f270 con 0x7f6570003a60 2023-10-06T03:27:09.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.842+0000 7f6579ffb700 1 -- 172.21.15.84:0/412088808 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6580057010 con 0x7f6570003a60 2023-10-06T03:27:09.844 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:09.844 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1222888908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1222888908},{"type":"v1","addr":"172.21.15.131:6835","nonce":1222888908}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/169780123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":169780123},{"type":"v1","addr":"172.21.15.131:6834","nonce":169780123}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6942,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1047033601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1047033601},{"type":"v1","addr":"172.21.15.84:6835","nonce":1047033601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:09.465682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6945":{"gid":6945,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/632169803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":632169803},{"type":"v1","addr":"172.21.15.84:6837","nonce":632169803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:09.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 -- 172.21.15.84:0/412088808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6568066f30 msgr2=0x7f65680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6568066f30 0x7f65680693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6574007fd0 tx=0x7f6574009040 comp rx=0 tx=0).stop 2023-10-06T03:27:09.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 -- 172.21.15.84:0/412088808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 msgr2=0x7f65840c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f65840c7e50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f658000afd0 tx=0x7f658001a000 comp rx=0 tx=0).stop 2023-10-06T03:27:09.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 -- 172.21.15.84:0/412088808 shutdown_connections 2023-10-06T03:27:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6568066f30 0x7f65680693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65840cfe70 0x7f6584154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6570003a60 0x7f65840c7e50 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 --2- 172.21.15.84:0/412088808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65840c9400 0x7f65840cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 -- 172.21.15.84:0/412088808 >> 172.21.15.84:0/412088808 conn(0x7f658406ed20 msgr2=0x7f65841552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 -- 172.21.15.84:0/412088808 shutdown_connections 2023-10-06T03:27:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.844+0000 7f658ae4a700 1 -- 172.21.15.84:0/412088808 wait complete. 2023-10-06T03:27:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 54 2023-10-06T03:27:09.858 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:27:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.970+0000 7f98ba655700 1 Processor -- start 2023-10-06T03:27:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.970+0000 7f98ba655700 1 -- start start 2023-10-06T03:27:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98ba655700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f98b41595a0 0x7f98b40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98ba655700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98b40b07a0 0x7f98b40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98ba655700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b40b0ca0 con 0x7f98b40b49e0 2023-10-06T03:27:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98ba655700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b40b0f80 con 0x7f98b40b07a0 2023-10-06T03:27:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98ba655700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b40b1260 con 0x7f98b41595a0 2023-10-06T03:27:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98b8bf2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98b40b07a0 0x7f98b40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98b8bf2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98b40b07a0 0x7f98b40b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34262/0 (socket says 172.21.15.84:34262) 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98b8bf2700 1 -- 172.21.15.84:0/1274035762 learned_addr learned my addr 172.21.15.84:0/1274035762 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98b3fff700 1 --2- 172.21.15.84:0/1274035762 >> v2:172.21.15.131:3300/0 conn(0x7f98b41595a0 0x7f98b40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98b8bf2700 1 -- 172.21.15.84:0/1274035762 >> v2:172.21.15.131:3300/0 conn(0x7f98b41595a0 msgr2=0x7f98b40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98b8bf2700 1 --2- 172.21.15.84:0/1274035762 >> v2:172.21.15.131:3300/0 conn(0x7f98b41595a0 0x7f98b40aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98b8bf2700 1 -- 172.21.15.84:0/1274035762 >> v1:172.21.15.131:6789/0 conn(0x7f98b40b49e0 legacy=0x7f98b40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98b8bf2700 1 -- 172.21.15.84:0/1274035762 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40b1540 con 0x7f98b40b07a0 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.971+0000 7f98b8bf2700 1 --2- 172.21.15.84:0/1274035762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b07a0 0x7f98b40b1c00 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009f20 tx=0x7f98ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b81f26672a7322 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98b2ffd700 1 -- 172.21.15.84:0/1274035762 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac00e070 con 0x7f98b40b07a0 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98b2ffd700 1 -- 172.21.15.84:0/1274035762 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac00ba00 con 0x7f98b40b07a0 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98b2ffd700 1 -- 172.21.15.84:0/1274035762 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0092e0 con 0x7f98b40b07a0 2023-10-06T03:27:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98ba655700 1 -- 172.21.15.84:0/1274035762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b07a0 msgr2=0x7f98b40b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98ba655700 1 --2- 172.21.15.84:0/1274035762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b07a0 0x7f98b40b1c00 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009f20 tx=0x7f98ac009840 comp rx=0 tx=0).stop 2023-10-06T03:27:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98ba655700 1 -- 172.21.15.84:0/1274035762 shutdown_connections 2023-10-06T03:27:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98ba655700 1 --2- 172.21.15.84:0/1274035762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b07a0 0x7f98b40b1c00 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98ba655700 1 --2- 172.21.15.84:0/1274035762 >> v2:172.21.15.131:3300/0 conn(0x7f98b41595a0 0x7f98b40aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98ba655700 1 -- 172.21.15.84:0/1274035762 >> 172.21.15.84:0/1274035762 conn(0x7f98b4099830 msgr2=0x7f98b406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98ba655700 1 -- 172.21.15.84:0/1274035762 shutdown_connections 2023-10-06T03:27:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.972+0000 7f98ba655700 1 -- 172.21.15.84:0/1274035762 wait complete. 2023-10-06T03:27:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.973+0000 7f98ba655700 1 Processor -- start 2023-10-06T03:27:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.973+0000 7f98ba655700 1 -- start start 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98ba655700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98b40b07a0 0x7f98b41694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98ba655700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b49e0 0x7f98b40ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98ba655700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98b41595a0 0x7f98b40aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98ba655700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40af090 con 0x7f98b40b49e0 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98ba655700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40adab0 con 0x7f98b41595a0 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98ba655700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40add90 con 0x7f98b40b07a0 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98b37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b49e0 0x7f98b40ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98b37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b49e0 0x7f98b40ad3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34276/0 (socket says 172.21.15.84:34276) 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98b37fe700 1 -- 172.21.15.84:0/4129168739 learned_addr learned my addr 172.21.15.84:0/4129168739 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98b3fff700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98b40b07a0 0x7f98b41694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.974+0000 7f98b8bf2700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98b41595a0 0x7f98b40aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f98b37fe700 1 -- 172.21.15.84:0/4129168739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98b40b07a0 msgr2=0x7f98b41694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f98b37fe700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98b40b07a0 0x7f98b41694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f98b37fe700 1 -- 172.21.15.84:0/4129168739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98b41595a0 msgr2=0x7f98b40aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f98b37fe700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98b41595a0 0x7f98b40aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f98b37fe700 1 -- 172.21.15.84:0/4129168739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac009ae0 con 0x7f98b40b49e0 2023-10-06T03:27:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f98b8bf2700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98b41595a0 0x7f98b40aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f98b37fe700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b49e0 0x7f98b40ad3f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f98a8002ee0 tx=0x7f98a8007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f989bfff700 1 -- 172.21.15.84:0/4129168739 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8016070 con 0x7f98b40b49e0 2023-10-06T03:27:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f989bfff700 1 -- 172.21.15.84:0/4129168739 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a8006820 con 0x7f98b40b49e0 2023-10-06T03:27:09.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f98ba655700 1 -- 172.21.15.84:0/4129168739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b40ae070 con 0x7f98b40b49e0 2023-10-06T03:27:09.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f989bfff700 1 -- 172.21.15.84:0/4129168739 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8006be0 con 0x7f98b40b49e0 2023-10-06T03:27:09.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.975+0000 7f98ba655700 1 -- 172.21.15.84:0/4129168739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b40ae6b0 con 0x7f98b40b49e0 2023-10-06T03:27:09.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.976+0000 7f98ba655700 1 -- 172.21.15.84:0/4129168739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b40ae840 con 0x7f98b40b49e0 2023-10-06T03:27:09.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.976+0000 7f989bfff700 1 -- 172.21.15.84:0/4129168739 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98a8007020 con 0x7f98b40b49e0 2023-10-06T03:27:09.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.976+0000 7f989bfff700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f98a0066f30 0x7f98a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:09.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.977+0000 7f989bfff700 1 -- 172.21.15.84:0/4129168739 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f98a8083f90 con 0x7f98b40b49e0 2023-10-06T03:27:09.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.977+0000 7f98b3fff700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f98a0066f30 0x7f98a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:09.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.977+0000 7f98b3fff700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f98a0066f30 0x7f98a00693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f98a40061f0 tx=0x7f98a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:09.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:09.981+0000 7f989bfff700 1 -- 172.21.15.84:0/4129168739 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98a8050f60 con 0x7f98b40b49e0 2023-10-06T03:27:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.165+0000 7f98ba655700 1 -- 172.21.15.84:0/4129168739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98b4064ad0 con 0x7f98b40b49e0 2023-10-06T03:27:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.166+0000 7f989bfff700 1 -- 172.21.15.84:0/4129168739 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f98a8054580 con 0x7f98b40b49e0 2023-10-06T03:27:10.170 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:10.170 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":98,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:27:07.355744+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:27:03.480044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:27:04.800908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:27:10.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 -- 172.21.15.84:0/4129168739 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f98a0066f30 msgr2=0x7f98a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f98a0066f30 0x7f98a00693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f98a40061f0 tx=0x7f98a4008040 comp rx=0 tx=0).stop 2023-10-06T03:27:10.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 -- 172.21.15.84:0/4129168739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b49e0 msgr2=0x7f98b40ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b49e0 0x7f98b40ad3f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f98a8002ee0 tx=0x7f98a8007f20 comp rx=0 tx=0).stop 2023-10-06T03:27:10.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 -- 172.21.15.84:0/4129168739 shutdown_connections 2023-10-06T03:27:10.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f98a0066f30 0x7f98a00693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98b41595a0 0x7f98b40aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98b40b07a0 0x7f98b41694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 --2- 172.21.15.84:0/4129168739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b49e0 0x7f98b40ad3f0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 -- 172.21.15.84:0/4129168739 >> 172.21.15.84:0/4129168739 conn(0x7f98b4099830 msgr2=0x7f98b4158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:10.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 -- 172.21.15.84:0/4129168739 shutdown_connections 2023-10-06T03:27:10.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.168+0000 7f98ba655700 1 -- 172.21.15.84:0/4129168739 wait complete. 2023-10-06T03:27:10.182 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:27:10.182 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:27:10.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.299+0000 7f0df0e62700 1 Processor -- start 2023-10-06T03:27:10.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.299+0000 7f0df0e62700 1 -- start start 2023-10-06T03:27:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0df0e62700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0dec1595a0 0x7f0dec0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0df0e62700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dec0b07a0 0x7f0dec0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0df0e62700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dec0b0ca0 con 0x7f0dec0b49e0 2023-10-06T03:27:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0df0e62700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dec0b0f80 con 0x7f0dec1595a0 2023-10-06T03:27:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0df0e62700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec0b1260 con 0x7f0dec0b07a0 2023-10-06T03:27:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de1d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0dec0b49e0 0x7f0dec0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57932/0 (socket says 172.21.15.84:57932) 2023-10-06T03:27:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de1d9b700 1 -- 172.21.15.84:0/2196539226 learned_addr learned my addr 172.21.15.84:0/2196539226 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0dea59c700 1 --2- 172.21.15.84:0/2196539226 >> v2:172.21.15.131:3300/0 conn(0x7f0dec1595a0 0x7f0dec0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0dead9d700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dec0b07a0 0x7f0dec0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078337820 0 0) 0x7f0dec0b0ca0 con 0x7f0dec0b49e0 2023-10-06T03:27:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd8003570 con 0x7f0dec0b49e0 2023-10-06T03:27:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1909514527 0 0) 0x7f0dd8003570 con 0x7f0dec0b49e0 2023-10-06T03:27:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dec0b07a0 msgr2=0x7f0dec0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de9d9b700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dec0b07a0 0x7f0dec0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 >> v2:172.21.15.131:3300/0 conn(0x7f0dec1595a0 msgr2=0x7f0dec0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de9d9b700 1 --2- 172.21.15.84:0/2196539226 >> v2:172.21.15.131:3300/0 conn(0x7f0dec1595a0 0x7f0dec0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec0b1540 con 0x7f0dec0b49e0 2023-10-06T03:27:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.300+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f0dd4001470 con 0x7f0dec0b49e0 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 >> v1:172.21.15.84:6789/0 conn(0x7f0dec0b49e0 legacy=0x7f0dec0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de9d9b700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dec0b07a0 0x7f0dd8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de9d9b700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dd8003fe0 0x7f0dd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de9d9b700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dd8004d50 0x7f0dd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec0b0f80 con 0x7f0dd8003fe0 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec0b1260 con 0x7f0dd8004d50 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd800ba90 con 0x7f0dec0b07a0 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de1d9b700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dd8003fe0 0x7f0dd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0dea59c700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dec0b07a0 0x7f0dd8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0dead9d700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dd8004d50 0x7f0dd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de1d9b700 1 -- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dec0b07a0 msgr2=0x7f0dd8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de1d9b700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dec0b07a0 0x7f0dd8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de1d9b700 1 -- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dd8004d50 msgr2=0x7f0dd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de1d9b700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dd8004d50 0x7f0dd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de1d9b700 1 -- 172.21.15.84:0/2196539226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8003570 con 0x7f0dd8003fe0 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de1d9b700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dd8003fe0 0x7f0dd8004810 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f0dec088e20 tx=0x7f0dd4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4208a3c5824ef3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400cbd0 con 0x7f0dd8003fe0 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd400cd30 con 0x7f0dd8003fe0 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.301+0000 7f0de9d9b700 1 -- 172.21.15.84:0/2196539226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400cea0 con 0x7f0dd8003fe0 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.302+0000 7f0df0e62700 1 -- 172.21.15.84:0/2196539226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dd8003fe0 msgr2=0x7f0dd8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.302+0000 7f0df0e62700 1 --2- 172.21.15.84:0/2196539226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dd8003fe0 0x7f0dd8004810 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f0dec088e20 tx=0x7f0dd4001e50 comp rx=0 tx=0).stop 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.302+0000 7f0dead9d700 1 -- 172.21.15.84:0/2196539226 reap_dead start 2023-10-06T03:27:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.302+0000 7f0df0e62700 1 -- 172.21.15.84:0/2196539226 shutdown_connections 2023-10-06T03:27:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.302+0000 7f0df0e62700 1 -- 172.21.15.84:0/2196539226 >> 172.21.15.84:0/2196539226 conn(0x7f0dec099830 msgr2=0x7f0dec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.302+0000 7f0df0e62700 1 -- 172.21.15.84:0/2196539226 shutdown_connections 2023-10-06T03:27:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.302+0000 7f0df0e62700 1 -- 172.21.15.84:0/2196539226 wait complete. 2023-10-06T03:27:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.303+0000 7f0df0e62700 1 Processor -- start 2023-10-06T03:27:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.303+0000 7f0df0e62700 1 -- start start 2023-10-06T03:27:10.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0df0e62700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dd8003fe0 0x7f0dec14a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0df0e62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dec15c880 0x7f0dec09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0df0e62700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dec09c090 0x7f0dec09c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0df0e62700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec09b920 con 0x7f0dec15c880 2023-10-06T03:27:10.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0df0e62700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec159e80 con 0x7f0dec09c090 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0df0e62700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec09ca40 con 0x7f0dd8003fe0 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dec15c880 0x7f0dec09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dec15c880 0x7f0dec09aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34296/0 (socket says 172.21.15.84:34296) 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de1d9b700 1 -- 172.21.15.84:0/2237950643 learned_addr learned my addr 172.21.15.84:0/2237950643 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0dea59c700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dd8003fe0 0x7f0dec14a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0dead9d700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dec09c090 0x7f0dec09c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de1d9b700 1 -- 172.21.15.84:0/2237950643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dd8003fe0 msgr2=0x7f0dec14a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de1d9b700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dd8003fe0 0x7f0dec14a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de1d9b700 1 -- 172.21.15.84:0/2237950643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dec09c090 msgr2=0x7f0dec09c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de1d9b700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dec09c090 0x7f0dec09c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de1d9b700 1 -- 172.21.15.84:0/2237950643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec14ade0 con 0x7f0dec15c880 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de1d9b700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dec15c880 0x7f0dec09aa50 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c950 tx=0x7f0dd4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de2ffd700 1 -- 172.21.15.84:0/2237950643 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400cea0 con 0x7f0dec15c880 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de2ffd700 1 -- 172.21.15.84:0/2237950643 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd4004a40 con 0x7f0dec15c880 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0df0e62700 1 -- 172.21.15.84:0/2237950643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dec09b360 con 0x7f0dec15c880 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.304+0000 7f0de2ffd700 1 -- 172.21.15.84:0/2237950643 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4004de0 con 0x7f0dec15c880 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.305+0000 7f0df0e62700 1 -- 172.21.15.84:0/2237950643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dec159b10 con 0x7f0dec15c880 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.305+0000 7f0df0e62700 1 -- 172.21.15.84:0/2237950643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dec159970 con 0x7f0dec15c880 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.306+0000 7f0de2ffd700 1 -- 172.21.15.84:0/2237950643 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0dd4019030 con 0x7f0dec15c880 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.306+0000 7f0de2ffd700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0dcc066f30 0x7f0dcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.306+0000 7f0de2ffd700 1 -- 172.21.15.84:0/2237950643 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0dd4085b70 con 0x7f0dec15c880 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.306+0000 7f0dea59c700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0dcc066f30 0x7f0dcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.307+0000 7f0dea59c700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0dcc066f30 0x7f0dcc0693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc006ea0 tx=0x7f0ddc009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:10.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.310+0000 7f0de2ffd700 1 -- 172.21.15.84:0/2237950643 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dec159970 con 0x7f0dec15c880 2023-10-06T03:27:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.491+0000 7f0df0e62700 1 -- 172.21.15.84:0/2237950643 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0dec159970 con 0x7f0dcc066f30 2023-10-06T03:27:10.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.500+0000 7f0de2ffd700 1 -- 172.21.15.84:0/2237950643 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311939 (secure 0 0 0) 0x7f0dec159970 con 0x7f0dcc066f30 2023-10-06T03:27:10.505 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 -- 172.21.15.84:0/2237950643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0dcc066f30 msgr2=0x7f0dcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0dcc066f30 0x7f0dcc0693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc006ea0 tx=0x7f0ddc009120 comp rx=0 tx=0).stop 2023-10-06T03:27:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 -- 172.21.15.84:0/2237950643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dec15c880 msgr2=0x7f0dec09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dec15c880 0x7f0dec09aa50 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c950 tx=0x7f0dd4015000 comp rx=0 tx=0).stop 2023-10-06T03:27:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 -- 172.21.15.84:0/2237950643 shutdown_connections 2023-10-06T03:27:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0dcc066f30 0x7f0dcc0693e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dec09c090 0x7f0dec09c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0dd8003fe0 0x7f0dec14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 --2- 172.21.15.84:0/2237950643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dec15c880 0x7f0dec09aa50 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 -- 172.21.15.84:0/2237950643 >> 172.21.15.84:0/2237950643 conn(0x7f0dec099830 msgr2=0x7f0dec0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 -- 172.21.15.84:0/2237950643 shutdown_connections 2023-10-06T03:27:10.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.503+0000 7f0df0e62700 1 -- 172.21.15.84:0/2237950643 wait complete. 2023-10-06T03:27:10.510 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:27:10.517 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2023-10-06T03:27:09.080782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388980,"kb_used_data":10676,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752585740,"statfs":{"total":773094113280,"available":770647797760,"internally_reserved":0,"allocated":10932224,"data_stored":5781391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.635448"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.381801+0000","last_change":"2023-10-06T03:27:06.377065+0000","last_active":"2023-10-06T03:27:06.381801+0000","last_peered":"2023-10-06T03:27:06.381801+0000","last_clean":"2023-10-06T03:27:06.381801+0000","last_became_active":"2023-10-06T03:27:06.376832+0000","last_became_peered":"2023-10-06T03:27:06.376832+0000","last_unstale":"2023-10-06T03:27:06.381801+0000","last_undegraded":"2023-10-06T03:27:06.381801+0000","last_fullsized":"2023-10-06T03:27:06.381801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:42.408872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383324+0000","last_change":"2023-10-06T03:27:06.373571+0000","last_active":"2023-10-06T03:27:06.383324+0000","last_peered":"2023-10-06T03:27:06.383324+0000","last_clean":"2023-10-06T03:27:06.383324+0000","last_became_active":"2023-10-06T03:27:06.373327+0000","last_became_peered":"2023-10-06T03:27:06.373327+0000","last_unstale":"2023-10-06T03:27:06.383324+0000","last_undegraded":"2023-10-06T03:27:06.383324+0000","last_fullsized":"2023-10-06T03:27:06.383324+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:01.454160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.375035+0000","last_change":"2023-10-06T03:27:06.370859+0000","last_active":"2023-10-06T03:27:06.375035+0000","last_peered":"2023-10-06T03:27:06.375035+0000","last_clean":"2023-10-06T03:27:06.375035+0000","last_became_active":"2023-10-06T03:27:06.370608+0000","last_became_peered":"2023-10-06T03:27:06.370608+0000","last_unstale":"2023-10-06T03:27:06.375035+0000","last_undegraded":"2023-10-06T03:27:06.375035+0000","last_fullsized":"2023-10-06T03:27:06.375035+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:28.542553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373324+0000","last_change":"2023-10-06T03:27:06.369895+0000","last_active":"2023-10-06T03:27:06.373324+0000","last_peered":"2023-10-06T03:27:06.373324+0000","last_clean":"2023-10-06T03:27:06.373324+0000","last_became_active":"2023-10-06T03:27:06.369631+0000","last_became_peered":"2023-10-06T03:27:06.369631+0000","last_unstale":"2023-10-06T03:27:06.373324+0000","last_undegraded":"2023-10-06T03:27:06.373324+0000","last_fullsized":"2023-10-06T03:27:06.373324+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:20.284723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.367314+0000","last_change":"2023-10-06T03:27:06.367314+0000","last_active":"2023-10-06T03:27:06.367314+0000","last_peered":"2023-10-06T03:27:06.367314+0000","last_clean":"2023-10-06T03:27:06.367314+0000","last_became_active":"2023-10-06T03:27:06.367060+0000","last_became_peered":"2023-10-06T03:27:06.367060+0000","last_unstale":"2023-10-06T03:27:06.367314+0000","last_undegraded":"2023-10-06T03:27:06.367314+0000","last_fullsized":"2023-10-06T03:27:06.367314+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:39.368699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373612+0000","last_change":"2023-10-06T03:27:06.373612+0000","last_active":"2023-10-06T03:27:06.373612+0000","last_peered":"2023-10-06T03:27:06.373612+0000","last_clean":"2023-10-06T03:27:06.373612+0000","last_became_active":"2023-10-06T03:27:06.373125+0000","last_became_peered":"2023-10-06T03:27:06.373125+0000","last_unstale":"2023-10-06T03:27:06.373612+0000","last_undegraded":"2023-10-06T03:27:06.373612+0000","last_fullsized":"2023-10-06T03:27:06.373612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:37.782366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378790+0000","last_change":"2023-10-06T03:27:06.378790+0000","last_active":"2023-10-06T03:27:06.378790+0000","last_peered":"2023-10-06T03:27:06.378790+0000","last_clean":"2023-10-06T03:27:06.378790+0000","last_became_active":"2023-10-06T03:27:06.378201+0000","last_became_peered":"2023-10-06T03:27:06.378201+0000","last_unstale":"2023-10-06T03:27:06.378790+0000","last_undegraded":"2023-10-06T03:27:06.378790+0000","last_fullsized":"2023-10-06T03:27:06.378790+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:17.123137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383361+0000","last_change":"2023-10-06T03:27:06.375674+0000","last_active":"2023-10-06T03:27:06.383361+0000","last_peered":"2023-10-06T03:27:06.383361+0000","last_clean":"2023-10-06T03:27:06.383361+0000","last_became_active":"2023-10-06T03:27:06.375404+0000","last_became_peered":"2023-10-06T03:27:06.375404+0000","last_unstale":"2023-10-06T03:27:06.383361+0000","last_undegraded":"2023-10-06T03:27:06.383361+0000","last_fullsized":"2023-10-06T03:27:06.383361+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:14.907686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373597+0000","last_change":"2023-10-06T03:27:06.371296+0000","last_active":"2023-10-06T03:27:06.373597+0000","last_peered":"2023-10-06T03:27:06.373597+0000","last_clean":"2023-10-06T03:27:06.373597+0000","last_became_active":"2023-10-06T03:27:06.371056+0000","last_became_peered":"2023-10-06T03:27:06.371056+0000","last_unstale":"2023-10-06T03:27:06.373597+0000","last_undegraded":"2023-10-06T03:27:06.373597+0000","last_fullsized":"2023-10-06T03:27:06.373597+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:27.270072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.372851+0000","last_change":"2023-10-06T03:27:06.367076+0000","last_active":"2023-10-06T03:27:06.372851+0000","last_peered":"2023-10-06T03:27:06.372851+0000","last_clean":"2023-10-06T03:27:06.372851+0000","last_became_active":"2023-10-06T03:27:06.366832+0000","last_became_peered":"2023-10-06T03:27:06.366832+0000","last_unstale":"2023-10-06T03:27:06.372851+0000","last_undegraded":"2023-10-06T03:27:06.372851+0000","last_fullsized":"2023-10-06T03:27:06.372851+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.408072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383391+0000","last_change":"2023-10-06T03:27:06.377539+0000","last_active":"2023-10-06T03:27:06.383391+0000","last_peered":"2023-10-06T03:27:06.383391+0000","last_clean":"2023-10-06T03:27:06.383391+0000","last_became_active":"2023-10-06T03:27:06.377289+0000","last_became_peered":"2023-10-06T03:27:06.377289+0000","last_unstale":"2023-10-06T03:27:06.383391+0000","last_undegraded":"2023-10-06T03:27:06.383391+0000","last_fullsized":"2023-10-06T03:27:06.383391+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:43.541587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373342+0000","last_change":"2023-10-06T03:27:06.369957+0000","last_active":"2023-10-06T03:27:06.373342+0000","last_peered":"2023-10-06T03:27:06.373342+0000","last_clean":"2023-10-06T03:27:06.373342+0000","last_became_active":"2023-10-06T03:27:06.369700+0000","last_became_peered":"2023-10-06T03:27:06.369700+0000","last_unstale":"2023-10-06T03:27:06.373342+0000","last_undegraded":"2023-10-06T03:27:06.373342+0000","last_fullsized":"2023-10-06T03:27:06.373342+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:15.958907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383240+0000","last_change":"2023-10-06T03:27:06.373722+0000","last_active":"2023-10-06T03:27:06.383240+0000","last_peered":"2023-10-06T03:27:06.383240+0000","last_clean":"2023-10-06T03:27:06.383240+0000","last_became_active":"2023-10-06T03:27:06.373447+0000","last_became_peered":"2023-10-06T03:27:06.373447+0000","last_unstale":"2023-10-06T03:27:06.383240+0000","last_undegraded":"2023-10-06T03:27:06.383240+0000","last_fullsized":"2023-10-06T03:27:06.383240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:58.642133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.384378+0000","last_change":"2023-10-06T03:27:06.379908+0000","last_active":"2023-10-06T03:27:06.384378+0000","last_peered":"2023-10-06T03:27:06.384378+0000","last_clean":"2023-10-06T03:27:06.384378+0000","last_became_active":"2023-10-06T03:27:06.379550+0000","last_became_peered":"2023-10-06T03:27:06.379550+0000","last_unstale":"2023-10-06T03:27:06.384378+0000","last_undegraded":"2023-10-06T03:27:06.384378+0000","last_fullsized":"2023-10-06T03:27:06.384378+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:49.821624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378374+0000","last_change":"2023-10-06T03:27:06.378374+0000","last_active":"2023-10-06T03:27:06.378374+0000","last_peered":"2023-10-06T03:27:06.378374+0000","last_clean":"2023-10-06T03:27:06.378374+0000","last_became_active":"2023-10-06T03:27:06.378103+0000","last_became_peered":"2023-10-06T03:27:06.378103+0000","last_unstale":"2023-10-06T03:27:06.378374+0000","last_undegraded":"2023-10-06T03:27:06.378374+0000","last_fullsized":"2023-10-06T03:27:06.378374+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:48.470026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.372800+0000","last_change":"2023-10-06T03:27:06.365288+0000","last_active":"2023-10-06T03:27:06.372800+0000","last_peered":"2023-10-06T03:27:06.372800+0000","last_clean":"2023-10-06T03:27:06.372800+0000","last_became_active":"2023-10-06T03:27:06.365058+0000","last_became_peered":"2023-10-06T03:27:06.365058+0000","last_unstale":"2023-10-06T03:27:06.372800+0000","last_undegraded":"2023-10-06T03:27:06.372800+0000","last_fullsized":"2023-10-06T03:27:06.372800+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:04.312718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383428+0000","last_change":"2023-10-06T03:27:06.376791+0000","last_active":"2023-10-06T03:27:06.383428+0000","last_peered":"2023-10-06T03:27:06.383428+0000","last_clean":"2023-10-06T03:27:06.383428+0000","last_became_active":"2023-10-06T03:27:06.376522+0000","last_became_peered":"2023-10-06T03:27:06.376522+0000","last_unstale":"2023-10-06T03:27:06.383428+0000","last_undegraded":"2023-10-06T03:27:06.383428+0000","last_fullsized":"2023-10-06T03:27:06.383428+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:56.234310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383978+0000","last_change":"2023-10-06T03:27:06.380304+0000","last_active":"2023-10-06T03:27:06.383978+0000","last_peered":"2023-10-06T03:27:06.383978+0000","last_clean":"2023-10-06T03:27:06.383978+0000","last_became_active":"2023-10-06T03:27:06.380031+0000","last_became_peered":"2023-10-06T03:27:06.380031+0000","last_unstale":"2023-10-06T03:27:06.383978+0000","last_undegraded":"2023-10-06T03:27:06.383978+0000","last_fullsized":"2023-10-06T03:27:06.383978+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:29.864014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383358+0000","last_change":"2023-10-06T03:27:06.376658+0000","last_active":"2023-10-06T03:27:06.383358+0000","last_peered":"2023-10-06T03:27:06.383358+0000","last_clean":"2023-10-06T03:27:06.383358+0000","last_became_active":"2023-10-06T03:27:06.376168+0000","last_became_peered":"2023-10-06T03:27:06.376168+0000","last_unstale":"2023-10-06T03:27:06.383358+0000","last_undegraded":"2023-10-06T03:27:06.383358+0000","last_fullsized":"2023-10-06T03:27:06.383358+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:14.093608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379450+0000","last_change":"2023-10-06T03:27:06.370085+0000","last_active":"2023-10-06T03:27:06.379450+0000","last_peered":"2023-10-06T03:27:06.379450+0000","last_clean":"2023-10-06T03:27:06.379450+0000","last_became_active":"2023-10-06T03:27:06.369662+0000","last_became_peered":"2023-10-06T03:27:06.369662+0000","last_unstale":"2023-10-06T03:27:06.379450+0000","last_undegraded":"2023-10-06T03:27:06.379450+0000","last_fullsized":"2023-10-06T03:27:06.379450+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:35.579166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383233+0000","last_change":"2023-10-06T03:27:06.373249+0000","last_active":"2023-10-06T03:27:06.383233+0000","last_peered":"2023-10-06T03:27:06.383233+0000","last_clean":"2023-10-06T03:27:06.383233+0000","last_became_active":"2023-10-06T03:27:06.372954+0000","last_became_peered":"2023-10-06T03:27:06.372954+0000","last_unstale":"2023-10-06T03:27:06.383233+0000","last_undegraded":"2023-10-06T03:27:06.383233+0000","last_fullsized":"2023-10-06T03:27:06.383233+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:12.430763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379980+0000","last_change":"2023-10-06T03:27:06.377394+0000","last_active":"2023-10-06T03:27:06.379980+0000","last_peered":"2023-10-06T03:27:06.379980+0000","last_clean":"2023-10-06T03:27:06.379980+0000","last_became_active":"2023-10-06T03:27:06.377151+0000","last_became_peered":"2023-10-06T03:27:06.377151+0000","last_unstale":"2023-10-06T03:27:06.379980+0000","last_undegraded":"2023-10-06T03:27:06.379980+0000","last_fullsized":"2023-10-06T03:27:06.379980+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:14.315364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379247+0000","last_change":"2023-10-06T03:27:06.369988+0000","last_active":"2023-10-06T03:27:06.379247+0000","last_peered":"2023-10-06T03:27:06.379247+0000","last_clean":"2023-10-06T03:27:06.379247+0000","last_became_active":"2023-10-06T03:27:06.369459+0000","last_became_peered":"2023-10-06T03:27:06.369459+0000","last_unstale":"2023-10-06T03:27:06.379247+0000","last_undegraded":"2023-10-06T03:27:06.379247+0000","last_fullsized":"2023-10-06T03:27:06.379247+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:41.373671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.376330+0000","last_change":"2023-10-06T03:27:06.371760+0000","last_active":"2023-10-06T03:27:06.376330+0000","last_peered":"2023-10-06T03:27:06.376330+0000","last_clean":"2023-10-06T03:27:06.376330+0000","last_became_active":"2023-10-06T03:27:06.371547+0000","last_became_peered":"2023-10-06T03:27:06.371547+0000","last_unstale":"2023-10-06T03:27:06.376330+0000","last_undegraded":"2023-10-06T03:27:06.376330+0000","last_fullsized":"2023-10-06T03:27:06.376330+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:40.302282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383265+0000","last_change":"2023-10-06T03:27:06.373023+0000","last_active":"2023-10-06T03:27:06.383265+0000","last_peered":"2023-10-06T03:27:06.383265+0000","last_clean":"2023-10-06T03:27:06.383265+0000","last_became_active":"2023-10-06T03:27:06.372763+0000","last_became_peered":"2023-10-06T03:27:06.372763+0000","last_unstale":"2023-10-06T03:27:06.383265+0000","last_undegraded":"2023-10-06T03:27:06.383265+0000","last_fullsized":"2023-10-06T03:27:06.383265+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:27.932568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.381573+0000","last_change":"2023-10-06T03:27:06.374238+0000","last_active":"2023-10-06T03:27:06.381573+0000","last_peered":"2023-10-06T03:27:06.381573+0000","last_clean":"2023-10-06T03:27:06.381573+0000","last_became_active":"2023-10-06T03:27:06.373951+0000","last_became_peered":"2023-10-06T03:27:06.373951+0000","last_unstale":"2023-10-06T03:27:06.381573+0000","last_undegraded":"2023-10-06T03:27:06.381573+0000","last_fullsized":"2023-10-06T03:27:06.381573+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:04.630991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.375145+0000","last_change":"2023-10-06T03:27:06.375145+0000","last_active":"2023-10-06T03:27:06.375145+0000","last_peered":"2023-10-06T03:27:06.375145+0000","last_clean":"2023-10-06T03:27:06.375145+0000","last_became_active":"2023-10-06T03:27:06.374898+0000","last_became_peered":"2023-10-06T03:27:06.374898+0000","last_unstale":"2023-10-06T03:27:06.375145+0000","last_undegraded":"2023-10-06T03:27:06.375145+0000","last_fullsized":"2023-10-06T03:27:06.375145+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:39.368699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378502+0000","last_change":"2023-10-06T03:27:06.375137+0000","last_active":"2023-10-06T03:27:06.378502+0000","last_peered":"2023-10-06T03:27:06.378502+0000","last_clean":"2023-10-06T03:27:06.378502+0000","last_became_active":"2023-10-06T03:27:06.374883+0000","last_became_peered":"2023-10-06T03:27:06.374883+0000","last_unstale":"2023-10-06T03:27:06.378502+0000","last_undegraded":"2023-10-06T03:27:06.378502+0000","last_fullsized":"2023-10-06T03:27:06.378502+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:16.894898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379408+0000","last_change":"2023-10-06T03:27:06.370021+0000","last_active":"2023-10-06T03:27:06.379408+0000","last_peered":"2023-10-06T03:27:06.379408+0000","last_clean":"2023-10-06T03:27:06.379408+0000","last_became_active":"2023-10-06T03:27:06.369616+0000","last_became_peered":"2023-10-06T03:27:06.369616+0000","last_unstale":"2023-10-06T03:27:06.379408+0000","last_undegraded":"2023-10-06T03:27:06.379408+0000","last_fullsized":"2023-10-06T03:27:06.379408+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:47.735401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.377892+0000","last_change":"2023-10-06T03:27:06.377892+0000","last_active":"2023-10-06T03:27:06.377892+0000","last_peered":"2023-10-06T03:27:06.377892+0000","last_clean":"2023-10-06T03:27:06.377892+0000","last_became_active":"2023-10-06T03:27:06.377618+0000","last_became_peered":"2023-10-06T03:27:06.377618+0000","last_unstale":"2023-10-06T03:27:06.377892+0000","last_undegraded":"2023-10-06T03:27:06.377892+0000","last_fullsized":"2023-10-06T03:27:06.377892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:30.360326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379360+0000","last_change":"2023-10-06T03:27:06.373800+0000","last_active":"2023-10-06T03:27:06.379360+0000","last_peered":"2023-10-06T03:27:06.379360+0000","last_clean":"2023-10-06T03:27:06.379360+0000","last_became_active":"2023-10-06T03:27:06.373107+0000","last_became_peered":"2023-10-06T03:27:06.373107+0000","last_unstale":"2023-10-06T03:27:06.379360+0000","last_undegraded":"2023-10-06T03:27:06.379360+0000","last_fullsized":"2023-10-06T03:27:06.379360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:28.384501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378099+0000","last_change":"2023-10-06T03:27:06.378099+0000","last_active":"2023-10-06T03:27:06.378099+0000","last_peered":"2023-10-06T03:27:06.378099+0000","last_clean":"2023-10-06T03:27:06.378099+0000","last_became_active":"2023-10-06T03:27:06.377818+0000","last_became_peered":"2023-10-06T03:27:06.377818+0000","last_unstale":"2023-10-06T03:27:06.378099+0000","last_undegraded":"2023-10-06T03:27:06.378099+0000","last_fullsized":"2023-10-06T03:27:06.378099+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:01.820133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.375174+0000","last_change":"2023-10-06T03:27:06.375174+0000","last_active":"2023-10-06T03:27:06.375174+0000","last_peered":"2023-10-06T03:27:06.375174+0000","last_clean":"2023-10-06T03:27:06.375174+0000","last_became_active":"2023-10-06T03:27:06.374960+0000","last_became_peered":"2023-10-06T03:27:06.374960+0000","last_unstale":"2023-10-06T03:27:06.375174+0000","last_undegraded":"2023-10-06T03:27:06.375174+0000","last_fullsized":"2023-10-06T03:27:06.375174+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:50.252367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"97'4","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.465242+0000","last_change":"2023-10-06T03:27:05.466901+0000","last_active":"2023-10-06T03:27:06.465242+0000","last_peered":"2023-10-06T03:27:06.465242+0000","last_clean":"2023-10-06T03:27:06.465242+0000","last_became_active":"2023-10-06T03:27:05.466639+0000","last_became_peered":"2023-10-06T03:27:05.466639+0000","last_unstale":"2023-10-06T03:27:06.465242+0000","last_undegraded":"2023-10-06T03:27:06.465242+0000","last_fullsized":"2023-10-06T03:27:06.465242+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:49.244976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379680+0000","last_change":"2023-10-06T03:27:06.373436+0000","last_active":"2023-10-06T03:27:06.379680+0000","last_peered":"2023-10-06T03:27:06.379680+0000","last_clean":"2023-10-06T03:27:06.379680+0000","last_became_active":"2023-10-06T03:27:06.372493+0000","last_became_peered":"2023-10-06T03:27:06.372493+0000","last_unstale":"2023-10-06T03:27:06.379680+0000","last_undegraded":"2023-10-06T03:27:06.379680+0000","last_fullsized":"2023-10-06T03:27:06.379680+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:58.732084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.465112+0000","last_change":"2023-10-06T03:27:05.466332+0000","last_active":"2023-10-06T03:27:06.465112+0000","last_peered":"2023-10-06T03:27:06.465112+0000","last_clean":"2023-10-06T03:27:06.465112+0000","last_became_active":"2023-10-06T03:27:05.465966+0000","last_became_peered":"2023-10-06T03:27:05.465966+0000","last_unstale":"2023-10-06T03:27:06.465112+0000","last_undegraded":"2023-10-06T03:27:06.465112+0000","last_fullsized":"2023-10-06T03:27:06.465112+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:31.807788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.377821+0000","last_change":"2023-10-06T03:27:06.377821+0000","last_active":"2023-10-06T03:27:06.377821+0000","last_peered":"2023-10-06T03:27:06.377821+0000","last_clean":"2023-10-06T03:27:06.377821+0000","last_became_active":"2023-10-06T03:27:06.377580+0000","last_became_peered":"2023-10-06T03:27:06.377580+0000","last_unstale":"2023-10-06T03:27:06.377821+0000","last_undegraded":"2023-10-06T03:27:06.377821+0000","last_fullsized":"2023-10-06T03:27:06.377821+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:58.480428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"97'2","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.461227+0000","last_change":"2023-10-06T03:27:05.470576+0000","last_active":"2023-10-06T03:27:06.461227+0000","last_peered":"2023-10-06T03:27:06.461227+0000","last_clean":"2023-10-06T03:27:06.461227+0000","last_became_active":"2023-10-06T03:27:05.470314+0000","last_became_peered":"2023-10-06T03:27:05.470314+0000","last_unstale":"2023-10-06T03:27:06.461227+0000","last_undegraded":"2023-10-06T03:27:06.461227+0000","last_fullsized":"2023-10-06T03:27:06.461227+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:49.244976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.384378+0000","last_change":"2023-10-06T03:27:06.376830+0000","last_active":"2023-10-06T03:27:06.384378+0000","last_peered":"2023-10-06T03:27:06.384378+0000","last_clean":"2023-10-06T03:27:06.384378+0000","last_became_active":"2023-10-06T03:27:06.376398+0000","last_became_peered":"2023-10-06T03:27:06.376398+0000","last_unstale":"2023-10-06T03:27:06.384378+0000","last_undegraded":"2023-10-06T03:27:06.384378+0000","last_fullsized":"2023-10-06T03:27:06.384378+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:40.302282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"97'2","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.461088+0000","last_change":"2023-10-06T03:27:05.468159+0000","last_active":"2023-10-06T03:27:06.461088+0000","last_peered":"2023-10-06T03:27:06.461088+0000","last_clean":"2023-10-06T03:27:06.461088+0000","last_became_active":"2023-10-06T03:27:05.467408+0000","last_became_peered":"2023-10-06T03:27:05.467408+0000","last_unstale":"2023-10-06T03:27:06.461088+0000","last_undegraded":"2023-10-06T03:27:06.461088+0000","last_fullsized":"2023-10-06T03:27:06.461088+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:31.954980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.374310+0000","last_change":"2023-10-06T03:27:06.370916+0000","last_active":"2023-10-06T03:27:06.374310+0000","last_peered":"2023-10-06T03:27:06.374310+0000","last_clean":"2023-10-06T03:27:06.374310+0000","last_became_active":"2023-10-06T03:27:06.370651+0000","last_became_peered":"2023-10-06T03:27:06.370651+0000","last_unstale":"2023-10-06T03:27:06.374310+0000","last_undegraded":"2023-10-06T03:27:06.374310+0000","last_fullsized":"2023-10-06T03:27:06.374310+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:47.874750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"97'1","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.364321+0000","last_change":"2023-10-06T03:27:05.469638+0000","last_active":"2023-10-06T03:27:06.364321+0000","last_peered":"2023-10-06T03:27:06.364321+0000","last_clean":"2023-10-06T03:27:06.364321+0000","last_became_active":"2023-10-06T03:27:05.469352+0000","last_became_peered":"2023-10-06T03:27:05.469352+0000","last_unstale":"2023-10-06T03:27:06.364321+0000","last_undegraded":"2023-10-06T03:27:06.364321+0000","last_fullsized":"2023-10-06T03:27:06.364321+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:00.812742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379557+0000","last_change":"2023-10-06T03:27:06.371320+0000","last_active":"2023-10-06T03:27:06.379557+0000","last_peered":"2023-10-06T03:27:06.379557+0000","last_clean":"2023-10-06T03:27:06.379557+0000","last_became_active":"2023-10-06T03:27:06.371051+0000","last_became_peered":"2023-10-06T03:27:06.371051+0000","last_unstale":"2023-10-06T03:27:06.379557+0000","last_undegraded":"2023-10-06T03:27:06.379557+0000","last_fullsized":"2023-10-06T03:27:06.379557+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:58.125583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.461364+0000","last_change":"2023-10-06T03:27:05.468869+0000","last_active":"2023-10-06T03:27:06.461364+0000","last_peered":"2023-10-06T03:27:06.461364+0000","last_clean":"2023-10-06T03:27:06.461364+0000","last_became_active":"2023-10-06T03:27:05.468618+0000","last_became_peered":"2023-10-06T03:27:05.468618+0000","last_unstale":"2023-10-06T03:27:06.461364+0000","last_undegraded":"2023-10-06T03:27:06.461364+0000","last_fullsized":"2023-10-06T03:27:06.461364+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:19.887723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.381616+0000","last_change":"2023-10-06T03:27:06.374867+0000","last_active":"2023-10-06T03:27:06.381616+0000","last_peered":"2023-10-06T03:27:06.381616+0000","last_clean":"2023-10-06T03:27:06.381616+0000","last_became_active":"2023-10-06T03:27:06.374622+0000","last_became_peered":"2023-10-06T03:27:06.374622+0000","last_unstale":"2023-10-06T03:27:06.381616+0000","last_undegraded":"2023-10-06T03:27:06.381616+0000","last_fullsized":"2023-10-06T03:27:06.381616+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:00.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.360622+0000","last_change":"2023-10-06T03:27:05.465144+0000","last_active":"2023-10-06T03:27:06.360622+0000","last_peered":"2023-10-06T03:27:06.360622+0000","last_clean":"2023-10-06T03:27:06.360622+0000","last_became_active":"2023-10-06T03:27:05.464840+0000","last_became_peered":"2023-10-06T03:27:05.464840+0000","last_unstale":"2023-10-06T03:27:06.360622+0000","last_undegraded":"2023-10-06T03:27:06.360622+0000","last_fullsized":"2023-10-06T03:27:06.360622+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:12.336653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378961+0000","last_change":"2023-10-06T03:27:06.378961+0000","last_active":"2023-10-06T03:27:06.378961+0000","last_peered":"2023-10-06T03:27:06.378961+0000","last_clean":"2023-10-06T03:27:06.378961+0000","last_became_active":"2023-10-06T03:27:06.378549+0000","last_became_peered":"2023-10-06T03:27:06.378549+0000","last_unstale":"2023-10-06T03:27:06.378961+0000","last_undegraded":"2023-10-06T03:27:06.378961+0000","last_fullsized":"2023-10-06T03:27:06.378961+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:21.118685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.359530+0000","last_change":"2023-10-06T03:27:05.466426+0000","last_active":"2023-10-06T03:27:06.359530+0000","last_peered":"2023-10-06T03:27:06.359530+0000","last_clean":"2023-10-06T03:27:06.359530+0000","last_became_active":"2023-10-06T03:27:05.465699+0000","last_became_peered":"2023-10-06T03:27:05.465699+0000","last_unstale":"2023-10-06T03:27:06.359530+0000","last_undegraded":"2023-10-06T03:27:06.359530+0000","last_fullsized":"2023-10-06T03:27:06.359530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:57.118192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371180+0000","last_change":"2023-10-06T03:27:06.371180+0000","last_active":"2023-10-06T03:27:06.371180+0000","last_peered":"2023-10-06T03:27:06.371180+0000","last_clean":"2023-10-06T03:27:06.371180+0000","last_became_active":"2023-10-06T03:27:06.370938+0000","last_became_peered":"2023-10-06T03:27:06.370938+0000","last_unstale":"2023-10-06T03:27:06.371180+0000","last_undegraded":"2023-10-06T03:27:06.371180+0000","last_fullsized":"2023-10-06T03:27:06.371180+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:48.470026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.465590+0000","last_change":"2023-10-06T03:27:05.465110+0000","last_active":"2023-10-06T03:27:06.465590+0000","last_peered":"2023-10-06T03:27:06.465590+0000","last_clean":"2023-10-06T03:27:06.465590+0000","last_became_active":"2023-10-06T03:27:05.464865+0000","last_became_peered":"2023-10-06T03:27:05.464865+0000","last_unstale":"2023-10-06T03:27:06.465590+0000","last_undegraded":"2023-10-06T03:27:06.465590+0000","last_fullsized":"2023-10-06T03:27:06.465590+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:44.378926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.375407+0000","last_change":"2023-10-06T03:27:06.375407+0000","last_active":"2023-10-06T03:27:06.375407+0000","last_peered":"2023-10-06T03:27:06.375407+0000","last_clean":"2023-10-06T03:27:06.375407+0000","last_became_active":"2023-10-06T03:27:06.375123+0000","last_became_peered":"2023-10-06T03:27:06.375123+0000","last_unstale":"2023-10-06T03:27:06.375407+0000","last_undegraded":"2023-10-06T03:27:06.375407+0000","last_fullsized":"2023-10-06T03:27:06.375407+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:34.223573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"97'2","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.461505+0000","last_change":"2023-10-06T03:27:05.467482+0000","last_active":"2023-10-06T03:27:06.461505+0000","last_peered":"2023-10-06T03:27:06.461505+0000","last_clean":"2023-10-06T03:27:06.461505+0000","last_became_active":"2023-10-06T03:27:05.467179+0000","last_became_peered":"2023-10-06T03:27:05.467179+0000","last_unstale":"2023-10-06T03:27:06.461505+0000","last_undegraded":"2023-10-06T03:27:06.461505+0000","last_fullsized":"2023-10-06T03:27:06.461505+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:21.100757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.384350+0000","last_change":"2023-10-06T03:27:06.379558+0000","last_active":"2023-10-06T03:27:06.384350+0000","last_peered":"2023-10-06T03:27:06.384350+0000","last_clean":"2023-10-06T03:27:06.384350+0000","last_became_active":"2023-10-06T03:27:06.376975+0000","last_became_peered":"2023-10-06T03:27:06.376975+0000","last_unstale":"2023-10-06T03:27:06.384350+0000","last_undegraded":"2023-10-06T03:27:06.384350+0000","last_fullsized":"2023-10-06T03:27:06.384350+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:31.069016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.465573+0000","last_change":"2023-10-06T03:27:05.479139+0000","last_active":"2023-10-06T03:27:06.465573+0000","last_peered":"2023-10-06T03:27:06.465573+0000","last_clean":"2023-10-06T03:27:06.465573+0000","last_became_active":"2023-10-06T03:27:05.478931+0000","last_became_peered":"2023-10-06T03:27:05.478931+0000","last_unstale":"2023-10-06T03:27:06.465573+0000","last_undegraded":"2023-10-06T03:27:06.465573+0000","last_fullsized":"2023-10-06T03:27:06.465573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:32.739786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383379+0000","last_change":"2023-10-06T03:27:06.376895+0000","last_active":"2023-10-06T03:27:06.383379+0000","last_peered":"2023-10-06T03:27:06.383379+0000","last_clean":"2023-10-06T03:27:06.383379+0000","last_became_active":"2023-10-06T03:27:06.376607+0000","last_became_peered":"2023-10-06T03:27:06.376607+0000","last_unstale":"2023-10-06T03:27:06.383379+0000","last_undegraded":"2023-10-06T03:27:06.383379+0000","last_fullsized":"2023-10-06T03:27:06.383379+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:16.894898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.475710+0000","last_change":"2023-10-06T03:27:05.473456+0000","last_active":"2023-10-06T03:27:05.475710+0000","last_peered":"2023-10-06T03:27:05.475710+0000","last_clean":"2023-10-06T03:27:05.475710+0000","last_became_active":"2023-10-06T03:27:05.473152+0000","last_became_peered":"2023-10-06T03:27:05.473152+0000","last_unstale":"2023-10-06T03:27:05.475710+0000","last_undegraded":"2023-10-06T03:27:05.475710+0000","last_fullsized":"2023-10-06T03:27:05.475710+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:38.377714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373977+0000","last_change":"2023-10-06T03:27:06.370917+0000","last_active":"2023-10-06T03:27:06.373977+0000","last_peered":"2023-10-06T03:27:06.373977+0000","last_clean":"2023-10-06T03:27:06.373977+0000","last_became_active":"2023-10-06T03:27:06.370470+0000","last_became_peered":"2023-10-06T03:27:06.370470+0000","last_unstale":"2023-10-06T03:27:06.373977+0000","last_undegraded":"2023-10-06T03:27:06.373977+0000","last_fullsized":"2023-10-06T03:27:06.373977+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:58.732084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"97'2","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.461588+0000","last_change":"2023-10-06T03:27:05.468310+0000","last_active":"2023-10-06T03:27:06.461588+0000","last_peered":"2023-10-06T03:27:06.461588+0000","last_clean":"2023-10-06T03:27:06.461588+0000","last_became_active":"2023-10-06T03:27:05.468058+0000","last_became_peered":"2023-10-06T03:27:05.468058+0000","last_unstale":"2023-10-06T03:27:06.461588+0000","last_undegraded":"2023-10-06T03:27:06.461588+0000","last_fullsized":"2023-10-06T03:27:06.461588+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:29.639851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.372648+0000","last_change":"2023-10-06T03:27:06.365383+0000","last_active":"2023-10-06T03:27:06.372648+0000","last_peered":"2023-10-06T03:27:06.372648+0000","last_clean":"2023-10-06T03:27:06.372648+0000","last_became_active":"2023-10-06T03:27:06.365130+0000","last_became_peered":"2023-10-06T03:27:06.365130+0000","last_unstale":"2023-10-06T03:27:06.372648+0000","last_undegraded":"2023-10-06T03:27:06.372648+0000","last_fullsized":"2023-10-06T03:27:06.372648+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:38.701547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.471666+0000","last_change":"2023-10-06T03:27:05.467650+0000","last_active":"2023-10-06T03:27:05.471666+0000","last_peered":"2023-10-06T03:27:05.471666+0000","last_clean":"2023-10-06T03:27:05.471666+0000","last_became_active":"2023-10-06T03:27:05.467385+0000","last_became_peered":"2023-10-06T03:27:05.467385+0000","last_unstale":"2023-10-06T03:27:05.471666+0000","last_undegraded":"2023-10-06T03:27:05.471666+0000","last_fullsized":"2023-10-06T03:27:05.471666+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:38.377714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383342+0000","last_change":"2023-10-06T03:27:06.375664+0000","last_active":"2023-10-06T03:27:06.383342+0000","last_peered":"2023-10-06T03:27:06.383342+0000","last_clean":"2023-10-06T03:27:06.383342+0000","last_became_active":"2023-10-06T03:27:06.375207+0000","last_became_peered":"2023-10-06T03:27:06.375207+0000","last_unstale":"2023-10-06T03:27:06.383342+0000","last_undegraded":"2023-10-06T03:27:06.383342+0000","last_fullsized":"2023-10-06T03:27:06.383342+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:26:51.980005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.477967+0000","last_change":"2023-10-06T03:27:05.472638+0000","last_active":"2023-10-06T03:27:05.477967+0000","last_peered":"2023-10-06T03:27:05.477967+0000","last_clean":"2023-10-06T03:27:05.477967+0000","last_became_active":"2023-10-06T03:27:05.472390+0000","last_became_peered":"2023-10-06T03:27:05.472390+0000","last_unstale":"2023-10-06T03:27:05.477967+0000","last_undegraded":"2023-10-06T03:27:05.477967+0000","last_fullsized":"2023-10-06T03:27:05.477967+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:13.281245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378514+0000","last_change":"2023-10-06T03:27:06.375342+0000","last_active":"2023-10-06T03:27:06.378514+0000","last_peered":"2023-10-06T03:27:06.378514+0000","last_clean":"2023-10-06T03:27:06.378514+0000","last_became_active":"2023-10-06T03:27:06.374831+0000","last_became_peered":"2023-10-06T03:27:06.374831+0000","last_unstale":"2023-10-06T03:27:06.378514+0000","last_undegraded":"2023-10-06T03:27:06.378514+0000","last_fullsized":"2023-10-06T03:27:06.378514+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:28.542553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.360391+0000","last_change":"2023-10-06T03:27:05.468194+0000","last_active":"2023-10-06T03:27:06.360391+0000","last_peered":"2023-10-06T03:27:06.360391+0000","last_clean":"2023-10-06T03:27:06.360391+0000","last_became_active":"2023-10-06T03:27:05.467946+0000","last_became_peered":"2023-10-06T03:27:05.467946+0000","last_unstale":"2023-10-06T03:27:06.360391+0000","last_undegraded":"2023-10-06T03:27:06.360391+0000","last_fullsized":"2023-10-06T03:27:06.360391+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:25.353601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.380096+0000","last_change":"2023-10-06T03:27:06.374120+0000","last_active":"2023-10-06T03:27:06.380096+0000","last_peered":"2023-10-06T03:27:06.380096+0000","last_clean":"2023-10-06T03:27:06.380096+0000","last_became_active":"2023-10-06T03:27:06.373806+0000","last_became_peered":"2023-10-06T03:27:06.373806+0000","last_unstale":"2023-10-06T03:27:06.380096+0000","last_undegraded":"2023-10-06T03:27:06.380096+0000","last_fullsized":"2023-10-06T03:27:06.380096+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:31.069016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.467918+0000","last_change":"2023-10-06T03:27:05.473530+0000","last_active":"2023-10-06T03:27:06.467918+0000","last_peered":"2023-10-06T03:27:06.467918+0000","last_clean":"2023-10-06T03:27:06.467918+0000","last_became_active":"2023-10-06T03:27:05.473242+0000","last_became_peered":"2023-10-06T03:27:05.473242+0000","last_unstale":"2023-10-06T03:27:06.467918+0000","last_undegraded":"2023-10-06T03:27:06.467918+0000","last_fullsized":"2023-10-06T03:27:06.467918+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:32.739786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373297+0000","last_change":"2023-10-06T03:27:06.370352+0000","last_active":"2023-10-06T03:27:06.373297+0000","last_peered":"2023-10-06T03:27:06.373297+0000","last_clean":"2023-10-06T03:27:06.373297+0000","last_became_active":"2023-10-06T03:27:06.370098+0000","last_became_peered":"2023-10-06T03:27:06.370098+0000","last_unstale":"2023-10-06T03:27:06.373297+0000","last_undegraded":"2023-10-06T03:27:06.373297+0000","last_fullsized":"2023-10-06T03:27:06.373297+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:46.920938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371192+0000","last_change":"2023-10-06T03:27:05.466897+0000","last_active":"2023-10-06T03:27:06.371192+0000","last_peered":"2023-10-06T03:27:06.371192+0000","last_clean":"2023-10-06T03:27:06.371192+0000","last_became_active":"2023-10-06T03:27:05.466644+0000","last_became_peered":"2023-10-06T03:27:05.466644+0000","last_unstale":"2023-10-06T03:27:06.371192+0000","last_undegraded":"2023-10-06T03:27:06.371192+0000","last_fullsized":"2023-10-06T03:27:06.371192+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:07.766620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.381688+0000","last_change":"2023-10-06T03:27:06.375472+0000","last_active":"2023-10-06T03:27:06.381688+0000","last_peered":"2023-10-06T03:27:06.381688+0000","last_clean":"2023-10-06T03:27:06.381688+0000","last_became_active":"2023-10-06T03:27:06.375213+0000","last_became_peered":"2023-10-06T03:27:06.375213+0000","last_unstale":"2023-10-06T03:27:06.381688+0000","last_undegraded":"2023-10-06T03:27:06.381688+0000","last_fullsized":"2023-10-06T03:27:06.381688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:08.790328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.362874+0000","last_change":"2023-10-06T03:27:05.467818+0000","last_active":"2023-10-06T03:27:06.362874+0000","last_peered":"2023-10-06T03:27:06.362874+0000","last_clean":"2023-10-06T03:27:06.362874+0000","last_became_active":"2023-10-06T03:27:05.467563+0000","last_became_peered":"2023-10-06T03:27:05.467563+0000","last_unstale":"2023-10-06T03:27:06.362874+0000","last_undegraded":"2023-10-06T03:27:06.362874+0000","last_fullsized":"2023-10-06T03:27:06.362874+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:05.602857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383488+0000","last_change":"2023-10-06T03:27:06.377274+0000","last_active":"2023-10-06T03:27:06.383488+0000","last_peered":"2023-10-06T03:27:06.383488+0000","last_clean":"2023-10-06T03:27:06.383488+0000","last_became_active":"2023-10-06T03:27:06.376990+0000","last_became_peered":"2023-10-06T03:27:06.376990+0000","last_unstale":"2023-10-06T03:27:06.383488+0000","last_undegraded":"2023-10-06T03:27:06.383488+0000","last_fullsized":"2023-10-06T03:27:06.383488+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:06.379038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.362572+0000","last_change":"2023-10-06T03:27:05.471522+0000","last_active":"2023-10-06T03:27:06.362572+0000","last_peered":"2023-10-06T03:27:06.362572+0000","last_clean":"2023-10-06T03:27:06.362572+0000","last_became_active":"2023-10-06T03:27:05.471268+0000","last_became_peered":"2023-10-06T03:27:05.471268+0000","last_unstale":"2023-10-06T03:27:06.362572+0000","last_undegraded":"2023-10-06T03:27:06.362572+0000","last_fullsized":"2023-10-06T03:27:06.362572+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:50.132863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383394+0000","last_change":"2023-10-06T03:27:06.376935+0000","last_active":"2023-10-06T03:27:06.383394+0000","last_peered":"2023-10-06T03:27:06.383394+0000","last_clean":"2023-10-06T03:27:06.383394+0000","last_became_active":"2023-10-06T03:27:06.376665+0000","last_became_peered":"2023-10-06T03:27:06.376665+0000","last_unstale":"2023-10-06T03:27:06.383394+0000","last_undegraded":"2023-10-06T03:27:06.383394+0000","last_fullsized":"2023-10-06T03:27:06.383394+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:26.360992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.469648+0000","last_change":"2023-10-06T03:27:05.465512+0000","last_active":"2023-10-06T03:27:05.469648+0000","last_peered":"2023-10-06T03:27:05.469648+0000","last_clean":"2023-10-06T03:27:05.469648+0000","last_became_active":"2023-10-06T03:27:05.465090+0000","last_became_peered":"2023-10-06T03:27:05.465090+0000","last_unstale":"2023-10-06T03:27:05.469648+0000","last_undegraded":"2023-10-06T03:27:05.469648+0000","last_fullsized":"2023-10-06T03:27:05.469648+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:31.954980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.370293+0000","last_change":"2023-10-06T03:27:06.367192+0000","last_active":"2023-10-06T03:27:06.370293+0000","last_peered":"2023-10-06T03:27:06.370293+0000","last_clean":"2023-10-06T03:27:06.370293+0000","last_became_active":"2023-10-06T03:27:06.366943+0000","last_became_peered":"2023-10-06T03:27:06.366943+0000","last_unstale":"2023-10-06T03:27:06.370293+0000","last_undegraded":"2023-10-06T03:27:06.370293+0000","last_fullsized":"2023-10-06T03:27:06.370293+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:10.911332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.360598+0000","last_change":"2023-10-06T03:27:05.468432+0000","last_active":"2023-10-06T03:27:06.360598+0000","last_peered":"2023-10-06T03:27:06.360598+0000","last_clean":"2023-10-06T03:27:06.360598+0000","last_became_active":"2023-10-06T03:27:05.468154+0000","last_became_peered":"2023-10-06T03:27:05.468154+0000","last_unstale":"2023-10-06T03:27:06.360598+0000","last_undegraded":"2023-10-06T03:27:06.360598+0000","last_fullsized":"2023-10-06T03:27:06.360598+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:06.870518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383322+0000","last_change":"2023-10-06T03:27:06.375474+0000","last_active":"2023-10-06T03:27:06.383322+0000","last_peered":"2023-10-06T03:27:06.383322+0000","last_clean":"2023-10-06T03:27:06.383322+0000","last_became_active":"2023-10-06T03:27:06.375032+0000","last_became_peered":"2023-10-06T03:27:06.375032+0000","last_unstale":"2023-10-06T03:27:06.383322+0000","last_undegraded":"2023-10-06T03:27:06.383322+0000","last_fullsized":"2023-10-06T03:27:06.383322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:14.315364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.471668+0000","last_change":"2023-10-06T03:27:05.468384+0000","last_active":"2023-10-06T03:27:05.471668+0000","last_peered":"2023-10-06T03:27:05.471668+0000","last_clean":"2023-10-06T03:27:05.471668+0000","last_became_active":"2023-10-06T03:27:05.468126+0000","last_became_peered":"2023-10-06T03:27:05.468126+0000","last_unstale":"2023-10-06T03:27:05.471668+0000","last_undegraded":"2023-10-06T03:27:05.471668+0000","last_fullsized":"2023-10-06T03:27:05.471668+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:36.025024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.381627+0000","last_change":"2023-10-06T03:27:06.374970+0000","last_active":"2023-10-06T03:27:06.381627+0000","last_peered":"2023-10-06T03:27:06.381627+0000","last_clean":"2023-10-06T03:27:06.381627+0000","last_became_active":"2023-10-06T03:27:06.374723+0000","last_became_peered":"2023-10-06T03:27:06.374723+0000","last_unstale":"2023-10-06T03:27:06.381627+0000","last_undegraded":"2023-10-06T03:27:06.381627+0000","last_fullsized":"2023-10-06T03:27:06.381627+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:19.950201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.359657+0000","last_change":"2023-10-06T03:27:05.467906+0000","last_active":"2023-10-06T03:27:06.359657+0000","last_peered":"2023-10-06T03:27:06.359657+0000","last_clean":"2023-10-06T03:27:06.359657+0000","last_became_active":"2023-10-06T03:27:05.467619+0000","last_became_peered":"2023-10-06T03:27:05.467619+0000","last_unstale":"2023-10-06T03:27:06.359657+0000","last_undegraded":"2023-10-06T03:27:06.359657+0000","last_fullsized":"2023-10-06T03:27:06.359657+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:00.446769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.376189+0000","last_change":"2023-10-06T03:27:06.376189+0000","last_active":"2023-10-06T03:27:06.376189+0000","last_peered":"2023-10-06T03:27:06.376189+0000","last_clean":"2023-10-06T03:27:06.376189+0000","last_became_active":"2023-10-06T03:27:06.375756+0000","last_became_peered":"2023-10-06T03:27:06.375756+0000","last_unstale":"2023-10-06T03:27:06.376189+0000","last_undegraded":"2023-10-06T03:27:06.376189+0000","last_fullsized":"2023-10-06T03:27:06.376189+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:19.672623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"97'6","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.470385+0000","last_change":"2023-10-06T03:27:05.466717+0000","last_active":"2023-10-06T03:27:06.470385+0000","last_peered":"2023-10-06T03:27:06.470385+0000","last_clean":"2023-10-06T03:27:06.470385+0000","last_became_active":"2023-10-06T03:27:05.465805+0000","last_became_peered":"2023-10-06T03:27:05.465805+0000","last_unstale":"2023-10-06T03:27:06.470385+0000","last_undegraded":"2023-10-06T03:27:06.470385+0000","last_fullsized":"2023-10-06T03:27:06.470385+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:55.226920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":82,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.361550+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:27:06.361550+0000","last_peered":"2023-10-06T03:27:06.361550+0000","last_clean":"2023-10-06T03:27:06.361550+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:27:06.361550+0000","last_undegraded":"2023-10-06T03:27:06.361550+0000","last_fullsized":"2023-10-06T03:27:06.361550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.376260+0000","last_change":"2023-10-06T03:27:06.369958+0000","last_active":"2023-10-06T03:27:06.376260+0000","last_peered":"2023-10-06T03:27:06.376260+0000","last_clean":"2023-10-06T03:27:06.376260+0000","last_became_active":"2023-10-06T03:27:06.369466+0000","last_became_peered":"2023-10-06T03:27:06.369466+0000","last_unstale":"2023-10-06T03:27:06.376260+0000","last_undegraded":"2023-10-06T03:27:06.376260+0000","last_fullsized":"2023-10-06T03:27:06.376260+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:14.093608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"97'3","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.464855+0000","last_change":"2023-10-06T03:27:05.470768+0000","last_active":"2023-10-06T03:27:06.464855+0000","last_peered":"2023-10-06T03:27:06.464855+0000","last_clean":"2023-10-06T03:27:06.464855+0000","last_became_active":"2023-10-06T03:27:05.469997+0000","last_became_peered":"2023-10-06T03:27:05.469997+0000","last_unstale":"2023-10-06T03:27:06.464855+0000","last_undegraded":"2023-10-06T03:27:06.464855+0000","last_fullsized":"2023-10-06T03:27:06.464855+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:09.903941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.362663+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:27:06.362663+0000","last_peered":"2023-10-06T03:27:06.362663+0000","last_clean":"2023-10-06T03:27:06.362663+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:27:06.362663+0000","last_undegraded":"2023-10-06T03:27:06.362663+0000","last_fullsized":"2023-10-06T03:27:06.362663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378447+0000","last_change":"2023-10-06T03:27:06.371879+0000","last_active":"2023-10-06T03:27:06.378447+0000","last_peered":"2023-10-06T03:27:06.378447+0000","last_clean":"2023-10-06T03:27:06.378447+0000","last_became_active":"2023-10-06T03:27:06.371639+0000","last_became_peered":"2023-10-06T03:27:06.371639+0000","last_unstale":"2023-10-06T03:27:06.378447+0000","last_undegraded":"2023-10-06T03:27:06.378447+0000","last_fullsized":"2023-10-06T03:27:06.378447+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:58.642133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371715+0000","last_change":"2023-10-06T03:27:05.473955+0000","last_active":"2023-10-06T03:27:06.371715+0000","last_peered":"2023-10-06T03:27:06.371715+0000","last_clean":"2023-10-06T03:27:06.371715+0000","last_became_active":"2023-10-06T03:27:05.473696+0000","last_became_peered":"2023-10-06T03:27:05.473696+0000","last_unstale":"2023-10-06T03:27:06.371715+0000","last_undegraded":"2023-10-06T03:27:06.371715+0000","last_fullsized":"2023-10-06T03:27:06.371715+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:19.887723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":75,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.463938+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:27:05.463938+0000","last_peered":"2023-10-06T03:27:05.463938+0000","last_clean":"2023-10-06T03:27:05.463938+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:27:05.463938+0000","last_undegraded":"2023-10-06T03:27:05.463938+0000","last_fullsized":"2023-10-06T03:27:05.463938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":241,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.363229+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:27:06.363229+0000","last_peered":"2023-10-06T03:27:06.363229+0000","last_clean":"2023-10-06T03:27:06.363229+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:27:06.363229+0000","last_undegraded":"2023-10-06T03:27:06.363229+0000","last_fullsized":"2023-10-06T03:27:06.363229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379998+0000","last_change":"2023-10-06T03:27:06.377557+0000","last_active":"2023-10-06T03:27:06.379998+0000","last_peered":"2023-10-06T03:27:06.379998+0000","last_clean":"2023-10-06T03:27:06.379998+0000","last_became_active":"2023-10-06T03:27:06.377299+0000","last_became_peered":"2023-10-06T03:27:06.377299+0000","last_unstale":"2023-10-06T03:27:06.379998+0000","last_undegraded":"2023-10-06T03:27:06.379998+0000","last_fullsized":"2023-10-06T03:27:06.379998+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:26:51.980005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"97'2","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.465231+0000","last_change":"2023-10-06T03:27:05.466611+0000","last_active":"2023-10-06T03:27:06.465231+0000","last_peered":"2023-10-06T03:27:06.465231+0000","last_clean":"2023-10-06T03:27:06.465231+0000","last_became_active":"2023-10-06T03:27:05.466320+0000","last_became_peered":"2023-10-06T03:27:05.466320+0000","last_unstale":"2023-10-06T03:27:06.465231+0000","last_undegraded":"2023-10-06T03:27:06.465231+0000","last_fullsized":"2023-10-06T03:27:06.465231+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:52.542599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":91,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.364662+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:27:06.364662+0000","last_peered":"2023-10-06T03:27:06.364662+0000","last_clean":"2023-10-06T03:27:06.364662+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:27:06.364662+0000","last_undegraded":"2023-10-06T03:27:06.364662+0000","last_fullsized":"2023-10-06T03:27:06.364662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378478+0000","last_change":"2023-10-06T03:27:06.371798+0000","last_active":"2023-10-06T03:27:06.378478+0000","last_peered":"2023-10-06T03:27:06.378478+0000","last_clean":"2023-10-06T03:27:06.378478+0000","last_became_active":"2023-10-06T03:27:06.371535+0000","last_became_peered":"2023-10-06T03:27:06.371535+0000","last_unstale":"2023-10-06T03:27:06.378478+0000","last_undegraded":"2023-10-06T03:27:06.378478+0000","last_fullsized":"2023-10-06T03:27:06.378478+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:31.069016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.475721+0000","last_change":"2023-10-06T03:27:05.473525+0000","last_active":"2023-10-06T03:27:05.475721+0000","last_peered":"2023-10-06T03:27:05.475721+0000","last_clean":"2023-10-06T03:27:05.475721+0000","last_became_active":"2023-10-06T03:27:05.473226+0000","last_became_peered":"2023-10-06T03:27:05.473226+0000","last_unstale":"2023-10-06T03:27:05.475721+0000","last_undegraded":"2023-10-06T03:27:05.475721+0000","last_fullsized":"2023-10-06T03:27:05.475721+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:29.237600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":91,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.363387+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:27:06.363387+0000","last_peered":"2023-10-06T03:27:06.363387+0000","last_clean":"2023-10-06T03:27:06.363387+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:27:06.363387+0000","last_undegraded":"2023-10-06T03:27:06.363387+0000","last_fullsized":"2023-10-06T03:27:06.363387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371904+0000","last_change":"2023-10-06T03:27:06.368904+0000","last_active":"2023-10-06T03:27:06.371904+0000","last_peered":"2023-10-06T03:27:06.371904+0000","last_clean":"2023-10-06T03:27:06.371904+0000","last_became_active":"2023-10-06T03:27:06.368242+0000","last_became_peered":"2023-10-06T03:27:06.368242+0000","last_unstale":"2023-10-06T03:27:06.371904+0000","last_undegraded":"2023-10-06T03:27:06.371904+0000","last_fullsized":"2023-10-06T03:27:06.371904+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:49.821624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"97'8","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.468775+0000","last_change":"2023-10-06T03:27:05.473835+0000","last_active":"2023-10-06T03:27:06.468775+0000","last_peered":"2023-10-06T03:27:06.468775+0000","last_clean":"2023-10-06T03:27:06.468775+0000","last_became_active":"2023-10-06T03:27:05.473599+0000","last_became_peered":"2023-10-06T03:27:05.473599+0000","last_unstale":"2023-10-06T03:27:06.468775+0000","last_undegraded":"2023-10-06T03:27:06.468775+0000","last_fullsized":"2023-10-06T03:27:06.468775+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:26.424129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.460283+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:27:05.460283+0000","last_peered":"2023-10-06T03:27:05.460283+0000","last_clean":"2023-10-06T03:27:05.460283+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:27:05.460283+0000","last_undegraded":"2023-10-06T03:27:05.460283+0000","last_fullsized":"2023-10-06T03:27:05.460283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.376726+0000","last_change":"2023-10-06T03:27:06.376726+0000","last_active":"2023-10-06T03:27:06.376726+0000","last_peered":"2023-10-06T03:27:06.376726+0000","last_clean":"2023-10-06T03:27:06.376726+0000","last_became_active":"2023-10-06T03:27:06.376474+0000","last_became_peered":"2023-10-06T03:27:06.376474+0000","last_unstale":"2023-10-06T03:27:06.376726+0000","last_undegraded":"2023-10-06T03:27:06.376726+0000","last_fullsized":"2023-10-06T03:27:06.376726+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:41.173471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.471610+0000","last_change":"2023-10-06T03:27:05.468816+0000","last_active":"2023-10-06T03:27:05.471610+0000","last_peered":"2023-10-06T03:27:05.471610+0000","last_clean":"2023-10-06T03:27:05.471610+0000","last_became_active":"2023-10-06T03:27:05.468570+0000","last_became_peered":"2023-10-06T03:27:05.468570+0000","last_unstale":"2023-10-06T03:27:05.471610+0000","last_undegraded":"2023-10-06T03:27:05.471610+0000","last_fullsized":"2023-10-06T03:27:05.471610+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:00.812742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371272+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:27:06.371272+0000","last_peered":"2023-10-06T03:27:06.371272+0000","last_clean":"2023-10-06T03:27:06.371272+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:27:06.371272+0000","last_undegraded":"2023-10-06T03:27:06.371272+0000","last_fullsized":"2023-10-06T03:27:06.371272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.380203+0000","last_change":"2023-10-06T03:27:06.374104+0000","last_active":"2023-10-06T03:27:06.380203+0000","last_peered":"2023-10-06T03:27:06.380203+0000","last_clean":"2023-10-06T03:27:06.380203+0000","last_became_active":"2023-10-06T03:27:06.373856+0000","last_became_peered":"2023-10-06T03:27:06.373856+0000","last_unstale":"2023-10-06T03:27:06.380203+0000","last_undegraded":"2023-10-06T03:27:06.380203+0000","last_fullsized":"2023-10-06T03:27:06.380203+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:58.642133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.361922+0000","last_change":"2023-10-06T03:27:05.469338+0000","last_active":"2023-10-06T03:27:06.361922+0000","last_peered":"2023-10-06T03:27:06.361922+0000","last_clean":"2023-10-06T03:27:06.361922+0000","last_became_active":"2023-10-06T03:27:05.469106+0000","last_became_peered":"2023-10-06T03:27:05.469106+0000","last_unstale":"2023-10-06T03:27:06.361922+0000","last_undegraded":"2023-10-06T03:27:06.361922+0000","last_fullsized":"2023-10-06T03:27:06.361922+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:07.766620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371220+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:27:06.371220+0000","last_peered":"2023-10-06T03:27:06.371220+0000","last_clean":"2023-10-06T03:27:06.371220+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:27:06.371220+0000","last_undegraded":"2023-10-06T03:27:06.371220+0000","last_fullsized":"2023-10-06T03:27:06.371220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299052,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072788,"statfs":{"total":96636764160,"available":96330534912,"internally_reserved":0,"allocated":1806336,"data_stored":1162150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.38900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.68100000000000005,"15min":0.747},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68799999999999994,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82599999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.47199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0720000000000001,"5min":1.103,"15min":1.103},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78400000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.372},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1220608,"data_stored":578225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77900000000000003,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71999999999999997,"5min":1.343,"15min":1.343},"last":0.621}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.72699999999999998,"15min":0.80200000000000005},"min":{"1min":0.41899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84699999999999998,"5min":1.329,"15min":1.329},"last":0.73899999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.70299999999999996,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.745,"15min":0.82099999999999995},"min":{"1min":0.371,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.40899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.752,"15min":0.82399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.76700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.79600000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.752,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.624},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299052,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072788,"statfs":{"total":96636764160,"available":96330534912,"internally_reserved":0,"allocated":1806336,"data_stored":1161686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.376,"15min":0.39900000000000002},"min":{"1min":0.255,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48299999999999998,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41199999999999998,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60999999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.378}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32100000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.50700000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39200000000000002,"15min":0.41199999999999998},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.504,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.433,"15min":0.46700000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52600000000000002,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.42599999999999999,"15min":0.45600000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58299999999999996,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.33200000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.101,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64200000000000002,"15min":0.67000000000000004},"min":{"1min":0.42199999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.79000000000000004,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.498}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91600000000000004,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298492,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073348,"statfs":{"total":96636764160,"available":96331108352,"internally_reserved":0,"allocated":1232896,"data_stored":578450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.64000000000000001,"15min":0.78600000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39100000000000001,"5min":12.19,"15min":12.19},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.56799999999999995,"15min":0.66400000000000003},"min":{"1min":0.28000000000000003,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.432,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.246,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.40799999999999997,"5min":1.357,"15min":1.357},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34300000000000003,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.40400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.77300000000000002,"15min":0.97099999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41299999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.42299999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.312}]},{"osd":4,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.96099999999999997,"15min":1.137},"min":{"1min":0.44500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76700000000000002,"5min":16.919,"15min":16.919},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.42699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.96999999999999997,"15min":1.1499999999999999},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":16.948,"15min":16.948},"last":0.41599999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40400000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.98699999999999999,"15min":1.1619999999999999},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83799999999999997,"5min":16.881,"15min":16.881},"last":0.48699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298464,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073376,"statfs":{"total":96636764160,"available":96331137024,"internally_reserved":0,"allocated":1204224,"data_stored":571194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.32600000000000001,"15min":0.33600000000000002},"min":{"1min":0.21299999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.42999999999999999,"5min":0.62,"15min":0.62},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.37,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.34799999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33800000000000002,"15min":0.34300000000000003},"min":{"1min":0.25800000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39300000000000002},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53100000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.29799999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.437}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72999999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73399999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298492,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073348,"statfs":{"total":96636764160,"available":96331108352,"internally_reserved":0,"allocated":1232896,"data_stored":579761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33300000000000002,"15min":0.34100000000000003},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.46300000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34300000000000003,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45000000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.31}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.20799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.435,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34699999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36499999999999999,"15min":0.374},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.49099999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.45400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.745,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72499999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59999999999999998,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73199999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48099999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.878,"15min":0.878},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79100000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81100000000000005,"5min":0.997,"15min":0.997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.46999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298476,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073364,"statfs":{"total":96636764160,"available":96331124736,"internally_reserved":0,"allocated":1216512,"data_stored":578155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.67800000000000005,"15min":0.72999999999999998},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":4.758,"15min":4.758},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.67000000000000004,"15min":0.73399999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88700000000000001,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.52200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.79800000000000004,"15min":0.92300000000000004},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90600000000000003,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.38},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.82399999999999995,"15min":0.95299999999999996},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79600000000000004,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.442}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.873,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.496}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70399999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67600000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47199999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84599999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40699999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.64500000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94799999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298472,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073368,"statfs":{"total":96636764160,"available":96331128832,"internally_reserved":0,"allocated":1212416,"data_stored":571770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65600000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.629,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.432},{"interface":"front","average":{"1min":0.503,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.999,"15min":0.999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67800000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.746,"15min":0.746},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.43099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77300000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":1.04,"15min":1.04},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.72099999999999997,"5min":1.284,"15min":1.284},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:27:10.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:27:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.670+0000 7f076bf86700 1 Processor -- start 2023-10-06T03:27:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.670+0000 7f076bf86700 1 -- start start 2023-10-06T03:27:10.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.671+0000 7f076bf86700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f07641595a0 0x7f07640aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.671+0000 7f076bf86700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07640b49e0 0x7f07640aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.671+0000 7f076bf86700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07640b0ca0 con 0x7f07640b07a0 2023-10-06T03:27:10.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.671+0000 7f076bf86700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640b0f80 con 0x7f07640b49e0 2023-10-06T03:27:10.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.671+0000 7f076bf86700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640b1260 con 0x7f07641595a0 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.671+0000 7f0769521700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07640b49e0 0x7f07640aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.671+0000 7f0769521700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07640b49e0 0x7f07640aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37908/0 (socket says 172.21.15.84:37908) 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.671+0000 7f0769521700 1 -- 172.21.15.84:0/200174775 learned_addr learned my addr 172.21.15.84:0/200174775 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f0769d22700 1 --2- 172.21.15.84:0/200174775 >> v2:172.21.15.131:3300/0 conn(0x7f07641595a0 0x7f07640aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f0769521700 1 -- 172.21.15.84:0/200174775 >> v2:172.21.15.131:3300/0 conn(0x7f07641595a0 msgr2=0x7f07640aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f0769521700 1 --2- 172.21.15.84:0/200174775 >> v2:172.21.15.131:3300/0 conn(0x7f07641595a0 0x7f07640aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f0769521700 1 -- 172.21.15.84:0/200174775 >> v1:172.21.15.131:6789/0 conn(0x7f07640b07a0 legacy=0x7f07640b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f0769521700 1 -- 172.21.15.84:0/200174775 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640b1540 con 0x7f07640b49e0 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f0769521700 1 --2- 172.21.15.84:0/200174775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 0x7f07640aaab0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f07540099b0 tx=0x7f0754009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb6b1b3fdc033d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f0768d20700 1 -- 172.21.15.84:0/200174775 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400b7e0 con 0x7f07640b49e0 2023-10-06T03:27:10.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f0768d20700 1 -- 172.21.15.84:0/200174775 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075400b940 con 0x7f07640b49e0 2023-10-06T03:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f0768d20700 1 -- 172.21.15.84:0/200174775 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400bce0 con 0x7f07640b49e0 2023-10-06T03:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f076bf86700 1 -- 172.21.15.84:0/200174775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 msgr2=0x7f07640aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.672+0000 7f076bf86700 1 --2- 172.21.15.84:0/200174775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 0x7f07640aaab0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f07540099b0 tx=0x7f0754009250 comp rx=0 tx=0).stop 2023-10-06T03:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.673+0000 7f076bf86700 1 -- 172.21.15.84:0/200174775 shutdown_connections 2023-10-06T03:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.673+0000 7f076bf86700 1 --2- 172.21.15.84:0/200174775 >> v2:172.21.15.131:3300/0 conn(0x7f07641595a0 0x7f07640aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.673+0000 7f076bf86700 1 --2- 172.21.15.84:0/200174775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 0x7f07640aaab0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.673+0000 7f076bf86700 1 -- 172.21.15.84:0/200174775 >> 172.21.15.84:0/200174775 conn(0x7f0764099830 msgr2=0x7f076406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.673+0000 7f076bf86700 1 -- 172.21.15.84:0/200174775 shutdown_connections 2023-10-06T03:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.673+0000 7f076bf86700 1 -- 172.21.15.84:0/200174775 wait complete. 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.674+0000 7f076bf86700 1 Processor -- start 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.674+0000 7f076bf86700 1 -- start start 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.674+0000 7f076bf86700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07640b07a0 0x7f076414a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.674+0000 7f076bf86700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 0x7f076409d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.674+0000 7f076bf86700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07641595a0 0x7f076409b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.674+0000 7f076bf86700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076409a130 con 0x7f07640b49e0 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.674+0000 7f076bf86700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076409a410 con 0x7f07641595a0 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.674+0000 7f076bf86700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076409a6f0 con 0x7f07640b07a0 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.674+0000 7f0769521700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 0x7f076409d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0769521700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 0x7f076409d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37924/0 (socket says 172.21.15.84:37924) 2023-10-06T03:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0769521700 1 -- 172.21.15.84:0/3395529581 learned_addr learned my addr 172.21.15.84:0/3395529581 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0769521700 1 -- 172.21.15.84:0/3395529581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07640b07a0 msgr2=0x7f076414a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0769521700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07640b07a0 0x7f076414a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0769521700 1 -- 172.21.15.84:0/3395529581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07641595a0 msgr2=0x7f076409b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0769521700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07641595a0 0x7f076409b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0769521700 1 -- 172.21.15.84:0/3395529581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540094f0 con 0x7f07640b49e0 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0769521700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 0x7f076409d9a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f07540030c0 tx=0x7f0754016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0759ffb700 1 -- 172.21.15.84:0/3395529581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754011d90 con 0x7f07640b49e0 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0759ffb700 1 -- 172.21.15.84:0/3395529581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0754020070 con 0x7f07640b49e0 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f076bf86700 1 -- 172.21.15.84:0/3395529581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076409a9d0 con 0x7f07640b49e0 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f0759ffb700 1 -- 172.21.15.84:0/3395529581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075401b6a0 con 0x7f07640b49e0 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.675+0000 7f076bf86700 1 -- 172.21.15.84:0/3395529581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076414ade0 con 0x7f07640b49e0 2023-10-06T03:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.676+0000 7f076bf86700 1 -- 172.21.15.84:0/3395529581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076409aef0 con 0x7f07640b49e0 2023-10-06T03:27:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.676+0000 7f0759ffb700 1 -- 172.21.15.84:0/3395529581 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0754022030 con 0x7f07640b49e0 2023-10-06T03:27:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.677+0000 7f0759ffb700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0748066f30 0x7f07480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.677+0000 7f0759ffb700 1 -- 172.21.15.84:0/3395529581 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0754086780 con 0x7f07640b49e0 2023-10-06T03:27:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.677+0000 7f0769d22700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0748066f30 0x7f07480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.677+0000 7f0769d22700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0748066f30 0x7f07480693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0760006fd0 tx=0x7f0760008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.681+0000 7f0759ffb700 1 -- 172.21.15.84:0/3395529581 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f076409aef0 con 0x7f07640b49e0 2023-10-06T03:27:10.754 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T03:27:10.752+0000 7f54273de700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:27:10.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.858+0000 7f076bf86700 1 -- 172.21.15.84:0/3395529581 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f076409aef0 con 0x7f0748066f30 2023-10-06T03:27:10.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.867+0000 7f0759ffb700 1 -- 172.21.15.84:0/3395529581 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311939 (secure 0 0 0) 0x7f076409aef0 con 0x7f0748066f30 2023-10-06T03:27:10.873 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 -- 172.21.15.84:0/3395529581 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0748066f30 msgr2=0x7f07480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0748066f30 0x7f07480693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0760006fd0 tx=0x7f0760008040 comp rx=0 tx=0).stop 2023-10-06T03:27:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 -- 172.21.15.84:0/3395529581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 msgr2=0x7f076409d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 0x7f076409d9a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f07540030c0 tx=0x7f0754016000 comp rx=0 tx=0).stop 2023-10-06T03:27:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 -- 172.21.15.84:0/3395529581 shutdown_connections 2023-10-06T03:27:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0748066f30 0x7f07480693e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07641595a0 0x7f076409b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07640b07a0 0x7f076414a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 --2- 172.21.15.84:0/3395529581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07640b49e0 0x7f076409d9a0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:10.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 -- 172.21.15.84:0/3395529581 >> 172.21.15.84:0/3395529581 conn(0x7f0764099830 msgr2=0x7f0764158920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:10.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 -- 172.21.15.84:0/3395529581 shutdown_connections 2023-10-06T03:27:10.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:10.870+0000 7f076bf86700 1 -- 172.21.15.84:0/3395529581 wait complete. 2023-10-06T03:27:10.877 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:27:10.883 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2023-10-06T03:27:09.080782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388980,"kb_used_data":10676,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752585740,"statfs":{"total":773094113280,"available":770647797760,"internally_reserved":0,"allocated":10932224,"data_stored":5781391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.635448"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.381801+0000","last_change":"2023-10-06T03:27:06.377065+0000","last_active":"2023-10-06T03:27:06.381801+0000","last_peered":"2023-10-06T03:27:06.381801+0000","last_clean":"2023-10-06T03:27:06.381801+0000","last_became_active":"2023-10-06T03:27:06.376832+0000","last_became_peered":"2023-10-06T03:27:06.376832+0000","last_unstale":"2023-10-06T03:27:06.381801+0000","last_undegraded":"2023-10-06T03:27:06.381801+0000","last_fullsized":"2023-10-06T03:27:06.381801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:42.408872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383324+0000","last_change":"2023-10-06T03:27:06.373571+0000","last_active":"2023-10-06T03:27:06.383324+0000","last_peered":"2023-10-06T03:27:06.383324+0000","last_clean":"2023-10-06T03:27:06.383324+0000","last_became_active":"2023-10-06T03:27:06.373327+0000","last_became_peered":"2023-10-06T03:27:06.373327+0000","last_unstale":"2023-10-06T03:27:06.383324+0000","last_undegraded":"2023-10-06T03:27:06.383324+0000","last_fullsized":"2023-10-06T03:27:06.383324+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:01.454160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.375035+0000","last_change":"2023-10-06T03:27:06.370859+0000","last_active":"2023-10-06T03:27:06.375035+0000","last_peered":"2023-10-06T03:27:06.375035+0000","last_clean":"2023-10-06T03:27:06.375035+0000","last_became_active":"2023-10-06T03:27:06.370608+0000","last_became_peered":"2023-10-06T03:27:06.370608+0000","last_unstale":"2023-10-06T03:27:06.375035+0000","last_undegraded":"2023-10-06T03:27:06.375035+0000","last_fullsized":"2023-10-06T03:27:06.375035+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:28.542553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373324+0000","last_change":"2023-10-06T03:27:06.369895+0000","last_active":"2023-10-06T03:27:06.373324+0000","last_peered":"2023-10-06T03:27:06.373324+0000","last_clean":"2023-10-06T03:27:06.373324+0000","last_became_active":"2023-10-06T03:27:06.369631+0000","last_became_peered":"2023-10-06T03:27:06.369631+0000","last_unstale":"2023-10-06T03:27:06.373324+0000","last_undegraded":"2023-10-06T03:27:06.373324+0000","last_fullsized":"2023-10-06T03:27:06.373324+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:20.284723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.367314+0000","last_change":"2023-10-06T03:27:06.367314+0000","last_active":"2023-10-06T03:27:06.367314+0000","last_peered":"2023-10-06T03:27:06.367314+0000","last_clean":"2023-10-06T03:27:06.367314+0000","last_became_active":"2023-10-06T03:27:06.367060+0000","last_became_peered":"2023-10-06T03:27:06.367060+0000","last_unstale":"2023-10-06T03:27:06.367314+0000","last_undegraded":"2023-10-06T03:27:06.367314+0000","last_fullsized":"2023-10-06T03:27:06.367314+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:39.368699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373612+0000","last_change":"2023-10-06T03:27:06.373612+0000","last_active":"2023-10-06T03:27:06.373612+0000","last_peered":"2023-10-06T03:27:06.373612+0000","last_clean":"2023-10-06T03:27:06.373612+0000","last_became_active":"2023-10-06T03:27:06.373125+0000","last_became_peered":"2023-10-06T03:27:06.373125+0000","last_unstale":"2023-10-06T03:27:06.373612+0000","last_undegraded":"2023-10-06T03:27:06.373612+0000","last_fullsized":"2023-10-06T03:27:06.373612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:37.782366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378790+0000","last_change":"2023-10-06T03:27:06.378790+0000","last_active":"2023-10-06T03:27:06.378790+0000","last_peered":"2023-10-06T03:27:06.378790+0000","last_clean":"2023-10-06T03:27:06.378790+0000","last_became_active":"2023-10-06T03:27:06.378201+0000","last_became_peered":"2023-10-06T03:27:06.378201+0000","last_unstale":"2023-10-06T03:27:06.378790+0000","last_undegraded":"2023-10-06T03:27:06.378790+0000","last_fullsized":"2023-10-06T03:27:06.378790+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:17.123137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383361+0000","last_change":"2023-10-06T03:27:06.375674+0000","last_active":"2023-10-06T03:27:06.383361+0000","last_peered":"2023-10-06T03:27:06.383361+0000","last_clean":"2023-10-06T03:27:06.383361+0000","last_became_active":"2023-10-06T03:27:06.375404+0000","last_became_peered":"2023-10-06T03:27:06.375404+0000","last_unstale":"2023-10-06T03:27:06.383361+0000","last_undegraded":"2023-10-06T03:27:06.383361+0000","last_fullsized":"2023-10-06T03:27:06.383361+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:14.907686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373597+0000","last_change":"2023-10-06T03:27:06.371296+0000","last_active":"2023-10-06T03:27:06.373597+0000","last_peered":"2023-10-06T03:27:06.373597+0000","last_clean":"2023-10-06T03:27:06.373597+0000","last_became_active":"2023-10-06T03:27:06.371056+0000","last_became_peered":"2023-10-06T03:27:06.371056+0000","last_unstale":"2023-10-06T03:27:06.373597+0000","last_undegraded":"2023-10-06T03:27:06.373597+0000","last_fullsized":"2023-10-06T03:27:06.373597+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:27.270072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.372851+0000","last_change":"2023-10-06T03:27:06.367076+0000","last_active":"2023-10-06T03:27:06.372851+0000","last_peered":"2023-10-06T03:27:06.372851+0000","last_clean":"2023-10-06T03:27:06.372851+0000","last_became_active":"2023-10-06T03:27:06.366832+0000","last_became_peered":"2023-10-06T03:27:06.366832+0000","last_unstale":"2023-10-06T03:27:06.372851+0000","last_undegraded":"2023-10-06T03:27:06.372851+0000","last_fullsized":"2023-10-06T03:27:06.372851+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.408072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383391+0000","last_change":"2023-10-06T03:27:06.377539+0000","last_active":"2023-10-06T03:27:06.383391+0000","last_peered":"2023-10-06T03:27:06.383391+0000","last_clean":"2023-10-06T03:27:06.383391+0000","last_became_active":"2023-10-06T03:27:06.377289+0000","last_became_peered":"2023-10-06T03:27:06.377289+0000","last_unstale":"2023-10-06T03:27:06.383391+0000","last_undegraded":"2023-10-06T03:27:06.383391+0000","last_fullsized":"2023-10-06T03:27:06.383391+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:43.541587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373342+0000","last_change":"2023-10-06T03:27:06.369957+0000","last_active":"2023-10-06T03:27:06.373342+0000","last_peered":"2023-10-06T03:27:06.373342+0000","last_clean":"2023-10-06T03:27:06.373342+0000","last_became_active":"2023-10-06T03:27:06.369700+0000","last_became_peered":"2023-10-06T03:27:06.369700+0000","last_unstale":"2023-10-06T03:27:06.373342+0000","last_undegraded":"2023-10-06T03:27:06.373342+0000","last_fullsized":"2023-10-06T03:27:06.373342+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:15.958907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383240+0000","last_change":"2023-10-06T03:27:06.373722+0000","last_active":"2023-10-06T03:27:06.383240+0000","last_peered":"2023-10-06T03:27:06.383240+0000","last_clean":"2023-10-06T03:27:06.383240+0000","last_became_active":"2023-10-06T03:27:06.373447+0000","last_became_peered":"2023-10-06T03:27:06.373447+0000","last_unstale":"2023-10-06T03:27:06.383240+0000","last_undegraded":"2023-10-06T03:27:06.383240+0000","last_fullsized":"2023-10-06T03:27:06.383240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:58.642133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.384378+0000","last_change":"2023-10-06T03:27:06.379908+0000","last_active":"2023-10-06T03:27:06.384378+0000","last_peered":"2023-10-06T03:27:06.384378+0000","last_clean":"2023-10-06T03:27:06.384378+0000","last_became_active":"2023-10-06T03:27:06.379550+0000","last_became_peered":"2023-10-06T03:27:06.379550+0000","last_unstale":"2023-10-06T03:27:06.384378+0000","last_undegraded":"2023-10-06T03:27:06.384378+0000","last_fullsized":"2023-10-06T03:27:06.384378+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:49.821624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378374+0000","last_change":"2023-10-06T03:27:06.378374+0000","last_active":"2023-10-06T03:27:06.378374+0000","last_peered":"2023-10-06T03:27:06.378374+0000","last_clean":"2023-10-06T03:27:06.378374+0000","last_became_active":"2023-10-06T03:27:06.378103+0000","last_became_peered":"2023-10-06T03:27:06.378103+0000","last_unstale":"2023-10-06T03:27:06.378374+0000","last_undegraded":"2023-10-06T03:27:06.378374+0000","last_fullsized":"2023-10-06T03:27:06.378374+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:48.470026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.372800+0000","last_change":"2023-10-06T03:27:06.365288+0000","last_active":"2023-10-06T03:27:06.372800+0000","last_peered":"2023-10-06T03:27:06.372800+0000","last_clean":"2023-10-06T03:27:06.372800+0000","last_became_active":"2023-10-06T03:27:06.365058+0000","last_became_peered":"2023-10-06T03:27:06.365058+0000","last_unstale":"2023-10-06T03:27:06.372800+0000","last_undegraded":"2023-10-06T03:27:06.372800+0000","last_fullsized":"2023-10-06T03:27:06.372800+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:04.312718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383428+0000","last_change":"2023-10-06T03:27:06.376791+0000","last_active":"2023-10-06T03:27:06.383428+0000","last_peered":"2023-10-06T03:27:06.383428+0000","last_clean":"2023-10-06T03:27:06.383428+0000","last_became_active":"2023-10-06T03:27:06.376522+0000","last_became_peered":"2023-10-06T03:27:06.376522+0000","last_unstale":"2023-10-06T03:27:06.383428+0000","last_undegraded":"2023-10-06T03:27:06.383428+0000","last_fullsized":"2023-10-06T03:27:06.383428+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:56.234310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383978+0000","last_change":"2023-10-06T03:27:06.380304+0000","last_active":"2023-10-06T03:27:06.383978+0000","last_peered":"2023-10-06T03:27:06.383978+0000","last_clean":"2023-10-06T03:27:06.383978+0000","last_became_active":"2023-10-06T03:27:06.380031+0000","last_became_peered":"2023-10-06T03:27:06.380031+0000","last_unstale":"2023-10-06T03:27:06.383978+0000","last_undegraded":"2023-10-06T03:27:06.383978+0000","last_fullsized":"2023-10-06T03:27:06.383978+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:29.864014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383358+0000","last_change":"2023-10-06T03:27:06.376658+0000","last_active":"2023-10-06T03:27:06.383358+0000","last_peered":"2023-10-06T03:27:06.383358+0000","last_clean":"2023-10-06T03:27:06.383358+0000","last_became_active":"2023-10-06T03:27:06.376168+0000","last_became_peered":"2023-10-06T03:27:06.376168+0000","last_unstale":"2023-10-06T03:27:06.383358+0000","last_undegraded":"2023-10-06T03:27:06.383358+0000","last_fullsized":"2023-10-06T03:27:06.383358+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:14.093608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379450+0000","last_change":"2023-10-06T03:27:06.370085+0000","last_active":"2023-10-06T03:27:06.379450+0000","last_peered":"2023-10-06T03:27:06.379450+0000","last_clean":"2023-10-06T03:27:06.379450+0000","last_became_active":"2023-10-06T03:27:06.369662+0000","last_became_peered":"2023-10-06T03:27:06.369662+0000","last_unstale":"2023-10-06T03:27:06.379450+0000","last_undegraded":"2023-10-06T03:27:06.379450+0000","last_fullsized":"2023-10-06T03:27:06.379450+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:35.579166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383233+0000","last_change":"2023-10-06T03:27:06.373249+0000","last_active":"2023-10-06T03:27:06.383233+0000","last_peered":"2023-10-06T03:27:06.383233+0000","last_clean":"2023-10-06T03:27:06.383233+0000","last_became_active":"2023-10-06T03:27:06.372954+0000","last_became_peered":"2023-10-06T03:27:06.372954+0000","last_unstale":"2023-10-06T03:27:06.383233+0000","last_undegraded":"2023-10-06T03:27:06.383233+0000","last_fullsized":"2023-10-06T03:27:06.383233+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:12.430763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379980+0000","last_change":"2023-10-06T03:27:06.377394+0000","last_active":"2023-10-06T03:27:06.379980+0000","last_peered":"2023-10-06T03:27:06.379980+0000","last_clean":"2023-10-06T03:27:06.379980+0000","last_became_active":"2023-10-06T03:27:06.377151+0000","last_became_peered":"2023-10-06T03:27:06.377151+0000","last_unstale":"2023-10-06T03:27:06.379980+0000","last_undegraded":"2023-10-06T03:27:06.379980+0000","last_fullsized":"2023-10-06T03:27:06.379980+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:14.315364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379247+0000","last_change":"2023-10-06T03:27:06.369988+0000","last_active":"2023-10-06T03:27:06.379247+0000","last_peered":"2023-10-06T03:27:06.379247+0000","last_clean":"2023-10-06T03:27:06.379247+0000","last_became_active":"2023-10-06T03:27:06.369459+0000","last_became_peered":"2023-10-06T03:27:06.369459+0000","last_unstale":"2023-10-06T03:27:06.379247+0000","last_undegraded":"2023-10-06T03:27:06.379247+0000","last_fullsized":"2023-10-06T03:27:06.379247+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:41.373671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.376330+0000","last_change":"2023-10-06T03:27:06.371760+0000","last_active":"2023-10-06T03:27:06.376330+0000","last_peered":"2023-10-06T03:27:06.376330+0000","last_clean":"2023-10-06T03:27:06.376330+0000","last_became_active":"2023-10-06T03:27:06.371547+0000","last_became_peered":"2023-10-06T03:27:06.371547+0000","last_unstale":"2023-10-06T03:27:06.376330+0000","last_undegraded":"2023-10-06T03:27:06.376330+0000","last_fullsized":"2023-10-06T03:27:06.376330+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:40.302282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383265+0000","last_change":"2023-10-06T03:27:06.373023+0000","last_active":"2023-10-06T03:27:06.383265+0000","last_peered":"2023-10-06T03:27:06.383265+0000","last_clean":"2023-10-06T03:27:06.383265+0000","last_became_active":"2023-10-06T03:27:06.372763+0000","last_became_peered":"2023-10-06T03:27:06.372763+0000","last_unstale":"2023-10-06T03:27:06.383265+0000","last_undegraded":"2023-10-06T03:27:06.383265+0000","last_fullsized":"2023-10-06T03:27:06.383265+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:27.932568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.381573+0000","last_change":"2023-10-06T03:27:06.374238+0000","last_active":"2023-10-06T03:27:06.381573+0000","last_peered":"2023-10-06T03:27:06.381573+0000","last_clean":"2023-10-06T03:27:06.381573+0000","last_became_active":"2023-10-06T03:27:06.373951+0000","last_became_peered":"2023-10-06T03:27:06.373951+0000","last_unstale":"2023-10-06T03:27:06.381573+0000","last_undegraded":"2023-10-06T03:27:06.381573+0000","last_fullsized":"2023-10-06T03:27:06.381573+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:04.630991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.375145+0000","last_change":"2023-10-06T03:27:06.375145+0000","last_active":"2023-10-06T03:27:06.375145+0000","last_peered":"2023-10-06T03:27:06.375145+0000","last_clean":"2023-10-06T03:27:06.375145+0000","last_became_active":"2023-10-06T03:27:06.374898+0000","last_became_peered":"2023-10-06T03:27:06.374898+0000","last_unstale":"2023-10-06T03:27:06.375145+0000","last_undegraded":"2023-10-06T03:27:06.375145+0000","last_fullsized":"2023-10-06T03:27:06.375145+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:39.368699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378502+0000","last_change":"2023-10-06T03:27:06.375137+0000","last_active":"2023-10-06T03:27:06.378502+0000","last_peered":"2023-10-06T03:27:06.378502+0000","last_clean":"2023-10-06T03:27:06.378502+0000","last_became_active":"2023-10-06T03:27:06.374883+0000","last_became_peered":"2023-10-06T03:27:06.374883+0000","last_unstale":"2023-10-06T03:27:06.378502+0000","last_undegraded":"2023-10-06T03:27:06.378502+0000","last_fullsized":"2023-10-06T03:27:06.378502+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:16.894898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379408+0000","last_change":"2023-10-06T03:27:06.370021+0000","last_active":"2023-10-06T03:27:06.379408+0000","last_peered":"2023-10-06T03:27:06.379408+0000","last_clean":"2023-10-06T03:27:06.379408+0000","last_became_active":"2023-10-06T03:27:06.369616+0000","last_became_peered":"2023-10-06T03:27:06.369616+0000","last_unstale":"2023-10-06T03:27:06.379408+0000","last_undegraded":"2023-10-06T03:27:06.379408+0000","last_fullsized":"2023-10-06T03:27:06.379408+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:47.735401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.377892+0000","last_change":"2023-10-06T03:27:06.377892+0000","last_active":"2023-10-06T03:27:06.377892+0000","last_peered":"2023-10-06T03:27:06.377892+0000","last_clean":"2023-10-06T03:27:06.377892+0000","last_became_active":"2023-10-06T03:27:06.377618+0000","last_became_peered":"2023-10-06T03:27:06.377618+0000","last_unstale":"2023-10-06T03:27:06.377892+0000","last_undegraded":"2023-10-06T03:27:06.377892+0000","last_fullsized":"2023-10-06T03:27:06.377892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:30.360326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379360+0000","last_change":"2023-10-06T03:27:06.373800+0000","last_active":"2023-10-06T03:27:06.379360+0000","last_peered":"2023-10-06T03:27:06.379360+0000","last_clean":"2023-10-06T03:27:06.379360+0000","last_became_active":"2023-10-06T03:27:06.373107+0000","last_became_peered":"2023-10-06T03:27:06.373107+0000","last_unstale":"2023-10-06T03:27:06.379360+0000","last_undegraded":"2023-10-06T03:27:06.379360+0000","last_fullsized":"2023-10-06T03:27:06.379360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:28.384501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378099+0000","last_change":"2023-10-06T03:27:06.378099+0000","last_active":"2023-10-06T03:27:06.378099+0000","last_peered":"2023-10-06T03:27:06.378099+0000","last_clean":"2023-10-06T03:27:06.378099+0000","last_became_active":"2023-10-06T03:27:06.377818+0000","last_became_peered":"2023-10-06T03:27:06.377818+0000","last_unstale":"2023-10-06T03:27:06.378099+0000","last_undegraded":"2023-10-06T03:27:06.378099+0000","last_fullsized":"2023-10-06T03:27:06.378099+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:01.820133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.375174+0000","last_change":"2023-10-06T03:27:06.375174+0000","last_active":"2023-10-06T03:27:06.375174+0000","last_peered":"2023-10-06T03:27:06.375174+0000","last_clean":"2023-10-06T03:27:06.375174+0000","last_became_active":"2023-10-06T03:27:06.374960+0000","last_became_peered":"2023-10-06T03:27:06.374960+0000","last_unstale":"2023-10-06T03:27:06.375174+0000","last_undegraded":"2023-10-06T03:27:06.375174+0000","last_fullsized":"2023-10-06T03:27:06.375174+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:50.252367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"97'4","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.465242+0000","last_change":"2023-10-06T03:27:05.466901+0000","last_active":"2023-10-06T03:27:06.465242+0000","last_peered":"2023-10-06T03:27:06.465242+0000","last_clean":"2023-10-06T03:27:06.465242+0000","last_became_active":"2023-10-06T03:27:05.466639+0000","last_became_peered":"2023-10-06T03:27:05.466639+0000","last_unstale":"2023-10-06T03:27:06.465242+0000","last_undegraded":"2023-10-06T03:27:06.465242+0000","last_fullsized":"2023-10-06T03:27:06.465242+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:49.244976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379680+0000","last_change":"2023-10-06T03:27:06.373436+0000","last_active":"2023-10-06T03:27:06.379680+0000","last_peered":"2023-10-06T03:27:06.379680+0000","last_clean":"2023-10-06T03:27:06.379680+0000","last_became_active":"2023-10-06T03:27:06.372493+0000","last_became_peered":"2023-10-06T03:27:06.372493+0000","last_unstale":"2023-10-06T03:27:06.379680+0000","last_undegraded":"2023-10-06T03:27:06.379680+0000","last_fullsized":"2023-10-06T03:27:06.379680+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:58.732084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.465112+0000","last_change":"2023-10-06T03:27:05.466332+0000","last_active":"2023-10-06T03:27:06.465112+0000","last_peered":"2023-10-06T03:27:06.465112+0000","last_clean":"2023-10-06T03:27:06.465112+0000","last_became_active":"2023-10-06T03:27:05.465966+0000","last_became_peered":"2023-10-06T03:27:05.465966+0000","last_unstale":"2023-10-06T03:27:06.465112+0000","last_undegraded":"2023-10-06T03:27:06.465112+0000","last_fullsized":"2023-10-06T03:27:06.465112+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:31.807788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.377821+0000","last_change":"2023-10-06T03:27:06.377821+0000","last_active":"2023-10-06T03:27:06.377821+0000","last_peered":"2023-10-06T03:27:06.377821+0000","last_clean":"2023-10-06T03:27:06.377821+0000","last_became_active":"2023-10-06T03:27:06.377580+0000","last_became_peered":"2023-10-06T03:27:06.377580+0000","last_unstale":"2023-10-06T03:27:06.377821+0000","last_undegraded":"2023-10-06T03:27:06.377821+0000","last_fullsized":"2023-10-06T03:27:06.377821+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:58.480428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"97'2","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.461227+0000","last_change":"2023-10-06T03:27:05.470576+0000","last_active":"2023-10-06T03:27:06.461227+0000","last_peered":"2023-10-06T03:27:06.461227+0000","last_clean":"2023-10-06T03:27:06.461227+0000","last_became_active":"2023-10-06T03:27:05.470314+0000","last_became_peered":"2023-10-06T03:27:05.470314+0000","last_unstale":"2023-10-06T03:27:06.461227+0000","last_undegraded":"2023-10-06T03:27:06.461227+0000","last_fullsized":"2023-10-06T03:27:06.461227+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:49.244976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.384378+0000","last_change":"2023-10-06T03:27:06.376830+0000","last_active":"2023-10-06T03:27:06.384378+0000","last_peered":"2023-10-06T03:27:06.384378+0000","last_clean":"2023-10-06T03:27:06.384378+0000","last_became_active":"2023-10-06T03:27:06.376398+0000","last_became_peered":"2023-10-06T03:27:06.376398+0000","last_unstale":"2023-10-06T03:27:06.384378+0000","last_undegraded":"2023-10-06T03:27:06.384378+0000","last_fullsized":"2023-10-06T03:27:06.384378+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:40.302282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"97'2","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.461088+0000","last_change":"2023-10-06T03:27:05.468159+0000","last_active":"2023-10-06T03:27:06.461088+0000","last_peered":"2023-10-06T03:27:06.461088+0000","last_clean":"2023-10-06T03:27:06.461088+0000","last_became_active":"2023-10-06T03:27:05.467408+0000","last_became_peered":"2023-10-06T03:27:05.467408+0000","last_unstale":"2023-10-06T03:27:06.461088+0000","last_undegraded":"2023-10-06T03:27:06.461088+0000","last_fullsized":"2023-10-06T03:27:06.461088+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:31.954980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.374310+0000","last_change":"2023-10-06T03:27:06.370916+0000","last_active":"2023-10-06T03:27:06.374310+0000","last_peered":"2023-10-06T03:27:06.374310+0000","last_clean":"2023-10-06T03:27:06.374310+0000","last_became_active":"2023-10-06T03:27:06.370651+0000","last_became_peered":"2023-10-06T03:27:06.370651+0000","last_unstale":"2023-10-06T03:27:06.374310+0000","last_undegraded":"2023-10-06T03:27:06.374310+0000","last_fullsized":"2023-10-06T03:27:06.374310+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:47.874750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"97'1","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.364321+0000","last_change":"2023-10-06T03:27:05.469638+0000","last_active":"2023-10-06T03:27:06.364321+0000","last_peered":"2023-10-06T03:27:06.364321+0000","last_clean":"2023-10-06T03:27:06.364321+0000","last_became_active":"2023-10-06T03:27:05.469352+0000","last_became_peered":"2023-10-06T03:27:05.469352+0000","last_unstale":"2023-10-06T03:27:06.364321+0000","last_undegraded":"2023-10-06T03:27:06.364321+0000","last_fullsized":"2023-10-06T03:27:06.364321+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:00.812742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379557+0000","last_change":"2023-10-06T03:27:06.371320+0000","last_active":"2023-10-06T03:27:06.379557+0000","last_peered":"2023-10-06T03:27:06.379557+0000","last_clean":"2023-10-06T03:27:06.379557+0000","last_became_active":"2023-10-06T03:27:06.371051+0000","last_became_peered":"2023-10-06T03:27:06.371051+0000","last_unstale":"2023-10-06T03:27:06.379557+0000","last_undegraded":"2023-10-06T03:27:06.379557+0000","last_fullsized":"2023-10-06T03:27:06.379557+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:58.125583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.461364+0000","last_change":"2023-10-06T03:27:05.468869+0000","last_active":"2023-10-06T03:27:06.461364+0000","last_peered":"2023-10-06T03:27:06.461364+0000","last_clean":"2023-10-06T03:27:06.461364+0000","last_became_active":"2023-10-06T03:27:05.468618+0000","last_became_peered":"2023-10-06T03:27:05.468618+0000","last_unstale":"2023-10-06T03:27:06.461364+0000","last_undegraded":"2023-10-06T03:27:06.461364+0000","last_fullsized":"2023-10-06T03:27:06.461364+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:19.887723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.381616+0000","last_change":"2023-10-06T03:27:06.374867+0000","last_active":"2023-10-06T03:27:06.381616+0000","last_peered":"2023-10-06T03:27:06.381616+0000","last_clean":"2023-10-06T03:27:06.381616+0000","last_became_active":"2023-10-06T03:27:06.374622+0000","last_became_peered":"2023-10-06T03:27:06.374622+0000","last_unstale":"2023-10-06T03:27:06.381616+0000","last_undegraded":"2023-10-06T03:27:06.381616+0000","last_fullsized":"2023-10-06T03:27:06.381616+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:00.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.360622+0000","last_change":"2023-10-06T03:27:05.465144+0000","last_active":"2023-10-06T03:27:06.360622+0000","last_peered":"2023-10-06T03:27:06.360622+0000","last_clean":"2023-10-06T03:27:06.360622+0000","last_became_active":"2023-10-06T03:27:05.464840+0000","last_became_peered":"2023-10-06T03:27:05.464840+0000","last_unstale":"2023-10-06T03:27:06.360622+0000","last_undegraded":"2023-10-06T03:27:06.360622+0000","last_fullsized":"2023-10-06T03:27:06.360622+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:12.336653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378961+0000","last_change":"2023-10-06T03:27:06.378961+0000","last_active":"2023-10-06T03:27:06.378961+0000","last_peered":"2023-10-06T03:27:06.378961+0000","last_clean":"2023-10-06T03:27:06.378961+0000","last_became_active":"2023-10-06T03:27:06.378549+0000","last_became_peered":"2023-10-06T03:27:06.378549+0000","last_unstale":"2023-10-06T03:27:06.378961+0000","last_undegraded":"2023-10-06T03:27:06.378961+0000","last_fullsized":"2023-10-06T03:27:06.378961+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:21.118685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.359530+0000","last_change":"2023-10-06T03:27:05.466426+0000","last_active":"2023-10-06T03:27:06.359530+0000","last_peered":"2023-10-06T03:27:06.359530+0000","last_clean":"2023-10-06T03:27:06.359530+0000","last_became_active":"2023-10-06T03:27:05.465699+0000","last_became_peered":"2023-10-06T03:27:05.465699+0000","last_unstale":"2023-10-06T03:27:06.359530+0000","last_undegraded":"2023-10-06T03:27:06.359530+0000","last_fullsized":"2023-10-06T03:27:06.359530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:57.118192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371180+0000","last_change":"2023-10-06T03:27:06.371180+0000","last_active":"2023-10-06T03:27:06.371180+0000","last_peered":"2023-10-06T03:27:06.371180+0000","last_clean":"2023-10-06T03:27:06.371180+0000","last_became_active":"2023-10-06T03:27:06.370938+0000","last_became_peered":"2023-10-06T03:27:06.370938+0000","last_unstale":"2023-10-06T03:27:06.371180+0000","last_undegraded":"2023-10-06T03:27:06.371180+0000","last_fullsized":"2023-10-06T03:27:06.371180+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:48.470026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.465590+0000","last_change":"2023-10-06T03:27:05.465110+0000","last_active":"2023-10-06T03:27:06.465590+0000","last_peered":"2023-10-06T03:27:06.465590+0000","last_clean":"2023-10-06T03:27:06.465590+0000","last_became_active":"2023-10-06T03:27:05.464865+0000","last_became_peered":"2023-10-06T03:27:05.464865+0000","last_unstale":"2023-10-06T03:27:06.465590+0000","last_undegraded":"2023-10-06T03:27:06.465590+0000","last_fullsized":"2023-10-06T03:27:06.465590+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:44.378926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.375407+0000","last_change":"2023-10-06T03:27:06.375407+0000","last_active":"2023-10-06T03:27:06.375407+0000","last_peered":"2023-10-06T03:27:06.375407+0000","last_clean":"2023-10-06T03:27:06.375407+0000","last_became_active":"2023-10-06T03:27:06.375123+0000","last_became_peered":"2023-10-06T03:27:06.375123+0000","last_unstale":"2023-10-06T03:27:06.375407+0000","last_undegraded":"2023-10-06T03:27:06.375407+0000","last_fullsized":"2023-10-06T03:27:06.375407+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:34.223573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"97'2","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.461505+0000","last_change":"2023-10-06T03:27:05.467482+0000","last_active":"2023-10-06T03:27:06.461505+0000","last_peered":"2023-10-06T03:27:06.461505+0000","last_clean":"2023-10-06T03:27:06.461505+0000","last_became_active":"2023-10-06T03:27:05.467179+0000","last_became_peered":"2023-10-06T03:27:05.467179+0000","last_unstale":"2023-10-06T03:27:06.461505+0000","last_undegraded":"2023-10-06T03:27:06.461505+0000","last_fullsized":"2023-10-06T03:27:06.461505+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:21.100757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.384350+0000","last_change":"2023-10-06T03:27:06.379558+0000","last_active":"2023-10-06T03:27:06.384350+0000","last_peered":"2023-10-06T03:27:06.384350+0000","last_clean":"2023-10-06T03:27:06.384350+0000","last_became_active":"2023-10-06T03:27:06.376975+0000","last_became_peered":"2023-10-06T03:27:06.376975+0000","last_unstale":"2023-10-06T03:27:06.384350+0000","last_undegraded":"2023-10-06T03:27:06.384350+0000","last_fullsized":"2023-10-06T03:27:06.384350+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:31.069016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.465573+0000","last_change":"2023-10-06T03:27:05.479139+0000","last_active":"2023-10-06T03:27:06.465573+0000","last_peered":"2023-10-06T03:27:06.465573+0000","last_clean":"2023-10-06T03:27:06.465573+0000","last_became_active":"2023-10-06T03:27:05.478931+0000","last_became_peered":"2023-10-06T03:27:05.478931+0000","last_unstale":"2023-10-06T03:27:06.465573+0000","last_undegraded":"2023-10-06T03:27:06.465573+0000","last_fullsized":"2023-10-06T03:27:06.465573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:32.739786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383379+0000","last_change":"2023-10-06T03:27:06.376895+0000","last_active":"2023-10-06T03:27:06.383379+0000","last_peered":"2023-10-06T03:27:06.383379+0000","last_clean":"2023-10-06T03:27:06.383379+0000","last_became_active":"2023-10-06T03:27:06.376607+0000","last_became_peered":"2023-10-06T03:27:06.376607+0000","last_unstale":"2023-10-06T03:27:06.383379+0000","last_undegraded":"2023-10-06T03:27:06.383379+0000","last_fullsized":"2023-10-06T03:27:06.383379+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:16.894898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.475710+0000","last_change":"2023-10-06T03:27:05.473456+0000","last_active":"2023-10-06T03:27:05.475710+0000","last_peered":"2023-10-06T03:27:05.475710+0000","last_clean":"2023-10-06T03:27:05.475710+0000","last_became_active":"2023-10-06T03:27:05.473152+0000","last_became_peered":"2023-10-06T03:27:05.473152+0000","last_unstale":"2023-10-06T03:27:05.475710+0000","last_undegraded":"2023-10-06T03:27:05.475710+0000","last_fullsized":"2023-10-06T03:27:05.475710+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:38.377714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373977+0000","last_change":"2023-10-06T03:27:06.370917+0000","last_active":"2023-10-06T03:27:06.373977+0000","last_peered":"2023-10-06T03:27:06.373977+0000","last_clean":"2023-10-06T03:27:06.373977+0000","last_became_active":"2023-10-06T03:27:06.370470+0000","last_became_peered":"2023-10-06T03:27:06.370470+0000","last_unstale":"2023-10-06T03:27:06.373977+0000","last_undegraded":"2023-10-06T03:27:06.373977+0000","last_fullsized":"2023-10-06T03:27:06.373977+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:58.732084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"97'2","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.461588+0000","last_change":"2023-10-06T03:27:05.468310+0000","last_active":"2023-10-06T03:27:06.461588+0000","last_peered":"2023-10-06T03:27:06.461588+0000","last_clean":"2023-10-06T03:27:06.461588+0000","last_became_active":"2023-10-06T03:27:05.468058+0000","last_became_peered":"2023-10-06T03:27:05.468058+0000","last_unstale":"2023-10-06T03:27:06.461588+0000","last_undegraded":"2023-10-06T03:27:06.461588+0000","last_fullsized":"2023-10-06T03:27:06.461588+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:29.639851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.372648+0000","last_change":"2023-10-06T03:27:06.365383+0000","last_active":"2023-10-06T03:27:06.372648+0000","last_peered":"2023-10-06T03:27:06.372648+0000","last_clean":"2023-10-06T03:27:06.372648+0000","last_became_active":"2023-10-06T03:27:06.365130+0000","last_became_peered":"2023-10-06T03:27:06.365130+0000","last_unstale":"2023-10-06T03:27:06.372648+0000","last_undegraded":"2023-10-06T03:27:06.372648+0000","last_fullsized":"2023-10-06T03:27:06.372648+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:38.701547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.471666+0000","last_change":"2023-10-06T03:27:05.467650+0000","last_active":"2023-10-06T03:27:05.471666+0000","last_peered":"2023-10-06T03:27:05.471666+0000","last_clean":"2023-10-06T03:27:05.471666+0000","last_became_active":"2023-10-06T03:27:05.467385+0000","last_became_peered":"2023-10-06T03:27:05.467385+0000","last_unstale":"2023-10-06T03:27:05.471666+0000","last_undegraded":"2023-10-06T03:27:05.471666+0000","last_fullsized":"2023-10-06T03:27:05.471666+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:38.377714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383342+0000","last_change":"2023-10-06T03:27:06.375664+0000","last_active":"2023-10-06T03:27:06.383342+0000","last_peered":"2023-10-06T03:27:06.383342+0000","last_clean":"2023-10-06T03:27:06.383342+0000","last_became_active":"2023-10-06T03:27:06.375207+0000","last_became_peered":"2023-10-06T03:27:06.375207+0000","last_unstale":"2023-10-06T03:27:06.383342+0000","last_undegraded":"2023-10-06T03:27:06.383342+0000","last_fullsized":"2023-10-06T03:27:06.383342+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:26:51.980005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.477967+0000","last_change":"2023-10-06T03:27:05.472638+0000","last_active":"2023-10-06T03:27:05.477967+0000","last_peered":"2023-10-06T03:27:05.477967+0000","last_clean":"2023-10-06T03:27:05.477967+0000","last_became_active":"2023-10-06T03:27:05.472390+0000","last_became_peered":"2023-10-06T03:27:05.472390+0000","last_unstale":"2023-10-06T03:27:05.477967+0000","last_undegraded":"2023-10-06T03:27:05.477967+0000","last_fullsized":"2023-10-06T03:27:05.477967+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:13.281245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378514+0000","last_change":"2023-10-06T03:27:06.375342+0000","last_active":"2023-10-06T03:27:06.378514+0000","last_peered":"2023-10-06T03:27:06.378514+0000","last_clean":"2023-10-06T03:27:06.378514+0000","last_became_active":"2023-10-06T03:27:06.374831+0000","last_became_peered":"2023-10-06T03:27:06.374831+0000","last_unstale":"2023-10-06T03:27:06.378514+0000","last_undegraded":"2023-10-06T03:27:06.378514+0000","last_fullsized":"2023-10-06T03:27:06.378514+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:28.542553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.360391+0000","last_change":"2023-10-06T03:27:05.468194+0000","last_active":"2023-10-06T03:27:06.360391+0000","last_peered":"2023-10-06T03:27:06.360391+0000","last_clean":"2023-10-06T03:27:06.360391+0000","last_became_active":"2023-10-06T03:27:05.467946+0000","last_became_peered":"2023-10-06T03:27:05.467946+0000","last_unstale":"2023-10-06T03:27:06.360391+0000","last_undegraded":"2023-10-06T03:27:06.360391+0000","last_fullsized":"2023-10-06T03:27:06.360391+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:25.353601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.380096+0000","last_change":"2023-10-06T03:27:06.374120+0000","last_active":"2023-10-06T03:27:06.380096+0000","last_peered":"2023-10-06T03:27:06.380096+0000","last_clean":"2023-10-06T03:27:06.380096+0000","last_became_active":"2023-10-06T03:27:06.373806+0000","last_became_peered":"2023-10-06T03:27:06.373806+0000","last_unstale":"2023-10-06T03:27:06.380096+0000","last_undegraded":"2023-10-06T03:27:06.380096+0000","last_fullsized":"2023-10-06T03:27:06.380096+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:31.069016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.467918+0000","last_change":"2023-10-06T03:27:05.473530+0000","last_active":"2023-10-06T03:27:06.467918+0000","last_peered":"2023-10-06T03:27:06.467918+0000","last_clean":"2023-10-06T03:27:06.467918+0000","last_became_active":"2023-10-06T03:27:05.473242+0000","last_became_peered":"2023-10-06T03:27:05.473242+0000","last_unstale":"2023-10-06T03:27:06.467918+0000","last_undegraded":"2023-10-06T03:27:06.467918+0000","last_fullsized":"2023-10-06T03:27:06.467918+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:32.739786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.373297+0000","last_change":"2023-10-06T03:27:06.370352+0000","last_active":"2023-10-06T03:27:06.373297+0000","last_peered":"2023-10-06T03:27:06.373297+0000","last_clean":"2023-10-06T03:27:06.373297+0000","last_became_active":"2023-10-06T03:27:06.370098+0000","last_became_peered":"2023-10-06T03:27:06.370098+0000","last_unstale":"2023-10-06T03:27:06.373297+0000","last_undegraded":"2023-10-06T03:27:06.373297+0000","last_fullsized":"2023-10-06T03:27:06.373297+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:46.920938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371192+0000","last_change":"2023-10-06T03:27:05.466897+0000","last_active":"2023-10-06T03:27:06.371192+0000","last_peered":"2023-10-06T03:27:06.371192+0000","last_clean":"2023-10-06T03:27:06.371192+0000","last_became_active":"2023-10-06T03:27:05.466644+0000","last_became_peered":"2023-10-06T03:27:05.466644+0000","last_unstale":"2023-10-06T03:27:06.371192+0000","last_undegraded":"2023-10-06T03:27:06.371192+0000","last_fullsized":"2023-10-06T03:27:06.371192+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:07.766620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.381688+0000","last_change":"2023-10-06T03:27:06.375472+0000","last_active":"2023-10-06T03:27:06.381688+0000","last_peered":"2023-10-06T03:27:06.381688+0000","last_clean":"2023-10-06T03:27:06.381688+0000","last_became_active":"2023-10-06T03:27:06.375213+0000","last_became_peered":"2023-10-06T03:27:06.375213+0000","last_unstale":"2023-10-06T03:27:06.381688+0000","last_undegraded":"2023-10-06T03:27:06.381688+0000","last_fullsized":"2023-10-06T03:27:06.381688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:08.790328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.362874+0000","last_change":"2023-10-06T03:27:05.467818+0000","last_active":"2023-10-06T03:27:06.362874+0000","last_peered":"2023-10-06T03:27:06.362874+0000","last_clean":"2023-10-06T03:27:06.362874+0000","last_became_active":"2023-10-06T03:27:05.467563+0000","last_became_peered":"2023-10-06T03:27:05.467563+0000","last_unstale":"2023-10-06T03:27:06.362874+0000","last_undegraded":"2023-10-06T03:27:06.362874+0000","last_fullsized":"2023-10-06T03:27:06.362874+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:05.602857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383488+0000","last_change":"2023-10-06T03:27:06.377274+0000","last_active":"2023-10-06T03:27:06.383488+0000","last_peered":"2023-10-06T03:27:06.383488+0000","last_clean":"2023-10-06T03:27:06.383488+0000","last_became_active":"2023-10-06T03:27:06.376990+0000","last_became_peered":"2023-10-06T03:27:06.376990+0000","last_unstale":"2023-10-06T03:27:06.383488+0000","last_undegraded":"2023-10-06T03:27:06.383488+0000","last_fullsized":"2023-10-06T03:27:06.383488+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:06.379038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.362572+0000","last_change":"2023-10-06T03:27:05.471522+0000","last_active":"2023-10-06T03:27:06.362572+0000","last_peered":"2023-10-06T03:27:06.362572+0000","last_clean":"2023-10-06T03:27:06.362572+0000","last_became_active":"2023-10-06T03:27:05.471268+0000","last_became_peered":"2023-10-06T03:27:05.471268+0000","last_unstale":"2023-10-06T03:27:06.362572+0000","last_undegraded":"2023-10-06T03:27:06.362572+0000","last_fullsized":"2023-10-06T03:27:06.362572+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:50.132863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383394+0000","last_change":"2023-10-06T03:27:06.376935+0000","last_active":"2023-10-06T03:27:06.383394+0000","last_peered":"2023-10-06T03:27:06.383394+0000","last_clean":"2023-10-06T03:27:06.383394+0000","last_became_active":"2023-10-06T03:27:06.376665+0000","last_became_peered":"2023-10-06T03:27:06.376665+0000","last_unstale":"2023-10-06T03:27:06.383394+0000","last_undegraded":"2023-10-06T03:27:06.383394+0000","last_fullsized":"2023-10-06T03:27:06.383394+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:26.360992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.469648+0000","last_change":"2023-10-06T03:27:05.465512+0000","last_active":"2023-10-06T03:27:05.469648+0000","last_peered":"2023-10-06T03:27:05.469648+0000","last_clean":"2023-10-06T03:27:05.469648+0000","last_became_active":"2023-10-06T03:27:05.465090+0000","last_became_peered":"2023-10-06T03:27:05.465090+0000","last_unstale":"2023-10-06T03:27:05.469648+0000","last_undegraded":"2023-10-06T03:27:05.469648+0000","last_fullsized":"2023-10-06T03:27:05.469648+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:31.954980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.370293+0000","last_change":"2023-10-06T03:27:06.367192+0000","last_active":"2023-10-06T03:27:06.370293+0000","last_peered":"2023-10-06T03:27:06.370293+0000","last_clean":"2023-10-06T03:27:06.370293+0000","last_became_active":"2023-10-06T03:27:06.366943+0000","last_became_peered":"2023-10-06T03:27:06.366943+0000","last_unstale":"2023-10-06T03:27:06.370293+0000","last_undegraded":"2023-10-06T03:27:06.370293+0000","last_fullsized":"2023-10-06T03:27:06.370293+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:10.911332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.360598+0000","last_change":"2023-10-06T03:27:05.468432+0000","last_active":"2023-10-06T03:27:06.360598+0000","last_peered":"2023-10-06T03:27:06.360598+0000","last_clean":"2023-10-06T03:27:06.360598+0000","last_became_active":"2023-10-06T03:27:05.468154+0000","last_became_peered":"2023-10-06T03:27:05.468154+0000","last_unstale":"2023-10-06T03:27:06.360598+0000","last_undegraded":"2023-10-06T03:27:06.360598+0000","last_fullsized":"2023-10-06T03:27:06.360598+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:06.870518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.383322+0000","last_change":"2023-10-06T03:27:06.375474+0000","last_active":"2023-10-06T03:27:06.383322+0000","last_peered":"2023-10-06T03:27:06.383322+0000","last_clean":"2023-10-06T03:27:06.383322+0000","last_became_active":"2023-10-06T03:27:06.375032+0000","last_became_peered":"2023-10-06T03:27:06.375032+0000","last_unstale":"2023-10-06T03:27:06.383322+0000","last_undegraded":"2023-10-06T03:27:06.383322+0000","last_fullsized":"2023-10-06T03:27:06.383322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:14.315364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.471668+0000","last_change":"2023-10-06T03:27:05.468384+0000","last_active":"2023-10-06T03:27:05.471668+0000","last_peered":"2023-10-06T03:27:05.471668+0000","last_clean":"2023-10-06T03:27:05.471668+0000","last_became_active":"2023-10-06T03:27:05.468126+0000","last_became_peered":"2023-10-06T03:27:05.468126+0000","last_unstale":"2023-10-06T03:27:05.471668+0000","last_undegraded":"2023-10-06T03:27:05.471668+0000","last_fullsized":"2023-10-06T03:27:05.471668+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:36.025024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.381627+0000","last_change":"2023-10-06T03:27:06.374970+0000","last_active":"2023-10-06T03:27:06.381627+0000","last_peered":"2023-10-06T03:27:06.381627+0000","last_clean":"2023-10-06T03:27:06.381627+0000","last_became_active":"2023-10-06T03:27:06.374723+0000","last_became_peered":"2023-10-06T03:27:06.374723+0000","last_unstale":"2023-10-06T03:27:06.381627+0000","last_undegraded":"2023-10-06T03:27:06.381627+0000","last_fullsized":"2023-10-06T03:27:06.381627+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:19.950201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.359657+0000","last_change":"2023-10-06T03:27:05.467906+0000","last_active":"2023-10-06T03:27:06.359657+0000","last_peered":"2023-10-06T03:27:06.359657+0000","last_clean":"2023-10-06T03:27:06.359657+0000","last_became_active":"2023-10-06T03:27:05.467619+0000","last_became_peered":"2023-10-06T03:27:05.467619+0000","last_unstale":"2023-10-06T03:27:06.359657+0000","last_undegraded":"2023-10-06T03:27:06.359657+0000","last_fullsized":"2023-10-06T03:27:06.359657+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:00.446769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.376189+0000","last_change":"2023-10-06T03:27:06.376189+0000","last_active":"2023-10-06T03:27:06.376189+0000","last_peered":"2023-10-06T03:27:06.376189+0000","last_clean":"2023-10-06T03:27:06.376189+0000","last_became_active":"2023-10-06T03:27:06.375756+0000","last_became_peered":"2023-10-06T03:27:06.375756+0000","last_unstale":"2023-10-06T03:27:06.376189+0000","last_undegraded":"2023-10-06T03:27:06.376189+0000","last_fullsized":"2023-10-06T03:27:06.376189+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:19.672623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"97'6","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.470385+0000","last_change":"2023-10-06T03:27:05.466717+0000","last_active":"2023-10-06T03:27:06.470385+0000","last_peered":"2023-10-06T03:27:06.470385+0000","last_clean":"2023-10-06T03:27:06.470385+0000","last_became_active":"2023-10-06T03:27:05.465805+0000","last_became_peered":"2023-10-06T03:27:05.465805+0000","last_unstale":"2023-10-06T03:27:06.470385+0000","last_undegraded":"2023-10-06T03:27:06.470385+0000","last_fullsized":"2023-10-06T03:27:06.470385+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:55.226920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":82,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.361550+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:27:06.361550+0000","last_peered":"2023-10-06T03:27:06.361550+0000","last_clean":"2023-10-06T03:27:06.361550+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:27:06.361550+0000","last_undegraded":"2023-10-06T03:27:06.361550+0000","last_fullsized":"2023-10-06T03:27:06.361550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.376260+0000","last_change":"2023-10-06T03:27:06.369958+0000","last_active":"2023-10-06T03:27:06.376260+0000","last_peered":"2023-10-06T03:27:06.376260+0000","last_clean":"2023-10-06T03:27:06.376260+0000","last_became_active":"2023-10-06T03:27:06.369466+0000","last_became_peered":"2023-10-06T03:27:06.369466+0000","last_unstale":"2023-10-06T03:27:06.376260+0000","last_undegraded":"2023-10-06T03:27:06.376260+0000","last_fullsized":"2023-10-06T03:27:06.376260+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:14.093608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"97'3","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.464855+0000","last_change":"2023-10-06T03:27:05.470768+0000","last_active":"2023-10-06T03:27:06.464855+0000","last_peered":"2023-10-06T03:27:06.464855+0000","last_clean":"2023-10-06T03:27:06.464855+0000","last_became_active":"2023-10-06T03:27:05.469997+0000","last_became_peered":"2023-10-06T03:27:05.469997+0000","last_unstale":"2023-10-06T03:27:06.464855+0000","last_undegraded":"2023-10-06T03:27:06.464855+0000","last_fullsized":"2023-10-06T03:27:06.464855+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:09.903941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.362663+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:27:06.362663+0000","last_peered":"2023-10-06T03:27:06.362663+0000","last_clean":"2023-10-06T03:27:06.362663+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:27:06.362663+0000","last_undegraded":"2023-10-06T03:27:06.362663+0000","last_fullsized":"2023-10-06T03:27:06.362663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378447+0000","last_change":"2023-10-06T03:27:06.371879+0000","last_active":"2023-10-06T03:27:06.378447+0000","last_peered":"2023-10-06T03:27:06.378447+0000","last_clean":"2023-10-06T03:27:06.378447+0000","last_became_active":"2023-10-06T03:27:06.371639+0000","last_became_peered":"2023-10-06T03:27:06.371639+0000","last_unstale":"2023-10-06T03:27:06.378447+0000","last_undegraded":"2023-10-06T03:27:06.378447+0000","last_fullsized":"2023-10-06T03:27:06.378447+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:58.642133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371715+0000","last_change":"2023-10-06T03:27:05.473955+0000","last_active":"2023-10-06T03:27:06.371715+0000","last_peered":"2023-10-06T03:27:06.371715+0000","last_clean":"2023-10-06T03:27:06.371715+0000","last_became_active":"2023-10-06T03:27:05.473696+0000","last_became_peered":"2023-10-06T03:27:05.473696+0000","last_unstale":"2023-10-06T03:27:06.371715+0000","last_undegraded":"2023-10-06T03:27:06.371715+0000","last_fullsized":"2023-10-06T03:27:06.371715+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:19.887723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":75,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.463938+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:27:05.463938+0000","last_peered":"2023-10-06T03:27:05.463938+0000","last_clean":"2023-10-06T03:27:05.463938+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:27:05.463938+0000","last_undegraded":"2023-10-06T03:27:05.463938+0000","last_fullsized":"2023-10-06T03:27:05.463938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":241,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.363229+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:27:06.363229+0000","last_peered":"2023-10-06T03:27:06.363229+0000","last_clean":"2023-10-06T03:27:06.363229+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:27:06.363229+0000","last_undegraded":"2023-10-06T03:27:06.363229+0000","last_fullsized":"2023-10-06T03:27:06.363229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.379998+0000","last_change":"2023-10-06T03:27:06.377557+0000","last_active":"2023-10-06T03:27:06.379998+0000","last_peered":"2023-10-06T03:27:06.379998+0000","last_clean":"2023-10-06T03:27:06.379998+0000","last_became_active":"2023-10-06T03:27:06.377299+0000","last_became_peered":"2023-10-06T03:27:06.377299+0000","last_unstale":"2023-10-06T03:27:06.379998+0000","last_undegraded":"2023-10-06T03:27:06.379998+0000","last_fullsized":"2023-10-06T03:27:06.379998+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:26:51.980005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"97'2","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.465231+0000","last_change":"2023-10-06T03:27:05.466611+0000","last_active":"2023-10-06T03:27:06.465231+0000","last_peered":"2023-10-06T03:27:06.465231+0000","last_clean":"2023-10-06T03:27:06.465231+0000","last_became_active":"2023-10-06T03:27:05.466320+0000","last_became_peered":"2023-10-06T03:27:05.466320+0000","last_unstale":"2023-10-06T03:27:06.465231+0000","last_undegraded":"2023-10-06T03:27:06.465231+0000","last_fullsized":"2023-10-06T03:27:06.465231+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:52.542599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":91,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.364662+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:27:06.364662+0000","last_peered":"2023-10-06T03:27:06.364662+0000","last_clean":"2023-10-06T03:27:06.364662+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:27:06.364662+0000","last_undegraded":"2023-10-06T03:27:06.364662+0000","last_fullsized":"2023-10-06T03:27:06.364662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.378478+0000","last_change":"2023-10-06T03:27:06.371798+0000","last_active":"2023-10-06T03:27:06.378478+0000","last_peered":"2023-10-06T03:27:06.378478+0000","last_clean":"2023-10-06T03:27:06.378478+0000","last_became_active":"2023-10-06T03:27:06.371535+0000","last_became_peered":"2023-10-06T03:27:06.371535+0000","last_unstale":"2023-10-06T03:27:06.378478+0000","last_undegraded":"2023-10-06T03:27:06.378478+0000","last_fullsized":"2023-10-06T03:27:06.378478+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:31.069016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.475721+0000","last_change":"2023-10-06T03:27:05.473525+0000","last_active":"2023-10-06T03:27:05.475721+0000","last_peered":"2023-10-06T03:27:05.475721+0000","last_clean":"2023-10-06T03:27:05.475721+0000","last_became_active":"2023-10-06T03:27:05.473226+0000","last_became_peered":"2023-10-06T03:27:05.473226+0000","last_unstale":"2023-10-06T03:27:05.475721+0000","last_undegraded":"2023-10-06T03:27:05.475721+0000","last_fullsized":"2023-10-06T03:27:05.475721+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:29.237600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":91,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.363387+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:27:06.363387+0000","last_peered":"2023-10-06T03:27:06.363387+0000","last_clean":"2023-10-06T03:27:06.363387+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:27:06.363387+0000","last_undegraded":"2023-10-06T03:27:06.363387+0000","last_fullsized":"2023-10-06T03:27:06.363387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371904+0000","last_change":"2023-10-06T03:27:06.368904+0000","last_active":"2023-10-06T03:27:06.371904+0000","last_peered":"2023-10-06T03:27:06.371904+0000","last_clean":"2023-10-06T03:27:06.371904+0000","last_became_active":"2023-10-06T03:27:06.368242+0000","last_became_peered":"2023-10-06T03:27:06.368242+0000","last_unstale":"2023-10-06T03:27:06.371904+0000","last_undegraded":"2023-10-06T03:27:06.371904+0000","last_fullsized":"2023-10-06T03:27:06.371904+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:49.821624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"97'8","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.468775+0000","last_change":"2023-10-06T03:27:05.473835+0000","last_active":"2023-10-06T03:27:06.468775+0000","last_peered":"2023-10-06T03:27:06.468775+0000","last_clean":"2023-10-06T03:27:06.468775+0000","last_became_active":"2023-10-06T03:27:05.473599+0000","last_became_peered":"2023-10-06T03:27:05.473599+0000","last_unstale":"2023-10-06T03:27:06.468775+0000","last_undegraded":"2023-10-06T03:27:06.468775+0000","last_fullsized":"2023-10-06T03:27:06.468775+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:26.424129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.460283+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:27:05.460283+0000","last_peered":"2023-10-06T03:27:05.460283+0000","last_clean":"2023-10-06T03:27:05.460283+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:27:05.460283+0000","last_undegraded":"2023-10-06T03:27:05.460283+0000","last_fullsized":"2023-10-06T03:27:05.460283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.376726+0000","last_change":"2023-10-06T03:27:06.376726+0000","last_active":"2023-10-06T03:27:06.376726+0000","last_peered":"2023-10-06T03:27:06.376726+0000","last_clean":"2023-10-06T03:27:06.376726+0000","last_became_active":"2023-10-06T03:27:06.376474+0000","last_became_peered":"2023-10-06T03:27:06.376474+0000","last_unstale":"2023-10-06T03:27:06.376726+0000","last_undegraded":"2023-10-06T03:27:06.376726+0000","last_fullsized":"2023-10-06T03:27:06.376726+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:41.173471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-06T03:27:05.471610+0000","last_change":"2023-10-06T03:27:05.468816+0000","last_active":"2023-10-06T03:27:05.471610+0000","last_peered":"2023-10-06T03:27:05.471610+0000","last_clean":"2023-10-06T03:27:05.471610+0000","last_became_active":"2023-10-06T03:27:05.468570+0000","last_became_peered":"2023-10-06T03:27:05.468570+0000","last_unstale":"2023-10-06T03:27:05.471610+0000","last_undegraded":"2023-10-06T03:27:05.471610+0000","last_fullsized":"2023-10-06T03:27:05.471610+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:00.812742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371272+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:27:06.371272+0000","last_peered":"2023-10-06T03:27:06.371272+0000","last_clean":"2023-10-06T03:27:06.371272+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:27:06.371272+0000","last_undegraded":"2023-10-06T03:27:06.371272+0000","last_fullsized":"2023-10-06T03:27:06.371272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.380203+0000","last_change":"2023-10-06T03:27:06.374104+0000","last_active":"2023-10-06T03:27:06.380203+0000","last_peered":"2023-10-06T03:27:06.380203+0000","last_clean":"2023-10-06T03:27:06.380203+0000","last_became_active":"2023-10-06T03:27:06.373856+0000","last_became_peered":"2023-10-06T03:27:06.373856+0000","last_unstale":"2023-10-06T03:27:06.380203+0000","last_undegraded":"2023-10-06T03:27:06.380203+0000","last_fullsized":"2023-10-06T03:27:06.380203+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:05.445434+0000","last_clean_scrub_stamp":"2023-10-06T03:27:05.445434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:58.642133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.361922+0000","last_change":"2023-10-06T03:27:05.469338+0000","last_active":"2023-10-06T03:27:06.361922+0000","last_peered":"2023-10-06T03:27:06.361922+0000","last_clean":"2023-10-06T03:27:06.361922+0000","last_became_active":"2023-10-06T03:27:05.469106+0000","last_became_peered":"2023-10-06T03:27:05.469106+0000","last_unstale":"2023-10-06T03:27:06.361922+0000","last_undegraded":"2023-10-06T03:27:06.361922+0000","last_fullsized":"2023-10-06T03:27:06.361922+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:04.438043+0000","last_clean_scrub_stamp":"2023-10-06T03:27:04.438043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:07.766620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-06T03:27:06.371220+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:27:06.371220+0000","last_peered":"2023-10-06T03:27:06.371220+0000","last_clean":"2023-10-06T03:27:06.371220+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:27:06.371220+0000","last_undegraded":"2023-10-06T03:27:06.371220+0000","last_fullsized":"2023-10-06T03:27:06.371220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299052,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072788,"statfs":{"total":96636764160,"available":96330534912,"internally_reserved":0,"allocated":1806336,"data_stored":1162150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.38900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.68100000000000005,"15min":0.747},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68799999999999994,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82599999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.47199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0720000000000001,"5min":1.103,"15min":1.103},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78400000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.372},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1220608,"data_stored":578225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77900000000000003,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71999999999999997,"5min":1.343,"15min":1.343},"last":0.621}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.72699999999999998,"15min":0.80200000000000005},"min":{"1min":0.41899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84699999999999998,"5min":1.329,"15min":1.329},"last":0.73899999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.70299999999999996,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.745,"15min":0.82099999999999995},"min":{"1min":0.371,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.40899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.752,"15min":0.82399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.76700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.79600000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.752,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.624},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299052,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072788,"statfs":{"total":96636764160,"available":96330534912,"internally_reserved":0,"allocated":1806336,"data_stored":1161686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.376,"15min":0.39900000000000002},"min":{"1min":0.255,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48299999999999998,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41199999999999998,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60999999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.378}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32100000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.50700000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39200000000000002,"15min":0.41199999999999998},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.504,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.433,"15min":0.46700000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52600000000000002,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.42599999999999999,"15min":0.45600000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58299999999999996,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.33200000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.101,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64200000000000002,"15min":0.67000000000000004},"min":{"1min":0.42199999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.79000000000000004,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.498}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91600000000000004,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298492,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073348,"statfs":{"total":96636764160,"available":96331108352,"internally_reserved":0,"allocated":1232896,"data_stored":578450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.64000000000000001,"15min":0.78600000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39100000000000001,"5min":12.19,"15min":12.19},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.56799999999999995,"15min":0.66400000000000003},"min":{"1min":0.28000000000000003,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.432,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.246,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.40799999999999997,"5min":1.357,"15min":1.357},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34300000000000003,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.40400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.77300000000000002,"15min":0.97099999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41299999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.42299999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.312}]},{"osd":4,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.96099999999999997,"15min":1.137},"min":{"1min":0.44500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76700000000000002,"5min":16.919,"15min":16.919},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.42699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.96999999999999997,"15min":1.1499999999999999},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":16.948,"15min":16.948},"last":0.41599999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40400000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.98699999999999999,"15min":1.1619999999999999},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83799999999999997,"5min":16.881,"15min":16.881},"last":0.48699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298464,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073376,"statfs":{"total":96636764160,"available":96331137024,"internally_reserved":0,"allocated":1204224,"data_stored":571194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.32600000000000001,"15min":0.33600000000000002},"min":{"1min":0.21299999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.42999999999999999,"5min":0.62,"15min":0.62},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.37,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.34799999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33800000000000002,"15min":0.34300000000000003},"min":{"1min":0.25800000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39300000000000002},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53100000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.29799999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.437}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72999999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73399999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298492,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073348,"statfs":{"total":96636764160,"available":96331108352,"internally_reserved":0,"allocated":1232896,"data_stored":579761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33300000000000002,"15min":0.34100000000000003},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.46300000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34300000000000003,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45000000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.31}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.20799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.435,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34699999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36499999999999999,"15min":0.374},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.49099999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.45400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.745,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72499999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59999999999999998,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73199999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48099999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.878,"15min":0.878},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79100000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81100000000000005,"5min":0.997,"15min":0.997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.46999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298476,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073364,"statfs":{"total":96636764160,"available":96331124736,"internally_reserved":0,"allocated":1216512,"data_stored":578155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.67800000000000005,"15min":0.72999999999999998},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":4.758,"15min":4.758},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.67000000000000004,"15min":0.73399999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88700000000000001,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.52200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.79800000000000004,"15min":0.92300000000000004},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90600000000000003,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.38},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.82399999999999995,"15min":0.95299999999999996},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79600000000000004,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.442}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.873,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.496}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70399999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67600000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47199999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84599999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40699999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.64500000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94799999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298472,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073368,"statfs":{"total":96636764160,"available":96331128832,"internally_reserved":0,"allocated":1212416,"data_stored":571770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65600000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.629,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.432},{"interface":"front","average":{"1min":0.503,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.999,"15min":0.999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67800000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.746,"15min":0.746},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.43099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77300000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":1.04,"15min":1.04},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.72099999999999997,"5min":1.284,"15min":1.284},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:27:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:27:10.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:27:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.043+0000 7f153107b700 1 Processor -- start 2023-10-06T03:27:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.043+0000 7f153107b700 1 -- start start 2023-10-06T03:27:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.044+0000 7f153107b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0b0610 0x7f152c0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.044+0000 7f153107b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c0cd100 con 0x7f152c0c95c0 2023-10-06T03:27:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.044+0000 7f153107b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c0cae10 con 0x7f152c0ccc90 2023-10-06T03:27:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.044+0000 7f153107b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c157810 con 0x7f152c0b0610 2023-10-06T03:27:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.044+0000 7f153087a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f152c0c95c0 0x7f152c0c2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52066/0 (socket says 172.21.15.84:52066) 2023-10-06T03:27:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.044+0000 7f153087a700 1 -- 172.21.15.84:0/1535349091 learned_addr learned my addr 172.21.15.84:0/1535349091 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:11.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.044+0000 7f152bfff700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0b0610 0x7f152c0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.044+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708433603 0 0) 0x7f152c0cd100 con 0x7f152c0c95c0 2023-10-06T03:27:11.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.044+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1514003570 con 0x7f152c0c95c0 2023-10-06T03:27:11.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3960502759 0 0) 0x7f1514003570 con 0x7f152c0c95c0 2023-10-06T03:27:11.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0b0610 msgr2=0x7f152c0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0b0610 0x7f152c0cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 >> v1:172.21.15.131:6789/0 conn(0x7f152c0ccc90 legacy=0x7f152c0c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0c9b20 con 0x7f152c0c95c0 2023-10-06T03:27:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f15240017f0 con 0x7f152c0c95c0 2023-10-06T03:27:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 >> v1:172.21.15.84:6789/0 conn(0x7f152c0c95c0 legacy=0x7f152c0c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 0x7f1514003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0b0610 0x7f1514004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1514004d50 0x7f15140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c157810 con 0x7f1514003a90 2023-10-06T03:27:11.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151400bb70 con 0x7f1514004d50 2023-10-06T03:27:11.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151400bd30 con 0x7f152c0b0610 2023-10-06T03:27:11.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152bfff700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 0x7f1514003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f153087a700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1514004d50 0x7f15140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152b7fe700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0b0610 0x7f1514004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152bfff700 1 -- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0b0610 msgr2=0x7f1514004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152bfff700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0b0610 0x7f1514004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152bfff700 1 -- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1514004d50 msgr2=0x7f15140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152bfff700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1514004d50 0x7f15140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152bfff700 1 -- 172.21.15.84:0/1535349091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514003570 con 0x7f1514003a90 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152bfff700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 0x7f1514003ea0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f151c009c00 tx=0x7f151c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca57cf6d6c8d306 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00e710 con 0x7f1514003a90 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00e870 con 0x7f1514003a90 2023-10-06T03:27:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.045+0000 7f152affd700 1 -- 172.21.15.84:0/1535349091 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00ec30 con 0x7f1514003a90 2023-10-06T03:27:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.046+0000 7f153107b700 1 -- 172.21.15.84:0/1535349091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 msgr2=0x7f1514003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.046+0000 7f153107b700 1 --2- 172.21.15.84:0/1535349091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 0x7f1514003ea0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f151c009c00 tx=0x7f151c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.046+0000 7f153087a700 1 -- 172.21.15.84:0/1535349091 reap_dead start 2023-10-06T03:27:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.046+0000 7f153107b700 1 -- 172.21.15.84:0/1535349091 shutdown_connections 2023-10-06T03:27:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.046+0000 7f153107b700 1 -- 172.21.15.84:0/1535349091 >> 172.21.15.84:0/1535349091 conn(0x7f152c096a70 msgr2=0x7f152c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.046+0000 7f153107b700 1 -- 172.21.15.84:0/1535349091 shutdown_connections 2023-10-06T03:27:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.046+0000 7f153107b700 1 -- 172.21.15.84:0/1535349091 wait complete. 2023-10-06T03:27:11.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.047+0000 7f153107b700 1 Processor -- start 2023-10-06T03:27:11.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.047+0000 7f153107b700 1 -- start start 2023-10-06T03:27:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f153107b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 0x7f152c0c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f153107b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0694c0 0x7f152c147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f153107b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0af090 0x7f152c0af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f153107b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0b1460 con 0x7f1514003a90 2023-10-06T03:27:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f153107b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0afa40 con 0x7f152c0af090 2023-10-06T03:27:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f153107b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0b15f0 con 0x7f152c0694c0 2023-10-06T03:27:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 0x7f152c0c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 0x7f152c0c5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37944/0 (socket says 172.21.15.84:37944) 2023-10-06T03:27:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152bfff700 1 -- 172.21.15.84:0/2834872607 learned_addr learned my addr 172.21.15.84:0/2834872607 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f153087a700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0af090 0x7f152c0af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152b7fe700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0694c0 0x7f152c147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152bfff700 1 -- 172.21.15.84:0/2834872607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0694c0 msgr2=0x7f152c147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152bfff700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0694c0 0x7f152c147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152bfff700 1 -- 172.21.15.84:0/2834872607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0af090 msgr2=0x7f152c0af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152bfff700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0af090 0x7f152c0af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152bfff700 1 -- 172.21.15.84:0/2834872607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0c5a70 con 0x7f1514003a90 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f153087a700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0af090 0x7f152c0af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152b7fe700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0694c0 0x7f152c147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.048+0000 7f152bfff700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 0x7f152c0c5220 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f151c00e4b0 tx=0x7f151c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.049+0000 7f1513fff700 1 -- 172.21.15.84:0/2834872607 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c022070 con 0x7f1514003a90 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.049+0000 7f1513fff700 1 -- 172.21.15.84:0/2834872607 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00e9e0 con 0x7f1514003a90 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.049+0000 7f153107b700 1 -- 172.21.15.84:0/2834872607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c0c5d50 con 0x7f1514003a90 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.049+0000 7f1513fff700 1 -- 172.21.15.84:0/2834872607 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c027470 con 0x7f1514003a90 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.049+0000 7f153107b700 1 -- 172.21.15.84:0/2834872607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c0c6310 con 0x7f1514003a90 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.049+0000 7f153107b700 1 -- 172.21.15.84:0/2834872607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c0b18d0 con 0x7f1514003a90 2023-10-06T03:27:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.050+0000 7f1513fff700 1 -- 172.21.15.84:0/2834872607 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f151c027880 con 0x7f1514003a90 2023-10-06T03:27:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.050+0000 7f1513fff700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1518066f30 0x7f15180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.050+0000 7f1513fff700 1 -- 172.21.15.84:0/2834872607 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f151c086270 con 0x7f1514003a90 2023-10-06T03:27:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.050+0000 7f152b7fe700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1518066f30 0x7f15180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.051+0000 7f152b7fe700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1518066f30 0x7f15180693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f152c069050 tx=0x7f1520009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.054+0000 7f1513fff700 1 -- 172.21.15.84:0/2834872607 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f151c0532f0 con 0x7f1514003a90 2023-10-06T03:27:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.311+0000 7f153107b700 1 -- 172.21.15.84:0/2834872607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f152c05f270 con 0x7f1514003a90 2023-10-06T03:27:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.315+0000 7f1513fff700 1 -- 172.21.15.84:0/2834872607 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f151c056910 con 0x7f1514003a90 2023-10-06T03:27:11.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.317+0000 7f153107b700 1 -- 172.21.15.84:0/2834872607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1518066f30 msgr2=0x7f15180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.317+0000 7f153107b700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1518066f30 0x7f15180693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f152c069050 tx=0x7f1520009040 comp rx=0 tx=0).stop 2023-10-06T03:27:11.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.317+0000 7f153107b700 1 -- 172.21.15.84:0/2834872607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 msgr2=0x7f152c0c5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.317+0000 7f153107b700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 0x7f152c0c5220 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f151c00e4b0 tx=0x7f151c01a000 comp rx=0 tx=0).stop 2023-10-06T03:27:11.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.317+0000 7f153107b700 1 -- 172.21.15.84:0/2834872607 shutdown_connections 2023-10-06T03:27:11.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.317+0000 7f153107b700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1518066f30 0x7f15180693e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.317+0000 7f153107b700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0af090 0x7f152c0af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.317+0000 7f153107b700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1514003a90 0x7f152c0c5220 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.317+0000 7f153107b700 1 --2- 172.21.15.84:0/2834872607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f152c0694c0 0x7f152c147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.317+0000 7f153107b700 1 -- 172.21.15.84:0/2834872607 >> 172.21.15.84:0/2834872607 conn(0x7f152c096a70 msgr2=0x7f152c0cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.318+0000 7f153107b700 1 -- 172.21.15.84:0/2834872607 shutdown_connections 2023-10-06T03:27:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.318+0000 7f153107b700 1 -- 172.21.15.84:0/2834872607 wait complete. 2023-10-06T03:27:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T03:27:11.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.443+0000 7f0a6a528700 1 Processor -- start 2023-10-06T03:27:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.443+0000 7f0a6a528700 1 -- start start 2023-10-06T03:27:11.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.444+0000 7f0a6a528700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a641595a0 0x7f0a640aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.444+0000 7f0a6a528700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a640b49e0 0x7f0a640aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.444+0000 7f0a6a528700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a640b0ca0 con 0x7f0a640b07a0 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.444+0000 7f0a6a528700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a640b0f80 con 0x7f0a641595a0 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.444+0000 7f0a6a528700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a640b1260 con 0x7f0a640b49e0 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.444+0000 7f0a63fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a641595a0 0x7f0a640aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.444+0000 7f0a68ac5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0a640b07a0 0x7f0a640b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52074/0 (socket says 172.21.15.84:52074) 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.444+0000 7f0a68ac5700 1 -- 172.21.15.84:0/1105889753 learned_addr learned my addr 172.21.15.84:0/1105889753 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a637fe700 1 --2- 172.21.15.84:0/1105889753 >> v2:172.21.15.131:3300/0 conn(0x7f0a640b49e0 0x7f0a640aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a63fff700 1 -- 172.21.15.84:0/1105889753 >> v2:172.21.15.131:3300/0 conn(0x7f0a640b49e0 msgr2=0x7f0a640aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a63fff700 1 --2- 172.21.15.84:0/1105889753 >> v2:172.21.15.131:3300/0 conn(0x7f0a640b49e0 0x7f0a640aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a63fff700 1 -- 172.21.15.84:0/1105889753 >> v1:172.21.15.84:6789/0 conn(0x7f0a640b07a0 legacy=0x7f0a640b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a63fff700 1 -- 172.21.15.84:0/1105889753 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a640b1540 con 0x7f0a641595a0 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a62ffd700 1 -- 172.21.15.84:0/1105889753 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765349672 0 0) 0x7f0a640b0ca0 con 0x7f0a640b07a0 2023-10-06T03:27:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a637fe700 1 --2- 172.21.15.84:0/1105889753 >> v2:172.21.15.131:3300/0 conn(0x7f0a640b49e0 0x7f0a640aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a63fff700 1 --2- 172.21.15.84:0/1105889753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a641595a0 0x7f0a640aa570 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0a540098d0 tx=0x7f0a54009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf042e0cfadddf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a62ffd700 1 -- 172.21.15.84:0/1105889753 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54009e70 con 0x7f0a641595a0 2023-10-06T03:27:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a62ffd700 1 -- 172.21.15.84:0/1105889753 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54005c10 con 0x7f0a641595a0 2023-10-06T03:27:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a62ffd700 1 -- 172.21.15.84:0/1105889753 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400b610 con 0x7f0a641595a0 2023-10-06T03:27:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a6a528700 1 -- 172.21.15.84:0/1105889753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a641595a0 msgr2=0x7f0a640aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a6a528700 1 --2- 172.21.15.84:0/1105889753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a641595a0 0x7f0a640aa570 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0a540098d0 tx=0x7f0a54009120 comp rx=0 tx=0).stop 2023-10-06T03:27:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a6a528700 1 -- 172.21.15.84:0/1105889753 shutdown_connections 2023-10-06T03:27:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a6a528700 1 --2- 172.21.15.84:0/1105889753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a641595a0 0x7f0a640aa570 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a6a528700 1 --2- 172.21.15.84:0/1105889753 >> v2:172.21.15.131:3300/0 conn(0x7f0a640b49e0 0x7f0a640aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a6a528700 1 -- 172.21.15.84:0/1105889753 >> 172.21.15.84:0/1105889753 conn(0x7f0a64099830 msgr2=0x7f0a6406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:11.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a6a528700 1 -- 172.21.15.84:0/1105889753 shutdown_connections 2023-10-06T03:27:11.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.445+0000 7f0a6a528700 1 -- 172.21.15.84:0/1105889753 wait complete. 2023-10-06T03:27:11.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.447+0000 7f0a6a528700 1 Processor -- start 2023-10-06T03:27:11.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.447+0000 7f0a6a528700 1 -- start start 2023-10-06T03:27:11.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.447+0000 7f0a6a528700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a640b07a0 0x7f0a640af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.447+0000 7f0a6a528700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a640b49e0 0x7f0a64144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.447+0000 7f0a6a528700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a641595a0 0x7f0a6415c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.447+0000 7f0a6a528700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a641599f0 con 0x7f0a640b07a0 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.447+0000 7f0a6a528700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6415a530 con 0x7f0a640b49e0 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.447+0000 7f0a6a528700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64159c00 con 0x7f0a641595a0 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.447+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a640b07a0 0x7f0a640af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a640b07a0 0x7f0a640af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37972/0 (socket says 172.21.15.84:37972) 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a63fff700 1 -- 172.21.15.84:0/2850361094 learned_addr learned my addr 172.21.15.84:0/2850361094 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a63fff700 1 -- 172.21.15.84:0/2850361094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a641595a0 msgr2=0x7f0a6415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a63fff700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a641595a0 0x7f0a6415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a63fff700 1 -- 172.21.15.84:0/2850361094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a640b49e0 msgr2=0x7f0a64144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a63fff700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a640b49e0 0x7f0a64144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a63fff700 1 -- 172.21.15.84:0/2850361094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a540093c0 con 0x7f0a640b07a0 2023-10-06T03:27:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a63fff700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a640b07a0 0x7f0a640af2c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0a64067c60 tx=0x7f0a54016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a4bfff700 1 -- 172.21.15.84:0/2850361094 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54006460 con 0x7f0a640b07a0 2023-10-06T03:27:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a4bfff700 1 -- 172.21.15.84:0/2850361094 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a540065c0 con 0x7f0a640b07a0 2023-10-06T03:27:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a6a528700 1 -- 172.21.15.84:0/2850361094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a64159ee0 con 0x7f0a640b07a0 2023-10-06T03:27:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a4bfff700 1 -- 172.21.15.84:0/2850361094 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5401b480 con 0x7f0a640b07a0 2023-10-06T03:27:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.448+0000 7f0a6a528700 1 -- 172.21.15.84:0/2850361094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a640af800 con 0x7f0a640b07a0 2023-10-06T03:27:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.449+0000 7f0a6a528700 1 -- 172.21.15.84:0/2850361094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a64064ad0 con 0x7f0a640b07a0 2023-10-06T03:27:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.449+0000 7f0a4bfff700 1 -- 172.21.15.84:0/2850361094 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a5401b7f0 con 0x7f0a640b07a0 2023-10-06T03:27:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.450+0000 7f0a4bfff700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a50066f30 0x7f0a500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.450+0000 7f0a4bfff700 1 -- 172.21.15.84:0/2850361094 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0a54086ac0 con 0x7f0a640b07a0 2023-10-06T03:27:11.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.450+0000 7f0a637fe700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a50066f30 0x7f0a500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:11.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.450+0000 7f0a637fe700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a50066f30 0x7f0a500693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0a640cf4e0 tx=0x7f0a58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:11.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.454+0000 7f0a4bfff700 1 -- 172.21.15.84:0/2850361094 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a54053a90 con 0x7f0a640b07a0 2023-10-06T03:27:11.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.679+0000 7f0a6a528700 1 -- 172.21.15.84:0/2850361094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a640b1820 con 0x7f0a640b07a0 2023-10-06T03:27:11.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.680+0000 7f0a4bfff700 1 -- 172.21.15.84:0/2850361094 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f0a540570b0 con 0x7f0a640b07a0 2023-10-06T03:27:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:11.682 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1222888908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1222888908},{"type":"v1","addr":"172.21.15.131:6835","nonce":1222888908}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/169780123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":169780123},{"type":"v1","addr":"172.21.15.131:6834","nonce":169780123}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6942,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1047033601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1047033601},{"type":"v1","addr":"172.21.15.84:6835","nonce":1047033601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:09.465682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6945":{"gid":6945,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/632169803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":632169803},{"type":"v1","addr":"172.21.15.84:6837","nonce":632169803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:11.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.681+0000 7f0a6a528700 1 -- 172.21.15.84:0/2850361094 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a50066f30 msgr2=0x7f0a500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.681+0000 7f0a6a528700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a50066f30 0x7f0a500693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0a640cf4e0 tx=0x7f0a58008040 comp rx=0 tx=0).stop 2023-10-06T03:27:11.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.681+0000 7f0a6a528700 1 -- 172.21.15.84:0/2850361094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a640b07a0 msgr2=0x7f0a640af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:11.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.681+0000 7f0a6a528700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a640b07a0 0x7f0a640af2c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0a64067c60 tx=0x7f0a54016000 comp rx=0 tx=0).stop 2023-10-06T03:27:11.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.681+0000 7f0a6a528700 1 -- 172.21.15.84:0/2850361094 shutdown_connections 2023-10-06T03:27:11.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.682+0000 7f0a6a528700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a50066f30 0x7f0a500693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.682+0000 7f0a6a528700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a641595a0 0x7f0a6415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.682+0000 7f0a6a528700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a640b07a0 0x7f0a640af2c0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.682+0000 7f0a6a528700 1 --2- 172.21.15.84:0/2850361094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a640b49e0 0x7f0a64144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:11.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.682+0000 7f0a6a528700 1 -- 172.21.15.84:0/2850361094 >> 172.21.15.84:0/2850361094 conn(0x7f0a64099830 msgr2=0x7f0a64068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:11.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.682+0000 7f0a6a528700 1 -- 172.21.15.84:0/2850361094 shutdown_connections 2023-10-06T03:27:11.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:11.682+0000 7f0a6a528700 1 -- 172.21.15.84:0/2850361094 wait complete. 2023-10-06T03:27:11.685 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 54 2023-10-06T03:27:12.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:27:05.838700+0000', 'modified': '2023-10-06T03:27:09.465682+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6945}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6945': {'gid': 6945, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/632169803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 632169803}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 632169803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:27:12.098 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:27:12.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:27:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.215+0000 7f7a95ef5700 1 Processor -- start 2023-10-06T03:27:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.215+0000 7f7a95ef5700 1 -- start start 2023-10-06T03:27:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.216+0000 7f7a95ef5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a901595a0 0x7f7a900aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.216+0000 7f7a95ef5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a900b0ca0 con 0x7f7a900b07a0 2023-10-06T03:27:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.216+0000 7f7a95ef5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a900b0f80 con 0x7f7a900b49e0 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.216+0000 7f7a95ef5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a900b1260 con 0x7f7a901595a0 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.216+0000 7f7a8f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a901595a0 0x7f7a900aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.216+0000 7f7a8ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7a900b07a0 0x7f7a900b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52078/0 (socket says 172.21.15.84:52078) 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.216+0000 7f7a8ffff700 1 -- 172.21.15.84:0/312717459 learned_addr learned my addr 172.21.15.84:0/312717459 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/312717459 >> v1:172.21.15.131:6789/0 conn(0x7f7a900b49e0 legacy=0x7f7a900aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/312717459 >> v1:172.21.15.84:6789/0 conn(0x7f7a900b07a0 legacy=0x7f7a900b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/312717459 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a900b1540 con 0x7f7a901595a0 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a8e7fc700 1 -- 172.21.15.84:0/312717459 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866079757 0 0) 0x7f7a900b0ca0 con 0x7f7a900b07a0 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/312717459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a901595a0 0x7f7a900aa570 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009ee0 tx=0x7f7a80009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba3ba35259f4d19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a8e7fc700 1 -- 172.21.15.84:0/312717459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000e070 con 0x7f7a901595a0 2023-10-06T03:27:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a8e7fc700 1 -- 172.21.15.84:0/312717459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8000bc10 con 0x7f7a901595a0 2023-10-06T03:27:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a8e7fc700 1 -- 172.21.15.84:0/312717459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80012430 con 0x7f7a901595a0 2023-10-06T03:27:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a95ef5700 1 -- 172.21.15.84:0/312717459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a901595a0 msgr2=0x7f7a900aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a95ef5700 1 --2- 172.21.15.84:0/312717459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a901595a0 0x7f7a900aa570 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009ee0 tx=0x7f7a80009780 comp rx=0 tx=0).stop 2023-10-06T03:27:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a95ef5700 1 -- 172.21.15.84:0/312717459 shutdown_connections 2023-10-06T03:27:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a95ef5700 1 --2- 172.21.15.84:0/312717459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a901595a0 0x7f7a900aa570 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a95ef5700 1 -- 172.21.15.84:0/312717459 >> 172.21.15.84:0/312717459 conn(0x7f7a90099830 msgr2=0x7f7a9006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a95ef5700 1 -- 172.21.15.84:0/312717459 shutdown_connections 2023-10-06T03:27:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.217+0000 7f7a95ef5700 1 -- 172.21.15.84:0/312717459 wait complete. 2023-10-06T03:27:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.219+0000 7f7a95ef5700 1 Processor -- start 2023-10-06T03:27:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.219+0000 7f7a95ef5700 1 -- start start 2023-10-06T03:27:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.219+0000 7f7a95ef5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a900b07a0 0x7f7a9009b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.219+0000 7f7a95ef5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a900b49e0 0x7f7a900abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.219+0000 7f7a95ef5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a901595a0 0x7f7a900aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.219+0000 7f7a95ef5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9009b010 con 0x7f7a900b07a0 2023-10-06T03:27:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.219+0000 7f7a95ef5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9009a400 con 0x7f7a900b49e0 2023-10-06T03:27:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.219+0000 7f7a95ef5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9009a6e0 con 0x7f7a901595a0 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.219+0000 7f7a8f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a900b07a0 0x7f7a9009b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a900b07a0 0x7f7a9009b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37988/0 (socket says 172.21.15.84:37988) 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/1686274139 learned_addr learned my addr 172.21.15.84:0/1686274139 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8ffff700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a901595a0 0x7f7a900aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8effd700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a900b49e0 0x7f7a900abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/1686274139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a901595a0 msgr2=0x7f7a900aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a901595a0 0x7f7a900aef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/1686274139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a900b49e0 msgr2=0x7f7a900abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a900b49e0 0x7f7a900abd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/1686274139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80009a20 con 0x7f7a900b07a0 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8ffff700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a901595a0 0x7f7a900aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a900b07a0 0x7f7a9009b4a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f7a90067c60 tx=0x7f7a80018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a777fe700 1 -- 172.21.15.84:0/1686274139 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80012e20 con 0x7f7a900b07a0 2023-10-06T03:27:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a777fe700 1 -- 172.21.15.84:0/1686274139 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8001d640 con 0x7f7a900b07a0 2023-10-06T03:27:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a95ef5700 1 -- 172.21.15.84:0/1686274139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9009a9c0 con 0x7f7a900b07a0 2023-10-06T03:27:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a777fe700 1 -- 172.21.15.84:0/1686274139 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8001da00 con 0x7f7a900b07a0 2023-10-06T03:27:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.220+0000 7f7a95ef5700 1 -- 172.21.15.84:0/1686274139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9009b9e0 con 0x7f7a900b07a0 2023-10-06T03:27:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.221+0000 7f7a777fe700 1 -- 172.21.15.84:0/1686274139 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a80024070 con 0x7f7a900b07a0 2023-10-06T03:27:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.222+0000 7f7a777fe700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a7c066f30 0x7f7a7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.222+0000 7f7a777fe700 1 -- 172.21.15.84:0/1686274139 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7a800870d0 con 0x7f7a900b07a0 2023-10-06T03:27:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.222+0000 7f7a8effd700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a7c066f30 0x7f7a7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.222+0000 7f7a8effd700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a7c066f30 0x7f7a7c0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7a9009e110 tx=0x7f7a84009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:12.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.224+0000 7f7a9f1edb80 1 Processor -- start 2023-10-06T03:27:12.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.224+0000 7f7a9f1edb80 1 -- start start 2023-10-06T03:27:12.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46bcc0 0x5570dc4ba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc4bac00 0x5570dc4bb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570dc3c1a70 con 0x5570dc46a840 2023-10-06T03:27:12.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570dc3bf270 con 0x5570dc4bac00 2023-10-06T03:27:12.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570dc3bb060 con 0x5570dc46bcc0 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a8f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a8f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37990/0 (socket says 172.21.15.84:37990) 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/3847712944 learned_addr learned my addr 172.21.15.84:0/3847712944 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/3847712944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46bcc0 msgr2=0x5570dc4ba6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/3847712944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46bcc0 0x5570dc4ba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/3847712944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc4bac00 msgr2=0x5570dc4bb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/3847712944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc4bac00 0x5570dc4bb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/3847712944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570dc255270 con 0x5570dc46a840 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/3847712944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46ac10 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f7a800071f0 tx=0x7f7a80020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b0716cf90e48ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a74ff9700 1 -- 172.21.15.84:0/3847712944 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000e070 con 0x5570dc46a840 2023-10-06T03:27:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a74ff9700 1 -- 172.21.15.84:0/3847712944 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8005d0f0 con 0x5570dc46a840 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.225+0000 7f7a74ff9700 1 -- 172.21.15.84:0/3847712944 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a800584c0 con 0x5570dc46a840 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.226+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3847712944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 msgr2=0x5570dc46ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.226+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3847712944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46ac10 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f7a800071f0 tx=0x7f7a80020040 comp rx=0 tx=0).stop 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.226+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3847712944 shutdown_connections 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.226+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3847712944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc4bac00 0x5570dc4bb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.226+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3847712944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46ac10 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.226+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3847712944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46bcc0 0x5570dc4ba6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.226+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3847712944 >> 172.21.15.84:0/3847712944 conn(0x5570dc46c160 msgr2=0x5570dc46c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.226+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3847712944 shutdown_connections 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.226+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3847712944 wait complete. 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a9f1edb80 1 -- start start 2023-10-06T03:27:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a9f1edb80 1 Processor -- start 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46a840 0x5570dc4959e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46bcc0 0x5570dc4aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc4bac00 0x5570dc4ab110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570dc366890 con 0x5570dc4bac00 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570dc381ea0 con 0x5570dc46a840 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570dc23de30 con 0x5570dc46bcc0 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a9f1edb80 10 client.0 _ll_register_callbacks cb 0x5570dc42de70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a8ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc4bac00 0x5570dc4ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a8ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc4bac00 0x5570dc4ab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37996/0 (socket says 172.21.15.84:37996) 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.227+0000 7f7a8ffff700 1 -- 172.21.15.84:0/3585191662 learned_addr learned my addr 172.21.15.84:0/3585191662 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46a840 0x5570dc4959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a8effd700 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46bcc0 0x5570dc4aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a8ffff700 1 -- 172.21.15.84:0/3585191662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46bcc0 msgr2=0x5570dc4aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a8ffff700 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46bcc0 0x5570dc4aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a8ffff700 1 -- 172.21.15.84:0/3585191662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46a840 msgr2=0x5570dc4959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a8ffff700 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46a840 0x5570dc4959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a8ffff700 1 -- 172.21.15.84:0/3585191662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9009b9e0 con 0x5570dc4bac00 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46a840 0x5570dc4959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a8ffff700 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc4bac00 0x5570dc4ab110 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800e4e0 tx=0x7f7a88009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813a822e4b8cd0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a6dffb700 1 -- 172.21.15.84:0/3585191662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88001d00 con 0x5570dc4bac00 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a6dffb700 1 -- 172.21.15.84:0/3585191662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7a88005af0 con 0x5570dc4bac00 2023-10-06T03:27:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3585191662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570dc45f940 con 0x5570dc4bac00 2023-10-06T03:27:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a6dffb700 1 -- 172.21.15.84:0/3585191662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a880070d0 con 0x5570dc4bac00 2023-10-06T03:27:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a9f1edb80 10 client.7098 fetch_fsmap learned FSMap version 54 2023-10-06T03:27:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3585191662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x5570dc1f7fe0 con 0x5570dc4bac00 2023-10-06T03:27:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a6dffb700 1 -- 172.21.15.84:0/3585191662 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5570dc45f940 con 0x5570dc4bac00 2023-10-06T03:27:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a6dffb700 1 -- 172.21.15.84:0/3585191662 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 54) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7a88007230 con 0x5570dc4bac00 2023-10-06T03:27:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a9f1edb80 10 client.7098 fetch_fsmap finished waiting for FSMap version 54 2023-10-06T03:27:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a9f1edb80 10 client.7098 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:27:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a9f1edb80 20 client.7098 populate_metadata read hostname 'smithi084' 2023-10-06T03:27:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.84:6836/632169803,v1:172.21.15.84:6837/632169803] conn(0x5570dc494ac0 0x5570dc4c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a9f1edb80 4 client.7098 mds_command: new command op to 6945 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:27:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.228+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3585191662 --> [v2:172.21.15.84:6836/632169803,v1:172.21.15.84:6837/632169803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570dc43c870 con 0x5570dc494ac0 2023-10-06T03:27:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.84:6836/632169803,v1:172.21.15.84:6837/632169803] conn(0x5570dc494ac0 0x5570dc4c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.84:6836/632169803,v1:172.21.15.84:6837/632169803] conn(0x5570dc494ac0 0x5570dc4c14a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d829b343d2ed5ba server_cookie=e89785a7c53519a2 in_seq=0 out_seq=0 2023-10-06T03:27:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a6dffb700 10 client.7098 ms_handle_connect on v2:172.21.15.84:6836/632169803 2023-10-06T03:27:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a6dffb700 1 -- 172.21.15.84:0/3585191662 <== mds.0 v2:172.21.15.84:6836/632169803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5570dc43c870 con 0x5570dc494ac0 2023-10-06T03:27:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a6dffb700 10 client.7098 handle_command_reply: tid=0 2023-10-06T03:27:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a9f1edb80 1 client.7098 shutdown 2023-10-06T03:27:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3585191662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc4bac00 msgr2=0x5570dc4ab110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc4bac00 0x5570dc4ab110 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800e4e0 tx=0x7f7a88009040 comp rx=0 tx=0).stop 2023-10-06T03:27:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3585191662 shutdown_connections 2023-10-06T03:27:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.84:6836/632169803,v1:172.21.15.84:6837/632169803] conn(0x5570dc494ac0 0x5570dc4c14a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46a840 0x5570dc4959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a6dffb700 0 client.7098 ms_handle_reset on v2:172.21.15.84:6836/632169803 2023-10-06T03:27:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc4bac00 0x5570dc4ab110 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3585191662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46bcc0 0x5570dc4aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.229+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3585191662 >> 172.21.15.84:0/3585191662 conn(0x5570dc46c160 msgr2=0x5570dc46b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.230+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3585191662 shutdown_connections 2023-10-06T03:27:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.230+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3585191662 wait complete. 2023-10-06T03:27:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.230+0000 7f7a9f1edb80 20 client.7098 trim_cache size 0 max 16384 2023-10-06T03:27:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.246+0000 7f7a9f1edb80 1 Processor -- start 2023-10-06T03:27:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.246+0000 7f7a9f1edb80 1 -- start start 2023-10-06T03:27:12.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46bcc0 0x5570dc467f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc4bac00 0x5570dc490db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570dc4a8c60 con 0x5570dc46a840 2023-10-06T03:27:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570dc46cdc0 con 0x5570dc46bcc0 2023-10-06T03:27:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570dc468b30 con 0x5570dc4bac00 2023-10-06T03:27:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38002/0 (socket says 172.21.15.84:38002) 2023-10-06T03:27:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/3976310979 learned_addr learned my addr 172.21.15.84:0/3976310979 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/3976310979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc4bac00 msgr2=0x5570dc490db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8ffff700 1 --2- 172.21.15.84:0/3976310979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc4bac00 0x5570dc490db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8effd700 1 --2- 172.21.15.84:0/3976310979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46bcc0 0x5570dc467f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/3976310979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc4bac00 0x5570dc490db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/3976310979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46bcc0 msgr2=0x5570dc467f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/3976310979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46bcc0 0x5570dc467f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8f7fe700 1 -- 172.21.15.84:0/3976310979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570dc389780 con 0x5570dc46a840 2023-10-06T03:27:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8effd700 1 --2- 172.21.15.84:0/3976310979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46bcc0 0x5570dc467f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.247+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/3976310979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46cfb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f7a80057cf0 tx=0x7f7a8006c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b084e13905cf6b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a757fa700 1 -- 172.21.15.84:0/3976310979 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80009410 con 0x5570dc46a840 2023-10-06T03:27:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a757fa700 1 -- 172.21.15.84:0/3976310979 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8006e170 con 0x5570dc46a840 2023-10-06T03:27:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a757fa700 1 -- 172.21.15.84:0/3976310979 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80057d60 con 0x5570dc46a840 2023-10-06T03:27:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3976310979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 msgr2=0x5570dc46cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3976310979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46cfb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f7a80057cf0 tx=0x7f7a8006c040 comp rx=0 tx=0).stop 2023-10-06T03:27:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3976310979 shutdown_connections 2023-10-06T03:27:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3976310979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc4bac00 0x5570dc490db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3976310979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46a840 0x5570dc46cfb0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/3976310979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc46bcc0 0x5570dc467f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3976310979 >> 172.21.15.84:0/3976310979 conn(0x5570dc46c160 msgr2=0x5570dc46dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3976310979 shutdown_connections 2023-10-06T03:27:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.248+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/3976310979 wait complete. 2023-10-06T03:27:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.249+0000 7f7a9f1edb80 1 -- start start 2023-10-06T03:27:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.249+0000 7f7a9f1edb80 1 Processor -- start 2023-10-06T03:27:12.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.249+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46a840 0x5570dc4fc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46bcc0 0x5570dc48f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a9f1edb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc4bac00 0x5570dc4c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570dc4a8610 con 0x5570dc46bcc0 2023-10-06T03:27:12.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570dc517c00 con 0x5570dc4bac00 2023-10-06T03:27:12.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a9f1edb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570dc516a00 con 0x5570dc46a840 2023-10-06T03:27:12.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a9f1edb80 10 client.0 _ll_register_callbacks cb 0x5570dc42de70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:27:12.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46bcc0 0x5570dc48f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46bcc0 0x5570dc48f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38008/0 (socket says 172.21.15.84:38008) 2023-10-06T03:27:12.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8effd700 1 -- 172.21.15.84:0/239165523 learned_addr learned my addr 172.21.15.84:0/239165523 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:12.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46a840 0x5570dc4fc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8ffff700 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc4bac00 0x5570dc4c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8effd700 1 -- 172.21.15.84:0/239165523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46a840 msgr2=0x5570dc4fc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:12.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8effd700 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46a840 0x5570dc4fc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8effd700 1 -- 172.21.15.84:0/239165523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc4bac00 msgr2=0x5570dc4c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:12.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8effd700 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc4bac00 0x5570dc4c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8effd700 1 -- 172.21.15.84:0/239165523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5570dc255270 con 0x5570dc46bcc0 2023-10-06T03:27:12.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8ffff700 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc4bac00 0x5570dc4c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:12.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a8effd700 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46bcc0 0x5570dc48f230 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f7a900cc9b0 tx=0x7f7a84014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba5c973740305f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:12.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:27:12.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a6dffb700 1 -- 172.21.15.84:0/239165523 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84013cc0 con 0x5570dc46bcc0 2023-10-06T03:27:12.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a6dffb700 1 -- 172.21.15.84:0/239165523 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7a84013e20 con 0x5570dc46bcc0 2023-10-06T03:27:12.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/239165523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a8005d0f0 con 0x5570dc46bcc0 2023-10-06T03:27:12.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a6dffb700 1 -- 172.21.15.84:0/239165523 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a84021610 con 0x5570dc46bcc0 2023-10-06T03:27:12.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a9f1edb80 10 client.7104 fetch_fsmap learned FSMap version 54 2023-10-06T03:27:12.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/239165523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x5570dc370470 con 0x5570dc46bcc0 2023-10-06T03:27:12.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.250+0000 7f7a6dffb700 1 -- 172.21.15.84:0/239165523 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8005d0f0 con 0x5570dc46bcc0 2023-10-06T03:27:12.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a6dffb700 1 -- 172.21.15.84:0/239165523 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 54) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7a84021770 con 0x5570dc46bcc0 2023-10-06T03:27:12.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 10 client.7104 fetch_fsmap finished waiting for FSMap version 54 2023-10-06T03:27:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 10 client.7104 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:27:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 20 client.7104 populate_metadata read hostname 'smithi084' 2023-10-06T03:27:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.84:6836/632169803,v1:172.21.15.84:6837/632169803] conn(0x5570dc4b93f0 0x5570dc4b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 4 client.7104 mds_command: new command op to 6945 tid=0[{"prefix": "status"}] 2023-10-06T03:27:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/239165523 --> [v2:172.21.15.84:6836/632169803,v1:172.21.15.84:6837/632169803] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5570dc35de00 con 0x5570dc4b93f0 2023-10-06T03:27:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.84:6836/632169803,v1:172.21.15.84:6837/632169803] conn(0x5570dc4b93f0 0x5570dc4b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a6dffb700 10 client.7104 ms_handle_connect on v2:172.21.15.84:6836/632169803 2023-10-06T03:27:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a8f7fe700 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.84:6836/632169803,v1:172.21.15.84:6837/632169803] conn(0x5570dc4b93f0 0x5570dc4b97c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b78b66bd63eaf1c server_cookie=b388634fb04128d3 in_seq=0 out_seq=0 2023-10-06T03:27:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a6dffb700 1 -- 172.21.15.84:0/239165523 <== mds.0 v2:172.21.15.84:6836/632169803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5570dc35de00 con 0x5570dc4b93f0 2023-10-06T03:27:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a6dffb700 10 client.7104 handle_command_reply: tid=0 2023-10-06T03:27:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 client.7104 shutdown 2023-10-06T03:27:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/239165523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46bcc0 msgr2=0x5570dc48f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46bcc0 0x5570dc48f230 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f7a900cc9b0 tx=0x7f7a84014000 comp rx=0 tx=0).stop 2023-10-06T03:27:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/239165523 shutdown_connections 2023-10-06T03:27:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.84:6836/632169803,v1:172.21.15.84:6837/632169803] conn(0x5570dc4b93f0 0x5570dc4b97c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5570dc4bac00 0x5570dc4c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a6dffb700 0 client.7104 ms_handle_reset on v2:172.21.15.84:6836/632169803 2023-10-06T03:27:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5570dc46a840 0x5570dc4fc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 --2- 172.21.15.84:0/239165523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570dc46bcc0 0x5570dc48f230 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/239165523 >> 172.21.15.84:0/239165523 conn(0x5570dc46c160 msgr2=0x5570dc467a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/239165523 shutdown_connections 2023-10-06T03:27:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 1 -- 172.21.15.84:0/239165523 wait complete. 2023-10-06T03:27:12.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.251+0000 7f7a9f1edb80 20 client.7104 trim_cache size 0 max 16384 2023-10-06T03:27:12.267 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:27:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:27:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6945, 2023-10-06T03:27:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:27:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:27:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:27:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 5.8002323499999999, 2023-10-06T03:27:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 54, 2023-10-06T03:27:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 98, 2023-10-06T03:27:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 98, 2023-10-06T03:27:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 11.906490601 2023-10-06T03:27:12.268 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 -- 172.21.15.84:0/1686274139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a7c066f30 msgr2=0x7f7a7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a7c066f30 0x7f7a7c0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7a9009e110 tx=0x7f7a84009120 comp rx=0 tx=0).stop 2023-10-06T03:27:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 -- 172.21.15.84:0/1686274139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a900b07a0 msgr2=0x7f7a9009b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a900b07a0 0x7f7a9009b4a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f7a90067c60 tx=0x7f7a80018000 comp rx=0 tx=0).stop 2023-10-06T03:27:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 -- 172.21.15.84:0/1686274139 shutdown_connections 2023-10-06T03:27:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f7a7c066f30 0x7f7a7c0693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a901595a0 0x7f7a900aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a900b07a0 0x7f7a9009b4a0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 --2- 172.21.15.84:0/1686274139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a900b49e0 0x7f7a900abd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 -- 172.21.15.84:0/1686274139 >> 172.21.15.84:0/1686274139 conn(0x7f7a90099830 msgr2=0x7f7a901589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 -- 172.21.15.84:0/1686274139 shutdown_connections 2023-10-06T03:27:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.252+0000 7f7a95ef5700 1 -- 172.21.15.84:0/1686274139 wait complete. 2023-10-06T03:27:12.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:27:12.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.386+0000 7ff23a885700 1 Processor -- start 2023-10-06T03:27:12.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.386+0000 7ff23a885700 1 -- start start 2023-10-06T03:27:12.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.387+0000 7ff23a885700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2340b29f0 0x7ff234159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.387+0000 7ff23a885700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2341596a0 0x7ff2340cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.387+0000 7ff23a885700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2340b0de0 con 0x7ff2340b2620 2023-10-06T03:27:12.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.387+0000 7ff23a885700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2340cbfe0 con 0x7ff2341596a0 2023-10-06T03:27:12.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.387+0000 7ff23a885700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340cb3d0 con 0x7ff2340b29f0 2023-10-06T03:27:12.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.387+0000 7ff238e22700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2341596a0 0x7ff2340cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.387+0000 7ff233fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff2340b2620 0x7ff2340b06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52088/0 (socket says 172.21.15.84:52088) 2023-10-06T03:27:12.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.387+0000 7ff233fff700 1 -- 172.21.15.84:0/1113014377 learned_addr learned my addr 172.21.15.84:0/1113014377 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:12.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff2337fe700 1 --2- 172.21.15.84:0/1113014377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2340b29f0 0x7ff234159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff238e22700 1 -- 172.21.15.84:0/1113014377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2340b29f0 msgr2=0x7ff234159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:12.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff238e22700 1 --2- 172.21.15.84:0/1113014377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2340b29f0 0x7ff234159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff238e22700 1 -- 172.21.15.84:0/1113014377 >> v1:172.21.15.84:6789/0 conn(0x7ff2340b2620 legacy=0x7ff2340b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff238e22700 1 -- 172.21.15.84:0/1113014377 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2340cb6b0 con 0x7ff2341596a0 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff232ffd700 1 -- 172.21.15.84:0/1113014377 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338418548 0 0) 0x7ff224001290 con 0x7ff2340b2620 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff2337fe700 1 --2- 172.21.15.84:0/1113014377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2340b29f0 0x7ff234159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff238e22700 1 --2- 172.21.15.84:0/1113014377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2341596a0 0x7ff2340cc470 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009e60 tx=0x7ff22c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f63e85672c630d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff232ffd700 1 -- 172.21.15.84:0/1113014377 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00e070 con 0x7ff2341596a0 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff232ffd700 1 -- 172.21.15.84:0/1113014377 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c00bc30 con 0x7ff2341596a0 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff232ffd700 1 -- 172.21.15.84:0/1113014377 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c012430 con 0x7ff2341596a0 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff23a885700 1 -- 172.21.15.84:0/1113014377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2341596a0 msgr2=0x7ff2340cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff23a885700 1 --2- 172.21.15.84:0/1113014377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2341596a0 0x7ff2340cc470 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009e60 tx=0x7ff22c009780 comp rx=0 tx=0).stop 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff23a885700 1 -- 172.21.15.84:0/1113014377 shutdown_connections 2023-10-06T03:27:12.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff23a885700 1 --2- 172.21.15.84:0/1113014377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2341596a0 0x7ff2340cc470 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff23a885700 1 --2- 172.21.15.84:0/1113014377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2340b29f0 0x7ff234159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.388+0000 7ff23a885700 1 -- 172.21.15.84:0/1113014377 >> 172.21.15.84:0/1113014377 conn(0x7ff23406ed20 msgr2=0x7ff23406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:12.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.389+0000 7ff23a885700 1 -- 172.21.15.84:0/1113014377 shutdown_connections 2023-10-06T03:27:12.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.389+0000 7ff23a885700 1 -- 172.21.15.84:0/1113014377 wait complete. 2023-10-06T03:27:12.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.390+0000 7ff23a885700 1 Processor -- start 2023-10-06T03:27:12.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.390+0000 7ff23a885700 1 -- start start 2023-10-06T03:27:12.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.390+0000 7ff23a885700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2340b2620 0x7ff234154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.390+0000 7ff23a885700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2340b29f0 0x7ff2340cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.390+0000 7ff23a885700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2341596a0 0x7ff2340cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.390+0000 7ff23a885700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c82c0 con 0x7ff2340b2620 2023-10-06T03:27:12.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.390+0000 7ff23a885700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c76b0 con 0x7ff2341596a0 2023-10-06T03:27:12.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.390+0000 7ff23a885700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c7990 con 0x7ff2340b29f0 2023-10-06T03:27:12.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff233fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2340b2620 0x7ff234154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff233fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2340b2620 0x7ff234154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38020/0 (socket says 172.21.15.84:38020) 2023-10-06T03:27:12.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff233fff700 1 -- 172.21.15.84:0/2545162960 learned_addr learned my addr 172.21.15.84:0/2545162960 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:12.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff233fff700 1 -- 172.21.15.84:0/2545162960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2340b29f0 msgr2=0x7ff2340cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff233fff700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2340b29f0 0x7ff2340cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff233fff700 1 -- 172.21.15.84:0/2545162960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2341596a0 msgr2=0x7ff2340cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff233fff700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2341596a0 0x7ff2340cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff233fff700 1 -- 172.21.15.84:0/2545162960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c009a20 con 0x7ff2340b2620 2023-10-06T03:27:12.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff233fff700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2340b2620 0x7ff234154950 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c810 tx=0x7ff224007ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:12.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff21bfff700 1 -- 172.21.15.84:0/2545162960 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224007300 con 0x7ff2340b2620 2023-10-06T03:27:12.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff21bfff700 1 -- 172.21.15.84:0/2545162960 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224007460 con 0x7ff2340b2620 2023-10-06T03:27:12.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff23a885700 1 -- 172.21.15.84:0/2545162960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2340c7c70 con 0x7ff2340b2620 2023-10-06T03:27:12.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff21bfff700 1 -- 172.21.15.84:0/2545162960 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2240057f0 con 0x7ff2340b2620 2023-10-06T03:27:12.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.391+0000 7ff23a885700 1 -- 172.21.15.84:0/2545162960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff234154e90 con 0x7ff2340b2620 2023-10-06T03:27:12.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.392+0000 7ff23a885700 1 -- 172.21.15.84:0/2545162960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff234064ad0 con 0x7ff2340b2620 2023-10-06T03:27:12.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.392+0000 7ff21bfff700 1 -- 172.21.15.84:0/2545162960 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff224005c20 con 0x7ff2340b2620 2023-10-06T03:27:12.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.393+0000 7ff21bfff700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff220066f30 0x7ff2200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:12.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.393+0000 7ff21bfff700 1 -- 172.21.15.84:0/2545162960 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff224084130 con 0x7ff2340b2620 2023-10-06T03:27:12.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.393+0000 7ff2337fe700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff220066f30 0x7ff2200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:12.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.393+0000 7ff2337fe700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff220066f30 0x7ff2200693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff234068530 tx=0x7ff228008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:12.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.397+0000 7ff21bfff700 1 -- 172.21.15.84:0/2545162960 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff224051180 con 0x7ff2340b2620 2023-10-06T03:27:12.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.624+0000 7ff23a885700 1 -- 172.21.15.84:0/2545162960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff23415a620 con 0x7ff2340b2620 2023-10-06T03:27:12.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.624+0000 7ff21bfff700 1 -- 172.21.15.84:0/2545162960 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff2240547a0 con 0x7ff2340b2620 2023-10-06T03:27:12.626 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:27:12.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 -- 172.21.15.84:0/2545162960 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff220066f30 msgr2=0x7ff2200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff220066f30 0x7ff2200693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff234068530 tx=0x7ff228008040 comp rx=0 tx=0).stop 2023-10-06T03:27:12.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 -- 172.21.15.84:0/2545162960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2340b2620 msgr2=0x7ff234154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:12.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2340b2620 0x7ff234154950 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c810 tx=0x7ff224007ac0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 -- 172.21.15.84:0/2545162960 shutdown_connections 2023-10-06T03:27:12.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7ff220066f30 0x7ff2200693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2341596a0 0x7ff2340cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2340b2620 0x7ff234154950 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 --2- 172.21.15.84:0/2545162960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2340b29f0 0x7ff2340cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:12.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 -- 172.21.15.84:0/2545162960 >> 172.21.15.84:0/2545162960 conn(0x7ff23406ed20 msgr2=0x7ff23406f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:12.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 -- 172.21.15.84:0/2545162960 shutdown_connections 2023-10-06T03:27:12.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:12.627+0000 7ff23a885700 1 -- 172.21.15.84:0/2545162960 wait complete. 2023-10-06T03:27:12.640 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:27:12.640 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:27:12.640 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:27:12.640 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:27:12.641 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:27:12.641 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:27:12.641 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:27:12.641 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:27:12.641 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:27:12.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:12.641 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:27:12.657 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:27:12.657 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:27:12.657 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:27:12.657 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:12.658 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:27:12.658 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:12.658 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:12.658 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:12.658 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:27:12.658 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:12.658 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:12.659 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:27:12.659 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:12.659 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:12.659 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:27:12.659 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:12.659 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:27:12.659 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42322sec preferred_lft 42322sec 2023-10-06T03:27:12.659 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:27:12.659 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:12.659 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:27:12.660 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:12.660 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:27:12.660 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:12.660 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9c01:bbff:fec1:72ce/64 scope link 2023-10-06T03:27:12.660 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:12.660 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:27:12.660 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:27:12.660 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::74a6:25ff:fe2a:c673/64 scope link 2023-10-06T03:27:12.661 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:12.661 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:27:12.661 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether de:34:c5:3f:21:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:27:12.661 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc34:c5ff:fe3f:21c3/64 scope link 2023-10-06T03:27:12.661 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:12.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:12.662 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:27:12.720 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:27:12.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:12.722 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:27:12.778 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:27:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:27:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:27:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:27:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:27:12.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:12.779 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:27:12.779 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:27:12.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:27:12.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:27:12.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:27:12.780 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:27:12.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:12.879 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:27:12.893 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:27:12.894 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:27:12.894 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:27:12.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:12.894 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:27:12.958 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:27:12.958 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:27:13.013 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:27:13.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:27:13.014 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:27:13.067 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:27:13.070 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:27:13.070 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:13.146 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:13.147 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:13.165 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:13.165 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:13.165 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:27:13.165 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:27:13.166 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:27:13.166 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:27:13.166 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:27:13.166 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:27:13.188 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:13.188 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:13.188 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:27:13.188 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:27:13.188 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:27:13.188 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:27:13.188 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:27:13.189 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:27:13.189 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:27:13.189 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:27:13.189 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:27:13.190 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:27:13.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:13.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:27:13.256 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:27:13.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.409+0000 7fc40359e700 1 Processor -- start 2023-10-06T03:27:13.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.409+0000 7fc40359e700 1 -- start start 2023-10-06T03:27:13.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.410+0000 7fc40359e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc404159480 0x7fc4040b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:13.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.410+0000 7fc40359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4040cb7e0 con 0x7fc4040b3610 2023-10-06T03:27:13.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.410+0000 7fc40359e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4040b08a0 con 0x7fc4040b2140 2023-10-06T03:27:13.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.410+0000 7fc40359e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4040cb190 con 0x7fc404159480 2023-10-06T03:27:13.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.410+0000 7fc401d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc4040b3610 0x7fc4040cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52090/0 (socket says 172.21.15.84:52090) 2023-10-06T03:27:13.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.410+0000 7fc401d9b700 1 -- 172.21.15.84:0/173504768 learned_addr learned my addr 172.21.15.84:0/173504768 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:13.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.410+0000 7fc40259c700 1 --2- 172.21.15.84:0/173504768 >> v2:172.21.15.131:3300/0 conn(0x7fc404159480 0x7fc4040b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:13.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.410+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822113369 0 0) 0x7fc4040cb7e0 con 0x7fc4040b3610 2023-10-06T03:27:13.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.410+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec003570 con 0x7fc4040b3610 2023-10-06T03:27:13.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1805241740 0 0) 0x7fc3ec003570 con 0x7fc4040b3610 2023-10-06T03:27:13.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 >> v2:172.21.15.131:3300/0 conn(0x7fc404159480 msgr2=0x7fc4040b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:13.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 --2- 172.21.15.84:0/173504768 >> v2:172.21.15.131:3300/0 conn(0x7fc404159480 0x7fc4040b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 >> v1:172.21.15.131:6789/0 conn(0x7fc4040b2140 legacy=0x7fc4040b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:13.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4040cb470 con 0x7fc4040b3610 2023-10-06T03:27:13.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fc3f8001470 con 0x7fc4040b3610 2023-10-06T03:27:13.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 >> v1:172.21.15.84:6789/0 conn(0x7fc4040b3610 legacy=0x7fc4040cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:13.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3ec003a60 0x7fc3ec003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:13.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3ec004810 0x7fc3ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:13.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3ec0051c0 0x7fc3ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:13.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040cb190 con 0x7fc3ec003a60 2023-10-06T03:27:13.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00c0e0 con 0x7fc3ec004810 2023-10-06T03:27:13.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00c2a0 con 0x7fc3ec0051c0 2023-10-06T03:27:13.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40259c700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3ec003a60 0x7fc3ec003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:13.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc401d9b700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3ec004810 0x7fc3ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:13.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc402d9d700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3ec0051c0 0x7fc3ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:13.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40259c700 1 -- 172.21.15.84:0/173504768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3ec0051c0 msgr2=0x7fc3ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:13.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40259c700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3ec0051c0 0x7fc3ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40259c700 1 -- 172.21.15.84:0/173504768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3ec004810 msgr2=0x7fc3ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:13.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40259c700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3ec004810 0x7fc3ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40259c700 1 -- 172.21.15.84:0/173504768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec003570 con 0x7fc3ec003a60 2023-10-06T03:27:13.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc402d9d700 1 -- 172.21.15.84:0/173504768 reap_dead start 2023-10-06T03:27:13.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc401d9b700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3ec004810 0x7fc3ec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:13.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40259c700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3ec003a60 0x7fc3ec003e30 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009c00 tx=0x7fc3f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293bf8cb1ba67946 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:13.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400e710 con 0x7fc3ec003a60 2023-10-06T03:27:13.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f400e870 con 0x7fc3ec003a60 2023-10-06T03:27:13.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.411+0000 7fc40159a700 1 -- 172.21.15.84:0/173504768 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400ec30 con 0x7fc3ec003a60 2023-10-06T03:27:13.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.412+0000 7fc40359e700 1 -- 172.21.15.84:0/173504768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3ec003a60 msgr2=0x7fc3ec003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:13.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.412+0000 7fc40359e700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3ec003a60 0x7fc3ec003e30 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009c00 tx=0x7fc3f40091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.412+0000 7fc40359e700 1 -- 172.21.15.84:0/173504768 shutdown_connections 2023-10-06T03:27:13.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.412+0000 7fc40359e700 1 --2- 172.21.15.84:0/173504768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3ec003a60 0x7fc3ec003e30 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.412+0000 7fc40359e700 1 -- 172.21.15.84:0/173504768 >> 172.21.15.84:0/173504768 conn(0x7fc40406ed20 msgr2=0x7fc40406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:13.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.412+0000 7fc40359e700 1 -- 172.21.15.84:0/173504768 shutdown_connections 2023-10-06T03:27:13.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.412+0000 7fc40359e700 1 -- 172.21.15.84:0/173504768 wait complete. 2023-10-06T03:27:13.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.413+0000 7fc40359e700 1 Processor -- start 2023-10-06T03:27:13.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.413+0000 7fc40359e700 1 -- start start 2023-10-06T03:27:13.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc40359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3ec003a60 0x7fc40415b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:13.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc40359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc404154960 0x7fc4040cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:13.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc40359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040d02d0 0x7fc404159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:13.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc40359e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040d0740 con 0x7fc4040d02d0 2023-10-06T03:27:13.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc40359e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40415b410 con 0x7fc3ec003a60 2023-10-06T03:27:13.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc40359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40415a800 con 0x7fc404154960 2023-10-06T03:27:13.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc402d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040d02d0 0x7fc404159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:13.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc402d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040d02d0 0x7fc404159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38048/0 (socket says 172.21.15.84:38048) 2023-10-06T03:27:13.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc402d9d700 1 -- 172.21.15.84:0/701296428 learned_addr learned my addr 172.21.15.84:0/701296428 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:13.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc401d9b700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc404154960 0x7fc4040cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:13.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc40259c700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3ec003a60 0x7fc40415b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:13.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc402d9d700 1 -- 172.21.15.84:0/701296428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc404154960 msgr2=0x7fc4040cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:13.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc402d9d700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc404154960 0x7fc4040cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc402d9d700 1 -- 172.21.15.84:0/701296428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3ec003a60 msgr2=0x7fc40415b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:13.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc402d9d700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3ec003a60 0x7fc40415b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc402d9d700 1 -- 172.21.15.84:0/701296428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40415aae0 con 0x7fc4040d02d0 2023-10-06T03:27:13.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.414+0000 7fc402d9d700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040d02d0 0x7fc404159ad0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc4040b63e0 tx=0x7fc3fc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:13.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.415+0000 7fc3f27fc700 1 -- 172.21.15.84:0/701296428 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0032e0 con 0x7fc4040d02d0 2023-10-06T03:27:13.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.415+0000 7fc3f27fc700 1 -- 172.21.15.84:0/701296428 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc003440 con 0x7fc4040d02d0 2023-10-06T03:27:13.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.415+0000 7fc40359e700 1 -- 172.21.15.84:0/701296428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40415adc0 con 0x7fc4040d02d0 2023-10-06T03:27:13.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.415+0000 7fc3f27fc700 1 -- 172.21.15.84:0/701296428 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc006df0 con 0x7fc4040d02d0 2023-10-06T03:27:13.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.415+0000 7fc40359e700 1 -- 172.21.15.84:0/701296428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc404154dd0 con 0x7fc4040d02d0 2023-10-06T03:27:13.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.415+0000 7fc40359e700 1 -- 172.21.15.84:0/701296428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40405f270 con 0x7fc4040d02d0 2023-10-06T03:27:13.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.416+0000 7fc3f27fc700 1 -- 172.21.15.84:0/701296428 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3fc001860 con 0x7fc4040d02d0 2023-10-06T03:27:13.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.416+0000 7fc3f27fc700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc3e4066f30 0x7fc3e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:13.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.416+0000 7fc3f27fc700 1 -- 172.21.15.84:0/701296428 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc3fc083ce0 con 0x7fc4040d02d0 2023-10-06T03:27:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.416+0000 7fc40259c700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc3e4066f30 0x7fc3e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.417+0000 7fc40259c700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc3e4066f30 0x7fc3e40693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40091e0 tx=0x7fc3f401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:13.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.420+0000 7fc3f27fc700 1 -- 172.21.15.84:0/701296428 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3fc050d70 con 0x7fc4040d02d0 2023-10-06T03:27:13.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.650+0000 7fc40359e700 1 -- 172.21.15.84:0/701296428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc40415b550 con 0x7fc4040d02d0 2023-10-06T03:27:13.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.650+0000 7fc3f27fc700 1 -- 172.21.15.84:0/701296428 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc3fc019070 con 0x7fc4040d02d0 2023-10-06T03:27:13.652 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:27:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 -- 172.21.15.84:0/701296428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc3e4066f30 msgr2=0x7fc3e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc3e4066f30 0x7fc3e40693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40091e0 tx=0x7fc3f401a000 comp rx=0 tx=0).stop 2023-10-06T03:27:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 -- 172.21.15.84:0/701296428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040d02d0 msgr2=0x7fc404159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040d02d0 0x7fc404159ad0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc4040b63e0 tx=0x7fc3fc009040 comp rx=0 tx=0).stop 2023-10-06T03:27:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 -- 172.21.15.84:0/701296428 shutdown_connections 2023-10-06T03:27:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc3e4066f30 0x7fc3e40693e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3ec003a60 0x7fc40415b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040d02d0 0x7fc404159ad0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 --2- 172.21.15.84:0/701296428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc404154960 0x7fc4040cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 -- 172.21.15.84:0/701296428 >> 172.21.15.84:0/701296428 conn(0x7fc40406ed20 msgr2=0x7fc4040680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:13.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 -- 172.21.15.84:0/701296428 shutdown_connections 2023-10-06T03:27:13.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:13.652+0000 7fc40359e700 1 -- 172.21.15.84:0/701296428 wait complete. 2023-10-06T03:27:13.665 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:27:13.665 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:27:13.665 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T03:27:13.666 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:27:13.666 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:27:13.666 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:27:13.666 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:27:13.666 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:27:13.666 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:27:13.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:13.667 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T03:27:13.685 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:27:13.685 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:27:13.685 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:27:13.685 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:13.685 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:27:13.685 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:13.685 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:13.686 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:13.686 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T03:27:13.686 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:13.686 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:13.686 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T03:27:13.686 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:13.686 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:13.686 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:27:13.686 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:13.686 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:27:13.687 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42319sec preferred_lft 42319sec 2023-10-06T03:27:13.687 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T03:27:13.687 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:13.687 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:27:13.687 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:13.687 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:27:13.687 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:13.688 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::a0d2:65ff:fe0e:962d/64 scope link 2023-10-06T03:27:13.688 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:13.688 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:27:13.688 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether e6:c9:c5:59:18:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:27:13.688 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::e4c9:c5ff:fe59:18bb/64 scope link 2023-10-06T03:27:13.688 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:13.688 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:27:13.688 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:27:13.688 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4f1:c0ff:fe85:853d/64 scope link 2023-10-06T03:27:13.688 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:13.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:13.689 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:27:13.753 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T03:27:13.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:13.755 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T03:27:13.815 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T03:27:13.816 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:27:13.816 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:27:13.816 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:27:13.816 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:27:13.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:13.817 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:27:13.817 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:27:13.818 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:27:13.818 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:27:13.818 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:27:13.818 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:27:13.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:13.923 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:27:13.938 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:27:13.939 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:27:13.939 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:27:13.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:13.939 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-10-06T03:27:14.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:27:14.005 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:27:14.060 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:27:14.060 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:27:14.060 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:27:14.115 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T03:27:14.115 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:27:14.115 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:14.195 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:14.196 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:14.214 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:14.215 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:14.215 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:27:14.215 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:27:14.215 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:27:14.215 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:27:14.215 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:27:14.215 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:27:14.236 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:14.236 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:14.236 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:27:14.237 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:27:14.237 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:27:14.237 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:27:14.237 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:27:14.237 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:27:14.237 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:27:14.237 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:27:14.237 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:27:14.239 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:27:14.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:14.239 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:27:14.304 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:27:14.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:27:14.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:27:14.348 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:27:14.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:14.349 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:27:14.403 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:27:14.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:27:14.404 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:27:14.438 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:27:14.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:14.439 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:27:14.495 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:27:14.497 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:27:14.537 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2023-10-06T03:27:14.537 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2023-10-06T03:27:14.537 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:27:14.537 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2023-10-06T03:27:14.537 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.537 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2023-10-06T03:27:14.538 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:27:14.539 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2023-10-06T03:27:14.540 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on skipped message = False 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 3eb6b236-a9b2-4c6a-bc84-749d824186bc 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2023-10-06T03:27:14.541 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2023-10-06T03:27:14.542 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2023-10-06T03:27:14.543 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2023-10-06T03:27:14.544 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2023-10-06T03:27:14.545 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:27:14.546 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:14.547 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = "" 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2023-10-06T03:27:14.548 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2023-10-06T03:27:14.549 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-10-06T03:27:14.550 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-10-06T03:27:14.550 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-10-06T03:27:14.550 INFO:teuthology.orchestra.run.smithi084.stdout: mds_sessionmap_keys_per_op = 1 2023-10-06T03:27:14.577 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2023-10-06T03:27:14.577 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2023-10-06T03:27:14.578 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:27:14.578 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2023-10-06T03:27:14.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.578 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2023-10-06T03:27:14.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.578 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2023-10-06T03:27:14.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.578 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2023-10-06T03:27:14.578 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2023-10-06T03:27:14.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2023-10-06T03:27:14.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.580 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.84,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on skipped message = False 2023-10-06T03:27:14.581 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 3eb6b236-a9b2-4c6a-bc84-749d824186bc 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2023-10-06T03:27:14.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.583 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 20 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 20 2023-10-06T03:27:14.584 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:27:14.585 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2023-10-06T03:27:14.585 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 10 2023-10-06T03:27:14.585 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:27:14.585 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2023-10-06T03:27:14.585 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:27:14.585 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:27:14.585 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2023-10-06T03:27:14.585 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-10-06T03:27:14.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.585 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-10-06T03:27:14.586 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:27:14.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:14.588 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = "" 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-10-06T03:27:14.589 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2023-10-06T03:27:14.590 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2023-10-06T03:27:14.591 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2023-10-06T03:27:14.591 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2023-10-06T03:27:14.591 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-10-06T03:27:14.591 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-10-06T03:27:14.591 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-10-06T03:27:14.591 INFO:teuthology.orchestra.run.smithi131.stdout: mds_sessionmap_keys_per_op = 1 2023-10-06T03:27:14.595 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:27:14.595 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:27:14.596 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:27:14.596 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:27:14.596 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:27:14.597 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:27:14.597 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:27:14.597 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:27:14.604 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:27:14.605 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2023-10-06T03:27:14.606 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:27:14.606 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2023-10-06T03:27:14.647 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:27:14.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2023-10-06T03:27:14.648 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:27:14.648 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2023-10-06T03:27:14.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.765+0000 7f1710967700 1 Processor -- start 2023-10-06T03:27:14.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.765+0000 7f1710967700 1 -- start start 2023-10-06T03:27:14.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.765+0000 7f25452cd700 1 Processor -- start 2023-10-06T03:27:14.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.765+0000 7f25452cd700 1 -- start start 2023-10-06T03:27:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.765+0000 7f1710967700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c0c15c0 0x7f170c159690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f1710967700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c06a020 con 0x7f170c06aa70 2023-10-06T03:27:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f1710967700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c06af10 con 0x7f170c1592c0 2023-10-06T03:27:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f1710967700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0c1ba0 con 0x7f170c0c15c0 2023-10-06T03:27:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f170b59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f170c06aa70 0x7f170c067f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52106/0 (socket says 172.21.15.84:52106) 2023-10-06T03:27:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f170b59e700 1 -- 172.21.15.84:0/369900825 learned_addr learned my addr 172.21.15.84:0/369900825 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f170a59c700 1 --2- 172.21.15.84:0/369900825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c0c15c0 0x7f170c159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f1709d9b700 1 -- 172.21.15.84:0/369900825 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578735297 0 0) 0x7f170c06a020 con 0x7f170c06aa70 2023-10-06T03:27:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f1709d9b700 1 -- 172.21.15.84:0/369900825 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16f4003570 con 0x7f170c06aa70 2023-10-06T03:27:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f1709d9b700 1 -- 172.21.15.84:0/369900825 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835729068 0 0) 0x7f170c06af10 con 0x7f170c1592c0 2023-10-06T03:27:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f1709d9b700 1 -- 172.21.15.84:0/369900825 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f170c06a020 con 0x7f170c1592c0 2023-10-06T03:27:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f170a59c700 1 -- 172.21.15.84:0/369900825 >> v1:172.21.15.131:6789/0 conn(0x7f170c1592c0 legacy=0x7f170c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f170a59c700 1 -- 172.21.15.84:0/369900825 >> v1:172.21.15.84:6789/0 conn(0x7f170c06aa70 legacy=0x7f170c067f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f170a59c700 1 -- 172.21.15.84:0/369900825 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c0c1e80 con 0x7f170c0c15c0 2023-10-06T03:27:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.766+0000 7f170a59c700 1 --2- 172.21.15.84:0/369900825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c0c15c0 0x7f170c159690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1700009900 tx=0x7f1700009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e6f8e8a42322f89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f25452cd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f25400c7510 0x7f254006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f25452cd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f254006c450 0x7f254006c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f1709d9b700 1 -- 172.21.15.84:0/369900825 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700005c10 con 0x7f170c0c15c0 2023-10-06T03:27:14.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f25452cd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254006a740 con 0x7f2540159550 2023-10-06T03:27:14.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f25452cd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254015ac00 con 0x7f254006c450 2023-10-06T03:27:14.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f25452cd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254015a920 con 0x7f25400c7510 2023-10-06T03:27:14.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f1709d9b700 1 -- 172.21.15.84:0/369900825 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700005d70 con 0x7f170c0c15c0 2023-10-06T03:27:14.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f1709d9b700 1 -- 172.21.15.84:0/369900825 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700006260 con 0x7f170c0c15c0 2023-10-06T03:27:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253e7fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f25400c7510 0x7f254006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f254006c450 0x7f254006c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2540159550 0x7f25400c6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52110/0 (socket says 172.21.15.84:52110) 2023-10-06T03:27:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253effd700 1 -- 172.21.15.84:0/2299786154 learned_addr learned my addr 172.21.15.84:0/2299786154 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253e7fc700 1 -- 172.21.15.84:0/2299786154 >> v2:172.21.15.84:3300/0 conn(0x7f254006c450 msgr2=0x7f254006c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253e7fc700 1 --2- 172.21.15.84:0/2299786154 >> v2:172.21.15.84:3300/0 conn(0x7f254006c450 0x7f254006c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253e7fc700 1 -- 172.21.15.84:0/2299786154 >> v1:172.21.15.84:6789/0 conn(0x7f2540159550 legacy=0x7f25400c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253e7fc700 1 -- 172.21.15.84:0/2299786154 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254006a0f0 con 0x7f25400c7510 2023-10-06T03:27:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253f7fe700 1 --2- 172.21.15.84:0/2299786154 >> v2:172.21.15.84:3300/0 conn(0x7f254006c450 0x7f254006c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253e7fc700 1 --2- 172.21.15.84:0/2299786154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25400c7510 0x7f254006abd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f254006e490 tx=0x7f25340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=893f2c25ffdc8d4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253dffb700 1 -- 172.21.15.84:0/2299786154 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534011630 con 0x7f25400c7510 2023-10-06T03:27:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253dffb700 1 -- 172.21.15.84:0/2299786154 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2534011790 con 0x7f25400c7510 2023-10-06T03:27:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.767+0000 7f253dffb700 1 -- 172.21.15.84:0/2299786154 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534011b30 con 0x7f25400c7510 2023-10-06T03:27:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f1710967700 1 -- 172.21.15.84:0/369900825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c0c15c0 msgr2=0x7f170c159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f1710967700 1 --2- 172.21.15.84:0/369900825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c0c15c0 0x7f170c159690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1700009900 tx=0x7f1700009120 comp rx=0 tx=0).stop 2023-10-06T03:27:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f1710967700 1 -- 172.21.15.84:0/369900825 shutdown_connections 2023-10-06T03:27:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f1710967700 1 --2- 172.21.15.84:0/369900825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c0c15c0 0x7f170c159690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f1710967700 1 -- 172.21.15.84:0/369900825 >> 172.21.15.84:0/369900825 conn(0x7f170c0c9d60 msgr2=0x7f170c0677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:14.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f1710967700 1 -- 172.21.15.84:0/369900825 shutdown_connections 2023-10-06T03:27:14.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f1710967700 1 -- 172.21.15.84:0/369900825 wait complete. 2023-10-06T03:27:14.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f25452cd700 1 -- 172.21.15.84:0/2299786154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25400c7510 msgr2=0x7f254006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f25452cd700 1 --2- 172.21.15.84:0/2299786154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25400c7510 0x7f254006abd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f254006e490 tx=0x7f25340091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f25452cd700 1 -- 172.21.15.84:0/2299786154 shutdown_connections 2023-10-06T03:27:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f25452cd700 1 --2- 172.21.15.84:0/2299786154 >> v2:172.21.15.84:3300/0 conn(0x7f254006c450 0x7f254006c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f25452cd700 1 --2- 172.21.15.84:0/2299786154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25400c7510 0x7f254006abd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f25452cd700 1 -- 172.21.15.84:0/2299786154 >> 172.21.15.84:0/2299786154 conn(0x7f25400cc860 msgr2=0x7f25400ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.768+0000 7f25452cd700 1 -- 172.21.15.84:0/2299786154 shutdown_connections 2023-10-06T03:27:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.769+0000 7f25452cd700 1 -- 172.21.15.84:0/2299786154 wait complete. 2023-10-06T03:27:14.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.769+0000 7f1710967700 1 Processor -- start 2023-10-06T03:27:14.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.769+0000 7f1710967700 1 -- start start 2023-10-06T03:27:14.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.770+0000 7f25452cd700 1 Processor -- start 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.770+0000 7f1710967700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c06aa70 0x7f170c0c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.770+0000 7f1710967700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c0c15c0 0x7f170c15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.770+0000 7f1710967700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f170c1592c0 0x7f170c169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.770+0000 7f1710967700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c169890 con 0x7f170c0c15c0 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.770+0000 7f1710967700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0c6920 con 0x7f170c1592c0 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.770+0000 7f1710967700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0c6080 con 0x7f170c06aa70 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c0c15c0 0x7f170c15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c0c15c0 0x7f170c15d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38068/0 (socket says 172.21.15.84:38068) 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170a59c700 1 -- 172.21.15.84:0/1118198333 learned_addr learned my addr 172.21.15.84:0/1118198333 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170ad9d700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c06aa70 0x7f170c0c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170b59e700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f170c1592c0 0x7f170c169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170a59c700 1 -- 172.21.15.84:0/1118198333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c06aa70 msgr2=0x7f170c0c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170a59c700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c06aa70 0x7f170c0c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170a59c700 1 -- 172.21.15.84:0/1118198333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f170c1592c0 msgr2=0x7f170c169fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170a59c700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f170c1592c0 0x7f170c169fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170a59c700 1 -- 172.21.15.84:0/1118198333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17000093c0 con 0x7f170c0c15c0 2023-10-06T03:27:14.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170b59e700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f170c1592c0 0x7f170c169fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:14.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f170a59c700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c0c15c0 0x7f170c15d0a0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f170c069260 tx=0x7f1700016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f16f2ffd700 1 -- 172.21.15.84:0/1118198333 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170001d6b0 con 0x7f170c0c15c0 2023-10-06T03:27:14.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.770+0000 7f25452cd700 1 -- start start 2023-10-06T03:27:14.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f25452cd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f254006c450 0x7f254016cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f25452cd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25400c7510 0x7f254016a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f25452cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2540159550 0x7f254006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f25452cd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254016d0b0 con 0x7f2540159550 2023-10-06T03:27:14.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f25452cd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25400b1c10 con 0x7f25400c7510 2023-10-06T03:27:14.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f25452cd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254016ac20 con 0x7f254006c450 2023-10-06T03:27:14.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.771+0000 7f1710967700 1 -- 172.21.15.84:0/1118198333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c0c6360 con 0x7f170c0c15c0 2023-10-06T03:27:14.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f16f2ffd700 1 -- 172.21.15.84:0/1118198333 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170001d810 con 0x7f170c0c15c0 2023-10-06T03:27:14.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f1710967700 1 -- 172.21.15.84:0/1118198333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c15d5e0 con 0x7f170c0c15c0 2023-10-06T03:27:14.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f16f2ffd700 1 -- 172.21.15.84:0/1118198333 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170001dbd0 con 0x7f170c0c15c0 2023-10-06T03:27:14.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f253effd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f254006c450 0x7f254016cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f253f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2540159550 0x7f254006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f253effd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f254006c450 0x7f254016cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:39792/0 (socket says 172.21.15.84:39792) 2023-10-06T03:27:14.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f253effd700 1 -- 172.21.15.84:0/1823611427 learned_addr learned my addr 172.21.15.84:0/1823611427 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:14.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f253effd700 1 -- 172.21.15.84:0/1823611427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25400c7510 msgr2=0x7f254016a6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:27:14.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f253effd700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25400c7510 0x7f254016a6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f253effd700 1 -- 172.21.15.84:0/1823611427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2540159550 msgr2=0x7f254006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f253effd700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2540159550 0x7f254006d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f253effd700 1 -- 172.21.15.84:0/1823611427 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538009a20 con 0x7f254006c450 2023-10-06T03:27:14.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f253effd700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f254006c450 0x7f254016cb70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f253000c590 tx=0x7f2530001020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f2526ffd700 1 -- 172.21.15.84:0/1823611427 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2530015c40 con 0x7f254006c450 2023-10-06T03:27:14.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f2526ffd700 1 -- 172.21.15.84:0/1823611427 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2530015da0 con 0x7f254006c450 2023-10-06T03:27:14.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f2526ffd700 1 -- 172.21.15.84:0/1823611427 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25300058a0 con 0x7f254006c450 2023-10-06T03:27:14.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f25452cd700 1 -- 172.21.15.84:0/1823611427 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2534009420 con 0x7f254006c450 2023-10-06T03:27:14.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.772+0000 7f25452cd700 1 -- 172.21.15.84:0/1823611427 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25400b0e50 con 0x7f254006c450 2023-10-06T03:27:14.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.773+0000 7f1710967700 1 -- 172.21.15.84:0/1118198333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c169ca0 con 0x7f170c0c15c0 2023-10-06T03:27:14.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.773+0000 7f16f2ffd700 1 -- 172.21.15.84:0/1118198333 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f170001b480 con 0x7f170c0c15c0 2023-10-06T03:27:14.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.774+0000 7f25452cd700 1 -- 172.21.15.84:0/1823611427 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254015c310 con 0x7f254006c450 2023-10-06T03:27:14.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.774+0000 7f16f2ffd700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f16f8066f30 0x7f16f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.774+0000 7f16f2ffd700 1 -- 172.21.15.84:0/1118198333 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1700086330 con 0x7f170c0c15c0 2023-10-06T03:27:14.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.774+0000 7f2526ffd700 1 -- 172.21.15.84:0/1823611427 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f253001b020 con 0x7f254006c450 2023-10-06T03:27:14.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.775+0000 7f170ad9d700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f16f8066f30 0x7f16f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.775+0000 7f2526ffd700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f252c077f40 0x7f252c07a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.775+0000 7f2526ffd700 1 -- 172.21.15.84:0/1823611427 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2530083cf0 con 0x7f254006c450 2023-10-06T03:27:14.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.775+0000 7f170ad9d700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f16f8066f30 0x7f16f80693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f16fc007fd0 tx=0x7f16fc007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.776+0000 7f253e7fc700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f252c077f40 0x7f252c07a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.776+0000 7f253e7fc700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f252c077f40 0x7f252c07a3f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f254006a4f0 tx=0x7f2534017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.778+0000 7f16f2ffd700 1 -- 172.21.15.84:0/1118198333 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1700053300 con 0x7f170c0c15c0 2023-10-06T03:27:14.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.779+0000 7f2526ffd700 1 -- 172.21.15.84:0/1823611427 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2530088070 con 0x7f254006c450 2023-10-06T03:27:14.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.811+0000 7fb3fb59e700 1 Processor -- start 2023-10-06T03:27:14.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.811+0000 7fb3fb59e700 1 -- start start 2023-10-06T03:27:14.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.811+0000 7f6511087700 1 Processor -- start 2023-10-06T03:27:14.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.811+0000 7f6511087700 1 -- start start 2023-10-06T03:27:14.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.811+0000 7fb3fb59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc13fb30 0x7fb3fc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fb59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb3fc0cd590 0x7fb3fc0c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fb59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3fc0c8300 con 0x7fb3fc06ae00 2023-10-06T03:27:14.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fb59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3fc06bc20 con 0x7fb3fc0cd590 2023-10-06T03:27:14.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fb59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc06b380 con 0x7fb3fc13fb30 2023-10-06T03:27:14.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f6511087700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f650c06c6a0 0x7f650c0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f6511087700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f650c06b870 0x7f650c1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f6511087700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f650c0cded0 con 0x7f650c06ca70 2023-10-06T03:27:14.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f6511087700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c0cd910 con 0x7f650c06b870 2023-10-06T03:27:14.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f6511087700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c0cdbf0 con 0x7f650c06c6a0 2023-10-06T03:27:14.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f6510886700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f650c06b870 0x7f650c1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3f9d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb3fc06ae00 0x7fb3fc0cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52112/0 (socket says 172.21.15.84:52112) 2023-10-06T03:27:14.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3f9d9b700 1 -- 172.21.15.84:0/354358880 learned_addr learned my addr 172.21.15.84:0/354358880 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:14.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fad9d700 1 --2- 172.21.15.84:0/354358880 >> v2:172.21.15.131:3300/0 conn(0x7fb3fc0cd590 0x7fb3fc0c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f6510886700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f650c06b870 0x7f650c1428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38092/0 (socket says 172.21.15.84:38092) 2023-10-06T03:27:14.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f650bfff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f650c06c6a0 0x7f650c0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f6510886700 1 -- 172.21.15.84:0/1711631830 learned_addr learned my addr 172.21.15.84:0/1711631830 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:14.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fa59c700 1 --2- 172.21.15.84:0/354358880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc13fb30 0x7fb3fc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3f959a700 1 -- 172.21.15.84:0/354358880 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950958283 0 0) 0x7fb3fc0c8300 con 0x7fb3fc06ae00 2023-10-06T03:27:14.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3f959a700 1 -- 172.21.15.84:0/354358880 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3e4003570 con 0x7fb3fc06ae00 2023-10-06T03:27:14.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f650bfff700 1 -- 172.21.15.84:0/1711631830 >> v2:172.21.15.84:3300/0 conn(0x7f650c06b870 msgr2=0x7f650c1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:14.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f650bfff700 1 --2- 172.21.15.84:0/1711631830 >> v2:172.21.15.84:3300/0 conn(0x7f650c06b870 0x7f650c1428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f650bfff700 1 -- 172.21.15.84:0/1711631830 >> v1:172.21.15.131:6789/0 conn(0x7f650c06ca70 legacy=0x7f650c06b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f650bfff700 1 -- 172.21.15.84:0/1711631830 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c06a960 con 0x7f650c06c6a0 2023-10-06T03:27:14.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f6510886700 1 --2- 172.21.15.84:0/1711631830 >> v2:172.21.15.84:3300/0 conn(0x7f650c06b870 0x7f650c1428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:14.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fad9d700 1 -- 172.21.15.84:0/354358880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc13fb30 msgr2=0x7fb3fc06a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:14.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fad9d700 1 --2- 172.21.15.84:0/354358880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc13fb30 0x7fb3fc06a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fad9d700 1 -- 172.21.15.84:0/354358880 >> v1:172.21.15.84:6789/0 conn(0x7fb3fc06ae00 legacy=0x7fb3fc0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fad9d700 1 -- 172.21.15.84:0/354358880 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc06b660 con 0x7fb3fc0cd590 2023-10-06T03:27:14.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7f650bfff700 1 --2- 172.21.15.84:0/1711631830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 0x7f650c0c76d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f650c069ff0 tx=0x7f64fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c5a76685cbf08a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.812+0000 7fb3fad9d700 1 --2- 172.21.15.84:0/354358880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3fc0cd590 0x7fb3fc0c8a50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009ee0 tx=0x7fb3f4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d79c4e74cf57fa79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7f650affd700 1 -- 172.21.15.84:0/1711631830 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011630 con 0x7f650c06c6a0 2023-10-06T03:27:14.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7f650affd700 1 -- 172.21.15.84:0/1711631830 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc011790 con 0x7f650c06c6a0 2023-10-06T03:27:14.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7f650affd700 1 -- 172.21.15.84:0/1711631830 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011b30 con 0x7f650c06c6a0 2023-10-06T03:27:14.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7fb3f959a700 1 -- 172.21.15.84:0/354358880 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400dcc0 con 0x7fb3fc0cd590 2023-10-06T03:27:14.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7fb3f959a700 1 -- 172.21.15.84:0/354358880 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f400de20 con 0x7fb3fc0cd590 2023-10-06T03:27:14.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7fb3f959a700 1 -- 172.21.15.84:0/354358880 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4010620 con 0x7fb3fc0cd590 2023-10-06T03:27:14.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7f6511087700 1 -- 172.21.15.84:0/1711631830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 msgr2=0x7f650c0c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7f6511087700 1 --2- 172.21.15.84:0/1711631830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 0x7f650c0c76d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f650c069ff0 tx=0x7f64fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7fb3fb59e700 1 -- 172.21.15.84:0/354358880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3fc0cd590 msgr2=0x7fb3fc0c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7fb3fb59e700 1 --2- 172.21.15.84:0/354358880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3fc0cd590 0x7fb3fc0c8a50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009ee0 tx=0x7fb3f4009780 comp rx=0 tx=0).stop 2023-10-06T03:27:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7f6511087700 1 -- 172.21.15.84:0/1711631830 shutdown_connections 2023-10-06T03:27:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7f6511087700 1 --2- 172.21.15.84:0/1711631830 >> v2:172.21.15.84:3300/0 conn(0x7f650c06b870 0x7f650c1428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7f6511087700 1 --2- 172.21.15.84:0/1711631830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 0x7f650c0c76d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7f6511087700 1 -- 172.21.15.84:0/1711631830 >> 172.21.15.84:0/1711631830 conn(0x7f650c06d560 msgr2=0x7f650c06d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7fb3fb59e700 1 -- 172.21.15.84:0/354358880 shutdown_connections 2023-10-06T03:27:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7fb3fb59e700 1 --2- 172.21.15.84:0/354358880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3fc0cd590 0x7fb3fc0c8a50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7fb3fb59e700 1 --2- 172.21.15.84:0/354358880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc13fb30 0x7fb3fc06a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.813+0000 7fb3fb59e700 1 -- 172.21.15.84:0/354358880 >> 172.21.15.84:0/354358880 conn(0x7fb3fc06d560 msgr2=0x7fb3fc06d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.814+0000 7fb3fb59e700 1 -- 172.21.15.84:0/354358880 shutdown_connections 2023-10-06T03:27:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.814+0000 7fb3fb59e700 1 -- 172.21.15.84:0/354358880 wait complete. 2023-10-06T03:27:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.814+0000 7f6511087700 1 -- 172.21.15.84:0/1711631830 shutdown_connections 2023-10-06T03:27:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.814+0000 7f6511087700 1 -- 172.21.15.84:0/1711631830 wait complete. 2023-10-06T03:27:14.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.815+0000 7fb3fb59e700 1 Processor -- start 2023-10-06T03:27:14.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.815+0000 7fb3fb59e700 1 -- start start 2023-10-06T03:27:14.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.815+0000 7f6511087700 1 Processor -- start 2023-10-06T03:27:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.815+0000 7fb3fb59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc06ae00 0x7fb3fc0c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.815+0000 7fb3fb59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3fc0cd590 0x7fb3fc154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.815+0000 7fb3fb59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3fc13fb30 0x7fb3fc155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.815+0000 7fb3fb59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0b0240 con 0x7fb3fc0cd590 2023-10-06T03:27:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.815+0000 7fb3fb59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0c69c0 con 0x7fb3fc13fb30 2023-10-06T03:27:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.815+0000 7fb3fb59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0c6ca0 con 0x7fb3fc06ae00 2023-10-06T03:27:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.815+0000 7fb3f9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3fc0cd590 0x7fb3fc154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3f9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3fc0cd590 0x7fb3fc154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38102/0 (socket says 172.21.15.84:38102) 2023-10-06T03:27:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3f9d9b700 1 -- 172.21.15.84:0/298538663 learned_addr learned my addr 172.21.15.84:0/298538663 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7f6511087700 1 -- start start 2023-10-06T03:27:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3fad9d700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3fc13fb30 0x7fb3fc155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3fa59c700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc06ae00 0x7fb3fc0c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3f9d9b700 1 -- 172.21.15.84:0/298538663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc06ae00 msgr2=0x7fb3fc0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3f9d9b700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc06ae00 0x7fb3fc0c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3f9d9b700 1 -- 172.21.15.84:0/298538663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3fc13fb30 msgr2=0x7fb3fc155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3f9d9b700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3fc13fb30 0x7fb3fc155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3f9d9b700 1 -- 172.21.15.84:0/298538663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f4009a20 con 0x7fb3fc0cd590 2023-10-06T03:27:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3fa59c700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc06ae00 0x7fb3fc0c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3fad9d700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3fc13fb30 0x7fb3fc155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3f9d9b700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3fc0cd590 0x7fb3fc154e50 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000c7c0 tx=0x7fb3f0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3ea7fc700 1 -- 172.21.15.84:0/298538663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0005cd0 con 0x7fb3fc0cd590 2023-10-06T03:27:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3ea7fc700 1 -- 172.21.15.84:0/298538663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f0005e30 con 0x7fb3fc0cd590 2023-10-06T03:27:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3fb59e700 1 -- 172.21.15.84:0/298538663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3fc0c6f80 con 0x7fb3fc0cd590 2023-10-06T03:27:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3ea7fc700 1 -- 172.21.15.84:0/298538663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0007320 con 0x7fb3fc0cd590 2023-10-06T03:27:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.816+0000 7fb3fb59e700 1 -- 172.21.15.84:0/298538663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3fc0c51b0 con 0x7fb3fc0cd590 2023-10-06T03:27:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f6511087700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650c06b870 0x7f650c15cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f6511087700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 0x7f650c169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f6511087700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650c0c6750 0x7f650c158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f6511087700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0c5b10 con 0x7f650c06b870 2023-10-06T03:27:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f6511087700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c159e20 con 0x7f650c06c6a0 2023-10-06T03:27:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f6511087700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c15a0c0 con 0x7f650c0c6750 2023-10-06T03:27:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f650b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 0x7f650c169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f6510886700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650c0c6750 0x7f650c158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f650b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 0x7f650c169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:38532/0 (socket says 172.21.15.84:38532) 2023-10-06T03:27:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f650b7fe700 1 -- 172.21.15.84:0/208707675 learned_addr learned my addr 172.21.15.84:0/208707675 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f6510886700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650c0c6750 0x7f650c158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:39810/0 (socket says 172.21.15.84:39810) 2023-10-06T03:27:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f650bfff700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650c06b870 0x7f650c15cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f650b7fe700 1 -- 172.21.15.84:0/208707675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650c0c6750 msgr2=0x7f650c158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f650b7fe700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650c0c6750 0x7f650c158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f650b7fe700 1 -- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650c06b870 msgr2=0x7f650c15cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f650b7fe700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650c06b870 0x7f650c15cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f650b7fe700 1 -- 172.21.15.84:0/208707675 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504009ae0 con 0x7f650c06c6a0 2023-10-06T03:27:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.817+0000 7f650bfff700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650c06b870 0x7f650c15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.818+0000 7f6510886700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650c0c6750 0x7f650c158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.818+0000 7f650b7fe700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 0x7f650c169b30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f650000c790 tx=0x7f6500007f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.818+0000 7fb3fb59e700 1 -- 172.21.15.84:0/298538663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3fc0b03b0 con 0x7fb3fc0cd590 2023-10-06T03:27:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.818+0000 7f64f3fff700 1 -- 172.21.15.84:0/208707675 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500011590 con 0x7f650c06c6a0 2023-10-06T03:27:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.818+0000 7f64f3fff700 1 -- 172.21.15.84:0/208707675 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65000116f0 con 0x7f650c06c6a0 2023-10-06T03:27:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.818+0000 7f6511087700 1 -- 172.21.15.84:0/208707675 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc009420 con 0x7f650c06c6a0 2023-10-06T03:27:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.818+0000 7f64f3fff700 1 -- 172.21.15.84:0/208707675 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500011a90 con 0x7f650c06c6a0 2023-10-06T03:27:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.818+0000 7f6511087700 1 -- 172.21.15.84:0/208707675 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c15a680 con 0x7f650c06c6a0 2023-10-06T03:27:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.818+0000 7fb3ea7fc700 1 -- 172.21.15.84:0/298538663 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3f001b3b0 con 0x7fb3fc0cd590 2023-10-06T03:27:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.819+0000 7fb3ea7fc700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3dc066f30 0x7fb3dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.819+0000 7f64f3fff700 1 -- 172.21.15.84:0/208707675 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f650001b3b0 con 0x7f650c06c6a0 2023-10-06T03:27:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.820+0000 7f64f3fff700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f8066f30 0x7f64f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.820+0000 7f64f3fff700 1 -- 172.21.15.84:0/208707675 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6500083c30 con 0x7f650c06c6a0 2023-10-06T03:27:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.820+0000 7f650bfff700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f8066f30 0x7f64f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.820+0000 7fb3ea7fc700 1 -- 172.21.15.84:0/298538663 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb3f0054f40 con 0x7fb3fc0cd590 2023-10-06T03:27:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.820+0000 7f650bfff700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f8066f30 0x7f64f80693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0091e0 tx=0x7f64fc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.821+0000 7fb3fa59c700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3dc066f30 0x7fb3dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.821+0000 7fb3fa59c700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3dc066f30 0x7fb3dc0693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009660 tx=0x7fb3ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.822+0000 7f6511087700 1 -- 172.21.15.84:0/208707675 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650c065e00 con 0x7f650c06c6a0 2023-10-06T03:27:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.823+0000 7fb3ea7fc700 1 -- 172.21.15.84:0/298538663 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3f0050b80 con 0x7fb3fc0cd590 2023-10-06T03:27:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:14.827+0000 7f64f3fff700 1 -- 172.21.15.84:0/208707675 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6500017020 con 0x7f650c06c6a0 2023-10-06T03:27:14.849 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-06T03:27:14.849 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-06T03:27:15.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.056+0000 7f25452cd700 1 -- 172.21.15.84:0/1823611427 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f2540065e00 con 0x7f254006c450 2023-10-06T03:27:15.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.076+0000 7f1710967700 1 -- 172.21.15.84:0/1118198333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f170c065e00 con 0x7f170c0c15c0 2023-10-06T03:27:15.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.096+0000 7fb3fb59e700 1 -- 172.21.15.84:0/298538663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7fb3fc065e00 con 0x7fb3fc0cd590 2023-10-06T03:27:15.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.115+0000 7f6511087700 1 -- 172.21.15.84:0/208707675 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f650c06ac40 con 0x7f650c06c6a0 2023-10-06T03:27:15.501 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:27:15.499+0000 7f573d793700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:27:15.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.500+0000 7f2526ffd700 1 -- 172.21.15.84:0/1823611427 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6942 v55) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2530050cc0 con 0x7f254006c450 2023-10-06T03:27:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 -- 172.21.15.84:0/1823611427 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f252c077f40 msgr2=0x7f252c07a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f252c077f40 0x7f252c07a3f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f254006a4f0 tx=0x7f2534017000 comp rx=0 tx=0).stop 2023-10-06T03:27:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 -- 172.21.15.84:0/1823611427 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f254006c450 msgr2=0x7f254016cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f254006c450 0x7f254016cb70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f253000c590 tx=0x7f2530001020 comp rx=0 tx=0).stop 2023-10-06T03:27:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 -- 172.21.15.84:0/1823611427 shutdown_connections 2023-10-06T03:27:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f252c077f40 0x7f252c07a3f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2540159550 0x7f254006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f254006c450 0x7f254016cb70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:15.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 --2- 172.21.15.84:0/1823611427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25400c7510 0x7f254016a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:15.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 -- 172.21.15.84:0/1823611427 >> 172.21.15.84:0/1823611427 conn(0x7f25400cc860 msgr2=0x7f25400caae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:15.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 -- 172.21.15.84:0/1823611427 shutdown_connections 2023-10-06T03:27:15.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.502+0000 7f25452cd700 1 -- 172.21.15.84:0/1823611427 wait complete. 2023-10-06T03:27:15.505 INFO:teuthology.orchestra.run.smithi084.stderr:failed mds gid 6942 2023-10-06T03:27:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.505+0000 7f16f2ffd700 1 -- 172.21.15.84:0/1118198333 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6945 v56) v1 ==== 95+0+0 (secure 0 0 0) 0x7f1700056920 con 0x7f170c0c15c0 2023-10-06T03:27:15.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.508+0000 7f1710967700 1 -- 172.21.15.84:0/1118198333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f16f8066f30 msgr2=0x7f16f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:15.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.508+0000 7f1710967700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f16f8066f30 0x7f16f80693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f16fc007fd0 tx=0x7f16fc007d50 comp rx=0 tx=0).stop 2023-10-06T03:27:15.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.508+0000 7f1710967700 1 -- 172.21.15.84:0/1118198333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c0c15c0 msgr2=0x7f170c15d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:15.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.508+0000 7f1710967700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c0c15c0 0x7f170c15d0a0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f170c069260 tx=0x7f1700016000 comp rx=0 tx=0).stop 2023-10-06T03:27:15.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.509+0000 7f1710967700 1 -- 172.21.15.84:0/1118198333 shutdown_connections 2023-10-06T03:27:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.509+0000 7f1710967700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f16f8066f30 0x7f16f80693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.509+0000 7f1710967700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f170c1592c0 0x7f170c169fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.509+0000 7f1710967700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f170c06aa70 0x7f170c0c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.509+0000 7f1710967700 1 --2- 172.21.15.84:0/1118198333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c0c15c0 0x7f170c15d0a0 secure :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f170c069260 tx=0x7f1700016000 comp rx=0 tx=0).stop 2023-10-06T03:27:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.509+0000 7f1710967700 1 -- 172.21.15.84:0/1118198333 >> 172.21.15.84:0/1118198333 conn(0x7f170c0c9d60 msgr2=0x7f170c158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.510+0000 7f1710967700 1 -- 172.21.15.84:0/1118198333 shutdown_connections 2023-10-06T03:27:15.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.510+0000 7f1710967700 1 -- 172.21.15.84:0/1118198333 wait complete. 2023-10-06T03:27:15.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.511+0000 7fb3ea7fc700 1 -- 172.21.15.84:0/298538663 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6223 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7fb3f0017020 con 0x7fb3fc0cd590 2023-10-06T03:27:15.513 INFO:teuthology.orchestra.run.smithi084.stderr:failed mds gid 6945 2023-10-06T03:27:15.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.513+0000 7fb3fb59e700 1 -- 172.21.15.84:0/298538663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3dc066f30 msgr2=0x7fb3dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:15.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.513+0000 7fb3fb59e700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3dc066f30 0x7fb3dc0693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009660 tx=0x7fb3ec008040 comp rx=0 tx=0).stop 2023-10-06T03:27:15.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.513+0000 7fb3fb59e700 1 -- 172.21.15.84:0/298538663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3fc0cd590 msgr2=0x7fb3fc154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:15.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.513+0000 7fb3fb59e700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3fc0cd590 0x7fb3fc154e50 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000c7c0 tx=0x7fb3f0007e00 comp rx=0 tx=0).stop 2023-10-06T03:27:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.514+0000 7fb3fb59e700 1 -- 172.21.15.84:0/298538663 shutdown_connections 2023-10-06T03:27:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.514+0000 7fb3fb59e700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb3dc066f30 0x7fb3dc0693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.514+0000 7fb3fb59e700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3fc13fb30 0x7fb3fc155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.514+0000 7fb3fb59e700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3fc06ae00 0x7fb3fc0c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.514+0000 7fb3fb59e700 1 --2- 172.21.15.84:0/298538663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3fc0cd590 0x7fb3fc154e50 secure :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000c7c0 tx=0x7fb3f0007e00 comp rx=0 tx=0).stop 2023-10-06T03:27:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.514+0000 7fb3fb59e700 1 -- 172.21.15.84:0/298538663 >> 172.21.15.84:0/298538663 conn(0x7fb3fc06d560 msgr2=0x7fb3fc06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:15.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.515+0000 7fb3fb59e700 1 -- 172.21.15.84:0/298538663 shutdown_connections 2023-10-06T03:27:15.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:15.515+0000 7fb3fb59e700 1 -- 172.21.15.84:0/298538663 wait complete. 2023-10-06T03:27:15.517 INFO:teuthology.orchestra.run.smithi084.stderr:failed mds gid 6223 2023-10-06T03:27:15.522 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:27:15.522 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:27:15.528 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:27:15.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:27:15.531 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:27:15.531 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:27:15.532 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:27:15.532 DEBUG:teuthology.parallel:result is None 2023-10-06T03:27:15.535 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:27:15.535 DEBUG:teuthology.parallel:result is None 2023-10-06T03:27:15.573 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:27:15.573 DEBUG:teuthology.parallel:result is None 2023-10-06T03:27:15.603 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:27:15.608 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:27:15.646 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:27:16.359 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:27:16.358+0000 7f573d793700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:27:16.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.367+0000 7f64f3fff700 1 -- 172.21.15.84:0/208707675 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6226 v58) v1 ==== 95+0+0 (secure 0 0 0) 0x7f6500050c00 con 0x7f650c06c6a0 2023-10-06T03:27:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 -- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f8066f30 msgr2=0x7f64f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f8066f30 0x7f64f80693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0091e0 tx=0x7f64fc017000 comp rx=0 tx=0).stop 2023-10-06T03:27:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 -- 172.21.15.84:0/208707675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 msgr2=0x7f650c169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 0x7f650c169b30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f650000c790 tx=0x7f6500007f20 comp rx=0 tx=0).stop 2023-10-06T03:27:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 -- 172.21.15.84:0/208707675 shutdown_connections 2023-10-06T03:27:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f64f8066f30 0x7f64f80693e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650c0c6750 0x7f650c158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650c06b870 0x7f650c15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 --2- 172.21.15.84:0/208707675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f650c06c6a0 0x7f650c169b30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 -- 172.21.15.84:0/208707675 >> 172.21.15.84:0/208707675 conn(0x7f650c06d560 msgr2=0x7f650c13fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 -- 172.21.15.84:0/208707675 shutdown_connections 2023-10-06T03:27:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.369+0000 7f6511087700 1 -- 172.21.15.84:0/208707675 wait complete. 2023-10-06T03:27:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:failed mds gid 6226 2023-10-06T03:27:16.387 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:27:16.387 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:27:16.390 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:27:16.391 DEBUG:teuthology.parallel:result is None 2023-10-06T03:27:16.391 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:16.462 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:27:16.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.542+0000 7f176ab06700 1 Processor -- start 2023-10-06T03:27:16.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.542+0000 7f176ab06700 1 -- start start 2023-10-06T03:27:16.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.543+0000 7f176ab06700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f17640af550 0x7f176415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:16.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.543+0000 7f176ab06700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 0x7f176406c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:16.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.543+0000 7f176ab06700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17640d01c0 con 0x7f17640af920 2023-10-06T03:27:16.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.543+0000 7f176ab06700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17640cecf0 con 0x7f17640af550 2023-10-06T03:27:16.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.543+0000 7f176ab06700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17640cefd0 con 0x7f17640cfd90 2023-10-06T03:27:16.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.543+0000 7f1769b04700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f17640af550 0x7f176415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:16.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.543+0000 7f1769b04700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f17640af550 0x7f176415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38148/0 (socket says 172.21.15.84:38148) 2023-10-06T03:27:16.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.543+0000 7f1769b04700 1 -- 172.21.15.84:0/4193600086 learned_addr learned my addr 172.21.15.84:0/4193600086 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:16.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.543+0000 7f176a305700 1 --2- 172.21.15.84:0/4193600086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 0x7f176406c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:16.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f1769b04700 1 -- 172.21.15.84:0/4193600086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 msgr2=0x7f176406c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:16.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f1769b04700 1 --2- 172.21.15.84:0/4193600086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 0x7f176406c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f1769b04700 1 -- 172.21.15.84:0/4193600086 >> v1:172.21.15.131:6789/0 conn(0x7f17640af920 legacy=0x7f17640ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:16.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f1769b04700 1 -- 172.21.15.84:0/4193600086 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17640cf2b0 con 0x7f17640af550 2023-10-06T03:27:16.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f1768b02700 1 -- 172.21.15.84:0/4193600086 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161380771 0 0) 0x7f1754001110 con 0x7f17640af920 2023-10-06T03:27:16.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f1769b04700 1 --2- 172.21.15.84:0/4193600086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af550 0x7f176415a5e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1760009f20 tx=0x7f1760009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c33a147327acbc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:16.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f1768b02700 1 -- 172.21.15.84:0/4193600086 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000e070 con 0x7f17640af550 2023-10-06T03:27:16.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f1768b02700 1 -- 172.21.15.84:0/4193600086 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176000b9d0 con 0x7f17640af550 2023-10-06T03:27:16.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f1768b02700 1 -- 172.21.15.84:0/4193600086 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600092e0 con 0x7f17640af550 2023-10-06T03:27:16.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f176ab06700 1 -- 172.21.15.84:0/4193600086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af550 msgr2=0x7f176415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:16.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f176ab06700 1 --2- 172.21.15.84:0/4193600086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af550 0x7f176415a5e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1760009f20 tx=0x7f1760009840 comp rx=0 tx=0).stop 2023-10-06T03:27:16.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f176ab06700 1 -- 172.21.15.84:0/4193600086 shutdown_connections 2023-10-06T03:27:16.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f176ab06700 1 --2- 172.21.15.84:0/4193600086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 0x7f176406c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f176ab06700 1 --2- 172.21.15.84:0/4193600086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af550 0x7f176415a5e0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f176ab06700 1 -- 172.21.15.84:0/4193600086 >> 172.21.15.84:0/4193600086 conn(0x7f17640d0360 msgr2=0x7f17640d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f176ab06700 1 -- 172.21.15.84:0/4193600086 shutdown_connections 2023-10-06T03:27:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.544+0000 7f176ab06700 1 -- 172.21.15.84:0/4193600086 wait complete. 2023-10-06T03:27:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.545+0000 7f176ab06700 1 Processor -- start 2023-10-06T03:27:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.546+0000 7f176ab06700 1 -- start start 2023-10-06T03:27:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.546+0000 7f176ab06700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17640af550 0x7f176414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:16.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.546+0000 7f176ab06700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af920 0x7f17640c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:16.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.546+0000 7f176ab06700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 0x7f176415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:16.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.546+0000 7f176ab06700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17640b3100 con 0x7f17640af920 2023-10-06T03:27:16.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.546+0000 7f176ab06700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17640b39a0 con 0x7f17640af550 2023-10-06T03:27:16.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.546+0000 7f176ab06700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17640c7050 con 0x7f17640cfd90 2023-10-06T03:27:16.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.546+0000 7f1769303700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af920 0x7f17640c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:16.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.546+0000 7f1769303700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af920 0x7f17640c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38154/0 (socket says 172.21.15.84:38154) 2023-10-06T03:27:16.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.546+0000 7f1769303700 1 -- 172.21.15.84:0/2253706559 learned_addr learned my addr 172.21.15.84:0/2253706559 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:16.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f1769b04700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17640af550 0x7f176414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:16.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f176a305700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 0x7f176415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:16.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f1769303700 1 -- 172.21.15.84:0/2253706559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 msgr2=0x7f176415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:16.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f1769303700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 0x7f176415ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f1769303700 1 -- 172.21.15.84:0/2253706559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17640af550 msgr2=0x7f176414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:16.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f1769303700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17640af550 0x7f176414fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f1769303700 1 -- 172.21.15.84:0/2253706559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009ae0 con 0x7f17640af920 2023-10-06T03:27:16.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f176a305700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 0x7f176415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f1769303700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af920 0x7f17640c6600 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f175400c7e0 tx=0x7f1754007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f1759ffb700 1 -- 172.21.15.84:0/2253706559 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754012630 con 0x7f17640af920 2023-10-06T03:27:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f1759ffb700 1 -- 172.21.15.84:0/2253706559 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17540127b0 con 0x7f17640af920 2023-10-06T03:27:16.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f176ab06700 1 -- 172.21.15.84:0/2253706559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17640b3350 con 0x7f17640af920 2023-10-06T03:27:16.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f1759ffb700 1 -- 172.21.15.84:0/2253706559 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754012b70 con 0x7f17640af920 2023-10-06T03:27:16.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.547+0000 7f176ab06700 1 -- 172.21.15.84:0/2253706559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1764150430 con 0x7f17640af920 2023-10-06T03:27:16.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.548+0000 7f176ab06700 1 -- 172.21.15.84:0/2253706559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17640b3b10 con 0x7f17640af920 2023-10-06T03:27:16.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.549+0000 7f1759ffb700 1 -- 172.21.15.84:0/2253706559 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f175401b400 con 0x7f17640af920 2023-10-06T03:27:16.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.549+0000 7f1759ffb700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1748066f60 0x7f1748069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:16.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.549+0000 7f1759ffb700 1 -- 172.21.15.84:0/2253706559 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f1754084230 con 0x7f17640af920 2023-10-06T03:27:16.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.549+0000 7f1769b04700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1748066f60 0x7f1748069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:16.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.549+0000 7f1769b04700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1748066f60 0x7f1748069410 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1760009880 tx=0x7f1760018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:16.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.553+0000 7f1759ffb700 1 -- 172.21.15.84:0/2253706559 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1754051150 con 0x7f17640af920 2023-10-06T03:27:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.780+0000 7f176ab06700 1 -- 172.21.15.84:0/2253706559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17640d01c0 con 0x7f17640af920 2023-10-06T03:27:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.781+0000 7f1759ffb700 1 -- 172.21.15.84:0/2253706559 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3844 (secure 0 0 0) 0x7f17640d01c0 con 0x7f17640af920 2023-10-06T03:27:16.783 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:16.783 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3912722771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3912722771},{"type":"v1","addr":"172.21.15.131:6833","nonce":3912722771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3193918731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3193918731},{"type":"v1","addr":"172.21.15.84:6835","nonce":3193918731}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:16.364789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7167":{"gid":7167,"name":"c","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.84:6837/573778757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":573778757},{"type":"v1","addr":"172.21.15.84:6837","nonce":573778757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:16.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 -- 172.21.15.84:0/2253706559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1748066f60 msgr2=0x7f1748069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:16.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1748066f60 0x7f1748069410 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1760009880 tx=0x7f1760018000 comp rx=0 tx=0).stop 2023-10-06T03:27:16.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 -- 172.21.15.84:0/2253706559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af920 msgr2=0x7f17640c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:16.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af920 0x7f17640c6600 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f175400c7e0 tx=0x7f1754007c60 comp rx=0 tx=0).stop 2023-10-06T03:27:16.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 -- 172.21.15.84:0/2253706559 shutdown_connections 2023-10-06T03:27:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1748066f60 0x7f1748069410 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17640af550 0x7f176414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17640cfd90 0x7f176415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 --2- 172.21.15.84:0/2253706559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17640af920 0x7f17640c6600 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 -- 172.21.15.84:0/2253706559 >> 172.21.15.84:0/2253706559 conn(0x7f17640d0360 msgr2=0x7f1764157730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:16.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 -- 172.21.15.84:0/2253706559 shutdown_connections 2023-10-06T03:27:16.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:16.783+0000 7f176ab06700 1 -- 172.21.15.84:0/2253706559 wait complete. 2023-10-06T03:27:16.787 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 59 2023-10-06T03:27:17.200 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:27:05.838700+0000', 'modified': '2023-10-06T03:27:16.364789+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7167': {'gid': 7167, 'name': 'c', 'rank': 0, 'incarnation': 59, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.84:6837/573778757', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 573778757}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 573778757}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:27:17.200 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7167:up:replay 2023-10-06T03:27:18.201 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.332+0000 7f8da6f83700 1 Processor -- start 2023-10-06T03:27:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.332+0000 7f8da6f83700 1 -- start start 2023-10-06T03:27:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.333+0000 7f8da6f83700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8da013fd10 0x7f8da00cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.333+0000 7f8da6f83700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8da00c7a90 0x7f8da00c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.333+0000 7f8da6f83700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00cb340 con 0x7f8da01400e0 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.333+0000 7f8da6f83700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da00c8470 con 0x7f8da00c7a90 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.333+0000 7f8da6f83700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da00ca730 con 0x7f8da013fd10 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.333+0000 7f8da5520700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8da00c7a90 0x7f8da00c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.333+0000 7f8da5520700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8da00c7a90 0x7f8da00c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38170/0 (socket says 172.21.15.84:38170) 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.333+0000 7f8da5520700 1 -- 172.21.15.84:0/1833479916 learned_addr learned my addr 172.21.15.84:0/1833479916 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8da4d1f700 1 --2- 172.21.15.84:0/1833479916 >> v2:172.21.15.131:3300/0 conn(0x7f8da013fd10 0x7f8da00cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8da5520700 1 -- 172.21.15.84:0/1833479916 >> v2:172.21.15.131:3300/0 conn(0x7f8da013fd10 msgr2=0x7f8da00cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8da5520700 1 --2- 172.21.15.84:0/1833479916 >> v2:172.21.15.131:3300/0 conn(0x7f8da013fd10 0x7f8da00cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8da5520700 1 -- 172.21.15.84:0/1833479916 >> v1:172.21.15.131:6789/0 conn(0x7f8da01400e0 legacy=0x7f8da00c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8da5520700 1 -- 172.21.15.84:0/1833479916 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da00caa10 con 0x7f8da00c7a90 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8da5520700 1 --2- 172.21.15.84:0/1833479916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 0x7f8da00c7f30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8d980099b0 tx=0x7f8d98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fbf1a3a97b3b5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8d9f7fe700 1 -- 172.21.15.84:0/1833479916 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800b7e0 con 0x7f8da00c7a90 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8d9f7fe700 1 -- 172.21.15.84:0/1833479916 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9800b940 con 0x7f8da00c7a90 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8d9f7fe700 1 -- 172.21.15.84:0/1833479916 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800bce0 con 0x7f8da00c7a90 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8da6f83700 1 -- 172.21.15.84:0/1833479916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 msgr2=0x7f8da00c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.334+0000 7f8da6f83700 1 --2- 172.21.15.84:0/1833479916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 0x7f8da00c7f30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8d980099b0 tx=0x7f8d98009250 comp rx=0 tx=0).stop 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.335+0000 7f8da6f83700 1 -- 172.21.15.84:0/1833479916 shutdown_connections 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.335+0000 7f8da6f83700 1 --2- 172.21.15.84:0/1833479916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 0x7f8da00c7f30 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.335+0000 7f8da6f83700 1 --2- 172.21.15.84:0/1833479916 >> v2:172.21.15.131:3300/0 conn(0x7f8da013fd10 0x7f8da00cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.335+0000 7f8da6f83700 1 -- 172.21.15.84:0/1833479916 >> 172.21.15.84:0/1833479916 conn(0x7f8da006cee0 msgr2=0x7f8da00cc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.335+0000 7f8da6f83700 1 -- 172.21.15.84:0/1833479916 shutdown_connections 2023-10-06T03:27:18.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.335+0000 7f8da6f83700 1 -- 172.21.15.84:0/1833479916 wait complete. 2023-10-06T03:27:18.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.336+0000 7f8da6f83700 1 Processor -- start 2023-10-06T03:27:18.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.336+0000 7f8da6f83700 1 -- start start 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da6f83700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 0x7f8da00adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da6f83700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da013fd10 0x7f8da00aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da6f83700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8da01400e0 0x7f8da00af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da6f83700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00c4000 con 0x7f8da00c7a90 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da6f83700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da0159420 con 0x7f8da013fd10 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da6f83700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00c36d0 con 0x7f8da01400e0 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da4d1f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 0x7f8da00adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da4d1f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 0x7f8da00adb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38172/0 (socket says 172.21.15.84:38172) 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da4d1f700 1 -- 172.21.15.84:0/335204620 learned_addr learned my addr 172.21.15.84:0/335204620 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da5520700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8da01400e0 0x7f8da00af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8d9ffff700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da013fd10 0x7f8da00aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da4d1f700 1 -- 172.21.15.84:0/335204620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8da01400e0 msgr2=0x7f8da00af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da4d1f700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8da01400e0 0x7f8da00af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da4d1f700 1 -- 172.21.15.84:0/335204620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da013fd10 msgr2=0x7f8da00aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da4d1f700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da013fd10 0x7f8da00aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da4d1f700 1 -- 172.21.15.84:0/335204620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980094f0 con 0x7f8da00c7a90 2023-10-06T03:27:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8d9ffff700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da013fd10 0x7f8da00aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da4d1f700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 0x7f8da00adb80 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000e190 tx=0x7f8d90009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8d9cff9700 1 -- 172.21.15.84:0/335204620 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000ee30 con 0x7f8da00c7a90 2023-10-06T03:27:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8d9cff9700 1 -- 172.21.15.84:0/335204620 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90014420 con 0x7f8da00c7a90 2023-10-06T03:27:18.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8da6f83700 1 -- 172.21.15.84:0/335204620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da00c39b0 con 0x7f8da00c7a90 2023-10-06T03:27:18.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.337+0000 7f8d9cff9700 1 -- 172.21.15.84:0/335204620 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d900147e0 con 0x7f8da00c7a90 2023-10-06T03:27:18.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.338+0000 7f8da6f83700 1 -- 172.21.15.84:0/335204620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da00ae0c0 con 0x7f8da00c7a90 2023-10-06T03:27:18.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.339+0000 7f8da6f83700 1 -- 172.21.15.84:0/335204620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da01595e0 con 0x7f8da00c7a90 2023-10-06T03:27:18.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.339+0000 7f8d9cff9700 1 -- 172.21.15.84:0/335204620 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d90014b90 con 0x7f8da00c7a90 2023-10-06T03:27:18.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.339+0000 7f8d9cff9700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d80066f30 0x7f8d800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:18.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.339+0000 7f8d9cff9700 1 -- 172.21.15.84:0/335204620 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f8d900850d0 con 0x7f8da00c7a90 2023-10-06T03:27:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.339+0000 7f8d9ffff700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d80066f30 0x7f8d800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.340+0000 7f8d9ffff700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d80066f30 0x7f8d800693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8d88006fd0 tx=0x7f8d88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.344+0000 7f8d9cff9700 1 -- 172.21.15.84:0/335204620 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d90051ff0 con 0x7f8da00c7a90 2023-10-06T03:27:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.567+0000 7f8da6f83700 1 -- 172.21.15.84:0/335204620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8da00c42e0 con 0x7f8da00c7a90 2023-10-06T03:27:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.567+0000 7f8d9cff9700 1 -- 172.21.15.84:0/335204620 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f8d90009a60 con 0x7f8da00c7a90 2023-10-06T03:27:18.568 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:18.568 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3912722771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3912722771},{"type":"v1","addr":"172.21.15.131:6833","nonce":3912722771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6382,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4017009844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4017009844},{"type":"v1","addr":"172.21.15.131:6835","nonce":4017009844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3193918731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3193918731},{"type":"v1","addr":"172.21.15.84:6835","nonce":3193918731}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:18.370598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7167":{"gid":7167,"name":"c","rank":0,"incarnation":59,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.84:6837/573778757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":573778757},{"type":"v1","addr":"172.21.15.84:6837","nonce":573778757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:18.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 -- 172.21.15.84:0/335204620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d80066f30 msgr2=0x7f8d800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:18.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d80066f30 0x7f8d800693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8d88006fd0 tx=0x7f8d88008040 comp rx=0 tx=0).stop 2023-10-06T03:27:18.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 -- 172.21.15.84:0/335204620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 msgr2=0x7f8da00adb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 0x7f8da00adb80 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000e190 tx=0x7f8d90009920 comp rx=0 tx=0).stop 2023-10-06T03:27:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 -- 172.21.15.84:0/335204620 shutdown_connections 2023-10-06T03:27:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8d80066f30 0x7f8d800693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8da01400e0 0x7f8da00af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8da00c7a90 0x7f8da00adb80 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 --2- 172.21.15.84:0/335204620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da013fd10 0x7f8da00aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 -- 172.21.15.84:0/335204620 >> 172.21.15.84:0/335204620 conn(0x7f8da006cee0 msgr2=0x7f8da006ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.569+0000 7f8da6f83700 1 -- 172.21.15.84:0/335204620 shutdown_connections 2023-10-06T03:27:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:18.570+0000 7f8da6f83700 1 -- 172.21.15.84:0/335204620 wait complete. 2023-10-06T03:27:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 61 2023-10-06T03:27:18.985 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:27:05.838700+0000', 'modified': '2023-10-06T03:27:18.370598+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7167': {'gid': 7167, 'name': 'c', 'rank': 0, 'incarnation': 59, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.84:6837/573778757', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 573778757}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 573778757}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:27:18.985 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7167:up:rejoin 2023-10-06T03:27:19.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:20.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.112+0000 7f3473bd0700 1 Processor -- start 2023-10-06T03:27:20.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.113+0000 7f3473bd0700 1 -- start start 2023-10-06T03:27:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.113+0000 7f3473bd0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f346c06c6a0 0x7f346c0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.113+0000 7f3473bd0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c15dbb0 0x7f346c1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.113+0000 7f3473bd0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c0cb4f0 con 0x7f346c06ca70 2023-10-06T03:27:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.113+0000 7f3473bd0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c0ccf10 con 0x7f346c06c6a0 2023-10-06T03:27:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.113+0000 7f3473bd0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c15e3b0 con 0x7f346c15dbb0 2023-10-06T03:27:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347116b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f346c06ca70 0x7f346c15d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52128/0 (socket says 172.21.15.84:52128) 2023-10-06T03:27:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347116b700 1 -- 172.21.15.84:0/3903157365 learned_addr learned my addr 172.21.15.84:0/3903157365 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347216d700 1 --2- 172.21.15.84:0/3903157365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c15dbb0 0x7f346c1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347196c700 1 --2- 172.21.15.84:0/3903157365 >> v2:172.21.15.131:3300/0 conn(0x7f346c06c6a0 0x7f346c0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347096a700 1 -- 172.21.15.84:0/3903157365 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683078190 0 0) 0x7f346c0cb4f0 con 0x7f346c06ca70 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347096a700 1 -- 172.21.15.84:0/3903157365 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3458003570 con 0x7f346c06ca70 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347216d700 1 -- 172.21.15.84:0/3903157365 >> v2:172.21.15.131:3300/0 conn(0x7f346c06c6a0 msgr2=0x7f346c0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347216d700 1 --2- 172.21.15.84:0/3903157365 >> v2:172.21.15.131:3300/0 conn(0x7f346c06c6a0 0x7f346c0cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347216d700 1 -- 172.21.15.84:0/3903157365 >> v1:172.21.15.84:6789/0 conn(0x7f346c06ca70 legacy=0x7f346c15d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347216d700 1 -- 172.21.15.84:0/3903157365 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c0caee0 con 0x7f346c15dbb0 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347216d700 1 --2- 172.21.15.84:0/3903157365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c15dbb0 0x7f346c1593e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3464009e60 tx=0x7f3464009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73c5f94f45cf7e7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347096a700 1 -- 172.21.15.84:0/3903157365 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346400e070 con 0x7f346c15dbb0 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.114+0000 7f347096a700 1 -- 172.21.15.84:0/3903157365 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346400bab0 con 0x7f346c15dbb0 2023-10-06T03:27:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.115+0000 7f347096a700 1 -- 172.21.15.84:0/3903157365 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346400be30 con 0x7f346c15dbb0 2023-10-06T03:27:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.115+0000 7f3473bd0700 1 -- 172.21.15.84:0/3903157365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c15dbb0 msgr2=0x7f346c1593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.115+0000 7f3473bd0700 1 --2- 172.21.15.84:0/3903157365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c15dbb0 0x7f346c1593e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3464009e60 tx=0x7f3464009780 comp rx=0 tx=0).stop 2023-10-06T03:27:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.115+0000 7f3473bd0700 1 -- 172.21.15.84:0/3903157365 shutdown_connections 2023-10-06T03:27:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.115+0000 7f3473bd0700 1 --2- 172.21.15.84:0/3903157365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c15dbb0 0x7f346c1593e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.115+0000 7f3473bd0700 1 --2- 172.21.15.84:0/3903157365 >> v2:172.21.15.131:3300/0 conn(0x7f346c06c6a0 0x7f346c0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.115+0000 7f3473bd0700 1 -- 172.21.15.84:0/3903157365 >> 172.21.15.84:0/3903157365 conn(0x7f346c06dfd0 msgr2=0x7f346c0cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.115+0000 7f3473bd0700 1 -- 172.21.15.84:0/3903157365 shutdown_connections 2023-10-06T03:27:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.115+0000 7f3473bd0700 1 -- 172.21.15.84:0/3903157365 wait complete. 2023-10-06T03:27:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.116+0000 7f3473bd0700 1 Processor -- start 2023-10-06T03:27:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.116+0000 7f3473bd0700 1 -- start start 2023-10-06T03:27:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f3473bd0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c06c6a0 0x7f346c0c1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f3473bd0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346c06ca70 0x7f346c0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f3473bd0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15dbb0 0x7f346c158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f3473bd0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0ad060 con 0x7f346c15dbb0 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f3473bd0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0c0d60 con 0x7f346c06ca70 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f3473bd0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0acaa0 con 0x7f346c06c6a0 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347216d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15dbb0 0x7f346c158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347216d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15dbb0 0x7f346c158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38176/0 (socket says 172.21.15.84:38176) 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347216d700 1 -- 172.21.15.84:0/674093679 learned_addr learned my addr 172.21.15.84:0/674093679 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347196c700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c06c6a0 0x7f346c0c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347116b700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346c06ca70 0x7f346c0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347216d700 1 -- 172.21.15.84:0/674093679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c06c6a0 msgr2=0x7f346c0c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347216d700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c06c6a0 0x7f346c0c1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347216d700 1 -- 172.21.15.84:0/674093679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346c06ca70 msgr2=0x7f346c0c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347216d700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346c06ca70 0x7f346c0c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347216d700 1 -- 172.21.15.84:0/674093679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009a20 con 0x7f346c15dbb0 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.117+0000 7f347196c700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c06c6a0 0x7f346c0c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.118+0000 7f347216d700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15dbb0 0x7f346c158820 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f346c15e4f0 tx=0x7f3464019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.118+0000 7f3461ffb700 1 -- 172.21.15.84:0/674093679 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464027470 con 0x7f346c15dbb0 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.118+0000 7f3461ffb700 1 -- 172.21.15.84:0/674093679 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34640275f0 con 0x7f346c15dbb0 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.118+0000 7f3473bd0700 1 -- 172.21.15.84:0/674093679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c0acd80 con 0x7f346c15dbb0 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.118+0000 7f3461ffb700 1 -- 172.21.15.84:0/674093679 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640279b0 con 0x7f346c15dbb0 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.118+0000 7f3473bd0700 1 -- 172.21.15.84:0/674093679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c0c12e0 con 0x7f346c15dbb0 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.119+0000 7f3473bd0700 1 -- 172.21.15.84:0/674093679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c0c1500 con 0x7f346c15dbb0 2023-10-06T03:27:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.119+0000 7f3461ffb700 1 -- 172.21.15.84:0/674093679 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3464024070 con 0x7f346c15dbb0 2023-10-06T03:27:20.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.120+0000 7f3461ffb700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3450066f30 0x7f34500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.120+0000 7f3461ffb700 1 -- 172.21.15.84:0/674093679 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f3464087300 con 0x7f346c15dbb0 2023-10-06T03:27:20.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.120+0000 7f347196c700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3450066f30 0x7f34500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.120+0000 7f347196c700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3450066f30 0x7f34500693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3468009d80 tx=0x7f3468008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:20.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.124+0000 7f3461ffb700 1 -- 172.21.15.84:0/674093679 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3464054220 con 0x7f346c15dbb0 2023-10-06T03:27:20.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.352+0000 7f3473bd0700 1 -- 172.21.15.84:0/674093679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f346c04c3c0 con 0x7f346c15dbb0 2023-10-06T03:27:20.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.352+0000 7f3461ffb700 1 -- 172.21.15.84:0/674093679 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f3464057840 con 0x7f346c15dbb0 2023-10-06T03:27:20.353 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:20.353 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3912722771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3912722771},{"type":"v1","addr":"172.21.15.131:6833","nonce":3912722771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6382,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4017009844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4017009844},{"type":"v1","addr":"172.21.15.131:6835","nonce":4017009844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3193918731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3193918731},{"type":"v1","addr":"172.21.15.84:6835","nonce":3193918731}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:19.371941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7167":{"gid":7167,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/573778757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":573778757},{"type":"v1","addr":"172.21.15.84:6837","nonce":573778757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:20.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 -- 172.21.15.84:0/674093679 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3450066f30 msgr2=0x7f34500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3450066f30 0x7f34500693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3468009d80 tx=0x7f3468008040 comp rx=0 tx=0).stop 2023-10-06T03:27:20.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 -- 172.21.15.84:0/674093679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15dbb0 msgr2=0x7f346c158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15dbb0 0x7f346c158820 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f346c15e4f0 tx=0x7f3464019000 comp rx=0 tx=0).stop 2023-10-06T03:27:20.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 -- 172.21.15.84:0/674093679 shutdown_connections 2023-10-06T03:27:20.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3450066f30 0x7f34500693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f346c15dbb0 0x7f346c158820 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f346c06c6a0 0x7f346c0c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 --2- 172.21.15.84:0/674093679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346c06ca70 0x7f346c0c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 -- 172.21.15.84:0/674093679 >> 172.21.15.84:0/674093679 conn(0x7f346c06dfd0 msgr2=0x7f346c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:20.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 -- 172.21.15.84:0/674093679 shutdown_connections 2023-10-06T03:27:20.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.354+0000 7f3473bd0700 1 -- 172.21.15.84:0/674093679 wait complete. 2023-10-06T03:27:20.357 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 62 2023-10-06T03:27:20.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:27:05.838700+0000', 'modified': '2023-10-06T03:27:19.371941+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7167': {'gid': 7167, 'name': 'c', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.84:6837/573778757', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 573778757}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 573778757}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:27:20.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:27:20.770 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:27:20.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.887+0000 7f0a5ed41700 1 Processor -- start 2023-10-06T03:27:20.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.887+0000 7f0a5ed41700 1 -- start start 2023-10-06T03:27:20.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5ed41700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a580cb840 0x7f0a5815da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5ed41700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a581539d0 0x7f0a581599f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5ed41700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a58159f30 con 0x7f0a58153600 2023-10-06T03:27:20.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5ed41700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5815aa30 con 0x7f0a580cb840 2023-10-06T03:27:20.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5ed41700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58153e70 con 0x7f0a581539d0 2023-10-06T03:27:20.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5dd3f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0a58153600 0x7f0a580cb130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58168/0 (socket says 172.21.15.84:58168) 2023-10-06T03:27:20.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5dd3f700 1 -- 172.21.15.84:0/1953669573 learned_addr learned my addr 172.21.15.84:0/1953669573 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:20.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5e540700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a581539d0 0x7f0a581599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132262396 0 0) 0x7f0a58159f30 con 0x7f0a58153600 2023-10-06T03:27:20.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a44003570 con 0x7f0a58153600 2023-10-06T03:27:20.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.888+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/1953669573 >> v2:172.21.15.131:3300/0 conn(0x7f0a580cb840 0x7f0a5815da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442551487 0 0) 0x7f0a44003570 con 0x7f0a58153600 2023-10-06T03:27:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a581539d0 msgr2=0x7f0a581599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a581539d0 0x7f0a581599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 >> v2:172.21.15.131:3300/0 conn(0x7f0a580cb840 msgr2=0x7f0a5815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 --2- 172.21.15.84:0/1953669573 >> v2:172.21.15.131:3300/0 conn(0x7f0a580cb840 0x7f0a5815da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5815a190 con 0x7f0a58153600 2023-10-06T03:27:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f0a540017f0 con 0x7f0a58153600 2023-10-06T03:27:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 >> v1:172.21.15.84:6789/0 conn(0x7f0a58153600 legacy=0x7f0a580cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a44003a60 0x7f0a44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a581539d0 0x7f0a44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a44004d50 0x7f0a440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5815aa30 con 0x7f0a44004d50 2023-10-06T03:27:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58153e70 con 0x7f0a44003a60 2023-10-06T03:27:20.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4400bae0 con 0x7f0a581539d0 2023-10-06T03:27:20.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/1953669573 >> v2:172.21.15.131:3300/0 conn(0x7f0a580cb840 0x7f0a5815da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:20.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5e540700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a44004d50 0x7f0a440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a44003a60 0x7f0a44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a581539d0 0x7f0a44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5e540700 1 -- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a581539d0 msgr2=0x7f0a44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5e540700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a581539d0 0x7f0a44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5e540700 1 -- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a44003a60 msgr2=0x7f0a44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5e540700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a44003a60 0x7f0a44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5e540700 1 -- 172.21.15.84:0/1953669573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a44003570 con 0x7f0a44004d50 2023-10-06T03:27:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5e540700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a44004d50 0x7f0a440051c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009c00 tx=0x7f0a500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c1e2ad090b5f43 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.889+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000e710 con 0x7f0a44004d50 2023-10-06T03:27:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.890+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5000e870 con 0x7f0a44004d50 2023-10-06T03:27:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.890+0000 7f0a5cd3d700 1 -- 172.21.15.84:0/1953669573 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000ec30 con 0x7f0a44004d50 2023-10-06T03:27:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.890+0000 7f0a5ed41700 1 -- 172.21.15.84:0/1953669573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a44004d50 msgr2=0x7f0a440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.890+0000 7f0a5ed41700 1 --2- 172.21.15.84:0/1953669573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a44004d50 0x7f0a440051c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009c00 tx=0x7f0a500091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.890+0000 7f0a5e540700 1 -- 172.21.15.84:0/1953669573 reap_dead start 2023-10-06T03:27:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.890+0000 7f0a5ed41700 1 -- 172.21.15.84:0/1953669573 shutdown_connections 2023-10-06T03:27:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.890+0000 7f0a5ed41700 1 -- 172.21.15.84:0/1953669573 >> 172.21.15.84:0/1953669573 conn(0x7f0a5806ede0 msgr2=0x7f0a5806f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.890+0000 7f0a5ed41700 1 -- 172.21.15.84:0/1953669573 shutdown_connections 2023-10-06T03:27:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.890+0000 7f0a5ed41700 1 -- 172.21.15.84:0/1953669573 wait complete. 2023-10-06T03:27:20.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.891+0000 7f0a5ed41700 1 Processor -- start 2023-10-06T03:27:20.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.891+0000 7f0a5ed41700 1 -- start start 2023-10-06T03:27:20.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5ed41700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a44004d50 0x7f0a580b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5ed41700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a5816d9d0 0x7f0a5815cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5ed41700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a5814d7d0 0x7f0a580b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5ed41700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5815d080 con 0x7f0a5814d7d0 2023-10-06T03:27:20.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5ed41700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5816cf80 con 0x7f0a44004d50 2023-10-06T03:27:20.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5ed41700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5816d540 con 0x7f0a5816d9d0 2023-10-06T03:27:20.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5e540700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a5814d7d0 0x7f0a580b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5e540700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a5814d7d0 0x7f0a580b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38000/0 (socket says 172.21.15.84:38000) 2023-10-06T03:27:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5e540700 1 -- 172.21.15.84:0/3941100983 learned_addr learned my addr 172.21.15.84:0/3941100983 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a44004d50 0x7f0a580b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a5816d9d0 0x7f0a5815cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5e540700 1 -- 172.21.15.84:0/3941100983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a5816d9d0 msgr2=0x7f0a5815cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5e540700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a5816d9d0 0x7f0a5815cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5e540700 1 -- 172.21.15.84:0/3941100983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a44004d50 msgr2=0x7f0a580b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5e540700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a44004d50 0x7f0a580b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5e540700 1 -- 172.21.15.84:0/3941100983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5816de40 con 0x7f0a5814d7d0 2023-10-06T03:27:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a44004d50 0x7f0a580b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.892+0000 7f0a5e540700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a5814d7d0 0x7f0a580b5810 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f0a50016000 tx=0x7f0a5001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.893+0000 7f0a4dffb700 1 -- 172.21.15.84:0/3941100983 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50022070 con 0x7f0a5814d7d0 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.893+0000 7f0a4dffb700 1 -- 172.21.15.84:0/3941100983 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5000ebf0 con 0x7f0a5814d7d0 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.893+0000 7f0a5ed41700 1 -- 172.21.15.84:0/3941100983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5815d2c0 con 0x7f0a5814d7d0 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.893+0000 7f0a4dffb700 1 -- 172.21.15.84:0/3941100983 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000e710 con 0x7f0a5814d7d0 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.893+0000 7f0a5ed41700 1 -- 172.21.15.84:0/3941100983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5816d1d0 con 0x7f0a5814d7d0 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.894+0000 7f0a4dffb700 1 -- 172.21.15.84:0/3941100983 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a50027940 con 0x7f0a5814d7d0 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.895+0000 7f0a4dffb700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a3c066f30 0x7f0a3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.895+0000 7f0a4dffb700 1 -- 172.21.15.84:0/3941100983 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f0a50000e40 con 0x7f0a5814d7d0 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.895+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a3c066f30 0x7f0a3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.895+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a3c066f30 0x7f0a3c0693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0a540013d0 tx=0x7f0a54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a6929bb80 1 Processor -- start 2023-10-06T03:27:20.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a6929bb80 1 -- start start 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c64e50 0x560540c3fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c40200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c46a10 0x560540c40740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560540b9aa70 con 0x560540c452c0 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560540b98270 con 0x560540c64e50 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560540b94060 con 0x560540c46a10 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a5d53e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c40200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a5d53e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c40200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38004/0 (socket says 172.21.15.84:38004) 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.897+0000 7f0a5d53e700 1 -- 172.21.15.84:0/3375994266 learned_addr learned my addr 172.21.15.84:0/3375994266 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/3375994266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c64e50 0x560540c3fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a5e540700 1 --2- 172.21.15.84:0/3375994266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c46a10 0x560540c40740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a5d53e700 1 -- 172.21.15.84:0/3375994266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c46a10 msgr2=0x560540c40740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/3375994266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c46a10 0x560540c40740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a5d53e700 1 -- 172.21.15.84:0/3375994266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c64e50 msgr2=0x560540c3fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/3375994266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c64e50 0x560540c3fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a5d53e700 1 -- 172.21.15.84:0/3375994266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560540a2e270 con 0x560540c452c0 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/3375994266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c40200 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009c40 tx=0x7f0a4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d03c8cfb2e6555 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a42ffd700 1 -- 172.21.15.84:0/3375994266 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a480138a0 con 0x560540c452c0 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a42ffd700 1 -- 172.21.15.84:0/3375994266 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a48013a00 con 0x560540c452c0 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.898+0000 7f0a42ffd700 1 -- 172.21.15.84:0/3375994266 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48013da0 con 0x560540c452c0 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3375994266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 msgr2=0x560540c40200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/3375994266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c40200 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009c40 tx=0x7f0a4800b040 comp rx=0 tx=0).stop 2023-10-06T03:27:20.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3375994266 shutdown_connections 2023-10-06T03:27:20.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/3375994266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c64e50 0x560540c3fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/3375994266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c46a10 0x560540c40740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/3375994266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c40200 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3375994266 >> 172.21.15.84:0/3375994266 conn(0x560540c44e80 msgr2=0x560540c456b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:20.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3375994266 shutdown_connections 2023-10-06T03:27:20.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3375994266 wait complete. 2023-10-06T03:27:20.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 -- start start 2023-10-06T03:27:20.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.899+0000 7f0a6929bb80 1 Processor -- start 2023-10-06T03:27:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.900+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c452c0 0x560540c9ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.900+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c46a10 0x560540c9a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.900+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c64e50 0x560540c9a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.900+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560540b3f890 con 0x560540c64e50 2023-10-06T03:27:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.900+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560540b5aea0 con 0x560540c452c0 2023-10-06T03:27:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.900+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560540a16e30 con 0x560540c46a10 2023-10-06T03:27:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.900+0000 7f0a6929bb80 10 client.0 _ll_register_callbacks cb 0x560540c07020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:27:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.900+0000 7f0a5e540700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c64e50 0x560540c9a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.900+0000 7f0a5e540700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c64e50 0x560540c9a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38006/0 (socket says 172.21.15.84:38006) 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.900+0000 7f0a5e540700 1 -- 172.21.15.84:0/3770346404 learned_addr learned my addr 172.21.15.84:0/3770346404 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c452c0 0x560540c9ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c46a10 0x560540c9a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a5e540700 1 -- 172.21.15.84:0/3770346404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c46a10 msgr2=0x560540c9a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a5e540700 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c46a10 0x560540c9a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a5e540700 1 -- 172.21.15.84:0/3770346404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c452c0 msgr2=0x560540c9ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a5e540700 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c452c0 0x560540c9ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a5e540700 1 -- 172.21.15.84:0/3770346404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a48009920 con 0x560540c64e50 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c452c0 0x560540c9ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a5e540700 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c64e50 0x560540c9a720 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000ed60 tx=0x7f0a50083eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f94d7930b578fa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a37fff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:27:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a37fff700 1 -- 172.21.15.84:0/3770346404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a500569e0 con 0x560540c64e50 2023-10-06T03:27:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a37fff700 1 -- 172.21.15.84:0/3770346404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f0a50059bb0 con 0x560540c64e50 2023-10-06T03:27:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3770346404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560540c38940 con 0x560540c64e50 2023-10-06T03:27:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a37fff700 1 -- 172.21.15.84:0/3770346404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a5005d900 con 0x560540c64e50 2023-10-06T03:27:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a6929bb80 10 client.7203 fetch_fsmap learned FSMap version 62 2023-10-06T03:27:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3770346404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x5605409d0fe0 con 0x560540c64e50 2023-10-06T03:27:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a37fff700 1 -- 172.21.15.84:0/3770346404 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560540c38940 con 0x560540c64e50 2023-10-06T03:27:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a37fff700 1 -- 172.21.15.84:0/3770346404 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a50055e50 con 0x560540c64e50 2023-10-06T03:27:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a6929bb80 10 client.7203 fetch_fsmap finished waiting for FSMap version 62 2023-10-06T03:27:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a6929bb80 10 client.7203 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:27:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a6929bb80 20 client.7203 populate_metadata read hostname 'smithi084' 2023-10-06T03:27:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x560540c8aa10 0x560540c8ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a6929bb80 4 client.7203 mds_command: new command op to 7167 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:27:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3770346404 --> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560540c15870 con 0x560540c8aa10 2023-10-06T03:27:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.901+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x560540c8aa10 0x560540c8ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a37fff700 10 client.7203 ms_handle_connect on v2:172.21.15.84:6836/573778757 2023-10-06T03:27:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x560540c8aa10 0x560540c8ade0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=722ce809fbb9ee40 server_cookie=395558a23f078495 in_seq=0 out_seq=0 2023-10-06T03:27:20.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a37fff700 1 -- 172.21.15.84:0/3770346404 <== mds.0 v2:172.21.15.84:6836/573778757 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560540c15870 con 0x560540c8aa10 2023-10-06T03:27:20.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a37fff700 10 client.7203 handle_command_reply: tid=0 2023-10-06T03:27:20.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a6929bb80 1 client.7203 shutdown 2023-10-06T03:27:20.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3770346404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c64e50 msgr2=0x560540c9a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c64e50 0x560540c9a720 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000ed60 tx=0x7f0a50083eb0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3770346404 shutdown_connections 2023-10-06T03:27:20.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x560540c8aa10 0x560540c8ade0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c452c0 0x560540c9ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c64e50 0x560540c9a720 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/3770346404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c46a10 0x560540c9a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.902+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3770346404 >> 172.21.15.84:0/3770346404 conn(0x560540c44e80 msgr2=0x560540c45d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:20.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.903+0000 7f0a37fff700 0 client.7203 ms_handle_reset on v2:172.21.15.84:6836/573778757 2023-10-06T03:27:20.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.903+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3770346404 shutdown_connections 2023-10-06T03:27:20.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.903+0000 7f0a6929bb80 1 -- 172.21.15.84:0/3770346404 wait complete. 2023-10-06T03:27:20.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.903+0000 7f0a6929bb80 20 client.7203 trim_cache size 0 max 16384 2023-10-06T03:27:20.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.919+0000 7f0a6929bb80 1 Processor -- start 2023-10-06T03:27:20.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.919+0000 7f0a6929bb80 1 -- start start 2023-10-06T03:27:20.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c8e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c46a10 0x560540c8eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c64e50 0x560540c65220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560540c9dd10 con 0x560540c452c0 2023-10-06T03:27:20.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560540c46550 con 0x560540c46a10 2023-10-06T03:27:20.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560540c647e0 con 0x560540c64e50 2023-10-06T03:27:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a5dd3f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c8e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a5dd3f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c8e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38014/0 (socket says 172.21.15.84:38014) 2023-10-06T03:27:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a5dd3f700 1 -- 172.21.15.84:0/149564455 learned_addr learned my addr 172.21.15.84:0/149564455 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a5e540700 1 --2- 172.21.15.84:0/149564455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c64e50 0x560540c65220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/149564455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c46a10 0x560540c8eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a5dd3f700 1 -- 172.21.15.84:0/149564455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c64e50 msgr2=0x560540c65220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/149564455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c64e50 0x560540c65220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a5dd3f700 1 -- 172.21.15.84:0/149564455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c46a10 msgr2=0x560540c8eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/149564455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c46a10 0x560540c8eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.920+0000 7f0a5dd3f700 1 -- 172.21.15.84:0/149564455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560540b62780 con 0x560540c452c0 2023-10-06T03:27:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/149564455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c8e660 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f0a580ccf30 tx=0x7f0a54019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7067a60d87f0a3f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a437fe700 1 -- 172.21.15.84:0/149564455 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54027540 con 0x560540c452c0 2023-10-06T03:27:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a437fe700 1 -- 172.21.15.84:0/149564455 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a540276a0 con 0x560540c452c0 2023-10-06T03:27:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a437fe700 1 -- 172.21.15.84:0/149564455 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54027810 con 0x560540c452c0 2023-10-06T03:27:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a6929bb80 1 -- 172.21.15.84:0/149564455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 msgr2=0x560540c8e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/149564455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c8e660 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f0a580ccf30 tx=0x7f0a54019040 comp rx=0 tx=0).stop 2023-10-06T03:27:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a6929bb80 1 -- 172.21.15.84:0/149564455 shutdown_connections 2023-10-06T03:27:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/149564455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c64e50 0x560540c65220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/149564455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c452c0 0x560540c8e660 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/149564455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c46a10 0x560540c8eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a6929bb80 1 -- 172.21.15.84:0/149564455 >> 172.21.15.84:0/149564455 conn(0x560540c44e80 msgr2=0x560540c41ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a6929bb80 1 -- 172.21.15.84:0/149564455 shutdown_connections 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.921+0000 7f0a6929bb80 1 -- 172.21.15.84:0/149564455 wait complete. 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.922+0000 7f0a6929bb80 1 -- start start 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.922+0000 7f0a6929bb80 1 Processor -- start 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c452c0 0x560540c8e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c46a10 0x560540c8eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a6929bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c64e50 0x560540c65220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560540ce6200 con 0x560540c46a10 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560540cef2f0 con 0x560540c64e50 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a6929bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560540c8a9a0 con 0x560540c452c0 2023-10-06T03:27:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a6929bb80 10 client.0 _ll_register_callbacks cb 0x560540c07020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5d53e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c46a10 0x560540c8eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5d53e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c46a10 0x560540c8eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38022/0 (socket says 172.21.15.84:38022) 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5d53e700 1 -- 172.21.15.84:0/2977121789 learned_addr learned my addr 172.21.15.84:0/2977121789 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c452c0 0x560540c8e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5e540700 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c64e50 0x560540c65220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5d53e700 1 -- 172.21.15.84:0/2977121789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c452c0 msgr2=0x560540c8e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c452c0 0x560540c8e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5d53e700 1 -- 172.21.15.84:0/2977121789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c64e50 msgr2=0x560540c65220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c64e50 0x560540c65220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5d53e700 1 -- 172.21.15.84:0/2977121789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5401f040 con 0x560540c46a10 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a5d53e700 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c46a10 0x560540c8eba0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f0a4801a000 tx=0x7f0a4801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b604d3081564e035 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.923+0000 7f0a37fff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a37fff700 1 -- 172.21.15.84:0/2977121789 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48009790 con 0x560540c46a10 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a37fff700 1 -- 172.21.15.84:0/2977121789 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f0a48005c10 con 0x560540c46a10 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a6929bb80 1 -- 172.21.15.84:0/2977121789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a48013a00 con 0x560540c46a10 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a37fff700 1 -- 172.21.15.84:0/2977121789 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a48016670 con 0x560540c46a10 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a6929bb80 10 client.7209 fetch_fsmap learned FSMap version 62 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a6929bb80 1 -- 172.21.15.84:0/2977121789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x560540b49470 con 0x560540c46a10 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a37fff700 1 -- 172.21.15.84:0/2977121789 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a48013a00 con 0x560540c46a10 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a37fff700 1 -- 172.21.15.84:0/2977121789 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a48016850 con 0x560540c46a10 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a6929bb80 10 client.7209 fetch_fsmap finished waiting for FSMap version 62 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a6929bb80 10 client.7209 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:27:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a6929bb80 20 client.7209 populate_metadata read hostname 'smithi084' 2023-10-06T03:27:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x560540c65760 0x560540c65b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a6929bb80 4 client.7209 mds_command: new command op to 7167 tid=0[{"prefix": "status"}] 2023-10-06T03:27:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a6929bb80 1 -- 172.21.15.84:0/2977121789 --> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560540b36e00 con 0x560540c65760 2023-10-06T03:27:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x560540c65760 0x560540c65b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a37fff700 10 client.7209 ms_handle_connect on v2:172.21.15.84:6836/573778757 2023-10-06T03:27:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.924+0000 7f0a5dd3f700 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x560540c65760 0x560540c65b30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1600dc92cd53e5b server_cookie=c918c47ccdb7e040 in_seq=0 out_seq=0 2023-10-06T03:27:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a37fff700 1 -- 172.21.15.84:0/2977121789 <== mds.0 v2:172.21.15.84:6836/573778757 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x560540b36e00 con 0x560540c65760 2023-10-06T03:27:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a37fff700 10 client.7209 handle_command_reply: tid=0 2023-10-06T03:27:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 client.7209 shutdown 2023-10-06T03:27:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 -- 172.21.15.84:0/2977121789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c46a10 msgr2=0x560540c8eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c46a10 0x560540c8eba0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f0a4801a000 tx=0x7f0a4801e000 comp rx=0 tx=0).stop 2023-10-06T03:27:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 -- 172.21.15.84:0/2977121789 shutdown_connections 2023-10-06T03:27:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x560540c65760 0x560540c65b30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560540c64e50 0x560540c65220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a37fff700 0 client.7209 ms_handle_reset on v2:172.21.15.84:6836/573778757 2023-10-06T03:27:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560540c452c0 0x560540c8e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 --2- 172.21.15.84:0/2977121789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560540c46a10 0x560540c8eba0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 -- 172.21.15.84:0/2977121789 >> 172.21.15.84:0/2977121789 conn(0x560540c44e80 msgr2=0x560540c9d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 -- 172.21.15.84:0/2977121789 shutdown_connections 2023-10-06T03:27:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 1 -- 172.21.15.84:0/2977121789 wait complete. 2023-10-06T03:27:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a6929bb80 20 client.7209 trim_cache size 0 max 16384 2023-10-06T03:27:20.938 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:27:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:27:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7167, 2023-10-06T03:27:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:27:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:27:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:27:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 4.5558552819999996, 2023-10-06T03:27:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 62, 2023-10-06T03:27:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 102, 2023-10-06T03:27:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 102, 2023-10-06T03:27:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 5.2786802499999999 2023-10-06T03:27:20.939 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a5ed41700 1 -- 172.21.15.84:0/3941100983 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a3c066f30 msgr2=0x7f0a3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.925+0000 7f0a5ed41700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a3c066f30 0x7f0a3c0693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0a540013d0 tx=0x7f0a54009040 comp rx=0 tx=0).stop 2023-10-06T03:27:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.926+0000 7f0a5ed41700 1 -- 172.21.15.84:0/3941100983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a5814d7d0 msgr2=0x7f0a580b5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.926+0000 7f0a5ed41700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a5814d7d0 0x7f0a580b5810 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f0a50016000 tx=0x7f0a5001a000 comp rx=0 tx=0).stop 2023-10-06T03:27:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.926+0000 7f0a5ed41700 1 -- 172.21.15.84:0/3941100983 shutdown_connections 2023-10-06T03:27:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.926+0000 7f0a5ed41700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f0a3c066f30 0x7f0a3c0693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.926+0000 7f0a5ed41700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a44004d50 0x7f0a580b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.926+0000 7f0a5ed41700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a5814d7d0 0x7f0a580b5810 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.926+0000 7f0a5ed41700 1 --2- 172.21.15.84:0/3941100983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a5816d9d0 0x7f0a5815cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.926+0000 7f0a5ed41700 1 -- 172.21.15.84:0/3941100983 >> 172.21.15.84:0/3941100983 conn(0x7f0a5806ede0 msgr2=0x7f0a580cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.926+0000 7f0a5ed41700 1 -- 172.21.15.84:0/3941100983 shutdown_connections 2023-10-06T03:27:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:20.926+0000 7f0a5ed41700 1 -- 172.21.15.84:0/3941100983 wait complete. 2023-10-06T03:27:20.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:27:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.054+0000 7fa6db2d1700 1 Processor -- start 2023-10-06T03:27:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.054+0000 7fa6db2d1700 1 -- start start 2023-10-06T03:27:21.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6db2d1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6d40cbdb0 0x7fa6d40cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:21.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6db2d1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6d40af9f0 0x7fa6d406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:21.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6db2d1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d40cc330 con 0x7fa6d40af620 2023-10-06T03:27:21.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6db2d1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d40cc610 con 0x7fa6d40cbdb0 2023-10-06T03:27:21.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6db2d1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40cc8f0 con 0x7fa6d40af9f0 2023-10-06T03:27:21.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6d906d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa6d40af620 0x7fa6d40cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58170/0 (socket says 172.21.15.84:58170) 2023-10-06T03:27:21.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6d906d700 1 -- 172.21.15.84:0/2135483840 learned_addr learned my addr 172.21.15.84:0/2135483840 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:21.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815738448 0 0) 0x7fa6d40cc330 con 0x7fa6d40af620 2023-10-06T03:27:21.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6d986e700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6d40af9f0 0x7fa6d406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:21.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c0003570 con 0x7fa6d40af620 2023-10-06T03:27:21.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.055+0000 7fa6d886c700 1 --2- 172.21.15.84:0/2135483840 >> v2:172.21.15.131:3300/0 conn(0x7fa6d40cbdb0 0x7fa6d40cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:21.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 690769389 0 0) 0x7fa6c0003570 con 0x7fa6d40af620 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6d40af9f0 msgr2=0x7fa6d406d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6d40af9f0 0x7fa6d406d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 >> v2:172.21.15.131:3300/0 conn(0x7fa6d40cbdb0 msgr2=0x7fa6d40cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 --2- 172.21.15.84:0/2135483840 >> v2:172.21.15.131:3300/0 conn(0x7fa6d40cbdb0 0x7fa6d40cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40ccbd0 con 0x7fa6d40af620 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fa6d00017f0 con 0x7fa6d40af620 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6d886c700 1 --2- 172.21.15.84:0/2135483840 >> v2:172.21.15.131:3300/0 conn(0x7fa6d40cbdb0 0x7fa6d40cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 >> v1:172.21.15.84:6789/0 conn(0x7fa6d40af620 legacy=0x7fa6d40cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6c0003a60 0x7fa6c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c0004810 0x7fa6c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6d40af9f0 0x7fa6c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40cc610 con 0x7fa6c0003a60 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40cc8f0 con 0x7fa6c0004810 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c000bb10 con 0x7fa6d40af9f0 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6d906d700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6c0003a60 0x7fa6c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6d886c700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c0004810 0x7fa6c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6d986e700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6d40af9f0 0x7fa6c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6d906d700 1 -- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6d40af9f0 msgr2=0x7fa6c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6d906d700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6d40af9f0 0x7fa6c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6d906d700 1 -- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c0004810 msgr2=0x7fa6c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6d906d700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c0004810 0x7fa6c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6d906d700 1 -- 172.21.15.84:0/2135483840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0003570 con 0x7fa6c0003a60 2023-10-06T03:27:21.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6d906d700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6c0003a60 0x7fa6c0003e70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a970 tx=0x7fa6d0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d84264867f53ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.056+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0012440 con 0x7fa6c0003a60 2023-10-06T03:27:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.057+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d00125c0 con 0x7fa6c0003a60 2023-10-06T03:27:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.057+0000 7fa6cbfff700 1 -- 172.21.15.84:0/2135483840 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0012980 con 0x7fa6c0003a60 2023-10-06T03:27:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.057+0000 7fa6db2d1700 1 -- 172.21.15.84:0/2135483840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6c0003a60 msgr2=0x7fa6c0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.057+0000 7fa6db2d1700 1 --2- 172.21.15.84:0/2135483840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6c0003a60 0x7fa6c0003e70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a970 tx=0x7fa6d0002210 comp rx=0 tx=0).stop 2023-10-06T03:27:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.057+0000 7fa6d986e700 1 -- 172.21.15.84:0/2135483840 reap_dead start 2023-10-06T03:27:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.057+0000 7fa6db2d1700 1 -- 172.21.15.84:0/2135483840 shutdown_connections 2023-10-06T03:27:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.057+0000 7fa6db2d1700 1 -- 172.21.15.84:0/2135483840 >> 172.21.15.84:0/2135483840 conn(0x7fa6d406c450 msgr2=0x7fa6d406c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.057+0000 7fa6db2d1700 1 -- 172.21.15.84:0/2135483840 shutdown_connections 2023-10-06T03:27:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.057+0000 7fa6db2d1700 1 -- 172.21.15.84:0/2135483840 wait complete. 2023-10-06T03:27:21.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.058+0000 7fa6db2d1700 1 Processor -- start 2023-10-06T03:27:21.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.058+0000 7fa6db2d1700 1 -- start start 2023-10-06T03:27:21.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6db2d1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c0003a60 0x7fa6d40c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:21.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6db2d1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6d41503f0 0x7fa6d40c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:21.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6db2d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d40c63a0 0x7fa6d40c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:21.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6db2d1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40c6d50 con 0x7fa6d40c63a0 2023-10-06T03:27:21.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6db2d1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40c87d0 con 0x7fa6d41503f0 2023-10-06T03:27:21.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6db2d1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40c9740 con 0x7fa6c0003a60 2023-10-06T03:27:21.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d986e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d40c63a0 0x7fa6d40c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:21.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d986e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d40c63a0 0x7fa6d40c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38046/0 (socket says 172.21.15.84:38046) 2023-10-06T03:27:21.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d986e700 1 -- 172.21.15.84:0/1355936113 learned_addr learned my addr 172.21.15.84:0/1355936113 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:21.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d906d700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c0003a60 0x7fa6d40c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:21.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d886c700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6d41503f0 0x7fa6d40c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:21.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d986e700 1 -- 172.21.15.84:0/1355936113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c0003a60 msgr2=0x7fa6d40c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:21.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d986e700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c0003a60 0x7fa6d40c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d986e700 1 -- 172.21.15.84:0/1355936113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6d41503f0 msgr2=0x7fa6d40c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:21.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d986e700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6d41503f0 0x7fa6d40c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d986e700 1 -- 172.21.15.84:0/1355936113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40c7bc0 con 0x7fa6d40c63a0 2023-10-06T03:27:21.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.059+0000 7fa6d886c700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6d41503f0 0x7fa6d40c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:21.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.060+0000 7fa6d986e700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d40c63a0 0x7fa6d40c6810 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4089730 tx=0x7fa6cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:21.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.060+0000 7fa6c97fa700 1 -- 172.21.15.84:0/1355936113 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc013680 con 0x7fa6d40c63a0 2023-10-06T03:27:21.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.060+0000 7fa6c97fa700 1 -- 172.21.15.84:0/1355936113 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc0137e0 con 0x7fa6d40c63a0 2023-10-06T03:27:21.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.060+0000 7fa6db2d1700 1 -- 172.21.15.84:0/1355936113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d40c7ea0 con 0x7fa6d40c63a0 2023-10-06T03:27:21.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.060+0000 7fa6c97fa700 1 -- 172.21.15.84:0/1355936113 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc013b60 con 0x7fa6d40c63a0 2023-10-06T03:27:21.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.060+0000 7fa6db2d1700 1 -- 172.21.15.84:0/1355936113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d40c8460 con 0x7fa6d40c63a0 2023-10-06T03:27:21.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.061+0000 7fa6db2d1700 1 -- 172.21.15.84:0/1355936113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d40ce060 con 0x7fa6d40c63a0 2023-10-06T03:27:21.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.061+0000 7fa6c97fa700 1 -- 172.21.15.84:0/1355936113 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6cc014440 con 0x7fa6d40c63a0 2023-10-06T03:27:21.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.061+0000 7fa6c97fa700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6b8066f30 0x7fa6b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:21.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.061+0000 7fa6c97fa700 1 -- 172.21.15.84:0/1355936113 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fa6cc084d60 con 0x7fa6d40c63a0 2023-10-06T03:27:21.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.062+0000 7fa6d906d700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6b8066f30 0x7fa6b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:21.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.062+0000 7fa6d906d700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6b8066f30 0x7fa6b80693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a430 tx=0x7fa6d0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:21.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.066+0000 7fa6c97fa700 1 -- 172.21.15.84:0/1355936113 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6cc051d00 con 0x7fa6d40c63a0 2023-10-06T03:27:21.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.291+0000 7fa6db2d1700 1 -- 172.21.15.84:0/1355936113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa6d404c3c0 con 0x7fa6d40c63a0 2023-10-06T03:27:21.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.291+0000 7fa6c97fa700 1 -- 172.21.15.84:0/1355936113 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa6cc022070 con 0x7fa6d40c63a0 2023-10-06T03:27:21.292 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:27:21.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 -- 172.21.15.84:0/1355936113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6b8066f30 msgr2=0x7fa6b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6b8066f30 0x7fa6b80693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a430 tx=0x7fa6d0015000 comp rx=0 tx=0).stop 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 -- 172.21.15.84:0/1355936113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d40c63a0 msgr2=0x7fa6d40c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d40c63a0 0x7fa6d40c6810 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4089730 tx=0x7fa6cc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 -- 172.21.15.84:0/1355936113 shutdown_connections 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6b8066f30 0x7fa6b80693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d40c63a0 0x7fa6d40c6810 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c0003a60 0x7fa6d40c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 --2- 172.21.15.84:0/1355936113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6d41503f0 0x7fa6d40c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 -- 172.21.15.84:0/1355936113 >> 172.21.15.84:0/1355936113 conn(0x7fa6d406c450 msgr2=0x7fa6d40cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 -- 172.21.15.84:0/1355936113 shutdown_connections 2023-10-06T03:27:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:21.293+0000 7fa6db2d1700 1 -- 172.21.15.84:0/1355936113 wait complete. 2023-10-06T03:27:21.306 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:27:21.306 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:27:21.306 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:27:21.306 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:27:21.306 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:27:21.306 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:27:21.306 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:27:21.306 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:27:21.306 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:27:21.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:21.307 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:27:21.322 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:27:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:27:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:27:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:27:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:21.322 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42313sec preferred_lft 42313sec 2023-10-06T03:27:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9c01:bbff:fec1:72ce/64 scope link 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 76:a6:25:2a:c6:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::74a6:25ff:fe2a:c673/64 scope link 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:21.324 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:27:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether de:34:c5:3f:21:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:27:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc34:c5ff:fe3f:21c3/64 scope link 2023-10-06T03:27:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:21.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:21.325 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:27:21.369 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T03:27:21.368+0000 7f03c463f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:27:21.388 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:27:21.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:21.389 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:27:21.446 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:27:21.446 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:27:21.446 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:27:21.446 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:27:21.446 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:27:21.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:21.447 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:27:21.447 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:27:21.447 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:27:21.447 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:27:21.447 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:27:21.447 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:27:21.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:21.547 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:27:21.562 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:27:21.563 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:27:21.563 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:27:21.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:21.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:27:21.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-06T03:27:21.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-06T03:27:21.629 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:27:21.630 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:27:21.686 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:27:21.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:27:21.687 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:27:21.744 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:27:21.744 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:27:21.744 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:21.824 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:21.824 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:21.843 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:21.843 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:21.843 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:27:21.843 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:27:21.843 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:27:21.843 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:27:21.843 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:27:21.844 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:27:21.865 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:21.865 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:21.865 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:27:21.865 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:27:21.866 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:27:21.866 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:27:21.866 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:27:21.866 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:27:21.866 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:27:21.866 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:27:21.866 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:27:21.868 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:27:21.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:21.868 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:27:21.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:27:22.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.090+0000 7f5108d38700 1 Processor -- start 2023-10-06T03:27:22.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.090+0000 7f5108d38700 1 -- start start 2023-10-06T03:27:22.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f5108d38700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f51040b3760 0x7f51040b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:22.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f5108d38700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51040b6380 0x7f510415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:22.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f5108d38700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51040b4480 con 0x7f51040b2b40 2023-10-06T03:27:22.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f5108d38700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51040b4760 con 0x7f51040b6380 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f5108d38700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51040b4a40 con 0x7f51040b3760 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f50f9d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51040b6380 0x7f510415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f5102d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f51040b2b40 0x7f51040b1120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58178/0 (socket says 172.21.15.84:58178) 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f5102d9d700 1 -- 172.21.15.84:0/2689106443 learned_addr learned my addr 172.21.15.84:0/2689106443 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f510259c700 1 --2- 172.21.15.84:0/2689106443 >> v2:172.21.15.131:3300/0 conn(0x7f51040b3760 0x7f51040b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f50f9d9b700 1 -- 172.21.15.84:0/2689106443 >> v2:172.21.15.131:3300/0 conn(0x7f51040b3760 msgr2=0x7f51040b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.091+0000 7f50f9d9b700 1 --2- 172.21.15.84:0/2689106443 >> v2:172.21.15.131:3300/0 conn(0x7f51040b3760 0x7f51040b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f50f9d9b700 1 -- 172.21.15.84:0/2689106443 >> v1:172.21.15.84:6789/0 conn(0x7f51040b2b40 legacy=0x7f51040b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f50f9d9b700 1 -- 172.21.15.84:0/2689106443 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510409a430 con 0x7f51040b6380 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5101d9b700 1 -- 172.21.15.84:0/2689106443 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707946787 0 0) 0x7f51040b4480 con 0x7f51040b2b40 2023-10-06T03:27:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f50f9d9b700 1 --2- 172.21.15.84:0/2689106443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b6380 0x7f510415cc70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0098e0 tx=0x7f50ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8ce7bc2f5342a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5101d9b700 1 -- 172.21.15.84:0/2689106443 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec009e80 con 0x7f51040b6380 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5101d9b700 1 -- 172.21.15.84:0/2689106443 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec00b820 con 0x7f51040b6380 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5101d9b700 1 -- 172.21.15.84:0/2689106443 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00bba0 con 0x7f51040b6380 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5108d38700 1 -- 172.21.15.84:0/2689106443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b6380 msgr2=0x7f510415cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5108d38700 1 --2- 172.21.15.84:0/2689106443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b6380 0x7f510415cc70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0098e0 tx=0x7f50ec0091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5108d38700 1 -- 172.21.15.84:0/2689106443 shutdown_connections 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5108d38700 1 --2- 172.21.15.84:0/2689106443 >> v2:172.21.15.131:3300/0 conn(0x7f51040b3760 0x7f51040b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5108d38700 1 --2- 172.21.15.84:0/2689106443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b6380 0x7f510415cc70 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5108d38700 1 -- 172.21.15.84:0/2689106443 >> 172.21.15.84:0/2689106443 conn(0x7f510406cc30 msgr2=0x7f51040d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5108d38700 1 -- 172.21.15.84:0/2689106443 shutdown_connections 2023-10-06T03:27:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.092+0000 7f5108d38700 1 -- 172.21.15.84:0/2689106443 wait complete. 2023-10-06T03:27:22.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f5108d38700 1 Processor -- start 2023-10-06T03:27:22.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f5108d38700 1 -- start start 2023-10-06T03:27:22.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f5108d38700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51040b2b40 0x7f5104145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:22.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f5108d38700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b3760 0x7f5104153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:22.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f5108d38700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51040b6380 0x7f5104160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:22.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f5108d38700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5104157010 con 0x7f51040b3760 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f5108d38700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510415fcd0 con 0x7f51040b2b40 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f5108d38700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510415f6e0 con 0x7f51040b6380 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f50f9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b3760 0x7f5104153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f50f9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b3760 0x7f5104153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38064/0 (socket says 172.21.15.84:38064) 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.094+0000 7f50f9d9b700 1 -- 172.21.15.84:0/2127120144 learned_addr learned my addr 172.21.15.84:0/2127120144 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f5102d9d700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51040b6380 0x7f5104160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f510259c700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51040b2b40 0x7f5104145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f50f9d9b700 1 -- 172.21.15.84:0/2127120144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51040b6380 msgr2=0x7f5104160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f50f9d9b700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51040b6380 0x7f5104160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f50f9d9b700 1 -- 172.21.15.84:0/2127120144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51040b2b40 msgr2=0x7f5104145d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f50f9d9b700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51040b2b40 0x7f5104145d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f50f9d9b700 1 -- 172.21.15.84:0/2127120144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec009420 con 0x7f51040b3760 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f510259c700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51040b2b40 0x7f5104145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f50f9d9b700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b3760 0x7f5104153be0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f50ec013000 tx=0x7f50ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f50faffd700 1 -- 172.21.15.84:0/2127120144 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec01f070 con 0x7f51040b3760 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f50faffd700 1 -- 172.21.15.84:0/2127120144 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec000cc0 con 0x7f51040b3760 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f50faffd700 1 -- 172.21.15.84:0/2127120144 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00bba0 con 0x7f51040b3760 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f5108d38700 1 -- 172.21.15.84:0/2127120144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5104146270 con 0x7f51040b3760 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.095+0000 7f5108d38700 1 -- 172.21.15.84:0/2127120144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5104156d30 con 0x7f51040b3760 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.096+0000 7f5108d38700 1 -- 172.21.15.84:0/2127120144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510415fe60 con 0x7f51040b3760 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.096+0000 7f50faffd700 1 -- 172.21.15.84:0/2127120144 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50ec011880 con 0x7f51040b3760 2023-10-06T03:27:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.097+0000 7f50faffd700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f50e4066f60 0x7f50e4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:22.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.097+0000 7f50faffd700 1 -- 172.21.15.84:0/2127120144 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f50ec085d40 con 0x7f51040b3760 2023-10-06T03:27:22.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.097+0000 7f510259c700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f50e4066f60 0x7f50e4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:22.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.097+0000 7f510259c700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f50e4066f60 0x7f50e4069410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f50f4006fd0 tx=0x7f50f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:22.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.101+0000 7f50faffd700 1 -- 172.21.15.84:0/2127120144 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50ec052c60 con 0x7f51040b3760 2023-10-06T03:27:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.325+0000 7f5108d38700 1 -- 172.21.15.84:0/2127120144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f510404c3c0 con 0x7f51040b3760 2023-10-06T03:27:22.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.325+0000 7f50faffd700 1 -- 172.21.15.84:0/2127120144 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7f50ec015060 con 0x7f51040b3760 2023-10-06T03:27:22.326 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:27:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 -- 172.21.15.84:0/2127120144 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f50e4066f60 msgr2=0x7f50e4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f50e4066f60 0x7f50e4069410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f50f4006fd0 tx=0x7f50f4008040 comp rx=0 tx=0).stop 2023-10-06T03:27:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 -- 172.21.15.84:0/2127120144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b3760 msgr2=0x7f5104153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b3760 0x7f5104153be0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f50ec013000 tx=0x7f50ec017000 comp rx=0 tx=0).stop 2023-10-06T03:27:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 -- 172.21.15.84:0/2127120144 shutdown_connections 2023-10-06T03:27:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f50e4066f60 0x7f50e4069410 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51040b2b40 0x7f5104145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51040b6380 0x7f5104160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 --2- 172.21.15.84:0/2127120144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51040b3760 0x7f5104153be0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 -- 172.21.15.84:0/2127120144 >> 172.21.15.84:0/2127120144 conn(0x7f510406cc30 msgr2=0x7f510409cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 -- 172.21.15.84:0/2127120144 shutdown_connections 2023-10-06T03:27:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:22.327+0000 7f5108d38700 1 -- 172.21.15.84:0/2127120144 wait complete. 2023-10-06T03:27:22.340 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:27:22.340 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:27:22.341 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T03:27:22.341 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:27:22.341 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:27:22.341 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:27:22.342 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:27:22.342 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:27:22.342 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:27:22.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:22.343 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T03:27:22.365 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:27:22.365 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:27:22.365 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:27:22.366 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42311sec preferred_lft 42311sec 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::a0d2:65ff:fe0e:962d/64 scope link 2023-10-06T03:27:22.367 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:22.368 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:27:22.368 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether e6:c9:c5:59:18:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:27:22.368 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::e4c9:c5ff:fe59:18bb/64 scope link 2023-10-06T03:27:22.368 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:22.368 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:27:22.368 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:f1:c0:85:85:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:27:22.368 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4f1:c0ff:fe85:853d/64 scope link 2023-10-06T03:27:22.368 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:27:22.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:22.369 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:27:22.397 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T03:27:22.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:22.399 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T03:27:22.459 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T03:27:22.459 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:27:22.459 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:27:22.459 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:27:22.459 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:27:22.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:22.459 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T03:27:22.460 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T03:27:22.460 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:27:22.460 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:27:22.460 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:27:22.460 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T03:27:22.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:22.566 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:27:22.581 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:27:22.581 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:27:22.581 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:27:22.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:22.582 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-10-06T03:27:22.646 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:27:22.646 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:27:22.702 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:27:22.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:27:22.702 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:27:22.756 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T03:27:22.756 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:27:22.756 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:22.835 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:22.836 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:22.854 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:22.854 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:22.854 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:27:22.854 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:27:22.854 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:27:22.854 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:27:22.854 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:27:22.855 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:27:22.876 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:27:22.876 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:27:22.876 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:27:22.876 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with new device syntax: 1@3eb6b236-a9b2-4c6a-bc84-749d824186bc.cephfs=/ 2023-10-06T03:27:22.876 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-10-06T03:27:22.876 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T03:27:22.877 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T03:27:22.877 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:27:22.877 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:27:22.877 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:27:22.877 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3eb6b236-a9b2-4c6a-bc84-749d824186bc" will pass to kernel 2023-10-06T03:27:22.878 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:27:22.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:22.878 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:27:22.944 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-06T03:27:23.079 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":7227,"entity":{"name":{"type":"client","num":7227},"addr":{"type":"v1","addr":"172.21.15.131:0","nonce":2632269813}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":0.19899651099999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99955418253869011,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7227 v1:172.21.15.131:0/2632269813","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x0000000000007bff"},"metric_spec":{"metric_flags":{"feature_bits":"0x00000000000003ff"}},"entity_id":"1","hostname":"smithi131","kernel_version":"4.18.0-425.3.1.el8.x86_64","root":"/"}},{"id":6421,"entity":{"name":{"type":"client","num":6421},"addr":{"type":"v1","addr":"172.21.15.84:0","nonce":3493340953}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":1.2099787820000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99722208366679765,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6421 v1:172.21.15.84:0/3493340953","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x0000000000007bff"},"metric_spec":{"metric_flags":{"feature_bits":"0x00000000000003ff"}},"entity_id":"0","hostname":"smithi084","kernel_version":"4.18.0-425.3.1.el8.x86_64","root":"/"}}] 2023-10-06T03:27:23.080 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "entity_id": "1", "hostname": "smithi131", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.131:0", "nonce": 2632269813, "type": "v1" }, "name": { "num": 7227, "type": "client" } }, "id": 7227, "inst": "client.7227 v1:172.21.15.131:0/2632269813", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9995541825386901 }, "state": "open", "uptime": 0.198996511 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "entity_id": "0", "hostname": "smithi084", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3493340953, "type": "v1" }, "name": { "num": 6421, "type": "client" } }, "id": 6421, "inst": "client.6421 v1:172.21.15.84:0/3493340953", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9972220836667977 }, "state": "open", "uptime": 1.209978782 } ] 2023-10-06T03:27:23.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T03:27:23.225 INFO:teuthology.orchestra.run.smithi084.stdout:{"message":"","return_code":0} 2023-10-06T03:27:23.225 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T03:27:23.225 DEBUG:teuthology.orchestra.run.smithi084:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2023-10-06T03:27:23.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.259+0000 7f4172d65240 1 -- start start 2023-10-06T03:27:23.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.259+0000 7f4172d65240 1 Processor -- start 2023-10-06T03:27:23.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.259+0000 7f4172d65240 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370e400 0x55d0136f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.259+0000 7f4172d65240 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d01370e800 0x55d0136f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.259+0000 7f4172d65240 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370ec00 0x55d0136f5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.259+0000 7f4172d65240 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01297dcc0 con 0x55d01370ec00 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.259+0000 7f4172d65240 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01297d540 con 0x55d01370e400 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.259+0000 7f4172d65240 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d01297de00 con 0x55d01370e800 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ca34700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370ec00 0x55d0136f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ca34700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370ec00 0x55d0136f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38084/0 (socket says 172.21.15.84:38084) 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ca34700 1 -- 172.21.15.84:0/2386674686 learned_addr learned my addr 172.21.15.84:0/2386674686 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ba32700 1 --2- 172.21.15.84:0/2386674686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d01370e800 0x55d0136f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416c233700 1 --2- 172.21.15.84:0/2386674686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370e400 0x55d0136f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ca34700 1 -- 172.21.15.84:0/2386674686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d01370e800 msgr2=0x55d0136f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ca34700 1 --2- 172.21.15.84:0/2386674686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d01370e800 0x55d0136f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ca34700 1 -- 172.21.15.84:0/2386674686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370e400 msgr2=0x55d0136f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ca34700 1 --2- 172.21.15.84:0/2386674686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370e400 0x55d0136f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ca34700 1 -- 172.21.15.84:0/2386674686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d012960340 con 0x55d01370ec00 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ba32700 1 --2- 172.21.15.84:0/2386674686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d01370e800 0x55d0136f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f416ca34700 1 --2- 172.21.15.84:0/2386674686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370ec00 0x55d0136f5080 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x55d0136c9d70 tx=0x55d0136c6d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9aeb442f2c11f9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f4169a2e700 1 -- 172.21.15.84:0/2386674686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d012975600 con 0x55d01370ec00 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f4169a2e700 1 -- 172.21.15.84:0/2386674686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d012992600 con 0x55d01370ec00 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f4169a2e700 1 -- 172.21.15.84:0/2386674686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d0129751e0 con 0x55d01370ec00 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f4172d65240 1 -- 172.21.15.84:0/2386674686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d012960000 con 0x55d01370ec00 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f4172d65240 1 -- 172.21.15.84:0/2386674686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d012960ea0 con 0x55d01370ec00 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f4172d65240 4 waiting for MDS map... 2023-10-06T03:27:23.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f4169a2e700 1 -- 172.21.15.84:0/2386674686 <== mon.0 v2:172.21.15.84:3300/0 4 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x55d012980c40 con 0x55d01370ec00 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f4169a2e700 1 -- 172.21.15.84:0/2386674686 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x55d013724600 con 0x55d01370ec00 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f4172d65240 4 Got MDS map 62 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.260+0000 7f4172d65240 10 main: main 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.261+0000 7f4172d65240 4 main: connecting to RADOS... 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.261+0000 7f4172d65240 1 Processor -- start 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.261+0000 7f4172d65240 1 -- start start 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f4172d65240 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370f800 0x55d0136f5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f4172d65240 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370fc00 0x55d0136f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f4172d65240 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0137a4000 0x55d0136f6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f4172d65240 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01297db80 con 0x55d01370fc00 2023-10-06T03:27:23.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f4172d65240 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01297d540 con 0x55d01370f800 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f4172d65240 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d01297cdc0 con 0x55d0137a4000 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416c233700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370fc00 0x55d0136f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416c233700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370fc00 0x55d0136f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38088/0 (socket says 172.21.15.84:38088) 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416c233700 1 -- 172.21.15.84:0/3866592637 learned_addr learned my addr 172.21.15.84:0/3866592637 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416ba32700 1 --2- 172.21.15.84:0/3866592637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370f800 0x55d0136f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416c233700 1 -- 172.21.15.84:0/3866592637 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0137a4000 msgr2=0x55d0136f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416c233700 1 --2- 172.21.15.84:0/3866592637 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0137a4000 0x55d0136f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416c233700 1 -- 172.21.15.84:0/3866592637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370f800 msgr2=0x55d0136f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416c233700 1 --2- 172.21.15.84:0/3866592637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370f800 0x55d0136f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416c233700 1 -- 172.21.15.84:0/3866592637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d012961860 con 0x55d01370fc00 2023-10-06T03:27:23.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416ba32700 1 --2- 172.21.15.84:0/3866592637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370f800 0x55d0136f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f416c233700 1 --2- 172.21.15.84:0/3866592637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370fc00 0x55d0136f5b80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x55d0137410e0 tx=0x55d013704240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866e0e3c2d1b26c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f4167a2a700 1 -- 172.21.15.84:0/3866592637 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d012975080 con 0x55d01370fc00 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f4167a2a700 1 -- 172.21.15.84:0/3866592637 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d012992300 con 0x55d01370fc00 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.262+0000 7f4167a2a700 1 -- 172.21.15.84:0/3866592637 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d012975600 con 0x55d01370fc00 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 -- 172.21.15.84:0/3866592637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370fc00 msgr2=0x55d0136f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 --2- 172.21.15.84:0/3866592637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370fc00 0x55d0136f5b80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x55d0137410e0 tx=0x55d013704240 comp rx=0 tx=0).stop 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 -- 172.21.15.84:0/3866592637 shutdown_connections 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 --2- 172.21.15.84:0/3866592637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370f800 0x55d0136f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 --2- 172.21.15.84:0/3866592637 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0137a4000 0x55d0136f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 --2- 172.21.15.84:0/3866592637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370fc00 0x55d0136f5b80 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 -- 172.21.15.84:0/3866592637 >> 172.21.15.84:0/3866592637 conn(0x55d01370f000 msgr2=0x55d012a2d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 -- 172.21.15.84:0/3866592637 shutdown_connections 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 -- 172.21.15.84:0/3866592637 wait complete. 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 Processor -- start 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.263+0000 7f4172d65240 1 -- start start 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f4172d65240 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370fc00 0x55d0136f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f4172d65240 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370f800 0x55d0136f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f4172d65240 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d01370a000 0x55d0136f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f4172d65240 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01297c3c0 con 0x55d01370f800 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f4172d65240 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01297c000 con 0x55d01370fc00 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f4172d65240 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d01297d180 con 0x55d01370a000 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416c233700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370f800 0x55d0136f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416c233700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370f800 0x55d0136f6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38106/0 (socket says 172.21.15.84:38106) 2023-10-06T03:27:23.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416c233700 1 -- 172.21.15.84:0/1597075480 learned_addr learned my addr 172.21.15.84:0/1597075480 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:23.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416ba32700 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370fc00 0x55d0136f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416ba32700 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d01370a000 0x55d0136f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416c233700 1 -- 172.21.15.84:0/1597075480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d01370a000 msgr2=0x55d0136f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416c233700 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d01370a000 0x55d0136f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416c233700 1 -- 172.21.15.84:0/1597075480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370fc00 msgr2=0x55d0136f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416c233700 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370fc00 0x55d0136f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416c233700 1 -- 172.21.15.84:0/1597075480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0129609c0 con 0x55d01370f800 2023-10-06T03:27:23.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f416c233700 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370f800 0x55d0136f6680 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x55d013741380 tx=0x55d0137041e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:23.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f4166227700 1 -- 172.21.15.84:0/1597075480 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d0129751e0 con 0x55d01370f800 2023-10-06T03:27:23.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f4166227700 1 -- 172.21.15.84:0/1597075480 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d012992c00 con 0x55d01370f800 2023-10-06T03:27:23.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f4166227700 1 -- 172.21.15.84:0/1597075480 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d012974dc0 con 0x55d01370f800 2023-10-06T03:27:23.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.264+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d012961a00 con 0x55d01370f800 2023-10-06T03:27:23.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.265+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d012961860 con 0x55d01370f800 2023-10-06T03:27:23.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.265+0000 7f4172d65240 4 main: resolving pool 16 2023-10-06T03:27:23.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.266+0000 7f4166227700 1 -- 172.21.15.84:0/1597075480 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x55d0136b3080 con 0x55d01370f800 2023-10-06T03:27:23.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.266+0000 7f4166227700 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x55d01370c400 0x55d0136f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.266+0000 7f4166227700 1 -- 172.21.15.84:0/1597075480 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x55d012980a80 con 0x55d01370f800 2023-10-06T03:27:23.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.266+0000 7f4172d65240 4 main: creating IoCtx.. 2023-10-06T03:27:23.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.266+0000 7f416ba32700 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x55d01370c400 0x55d0136f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.266+0000 7f4172d65240 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x55d01370a400 0x55d0136f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.266+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 --> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] -- osd_op(unknown.0.0:1 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102) v8 -- 0x55d01370a800 con 0x55d01370a400 2023-10-06T03:27:23.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.266+0000 7f416ba32700 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x55d01370a400 0x55d0136f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.266+0000 7f416ba32700 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x55d01370c400 0x55d0136f7700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x55d0136c9350 tx=0x55d01374fec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:23.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.267+0000 7f416ba32700 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x55d01370a400 0x55d0136f5b80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:23.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.267+0000 7f416ba32700 1 -- 172.21.15.84:0/1597075480 <== osd.1 v2:172.21.15.84:6808/90663 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x55d01371afc0 con 0x55d01370a400 2023-10-06T03:27:23.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.267+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 --> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] -- osd_op(unknown.0.0:2 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102) v8 -- 0x55d01370ac00 con 0x55d01370a400 2023-10-06T03:27:23.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.267+0000 7f416ba32700 1 -- 172.21.15.84:0/1597075480 <== osd.1 v2:172.21.15.84:6808/90663 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=479b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+479 (crc 0 0 0) 0x55d01371afc0 con 0x55d01370a400 2023-10-06T03:27:23.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.267+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 --> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] -- osd_op(unknown.0.0:3 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102) v8 -- 0x55d01370b000 con 0x55d01370a400 2023-10-06T03:27:23.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.267+0000 7f416ba32700 1 -- 172.21.15.84:0/1597075480 <== osd.1 v2:172.21.15.84:6808/90663 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x55d01371afc0 con 0x55d01370a400 2023-10-06T03:27:23.285 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:23.285 INFO:teuthology.orchestra.run.smithi084.stdout: "0": { 2023-10-06T03:27:23.285 INFO:teuthology.orchestra.run.smithi084.stdout: "data": { 2023-10-06T03:27:23.285 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions": [ 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7227, 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": { 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 7227 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.131:0", 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2632269813 2023-10-06T03:27:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "open", 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "num_leases": 0, 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "num_caps": 0, 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "request_load_avg": 0, 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 0, 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "requests_in_flight": 0, 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "num_completed_requests": 0, 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "num_completed_flushes": 0, 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "reconnecting": false, 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "recall_caps": { 2023-10-06T03:27:23.287 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 60 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: "release_caps": { 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 60 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: "recall_caps_throttle": { 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 1.5 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: "recall_caps_throttle2o": { 2023-10-06T03:27:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 0.5 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: "session_cache_liveness": { 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 300 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_acquisition": { 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 30 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: "last_trim_completed_requests_tid": 0, 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: "last_trim_completed_flushes_tid": 0, 2023-10-06T03:27:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: "delegated_inos": [], 2023-10-06T03:27:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": "client.7227 v1:172.21.15.131:0/2632269813", 2023-10-06T03:27:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: "completed_requests": [], 2023-10-06T03:27:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: "prealloc_inos": [], 2023-10-06T03:27:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: "client_metadata": { 2023-10-06T03:27:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: "client_features": { 2023-10-06T03:27:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: "feature_bits": "0x0000000000007bff" 2023-10-06T03:27:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: "metric_spec": { 2023-10-06T03:27:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: "metric_flags": { 2023-10-06T03:27:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: "feature_bits": "0x00000000000003ff" 2023-10-06T03:27:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "1", 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi131", 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: "kernel_version": "4.18.0-425.3.1.el8.x86_64", 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6421, 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": { 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-10-06T03:27:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 6421 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3493340953 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "open", 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: "num_leases": 0, 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: "num_caps": 0, 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: "request_load_avg": 0, 2023-10-06T03:27:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 0, 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: "requests_in_flight": 0, 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: "num_completed_requests": 0, 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: "num_completed_flushes": 0, 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: "reconnecting": false, 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: "recall_caps": { 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 60 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: "release_caps": { 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 60 2023-10-06T03:27:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: "recall_caps_throttle": { 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 1.5 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: "recall_caps_throttle2o": { 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 0.5 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: "session_cache_liveness": { 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 300 2023-10-06T03:27:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_acquisition": { 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: "value": 0, 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: "halflife": 30 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: "last_trim_completed_requests_tid": 0, 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: "last_trim_completed_flushes_tid": 0, 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: "delegated_inos": [], 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": "client.6421 v1:172.21.15.84:0/3493340953", 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: "completed_requests": [], 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: "prealloc_inos": [], 2023-10-06T03:27:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: "client_metadata": { 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: "client_features": { 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: "feature_bits": "0x0000000000007bff" 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: "metric_spec": { 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: "metric_flags": { 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: "feature_bits": "0x00000000000003ff" 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-10-06T03:27:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: "kernel_version": "4.18.0-425.3.1.el8.x86_64", 2023-10-06T03:27:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-10-06T03:27:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T03:27:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: "result": 0 2023-10-06T03:27:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:23.298 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:23.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.267+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x55d01370a400 msgr2=0x55d0136f5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.267+0000 7f4172d65240 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x55d01370a400 0x55d0136f5b80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x55d01370c400 msgr2=0x55d0136f7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x55d01370c400 0x55d0136f7700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x55d0136c9350 tx=0x55d01374fec0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370f800 msgr2=0x55d0136f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 --2- 172.21.15.84:0/1597075480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370f800 0x55d0136f6680 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x55d013741380 tx=0x55d0137041e0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f416c233700 1 -- 172.21.15.84:0/1597075480 reap_dead start 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 shutdown_connections 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 >> 172.21.15.84:0/1597075480 conn(0x55d01370f000 msgr2=0x55d012a2d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 shutdown_connections 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/1597075480 wait complete. 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/2386674686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370ec00 msgr2=0x55d0136f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 --2- 172.21.15.84:0/2386674686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370ec00 0x55d0136f5080 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x55d0136c9d70 tx=0x55d0136c6d80 comp rx=0 tx=0).stop 2023-10-06T03:27:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/2386674686 shutdown_connections 2023-10-06T03:27:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 --2- 172.21.15.84:0/2386674686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d01370e400 0x55d0136f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 --2- 172.21.15.84:0/2386674686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01370ec00 0x55d0136f5080 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 --2- 172.21.15.84:0/2386674686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d01370e800 0x55d0136f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/2386674686 >> 172.21.15.84:0/2386674686 conn(0x55d01370e000 msgr2=0x55d012a2d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/2386674686 shutdown_connections 2023-10-06T03:27:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.268+0000 7f4172d65240 1 -- 172.21.15.84:0/2386674686 wait complete. 2023-10-06T03:27:23.302 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.077003, result: { "0": { "data": { "sessions": [ { "id": 7227, "entity": { "name": { "type": "client", "num": 7227 }, "addr": { "type": "v1", "addr": "172.21.15.131:0", "nonce": 2632269813 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7227 v1:172.21.15.131:0/2632269813", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "entity_id": "1", "hostname": "smithi131", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "root": "/" } }, { "id": 6421, "entity": { "name": { "type": "client", "num": 6421 }, "addr": { "type": "v1", "addr": "172.21.15.84:0", "nonce": 3493340953 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6421 v1:172.21.15.84:0/3493340953", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "entity_id": "0", "hostname": "smithi084", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "root": "/" } } ] }, "result": 0 } } 2023-10-06T03:27:23.303 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [ { "id": 7227, "entity": { "name": { "type": "client", "num": 7227 }, "addr": { "type": "v1", "addr": "172.21.15.131:0", "nonce": 2632269813 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7227 v1:172.21.15.131:0/2632269813", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "entity_id": "1", "hostname": "smithi131", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "root": "/" } }, { "id": 6421, "entity": { "name": { "type": "client", "num": 6421 }, "addr": { "type": "v1", "addr": "172.21.15.84:0", "nonce": 3493340953 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6421 v1:172.21.15.84:0/3493340953", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "entity_id": "0", "hostname": "smithi084", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "root": "/" } } ] }, "result": 0 } } 2023-10-06T03:27:23.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:27:23.303 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir bravo) 2023-10-06T03:27:23.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:27:23.358 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch bravo/file_a) 2023-10-06T03:27:23.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:27:23.415 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch bravo/file_b) 2023-10-06T03:27:23.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-10-06T03:27:23.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.572+0000 7fc75759e700 1 Processor -- start 2023-10-06T03:27:23.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.572+0000 7fc75759e700 1 -- start start 2023-10-06T03:27:23.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc75759e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc7580b1890 0x7fc7580ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc75759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580ad600 0x7fc7580abc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc75759e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75815bf80 con 0x7fc758157470 2023-10-06T03:27:23.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc75759e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7580ada80 con 0x7fc7580b1890 2023-10-06T03:27:23.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc75759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75815b090 con 0x7fc7580ad600 2023-10-06T03:27:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc756d9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580ad600 0x7fc7580abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc755d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc7580b1890 0x7fc7580ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc755d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc7580b1890 0x7fc7580ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:40952/0 (socket says 172.21.15.84:40952) 2023-10-06T03:27:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc75659c700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc758157470 0x7fc7580b1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:46656/0 (socket says 172.21.15.84:46656) 2023-10-06T03:27:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc756d9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580ad600 0x7fc7580abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:46358/0 (socket says 172.21.15.84:46358) 2023-10-06T03:27:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc755d9b700 1 -- 172.21.15.84:0/2991820824 learned_addr learned my addr 172.21.15.84:0/2991820824 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc75559a700 1 -- 172.21.15.84:0/2991820824 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159593307 0 0) 0x7fc75815bf80 con 0x7fc758157470 2023-10-06T03:27:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc75559a700 1 -- 172.21.15.84:0/2991820824 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc744003570 con 0x7fc758157470 2023-10-06T03:27:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc756d9d700 1 -- 172.21.15.84:0/2991820824 >> v2:172.21.15.131:3300/0 conn(0x7fc7580b1890 msgr2=0x7fc7580ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc756d9d700 1 --2- 172.21.15.84:0/2991820824 >> v2:172.21.15.131:3300/0 conn(0x7fc7580b1890 0x7fc7580ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc756d9d700 1 -- 172.21.15.84:0/2991820824 >> v1:172.21.15.131:6789/0 conn(0x7fc758157470 legacy=0x7fc7580b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc756d9d700 1 -- 172.21.15.84:0/2991820824 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75815b370 con 0x7fc7580ad600 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.573+0000 7fc755d9b700 1 --2- 172.21.15.84:0/2991820824 >> v2:172.21.15.131:3300/0 conn(0x7fc7580b1890 0x7fc7580ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc756d9d700 1 --2- 172.21.15.84:0/2991820824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580ad600 0x7fc7580abc40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7480098e0 tx=0x7fc7480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2189662480fcd9c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc75559a700 1 -- 172.21.15.84:0/2991820824 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748011630 con 0x7fc7580ad600 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc75559a700 1 -- 172.21.15.84:0/2991820824 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748011790 con 0x7fc7580ad600 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc75559a700 1 -- 172.21.15.84:0/2991820824 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748011b10 con 0x7fc7580ad600 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc75759e700 1 -- 172.21.15.84:0/2991820824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580ad600 msgr2=0x7fc7580abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc75759e700 1 --2- 172.21.15.84:0/2991820824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580ad600 0x7fc7580abc40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7480098e0 tx=0x7fc7480091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc75759e700 1 -- 172.21.15.84:0/2991820824 shutdown_connections 2023-10-06T03:27:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc75759e700 1 --2- 172.21.15.84:0/2991820824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580ad600 0x7fc7580abc40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc75759e700 1 --2- 172.21.15.84:0/2991820824 >> v2:172.21.15.131:3300/0 conn(0x7fc7580b1890 0x7fc7580ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc75759e700 1 -- 172.21.15.84:0/2991820824 >> 172.21.15.84:0/2991820824 conn(0x7fc75806cf20 msgr2=0x7fc75806b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:23.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.574+0000 7fc75759e700 1 -- 172.21.15.84:0/2991820824 shutdown_connections 2023-10-06T03:27:23.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.575+0000 7fc75759e700 1 -- 172.21.15.84:0/2991820824 wait complete. 2023-10-06T03:27:23.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75759e700 1 Processor -- start 2023-10-06T03:27:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75759e700 1 -- start start 2023-10-06T03:27:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7580ad600 0x7fc758141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580b1890 0x7fc758140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc758157470 0x7fc7581413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758140a10 con 0x7fc7580ad600 2023-10-06T03:27:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75813fe00 con 0x7fc758157470 2023-10-06T03:27:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7581400e0 con 0x7fc7580b1890 2023-10-06T03:27:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7580ad600 0x7fc758141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7580ad600 0x7fc758141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38120/0 (socket says 172.21.15.84:38120) 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.576+0000 7fc75659c700 1 -- 172.21.15.84:0/2484894464 learned_addr learned my addr 172.21.15.84:0/2484894464 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc755d9b700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580b1890 0x7fc758140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc756d9d700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc758157470 0x7fc7581413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc75659c700 1 -- 172.21.15.84:0/2484894464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580b1890 msgr2=0x7fc758140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc75659c700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580b1890 0x7fc758140ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc75659c700 1 -- 172.21.15.84:0/2484894464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc758157470 msgr2=0x7fc7581413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc75659c700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc758157470 0x7fc7581413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc75659c700 1 -- 172.21.15.84:0/2484894464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400094f0 con 0x7fc7580ad600 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc75659c700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7580ad600 0x7fc758141da0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc75000cdb0 tx=0x7fc750001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc74e7fc700 1 -- 172.21.15.84:0/2484894464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750005df0 con 0x7fc7580ad600 2023-10-06T03:27:23.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc74e7fc700 1 -- 172.21.15.84:0/2484894464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75000a8b0 con 0x7fc7580ad600 2023-10-06T03:27:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc75759e700 1 -- 172.21.15.84:0/2484894464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc748009420 con 0x7fc7580ad600 2023-10-06T03:27:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc74e7fc700 1 -- 172.21.15.84:0/2484894464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75000ac50 con 0x7fc7580ad600 2023-10-06T03:27:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.577+0000 7fc75759e700 1 -- 172.21.15.84:0/2484894464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7581406a0 con 0x7fc7580ad600 2023-10-06T03:27:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.578+0000 7fc75759e700 1 -- 172.21.15.84:0/2484894464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc758065e00 con 0x7fc7580ad600 2023-10-06T03:27:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.578+0000 7fc74e7fc700 1 -- 172.21.15.84:0/2484894464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc750007300 con 0x7fc7580ad600 2023-10-06T03:27:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.579+0000 7fc74e7fc700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc738066f30 0x7fc7380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.579+0000 7fc74e7fc700 1 -- 172.21.15.84:0/2484894464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fc750084970 con 0x7fc7580ad600 2023-10-06T03:27:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.579+0000 7fc755d9b700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc738066f30 0x7fc7380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.579+0000 7fc755d9b700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc738066f30 0x7fc7380693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc75816add0 tx=0x7fc740009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.583+0000 7fc74e7fc700 1 -- 172.21.15.84:0/2484894464 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc750051910 con 0x7fc7580ad600 2023-10-06T03:27:23.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:23.812+0000 7fc75759e700 1 -- 172.21.15.84:0/2484894464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fc7580ab7e0 con 0x7fc7580ad600 2023-10-06T03:27:24.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.520+0000 7fc74e7fc700 1 -- 172.21.15.84:0/2484894464 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v63) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc750054f30 con 0x7fc7580ad600 2023-10-06T03:27:24.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 -- 172.21.15.84:0/2484894464 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc738066f30 msgr2=0x7fc7380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:24.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc738066f30 0x7fc7380693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc75816add0 tx=0x7fc740009250 comp rx=0 tx=0).stop 2023-10-06T03:27:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 -- 172.21.15.84:0/2484894464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7580ad600 msgr2=0x7fc758141da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7580ad600 0x7fc758141da0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc75000cdb0 tx=0x7fc750001b90 comp rx=0 tx=0).stop 2023-10-06T03:27:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 -- 172.21.15.84:0/2484894464 shutdown_connections 2023-10-06T03:27:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc738066f30 0x7fc7380693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc758157470 0x7fc7581413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7580ad600 0x7fc758141da0 secure :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc75000cdb0 tx=0x7fc750001b90 comp rx=0 tx=0).stop 2023-10-06T03:27:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 --2- 172.21.15.84:0/2484894464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7580b1890 0x7fc758140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 -- 172.21.15.84:0/2484894464 >> 172.21.15.84:0/2484894464 conn(0x7fc75806cf20 msgr2=0x7fc7581508a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 -- 172.21.15.84:0/2484894464 shutdown_connections 2023-10-06T03:27:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.523+0000 7fc75759e700 1 -- 172.21.15.84:0/2484894464 wait complete. 2023-10-06T03:27:24.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:24.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.656+0000 7f7054b38700 1 Processor -- start 2023-10-06T03:27:24.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.656+0000 7f7054b38700 1 -- start start 2023-10-06T03:27:24.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.657+0000 7f7054b38700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70500af550 0x7f705015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:24.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.657+0000 7f7054b38700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70500d01c0 con 0x7f70500af920 2023-10-06T03:27:24.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.657+0000 7f7054b38700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70500cecf0 con 0x7f70500cfd90 2023-10-06T03:27:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.657+0000 7f7054b38700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70500cefd0 con 0x7f70500af550 2023-10-06T03:27:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.657+0000 7f704f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70500af550 0x7f705015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.657+0000 7f704effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f70500af920 0x7f70500ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58188/0 (socket says 172.21.15.84:58188) 2023-10-06T03:27:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.657+0000 7f704effd700 1 -- 172.21.15.84:0/3434006495 learned_addr learned my addr 172.21.15.84:0/3434006495 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f704f7fe700 1 -- 172.21.15.84:0/3434006495 >> v1:172.21.15.131:6789/0 conn(0x7f70500cfd90 legacy=0x7f705006c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f704f7fe700 1 -- 172.21.15.84:0/3434006495 >> v1:172.21.15.84:6789/0 conn(0x7f70500af920 legacy=0x7f70500ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f704f7fe700 1 -- 172.21.15.84:0/3434006495 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70500cf2b0 con 0x7f70500af550 2023-10-06T03:27:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f704f7fe700 1 --2- 172.21.15.84:0/3434006495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500af550 0x7f705015a5e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7040009e60 tx=0x7f7040009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a908d91ae3aa4d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f704e7fc700 1 -- 172.21.15.84:0/3434006495 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000e070 con 0x7f70500af550 2023-10-06T03:27:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f704e7fc700 1 -- 172.21.15.84:0/3434006495 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704000bbf0 con 0x7f70500af550 2023-10-06T03:27:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f704e7fc700 1 -- 172.21.15.84:0/3434006495 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040012430 con 0x7f70500af550 2023-10-06T03:27:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f7054b38700 1 -- 172.21.15.84:0/3434006495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500af550 msgr2=0x7f705015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f7054b38700 1 --2- 172.21.15.84:0/3434006495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500af550 0x7f705015a5e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7040009e60 tx=0x7f7040009780 comp rx=0 tx=0).stop 2023-10-06T03:27:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f7054b38700 1 -- 172.21.15.84:0/3434006495 shutdown_connections 2023-10-06T03:27:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f7054b38700 1 --2- 172.21.15.84:0/3434006495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500af550 0x7f705015a5e0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.658+0000 7f7054b38700 1 -- 172.21.15.84:0/3434006495 >> 172.21.15.84:0/3434006495 conn(0x7f70500d0360 msgr2=0x7f70500d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.659+0000 7f7054b38700 1 -- 172.21.15.84:0/3434006495 shutdown_connections 2023-10-06T03:27:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.659+0000 7f7054b38700 1 -- 172.21.15.84:0/3434006495 wait complete. 2023-10-06T03:27:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.660+0000 7f7054b38700 1 Processor -- start 2023-10-06T03:27:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.660+0000 7f7054b38700 1 -- start start 2023-10-06T03:27:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f7054b38700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70500af550 0x7f70500ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f7054b38700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70500af920 0x7f70500b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f7054b38700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500cfd90 0x7f70500b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f7054b38700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70500b44f0 con 0x7f70500cfd90 2023-10-06T03:27:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f7054b38700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70500b3640 con 0x7f70500af550 2023-10-06T03:27:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f7054b38700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70500b4ec0 con 0x7f70500af920 2023-10-06T03:27:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f704ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500cfd90 0x7f70500b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f704ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500cfd90 0x7f70500b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38142/0 (socket says 172.21.15.84:38142) 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f704ffff700 1 -- 172.21.15.84:0/1161101085 learned_addr learned my addr 172.21.15.84:0/1161101085 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f704ffff700 1 -- 172.21.15.84:0/1161101085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70500af920 msgr2=0x7f70500b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f704ffff700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70500af920 0x7f70500b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f704f7fe700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70500af550 0x7f70500ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f704ffff700 1 -- 172.21.15.84:0/1161101085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70500af550 msgr2=0x7f70500ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f704ffff700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70500af550 0x7f70500ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f704ffff700 1 -- 172.21.15.84:0/1161101085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040009a20 con 0x7f70500cfd90 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f704ffff700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500cfd90 0x7f70500b4980 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f704800c5b0 tx=0x7f7048007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f70377fe700 1 -- 172.21.15.84:0/1161101085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048011590 con 0x7f70500cfd90 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f70377fe700 1 -- 172.21.15.84:0/1161101085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7048011710 con 0x7f70500cfd90 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f70377fe700 1 -- 172.21.15.84:0/1161101085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048011ad0 con 0x7f70500cfd90 2023-10-06T03:27:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f7054b38700 1 -- 172.21.15.84:0/1161101085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70500b38e0 con 0x7f70500cfd90 2023-10-06T03:27:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.661+0000 7f7054b38700 1 -- 172.21.15.84:0/1161101085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70500b3ea0 con 0x7f70500cfd90 2023-10-06T03:27:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.662+0000 7f7054b38700 1 -- 172.21.15.84:0/1161101085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7050065e00 con 0x7f70500cfd90 2023-10-06T03:27:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.663+0000 7f70377fe700 1 -- 172.21.15.84:0/1161101085 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f704801c460 con 0x7f70500cfd90 2023-10-06T03:27:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.663+0000 7f70377fe700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f703c066f30 0x7f703c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.663+0000 7f70377fe700 1 -- 172.21.15.84:0/1161101085 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f7048084530 con 0x7f70500cfd90 2023-10-06T03:27:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.663+0000 7f704f7fe700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f703c066f30 0x7f703c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.664+0000 7f704f7fe700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f703c066f30 0x7f703c0693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f70400099f0 tx=0x7f7040018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.667+0000 7f70377fe700 1 -- 172.21.15.84:0/1161101085 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7048051450 con 0x7f70500cfd90 2023-10-06T03:27:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.890+0000 7f7054b38700 1 -- 172.21.15.84:0/1161101085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70500b4630 con 0x7f70500cfd90 2023-10-06T03:27:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.890+0000 7f70377fe700 1 -- 172.21.15.84:0/1161101085 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4620 (secure 0 0 0) 0x7f7048054a70 con 0x7f70500cfd90 2023-10-06T03:27:24.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:24.891 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3912722771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3912722771},{"type":"v1","addr":"172.21.15.131:6833","nonce":3912722771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6382,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4017009844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4017009844},{"type":"v1","addr":"172.21.15.131:6835","nonce":4017009844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:24.520580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7167,"mds_1":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"a","rank":1,"incarnation":64,"state":"up:creating","state_seq":1,"addr":"172.21.15.84:6835/3193918731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3193918731},{"type":"v1","addr":"172.21.15.84:6835","nonce":3193918731}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7167":{"gid":7167,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/573778757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":573778757},{"type":"v1","addr":"172.21.15.84:6837","nonce":573778757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 -- 172.21.15.84:0/1161101085 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f703c066f30 msgr2=0x7f703c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f703c066f30 0x7f703c0693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f70400099f0 tx=0x7f7040018000 comp rx=0 tx=0).stop 2023-10-06T03:27:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 -- 172.21.15.84:0/1161101085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500cfd90 msgr2=0x7f70500b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500cfd90 0x7f70500b4980 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f704800c5b0 tx=0x7f7048007f60 comp rx=0 tx=0).stop 2023-10-06T03:27:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 -- 172.21.15.84:0/1161101085 shutdown_connections 2023-10-06T03:27:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f703c066f30 0x7f703c0693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70500af550 0x7f70500ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70500cfd90 0x7f70500b4980 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 --2- 172.21.15.84:0/1161101085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70500af920 0x7f70500b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 -- 172.21.15.84:0/1161101085 >> 172.21.15.84:0/1161101085 conn(0x7f70500d0360 msgr2=0x7f705015c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 -- 172.21.15.84:0/1161101085 shutdown_connections 2023-10-06T03:27:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:24.892+0000 7f7054b38700 1 -- 172.21.15.84:0/1161101085 wait complete. 2023-10-06T03:27:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 64 2023-10-06T03:27:25.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:27:05.838700+0000', 'modified': '2023-10-06T03:27:24.520580+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7167, 'mds_1': 7152}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7152': {'gid': 7152, 'name': 'a', 'rank': 1, 'incarnation': 64, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.84:6835/3193918731', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 3193918731}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 3193918731}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7167': {'gid': 7167, 'name': 'c', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.84:6837/573778757', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 573778757}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 573778757}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:27:25.307 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7152:up:creating 2023-10-06T03:27:26.308 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:26.369 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T03:27:26.369+0000 7f03c463f700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-06T03:27:26.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:27:26.375 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:27:26.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.431+0000 7f6a659be700 1 Processor -- start 2023-10-06T03:27:26.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.431+0000 7f6a659be700 1 -- start start 2023-10-06T03:27:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.432+0000 7f6a659be700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6006c6a0 0x7f6a600cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.432+0000 7f6a659be700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a6006ca70 0x7f6a6015d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.432+0000 7f6a659be700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a600cb4f0 con 0x7f6a6015d9e0 2023-10-06T03:27:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.432+0000 7f6a659be700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a600ccf10 con 0x7f6a6006ca70 2023-10-06T03:27:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.432+0000 7f6a659be700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6015e3b0 con 0x7f6a6006c6a0 2023-10-06T03:27:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.432+0000 7f6a567fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a6006ca70 0x7f6a6015d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.432+0000 7f6a5f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a6015d9e0 0x7f6a601593e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58204/0 (socket says 172.21.15.84:58204) 2023-10-06T03:27:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.432+0000 7f6a5f7fe700 1 -- 172.21.15.84:0/2271786334 learned_addr learned my addr 172.21.15.84:0/2271786334 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.432+0000 7f6a5effd700 1 --2- 172.21.15.84:0/2271786334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6006c6a0 0x7f6a600cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a567fc700 1 -- 172.21.15.84:0/2271786334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6006c6a0 msgr2=0x7f6a600cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a567fc700 1 --2- 172.21.15.84:0/2271786334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6006c6a0 0x7f6a600cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a567fc700 1 -- 172.21.15.84:0/2271786334 >> v1:172.21.15.84:6789/0 conn(0x7f6a6015d9e0 legacy=0x7f6a601593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a5e7fc700 1 -- 172.21.15.84:0/2271786334 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642342244 0 0) 0x7f6a600cb4f0 con 0x7f6a6015d9e0 2023-10-06T03:27:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a567fc700 1 -- 172.21.15.84:0/2271786334 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6015de40 con 0x7f6a6006ca70 2023-10-06T03:27:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a5effd700 1 --2- 172.21.15.84:0/2271786334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6006c6a0 0x7f6a600cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a567fc700 1 --2- 172.21.15.84:0/2271786334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 0x7f6a6015d4a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f6a480098e0 tx=0x7f6a480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abeda4e8ce176240 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a5e7fc700 1 -- 172.21.15.84:0/2271786334 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48009e80 con 0x7f6a6006ca70 2023-10-06T03:27:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a5e7fc700 1 -- 172.21.15.84:0/2271786334 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4800b860 con 0x7f6a6006ca70 2023-10-06T03:27:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a5e7fc700 1 -- 172.21.15.84:0/2271786334 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800bbe0 con 0x7f6a6006ca70 2023-10-06T03:27:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a659be700 1 -- 172.21.15.84:0/2271786334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 msgr2=0x7f6a6015d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a659be700 1 --2- 172.21.15.84:0/2271786334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 0x7f6a6015d4a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f6a480098e0 tx=0x7f6a480091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a659be700 1 -- 172.21.15.84:0/2271786334 shutdown_connections 2023-10-06T03:27:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a659be700 1 --2- 172.21.15.84:0/2271786334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6006c6a0 0x7f6a600cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a659be700 1 --2- 172.21.15.84:0/2271786334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 0x7f6a6015d4a0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a659be700 1 -- 172.21.15.84:0/2271786334 >> 172.21.15.84:0/2271786334 conn(0x7f6a6006dfd0 msgr2=0x7f6a600cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a659be700 1 -- 172.21.15.84:0/2271786334 shutdown_connections 2023-10-06T03:27:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.433+0000 7f6a659be700 1 -- 172.21.15.84:0/2271786334 wait complete. 2023-10-06T03:27:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.435+0000 7f6a659be700 1 Processor -- start 2023-10-06T03:27:26.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.435+0000 7f6a659be700 1 -- start start 2023-10-06T03:27:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.435+0000 7f6a659be700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6006c6a0 0x7f6a6016dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.435+0000 7f6a659be700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 0x7f6a60150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.435+0000 7f6a659be700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6015d9e0 0x7f6a600b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.435+0000 7f6a659be700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600acaa0 con 0x7f6a6006ca70 2023-10-06T03:27:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.435+0000 7f6a659be700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60150e80 con 0x7f6a6006c6a0 2023-10-06T03:27:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.435+0000 7f6a659be700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600b23c0 con 0x7f6a6015d9e0 2023-10-06T03:27:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.435+0000 7f6a567fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 0x7f6a60150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a567fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 0x7f6a60150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38166/0 (socket says 172.21.15.84:38166) 2023-10-06T03:27:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a567fc700 1 -- 172.21.15.84:0/3277625997 learned_addr learned my addr 172.21.15.84:0/3277625997 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a5effd700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6006c6a0 0x7f6a6016dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a5f7fe700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6015d9e0 0x7f6a600b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a567fc700 1 -- 172.21.15.84:0/3277625997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6015d9e0 msgr2=0x7f6a600b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a567fc700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6015d9e0 0x7f6a600b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a567fc700 1 -- 172.21.15.84:0/3277625997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6006c6a0 msgr2=0x7f6a6016dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a567fc700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6006c6a0 0x7f6a6016dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:26.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a567fc700 1 -- 172.21.15.84:0/3277625997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48009420 con 0x7f6a6006ca70 2023-10-06T03:27:26.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a567fc700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 0x7f6a60150940 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f6a6006ee90 tx=0x7f6a48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:26.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a577fe700 1 -- 172.21.15.84:0/3277625997 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800bbe0 con 0x7f6a6006ca70 2023-10-06T03:27:26.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a577fe700 1 -- 172.21.15.84:0/3277625997 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a48011420 con 0x7f6a6006ca70 2023-10-06T03:27:26.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a577fe700 1 -- 172.21.15.84:0/3277625997 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480117a0 con 0x7f6a6006ca70 2023-10-06T03:27:26.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a659be700 1 -- 172.21.15.84:0/3277625997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a600accf0 con 0x7f6a6006ca70 2023-10-06T03:27:26.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.436+0000 7f6a659be700 1 -- 172.21.15.84:0/3277625997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a600ad2b0 con 0x7f6a6006ca70 2023-10-06T03:27:26.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.437+0000 7f6a659be700 1 -- 172.21.15.84:0/3277625997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6004c3c0 con 0x7f6a6006ca70 2023-10-06T03:27:26.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.437+0000 7f6a577fe700 1 -- 172.21.15.84:0/3277625997 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a48011b50 con 0x7f6a6006ca70 2023-10-06T03:27:26.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.438+0000 7f6a577fe700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6a40066f30 0x7f6a400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:26.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.438+0000 7f6a577fe700 1 -- 172.21.15.84:0/3277625997 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f6a48086280 con 0x7f6a6006ca70 2023-10-06T03:27:26.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.438+0000 7f6a5effd700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6a40066f30 0x7f6a400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:26.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.438+0000 7f6a5effd700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6a40066f30 0x7f6a400693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6a50006f00 tx=0x7f6a50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:26.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.442+0000 7f6a577fe700 1 -- 172.21.15.84:0/3277625997 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a480531a0 con 0x7f6a6006ca70 2023-10-06T03:27:26.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.669+0000 7f6a659be700 1 -- 172.21.15.84:0/3277625997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a600cdef0 con 0x7f6a6006ca70 2023-10-06T03:27:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.669+0000 7f6a577fe700 1 -- 172.21.15.84:0/3277625997 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f6a480567c0 con 0x7f6a6006ca70 2023-10-06T03:27:26.670 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:26.670 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3912722771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3912722771},{"type":"v1","addr":"172.21.15.131:6833","nonce":3912722771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6382,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4017009844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4017009844},{"type":"v1","addr":"172.21.15.131:6835","nonce":4017009844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:25.522183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7167,"mds_1":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"a","rank":1,"incarnation":64,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6835/3193918731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3193918731},{"type":"v1","addr":"172.21.15.84:6835","nonce":3193918731}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7167":{"gid":7167,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/573778757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":573778757},{"type":"v1","addr":"172.21.15.84:6837","nonce":573778757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:26.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 -- 172.21.15.84:0/3277625997 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6a40066f30 msgr2=0x7f6a400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:26.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6a40066f30 0x7f6a400693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6a50006f00 tx=0x7f6a50008040 comp rx=0 tx=0).stop 2023-10-06T03:27:26.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 -- 172.21.15.84:0/3277625997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 msgr2=0x7f6a60150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:26.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 0x7f6a60150940 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f6a6006ee90 tx=0x7f6a48017000 comp rx=0 tx=0).stop 2023-10-06T03:27:26.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 -- 172.21.15.84:0/3277625997 shutdown_connections 2023-10-06T03:27:26.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f6a40066f30 0x7f6a400693e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:26.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6006c6a0 0x7f6a6016dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:26.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a6015d9e0 0x7f6a600b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:26.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 --2- 172.21.15.84:0/3277625997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a6006ca70 0x7f6a60150940 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:26.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 -- 172.21.15.84:0/3277625997 >> 172.21.15.84:0/3277625997 conn(0x7f6a6006dfd0 msgr2=0x7f6a600aa290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:26.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 -- 172.21.15.84:0/3277625997 shutdown_connections 2023-10-06T03:27:26.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:26.671+0000 7f6a659be700 1 -- 172.21.15.84:0/3277625997 wait complete. 2023-10-06T03:27:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 65 2023-10-06T03:27:27.087 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:27:05.838700+0000', 'modified': '2023-10-06T03:27:25.522183+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7167, 'mds_1': 7152}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7152': {'gid': 7152, 'name': 'a', 'rank': 1, 'incarnation': 64, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.84:6835/3193918731', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 3193918731}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 3193918731}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7167': {'gid': 7167, 'name': 'c', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.84:6837/573778757', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 573778757}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 573778757}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:27:27.087 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-10-06T03:27:27.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:27:27.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.203+0000 7fe87a237700 1 Processor -- start 2023-10-06T03:27:27.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.203+0000 7fe87a237700 1 -- start start 2023-10-06T03:27:27.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe87a237700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe87406d900 0x7fe87406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe87a237700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe874159170 0x7fe8741595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe87a237700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87415dfc0 con 0x7fe8740b24b0 2023-10-06T03:27:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe87a237700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8740b0f40 con 0x7fe87406d900 2023-10-06T03:27:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe87a237700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87415d3f0 con 0x7fe874159170 2023-10-06T03:27:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe872ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe87406d900 0x7fe87406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe8737fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe8740b24b0 0x7fe8740b2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58220/0 (socket says 172.21.15.84:58220) 2023-10-06T03:27:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe8737fe700 1 -- 172.21.15.84:0/2781128010 learned_addr learned my addr 172.21.15.84:0/2781128010 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe872ffd700 1 -- 172.21.15.84:0/2781128010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe874159170 msgr2=0x7fe8741595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe873fff700 1 --2- 172.21.15.84:0/2781128010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe874159170 0x7fe8741595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe8727fc700 1 -- 172.21.15.84:0/2781128010 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529195995 0 0) 0x7fe87415dfc0 con 0x7fe8740b24b0 2023-10-06T03:27:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe872ffd700 1 --2- 172.21.15.84:0/2781128010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe874159170 0x7fe8741595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe872ffd700 1 -- 172.21.15.84:0/2781128010 >> v1:172.21.15.84:6789/0 conn(0x7fe8740b24b0 legacy=0x7fe8740b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe872ffd700 1 -- 172.21.15.84:0/2781128010 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87406e2c0 con 0x7fe87406d900 2023-10-06T03:27:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe872ffd700 1 --2- 172.21.15.84:0/2781128010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe87406d900 0x7fe87406dd80 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe8640098e0 tx=0x7fe8640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e72d56390654263 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe8727fc700 1 -- 172.21.15.84:0/2781128010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864009e80 con 0x7fe87406d900 2023-10-06T03:27:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe8727fc700 1 -- 172.21.15.84:0/2781128010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86400b860 con 0x7fe87406d900 2023-10-06T03:27:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.204+0000 7fe8727fc700 1 -- 172.21.15.84:0/2781128010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86400bbe0 con 0x7fe87406d900 2023-10-06T03:27:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.205+0000 7fe87a237700 1 -- 172.21.15.84:0/2781128010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe87406d900 msgr2=0x7fe87406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.205+0000 7fe87a237700 1 --2- 172.21.15.84:0/2781128010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe87406d900 0x7fe87406dd80 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe8640098e0 tx=0x7fe8640091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.205+0000 7fe87a237700 1 -- 172.21.15.84:0/2781128010 shutdown_connections 2023-10-06T03:27:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.205+0000 7fe87a237700 1 --2- 172.21.15.84:0/2781128010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe874159170 0x7fe8741595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.205+0000 7fe87a237700 1 --2- 172.21.15.84:0/2781128010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe87406d900 0x7fe87406dd80 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.205+0000 7fe87a237700 1 -- 172.21.15.84:0/2781128010 >> 172.21.15.84:0/2781128010 conn(0x7fe8740d0520 msgr2=0x7fe8740d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.205+0000 7fe87a237700 1 -- 172.21.15.84:0/2781128010 shutdown_connections 2023-10-06T03:27:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.205+0000 7fe87a237700 1 -- 172.21.15.84:0/2781128010 wait complete. 2023-10-06T03:27:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.206+0000 7fe87a237700 1 Processor -- start 2023-10-06T03:27:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.206+0000 7fe87a237700 1 -- start start 2023-10-06T03:27:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe87a237700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe87406d900 0x7fe874157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe87a237700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740b24b0 0x7fe87415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe87a237700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe874159170 0x7fe8740af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe87a237700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87415a450 con 0x7fe8740b24b0 2023-10-06T03:27:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe87a237700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8741595a0 con 0x7fe87406d900 2023-10-06T03:27:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe87a237700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe874159840 con 0x7fe874159170 2023-10-06T03:27:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe872ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740b24b0 0x7fe87415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe872ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740b24b0 0x7fe87415b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38182/0 (socket says 172.21.15.84:38182) 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe872ffd700 1 -- 172.21.15.84:0/1133978007 learned_addr learned my addr 172.21.15.84:0/1133978007 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe8737fe700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe87406d900 0x7fe874157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.207+0000 7fe873fff700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe874159170 0x7fe8740af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe872ffd700 1 -- 172.21.15.84:0/1133978007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe874159170 msgr2=0x7fe8740af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe872ffd700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe874159170 0x7fe8740af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe872ffd700 1 -- 172.21.15.84:0/1133978007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe87406d900 msgr2=0x7fe874157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe872ffd700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe87406d900 0x7fe874157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe872ffd700 1 -- 172.21.15.84:0/1133978007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe864009420 con 0x7fe8740b24b0 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe872ffd700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740b24b0 0x7fe87415b460 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fe874089500 tx=0x7fe864017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe85b7fe700 1 -- 172.21.15.84:0/1133978007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86400bbe0 con 0x7fe8740b24b0 2023-10-06T03:27:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe85b7fe700 1 -- 172.21.15.84:0/1133978007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe864000cc0 con 0x7fe8740b24b0 2023-10-06T03:27:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe87a237700 1 -- 172.21.15.84:0/1133978007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe874159b20 con 0x7fe8740b24b0 2023-10-06T03:27:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe85b7fe700 1 -- 172.21.15.84:0/1133978007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864011670 con 0x7fe8740b24b0 2023-10-06T03:27:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.208+0000 7fe87a237700 1 -- 172.21.15.84:0/1133978007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87415a0e0 con 0x7fe8740b24b0 2023-10-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.211+0000 7fe85b7fe700 1 -- 172.21.15.84:0/1133978007 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe864011a60 con 0x7fe8740b24b0 2023-10-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.211+0000 7fe85b7fe700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe860066f30 0x7fe8600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.211+0000 7fe85b7fe700 1 -- 172.21.15.84:0/1133978007 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fe864086200 con 0x7fe8740b24b0 2023-10-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.211+0000 7fe8737fe700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe860066f30 0x7fe8600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.212+0000 7fe88352fb80 1 Processor -- start 2023-10-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.212+0000 7fe88352fb80 1 -- start start 2023-10-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.212+0000 7fe8737fe700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe860066f30 0x7fe8600693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe868007fd0 tx=0x7fe868007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.212+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a995c840 0x55e9a995cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.212+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995dcc0 0x55e9a99ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.212+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a99acc00 0x55e9a99ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.212+0000 7fe88352fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a98b3a70 con 0x55e9a99acc00 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.212+0000 7fe88352fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a98b1270 con 0x55e9a995dcc0 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.212+0000 7fe88352fb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a98ad060 con 0x55e9a995c840 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe873fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a99acc00 0x55e9a99ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe873fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a99acc00 0x55e9a99ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38194/0 (socket says 172.21.15.84:38194) 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe873fff700 1 -- 172.21.15.84:0/145435601 learned_addr learned my addr 172.21.15.84:0/145435601 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe8737fe700 1 --2- 172.21.15.84:0/145435601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a995c840 0x55e9a995cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe872ffd700 1 --2- 172.21.15.84:0/145435601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995dcc0 0x55e9a99ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe873fff700 1 -- 172.21.15.84:0/145435601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a995c840 msgr2=0x55e9a995cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe873fff700 1 --2- 172.21.15.84:0/145435601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a995c840 0x55e9a995cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe873fff700 1 -- 172.21.15.84:0/145435601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995dcc0 msgr2=0x55e9a99ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe873fff700 1 --2- 172.21.15.84:0/145435601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995dcc0 0x55e9a99ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe873fff700 1 -- 172.21.15.84:0/145435601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9a9747270 con 0x55e9a99acc00 2023-10-06T03:27:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe873fff700 1 --2- 172.21.15.84:0/145435601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a99acc00 0x55e9a99ad050 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00f650 tx=0x7fe86c0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f08c9aa17be0347 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe858ff9700 1 -- 172.21.15.84:0/145435601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00a5d0 con 0x55e9a99acc00 2023-10-06T03:27:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe858ff9700 1 -- 172.21.15.84:0/145435601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c00a730 con 0x55e9a99acc00 2023-10-06T03:27:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.213+0000 7fe858ff9700 1 -- 172.21.15.84:0/145435601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00aad0 con 0x55e9a99acc00 2023-10-06T03:27:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 -- 172.21.15.84:0/145435601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a99acc00 msgr2=0x55e9a99ad050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 --2- 172.21.15.84:0/145435601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a99acc00 0x55e9a99ad050 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00f650 tx=0x7fe86c0077b0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 -- 172.21.15.84:0/145435601 shutdown_connections 2023-10-06T03:27:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 --2- 172.21.15.84:0/145435601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a99acc00 0x55e9a99ad050 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 --2- 172.21.15.84:0/145435601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a995c840 0x55e9a995cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 --2- 172.21.15.84:0/145435601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995dcc0 0x55e9a99ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 -- 172.21.15.84:0/145435601 >> 172.21.15.84:0/145435601 conn(0x55e9a995e160 msgr2=0x55e9a995e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 -- 172.21.15.84:0/145435601 shutdown_connections 2023-10-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 -- 172.21.15.84:0/145435601 wait complete. 2023-10-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 -- start start 2023-10-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.214+0000 7fe88352fb80 1 Processor -- start 2023-10-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a99aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a99b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe88352fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a9858890 con 0x55e9a995dcc0 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe88352fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a9873ea0 con 0x55e9a995c840 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe88352fb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a972fe30 con 0x55e9a99acc00 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe88352fb80 10 client.0 _ll_register_callbacks cb 0x55e9a991fe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe872ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe872ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38198/0 (socket says 172.21.15.84:38198) 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe872ffd700 1 -- 172.21.15.84:0/2902937042 learned_addr learned my addr 172.21.15.84:0/2902937042 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe8737fe700 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a99aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.215+0000 7fe873fff700 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a99b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe872ffd700 1 -- 172.21.15.84:0/2902937042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 msgr2=0x55e9a99b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe872ffd700 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a99b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe872ffd700 1 -- 172.21.15.84:0/2902937042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 msgr2=0x55e9a99aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe872ffd700 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a99aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe872ffd700 1 -- 172.21.15.84:0/2902937042 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86c007dc0 con 0x55e9a995dcc0 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe873fff700 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a99b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe872ffd700 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99b6d80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe864014040 tx=0x7fe86405c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a57a59ad7168941 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe851ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe851ffb700 1 -- 172.21.15.84:0/2902937042 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86406d170 con 0x55e9a995dcc0 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe851ffb700 1 -- 172.21.15.84:0/2902937042 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fe864056d40 con 0x55e9a995dcc0 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe88352fb80 1 -- 172.21.15.84:0/2902937042 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9a9951940 con 0x55e9a995dcc0 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe851ffb700 1 -- 172.21.15.84:0/2902937042 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe864059f90 con 0x55e9a995dcc0 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe88352fb80 10 client.7278 fetch_fsmap learned FSMap version 65 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe88352fb80 1 -- 172.21.15.84:0/2902937042 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55e9a96e9fe0 con 0x55e9a995dcc0 2023-10-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe851ffb700 1 -- 172.21.15.84:0/2902937042 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe864082020 con 0x55e9a995dcc0 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe851ffb700 1 -- 172.21.15.84:0/2902937042 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 65) v1 ==== 3112+0+0 (secure 0 0 0) 0x7fe86405d850 con 0x55e9a995dcc0 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe88352fb80 10 client.7278 fetch_fsmap finished waiting for FSMap version 65 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe88352fb80 10 client.7278 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe88352fb80 20 client.7278 populate_metadata read hostname 'smithi084' 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe88352fb80 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.84:6834/3193918731,v1:172.21.15.84:6835/3193918731] conn(0x55e9a99a3ff0 0x55e9a999cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe88352fb80 4 client.7278 mds_command: new command op to 7152 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe88352fb80 1 -- 172.21.15.84:0/2902937042 --> [v2:172.21.15.84:6834/3193918731,v1:172.21.15.84:6835/3193918731] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9a992e870 con 0x55e9a99a3ff0 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.216+0000 7fe8737fe700 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.84:6834/3193918731,v1:172.21.15.84:6835/3193918731] conn(0x55e9a99a3ff0 0x55e9a999cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe851ffb700 10 client.7278 ms_handle_connect on v2:172.21.15.84:6834/3193918731 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe8737fe700 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.84:6834/3193918731,v1:172.21.15.84:6835/3193918731] conn(0x55e9a99a3ff0 0x55e9a999cb60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71a9d0a140dab005 server_cookie=c2ae80799232a7ce in_seq=0 out_seq=0 2023-10-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe851ffb700 1 -- 172.21.15.84:0/2902937042 <== mds.1 v2:172.21.15.84:6834/3193918731 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e9a992e870 con 0x55e9a99a3ff0 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe851ffb700 10 client.7278 handle_command_reply: tid=0 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe88352fb80 1 client.7278 shutdown 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe88352fb80 1 -- 172.21.15.84:0/2902937042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 msgr2=0x55e9a99b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe88352fb80 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99b6d80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe864014040 tx=0x7fe86405c040 comp rx=0 tx=0).stop 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe88352fb80 1 -- 172.21.15.84:0/2902937042 shutdown_connections 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe88352fb80 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.84:6834/3193918731,v1:172.21.15.84:6835/3193918731] conn(0x55e9a99a3ff0 0x55e9a999cb60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe88352fb80 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a99aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe88352fb80 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a99b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe851ffb700 0 client.7278 ms_handle_reset on v2:172.21.15.84:6834/3193918731 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe88352fb80 1 --2- 172.21.15.84:0/2902937042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99b6d80 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe88352fb80 1 -- 172.21.15.84:0/2902937042 >> 172.21.15.84:0/2902937042 conn(0x55e9a995e160 msgr2=0x55e9a995d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.217+0000 7fe88352fb80 1 -- 172.21.15.84:0/2902937042 shutdown_connections 2023-10-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.218+0000 7fe88352fb80 1 -- 172.21.15.84:0/2902937042 wait complete. 2023-10-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.218+0000 7fe88352fb80 20 client.7278 trim_cache size 0 max 16384 2023-10-06T03:27:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.234+0000 7fe88352fb80 1 Processor -- start 2023-10-06T03:27:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.234+0000 7fe88352fb80 1 -- start start 2023-10-06T03:27:27.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a99b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99a2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a99a2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe88352fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a995db30 con 0x55e9a995dcc0 2023-10-06T03:27:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe88352fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a998ce20 con 0x55e9a995c840 2023-10-06T03:27:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe88352fb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a999d620 con 0x55e9a99acc00 2023-10-06T03:27:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe872ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe872ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99a2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38212/0 (socket says 172.21.15.84:38212) 2023-10-06T03:27:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe872ffd700 1 -- 172.21.15.84:0/1905814713 learned_addr learned my addr 172.21.15.84:0/1905814713 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe8737fe700 1 --2- 172.21.15.84:0/1905814713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a99b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe873fff700 1 --2- 172.21.15.84:0/1905814713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a99a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe872ffd700 1 -- 172.21.15.84:0/1905814713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 msgr2=0x55e9a99a2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe872ffd700 1 --2- 172.21.15.84:0/1905814713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a99a2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe872ffd700 1 -- 172.21.15.84:0/1905814713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 msgr2=0x55e9a99b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe872ffd700 1 --2- 172.21.15.84:0/1905814713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a99b6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe872ffd700 1 -- 172.21.15.84:0/1905814713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9a987b780 con 0x55e9a995dcc0 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe873fff700 1 --2- 172.21.15.84:0/1905814713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a99a2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe872ffd700 1 --2- 172.21.15.84:0/1905814713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99a2410 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe864020040 tx=0x7fe864030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7bd4a24f9c02e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe8597fa700 1 -- 172.21.15.84:0/1905814713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86406d170 con 0x55e9a995dcc0 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe8597fa700 1 -- 172.21.15.84:0/1905814713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe864082070 con 0x55e9a995dcc0 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.235+0000 7fe8597fa700 1 -- 172.21.15.84:0/1905814713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86405c040 con 0x55e9a995dcc0 2023-10-06T03:27:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.236+0000 7fe88352fb80 1 -- 172.21.15.84:0/1905814713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 msgr2=0x55e9a99a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.236+0000 7fe88352fb80 1 --2- 172.21.15.84:0/1905814713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99a2410 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe864020040 tx=0x7fe864030000 comp rx=0 tx=0).stop 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.236+0000 7fe88352fb80 1 -- 172.21.15.84:0/1905814713 shutdown_connections 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.236+0000 7fe88352fb80 1 --2- 172.21.15.84:0/1905814713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a99b6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.236+0000 7fe88352fb80 1 --2- 172.21.15.84:0/1905814713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a99a2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.236+0000 7fe88352fb80 1 --2- 172.21.15.84:0/1905814713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99a2410 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.236+0000 7fe88352fb80 1 -- 172.21.15.84:0/1905814713 >> 172.21.15.84:0/1905814713 conn(0x55e9a995e160 msgr2=0x55e9a9955280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.236+0000 7fe88352fb80 1 -- 172.21.15.84:0/1905814713 shutdown_connections 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.236+0000 7fe88352fb80 1 -- 172.21.15.84:0/1905814713 wait complete. 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.237+0000 7fe88352fb80 1 -- start start 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.237+0000 7fe88352fb80 1 Processor -- start 2023-10-06T03:27:27.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.237+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a9a07ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.237+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99847b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.237+0000 7fe88352fb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a9984cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.237+0000 7fe88352fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a9a08420 con 0x55e9a995dcc0 2023-10-06T03:27:27.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.237+0000 7fe88352fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a99c35a0 con 0x55e9a995c840 2023-10-06T03:27:27.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.237+0000 7fe88352fb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a9985610 con 0x55e9a99acc00 2023-10-06T03:27:27.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.237+0000 7fe88352fb80 10 client.0 _ll_register_callbacks cb 0x55e9a991fe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:27:27.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.237+0000 7fe872ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe872ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99847b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38220/0 (socket says 172.21.15.84:38220) 2023-10-06T03:27:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe872ffd700 1 -- 172.21.15.84:0/4136740593 learned_addr learned my addr 172.21.15.84:0/4136740593 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe872ffd700 1 -- 172.21.15.84:0/4136740593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 msgr2=0x55e9a9984cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe873fff700 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a9984cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe8737fe700 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a9a07ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe872ffd700 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a9984cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe872ffd700 1 -- 172.21.15.84:0/4136740593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 msgr2=0x55e9a9a07ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe872ffd700 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a9a07ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe872ffd700 1 -- 172.21.15.84:0/4136740593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9a96e9fe0 con 0x55e9a995dcc0 2023-10-06T03:27:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe873fff700 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a9984cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe8737fe700 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a9a07ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe872ffd700 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99847b0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe864053240 tx=0x7fe86402f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b532306711189b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe851ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe851ffb700 1 -- 172.21.15.84:0/4136740593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864061070 con 0x55e9a995dcc0 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe851ffb700 1 -- 172.21.15.84:0/4136740593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fe864083080 con 0x55e9a995dcc0 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe88352fb80 1 -- 172.21.15.84:0/4136740593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe86c00a730 con 0x55e9a995dcc0 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe851ffb700 1 -- 172.21.15.84:0/4136740593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe86406d170 con 0x55e9a995dcc0 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe88352fb80 10 client.7284 fetch_fsmap learned FSMap version 65 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe88352fb80 1 -- 172.21.15.84:0/4136740593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55e9a9862470 con 0x55e9a995dcc0 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe851ffb700 1 -- 172.21.15.84:0/4136740593 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c00a730 con 0x55e9a995dcc0 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe851ffb700 1 -- 172.21.15.84:0/4136740593 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 65) v1 ==== 3112+0+0 (secure 0 0 0) 0x7fe864055ca0 con 0x55e9a995dcc0 2023-10-06T03:27:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe88352fb80 10 client.7284 fetch_fsmap finished waiting for FSMap version 65 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe88352fb80 10 client.7284 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe88352fb80 20 client.7284 populate_metadata read hostname 'smithi084' 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe88352fb80 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.84:6834/3193918731,v1:172.21.15.84:6835/3193918731] conn(0x55e9a99a9ad0 0x55e9a99a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe88352fb80 4 client.7284 mds_command: new command op to 7152 tid=0[{"prefix": "status"}] 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.238+0000 7fe88352fb80 1 -- 172.21.15.84:0/4136740593 --> [v2:172.21.15.84:6834/3193918731,v1:172.21.15.84:6835/3193918731] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e9a984fe00 con 0x55e9a99a9ad0 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe8737fe700 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.84:6834/3193918731,v1:172.21.15.84:6835/3193918731] conn(0x55e9a99a9ad0 0x55e9a99a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe851ffb700 10 client.7284 ms_handle_connect on v2:172.21.15.84:6834/3193918731 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe8737fe700 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.84:6834/3193918731,v1:172.21.15.84:6835/3193918731] conn(0x55e9a99a9ad0 0x55e9a99a9ea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec3e81bdc6793dbd server_cookie=bfef925b932834aa in_seq=0 out_seq=0 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe851ffb700 1 -- 172.21.15.84:0/4136740593 <== mds.1 v2:172.21.15.84:6834/3193918731 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55e9a984fe00 con 0x55e9a99a9ad0 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe851ffb700 10 client.7284 handle_command_reply: tid=0 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 client.7284 shutdown 2023-10-06T03:27:27.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 -- 172.21.15.84:0/4136740593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 msgr2=0x55e9a99847b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99847b0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe864053240 tx=0x7fe86402f000 comp rx=0 tx=0).stop 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 -- 172.21.15.84:0/4136740593 shutdown_connections 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.84:6834/3193918731,v1:172.21.15.84:6835/3193918731] conn(0x55e9a99a9ad0 0x55e9a99a9ea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e9a995c840 0x55e9a9a07ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe851ffb700 0 client.7284 ms_handle_reset on v2:172.21.15.84:6834/3193918731 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e9a99acc00 0x55e9a9984cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 --2- 172.21.15.84:0/4136740593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e9a995dcc0 0x55e9a99847b0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 -- 172.21.15.84:0/4136740593 >> 172.21.15.84:0/4136740593 conn(0x55e9a995e160 msgr2=0x55e9a9955280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 -- 172.21.15.84:0/4136740593 shutdown_connections 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 1 -- 172.21.15.84:0/4136740593 wait complete. 2023-10-06T03:27:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.239+0000 7fe88352fb80 20 client.7284 trim_cache size 0 max 16384 2023-10-06T03:27:27.250 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:27.250 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:27:27.250 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2023-10-06T03:27:27.250 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7152, 2023-10-06T03:27:27.250 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:27:27.250 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:27:27.250 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:27:27.250 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 2.7173483580000002, 2023-10-06T03:27:27.251 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 65, 2023-10-06T03:27:27.251 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 102, 2023-10-06T03:27:27.251 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 102, 2023-10-06T03:27:27.251 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 11.635179675 2023-10-06T03:27:27.251 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:27.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 -- 172.21.15.84:0/1133978007 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe860066f30 msgr2=0x7fe8600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe860066f30 0x7fe8600693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe868007fd0 tx=0x7fe868007d30 comp rx=0 tx=0).stop 2023-10-06T03:27:27.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 -- 172.21.15.84:0/1133978007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740b24b0 msgr2=0x7fe87415b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740b24b0 0x7fe87415b460 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fe874089500 tx=0x7fe864017000 comp rx=0 tx=0).stop 2023-10-06T03:27:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 -- 172.21.15.84:0/1133978007 shutdown_connections 2023-10-06T03:27:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe860066f30 0x7fe8600693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe87406d900 0x7fe874157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe874159170 0x7fe8740af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 --2- 172.21.15.84:0/1133978007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740b24b0 0x7fe87415b460 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 -- 172.21.15.84:0/1133978007 >> 172.21.15.84:0/1133978007 conn(0x7fe8740d0520 msgr2=0x7fe874158880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 -- 172.21.15.84:0/1133978007 shutdown_connections 2023-10-06T03:27:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.240+0000 7fe87a237700 1 -- 172.21.15.84:0/1133978007 wait complete. 2023-10-06T03:27:27.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:27:27.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.368+0000 7f84a13a0700 1 Processor -- start 2023-10-06T03:27:27.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.368+0000 7f84a13a0700 1 -- start start 2023-10-06T03:27:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a13a0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f849c153600 0x7f849c15da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a13a0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 0x7f849c1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a13a0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f849c0cb130 0x7f849c0cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a13a0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849c15aa30 con 0x7f849c0cb130 2023-10-06T03:27:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a13a0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849c159f30 con 0x7f849c153600 2023-10-06T03:27:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a13a0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0cbaf0 con 0x7f849c1539d0 2023-10-06T03:27:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a0b9f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f849c0cb130 0x7f849c0cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a0b9f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f849c0cb130 0x7f849c0cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38230/0 (socket says 172.21.15.84:38230) 2023-10-06T03:27:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a0b9f700 1 -- 172.21.15.84:0/340322171 learned_addr learned my addr 172.21.15.84:0/340322171 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f849bfff700 1 --2- 172.21.15.84:0/340322171 >> v2:172.21.15.131:3300/0 conn(0x7f849c153600 0x7f849c15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f849b7fe700 1 --2- 172.21.15.84:0/340322171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 0x7f849c1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a0b9f700 1 -- 172.21.15.84:0/340322171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 msgr2=0x7f849c1599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a0b9f700 1 --2- 172.21.15.84:0/340322171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 0x7f849c1599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a0b9f700 1 -- 172.21.15.84:0/340322171 >> v2:172.21.15.131:3300/0 conn(0x7f849c153600 msgr2=0x7f849c15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a0b9f700 1 --2- 172.21.15.84:0/340322171 >> v2:172.21.15.131:3300/0 conn(0x7f849c153600 0x7f849c15da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a0b9f700 1 -- 172.21.15.84:0/340322171 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c153e70 con 0x7f849c0cb130 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f849b7fe700 1 --2- 172.21.15.84:0/340322171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 0x7f849c1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f84a0b9f700 1 --2- 172.21.15.84:0/340322171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0cb130 0x7f849c0cb5b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f849c0891a0 tx=0x7f8494009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea71e97f0f6d3e54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f849affd700 1 -- 172.21.15.84:0/340322171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400e070 con 0x7f849c0cb130 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f849affd700 1 -- 172.21.15.84:0/340322171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849400ba50 con 0x7f849c0cb130 2023-10-06T03:27:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.369+0000 7f849affd700 1 -- 172.21.15.84:0/340322171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84940092e0 con 0x7f849c0cb130 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.370+0000 7f84a13a0700 1 -- 172.21.15.84:0/340322171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0cb130 msgr2=0x7f849c0cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.370+0000 7f84a13a0700 1 --2- 172.21.15.84:0/340322171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0cb130 0x7f849c0cb5b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f849c0891a0 tx=0x7f8494009840 comp rx=0 tx=0).stop 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.370+0000 7f84a13a0700 1 -- 172.21.15.84:0/340322171 shutdown_connections 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.370+0000 7f84a13a0700 1 --2- 172.21.15.84:0/340322171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0cb130 0x7f849c0cb5b0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.370+0000 7f84a13a0700 1 --2- 172.21.15.84:0/340322171 >> v2:172.21.15.131:3300/0 conn(0x7f849c153600 0x7f849c15da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.370+0000 7f84a13a0700 1 --2- 172.21.15.84:0/340322171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 0x7f849c1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.370+0000 7f84a13a0700 1 -- 172.21.15.84:0/340322171 >> 172.21.15.84:0/340322171 conn(0x7f849c06ede0 msgr2=0x7f849c06f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.370+0000 7f84a13a0700 1 -- 172.21.15.84:0/340322171 shutdown_connections 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.370+0000 7f84a13a0700 1 -- 172.21.15.84:0/340322171 wait complete. 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.371+0000 7f84a13a0700 1 Processor -- start 2023-10-06T03:27:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.371+0000 7f84a13a0700 1 -- start start 2023-10-06T03:27:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f84a13a0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c0cb130 0x7f849c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f84a13a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c153600 0x7f849c0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f84a13a0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 0x7f849c0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f84a13a0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0cac20 con 0x7f849c153600 2023-10-06T03:27:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f84a13a0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c153410 con 0x7f849c0cb130 2023-10-06T03:27:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f84a13a0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0ca660 con 0x7f849c1539d0 2023-10-06T03:27:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c153600 0x7f849c0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c153600 0x7f849c0c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38236/0 (socket says 172.21.15.84:38236) 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f849b7fe700 1 -- 172.21.15.84:0/1912423492 learned_addr learned my addr 172.21.15.84:0/1912423492 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f849bfff700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c0cb130 0x7f849c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f84a0b9f700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 0x7f849c0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f849b7fe700 1 -- 172.21.15.84:0/1912423492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 msgr2=0x7f849c0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f849b7fe700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 0x7f849c0c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f849b7fe700 1 -- 172.21.15.84:0/1912423492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c0cb130 msgr2=0x7f849c152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f849b7fe700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c0cb130 0x7f849c152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f849b7fe700 1 -- 172.21.15.84:0/1912423492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009ae0 con 0x7f849c153600 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.372+0000 7f849b7fe700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c153600 0x7f849c0c7430 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f849000c830 tx=0x7f8490008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.373+0000 7f8483fff700 1 -- 172.21.15.84:0/1912423492 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490011600 con 0x7f849c153600 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.373+0000 7f8483fff700 1 -- 172.21.15.84:0/1912423492 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490011760 con 0x7f849c153600 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.373+0000 7f84a13a0700 1 -- 172.21.15.84:0/1912423492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849c0ca940 con 0x7f849c153600 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.373+0000 7f8483fff700 1 -- 172.21.15.84:0/1912423492 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490011b20 con 0x7f849c153600 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.373+0000 7f84a13a0700 1 -- 172.21.15.84:0/1912423492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c0b4100 con 0x7f849c153600 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.374+0000 7f8483fff700 1 -- 172.21.15.84:0/1912423492 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8490018360 con 0x7f849c153600 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.374+0000 7f8483fff700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8488066f30 0x7f84880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.375+0000 7f8483fff700 1 -- 172.21.15.84:0/1912423492 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f84900847a0 con 0x7f849c153600 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.375+0000 7f849bfff700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8488066f30 0x7f84880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.375+0000 7f849bfff700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8488066f30 0x7f84880693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f848c006fd0 tx=0x7f848c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.376+0000 7f84ab8fab80 1 Processor -- start 2023-10-06T03:27:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.376+0000 7f84ab8fab80 1 -- start start 2023-10-06T03:27:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.377+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac48e50 0x562e1ac23cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.377+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac292c0 0x562e1ac24200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.377+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 0x562e1ac24740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.377+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e1ab7ea70 con 0x562e1ac48e50 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.377+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e1ab7c270 con 0x562e1ac292c0 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.377+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e1ab78060 con 0x562e1ac2aa10 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.377+0000 7f849bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac48e50 0x562e1ac23cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.377+0000 7f849bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac48e50 0x562e1ac23cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38252/0 (socket says 172.21.15.84:38252) 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.377+0000 7f849bfff700 1 -- 172.21.15.84:0/2920984957 learned_addr learned my addr 172.21.15.84:0/2920984957 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f849bfff700 1 -- 172.21.15.84:0/2920984957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 msgr2=0x562e1ac24740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f84a0b9f700 1 --2- 172.21.15.84:0/2920984957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 0x562e1ac24740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f849b7fe700 1 --2- 172.21.15.84:0/2920984957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac292c0 0x562e1ac24200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f849bfff700 1 --2- 172.21.15.84:0/2920984957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 0x562e1ac24740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f849bfff700 1 -- 172.21.15.84:0/2920984957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac292c0 msgr2=0x562e1ac24200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f849bfff700 1 --2- 172.21.15.84:0/2920984957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac292c0 0x562e1ac24200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f849bfff700 1 -- 172.21.15.84:0/2920984957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e1aa12270 con 0x562e1ac48e50 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f849bfff700 1 --2- 172.21.15.84:0/2920984957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac48e50 0x562e1ac23cc0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f848c00b4e0 tx=0x7f848c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d60d629abbfa31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f84817fa700 1 -- 172.21.15.84:0/2920984957 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c00bea0 con 0x562e1ac48e50 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f84817fa700 1 -- 172.21.15.84:0/2920984957 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c01a070 con 0x562e1ac48e50 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.378+0000 7f84817fa700 1 -- 172.21.15.84:0/2920984957 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c021440 con 0x562e1ac48e50 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2920984957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac48e50 msgr2=0x562e1ac23cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/2920984957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac48e50 0x562e1ac23cc0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f848c00b4e0 tx=0x7f848c017000 comp rx=0 tx=0).stop 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2920984957 shutdown_connections 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/2920984957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 0x562e1ac24740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/2920984957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac48e50 0x562e1ac23cc0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/2920984957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac292c0 0x562e1ac24200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2920984957 >> 172.21.15.84:0/2920984957 conn(0x562e1ac28e80 msgr2=0x562e1ac296b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2920984957 shutdown_connections 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2920984957 wait complete. 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 -- start start 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.379+0000 7f84ab8fab80 1 Processor -- start 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac49420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac2aa10 0x562e1ac472a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac48e50 0x562e1ac477e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e1ab23890 con 0x562e1ac292c0 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e1ab3eea0 con 0x562e1ac2aa10 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e1a9fae30 con 0x562e1ac48e50 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f84ab8fab80 10 client.0 _ll_register_callbacks cb 0x562e1abeb020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:27:27.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f849bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac49420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f849bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac49420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38256/0 (socket says 172.21.15.84:38256) 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f849bfff700 1 -- 172.21.15.84:0/2682575878 learned_addr learned my addr 172.21.15.84:0/2682575878 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f849b7fe700 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac2aa10 0x562e1ac472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f84a0b9f700 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac48e50 0x562e1ac477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f849bfff700 1 -- 172.21.15.84:0/2682575878 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac48e50 msgr2=0x562e1ac477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f849bfff700 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac48e50 0x562e1ac477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f849bfff700 1 -- 172.21.15.84:0/2682575878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac2aa10 msgr2=0x562e1ac472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f849bfff700 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac2aa10 0x562e1ac472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f849bfff700 1 -- 172.21.15.84:0/2682575878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c00e040 con 0x562e1ac292c0 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.380+0000 7f849b7fe700 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac2aa10 0x562e1ac472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:27.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f849bfff700 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac49420 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f848c006c20 tx=0x7f848c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f54a037dc7d9bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f847a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f847a7fc700 1 -- 172.21.15.84:0/2682575878 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c0219c0 con 0x562e1ac292c0 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f847a7fc700 1 -- 172.21.15.84:0/2682575878 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f848c021b20 con 0x562e1ac292c0 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2682575878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e1ac1c940 con 0x562e1ac292c0 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f847a7fc700 1 -- 172.21.15.84:0/2682575878 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f848c005fb0 con 0x562e1ac292c0 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f84ab8fab80 10 client.7296 fetch_fsmap learned FSMap version 65 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2682575878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x562e1a9b4fe0 con 0x562e1ac292c0 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f847a7fc700 1 -- 172.21.15.84:0/2682575878 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562e1ac1c940 con 0x562e1ac292c0 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f847a7fc700 1 -- 172.21.15.84:0/2682575878 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 65) v1 ==== 3112+0+0 (secure 0 0 0) 0x7f848c034400 con 0x562e1ac292c0 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f84ab8fab80 10 client.7296 fetch_fsmap finished waiting for FSMap version 65 2023-10-06T03:27:27.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f84ab8fab80 10 client.7296 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f84ab8fab80 20 client.7296 populate_metadata read hostname 'smithi084' 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x562e1ac71360 0x562e1ac71730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f84ab8fab80 4 client.7296 mds_command: new command op to 7167 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2682575878 --> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e1abf9870 con 0x562e1ac71360 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.381+0000 7f849b7fe700 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x562e1ac71360 0x562e1ac71730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f847a7fc700 10 client.7296 ms_handle_connect on v2:172.21.15.84:6836/573778757 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f849b7fe700 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x562e1ac71360 0x562e1ac71730 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7ccd1d3b0979121 server_cookie=7667be915085598 in_seq=0 out_seq=0 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f847a7fc700 1 -- 172.21.15.84:0/2682575878 <== mds.0 v2:172.21.15.84:6836/573778757 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562e1abf9870 con 0x562e1ac71360 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f847a7fc700 10 client.7296 handle_command_reply: tid=0 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 client.7296 shutdown 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2682575878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 msgr2=0x562e1ac49420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac49420 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f848c006c20 tx=0x7f848c021000 comp rx=0 tx=0).stop 2023-10-06T03:27:27.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2682575878 shutdown_connections 2023-10-06T03:27:27.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x562e1ac71360 0x562e1ac71730 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac48e50 0x562e1ac477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f847a7fc700 0 client.7296 ms_handle_reset on v2:172.21.15.84:6836/573778757 2023-10-06T03:27:27.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac49420 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/2682575878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac2aa10 0x562e1ac472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2682575878 >> 172.21.15.84:0/2682575878 conn(0x562e1ac28e80 msgr2=0x562e1ac29d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2682575878 shutdown_connections 2023-10-06T03:27:27.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 1 -- 172.21.15.84:0/2682575878 wait complete. 2023-10-06T03:27:27.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.382+0000 7f84ab8fab80 20 client.7296 trim_cache size 0 max 16384 2023-10-06T03:27:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.399+0000 7f84ab8fab80 1 Processor -- start 2023-10-06T03:27:27.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.399+0000 7f84ab8fab80 1 -- start start 2023-10-06T03:27:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 0x562e1ac71e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 0x562e1ac72340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e1ac48b40 con 0x562e1ac292c0 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e1ac70090 con 0x562e1ac48e50 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e1ac1c700 con 0x562e1ac2aa10 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38264/0 (socket says 172.21.15.84:38264) 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849bfff700 1 -- 172.21.15.84:0/113303232 learned_addr learned my addr 172.21.15.84:0/113303232 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849b7fe700 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 0x562e1ac71e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f84a0b9f700 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 0x562e1ac72340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849bfff700 1 -- 172.21.15.84:0/113303232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 msgr2=0x562e1ac71e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849bfff700 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 0x562e1ac71e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849bfff700 1 -- 172.21.15.84:0/113303232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 msgr2=0x562e1ac72340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849bfff700 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 0x562e1ac72340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849bfff700 1 -- 172.21.15.84:0/113303232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e1ab46780 con 0x562e1ac292c0 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849b7fe700 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 0x562e1ac71e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f84a0b9f700 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 0x562e1ac72340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f849bfff700 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac493f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f848c00b690 tx=0x7f848c02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc4d27a3e9bf23c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f8481ffb700 1 -- 172.21.15.84:0/113303232 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c016a60 con 0x562e1ac292c0 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f8481ffb700 1 -- 172.21.15.84:0/113303232 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c034b40 con 0x562e1ac292c0 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.400+0000 7f8481ffb700 1 -- 172.21.15.84:0/113303232 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c0219c0 con 0x562e1ac292c0 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.401+0000 7f84ab8fab80 1 -- 172.21.15.84:0/113303232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 msgr2=0x562e1ac493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.401+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac493f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f848c00b690 tx=0x7f848c02d070 comp rx=0 tx=0).stop 2023-10-06T03:27:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.401+0000 7f84ab8fab80 1 -- 172.21.15.84:0/113303232 shutdown_connections 2023-10-06T03:27:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.401+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 0x562e1ac72340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.401+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac292c0 0x562e1ac493f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.401+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/113303232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac2aa10 0x562e1ac71e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.401+0000 7f84ab8fab80 1 -- 172.21.15.84:0/113303232 >> 172.21.15.84:0/113303232 conn(0x562e1ac28e80 msgr2=0x562e1ac802f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.401+0000 7f84ab8fab80 1 -- 172.21.15.84:0/113303232 shutdown_connections 2023-10-06T03:27:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.401+0000 7f84ab8fab80 1 -- 172.21.15.84:0/113303232 wait complete. 2023-10-06T03:27:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f84ab8fab80 1 -- start start 2023-10-06T03:27:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f84ab8fab80 1 Processor -- start 2023-10-06T03:27:27.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac292c0 0x562e1ac54430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac2aa10 0x562e1ac562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f84ab8fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 0x562e1ac23ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e1ac56cb0 con 0x562e1ac2aa10 2023-10-06T03:27:27.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e1ac53fa0 con 0x562e1ac48e50 2023-10-06T03:27:27.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f84ab8fab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e1ac24740 con 0x562e1ac292c0 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f84ab8fab80 10 client.0 _ll_register_callbacks cb 0x562e1abeb020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac2aa10 0x562e1ac562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac2aa10 0x562e1ac562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38280/0 (socket says 172.21.15.84:38280) 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.402+0000 7f849b7fe700 1 -- 172.21.15.84:0/688592135 learned_addr learned my addr 172.21.15.84:0/688592135 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f849bfff700 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac292c0 0x562e1ac54430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f84a0b9f700 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 0x562e1ac23ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f849b7fe700 1 -- 172.21.15.84:0/688592135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac292c0 msgr2=0x562e1ac54430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f849b7fe700 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac292c0 0x562e1ac54430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f849b7fe700 1 -- 172.21.15.84:0/688592135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 msgr2=0x562e1ac23ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f849b7fe700 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 0x562e1ac23ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f849b7fe700 1 -- 172.21.15.84:0/688592135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e1a9b4fe0 con 0x562e1ac2aa10 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f849b7fe700 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac2aa10 0x562e1ac562c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f8490051880 tx=0x7f8490084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190d17e2f1026bf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f847a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f847a7fc700 1 -- 172.21.15.84:0/688592135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490053720 con 0x562e1ac2aa10 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f847a7fc700 1 -- 172.21.15.84:0/688592135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f8490054870 con 0x562e1ac2aa10 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f84ab8fab80 1 -- 172.21.15.84:0/688592135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f848c01a070 con 0x562e1ac2aa10 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f847a7fc700 1 -- 172.21.15.84:0/688592135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8490067bd0 con 0x562e1ac2aa10 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f84ab8fab80 10 client.7302 fetch_fsmap learned FSMap version 65 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f84ab8fab80 1 -- 172.21.15.84:0/688592135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x562e1ab2d470 con 0x562e1ac2aa10 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f847a7fc700 1 -- 172.21.15.84:0/688592135 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490060070 con 0x562e1ac2aa10 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f847a7fc700 1 -- 172.21.15.84:0/688592135 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 65) v1 ==== 3112+0+0 (secure 0 0 0) 0x7f849005be90 con 0x562e1ac2aa10 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f84ab8fab80 10 client.7302 fetch_fsmap finished waiting for FSMap version 65 2023-10-06T03:27:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f84ab8fab80 10 client.7302 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f84ab8fab80 20 client.7302 populate_metadata read hostname 'smithi084' 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x562e1ac56800 0x562e1ac24010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f84ab8fab80 4 client.7302 mds_command: new command op to 7167 tid=0[{"prefix": "status"}] 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f84ab8fab80 1 -- 172.21.15.84:0/688592135 --> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562e1ab1ae00 con 0x562e1ac56800 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.403+0000 7f849bfff700 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x562e1ac56800 0x562e1ac24010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f847a7fc700 10 client.7302 ms_handle_connect on v2:172.21.15.84:6836/573778757 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f849bfff700 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x562e1ac56800 0x562e1ac24010 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a61323ef4cee67a0 server_cookie=8aa1e65b6bafc2b2 in_seq=0 out_seq=0 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f847a7fc700 1 -- 172.21.15.84:0/688592135 <== mds.0 v2:172.21.15.84:6836/573778757 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x562e1ab1ae00 con 0x562e1ac56800 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f847a7fc700 10 client.7302 handle_command_reply: tid=0 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 client.7302 shutdown 2023-10-06T03:27:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 -- 172.21.15.84:0/688592135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac2aa10 msgr2=0x562e1ac562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac2aa10 0x562e1ac562c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f8490051880 tx=0x7f8490084040 comp rx=0 tx=0).stop 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 -- 172.21.15.84:0/688592135 shutdown_connections 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.84:6836/573778757,v1:172.21.15.84:6837/573778757] conn(0x562e1ac56800 0x562e1ac24010 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e1ac48e50 0x562e1ac23ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562e1ac292c0 0x562e1ac54430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f847a7fc700 0 client.7302 ms_handle_reset on v2:172.21.15.84:6836/573778757 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 --2- 172.21.15.84:0/688592135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e1ac2aa10 0x562e1ac562c0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 -- 172.21.15.84:0/688592135 >> 172.21.15.84:0/688592135 conn(0x562e1ac28e80 msgr2=0x562e1ac2ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 -- 172.21.15.84:0/688592135 shutdown_connections 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 1 -- 172.21.15.84:0/688592135 wait complete. 2023-10-06T03:27:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.404+0000 7f84ab8fab80 20 client.7302 trim_cache size 0 max 16384 2023-10-06T03:27:27.414 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:27.414 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3eb6b236-a9b2-4c6a-bc84-749d824186bc", 2023-10-06T03:27:27.414 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:27:27.414 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7167, 2023-10-06T03:27:27.414 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:27:27.414 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:27:27.414 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:27:27.414 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 11.035074375000001, 2023-10-06T03:27:27.414 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 65, 2023-10-06T03:27:27.414 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 102, 2023-10-06T03:27:27.415 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 102, 2023-10-06T03:27:27.415 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 11.757900168999999 2023-10-06T03:27:27.415 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 -- 172.21.15.84:0/1912423492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8488066f30 msgr2=0x7f84880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8488066f30 0x7f84880693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f848c006fd0 tx=0x7f848c008040 comp rx=0 tx=0).stop 2023-10-06T03:27:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 -- 172.21.15.84:0/1912423492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c153600 msgr2=0x7f849c0c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c153600 0x7f849c0c7430 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f849000c830 tx=0x7f8490008040 comp rx=0 tx=0).stop 2023-10-06T03:27:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 -- 172.21.15.84:0/1912423492 shutdown_connections 2023-10-06T03:27:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8488066f30 0x7f84880693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c0cb130 0x7f849c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c1539d0 0x7f849c0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 --2- 172.21.15.84:0/1912423492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c153600 0x7f849c0c7430 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 -- 172.21.15.84:0/1912423492 >> 172.21.15.84:0/1912423492 conn(0x7f849c06ede0 msgr2=0x7f849c0c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:27.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 -- 172.21.15.84:0/1912423492 shutdown_connections 2023-10-06T03:27:27.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:27.405+0000 7f84a13a0700 1 -- 172.21.15.84:0/1912423492 wait complete. 2023-10-06T03:27:27.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T03:27:27.558 INFO:teuthology.orchestra.run.smithi084.stdout:{"message":"","return_code":0} 2023-10-06T03:27:27.559 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T03:27:27.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2023-10-06T03:27:27.690 INFO:teuthology.orchestra.run.smithi084.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":39,"op_send_bytes":11276,"op_resend":33,"op_reply":39,"oplen_avg":{"avgcount":39,"sum":61},"op":39,"op_r":0,"op_w":39,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1}} 2023-10-06T03:27:27.691 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 39, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 39, "op_resend": 33, "op_rmw": 0, "op_send": 39, "op_send_bytes": 11276, "op_w": 39, "oplen_avg": { "avgcount": 39, "sum": 61 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2023-10-06T03:27:27.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json export dir /bravo 1 2023-10-06T03:27:27.821 INFO:teuthology.orchestra.run.smithi084.stdout:{"return_code":0} 2023-10-06T03:27:27.821 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2023-10-06T03:27:27.822 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2023-10-06T03:27:27.953 INFO:teuthology.orchestra.run.smithi084.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":39,"op_send_bytes":11276,"op_resend":33,"op_reply":39,"oplen_avg":{"avgcount":39,"sum":61},"op":39,"op_r":0,"op_w":39,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1}} 2023-10-06T03:27:27.953 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 39, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 39, "op_resend": 33, "op_rmw": 0, "op_send": 39, "op_send_bytes": 11276, "op_w": 39, "oplen_avg": { "avgcount": 39, "sum": 61 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2023-10-06T03:27:27.954 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-06T03:27:32.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2023-10-06T03:27:33.101 INFO:teuthology.orchestra.run.smithi084.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":41,"op_send_bytes":14556,"op_resend":33,"op_reply":41,"oplen_avg":{"avgcount":41,"sum":64},"op":41,"op_r":0,"op_w":41,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":3,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":17,"omap_rd":0,"omap_del":1}} 2023-10-06T03:27:33.102 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 17, "op": 41, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 41, "op_resend": 33, "op_rmw": 0, "op_send": 41, "op_send_bytes": 14556, "op_w": 41, "oplen_avg": { "avgcount": 41, "sum": 64 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2023-10-06T03:27:33.102 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-06T03:27:38.103 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2023-10-06T03:27:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":14890,"op_resend":33,"op_reply":43,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":4,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":19,"omap_rd":0,"omap_del":1}} 2023-10-06T03:27:38.247 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 19, "op": 43, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 33, "op_rmw": 0, "op_send": 43, "op_send_bytes": 14890, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2023-10-06T03:27:38.248 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-06T03:27:38.248 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:27:38.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:27:38.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:27:38.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:27:38.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:38.302 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:27:38.330 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:27:38.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:27:38.331 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:27:38.377 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:27:38.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:38.377 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:27:38.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-06T03:27:38.527 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2023-10-06T03:27:38.527 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-10-06T03:27:38.527 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T03:27:38.671 INFO:teuthology.orchestra.run.smithi084.stdout:{"message":"","return_code":0} 2023-10-06T03:27:38.671 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T03:27:38.672 DEBUG:teuthology.orchestra.run.smithi084:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2023-10-06T03:27:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.705+0000 7f2b6ebef240 1 -- start start 2023-10-06T03:27:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.705+0000 7f2b6ebef240 1 Processor -- start 2023-10-06T03:27:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b6ebef240 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c85c400 0x55fb2c832580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b6ebef240 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85c800 0x55fb2c832b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b6ebef240 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85cc00 0x55fb2c833080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b6ebef240 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2babbcc0 con 0x55fb2c85cc00 2023-10-06T03:27:38.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b6ebef240 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2babb540 con 0x55fb2c85c400 2023-10-06T03:27:38.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b6ebef240 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb2babbb80 con 0x55fb2c85c800 2023-10-06T03:27:38.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b688be700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85cc00 0x55fb2c833080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b688be700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85cc00 0x55fb2c833080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36134/0 (socket says 172.21.15.84:36134) 2023-10-06T03:27:38.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b688be700 1 -- 172.21.15.84:0/1443463384 learned_addr learned my addr 172.21.15.84:0/1443463384 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:38.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b680bd700 1 --2- 172.21.15.84:0/1443463384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c85c400 0x55fb2c832580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.706+0000 7f2b678bc700 1 --2- 172.21.15.84:0/1443463384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85c800 0x55fb2c832b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b688be700 1 -- 172.21.15.84:0/1443463384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85c800 msgr2=0x55fb2c832b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:38.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b688be700 1 --2- 172.21.15.84:0/1443463384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85c800 0x55fb2c832b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b688be700 1 -- 172.21.15.84:0/1443463384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c85c400 msgr2=0x55fb2c832580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:38.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b688be700 1 --2- 172.21.15.84:0/1443463384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c85c400 0x55fb2c832580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b688be700 1 -- 172.21.15.84:0/1443463384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb2ba9e340 con 0x55fb2c85cc00 2023-10-06T03:27:38.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b688be700 1 --2- 172.21.15.84:0/1443463384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85cc00 0x55fb2c833080 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x55fb2c807dd0 tx=0x55fb2c848000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a816a891aed1e82a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:38.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b658b8700 1 -- 172.21.15.84:0/1443463384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fb2bab3600 con 0x55fb2c85cc00 2023-10-06T03:27:38.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b658b8700 1 -- 172.21.15.84:0/1443463384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fb2bad0480 con 0x55fb2c85cc00 2023-10-06T03:27:38.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b658b8700 1 -- 172.21.15.84:0/1443463384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fb2bab31e0 con 0x55fb2c85cc00 2023-10-06T03:27:38.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1443463384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb2ba9e000 con 0x55fb2c85cc00 2023-10-06T03:27:38.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1443463384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55fb2ba9eea0 con 0x55fb2c85cc00 2023-10-06T03:27:38.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b6ebef240 4 waiting for MDS map... 2023-10-06T03:27:38.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b658b8700 1 -- 172.21.15.84:0/1443463384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== osd_map(103..103 src has 1..103) v4 ==== 6608+0+0 (secure 0 0 0) 0x55fb2babec40 con 0x55fb2c85cc00 2023-10-06T03:27:38.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b658b8700 1 -- 172.21.15.84:0/1443463384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 66) v1 ==== 3116+0+0 (secure 0 0 0) 0x55fb2c846600 con 0x55fb2c85cc00 2023-10-06T03:27:38.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b6ebef240 4 Got MDS map 66 2023-10-06T03:27:38.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b6ebef240 10 main: main 2023-10-06T03:27:38.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.707+0000 7f2b6ebef240 4 main: connecting to RADOS... 2023-10-06T03:27:38.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.708+0000 7f2b6ebef240 1 Processor -- start 2023-10-06T03:27:38.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.708+0000 7f2b6ebef240 1 -- start start 2023-10-06T03:27:38.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.708+0000 7f2b6ebef240 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85d800 0x55fb2c833600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.708+0000 7f2b6ebef240 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85dc00 0x55fb2c833b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.708+0000 7f2b6ebef240 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c8d0000 0x55fb2c834100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.708+0000 7f2b6ebef240 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2babadc0 con 0x55fb2c85dc00 2023-10-06T03:27:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.708+0000 7f2b6ebef240 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2babb540 con 0x55fb2c8d0000 2023-10-06T03:27:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.708+0000 7f2b6ebef240 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb2baba3c0 con 0x55fb2c85d800 2023-10-06T03:27:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.708+0000 7f2b680bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85dc00 0x55fb2c833b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b680bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85dc00 0x55fb2c833b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36146/0 (socket says 172.21.15.84:36146) 2023-10-06T03:27:38.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b680bd700 1 -- 172.21.15.84:0/1740365926 learned_addr learned my addr 172.21.15.84:0/1740365926 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:38.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b678bc700 1 --2- 172.21.15.84:0/1740365926 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85d800 0x55fb2c833600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b678bc700 1 --2- 172.21.15.84:0/1740365926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c8d0000 0x55fb2c834100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b680bd700 1 -- 172.21.15.84:0/1740365926 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85d800 msgr2=0x55fb2c833600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:38.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b680bd700 1 --2- 172.21.15.84:0/1740365926 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85d800 0x55fb2c833600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b680bd700 1 -- 172.21.15.84:0/1740365926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c8d0000 msgr2=0x55fb2c834100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:38.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b680bd700 1 --2- 172.21.15.84:0/1740365926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c8d0000 0x55fb2c834100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b680bd700 1 -- 172.21.15.84:0/1740365926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb2ba9f860 con 0x55fb2c85dc00 2023-10-06T03:27:38.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b678bc700 1 --2- 172.21.15.84:0/1740365926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c8d0000 0x55fb2c834100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:38.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b680bd700 1 --2- 172.21.15.84:0/1740365926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85dc00 0x55fb2c833b80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x55fb2c86b1d0 tx=0x55fb2c80dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869e447766cb46ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:38.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b638b4700 1 -- 172.21.15.84:0/1740365926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fb2bab3080 con 0x55fb2c85dc00 2023-10-06T03:27:38.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b638b4700 1 -- 172.21.15.84:0/1740365926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fb2bad0c00 con 0x55fb2c85dc00 2023-10-06T03:27:38.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b638b4700 1 -- 172.21.15.84:0/1740365926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fb2bab3600 con 0x55fb2c85dc00 2023-10-06T03:27:38.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1740365926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85dc00 msgr2=0x55fb2c833b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/1740365926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85dc00 0x55fb2c833b80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x55fb2c86b1d0 tx=0x55fb2c80dbc0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1740365926 shutdown_connections 2023-10-06T03:27:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/1740365926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c8d0000 0x55fb2c834100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/1740365926 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85d800 0x55fb2c833600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/1740365926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85dc00 0x55fb2c833b80 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1740365926 >> 172.21.15.84:0/1740365926 conn(0x55fb2c85d000 msgr2=0x55fb2c801800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1740365926 shutdown_connections 2023-10-06T03:27:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.709+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1740365926 wait complete. 2023-10-06T03:27:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.710+0000 7f2b6ebef240 1 Processor -- start 2023-10-06T03:27:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.710+0000 7f2b6ebef240 1 -- start start 2023-10-06T03:27:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b6ebef240 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85dc00 0x55fb2c834c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b6ebef240 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85d800 0x55fb2c834680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b6ebef240 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c8d0000 0x55fb2c834100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b6ebef240 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2baba000 con 0x55fb2c85d800 2023-10-06T03:27:38.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b6ebef240 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2babb180 con 0x55fb2c8d0000 2023-10-06T03:27:38.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b6ebef240 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb2babb040 con 0x55fb2c85dc00 2023-10-06T03:27:38.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b680bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85d800 0x55fb2c834680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b680bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85d800 0x55fb2c834680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36158/0 (socket says 172.21.15.84:36158) 2023-10-06T03:27:38.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b680bd700 1 -- 172.21.15.84:0/3040315563 learned_addr learned my addr 172.21.15.84:0/3040315563 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:38.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b678bc700 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c8d0000 0x55fb2c834100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b678bc700 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85dc00 0x55fb2c834c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b680bd700 1 -- 172.21.15.84:0/3040315563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85dc00 msgr2=0x55fb2c834c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b680bd700 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85dc00 0x55fb2c834c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b680bd700 1 -- 172.21.15.84:0/3040315563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c8d0000 msgr2=0x55fb2c834100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b680bd700 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c8d0000 0x55fb2c834100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b680bd700 1 -- 172.21.15.84:0/3040315563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb2ba9e9c0 con 0x55fb2c85d800 2023-10-06T03:27:38.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b680bd700 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85d800 0x55fb2c834680 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x55fb2c86be90 tx=0x55fb2c80db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:38.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b620b1700 1 -- 172.21.15.84:0/3040315563 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fb2bab31e0 con 0x55fb2c85d800 2023-10-06T03:27:38.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b620b1700 1 -- 172.21.15.84:0/3040315563 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fb2bad0d80 con 0x55fb2c85d800 2023-10-06T03:27:38.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fb2ba9fa00 con 0x55fb2c85d800 2023-10-06T03:27:38.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b620b1700 1 -- 172.21.15.84:0/3040315563 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fb2bab2dc0 con 0x55fb2c85d800 2023-10-06T03:27:38.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb2ba9f860 con 0x55fb2c85d800 2023-10-06T03:27:38.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.711+0000 7f2b6ebef240 4 main: resolving pool 16 2023-10-06T03:27:38.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.713+0000 7f2b620b1700 1 -- 172.21.15.84:0/3040315563 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x55fb2c7f1080 con 0x55fb2c85d800 2023-10-06T03:27:38.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.713+0000 7f2b620b1700 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x55fb2c8f2400 0x55fb2c835700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.713+0000 7f2b620b1700 1 -- 172.21.15.84:0/3040315563 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6608+0+0 (secure 0 0 0) 0x55fb2babea80 con 0x55fb2c85d800 2023-10-06T03:27:38.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.713+0000 7f2b6ebef240 4 main: creating IoCtx.. 2023-10-06T03:27:38.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.713+0000 7f2b678bc700 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x55fb2c8f2400 0x55fb2c835700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.713+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x55fb2c8d0400 0x55fb2c833b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.713+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 --> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] -- osd_op(unknown.0.0:1 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v8 -- 0x55fb2c8d0800 con 0x55fb2c8d0400 2023-10-06T03:27:38.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.713+0000 7f2b678bc700 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x55fb2c8d0400 0x55fb2c833b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.713+0000 7f2b678bc700 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x55fb2c8f2400 0x55fb2c835700 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55fb2c807350 tx=0x55fb2c888c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:38.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.713+0000 7f2b678bc700 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x55fb2c8d0400 0x55fb2c833b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:38.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b678bc700 1 -- 172.21.15.84:0/3040315563 <== osd.1 v2:172.21.15.84:6808/90663 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv10 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x55fb2c864fc0 con 0x55fb2c8d0400 2023-10-06T03:27:38.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 --> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] -- osd_op(unknown.0.0:2 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v8 -- 0x55fb2c8d0c00 con 0x55fb2c8d0400 2023-10-06T03:27:38.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b678bc700 1 -- 172.21.15.84:0/3040315563 <== osd.1 v2:172.21.15.84:6808/90663 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv10 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x55fb2c864fc0 con 0x55fb2c8d0400 2023-10-06T03:27:38.733 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:38.733 INFO:teuthology.orchestra.run.smithi084.stdout: "0": { 2023-10-06T03:27:38.733 INFO:teuthology.orchestra.run.smithi084.stdout: "data": { 2023-10-06T03:27:38.734 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions": [] 2023-10-06T03:27:38.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:27:38.734 INFO:teuthology.orchestra.run.smithi084.stdout: "result": 0 2023-10-06T03:27:38.734 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:27:38.734 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:38.734 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:38.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x55fb2c8d0400 msgr2=0x55fb2c833b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x55fb2c8d0400 0x55fb2c833b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x55fb2c8f2400 msgr2=0x55fb2c835700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x55fb2c8f2400 0x55fb2c835700 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55fb2c807350 tx=0x55fb2c888c60 comp rx=0 tx=0).stop 2023-10-06T03:27:38.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85d800 msgr2=0x55fb2c834680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/3040315563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85d800 0x55fb2c834680 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x55fb2c86be90 tx=0x55fb2c80db60 comp rx=0 tx=0).stop 2023-10-06T03:27:38.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b680bd700 1 -- 172.21.15.84:0/3040315563 reap_dead start 2023-10-06T03:27:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 shutdown_connections 2023-10-06T03:27:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 >> 172.21.15.84:0/3040315563 conn(0x55fb2c85d000 msgr2=0x55fb2c801800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 shutdown_connections 2023-10-06T03:27:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 -- 172.21.15.84:0/3040315563 wait complete. 2023-10-06T03:27:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1443463384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85cc00 msgr2=0x55fb2c833080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/1443463384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85cc00 0x55fb2c833080 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x55fb2c807dd0 tx=0x55fb2c848000 comp rx=0 tx=0).stop 2023-10-06T03:27:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.714+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1443463384 shutdown_connections 2023-10-06T03:27:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.715+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/1443463384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb2c85c400 0x55fb2c832580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.715+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/1443463384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb2c85cc00 0x55fb2c833080 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.715+0000 7f2b6ebef240 1 --2- 172.21.15.84:0/1443463384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fb2c85c800 0x55fb2c832b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.715+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1443463384 >> 172.21.15.84:0/1443463384 conn(0x55fb2c85c000 msgr2=0x55fb2c801000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.715+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1443463384 shutdown_connections 2023-10-06T03:27:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.715+0000 7f2b6ebef240 1 -- 172.21.15.84:0/1443463384 wait complete. 2023-10-06T03:27:38.740 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.068629, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2023-10-06T03:27:38.740 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [] }, "result": 0 } } 2023-10-06T03:27:38.741 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:27:38.741 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:27:38.816 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:27:38.865 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:27:38.865 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.977+0000 7fa6e22ce700 1 Processor -- start 2023-10-06T03:27:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.977+0000 7fa6e22ce700 1 -- start start 2023-10-06T03:27:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.978+0000 7fa6e22ce700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b3760 0x7fa6dc0b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.978+0000 7fa6e22ce700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6dc0b6380 0x7fa6dc15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.978+0000 7fa6e22ce700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc0b4480 con 0x7fa6dc0b2b40 2023-10-06T03:27:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.978+0000 7fa6e22ce700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc0b4760 con 0x7fa6dc0b6380 2023-10-06T03:27:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.978+0000 7fa6e22ce700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0b4a40 con 0x7fa6dc0b3760 2023-10-06T03:27:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6dbfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b3760 0x7fa6dc0b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6db7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6dc0b6380 0x7fa6dc15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6e086b700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa6dc0b2b40 0x7fa6dc0b1120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:47666/0 (socket says 172.21.15.84:47666) 2023-10-06T03:27:38.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6e086b700 1 -- 172.21.15.84:0/1832887404 learned_addr learned my addr 172.21.15.84:0/1832887404 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:38.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6daffd700 1 -- 172.21.15.84:0/1832887404 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121323201 0 0) 0x7fa6dc0b4480 con 0x7fa6dc0b2b40 2023-10-06T03:27:38.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6daffd700 1 -- 172.21.15.84:0/1832887404 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c4003570 con 0x7fa6dc0b2b40 2023-10-06T03:27:38.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6dbfff700 1 -- 172.21.15.84:0/1832887404 >> v2:172.21.15.131:3300/0 conn(0x7fa6dc0b6380 msgr2=0x7fa6dc15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:38.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6dbfff700 1 --2- 172.21.15.84:0/1832887404 >> v2:172.21.15.131:3300/0 conn(0x7fa6dc0b6380 0x7fa6dc15cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6dbfff700 1 -- 172.21.15.84:0/1832887404 >> v1:172.21.15.131:6789/0 conn(0x7fa6dc0b2b40 legacy=0x7fa6dc0b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6dbfff700 1 -- 172.21.15.84:0/1832887404 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc09a430 con 0x7fa6dc0b3760 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6db7fe700 1 --2- 172.21.15.84:0/1832887404 >> v2:172.21.15.131:3300/0 conn(0x7fa6dc0b6380 0x7fa6dc15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6dbfff700 1 --2- 172.21.15.84:0/1832887404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b3760 0x7fa6dc0b3b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0098d0 tx=0x7fa6cc009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0b082aa05e61948 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.979+0000 7fa6daffd700 1 -- 172.21.15.84:0/1832887404 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc005c10 con 0x7fa6dc0b3760 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.980+0000 7fa6daffd700 1 -- 172.21.15.84:0/1832887404 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc005d70 con 0x7fa6dc0b3760 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.980+0000 7fa6daffd700 1 -- 172.21.15.84:0/1832887404 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc006260 con 0x7fa6dc0b3760 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.980+0000 7fa6e22ce700 1 -- 172.21.15.84:0/1832887404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b3760 msgr2=0x7fa6dc0b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.980+0000 7fa6e22ce700 1 --2- 172.21.15.84:0/1832887404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b3760 0x7fa6dc0b3b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0098d0 tx=0x7fa6cc009120 comp rx=0 tx=0).stop 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.980+0000 7fa6e22ce700 1 -- 172.21.15.84:0/1832887404 shutdown_connections 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.980+0000 7fa6e22ce700 1 --2- 172.21.15.84:0/1832887404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b3760 0x7fa6dc0b3b30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.980+0000 7fa6e22ce700 1 --2- 172.21.15.84:0/1832887404 >> v2:172.21.15.131:3300/0 conn(0x7fa6dc0b6380 0x7fa6dc15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.980+0000 7fa6e22ce700 1 -- 172.21.15.84:0/1832887404 >> 172.21.15.84:0/1832887404 conn(0x7fa6dc06cc30 msgr2=0x7fa6dc0d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:38.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.980+0000 7fa6e22ce700 1 -- 172.21.15.84:0/1832887404 shutdown_connections 2023-10-06T03:27:38.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.980+0000 7fa6e22ce700 1 -- 172.21.15.84:0/1832887404 wait complete. 2023-10-06T03:27:38.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.981+0000 7fa6e22ce700 1 Processor -- start 2023-10-06T03:27:38.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.981+0000 7fa6e22ce700 1 -- start start 2023-10-06T03:27:38.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6e22ce700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc0b2b40 0x7fa6dc152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6e22ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc0b3760 0x7fa6dc154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6e22ce700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b6380 0x7fa6dc158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6e22ce700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0adf50 con 0x7fa6dc0b3760 2023-10-06T03:27:38.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6e22ce700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0ae7b0 con 0x7fa6dc0b2b40 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6e22ce700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc154770 con 0x7fa6dc0b6380 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc0b3760 0x7fa6dc154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc0b3760 0x7fa6dc154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36168/0 (socket says 172.21.15.84:36168) 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6db7fe700 1 -- 172.21.15.84:0/4267633823 learned_addr learned my addr 172.21.15.84:0/4267633823 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6e086b700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b6380 0x7fa6dc158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6dbfff700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc0b2b40 0x7fa6dc152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6db7fe700 1 -- 172.21.15.84:0/4267633823 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b6380 msgr2=0x7fa6dc158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6db7fe700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b6380 0x7fa6dc158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6db7fe700 1 -- 172.21.15.84:0/4267633823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc0b2b40 msgr2=0x7fa6dc152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6db7fe700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc0b2b40 0x7fa6dc152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6db7fe700 1 -- 172.21.15.84:0/4267633823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d0009420 con 0x7fa6dc0b3760 2023-10-06T03:27:38.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.982+0000 7fa6dbfff700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc0b2b40 0x7fa6dc152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.983+0000 7fa6db7fe700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc0b3760 0x7fa6dc154dc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000ece0 tx=0x7fa6d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.983+0000 7fa6c3fff700 1 -- 172.21.15.84:0/4267633823 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000c7f0 con 0x7fa6dc0b3760 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.983+0000 7fa6c3fff700 1 -- 172.21.15.84:0/4267633823 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d000c950 con 0x7fa6dc0b3760 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.983+0000 7fa6e22ce700 1 -- 172.21.15.84:0/4267633823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc0093c0 con 0x7fa6dc0b3760 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.983+0000 7fa6c3fff700 1 -- 172.21.15.84:0/4267633823 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000ccd0 con 0x7fa6dc0b3760 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.983+0000 7fa6e22ce700 1 -- 172.21.15.84:0/4267633823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc0ae440 con 0x7fa6dc0b3760 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.984+0000 7fa6e22ce700 1 -- 172.21.15.84:0/4267633823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc04c3c0 con 0x7fa6dc0b3760 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.984+0000 7fa6c3fff700 1 -- 172.21.15.84:0/4267633823 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6d0013470 con 0x7fa6dc0b3760 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.984+0000 7fa6c3fff700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6c8066f30 0x7fa6c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.985+0000 7fa6dbfff700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6c8066f30 0x7fa6c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.985+0000 7fa6c3fff700 1 -- 172.21.15.84:0/4267633823 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fa6d0084b60 con 0x7fa6dc0b3760 2023-10-06T03:27:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.985+0000 7fa6dbfff700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6c8066f30 0x7fa6c80693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc088310 tx=0x7fa6cc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:38.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:38.989+0000 7fa6c3fff700 1 -- 172.21.15.84:0/4267633823 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6d0051a50 con 0x7fa6dc0b3760 2023-10-06T03:27:39.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.214+0000 7fa6e22ce700 1 -- 172.21.15.84:0/4267633823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6dc0ae8f0 con 0x7fa6dc0b3760 2023-10-06T03:27:39.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.214+0000 7fa6c3fff700 1 -- 172.21.15.84:0/4267633823 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4619 (secure 0 0 0) 0x7fa6d0017090 con 0x7fa6dc0b3760 2023-10-06T03:27:39.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:39.216 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3912722771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3912722771},{"type":"v1","addr":"172.21.15.131:6833","nonce":3912722771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6382,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4017009844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4017009844},{"type":"v1","addr":"172.21.15.131:6835","nonce":4017009844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:31.536601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7167,"mds_1":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"a","rank":1,"incarnation":64,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6835/3193918731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3193918731},{"type":"v1","addr":"172.21.15.84:6835","nonce":3193918731}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7167":{"gid":7167,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/573778757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":573778757},{"type":"v1","addr":"172.21.15.84:6837","nonce":573778757}]},"join_fscid":-1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:39.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 -- 172.21.15.84:0/4267633823 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6c8066f30 msgr2=0x7fa6c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6c8066f30 0x7fa6c80693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc088310 tx=0x7fa6cc016000 comp rx=0 tx=0).stop 2023-10-06T03:27:39.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 -- 172.21.15.84:0/4267633823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc0b3760 msgr2=0x7fa6dc154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc0b3760 0x7fa6dc154dc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000ece0 tx=0x7fa6d00091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 -- 172.21.15.84:0/4267633823 shutdown_connections 2023-10-06T03:27:39.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa6c8066f30 0x7fa6c80693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc0b2b40 0x7fa6dc152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6dc0b6380 0x7fa6dc158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 --2- 172.21.15.84:0/4267633823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc0b3760 0x7fa6dc154dc0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 -- 172.21.15.84:0/4267633823 >> 172.21.15.84:0/4267633823 conn(0x7fa6dc06cc30 msgr2=0x7fa6dc09bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:39.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 -- 172.21.15.84:0/4267633823 shutdown_connections 2023-10-06T03:27:39.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.217+0000 7fa6e22ce700 1 -- 172.21.15.84:0/4267633823 wait complete. 2023-10-06T03:27:39.220 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 66 2023-10-06T03:27:39.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:27:39.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.342+0000 7fc99f59e700 1 Processor -- start 2023-10-06T03:27:39.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.342+0000 7fc99f59e700 1 -- start start 2023-10-06T03:27:39.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.343+0000 7fc99f59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 0x7fc9a00cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.343+0000 7fc99f59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a00c9580 con 0x7fc9a0157340 2023-10-06T03:27:39.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.343+0000 7fc99f59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a00cce40 con 0x7fc9a00c2f70 2023-10-06T03:27:39.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.343+0000 7fc99f59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00cd400 con 0x7fc9a015b710 2023-10-06T03:27:39.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.343+0000 7fc99e59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc9a0157340 0x7fc9a015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43246/0 (socket says 172.21.15.84:43246) 2023-10-06T03:27:39.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.343+0000 7fc99e59c700 1 -- 172.21.15.84:0/290287983 learned_addr learned my addr 172.21.15.84:0/290287983 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:39.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.343+0000 7fc995d9b700 1 --2- 172.21.15.84:0/290287983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 0x7fc9a00cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:39.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc99dd9b700 1 -- 172.21.15.84:0/290287983 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987519285 0 0) 0x7fc9a00c9580 con 0x7fc9a0157340 2023-10-06T03:27:39.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc99dd9b700 1 -- 172.21.15.84:0/290287983 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc98c003570 con 0x7fc9a0157340 2023-10-06T03:27:39.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc99dd9b700 1 -- 172.21.15.84:0/290287983 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483179360 0 0) 0x7fc9a00cce40 con 0x7fc9a00c2f70 2023-10-06T03:27:39.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc99dd9b700 1 -- 172.21.15.84:0/290287983 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a00c9580 con 0x7fc9a00c2f70 2023-10-06T03:27:39.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc995d9b700 1 -- 172.21.15.84:0/290287983 >> v1:172.21.15.131:6789/0 conn(0x7fc9a00c2f70 legacy=0x7fc9a0157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc995d9b700 1 -- 172.21.15.84:0/290287983 >> v1:172.21.15.84:6789/0 conn(0x7fc9a0157340 legacy=0x7fc9a015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc995d9b700 1 -- 172.21.15.84:0/290287983 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00cd120 con 0x7fc9a015b710 2023-10-06T03:27:39.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc995d9b700 1 --2- 172.21.15.84:0/290287983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 0x7fc9a00cc7b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc988009910 tx=0x7fc9880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df10499dd067278 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:39.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc99dd9b700 1 -- 172.21.15.84:0/290287983 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800b690 con 0x7fc9a015b710 2023-10-06T03:27:39.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc99dd9b700 1 -- 172.21.15.84:0/290287983 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98800b7f0 con 0x7fc9a015b710 2023-10-06T03:27:39.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.344+0000 7fc99dd9b700 1 -- 172.21.15.84:0/290287983 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800bb90 con 0x7fc9a015b710 2023-10-06T03:27:39.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.345+0000 7fc99f59e700 1 -- 172.21.15.84:0/290287983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 msgr2=0x7fc9a00cc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.345+0000 7fc99f59e700 1 --2- 172.21.15.84:0/290287983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 0x7fc9a00cc7b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc988009910 tx=0x7fc9880091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.345+0000 7fc99f59e700 1 -- 172.21.15.84:0/290287983 shutdown_connections 2023-10-06T03:27:39.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.345+0000 7fc99f59e700 1 --2- 172.21.15.84:0/290287983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 0x7fc9a00cc7b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.345+0000 7fc99f59e700 1 -- 172.21.15.84:0/290287983 >> 172.21.15.84:0/290287983 conn(0x7fc9a0070f20 msgr2=0x7fc9a00ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:39.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.345+0000 7fc99f59e700 1 -- 172.21.15.84:0/290287983 shutdown_connections 2023-10-06T03:27:39.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.345+0000 7fc99f59e700 1 -- 172.21.15.84:0/290287983 wait complete. 2023-10-06T03:27:39.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.346+0000 7fc99f59e700 1 Processor -- start 2023-10-06T03:27:39.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.346+0000 7fc99f59e700 1 -- start start 2023-10-06T03:27:39.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99f59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9a00c2f70 0x7fc9a00b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99f59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a0157340 0x7fc9a0155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99f59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 0x7fc9a0158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99f59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00b2a30 con 0x7fc9a00c2f70 2023-10-06T03:27:39.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99f59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00b1450 con 0x7fc9a0157340 2023-10-06T03:27:39.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99f59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00b1730 con 0x7fc9a015b710 2023-10-06T03:27:39.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9a00c2f70 0x7fc9a00b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:39.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9a00c2f70 0x7fc9a00b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36180/0 (socket says 172.21.15.84:36180) 2023-10-06T03:27:39.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99e59c700 1 -- 172.21.15.84:0/481237139 learned_addr learned my addr 172.21.15.84:0/481237139 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:39.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc995d9b700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a0157340 0x7fc9a0155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:39.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99ed9d700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 0x7fc9a0158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:39.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99e59c700 1 -- 172.21.15.84:0/481237139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 msgr2=0x7fc9a0158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99e59c700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 0x7fc9a0158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99e59c700 1 -- 172.21.15.84:0/481237139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a0157340 msgr2=0x7fc9a0155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99e59c700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a0157340 0x7fc9a0155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99e59c700 1 -- 172.21.15.84:0/481237139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc988009420 con 0x7fc9a00c2f70 2023-10-06T03:27:39.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc995d9b700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a0157340 0x7fc9a0155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:39.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99e59c700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9a00c2f70 0x7fc9a00b24f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c790 tx=0x7fc990007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:39.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc996ffd700 1 -- 172.21.15.84:0/481237139 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990005b30 con 0x7fc9a00c2f70 2023-10-06T03:27:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc996ffd700 1 -- 172.21.15.84:0/481237139 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990005c90 con 0x7fc9a00c2f70 2023-10-06T03:27:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99f59e700 1 -- 172.21.15.84:0/481237139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a00b1a10 con 0x7fc9a00c2f70 2023-10-06T03:27:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc996ffd700 1 -- 172.21.15.84:0/481237139 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990007300 con 0x7fc9a00c2f70 2023-10-06T03:27:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.347+0000 7fc99f59e700 1 -- 172.21.15.84:0/481237139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a00b1fd0 con 0x7fc9a00c2f70 2023-10-06T03:27:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.348+0000 7fc99f59e700 1 -- 172.21.15.84:0/481237139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a0065e00 con 0x7fc9a00c2f70 2023-10-06T03:27:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.349+0000 7fc996ffd700 1 -- 172.21.15.84:0/481237139 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc99001b3b0 con 0x7fc9a00c2f70 2023-10-06T03:27:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.349+0000 7fc996ffd700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc980066f30 0x7fc9800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.349+0000 7fc995d9b700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc980066f30 0x7fc9800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.349+0000 7fc996ffd700 1 -- 172.21.15.84:0/481237139 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fc990083e40 con 0x7fc9a00c2f70 2023-10-06T03:27:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.350+0000 7fc995d9b700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc980066f30 0x7fc9800693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc988009860 tx=0x7fc988017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:39.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.353+0000 7fc996ffd700 1 -- 172.21.15.84:0/481237139 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc990050d30 con 0x7fc9a00c2f70 2023-10-06T03:27:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.537+0000 7fc99f59e700 1 -- 172.21.15.84:0/481237139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a0071550 con 0x7fc9a00c2f70 2023-10-06T03:27:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.537+0000 7fc996ffd700 1 -- 172.21.15.84:0/481237139 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+17429 (secure 0 0 0) 0x7fc990017020 con 0x7fc9a00c2f70 2023-10-06T03:27:39.539 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:39.540 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":103,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:27:38.549257+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:27:03.480044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:27:04.800908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.e","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6834/169780123":"2023-10-07T03:27:16.359327+0000","172.21.15.131:6832/169780123":"2023-10-07T03:27:16.359327+0000","172.21.15.84:6836/632169803":"2023-10-07T03:27:15.500473+0000","172.21.15.84:6837/632169803":"2023-10-07T03:27:15.500473+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:27:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.539+0000 7fc99f59e700 1 -- 172.21.15.84:0/481237139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc980066f30 msgr2=0x7fc9800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.539+0000 7fc99f59e700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc980066f30 0x7fc9800693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc988009860 tx=0x7fc988017000 comp rx=0 tx=0).stop 2023-10-06T03:27:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.539+0000 7fc99f59e700 1 -- 172.21.15.84:0/481237139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9a00c2f70 msgr2=0x7fc9a00b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.539+0000 7fc99f59e700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9a00c2f70 0x7fc9a00b24f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c790 tx=0x7fc990007ea0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.539+0000 7fc99f59e700 1 -- 172.21.15.84:0/481237139 shutdown_connections 2023-10-06T03:27:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.539+0000 7fc99f59e700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc980066f30 0x7fc9800693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.539+0000 7fc99f59e700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9a015b710 0x7fc9a0158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.539+0000 7fc99f59e700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9a00c2f70 0x7fc9a00b24f0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.539+0000 7fc99f59e700 1 --2- 172.21.15.84:0/481237139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a0157340 0x7fc9a0155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.539+0000 7fc99f59e700 1 -- 172.21.15.84:0/481237139 >> 172.21.15.84:0/481237139 conn(0x7fc9a0070f20 msgr2=0x7fc9a00cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:39.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.540+0000 7fc99f59e700 1 -- 172.21.15.84:0/481237139 shutdown_connections 2023-10-06T03:27:39.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.540+0000 7fc99f59e700 1 -- 172.21.15.84:0/481237139 wait complete. 2023-10-06T03:27:39.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:42.683917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:43.082697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:27:03.480044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:27:04.800908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:27:39.554 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:27:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.671+0000 7fec4ce0f700 1 Processor -- start 2023-10-06T03:27:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.671+0000 7fec4ce0f700 1 -- start start 2023-10-06T03:27:39.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec4ce0f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec4806d900 0x7fec4806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec4ce0f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fec48159170 0x7fec481595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec4ce0f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4815dfc0 con 0x7fec480b24b0 2023-10-06T03:27:39.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec4ce0f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec480b0f40 con 0x7fec4806d900 2023-10-06T03:27:39.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec4ce0f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4815d3f0 con 0x7fec48159170 2023-10-06T03:27:39.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec3dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec4806d900 0x7fec4806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec4659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fec480b24b0 0x7fec480b2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43250/0 (socket says 172.21.15.84:43250) 2023-10-06T03:27:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec4659c700 1 -- 172.21.15.84:0/3814743562 learned_addr learned my addr 172.21.15.84:0/3814743562 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec3dd9b700 1 -- 172.21.15.84:0/3814743562 >> v2:172.21.15.131:3300/0 conn(0x7fec48159170 msgr2=0x7fec481595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec3dd9b700 1 --2- 172.21.15.84:0/3814743562 >> v2:172.21.15.131:3300/0 conn(0x7fec48159170 0x7fec481595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec3dd9b700 1 -- 172.21.15.84:0/3814743562 >> v1:172.21.15.84:6789/0 conn(0x7fec480b24b0 legacy=0x7fec480b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec45d9b700 1 -- 172.21.15.84:0/3814743562 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160055735 0 0) 0x7fec4815dfc0 con 0x7fec480b24b0 2023-10-06T03:27:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.672+0000 7fec3dd9b700 1 -- 172.21.15.84:0/3814743562 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4806e2c0 con 0x7fec4806d900 2023-10-06T03:27:39.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec3dd9b700 1 --2- 172.21.15.84:0/3814743562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4806d900 0x7fec4806dd80 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fec480b2f90 tx=0x7fec300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7bf85a41ed2c0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:39.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec45d9b700 1 -- 172.21.15.84:0/3814743562 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3000b6b0 con 0x7fec4806d900 2023-10-06T03:27:39.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec45d9b700 1 -- 172.21.15.84:0/3814743562 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3000b810 con 0x7fec4806d900 2023-10-06T03:27:39.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec45d9b700 1 -- 172.21.15.84:0/3814743562 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3000bbb0 con 0x7fec4806d900 2023-10-06T03:27:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec4ce0f700 1 -- 172.21.15.84:0/3814743562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4806d900 msgr2=0x7fec4806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec4ce0f700 1 --2- 172.21.15.84:0/3814743562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4806d900 0x7fec4806dd80 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fec480b2f90 tx=0x7fec300091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec4ce0f700 1 -- 172.21.15.84:0/3814743562 shutdown_connections 2023-10-06T03:27:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec4ce0f700 1 --2- 172.21.15.84:0/3814743562 >> v2:172.21.15.131:3300/0 conn(0x7fec48159170 0x7fec481595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec4ce0f700 1 --2- 172.21.15.84:0/3814743562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4806d900 0x7fec4806dd80 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec4ce0f700 1 -- 172.21.15.84:0/3814743562 >> 172.21.15.84:0/3814743562 conn(0x7fec480d0520 msgr2=0x7fec480d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec4ce0f700 1 -- 172.21.15.84:0/3814743562 shutdown_connections 2023-10-06T03:27:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.673+0000 7fec4ce0f700 1 -- 172.21.15.84:0/3814743562 wait complete. 2023-10-06T03:27:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec4ce0f700 1 Processor -- start 2023-10-06T03:27:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec4ce0f700 1 -- start start 2023-10-06T03:27:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec4ce0f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec4806d900 0x7fec481589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec4ce0f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec480b24b0 0x7fec480c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec4ce0f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec48159170 0x7fec480c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec4ce0f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec48169920 con 0x7fec48159170 2023-10-06T03:27:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec4ce0f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec480c83f0 con 0x7fec4806d900 2023-10-06T03:27:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec4ce0f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec480c86d0 con 0x7fec480b24b0 2023-10-06T03:27:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec46d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec48159170 0x7fec480c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec46d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec48159170 0x7fec480c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36192/0 (socket says 172.21.15.84:36192) 2023-10-06T03:27:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.675+0000 7fec46d9d700 1 -- 172.21.15.84:0/2650032238 learned_addr learned my addr 172.21.15.84:0/2650032238 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec4659c700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec4806d900 0x7fec481589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec3dd9b700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec480b24b0 0x7fec480c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec46d9d700 1 -- 172.21.15.84:0/2650032238 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec480b24b0 msgr2=0x7fec480c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec46d9d700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec480b24b0 0x7fec480c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec46d9d700 1 -- 172.21.15.84:0/2650032238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec4806d900 msgr2=0x7fec481589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec46d9d700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec4806d900 0x7fec481589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec46d9d700 1 -- 172.21.15.84:0/2650032238 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec30009420 con 0x7fec48159170 2023-10-06T03:27:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec4659c700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec4806d900 0x7fec481589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec46d9d700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec48159170 0x7fec480c9cb0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fec4000bc30 tx=0x7fec40009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec3effd700 1 -- 172.21.15.84:0/2650032238 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec400092e0 con 0x7fec48159170 2023-10-06T03:27:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec3effd700 1 -- 172.21.15.84:0/2650032238 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4000c7a0 con 0x7fec48159170 2023-10-06T03:27:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec4ce0f700 1 -- 172.21.15.84:0/2650032238 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec480c89b0 con 0x7fec48159170 2023-10-06T03:27:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec3effd700 1 -- 172.21.15.84:0/2650032238 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4000cb80 con 0x7fec48159170 2023-10-06T03:27:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.676+0000 7fec4ce0f700 1 -- 172.21.15.84:0/2650032238 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec48158f20 con 0x7fec48159170 2023-10-06T03:27:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.677+0000 7fec4ce0f700 1 -- 172.21.15.84:0/2650032238 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4804c3c0 con 0x7fec48159170 2023-10-06T03:27:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.677+0000 7fec3effd700 1 -- 172.21.15.84:0/2650032238 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec40012070 con 0x7fec48159170 2023-10-06T03:27:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.678+0000 7fec3effd700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec28066f30 0x7fec280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.678+0000 7fec3effd700 1 -- 172.21.15.84:0/2650032238 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fec400845d0 con 0x7fec48159170 2023-10-06T03:27:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.678+0000 7fec4659c700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec28066f30 0x7fec280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.678+0000 7fec4659c700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec28066f30 0x7fec280693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fec38001890 tx=0x7fec38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:39.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.682+0000 7fec3effd700 1 -- 172.21.15.84:0/2650032238 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec400514c0 con 0x7fec48159170 2023-10-06T03:27:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.863+0000 7fec4ce0f700 1 -- 172.21.15.84:0/2650032238 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec4815d690 con 0x7fec48159170 2023-10-06T03:27:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.864+0000 7fec3effd700 1 -- 172.21.15.84:0/2650032238 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v104) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec40054ae0 con 0x7fec48159170 2023-10-06T03:27:39.866 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:27:39.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.866+0000 7fec4ce0f700 1 -- 172.21.15.84:0/2650032238 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec28066f30 msgr2=0x7fec280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.866+0000 7fec4ce0f700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec28066f30 0x7fec280693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fec38001890 tx=0x7fec38009040 comp rx=0 tx=0).stop 2023-10-06T03:27:39.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.866+0000 7fec4ce0f700 1 -- 172.21.15.84:0/2650032238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec48159170 msgr2=0x7fec480c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.866+0000 7fec4ce0f700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec48159170 0x7fec480c9cb0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fec4000bc30 tx=0x7fec40009840 comp rx=0 tx=0).stop 2023-10-06T03:27:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.866+0000 7fec4ce0f700 1 -- 172.21.15.84:0/2650032238 shutdown_connections 2023-10-06T03:27:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.866+0000 7fec4ce0f700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fec28066f30 0x7fec280693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.866+0000 7fec4ce0f700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec4806d900 0x7fec481589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.866+0000 7fec4ce0f700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec48159170 0x7fec480c9cb0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.866+0000 7fec4ce0f700 1 --2- 172.21.15.84:0/2650032238 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec480b24b0 0x7fec480c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.866+0000 7fec4ce0f700 1 -- 172.21.15.84:0/2650032238 >> 172.21.15.84:0/2650032238 conn(0x7fec480d0520 msgr2=0x7fec480cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.867+0000 7fec4ce0f700 1 -- 172.21.15.84:0/2650032238 shutdown_connections 2023-10-06T03:27:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.867+0000 7fec4ce0f700 1 -- 172.21.15.84:0/2650032238 wait complete. 2023-10-06T03:27:39.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:27:39.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.995+0000 7fef41428700 1 Processor -- start 2023-10-06T03:27:39.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.995+0000 7fef41428700 1 -- start start 2023-10-06T03:27:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.996+0000 7fef41428700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fef3c06d900 0x7fef3c06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.996+0000 7fef41428700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fef3c159170 0x7fef3c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.996+0000 7fef41428700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c15dfc0 con 0x7fef3c0b24b0 2023-10-06T03:27:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.996+0000 7fef41428700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c0b0f40 con 0x7fef3c06d900 2023-10-06T03:27:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.996+0000 7fef41428700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c15d3f0 con 0x7fef3c159170 2023-10-06T03:27:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.996+0000 7fef327fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fef3c06d900 0x7fef3c06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.996+0000 7fef3affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fef3c0b24b0 0x7fef3c0b2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43252/0 (socket says 172.21.15.84:43252) 2023-10-06T03:27:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.996+0000 7fef3affd700 1 -- 172.21.15.84:0/2636459600 learned_addr learned my addr 172.21.15.84:0/2636459600 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef3b7fe700 1 --2- 172.21.15.84:0/2636459600 >> v2:172.21.15.131:3300/0 conn(0x7fef3c159170 0x7fef3c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef327fc700 1 -- 172.21.15.84:0/2636459600 >> v2:172.21.15.131:3300/0 conn(0x7fef3c159170 msgr2=0x7fef3c1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef327fc700 1 --2- 172.21.15.84:0/2636459600 >> v2:172.21.15.131:3300/0 conn(0x7fef3c159170 0x7fef3c1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef327fc700 1 -- 172.21.15.84:0/2636459600 >> v1:172.21.15.84:6789/0 conn(0x7fef3c0b24b0 legacy=0x7fef3c0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef327fc700 1 -- 172.21.15.84:0/2636459600 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c06e2c0 con 0x7fef3c06d900 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef3b7fe700 1 --2- 172.21.15.84:0/2636459600 >> v2:172.21.15.131:3300/0 conn(0x7fef3c159170 0x7fef3c1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef327fc700 1 --2- 172.21.15.84:0/2636459600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c06d900 0x7fef3c06dd80 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0b2f90 tx=0x7fef240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ae6376354ece1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef3a7fc700 1 -- 172.21.15.84:0/2636459600 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400b6b0 con 0x7fef3c06d900 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef3a7fc700 1 -- 172.21.15.84:0/2636459600 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2400b810 con 0x7fef3c06d900 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef3a7fc700 1 -- 172.21.15.84:0/2636459600 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400bbb0 con 0x7fef3c06d900 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef41428700 1 -- 172.21.15.84:0/2636459600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c06d900 msgr2=0x7fef3c06dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef41428700 1 --2- 172.21.15.84:0/2636459600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c06d900 0x7fef3c06dd80 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0b2f90 tx=0x7fef240091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef41428700 1 -- 172.21.15.84:0/2636459600 shutdown_connections 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef41428700 1 --2- 172.21.15.84:0/2636459600 >> v2:172.21.15.131:3300/0 conn(0x7fef3c159170 0x7fef3c1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef41428700 1 --2- 172.21.15.84:0/2636459600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c06d900 0x7fef3c06dd80 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.997+0000 7fef41428700 1 -- 172.21.15.84:0/2636459600 >> 172.21.15.84:0/2636459600 conn(0x7fef3c0d0520 msgr2=0x7fef3c0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.998+0000 7fef41428700 1 -- 172.21.15.84:0/2636459600 shutdown_connections 2023-10-06T03:27:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.998+0000 7fef41428700 1 -- 172.21.15.84:0/2636459600 wait complete. 2023-10-06T03:27:40.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.999+0000 7fef41428700 1 Processor -- start 2023-10-06T03:27:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.999+0000 7fef41428700 1 -- start start 2023-10-06T03:27:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.999+0000 7fef41428700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef3c06d900 0x7fef3c157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.999+0000 7fef41428700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef3c0b24b0 0x7fef3c0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.999+0000 7fef41428700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c159170 0x7fef3c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.999+0000 7fef41428700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c169970 con 0x7fef3c159170 2023-10-06T03:27:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.999+0000 7fef41428700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0c86d0 con 0x7fef3c06d900 2023-10-06T03:27:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:39.999+0000 7fef41428700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0c7e30 con 0x7fef3c0b24b0 2023-10-06T03:27:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef3b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c159170 0x7fef3c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef3b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c159170 0x7fef3c158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36214/0 (socket says 172.21.15.84:36214) 2023-10-06T03:27:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef3b7fe700 1 -- 172.21.15.84:0/2053284721 learned_addr learned my addr 172.21.15.84:0/2053284721 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef3affd700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef3c06d900 0x7fef3c157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef327fc700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef3c0b24b0 0x7fef3c0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef3b7fe700 1 -- 172.21.15.84:0/2053284721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef3c0b24b0 msgr2=0x7fef3c0c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef3b7fe700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef3c0b24b0 0x7fef3c0c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef3b7fe700 1 -- 172.21.15.84:0/2053284721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef3c06d900 msgr2=0x7fef3c157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef3b7fe700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef3c06d900 0x7fef3c157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef3b7fe700 1 -- 172.21.15.84:0/2053284721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef24009420 con 0x7fef3c159170 2023-10-06T03:27:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef3b7fe700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c159170 0x7fef3c158400 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fef3400a380 tx=0x7fef34007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef337fe700 1 -- 172.21.15.84:0/2053284721 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34015440 con 0x7fef3c159170 2023-10-06T03:27:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef337fe700 1 -- 172.21.15.84:0/2053284721 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef340155a0 con 0x7fef3c159170 2023-10-06T03:27:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef41428700 1 -- 172.21.15.84:0/2053284721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c0c8110 con 0x7fef3c159170 2023-10-06T03:27:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef337fe700 1 -- 172.21.15.84:0/2053284721 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34015960 con 0x7fef3c159170 2023-10-06T03:27:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.000+0000 7fef41428700 1 -- 172.21.15.84:0/2053284721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c158070 con 0x7fef3c159170 2023-10-06T03:27:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.001+0000 7fef41428700 1 -- 172.21.15.84:0/2053284721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c04c3c0 con 0x7fef3c159170 2023-10-06T03:27:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.002+0000 7fef337fe700 1 -- 172.21.15.84:0/2053284721 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef3400d440 con 0x7fef3c159170 2023-10-06T03:27:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.002+0000 7fef337fe700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fef1c066f30 0x7fef1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.002+0000 7fef337fe700 1 -- 172.21.15.84:0/2053284721 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fef340853b0 con 0x7fef3c159170 2023-10-06T03:27:40.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.002+0000 7fef3affd700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fef1c066f30 0x7fef1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.002+0000 7fef3affd700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fef1c066f30 0x7fef1c0693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fef2c001950 tx=0x7fef2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.006+0000 7fef337fe700 1 -- 172.21.15.84:0/2053284721 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef340522a0 con 0x7fef3c159170 2023-10-06T03:27:40.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.187+0000 7fef41428700 1 -- 172.21.15.84:0/2053284721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef3c169ab0 con 0x7fef3c159170 2023-10-06T03:27:40.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.187+0000 7fef337fe700 1 -- 172.21.15.84:0/2053284721 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef340558c0 con 0x7fef3c159170 2023-10-06T03:27:40.189 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:27:40.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 -- 172.21.15.84:0/2053284721 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fef1c066f30 msgr2=0x7fef1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fef1c066f30 0x7fef1c0693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fef2c001950 tx=0x7fef2c009040 comp rx=0 tx=0).stop 2023-10-06T03:27:40.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 -- 172.21.15.84:0/2053284721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c159170 msgr2=0x7fef3c158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c159170 0x7fef3c158400 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fef3400a380 tx=0x7fef34007900 comp rx=0 tx=0).stop 2023-10-06T03:27:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 -- 172.21.15.84:0/2053284721 shutdown_connections 2023-10-06T03:27:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fef1c066f30 0x7fef1c0693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef3c06d900 0x7fef3c157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef3c159170 0x7fef3c158400 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 --2- 172.21.15.84:0/2053284721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef3c0b24b0 0x7fef3c0c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 -- 172.21.15.84:0/2053284721 >> 172.21.15.84:0/2053284721 conn(0x7fef3c0d0520 msgr2=0x7fef3c0cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 -- 172.21.15.84:0/2053284721 shutdown_connections 2023-10-06T03:27:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.189+0000 7fef41428700 1 -- 172.21.15.84:0/2053284721 wait complete. 2023-10-06T03:27:40.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:27:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.318+0000 7f2cfea39700 1 Processor -- start 2023-10-06T03:27:40.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.318+0000 7f2cfea39700 1 -- start start 2023-10-06T03:27:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfea39700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2cf806d900 0x7f2cf806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfea39700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cf8159170 0x7f2cf81595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfea39700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf815dfc0 con 0x7f2cf80b24b0 2023-10-06T03:27:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfea39700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf80b0f40 con 0x7f2cf8159170 2023-10-06T03:27:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfea39700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf815d3f0 con 0x7f2cf806d900 2023-10-06T03:27:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfcfd6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cf8159170 0x7f2cf81595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfcfd6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cf8159170 0x7f2cf81595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36230/0 (socket says 172.21.15.84:36230) 2023-10-06T03:27:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfcfd6700 1 -- 172.21.15.84:0/1887252120 learned_addr learned my addr 172.21.15.84:0/1887252120 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cf77fe700 1 --2- 172.21.15.84:0/1887252120 >> v2:172.21.15.131:3300/0 conn(0x7f2cf806d900 0x7f2cf806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfcfd6700 1 -- 172.21.15.84:0/1887252120 >> v2:172.21.15.131:3300/0 conn(0x7f2cf806d900 msgr2=0x7f2cf806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfcfd6700 1 --2- 172.21.15.84:0/1887252120 >> v2:172.21.15.131:3300/0 conn(0x7f2cf806d900 0x7f2cf806dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfcfd6700 1 -- 172.21.15.84:0/1887252120 >> v1:172.21.15.131:6789/0 conn(0x7f2cf80b24b0 legacy=0x7f2cf80b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfcfd6700 1 -- 172.21.15.84:0/1887252120 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf806e2c0 con 0x7f2cf8159170 2023-10-06T03:27:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cfcfd6700 1 --2- 172.21.15.84:0/1887252120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf8159170 0x7f2cf81595a0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80d0480 tx=0x7f2cf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7706fca2fde82c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cf6ffd700 1 -- 172.21.15.84:0/1887252120 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000e070 con 0x7f2cf8159170 2023-10-06T03:27:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cf6ffd700 1 -- 172.21.15.84:0/1887252120 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf000ba50 con 0x7f2cf8159170 2023-10-06T03:27:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.319+0000 7f2cf6ffd700 1 -- 172.21.15.84:0/1887252120 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00092e0 con 0x7f2cf8159170 2023-10-06T03:27:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.320+0000 7f2cfea39700 1 -- 172.21.15.84:0/1887252120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf8159170 msgr2=0x7f2cf81595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.320+0000 7f2cfea39700 1 --2- 172.21.15.84:0/1887252120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf8159170 0x7f2cf81595a0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80d0480 tx=0x7f2cf0009840 comp rx=0 tx=0).stop 2023-10-06T03:27:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.320+0000 7f2cfea39700 1 -- 172.21.15.84:0/1887252120 shutdown_connections 2023-10-06T03:27:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.320+0000 7f2cfea39700 1 --2- 172.21.15.84:0/1887252120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf8159170 0x7f2cf81595a0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.320+0000 7f2cfea39700 1 --2- 172.21.15.84:0/1887252120 >> v2:172.21.15.131:3300/0 conn(0x7f2cf806d900 0x7f2cf806dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.320+0000 7f2cfea39700 1 -- 172.21.15.84:0/1887252120 >> 172.21.15.84:0/1887252120 conn(0x7f2cf80d0520 msgr2=0x7f2cf80d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.320+0000 7f2cfea39700 1 -- 172.21.15.84:0/1887252120 shutdown_connections 2023-10-06T03:27:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.320+0000 7f2cfea39700 1 -- 172.21.15.84:0/1887252120 wait complete. 2023-10-06T03:27:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.321+0000 7f2cfea39700 1 Processor -- start 2023-10-06T03:27:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.321+0000 7f2cfea39700 1 -- start start 2023-10-06T03:27:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cfea39700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cf806d900 0x7f2cf80a7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cfea39700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf80b24b0 0x7f2cf80c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cfea39700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf8159170 0x7f2cf8158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cfea39700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf815bfa0 con 0x7f2cf80b24b0 2023-10-06T03:27:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cfea39700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf815b700 con 0x7f2cf8159170 2023-10-06T03:27:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cfea39700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf815b9e0 con 0x7f2cf806d900 2023-10-06T03:27:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf80b24b0 0x7f2cf80c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf80b24b0 0x7f2cf80c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36242/0 (socket says 172.21.15.84:36242) 2023-10-06T03:27:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cf77fe700 1 -- 172.21.15.84:0/3521457206 learned_addr learned my addr 172.21.15.84:0/3521457206 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cf7fff700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cf806d900 0x7f2cf80a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cfcfd6700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf8159170 0x7f2cf8158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cf77fe700 1 -- 172.21.15.84:0/3521457206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cf806d900 msgr2=0x7f2cf80a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cf77fe700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cf806d900 0x7f2cf80a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cf77fe700 1 -- 172.21.15.84:0/3521457206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf8159170 msgr2=0x7f2cf8158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cf77fe700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf8159170 0x7f2cf8158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cf77fe700 1 -- 172.21.15.84:0/3521457206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0009ae0 con 0x7f2cf80b24b0 2023-10-06T03:27:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.322+0000 7f2cf77fe700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf80b24b0 0x7f2cf80c98d0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00d860 tx=0x7f2cec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.323+0000 7f2cdffff700 1 -- 172.21.15.84:0/3521457206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec009610 con 0x7f2cf80b24b0 2023-10-06T03:27:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.323+0000 7f2cdffff700 1 -- 172.21.15.84:0/3521457206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec009770 con 0x7f2cf80b24b0 2023-10-06T03:27:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.323+0000 7f2cfea39700 1 -- 172.21.15.84:0/3521457206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf815bcc0 con 0x7f2cf80b24b0 2023-10-06T03:27:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.323+0000 7f2cdffff700 1 -- 172.21.15.84:0/3521457206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec009b30 con 0x7f2cf80b24b0 2023-10-06T03:27:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.323+0000 7f2cfea39700 1 -- 172.21.15.84:0/3521457206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf80a7ac0 con 0x7f2cf80b24b0 2023-10-06T03:27:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.324+0000 7f2cfea39700 1 -- 172.21.15.84:0/3521457206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf8169870 con 0x7f2cf80b24b0 2023-10-06T03:27:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.324+0000 7f2cdffff700 1 -- 172.21.15.84:0/3521457206 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cec01e460 con 0x7f2cf80b24b0 2023-10-06T03:27:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.324+0000 7f2cdffff700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ce4066f30 0x7f2ce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.324+0000 7f2cdffff700 1 -- 172.21.15.84:0/3521457206 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f2cec084f20 con 0x7f2cf80b24b0 2023-10-06T03:27:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.324+0000 7f2cf7fff700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ce4066f30 0x7f2ce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.325+0000 7f2cf7fff700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ce4066f30 0x7f2ce40693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80037c0 tx=0x7f2ce8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.329+0000 7f2cdffff700 1 -- 172.21.15.84:0/3521457206 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cec051e10 con 0x7f2cf80b24b0 2023-10-06T03:27:40.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.511+0000 7f2cfea39700 1 -- 172.21.15.84:0/3521457206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cf804c3c0 con 0x7f2cf80b24b0 2023-10-06T03:27:40.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.511+0000 7f2cdffff700 1 -- 172.21.15.84:0/3521457206 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cec055430 con 0x7f2cf80b24b0 2023-10-06T03:27:40.513 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:27:40.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 -- 172.21.15.84:0/3521457206 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ce4066f30 msgr2=0x7f2ce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ce4066f30 0x7f2ce40693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80037c0 tx=0x7f2ce8009040 comp rx=0 tx=0).stop 2023-10-06T03:27:40.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 -- 172.21.15.84:0/3521457206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf80b24b0 msgr2=0x7f2cf80c98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf80b24b0 0x7f2cf80c98d0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00d860 tx=0x7f2cec008040 comp rx=0 tx=0).stop 2023-10-06T03:27:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 -- 172.21.15.84:0/3521457206 shutdown_connections 2023-10-06T03:27:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2ce4066f30 0x7f2ce40693e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf8159170 0x7f2cf8158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cf806d900 0x7f2cf80a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 --2- 172.21.15.84:0/3521457206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf80b24b0 0x7f2cf80c98d0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 -- 172.21.15.84:0/3521457206 >> 172.21.15.84:0/3521457206 conn(0x7f2cf80d0520 msgr2=0x7f2cf80af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 -- 172.21.15.84:0/3521457206 shutdown_connections 2023-10-06T03:27:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.513+0000 7f2cfea39700 1 -- 172.21.15.84:0/3521457206 wait complete. 2023-10-06T03:27:40.527 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:27:40.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.643+0000 7f22f1970700 1 Processor -- start 2023-10-06T03:27:40.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.643+0000 7f22f1970700 1 -- start start 2023-10-06T03:27:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.644+0000 7f22f1970700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22ec06d900 0x7f22ec06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.644+0000 7f22f1970700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f22ec159170 0x7f22ec1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.644+0000 7f22f1970700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec15dfc0 con 0x7f22ec0b24b0 2023-10-06T03:27:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.644+0000 7f22f1970700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec0b0f40 con 0x7f22ec159170 2023-10-06T03:27:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.644+0000 7f22f1970700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec15d3f0 con 0x7f22ec06d900 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.644+0000 7f22eaffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f22ec0b24b0 0x7f22ec0b2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54478/0 (socket says 172.21.15.84:54478) 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.644+0000 7f22eaffd700 1 -- 172.21.15.84:0/3909937718 learned_addr learned my addr 172.21.15.84:0/3909937718 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.644+0000 7f22eb7fe700 1 --2- 172.21.15.84:0/3909937718 >> v2:172.21.15.131:3300/0 conn(0x7f22ec159170 0x7f22ec1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.644+0000 7f22e27fc700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22ec06d900 0x7f22ec06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167266787 0 0) 0x7f22ec15dfc0 con 0x7f22ec0b24b0 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d8003570 con 0x7f22ec0b24b0 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 140235231 0 0) 0x7f22d8003570 con 0x7f22ec0b24b0 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22ec06d900 msgr2=0x7f22ec06dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22ec06d900 0x7f22ec06dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 >> v2:172.21.15.131:3300/0 conn(0x7f22ec159170 msgr2=0x7f22ec1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 --2- 172.21.15.84:0/3909937718 >> v2:172.21.15.131:3300/0 conn(0x7f22ec159170 0x7f22ec1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec15d690 con 0x7f22ec0b24b0 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f22dc001470 con 0x7f22ec0b24b0 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 >> v1:172.21.15.84:6789/0 conn(0x7f22ec0b24b0 legacy=0x7f22ec0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22d8003a60 0x7f22d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d8004810 0x7f22d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22d80051c0 0x7f22d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0b0f40 con 0x7f22d8003a60 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec15d3f0 con 0x7f22d80051c0 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d800bfa0 con 0x7f22d8004810 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22e27fc700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22ec06d900 0x7f22ec06dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22eb7fe700 1 --2- 172.21.15.84:0/3909937718 >> v2:172.21.15.131:3300/0 conn(0x7f22ec159170 0x7f22ec1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22eaffd700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22d8003a60 0x7f22d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22e27fc700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d8004810 0x7f22d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22eb7fe700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22d80051c0 0x7f22d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22eaffd700 1 -- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d8004810 msgr2=0x7f22d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22eaffd700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d8004810 0x7f22d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22eaffd700 1 -- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22d80051c0 msgr2=0x7f22d800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22eaffd700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22d80051c0 0x7f22d800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22eaffd700 1 -- 172.21.15.84:0/3909937718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8003570 con 0x7f22d8003a60 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22eb7fe700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22d80051c0 0x7f22d800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.645+0000 7f22eaffd700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22d8003a60 0x7f22d8003e70 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00c3f0 tx=0x7f22dc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb226eaeb69a58bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.646+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc00cc20 con 0x7f22d8003a60 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.646+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc00cda0 con 0x7f22d8003a60 2023-10-06T03:27:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.646+0000 7f22ea7fc700 1 -- 172.21.15.84:0/3909937718 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc005b70 con 0x7f22d8003a60 2023-10-06T03:27:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.646+0000 7f22f1970700 1 -- 172.21.15.84:0/3909937718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22d8003a60 msgr2=0x7f22d8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.646+0000 7f22f1970700 1 --2- 172.21.15.84:0/3909937718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22d8003a60 0x7f22d8003e70 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00c3f0 tx=0x7f22dc001e90 comp rx=0 tx=0).stop 2023-10-06T03:27:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.646+0000 7f22eb7fe700 1 -- 172.21.15.84:0/3909937718 reap_dead start 2023-10-06T03:27:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.646+0000 7f22f1970700 1 -- 172.21.15.84:0/3909937718 shutdown_connections 2023-10-06T03:27:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.646+0000 7f22f1970700 1 -- 172.21.15.84:0/3909937718 >> 172.21.15.84:0/3909937718 conn(0x7f22ec0d0520 msgr2=0x7f22ec0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.646+0000 7f22f1970700 1 -- 172.21.15.84:0/3909937718 shutdown_connections 2023-10-06T03:27:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.646+0000 7f22f1970700 1 -- 172.21.15.84:0/3909937718 wait complete. 2023-10-06T03:27:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.647+0000 7f22f1970700 1 Processor -- start 2023-10-06T03:27:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.647+0000 7f22f1970700 1 -- start start 2023-10-06T03:27:40.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22f1970700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d8003a60 0x7f22ec1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22f1970700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22ec0c8670 0x7f22ec0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22f1970700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ec169a00 0x7f22ec169e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22f1970700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec16a390 con 0x7f22ec169a00 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22f1970700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0c81e0 con 0x7f22ec0c8670 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22f1970700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0c75d0 con 0x7f22d8003a60 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22eb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ec169a00 0x7f22ec169e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22eb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ec169a00 0x7f22ec169e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44504/0 (socket says 172.21.15.84:44504) 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22eb7fe700 1 -- 172.21.15.84:0/4272411757 learned_addr learned my addr 172.21.15.84:0/4272411757 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22eaffd700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d8003a60 0x7f22ec1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22e27fc700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22ec0c8670 0x7f22ec0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.648+0000 7f22eb7fe700 1 -- 172.21.15.84:0/4272411757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d8003a60 msgr2=0x7f22ec1589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.649+0000 7f22eb7fe700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d8003a60 0x7f22ec1589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.649+0000 7f22eb7fe700 1 -- 172.21.15.84:0/4272411757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22ec0c8670 msgr2=0x7f22ec0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.649+0000 7f22eb7fe700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22ec0c8670 0x7f22ec0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.649+0000 7f22eb7fe700 1 -- 172.21.15.84:0/4272411757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0c78b0 con 0x7f22ec169a00 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.649+0000 7f22eb7fe700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ec169a00 0x7f22ec169e50 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0d1590 tx=0x7f22e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.649+0000 7f22e37fe700 1 -- 172.21.15.84:0/4272411757 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e400fcd0 con 0x7f22ec169a00 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.649+0000 7f22e37fe700 1 -- 172.21.15.84:0/4272411757 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e400fe30 con 0x7f22ec169a00 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.649+0000 7f22f1970700 1 -- 172.21.15.84:0/4272411757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec0c7b90 con 0x7f22ec169a00 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.649+0000 7f22e37fe700 1 -- 172.21.15.84:0/4272411757 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4016650 con 0x7f22ec169a00 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.649+0000 7f22f1970700 1 -- 172.21.15.84:0/4272411757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec158ef0 con 0x7f22ec169a00 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.650+0000 7f22f1970700 1 -- 172.21.15.84:0/4272411757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec04c3c0 con 0x7f22ec169a00 2023-10-06T03:27:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.650+0000 7f22e37fe700 1 -- 172.21.15.84:0/4272411757 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22e4016a40 con 0x7f22ec169a00 2023-10-06T03:27:40.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.650+0000 7f22e37fe700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f22cc066f30 0x7f22cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.651+0000 7f22e37fe700 1 -- 172.21.15.84:0/4272411757 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f22e40852b0 con 0x7f22ec169a00 2023-10-06T03:27:40.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.651+0000 7f22eaffd700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f22cc066f30 0x7f22cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.651+0000 7f22eaffd700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f22cc066f30 0x7f22cc0693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f22dc001ed0 tx=0x7f22dc015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.655+0000 7f22e37fe700 1 -- 172.21.15.84:0/4272411757 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22e4052260 con 0x7f22ec169a00 2023-10-06T03:27:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.837+0000 7f22f1970700 1 -- 172.21.15.84:0/4272411757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22ec15d970 con 0x7f22ec169a00 2023-10-06T03:27:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.837+0000 7f22e37fe700 1 -- 172.21.15.84:0/4272411757 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22e4055880 con 0x7f22ec169a00 2023-10-06T03:27:40.839 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:27:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.839+0000 7f22f1970700 1 -- 172.21.15.84:0/4272411757 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f22cc066f30 msgr2=0x7f22cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.839+0000 7f22f1970700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f22cc066f30 0x7f22cc0693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f22dc001ed0 tx=0x7f22dc015000 comp rx=0 tx=0).stop 2023-10-06T03:27:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.839+0000 7f22f1970700 1 -- 172.21.15.84:0/4272411757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ec169a00 msgr2=0x7f22ec169e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.839+0000 7f22f1970700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ec169a00 0x7f22ec169e50 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0d1590 tx=0x7f22e400b040 comp rx=0 tx=0).stop 2023-10-06T03:27:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.839+0000 7f22f1970700 1 -- 172.21.15.84:0/4272411757 shutdown_connections 2023-10-06T03:27:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.839+0000 7f22f1970700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f22cc066f30 0x7f22cc0693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.839+0000 7f22f1970700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ec169a00 0x7f22ec169e50 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.839+0000 7f22f1970700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d8003a60 0x7f22ec1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.839+0000 7f22f1970700 1 --2- 172.21.15.84:0/4272411757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22ec0c8670 0x7f22ec0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.839+0000 7f22f1970700 1 -- 172.21.15.84:0/4272411757 >> 172.21.15.84:0/4272411757 conn(0x7f22ec0d0520 msgr2=0x7f22ec0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:40.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.840+0000 7f22f1970700 1 -- 172.21.15.84:0/4272411757 shutdown_connections 2023-10-06T03:27:40.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.840+0000 7f22f1970700 1 -- 172.21.15.84:0/4272411757 wait complete. 2023-10-06T03:27:40.854 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.966+0000 7f961e15e700 1 Processor -- start 2023-10-06T03:27:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.966+0000 7f961e15e700 1 -- start start 2023-10-06T03:27:40.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f961e15e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96180b3760 0x7f96180b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f961e15e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f961815d380 0x7f961809a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f961e15e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96180b4480 con 0x7f96180b6380 2023-10-06T03:27:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f961e15e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180b4760 con 0x7f96180b3760 2023-10-06T03:27:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f961e15e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180b4a40 con 0x7f961815d380 2023-10-06T03:27:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f96177fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96180b3760 0x7f96180b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f9616ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f96180b6380 0x7f961815cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54490/0 (socket says 172.21.15.84:54490) 2023-10-06T03:27:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f96177fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96180b3760 0x7f96180b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44506/0 (socket says 172.21.15.84:44506) 2023-10-06T03:27:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f9616ffd700 1 -- 172.21.15.84:0/2403676530 learned_addr learned my addr 172.21.15.84:0/2403676530 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f9617fff700 1 --2- 172.21.15.84:0/2403676530 >> v2:172.21.15.131:3300/0 conn(0x7f961815d380 0x7f961809a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f96177fe700 1 -- 172.21.15.84:0/2403676530 >> v2:172.21.15.131:3300/0 conn(0x7f961815d380 msgr2=0x7f961809a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f96177fe700 1 --2- 172.21.15.84:0/2403676530 >> v2:172.21.15.131:3300/0 conn(0x7f961815d380 0x7f961809a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f96177fe700 1 -- 172.21.15.84:0/2403676530 >> v1:172.21.15.84:6789/0 conn(0x7f96180b6380 legacy=0x7f961815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.967+0000 7f96177fe700 1 -- 172.21.15.84:0/2403676530 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961809a430 con 0x7f96180b3760 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f96177fe700 1 --2- 172.21.15.84:0/2403676530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 0x7f96180b3b30 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f96180b5790 tx=0x7f9608009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975dfb3bd8bcba27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f96167fc700 1 -- 172.21.15.84:0/2403676530 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800e070 con 0x7f96180b3760 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f96167fc700 1 -- 172.21.15.84:0/2403676530 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960800bc30 con 0x7f96180b3760 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f96167fc700 1 -- 172.21.15.84:0/2403676530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608012430 con 0x7f96180b3760 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f961e15e700 1 -- 172.21.15.84:0/2403676530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 msgr2=0x7f96180b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f961e15e700 1 --2- 172.21.15.84:0/2403676530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 0x7f96180b3b30 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f96180b5790 tx=0x7f9608009780 comp rx=0 tx=0).stop 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f961e15e700 1 -- 172.21.15.84:0/2403676530 shutdown_connections 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f961e15e700 1 --2- 172.21.15.84:0/2403676530 >> v2:172.21.15.131:3300/0 conn(0x7f961815d380 0x7f961809a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f961e15e700 1 --2- 172.21.15.84:0/2403676530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 0x7f96180b3b30 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f961e15e700 1 -- 172.21.15.84:0/2403676530 >> 172.21.15.84:0/2403676530 conn(0x7f961806cc30 msgr2=0x7f96180d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f961e15e700 1 -- 172.21.15.84:0/2403676530 shutdown_connections 2023-10-06T03:27:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.968+0000 7f961e15e700 1 -- 172.21.15.84:0/2403676530 wait complete. 2023-10-06T03:27:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.969+0000 7f961e15e700 1 Processor -- start 2023-10-06T03:27:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f961e15e700 1 -- start start 2023-10-06T03:27:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f961e15e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 0x7f96180ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f961e15e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96180b6380 0x7f96180d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f961e15e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f961815d380 0x7f961815f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f961e15e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180acab0 con 0x7f96180b3760 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f961e15e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180acd90 con 0x7f96180b6380 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f961e15e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96180ad070 con 0x7f961815d380 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f96177fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 0x7f96180ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f96177fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 0x7f96180ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44522/0 (socket says 172.21.15.84:44522) 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f96177fe700 1 -- 172.21.15.84:0/697534777 learned_addr learned my addr 172.21.15.84:0/697534777 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.970+0000 7f9617fff700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f961815d380 0x7f961815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f9616ffd700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96180b6380 0x7f96180d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f96177fe700 1 -- 172.21.15.84:0/697534777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f961815d380 msgr2=0x7f961815f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f96177fe700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f961815d380 0x7f961815f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f96177fe700 1 -- 172.21.15.84:0/697534777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96180b6380 msgr2=0x7f96180d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f96177fe700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96180b6380 0x7f96180d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f96177fe700 1 -- 172.21.15.84:0/697534777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608009a20 con 0x7f96180b3760 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f96177fe700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 0x7f96180ac090 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f96080099f0 tx=0x7f9608019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f95ff7fe700 1 -- 172.21.15.84:0/697534777 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608012e80 con 0x7f96180b3760 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f95ff7fe700 1 -- 172.21.15.84:0/697534777 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608027470 con 0x7f96180b3760 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f961e15e700 1 -- 172.21.15.84:0/697534777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96180ad350 con 0x7f96180b3760 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f95ff7fe700 1 -- 172.21.15.84:0/697534777 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608027810 con 0x7f96180b3760 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.971+0000 7f961e15e700 1 -- 172.21.15.84:0/697534777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96180ad910 con 0x7f96180b3760 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.972+0000 7f961e15e700 1 -- 172.21.15.84:0/697534777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961804c3c0 con 0x7f96180b3760 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.972+0000 7f95ff7fe700 1 -- 172.21.15.84:0/697534777 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9608024070 con 0x7f96180b3760 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.973+0000 7f95ff7fe700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9604066fb0 0x7f9604069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.973+0000 7f9616ffd700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9604066fb0 0x7f9604069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:40.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.973+0000 7f95ff7fe700 1 -- 172.21.15.84:0/697534777 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f9608087430 con 0x7f96180b3760 2023-10-06T03:27:40.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.973+0000 7f9616ffd700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9604066fb0 0x7f9604069460 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f96180b67a0 tx=0x7f960c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:40.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:40.977+0000 7f95ff7fe700 1 -- 172.21.15.84:0/697534777 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96080542a0 con 0x7f96180b3760 2023-10-06T03:27:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.201+0000 7f961e15e700 1 -- 172.21.15.84:0/697534777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96180b4d20 con 0x7f96180b3760 2023-10-06T03:27:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.201+0000 7f95ff7fe700 1 -- 172.21.15.84:0/697534777 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4619 (secure 0 0 0) 0x7f96080578c0 con 0x7f96180b3760 2023-10-06T03:27:41.203 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:41.203 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3912722771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3912722771},{"type":"v1","addr":"172.21.15.131:6833","nonce":3912722771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6382,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4017009844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4017009844},{"type":"v1","addr":"172.21.15.131:6835","nonce":4017009844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:31.536601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7167,"mds_1":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"a","rank":1,"incarnation":64,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6835/3193918731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3193918731},{"type":"v1","addr":"172.21.15.84:6835","nonce":3193918731}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7167":{"gid":7167,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/573778757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":573778757},{"type":"v1","addr":"172.21.15.84:6837","nonce":573778757}]},"join_fscid":-1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:41.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 -- 172.21.15.84:0/697534777 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9604066fb0 msgr2=0x7f9604069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9604066fb0 0x7f9604069460 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f96180b67a0 tx=0x7f960c009040 comp rx=0 tx=0).stop 2023-10-06T03:27:41.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 -- 172.21.15.84:0/697534777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 msgr2=0x7f96180ac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 0x7f96180ac090 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f96080099f0 tx=0x7f9608019000 comp rx=0 tx=0).stop 2023-10-06T03:27:41.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 -- 172.21.15.84:0/697534777 shutdown_connections 2023-10-06T03:27:41.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9604066fb0 0x7f9604069460 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f961815d380 0x7f961815f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96180b3760 0x7f96180ac090 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 --2- 172.21.15.84:0/697534777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96180b6380 0x7f96180d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 -- 172.21.15.84:0/697534777 >> 172.21.15.84:0/697534777 conn(0x7f961806cc30 msgr2=0x7f961809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:41.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 -- 172.21.15.84:0/697534777 shutdown_connections 2023-10-06T03:27:41.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.203+0000 7f961e15e700 1 -- 172.21.15.84:0/697534777 wait complete. 2023-10-06T03:27:41.207 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 66 2023-10-06T03:27:41.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:27:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.329+0000 7fafcb1d3700 1 Processor -- start 2023-10-06T03:27:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.329+0000 7fafcb1d3700 1 -- start start 2023-10-06T03:27:41.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafcb1d3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fafc40af550 0x7fafc415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafcb1d3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafc40cfd90 0x7fafc406c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafcb1d3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40d01c0 con 0x7fafc40af920 2023-10-06T03:27:41.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafcb1d3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc40cecf0 con 0x7fafc40af550 2023-10-06T03:27:41.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafcb1d3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40cefd0 con 0x7fafc40cfd90 2023-10-06T03:27:41.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafca1d1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fafc40af550 0x7fafc415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafca1d1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fafc40af550 0x7fafc415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44530/0 (socket says 172.21.15.84:44530) 2023-10-06T03:27:41.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafca1d1700 1 -- 172.21.15.84:0/2792073519 learned_addr learned my addr 172.21.15.84:0/2792073519 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:41.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafca9d2700 1 --2- 172.21.15.84:0/2792073519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafc40cfd90 0x7fafc406c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafca1d1700 1 -- 172.21.15.84:0/2792073519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafc40cfd90 msgr2=0x7fafc406c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafca1d1700 1 --2- 172.21.15.84:0/2792073519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafc40cfd90 0x7fafc406c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafca1d1700 1 -- 172.21.15.84:0/2792073519 >> v1:172.21.15.131:6789/0 conn(0x7fafc40af920 legacy=0x7fafc40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafca1d1700 1 -- 172.21.15.84:0/2792073519 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40cf2b0 con 0x7fafc40af550 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafca1d1700 1 --2- 172.21.15.84:0/2792073519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af550 0x7fafc415a5e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009f20 tx=0x7fafc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb90d27553bc141 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafc91cf700 1 -- 172.21.15.84:0/2792073519 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc000e070 con 0x7fafc40af550 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafc91cf700 1 -- 172.21.15.84:0/2792073519 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc000ba80 con 0x7fafc40af550 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.330+0000 7fafc91cf700 1 -- 172.21.15.84:0/2792073519 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00092e0 con 0x7fafc40af550 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.331+0000 7fafcb1d3700 1 -- 172.21.15.84:0/2792073519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af550 msgr2=0x7fafc415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.331+0000 7fafcb1d3700 1 --2- 172.21.15.84:0/2792073519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af550 0x7fafc415a5e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009f20 tx=0x7fafc0009840 comp rx=0 tx=0).stop 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.331+0000 7fafcb1d3700 1 -- 172.21.15.84:0/2792073519 shutdown_connections 2023-10-06T03:27:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.331+0000 7fafcb1d3700 1 --2- 172.21.15.84:0/2792073519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafc40cfd90 0x7fafc406c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.331+0000 7fafcb1d3700 1 --2- 172.21.15.84:0/2792073519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af550 0x7fafc415a5e0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.331+0000 7fafcb1d3700 1 -- 172.21.15.84:0/2792073519 >> 172.21.15.84:0/2792073519 conn(0x7fafc40d0360 msgr2=0x7fafc40d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:41.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.331+0000 7fafcb1d3700 1 -- 172.21.15.84:0/2792073519 shutdown_connections 2023-10-06T03:27:41.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.331+0000 7fafcb1d3700 1 -- 172.21.15.84:0/2792073519 wait complete. 2023-10-06T03:27:41.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.332+0000 7fafcb1d3700 1 Processor -- start 2023-10-06T03:27:41.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.332+0000 7fafcb1d3700 1 -- start start 2023-10-06T03:27:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafcb1d3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafc40af550 0x7fafc416e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafcb1d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af920 0x7fafc40b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafcb1d3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafc40cfd90 0x7fafc41512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafcb1d3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc415fb20 con 0x7fafc40af920 2023-10-06T03:27:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafcb1d3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc416ed00 con 0x7fafc40af550 2023-10-06T03:27:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafcb1d3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc415ef10 con 0x7fafc40cfd90 2023-10-06T03:27:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafc99d0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af920 0x7fafc40b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafca1d1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafc40af550 0x7fafc416e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafc99d0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af920 0x7fafc40b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44532/0 (socket says 172.21.15.84:44532) 2023-10-06T03:27:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafc99d0700 1 -- 172.21.15.84:0/3397609896 learned_addr learned my addr 172.21.15.84:0/3397609896 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafca9d2700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafc40cfd90 0x7fafc41512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafc99d0700 1 -- 172.21.15.84:0/3397609896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafc40cfd90 msgr2=0x7fafc41512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafc99d0700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafc40cfd90 0x7fafc41512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafc99d0700 1 -- 172.21.15.84:0/3397609896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafc40af550 msgr2=0x7fafc416e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafc99d0700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafc40af550 0x7fafc416e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafc99d0700 1 -- 172.21.15.84:0/3397609896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0009ae0 con 0x7fafc40af920 2023-10-06T03:27:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafc99d0700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af920 0x7fafc40b5430 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fafb400c590 tx=0x7fafb400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafba7fc700 1 -- 172.21.15.84:0/3397609896 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011590 con 0x7fafc40af920 2023-10-06T03:27:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafba7fc700 1 -- 172.21.15.84:0/3397609896 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb4011710 con 0x7fafc40af920 2023-10-06T03:27:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafcb1d3700 1 -- 172.21.15.84:0/3397609896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc415f1f0 con 0x7fafc40af920 2023-10-06T03:27:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafba7fc700 1 -- 172.21.15.84:0/3397609896 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011ad0 con 0x7fafc40af920 2023-10-06T03:27:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.333+0000 7fafcb1d3700 1 -- 172.21.15.84:0/3397609896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc415f7b0 con 0x7fafc40af920 2023-10-06T03:27:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.334+0000 7fafcb1d3700 1 -- 172.21.15.84:0/3397609896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc415fcd0 con 0x7fafc40af920 2023-10-06T03:27:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.335+0000 7fafba7fc700 1 -- 172.21.15.84:0/3397609896 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafb401b3b0 con 0x7fafc40af920 2023-10-06T03:27:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.335+0000 7fafba7fc700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fafa8066f30 0x7fafa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.335+0000 7fafca1d1700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fafa8066f30 0x7fafa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.335+0000 7fafba7fc700 1 -- 172.21.15.84:0/3397609896 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fafb4083b30 con 0x7fafc40af920 2023-10-06T03:27:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.336+0000 7fafca1d1700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fafa8066f30 0x7fafa80693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009880 tx=0x7fafc0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.339+0000 7fafba7fc700 1 -- 172.21.15.84:0/3397609896 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafc415fcd0 con 0x7fafc40af920 2023-10-06T03:27:41.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.524+0000 7fafcb1d3700 1 -- 172.21.15.84:0/3397609896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafc40d01c0 con 0x7fafc40af920 2023-10-06T03:27:41.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.525+0000 7fafba7fc700 1 -- 172.21.15.84:0/3397609896 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+17430 (secure 0 0 0) 0x7fafc40d01c0 con 0x7fafc40af920 2023-10-06T03:27:41.527 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:41.527 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":104,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:27:39.557740+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:27:03.480044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:27:04.800908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.e","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6834/169780123":"2023-10-07T03:27:16.359327+0000","172.21.15.131:6832/169780123":"2023-10-07T03:27:16.359327+0000","172.21.15.84:6836/632169803":"2023-10-07T03:27:15.500473+0000","172.21.15.84:6837/632169803":"2023-10-07T03:27:15.500473+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 -- 172.21.15.84:0/3397609896 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fafa8066f30 msgr2=0x7fafa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fafa8066f30 0x7fafa80693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009880 tx=0x7fafc0018000 comp rx=0 tx=0).stop 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 -- 172.21.15.84:0/3397609896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af920 msgr2=0x7fafc40b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af920 0x7fafc40b5430 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fafb400c590 tx=0x7fafb400c8a0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 -- 172.21.15.84:0/3397609896 shutdown_connections 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fafa8066f30 0x7fafa80693e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafc40af550 0x7fafc416e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafc40cfd90 0x7fafc41512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 --2- 172.21.15.84:0/3397609896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc40af920 0x7fafc40b5430 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 -- 172.21.15.84:0/3397609896 >> 172.21.15.84:0/3397609896 conn(0x7fafc40d0360 msgr2=0x7fafc415b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 -- 172.21.15.84:0/3397609896 shutdown_connections 2023-10-06T03:27:41.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.527+0000 7fafcb1d3700 1 -- 172.21.15.84:0/3397609896 wait complete. 2023-10-06T03:27:41.541 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:27:41.541 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:41.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.654+0000 7fc4fca4d700 1 Processor -- start 2023-10-06T03:27:41.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.654+0000 7fc4fca4d700 1 -- start start 2023-10-06T03:27:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4fca4d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f80b3760 0x7fc4f80b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4fca4d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4f815d380 0x7fc4f809a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4fca4d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f80b4480 con 0x7fc4f80b6380 2023-10-06T03:27:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4fca4d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f80b4760 con 0x7fc4f815d380 2023-10-06T03:27:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4fca4d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80b4a40 con 0x7fc4f80b3760 2023-10-06T03:27:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4f815d380 0x7fc4f809a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f5d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc4f80b6380 0x7fc4f815cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54494/0 (socket says 172.21.15.84:54494) 2023-10-06T03:27:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4f815d380 0x7fc4f809a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44542/0 (socket says 172.21.15.84:44542) 2023-10-06T03:27:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f5d9b700 1 -- 172.21.15.84:0/1616962424 learned_addr learned my addr 172.21.15.84:0/1616962424 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f659c700 1 --2- 172.21.15.84:0/1616962424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f80b3760 0x7fc4f80b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f6d9d700 1 -- 172.21.15.84:0/1616962424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f80b3760 msgr2=0x7fc4f80b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f6d9d700 1 --2- 172.21.15.84:0/1616962424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f80b3760 0x7fc4f80b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f6d9d700 1 -- 172.21.15.84:0/1616962424 >> v1:172.21.15.84:6789/0 conn(0x7fc4f80b6380 legacy=0x7fc4f815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f6d9d700 1 -- 172.21.15.84:0/1616962424 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f809a430 con 0x7fc4f815d380 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f559a700 1 -- 172.21.15.84:0/1616962424 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180036769 0 0) 0x7fc4f80b4480 con 0x7fc4f80b6380 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f659c700 1 --2- 172.21.15.84:0/1616962424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f80b3760 0x7fc4f80b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f6d9d700 1 --2- 172.21.15.84:0/1616962424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f815d380 0x7fc4f809a950 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0009e60 tx=0x7fc4f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5996e9d01f717d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f559a700 1 -- 172.21.15.84:0/1616962424 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f000e070 con 0x7fc4f815d380 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f559a700 1 -- 172.21.15.84:0/1616962424 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f000bc30 con 0x7fc4f815d380 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.655+0000 7fc4f559a700 1 -- 172.21.15.84:0/1616962424 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0012430 con 0x7fc4f815d380 2023-10-06T03:27:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.656+0000 7fc4fca4d700 1 -- 172.21.15.84:0/1616962424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f815d380 msgr2=0x7fc4f809a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.656+0000 7fc4fca4d700 1 --2- 172.21.15.84:0/1616962424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f815d380 0x7fc4f809a950 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0009e60 tx=0x7fc4f0009780 comp rx=0 tx=0).stop 2023-10-06T03:27:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.656+0000 7fc4fca4d700 1 -- 172.21.15.84:0/1616962424 shutdown_connections 2023-10-06T03:27:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.656+0000 7fc4fca4d700 1 --2- 172.21.15.84:0/1616962424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f815d380 0x7fc4f809a950 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.656+0000 7fc4fca4d700 1 --2- 172.21.15.84:0/1616962424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f80b3760 0x7fc4f80b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.656+0000 7fc4fca4d700 1 -- 172.21.15.84:0/1616962424 >> 172.21.15.84:0/1616962424 conn(0x7fc4f806cc30 msgr2=0x7fc4f80d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.656+0000 7fc4fca4d700 1 -- 172.21.15.84:0/1616962424 shutdown_connections 2023-10-06T03:27:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.656+0000 7fc4fca4d700 1 -- 172.21.15.84:0/1616962424 wait complete. 2023-10-06T03:27:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.657+0000 7fc4fca4d700 1 Processor -- start 2023-10-06T03:27:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.657+0000 7fc4fca4d700 1 -- start start 2023-10-06T03:27:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4fca4d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4f80b3760 0x7fc4f80d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4fca4d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f80b6380 0x7fc4f8169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4fca4d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f815d380 0x7fc4f80c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4fca4d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80c7ee0 con 0x7fc4f80b6380 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4fca4d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f816a2e0 con 0x7fc4f80b3760 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4fca4d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80c6f80 con 0x7fc4f815d380 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f80b6380 0x7fc4f8169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f80b6380 0x7fc4f8169da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44550/0 (socket says 172.21.15.84:44550) 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f5d9b700 1 -- 172.21.15.84:0/3978366540 learned_addr learned my addr 172.21.15.84:0/3978366540 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f6d9d700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f815d380 0x7fc4f80c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f659c700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4f80b3760 0x7fc4f80d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f5d9b700 1 -- 172.21.15.84:0/3978366540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f815d380 msgr2=0x7fc4f80c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f5d9b700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f815d380 0x7fc4f80c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f5d9b700 1 -- 172.21.15.84:0/3978366540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4f80b3760 msgr2=0x7fc4f80d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f5d9b700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4f80b3760 0x7fc4f80d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f5d9b700 1 -- 172.21.15.84:0/3978366540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f0009a20 con 0x7fc4f80b6380 2023-10-06T03:27:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f6d9d700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f815d380 0x7fc4f80c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f659c700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4f80b3760 0x7fc4f80d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4f5d9b700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f80b6380 0x7fc4f8169da0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c7e0 tx=0x7fc4ec007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4e67fc700 1 -- 172.21.15.84:0/3978366540 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec005b30 con 0x7fc4f80b6380 2023-10-06T03:27:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4e67fc700 1 -- 172.21.15.84:0/3978366540 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec005c90 con 0x7fc4f80b6380 2023-10-06T03:27:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.658+0000 7fc4e67fc700 1 -- 172.21.15.84:0/3978366540 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec007300 con 0x7fc4f80b6380 2023-10-06T03:27:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.659+0000 7fc4fca4d700 1 -- 172.21.15.84:0/3978366540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f80c7260 con 0x7fc4f80b6380 2023-10-06T03:27:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.659+0000 7fc4fca4d700 1 -- 172.21.15.84:0/3978366540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f80c7820 con 0x7fc4f80b6380 2023-10-06T03:27:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.659+0000 7fc4fca4d700 1 -- 172.21.15.84:0/3978366540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f80c8020 con 0x7fc4f80b6380 2023-10-06T03:27:41.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.660+0000 7fc4e67fc700 1 -- 172.21.15.84:0/3978366540 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4ec01b400 con 0x7fc4f80b6380 2023-10-06T03:27:41.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.660+0000 7fc4e67fc700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc4d8066f30 0x7fc4d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:41.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.660+0000 7fc4e67fc700 1 -- 172.21.15.84:0/3978366540 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fc4ec0843b0 con 0x7fc4f80b6380 2023-10-06T03:27:41.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.660+0000 7fc4f659c700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc4d8066f30 0x7fc4d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:41.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.661+0000 7fc4f659c700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc4d8066f30 0x7fc4d80693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8006ea0 tx=0x7fc4e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:41.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.665+0000 7fc4e67fc700 1 -- 172.21.15.84:0/3978366540 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4f80c8020 con 0x7fc4f80b6380 2023-10-06T03:27:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.890+0000 7fc4fca4d700 1 -- 172.21.15.84:0/3978366540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4f80c8020 con 0x7fc4f80b6380 2023-10-06T03:27:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.891+0000 7fc4e67fc700 1 -- 172.21.15.84:0/3978366540 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4619 (secure 0 0 0) 0x7fc4f80c8020 con 0x7fc4f80b6380 2023-10-06T03:27:41.893 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:41.893 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3912722771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3912722771},{"type":"v1","addr":"172.21.15.131:6833","nonce":3912722771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6382,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4017009844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4017009844},{"type":"v1","addr":"172.21.15.131:6835","nonce":4017009844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:31.536601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7167,"mds_1":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"a","rank":1,"incarnation":64,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6835/3193918731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3193918731},{"type":"v1","addr":"172.21.15.84:6835","nonce":3193918731}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7167":{"gid":7167,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/573778757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":573778757},{"type":"v1","addr":"172.21.15.84:6837","nonce":573778757}]},"join_fscid":-1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 -- 172.21.15.84:0/3978366540 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc4d8066f30 msgr2=0x7fc4d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc4d8066f30 0x7fc4d80693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8006ea0 tx=0x7fc4e8008040 comp rx=0 tx=0).stop 2023-10-06T03:27:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 -- 172.21.15.84:0/3978366540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f80b6380 msgr2=0x7fc4f8169da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f80b6380 0x7fc4f8169da0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c7e0 tx=0x7fc4ec007df0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 -- 172.21.15.84:0/3978366540 shutdown_connections 2023-10-06T03:27:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc4d8066f30 0x7fc4d80693e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4f80b3760 0x7fc4f80d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4f815d380 0x7fc4f80c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 --2- 172.21.15.84:0/3978366540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4f80b6380 0x7fc4f8169da0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 -- 172.21.15.84:0/3978366540 >> 172.21.15.84:0/3978366540 conn(0x7fc4f806cc30 msgr2=0x7fc4f809a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 -- 172.21.15.84:0/3978366540 shutdown_connections 2023-10-06T03:27:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:41.893+0000 7fc4fca4d700 1 -- 172.21.15.84:0/3978366540 wait complete. 2023-10-06T03:27:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 66 2023-10-06T03:27:41.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:27:42.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.019+0000 7fd9998d6700 1 Processor -- start 2023-10-06T03:27:42.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.019+0000 7fd9998d6700 1 -- start start 2023-10-06T03:27:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.020+0000 7fd9998d6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9940b3760 0x7fd9940b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.020+0000 7fd9998d6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd99415d380 0x7fd99409a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.020+0000 7fd9998d6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9940b4480 con 0x7fd9940b6380 2023-10-06T03:27:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.020+0000 7fd9998d6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940b4760 con 0x7fd9940b3760 2023-10-06T03:27:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.020+0000 7fd9998d6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940b4a40 con 0x7fd99415d380 2023-10-06T03:27:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.020+0000 7fd992ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9940b3760 0x7fd9940b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.020+0000 7fd9927fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd9940b6380 0x7fd99415cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54504/0 (socket says 172.21.15.84:54504) 2023-10-06T03:27:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.020+0000 7fd992ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9940b3760 0x7fd9940b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44566/0 (socket says 172.21.15.84:44566) 2023-10-06T03:27:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.020+0000 7fd9927fc700 1 -- 172.21.15.84:0/704893128 learned_addr learned my addr 172.21.15.84:0/704893128 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.021+0000 7fd9937fe700 1 --2- 172.21.15.84:0/704893128 >> v2:172.21.15.131:3300/0 conn(0x7fd99415d380 0x7fd99409a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.021+0000 7fd992ffd700 1 -- 172.21.15.84:0/704893128 >> v2:172.21.15.131:3300/0 conn(0x7fd99415d380 msgr2=0x7fd99409a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.021+0000 7fd992ffd700 1 --2- 172.21.15.84:0/704893128 >> v2:172.21.15.131:3300/0 conn(0x7fd99415d380 0x7fd99409a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.021+0000 7fd992ffd700 1 -- 172.21.15.84:0/704893128 >> v1:172.21.15.84:6789/0 conn(0x7fd9940b6380 legacy=0x7fd99415cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.021+0000 7fd991ffb700 1 -- 172.21.15.84:0/704893128 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093566323 0 0) 0x7fd9940b4480 con 0x7fd9940b6380 2023-10-06T03:27:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.021+0000 7fd992ffd700 1 -- 172.21.15.84:0/704893128 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99409a430 con 0x7fd9940b3760 2023-10-06T03:27:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.021+0000 7fd992ffd700 1 --2- 172.21.15.84:0/704893128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b3760 0x7fd9940b3b30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd9940b5790 tx=0x7fd98c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b7511b5d803922 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.021+0000 7fd991ffb700 1 -- 172.21.15.84:0/704893128 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c00e070 con 0x7fd9940b3760 2023-10-06T03:27:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.021+0000 7fd991ffb700 1 -- 172.21.15.84:0/704893128 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c00bc30 con 0x7fd9940b3760 2023-10-06T03:27:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.021+0000 7fd991ffb700 1 -- 172.21.15.84:0/704893128 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c012430 con 0x7fd9940b3760 2023-10-06T03:27:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.022+0000 7fd9998d6700 1 -- 172.21.15.84:0/704893128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b3760 msgr2=0x7fd9940b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.022+0000 7fd9998d6700 1 --2- 172.21.15.84:0/704893128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b3760 0x7fd9940b3b30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd9940b5790 tx=0x7fd98c009780 comp rx=0 tx=0).stop 2023-10-06T03:27:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.022+0000 7fd9998d6700 1 -- 172.21.15.84:0/704893128 shutdown_connections 2023-10-06T03:27:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.022+0000 7fd9998d6700 1 --2- 172.21.15.84:0/704893128 >> v2:172.21.15.131:3300/0 conn(0x7fd99415d380 0x7fd99409a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.022+0000 7fd9998d6700 1 --2- 172.21.15.84:0/704893128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b3760 0x7fd9940b3b30 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.022+0000 7fd9998d6700 1 -- 172.21.15.84:0/704893128 >> 172.21.15.84:0/704893128 conn(0x7fd99406cc30 msgr2=0x7fd9940d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:42.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.022+0000 7fd9998d6700 1 -- 172.21.15.84:0/704893128 shutdown_connections 2023-10-06T03:27:42.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.022+0000 7fd9998d6700 1 -- 172.21.15.84:0/704893128 wait complete. 2023-10-06T03:27:42.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.023+0000 7fd9998d6700 1 Processor -- start 2023-10-06T03:27:42.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.023+0000 7fd9998d6700 1 -- start start 2023-10-06T03:27:42.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.023+0000 7fd9998d6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9940b3760 0x7fd99414f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.023+0000 7fd9998d6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b6380 0x7fd99415d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9998d6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd99415d380 0x7fd99415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9998d6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940b1fa0 con 0x7fd9940b6380 2023-10-06T03:27:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9998d6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99415e380 con 0x7fd99415d380 2023-10-06T03:27:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9998d6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99415e660 con 0x7fd9940b3760 2023-10-06T03:27:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9927fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b6380 0x7fd99415d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9927fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b6380 0x7fd99415d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44578/0 (socket says 172.21.15.84:44578) 2023-10-06T03:27:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9927fc700 1 -- 172.21.15.84:0/1254762140 learned_addr learned my addr 172.21.15.84:0/1254762140 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd992ffd700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9940b3760 0x7fd99414f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9927fc700 1 -- 172.21.15.84:0/1254762140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9940b3760 msgr2=0x7fd99414f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9927fc700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9940b3760 0x7fd99414f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9927fc700 1 -- 172.21.15.84:0/1254762140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd99415d380 msgr2=0x7fd99415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9927fc700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd99415d380 0x7fd99415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9927fc700 1 -- 172.21.15.84:0/1254762140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c009a20 con 0x7fd9940b6380 2023-10-06T03:27:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9927fc700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b6380 0x7fd99415d830 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c810 tx=0x7fd97c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd98affd700 1 -- 172.21.15.84:0/1254762140 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c005b30 con 0x7fd9940b6380 2023-10-06T03:27:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd98affd700 1 -- 172.21.15.84:0/1254762140 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c005cb0 con 0x7fd9940b6380 2023-10-06T03:27:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9998d6700 1 -- 172.21.15.84:0/1254762140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99415e940 con 0x7fd9940b6380 2023-10-06T03:27:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd98affd700 1 -- 172.21.15.84:0/1254762140 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c007340 con 0x7fd9940b6380 2023-10-06T03:27:42.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.024+0000 7fd9998d6700 1 -- 172.21.15.84:0/1254762140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9941508d0 con 0x7fd9940b6380 2023-10-06T03:27:42.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.025+0000 7fd9998d6700 1 -- 172.21.15.84:0/1254762140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd994150e40 con 0x7fd9940b6380 2023-10-06T03:27:42.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.026+0000 7fd98affd700 1 -- 172.21.15.84:0/1254762140 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd97c01b400 con 0x7fd9940b6380 2023-10-06T03:27:42.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.026+0000 7fd98affd700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd974066f30 0x7fd9740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.026+0000 7fd98affd700 1 -- 172.21.15.84:0/1254762140 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fd97c0843f0 con 0x7fd9940b6380 2023-10-06T03:27:42.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.026+0000 7fd992ffd700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd974066f30 0x7fd9740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.026+0000 7fd992ffd700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd974066f30 0x7fd9740693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd9940b5790 tx=0x7fd98c019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:42.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.030+0000 7fd98affd700 1 -- 172.21.15.84:0/1254762140 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd97c0512e0 con 0x7fd9940b6380 2023-10-06T03:27:42.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.255+0000 7fd9998d6700 1 -- 172.21.15.84:0/1254762140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd99404c3c0 con 0x7fd9940b6380 2023-10-06T03:27:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.255+0000 7fd98affd700 1 -- 172.21.15.84:0/1254762140 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4619 (secure 0 0 0) 0x7fd97c0076f0 con 0x7fd9940b6380 2023-10-06T03:27:42.257 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:42.257 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3912722771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3912722771},{"type":"v1","addr":"172.21.15.131:6833","nonce":3912722771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6382,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4017009844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4017009844},{"type":"v1","addr":"172.21.15.131:6835","nonce":4017009844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:27:05.838700+0000","modified":"2023-10-06T03:27:31.536601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7167,"mds_1":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"a","rank":1,"incarnation":64,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6835/3193918731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3193918731},{"type":"v1","addr":"172.21.15.84:6835","nonce":3193918731}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7167":{"gid":7167,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6837/573778757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":573778757},{"type":"v1","addr":"172.21.15.84:6837","nonce":573778757}]},"join_fscid":-1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:27:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 -- 172.21.15.84:0/1254762140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd974066f30 msgr2=0x7fd9740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd974066f30 0x7fd9740693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd9940b5790 tx=0x7fd98c019000 comp rx=0 tx=0).stop 2023-10-06T03:27:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 -- 172.21.15.84:0/1254762140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b6380 msgr2=0x7fd99415d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b6380 0x7fd99415d830 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c810 tx=0x7fd97c007db0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 -- 172.21.15.84:0/1254762140 shutdown_connections 2023-10-06T03:27:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fd974066f30 0x7fd9740693e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd99415d380 0x7fd99415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9940b3760 0x7fd99414f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 --2- 172.21.15.84:0/1254762140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9940b6380 0x7fd99415d830 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 -- 172.21.15.84:0/1254762140 >> 172.21.15.84:0/1254762140 conn(0x7fd99406cc30 msgr2=0x7fd99409c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 -- 172.21.15.84:0/1254762140 shutdown_connections 2023-10-06T03:27:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.257+0000 7fd9998d6700 1 -- 172.21.15.84:0/1254762140 wait complete. 2023-10-06T03:27:42.261 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 66 2023-10-06T03:27:42.271 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:27:42.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.383+0000 7f9993d25700 1 Processor -- start 2023-10-06T03:27:42.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.383+0000 7f9993d25700 1 -- start start 2023-10-06T03:27:42.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.384+0000 7f9993d25700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c0b3760 0x7f998c0b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.384+0000 7f9993d25700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f998c15d380 0x7f998c09a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.384+0000 7f9993d25700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0b4480 con 0x7f998c0b6380 2023-10-06T03:27:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.384+0000 7f9993d25700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c0b4760 con 0x7f998c15d380 2023-10-06T03:27:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.384+0000 7f9993d25700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0b4a40 con 0x7f998c0b3760 2023-10-06T03:27:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.384+0000 7f99912c0700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f998c0b6380 0x7f998c15cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54512/0 (socket says 172.21.15.84:54512) 2023-10-06T03:27:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.384+0000 7f99912c0700 1 -- 172.21.15.84:0/3143422269 learned_addr learned my addr 172.21.15.84:0/3143422269 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.384+0000 7f9991ac1700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c0b3760 0x7f998c0b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.384+0000 7f99922c2700 1 --2- 172.21.15.84:0/3143422269 >> v2:172.21.15.131:3300/0 conn(0x7f998c15d380 0x7f998c09a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.384+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428335111 0 0) 0x7f998c0b4480 con 0x7f998c0b6380 2023-10-06T03:27:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9978003570 con 0x7f998c0b6380 2023-10-06T03:27:42.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2175591163 0 0) 0x7f9978003570 con 0x7f998c0b6380 2023-10-06T03:27:42.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c0b3760 msgr2=0x7f998c0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:42.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c0b3760 0x7f998c0b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 >> v2:172.21.15.131:3300/0 conn(0x7f998c15d380 msgr2=0x7f998c09a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:42.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 --2- 172.21.15.84:0/3143422269 >> v2:172.21.15.131:3300/0 conn(0x7f998c15d380 0x7f998c09a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c09a430 con 0x7f998c0b6380 2023-10-06T03:27:42.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f997c001470 con 0x7f998c0b6380 2023-10-06T03:27:42.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 >> v1:172.21.15.84:6789/0 conn(0x7f998c0b6380 legacy=0x7f998c15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9978003a60 0x7f9978003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 0x7f9978004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c0b3760 0x7f99780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0b4760 con 0x7f9978004810 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0b4a40 con 0x7f9978003a60 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997800ba60 con 0x7f998c0b3760 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f99912c0700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 0x7f9978004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9991ac1700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9978003a60 0x7f9978003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f99922c2700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c0b3760 0x7f99780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f99912c0700 1 -- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c0b3760 msgr2=0x7f99780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f99912c0700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c0b3760 0x7f99780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f99912c0700 1 -- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9978003a60 msgr2=0x7f9978003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f99912c0700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9978003a60 0x7f9978003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f99912c0700 1 -- 172.21.15.84:0/3143422269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978003570 con 0x7f9978004810 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9991ac1700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9978003a60 0x7f9978003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f99922c2700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c0b3760 0x7f99780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f99912c0700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 0x7f9978004c80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f997c00c3f0 tx=0x7f997c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a8d4eeb5c3eb2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.385+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c00cc80 con 0x7f9978004810 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.386+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c00ce00 con 0x7f9978004810 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.386+0000 7f9990abf700 1 -- 172.21.15.84:0/3143422269 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c005b70 con 0x7f9978004810 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.386+0000 7f9993d25700 1 -- 172.21.15.84:0/3143422269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 msgr2=0x7f9978004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.386+0000 7f9993d25700 1 --2- 172.21.15.84:0/3143422269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 0x7f9978004c80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f997c00c3f0 tx=0x7f997c001e90 comp rx=0 tx=0).stop 2023-10-06T03:27:42.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.386+0000 7f99922c2700 1 -- 172.21.15.84:0/3143422269 reap_dead start 2023-10-06T03:27:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.386+0000 7f9993d25700 1 -- 172.21.15.84:0/3143422269 shutdown_connections 2023-10-06T03:27:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.386+0000 7f9993d25700 1 -- 172.21.15.84:0/3143422269 >> 172.21.15.84:0/3143422269 conn(0x7f998c06cc30 msgr2=0x7f998c0d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.386+0000 7f9993d25700 1 -- 172.21.15.84:0/3143422269 shutdown_connections 2023-10-06T03:27:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.386+0000 7f9993d25700 1 -- 172.21.15.84:0/3143422269 wait complete. 2023-10-06T03:27:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.387+0000 7f9993d25700 1 Processor -- start 2023-10-06T03:27:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.387+0000 7f9993d25700 1 -- start start 2023-10-06T03:27:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9993d25700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 0x7f998c149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9993d25700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f998c1466b0 0x7f998c15f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9993d25700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c146b20 0x7f998c15fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9993d25700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c149640 con 0x7f9978004810 2023-10-06T03:27:42.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9993d25700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c148a30 con 0x7f998c1466b0 2023-10-06T03:27:42.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9993d25700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c148d10 con 0x7f998c146b20 2023-10-06T03:27:42.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9991ac1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 0x7f998c149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9991ac1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 0x7f998c149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44590/0 (socket says 172.21.15.84:44590) 2023-10-06T03:27:42.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9991ac1700 1 -- 172.21.15.84:0/2209132709 learned_addr learned my addr 172.21.15.84:0/2209132709 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:42.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f99922c2700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c146b20 0x7f998c15fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f99912c0700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f998c1466b0 0x7f998c15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9991ac1700 1 -- 172.21.15.84:0/2209132709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c146b20 msgr2=0x7f998c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9991ac1700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c146b20 0x7f998c15fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9991ac1700 1 -- 172.21.15.84:0/2209132709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f998c1466b0 msgr2=0x7f998c15f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9991ac1700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f998c1466b0 0x7f998c15f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f9991ac1700 1 -- 172.21.15.84:0/2209132709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c148ff0 con 0x7f9978004810 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.388+0000 7f99922c2700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c146b20 0x7f998c15fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.389+0000 7f9991ac1700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 0x7f998c149ad0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f9988010570 tx=0x7f998800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.389+0000 7f9981ffb700 1 -- 172.21.15.84:0/2209132709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998800e050 con 0x7f9978004810 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.389+0000 7f9981ffb700 1 -- 172.21.15.84:0/2209132709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998800f040 con 0x7f9978004810 2023-10-06T03:27:42.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.389+0000 7f9981ffb700 1 -- 172.21.15.84:0/2209132709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988015860 con 0x7f9978004810 2023-10-06T03:27:42.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.389+0000 7f9993d25700 1 -- 172.21.15.84:0/2209132709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c1492d0 con 0x7f9978004810 2023-10-06T03:27:42.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.389+0000 7f9993d25700 1 -- 172.21.15.84:0/2209132709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c147f00 con 0x7f9978004810 2023-10-06T03:27:42.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.390+0000 7f9993d25700 1 -- 172.21.15.84:0/2209132709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c149920 con 0x7f9978004810 2023-10-06T03:27:42.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.390+0000 7f9981ffb700 1 -- 172.21.15.84:0/2209132709 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9988003020 con 0x7f9978004810 2023-10-06T03:27:42.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.391+0000 7f9981ffb700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9970066f30 0x7f99700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.391+0000 7f9981ffb700 1 -- 172.21.15.84:0/2209132709 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f9988085590 con 0x7f9978004810 2023-10-06T03:27:42.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.391+0000 7f99912c0700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9970066f30 0x7f99700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.391+0000 7f99912c0700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9970066f30 0x7f99700693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f997c00c310 tx=0x7f997c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:42.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.395+0000 7f9981ffb700 1 -- 172.21.15.84:0/2209132709 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9988052480 con 0x7f9978004810 2023-10-06T03:27:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.580+0000 7f9993d25700 1 -- 172.21.15.84:0/2209132709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f998c04c3c0 con 0x7f9978004810 2023-10-06T03:27:42.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.581+0000 7f9981ffb700 1 -- 172.21.15.84:0/2209132709 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+17430 (secure 0 0 0) 0x7f9988055aa0 con 0x7f9978004810 2023-10-06T03:27:42.583 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:42.583 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":104,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:27:39.557740+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:27:03.480044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:27:04.800908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.e","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6834/169780123":"2023-10-07T03:27:16.359327+0000","172.21.15.131:6832/169780123":"2023-10-07T03:27:16.359327+0000","172.21.15.84:6836/632169803":"2023-10-07T03:27:15.500473+0000","172.21.15.84:6837/632169803":"2023-10-07T03:27:15.500473+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:27:42.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 -- 172.21.15.84:0/2209132709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9970066f30 msgr2=0x7f99700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9970066f30 0x7f99700693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f997c00c310 tx=0x7f997c015000 comp rx=0 tx=0).stop 2023-10-06T03:27:42.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 -- 172.21.15.84:0/2209132709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 msgr2=0x7f998c149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 0x7f998c149ad0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f9988010570 tx=0x7f998800b040 comp rx=0 tx=0).stop 2023-10-06T03:27:42.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 -- 172.21.15.84:0/2209132709 shutdown_connections 2023-10-06T03:27:42.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f9970066f30 0x7f99700693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998c146b20 0x7f998c15fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9978004810 0x7f998c149ad0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 --2- 172.21.15.84:0/2209132709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f998c1466b0 0x7f998c15f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 -- 172.21.15.84:0/2209132709 >> 172.21.15.84:0/2209132709 conn(0x7f998c06cc30 msgr2=0x7f998c15aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:42.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 -- 172.21.15.84:0/2209132709 shutdown_connections 2023-10-06T03:27:42.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.583+0000 7f9993d25700 1 -- 172.21.15.84:0/2209132709 wait complete. 2023-10-06T03:27:42.597 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:27:42.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.710+0000 7f3894154700 1 Processor -- start 2023-10-06T03:27:42.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.710+0000 7f3894154700 1 -- start start 2023-10-06T03:27:42.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.711+0000 7f3894154700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f388c0b24b0 0x7f388c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.711+0000 7f3894154700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388c15dfc0 con 0x7f388c159170 2023-10-06T03:27:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.711+0000 7f3894154700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388c0b0f40 con 0x7f388c06d900 2023-10-06T03:27:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.711+0000 7f3894154700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388c15d3f0 con 0x7f388c0b24b0 2023-10-06T03:27:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.711+0000 7f3891ef0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f388c0b24b0 0x7f388c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.711+0000 7f38926f1700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f388c159170 0x7f388c1595d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54528/0 (socket says 172.21.15.84:54528) 2023-10-06T03:27:42.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.711+0000 7f38926f1700 1 -- 172.21.15.84:0/2647387717 learned_addr learned my addr 172.21.15.84:0/2647387717 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:42.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3891ef0700 1 -- 172.21.15.84:0/2647387717 >> v1:172.21.15.131:6789/0 conn(0x7f388c06d900 legacy=0x7f388c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3891ef0700 1 -- 172.21.15.84:0/2647387717 >> v1:172.21.15.84:6789/0 conn(0x7f388c159170 legacy=0x7f388c1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3891ef0700 1 -- 172.21.15.84:0/2647387717 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c0b2dc0 con 0x7f388c0b24b0 2023-10-06T03:27:42.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3891ef0700 1 --2- 172.21.15.84:0/2647387717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c0b24b0 0x7f388c0b2880 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f3888009e60 tx=0x7f3888009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99bee2551f38774 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:42.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3890eee700 1 -- 172.21.15.84:0/2647387717 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388800e070 con 0x7f388c0b24b0 2023-10-06T03:27:42.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3890eee700 1 -- 172.21.15.84:0/2647387717 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388800bc30 con 0x7f388c0b24b0 2023-10-06T03:27:42.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3890eee700 1 -- 172.21.15.84:0/2647387717 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888012430 con 0x7f388c0b24b0 2023-10-06T03:27:42.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3894154700 1 -- 172.21.15.84:0/2647387717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c0b24b0 msgr2=0x7f388c0b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3894154700 1 --2- 172.21.15.84:0/2647387717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c0b24b0 0x7f388c0b2880 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f3888009e60 tx=0x7f3888009780 comp rx=0 tx=0).stop 2023-10-06T03:27:42.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3894154700 1 -- 172.21.15.84:0/2647387717 shutdown_connections 2023-10-06T03:27:42.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3894154700 1 --2- 172.21.15.84:0/2647387717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c0b24b0 0x7f388c0b2880 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3894154700 1 -- 172.21.15.84:0/2647387717 >> 172.21.15.84:0/2647387717 conn(0x7f388c0d0520 msgr2=0x7f388c0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:42.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3894154700 1 -- 172.21.15.84:0/2647387717 shutdown_connections 2023-10-06T03:27:42.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.712+0000 7f3894154700 1 -- 172.21.15.84:0/2647387717 wait complete. 2023-10-06T03:27:42.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.713+0000 7f3894154700 1 Processor -- start 2023-10-06T03:27:42.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f3894154700 1 -- start start 2023-10-06T03:27:42.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f3894154700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c06d900 0x7f388c0ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f3894154700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388c0b24b0 0x7f388c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f3894154700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f388c159170 0x7f388c0a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f3894154700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c0ae9d0 con 0x7f388c06d900 2023-10-06T03:27:42.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f3894154700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c15b570 con 0x7f388c159170 2023-10-06T03:27:42.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f3894154700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388c15b850 con 0x7f388c0b24b0 2023-10-06T03:27:42.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f3891ef0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c06d900 0x7f388c0ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f3891ef0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c06d900 0x7f388c0ae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44616/0 (socket says 172.21.15.84:44616) 2023-10-06T03:27:42.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f3891ef0700 1 -- 172.21.15.84:0/3132287396 learned_addr learned my addr 172.21.15.84:0/3132287396 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:42.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.714+0000 7f38926f1700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f388c159170 0x7f388c0a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f38916ef700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388c0b24b0 0x7f388c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3891ef0700 1 -- 172.21.15.84:0/3132287396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388c0b24b0 msgr2=0x7f388c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3891ef0700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388c0b24b0 0x7f388c15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3891ef0700 1 -- 172.21.15.84:0/3132287396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f388c159170 msgr2=0x7f388c0a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3891ef0700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f388c159170 0x7f388c0a6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3891ef0700 1 -- 172.21.15.84:0/3132287396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3888009a20 con 0x7f388c06d900 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3891ef0700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c06d900 0x7f388c0ae490 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f3888013000 tx=0x7f3888019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3881ffb700 1 -- 172.21.15.84:0/3132287396 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888027470 con 0x7f388c06d900 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3881ffb700 1 -- 172.21.15.84:0/3132287396 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38880275d0 con 0x7f388c06d900 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3894154700 1 -- 172.21.15.84:0/3132287396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388c15bb30 con 0x7f388c06d900 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3881ffb700 1 -- 172.21.15.84:0/3132287396 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888027990 con 0x7f388c06d900 2023-10-06T03:27:42.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.715+0000 7f3894154700 1 -- 172.21.15.84:0/3132287396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388c15c0f0 con 0x7f388c06d900 2023-10-06T03:27:42.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.716+0000 7f3894154700 1 -- 172.21.15.84:0/3132287396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388c15c2e0 con 0x7f388c06d900 2023-10-06T03:27:42.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.716+0000 7f3881ffb700 1 -- 172.21.15.84:0/3132287396 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3888024070 con 0x7f388c06d900 2023-10-06T03:27:42.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.717+0000 7f3881ffb700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3870066f30 0x7f38700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:42.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.717+0000 7f3881ffb700 1 -- 172.21.15.84:0/3132287396 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f3888086ee0 con 0x7f388c06d900 2023-10-06T03:27:42.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.717+0000 7f38916ef700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3870066f30 0x7f38700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:42.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.717+0000 7f38916ef700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3870066f30 0x7f38700693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f388c0cfef0 tx=0x7f387c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:42.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.721+0000 7f3881ffb700 1 -- 172.21.15.84:0/3132287396 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3888053dd0 con 0x7f388c06d900 2023-10-06T03:27:42.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.944+0000 7f3894154700 1 -- 172.21.15.84:0/3132287396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f388c04c3c0 con 0x7f388c06d900 2023-10-06T03:27:42.946 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:27:42.944+0000 7f573ff98700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:27:42.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.950+0000 7f3881ffb700 1 -- 172.21.15.84:0/3132287396 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7f38880573f0 con 0x7f388c06d900 2023-10-06T03:27:42.953 INFO:tasks.ceph.mds.c.smithi084.stderr: -4296> 2023-10-06T03:27:21.368+0000 7f03c463f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 -- 172.21.15.84:0/3132287396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3870066f30 msgr2=0x7f38700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3870066f30 0x7f38700693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f388c0cfef0 tx=0x7f387c009040 comp rx=0 tx=0).stop 2023-10-06T03:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 -- 172.21.15.84:0/3132287396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c06d900 msgr2=0x7f388c0ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c06d900 0x7f388c0ae490 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f3888013000 tx=0x7f3888019000 comp rx=0 tx=0).stop 2023-10-06T03:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 -- 172.21.15.84:0/3132287396 shutdown_connections 2023-10-06T03:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3870066f30 0x7f38700693e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f388c159170 0x7f388c0a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f388c06d900 0x7f388c0ae490 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 --2- 172.21.15.84:0/3132287396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388c0b24b0 0x7f388c15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 -- 172.21.15.84:0/3132287396 >> 172.21.15.84:0/3132287396 conn(0x7f388c0d0520 msgr2=0x7f388c0b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 -- 172.21.15.84:0/3132287396 shutdown_connections 2023-10-06T03:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:42.953+0000 7f3894154700 1 -- 172.21.15.84:0/3132287396 wait complete. 2023-10-06T03:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:27:42.956 INFO:tasks.ceph.mds.c.smithi084.stderr: -2529> 2023-10-06T03:27:26.369+0000 7f03c463f700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-06T03:27:42.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:27:42.974 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:27:42.981 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:27:43.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.084+0000 7f4f10f0a700 1 Processor -- start 2023-10-06T03:27:43.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.084+0000 7f4f10f0a700 1 -- start start 2023-10-06T03:27:43.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.085+0000 7f4f10f0a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c1571f0 0x7f4f0c1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:43.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.085+0000 7f4f10f0a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4f0c0ae6c0 0x7f4f0c0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:43.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.085+0000 7f4f10f0a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c06b4a0 con 0x7f4f0c15ba40 2023-10-06T03:27:43.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.085+0000 7f4f10f0a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c0699f0 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.085+0000 7f4f10f0a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0c68a0 con 0x7f4f0c1571f0 2023-10-06T03:27:43.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.085+0000 7f4f01d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4f0c15ba40 0x7f4f0c0adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54544/0 (socket says 172.21.15.84:54544) 2023-10-06T03:27:43.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.085+0000 7f4f01d9b700 1 -- 172.21.15.84:0/727802414 learned_addr learned my addr 172.21.15.84:0/727802414 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:43.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.085+0000 7f4f0a59c700 1 --2- 172.21.15.84:0/727802414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c1571f0 0x7f4f0c1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:43.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.085+0000 7f4f0ad9d700 1 --2- 172.21.15.84:0/727802414 >> v2:172.21.15.131:3300/0 conn(0x7f4f0c0ae6c0 0x7f4f0c0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:43.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.085+0000 7f4f09d9b700 1 -- 172.21.15.84:0/727802414 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989423589 0 0) 0x7f4f0c06b4a0 con 0x7f4f0c15ba40 2023-10-06T03:27:43.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.086+0000 7f4f09d9b700 1 -- 172.21.15.84:0/727802414 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef8003570 con 0x7f4f0c15ba40 2023-10-06T03:27:43.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.086+0000 7f4f0a59c700 1 -- 172.21.15.84:0/727802414 >> v2:172.21.15.131:3300/0 conn(0x7f4f0c0ae6c0 msgr2=0x7f4f0c0c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:43.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.086+0000 7f4f0a59c700 1 --2- 172.21.15.84:0/727802414 >> v2:172.21.15.131:3300/0 conn(0x7f4f0c0ae6c0 0x7f4f0c0c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:43.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.086+0000 7f4f0a59c700 1 -- 172.21.15.84:0/727802414 >> v1:172.21.15.84:6789/0 conn(0x7f4f0c15ba40 legacy=0x7f4f0c0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:43.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.086+0000 7f4f0a59c700 1 -- 172.21.15.84:0/727802414 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c15be90 con 0x7f4f0c1571f0 2023-10-06T03:27:43.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.086+0000 7f4f0a59c700 1 --2- 172.21.15.84:0/727802414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c1571f0 0x7f4f0c1575c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0098e0 tx=0x7f4efc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57f6d7183d6d1769 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:43.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.086+0000 7f4f09d9b700 1 -- 172.21.15.84:0/727802414 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc011630 con 0x7f4f0c1571f0 2023-10-06T03:27:43.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.086+0000 7f4f09d9b700 1 -- 172.21.15.84:0/727802414 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc011790 con 0x7f4f0c1571f0 2023-10-06T03:27:43.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.086+0000 7f4f09d9b700 1 -- 172.21.15.84:0/727802414 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc011b30 con 0x7f4f0c1571f0 2023-10-06T03:27:43.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.087+0000 7f4f10f0a700 1 -- 172.21.15.84:0/727802414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c1571f0 msgr2=0x7f4f0c1575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:43.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.087+0000 7f4f10f0a700 1 --2- 172.21.15.84:0/727802414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c1571f0 0x7f4f0c1575c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0098e0 tx=0x7f4efc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:43.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.087+0000 7f4f10f0a700 1 -- 172.21.15.84:0/727802414 shutdown_connections 2023-10-06T03:27:43.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.087+0000 7f4f10f0a700 1 --2- 172.21.15.84:0/727802414 >> v2:172.21.15.131:3300/0 conn(0x7f4f0c0ae6c0 0x7f4f0c0c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:43.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.087+0000 7f4f10f0a700 1 --2- 172.21.15.84:0/727802414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c1571f0 0x7f4f0c1575c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:43.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.087+0000 7f4f10f0a700 1 -- 172.21.15.84:0/727802414 >> 172.21.15.84:0/727802414 conn(0x7f4f0c06cee0 msgr2=0x7f4f0c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:43.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.087+0000 7f4f10f0a700 1 -- 172.21.15.84:0/727802414 shutdown_connections 2023-10-06T03:27:43.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.087+0000 7f4f10f0a700 1 -- 172.21.15.84:0/727802414 wait complete. 2023-10-06T03:27:43.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.088+0000 7f4f10f0a700 1 Processor -- start 2023-10-06T03:27:43.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.088+0000 7f4f10f0a700 1 -- start start 2023-10-06T03:27:43.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f10f0a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c0ae6c0 0x7f4f0c0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:43.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f10f0a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f0c1571f0 0x7f4f0c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:43.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f10f0a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c15ba40 0x7f4f0c15d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:43.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f10f0a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0af960 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f10f0a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c15e630 con 0x7f4f0c1571f0 2023-10-06T03:27:43.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f10f0a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c15dd90 con 0x7f4f0c15ba40 2023-10-06T03:27:43.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f0a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c0ae6c0 0x7f4f0c0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:43.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f0a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c0ae6c0 0x7f4f0c0b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44652/0 (socket says 172.21.15.84:44652) 2023-10-06T03:27:43.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f0a59c700 1 -- 172.21.15.84:0/1507369834 learned_addr learned my addr 172.21.15.84:0/1507369834 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:43.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f01d9b700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f0c1571f0 0x7f4f0c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:43.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f0ad9d700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c15ba40 0x7f4f0c15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:43.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f0a59c700 1 -- 172.21.15.84:0/1507369834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c15ba40 msgr2=0x7f4f0c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:43.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f0a59c700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c15ba40 0x7f4f0c15d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:43.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f0a59c700 1 -- 172.21.15.84:0/1507369834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f0c1571f0 msgr2=0x7f4f0c0c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:43.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f0a59c700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f0c1571f0 0x7f4f0c0c3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:43.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f0a59c700 1 -- 172.21.15.84:0/1507369834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc009420 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f0a59c700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c0ae6c0 0x7f4f0c0b1b10 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009ed0 tx=0x7f4efc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:43.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f02ffd700 1 -- 172.21.15.84:0/1507369834 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc011b10 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.089+0000 7f4f02ffd700 1 -- 172.21.15.84:0/1507369834 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc0253f0 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.090+0000 7f4f02ffd700 1 -- 172.21.15.84:0/1507369834 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0257b0 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.090+0000 7f4f10f0a700 1 -- 172.21.15.84:0/1507369834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c15e070 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.090+0000 7f4f10f0a700 1 -- 172.21.15.84:0/1507369834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c0c1ac0 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.090+0000 7f4f10f0a700 1 -- 172.21.15.84:0/1507369834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c0af730 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.091+0000 7f4f02ffd700 1 -- 172.21.15.84:0/1507369834 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4efc025ba0 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.091+0000 7f4f02ffd700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4eec066f30 0x7f4eec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:43.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.091+0000 7f4f02ffd700 1 -- 172.21.15.84:0/1507369834 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6780+0+0 (secure 0 0 0) 0x7f4efc086170 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.091+0000 7f4f01d9b700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4eec066f30 0x7f4eec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:43.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.092+0000 7f4f01d9b700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4eec066f30 0x7f4eec0693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40058d0 tx=0x7f4ef4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:43.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.095+0000 7f4f02ffd700 1 -- 172.21.15.84:0/1507369834 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f0c0af730 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.320+0000 7f4f10f0a700 1 -- 172.21.15.84:0/1507369834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4f0c0af730 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.949+0000 7f4f02ffd700 1 -- 172.21.15.84:0/1507369834 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4f0c0af730 con 0x7f4f0c0ae6c0 2023-10-06T03:27:43.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 -- 172.21.15.84:0/1507369834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4eec066f30 msgr2=0x7f4eec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:43.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4eec066f30 0x7f4eec0693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40058d0 tx=0x7f4ef4009040 comp rx=0 tx=0).stop 2023-10-06T03:27:43.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 -- 172.21.15.84:0/1507369834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c0ae6c0 msgr2=0x7f4f0c0b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:43.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c0ae6c0 0x7f4f0c0b1b10 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009ed0 tx=0x7f4efc017000 comp rx=0 tx=0).stop 2023-10-06T03:27:43.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 -- 172.21.15.84:0/1507369834 shutdown_connections 2023-10-06T03:27:43.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4eec066f30 0x7f4eec0693e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:43.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f0c15ba40 0x7f4f0c15d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:43.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c0ae6c0 0x7f4f0c0b1b10 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:43.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 --2- 172.21.15.84:0/1507369834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f0c1571f0 0x7f4f0c0c3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:43.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 -- 172.21.15.84:0/1507369834 >> 172.21.15.84:0/1507369834 conn(0x7f4f0c06cee0 msgr2=0x7f4f0c156200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:43.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 -- 172.21.15.84:0/1507369834 shutdown_connections 2023-10-06T03:27:43.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:43.953+0000 7f4f10f0a700 1 -- 172.21.15.84:0/1507369834 wait complete. 2023-10-06T03:27:43.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:27:44.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.125+0000 7fb645585700 1 Processor -- start 2023-10-06T03:27:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.125+0000 7fb645585700 1 -- start start 2023-10-06T03:27:44.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb645585700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb6401578d0 0x7fb6400c5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb645585700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6400cec30 0x7fb6400c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb645585700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6400cdfb0 con 0x7fb6400c88b0 2023-10-06T03:27:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb645585700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6400cd130 con 0x7fb6401578d0 2023-10-06T03:27:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb645585700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6400cd410 con 0x7fb6400cec30 2023-10-06T03:27:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63e7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb6401578d0 0x7fb6400c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb6400c88b0 0x7fb6400c8c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54546/0 (socket says 172.21.15.84:54546) 2023-10-06T03:27:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63effd700 1 -- 172.21.15.84:0/2983320650 learned_addr learned my addr 172.21.15.84:0/2983320650 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63f7fe700 1 --2- 172.21.15.84:0/2983320650 >> v2:172.21.15.131:3300/0 conn(0x7fb6400cec30 0x7fb6400c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63e7fc700 1 -- 172.21.15.84:0/2983320650 >> v2:172.21.15.131:3300/0 conn(0x7fb6400cec30 msgr2=0x7fb6400c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63e7fc700 1 --2- 172.21.15.84:0/2983320650 >> v2:172.21.15.131:3300/0 conn(0x7fb6400cec30 0x7fb6400c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63e7fc700 1 -- 172.21.15.84:0/2983320650 >> v1:172.21.15.84:6789/0 conn(0x7fb6400c88b0 legacy=0x7fb6400c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63e7fc700 1 -- 172.21.15.84:0/2983320650 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400cd6f0 con 0x7fb6401578d0 2023-10-06T03:27:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63dffb700 1 -- 172.21.15.84:0/2983320650 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685844023 0 0) 0x7fb6400cdfb0 con 0x7fb6400c88b0 2023-10-06T03:27:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63f7fe700 1 --2- 172.21.15.84:0/2983320650 >> v2:172.21.15.131:3300/0 conn(0x7fb6400cec30 0x7fb6400c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63e7fc700 1 --2- 172.21.15.84:0/2983320650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6401578d0 0x7fb6400c5840 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fb6400c87e0 tx=0x7fb6280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7006ecd2ed322926 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63dffb700 1 -- 172.21.15.84:0/2983320650 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800b6b0 con 0x7fb6401578d0 2023-10-06T03:27:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63dffb700 1 -- 172.21.15.84:0/2983320650 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800b810 con 0x7fb6401578d0 2023-10-06T03:27:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.126+0000 7fb63dffb700 1 -- 172.21.15.84:0/2983320650 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800bbb0 con 0x7fb6401578d0 2023-10-06T03:27:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.127+0000 7fb645585700 1 -- 172.21.15.84:0/2983320650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6401578d0 msgr2=0x7fb6400c5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.127+0000 7fb645585700 1 --2- 172.21.15.84:0/2983320650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6401578d0 0x7fb6400c5840 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fb6400c87e0 tx=0x7fb6280091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.127+0000 7fb645585700 1 -- 172.21.15.84:0/2983320650 shutdown_connections 2023-10-06T03:27:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.127+0000 7fb645585700 1 --2- 172.21.15.84:0/2983320650 >> v2:172.21.15.131:3300/0 conn(0x7fb6400cec30 0x7fb6400c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.127+0000 7fb645585700 1 --2- 172.21.15.84:0/2983320650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6401578d0 0x7fb6400c5840 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.127+0000 7fb645585700 1 -- 172.21.15.84:0/2983320650 >> 172.21.15.84:0/2983320650 conn(0x7fb640070f20 msgr2=0x7fb6400ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.127+0000 7fb645585700 1 -- 172.21.15.84:0/2983320650 shutdown_connections 2023-10-06T03:27:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.127+0000 7fb645585700 1 -- 172.21.15.84:0/2983320650 wait complete. 2023-10-06T03:27:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.128+0000 7fb645585700 1 Processor -- start 2023-10-06T03:27:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.128+0000 7fb645585700 1 -- start start 2023-10-06T03:27:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb645585700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6400c88b0 0x7fb64014b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb645585700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6400cec30 0x7fb640155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb645585700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401578d0 0x7fb6400cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb645585700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400c2b00 con 0x7fb6400c88b0 2023-10-06T03:27:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb645585700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb640153a60 con 0x7fb6401578d0 2023-10-06T03:27:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb645585700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb640154fd0 con 0x7fb6400cec30 2023-10-06T03:27:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6400c88b0 0x7fb64014b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6400c88b0 0x7fb64014b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44674/0 (socket says 172.21.15.84:44674) 2023-10-06T03:27:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63effd700 1 -- 172.21.15.84:0/903476481 learned_addr learned my addr 172.21.15.84:0/903476481 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63f7fe700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401578d0 0x7fb6400cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63e7fc700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6400cec30 0x7fb640155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63effd700 1 -- 172.21.15.84:0/903476481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6400cec30 msgr2=0x7fb640155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63effd700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6400cec30 0x7fb640155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63effd700 1 -- 172.21.15.84:0/903476481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401578d0 msgr2=0x7fb6400cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63effd700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401578d0 0x7fb6400cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63effd700 1 -- 172.21.15.84:0/903476481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb628009420 con 0x7fb6400c88b0 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.129+0000 7fb63effd700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6400c88b0 0x7fb64014b780 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c8e0 tx=0x7fb6300016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.130+0000 7fb636ffd700 1 -- 172.21.15.84:0/903476481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000ce80 con 0x7fb6400c88b0 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.130+0000 7fb636ffd700 1 -- 172.21.15.84:0/903476481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb630005d80 con 0x7fb6400c88b0 2023-10-06T03:27:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.130+0000 7fb645585700 1 -- 172.21.15.84:0/903476481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb640153c70 con 0x7fb6400c88b0 2023-10-06T03:27:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.130+0000 7fb636ffd700 1 -- 172.21.15.84:0/903476481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000a800 con 0x7fb6400c88b0 2023-10-06T03:27:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.130+0000 7fb645585700 1 -- 172.21.15.84:0/903476481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb640154230 con 0x7fb6400c88b0 2023-10-06T03:27:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.131+0000 7fb645585700 1 -- 172.21.15.84:0/903476481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64004c3c0 con 0x7fb6400c88b0 2023-10-06T03:27:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.131+0000 7fb636ffd700 1 -- 172.21.15.84:0/903476481 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb63000ac30 con 0x7fb6400c88b0 2023-10-06T03:27:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.131+0000 7fb636ffd700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb620066f30 0x7fb6200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.131+0000 7fb636ffd700 1 -- 172.21.15.84:0/903476481 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6780+0+0 (secure 0 0 0) 0x7fb630084620 con 0x7fb6400c88b0 2023-10-06T03:27:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.131+0000 7fb63e7fc700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb620066f30 0x7fb6200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.132+0000 7fb63e7fc700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb620066f30 0x7fb6200693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb6400c87e0 tx=0x7fb628017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.136+0000 7fb636ffd700 1 -- 172.21.15.84:0/903476481 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6300514e0 con 0x7fb6400c88b0 2023-10-06T03:27:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.319+0000 7fb645585700 1 -- 172.21.15.84:0/903476481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb640071550 con 0x7fb6400c88b0 2023-10-06T03:27:44.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.957+0000 7fb636ffd700 1 -- 172.21.15.84:0/903476481 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v106) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb630054b00 con 0x7fb6400c88b0 2023-10-06T03:27:44.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.961+0000 7fb645585700 1 -- 172.21.15.84:0/903476481 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb620066f30 msgr2=0x7fb6200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:44.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.961+0000 7fb645585700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb620066f30 0x7fb6200693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb6400c87e0 tx=0x7fb628017000 comp rx=0 tx=0).stop 2023-10-06T03:27:44.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.961+0000 7fb645585700 1 -- 172.21.15.84:0/903476481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6400c88b0 msgr2=0x7fb64014b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:44.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.961+0000 7fb645585700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6400c88b0 0x7fb64014b780 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c8e0 tx=0x7fb6300016f0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.961+0000 7fb645585700 1 -- 172.21.15.84:0/903476481 shutdown_connections 2023-10-06T03:27:44.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.961+0000 7fb645585700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb620066f30 0x7fb6200693e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.961+0000 7fb645585700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401578d0 0x7fb6400cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.961+0000 7fb645585700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6400c88b0 0x7fb64014b780 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.961+0000 7fb645585700 1 --2- 172.21.15.84:0/903476481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6400cec30 0x7fb640155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:44.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.961+0000 7fb645585700 1 -- 172.21.15.84:0/903476481 >> 172.21.15.84:0/903476481 conn(0x7fb640070f20 msgr2=0x7fb64014fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:44.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.962+0000 7fb645585700 1 -- 172.21.15.84:0/903476481 shutdown_connections 2023-10-06T03:27:44.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:44.962+0000 7fb645585700 1 -- 172.21.15.84:0/903476481 wait complete. 2023-10-06T03:27:44.964 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:27:44.977 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:27:45.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.093+0000 7fcbf532a700 1 Processor -- start 2023-10-06T03:27:45.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.093+0000 7fcbf532a700 1 -- start start 2023-10-06T03:27:45.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbf532a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcbf0159ba0 0x7fcbf00ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:45.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbf532a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf00cea20 0x7fcbf00cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:45.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbf532a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcbf00cc380 0x7fcbf00c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:45.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbf532a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf00cc800 con 0x7fcbf0159ba0 2023-10-06T03:27:45.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbf532a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf006dc50 con 0x7fcbf00cc380 2023-10-06T03:27:45.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbf532a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf00cee90 con 0x7fcbf00cea20 2023-10-06T03:27:45.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbeeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcbf0159ba0 0x7fcbf00ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:45.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbeeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcbf0159ba0 0x7fcbf00ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44684/0 (socket says 172.21.15.84:44684) 2023-10-06T03:27:45.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbeeffd700 1 -- 172.21.15.84:0/1633959149 learned_addr learned my addr 172.21.15.84:0/1633959149 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:45.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbef7fe700 1 --2- 172.21.15.84:0/1633959149 >> v2:172.21.15.131:3300/0 conn(0x7fcbf00cc380 0x7fcbf00c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:45.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.094+0000 7fcbe67fc700 1 --2- 172.21.15.84:0/1633959149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf00cea20 0x7fcbf00cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:45.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbeeffd700 1 -- 172.21.15.84:0/1633959149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf00cea20 msgr2=0x7fcbf00cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbeeffd700 1 --2- 172.21.15.84:0/1633959149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf00cea20 0x7fcbf00cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbeeffd700 1 -- 172.21.15.84:0/1633959149 >> v2:172.21.15.131:3300/0 conn(0x7fcbf00cc380 msgr2=0x7fcbf00c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbeeffd700 1 --2- 172.21.15.84:0/1633959149 >> v2:172.21.15.131:3300/0 conn(0x7fcbf00cc380 0x7fcbf00c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbeeffd700 1 -- 172.21.15.84:0/1633959149 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf00cf170 con 0x7fcbf0159ba0 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbeeffd700 1 --2- 172.21.15.84:0/1633959149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0159ba0 0x7fcbf00ca410 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00b43d0 tx=0x7fcbe0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3947ade23ce87b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbee7fc700 1 -- 172.21.15.84:0/1633959149 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0005c10 con 0x7fcbf0159ba0 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbee7fc700 1 -- 172.21.15.84:0/1633959149 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe0005d70 con 0x7fcbf0159ba0 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbee7fc700 1 -- 172.21.15.84:0/1633959149 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000b880 con 0x7fcbf0159ba0 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbf532a700 1 -- 172.21.15.84:0/1633959149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0159ba0 msgr2=0x7fcbf00ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbf532a700 1 --2- 172.21.15.84:0/1633959149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0159ba0 0x7fcbf00ca410 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00b43d0 tx=0x7fcbe0009220 comp rx=0 tx=0).stop 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbf532a700 1 -- 172.21.15.84:0/1633959149 shutdown_connections 2023-10-06T03:27:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbf532a700 1 --2- 172.21.15.84:0/1633959149 >> v2:172.21.15.131:3300/0 conn(0x7fcbf00cc380 0x7fcbf00c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbf532a700 1 --2- 172.21.15.84:0/1633959149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0159ba0 0x7fcbf00ca410 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbf532a700 1 --2- 172.21.15.84:0/1633959149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf00cea20 0x7fcbf00cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbf532a700 1 -- 172.21.15.84:0/1633959149 >> 172.21.15.84:0/1633959149 conn(0x7fcbf0070f20 msgr2=0x7fcbf00ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:45.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbf532a700 1 -- 172.21.15.84:0/1633959149 shutdown_connections 2023-10-06T03:27:45.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.095+0000 7fcbf532a700 1 -- 172.21.15.84:0/1633959149 wait complete. 2023-10-06T03:27:45.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbf532a700 1 Processor -- start 2023-10-06T03:27:45.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbf532a700 1 -- start start 2023-10-06T03:27:45.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbf532a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf00cc380 0x7fcbf01588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbf532a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf00cea20 0x7fcbf0155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbf532a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf0159ba0 0x7fcbf00c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbf532a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf016d4a0 con 0x7fcbf00cc380 2023-10-06T03:27:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbf532a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf0158e10 con 0x7fcbf0159ba0 2023-10-06T03:27:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbf532a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf016d930 con 0x7fcbf00cea20 2023-10-06T03:27:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf00cc380 0x7fcbf01588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf00cc380 0x7fcbf01588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44696/0 (socket says 172.21.15.84:44696) 2023-10-06T03:27:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.097+0000 7fcbeeffd700 1 -- 172.21.15.84:0/1407015819 learned_addr learned my addr 172.21.15.84:0/1407015819 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbeeffd700 1 -- 172.21.15.84:0/1407015819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf00cea20 msgr2=0x7fcbf0155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbeeffd700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf00cea20 0x7fcbf0155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbeeffd700 1 -- 172.21.15.84:0/1407015819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf0159ba0 msgr2=0x7fcbf00c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbeeffd700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf0159ba0 0x7fcbf00c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbeeffd700 1 -- 172.21.15.84:0/1407015819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe0009480 con 0x7fcbf00cc380 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbeeffd700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf00cc380 0x7fcbf01588d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009fd0 tx=0x7fcbe0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbe77fe700 1 -- 172.21.15.84:0/1407015819 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0011910 con 0x7fcbf00cc380 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbe77fe700 1 -- 172.21.15.84:0/1407015819 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe0020070 con 0x7fcbf00cc380 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbf532a700 1 -- 172.21.15.84:0/1407015819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf009bc10 con 0x7fcbf00cc380 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbe77fe700 1 -- 172.21.15.84:0/1407015819 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0011ca0 con 0x7fcbf00cc380 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.098+0000 7fcbf532a700 1 -- 172.21.15.84:0/1407015819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf016ce50 con 0x7fcbf00cc380 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.099+0000 7fcbf532a700 1 -- 172.21.15.84:0/1407015819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf004c3c0 con 0x7fcbf00cc380 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.099+0000 7fcbe77fe700 1 -- 172.21.15.84:0/1407015819 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbe0022030 con 0x7fcbf00cc380 2023-10-06T03:27:45.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.100+0000 7fcbe77fe700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcbd0066fb0 0x7fcbd0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:45.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.100+0000 7fcbe77fe700 1 -- 172.21.15.84:0/1407015819 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fcbe0086530 con 0x7fcbf00cc380 2023-10-06T03:27:45.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.100+0000 7fcbe67fc700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcbd0066fb0 0x7fcbd0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:45.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.100+0000 7fcbe67fc700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcbd0066fb0 0x7fcbd0069460 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcbf015fd40 tx=0x7fcbd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:45.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.104+0000 7fcbe77fe700 1 -- 172.21.15.84:0/1407015819 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbe0053480 con 0x7fcbf00cc380 2023-10-06T03:27:45.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.285+0000 7fcbf532a700 1 -- 172.21.15.84:0/1407015819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcbf006d600 con 0x7fcbf00cc380 2023-10-06T03:27:45.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.965+0000 7fcbe77fe700 1 -- 172.21.15.84:0/1407015819 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v107) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcbe001a390 con 0x7fcbf00cc380 2023-10-06T03:27:45.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.969+0000 7fcbf532a700 1 -- 172.21.15.84:0/1407015819 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcbd0066fb0 msgr2=0x7fcbd0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:45.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.969+0000 7fcbf532a700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcbd0066fb0 0x7fcbd0069460 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcbf015fd40 tx=0x7fcbd8008040 comp rx=0 tx=0).stop 2023-10-06T03:27:45.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.969+0000 7fcbf532a700 1 -- 172.21.15.84:0/1407015819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf00cc380 msgr2=0x7fcbf01588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:45.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.969+0000 7fcbf532a700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf00cc380 0x7fcbf01588d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009fd0 tx=0x7fcbe0016000 comp rx=0 tx=0).stop 2023-10-06T03:27:45.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.970+0000 7fcbf532a700 1 -- 172.21.15.84:0/1407015819 shutdown_connections 2023-10-06T03:27:45.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.970+0000 7fcbf532a700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fcbd0066fb0 0x7fcbd0069460 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.970+0000 7fcbf532a700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf0159ba0 0x7fcbf00c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.970+0000 7fcbf532a700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf00cc380 0x7fcbf01588d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.970+0000 7fcbf532a700 1 --2- 172.21.15.84:0/1407015819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf00cea20 0x7fcbf0155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:45.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.970+0000 7fcbf532a700 1 -- 172.21.15.84:0/1407015819 >> 172.21.15.84:0/1407015819 conn(0x7fcbf0070f20 msgr2=0x7fcbf00c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:45.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.970+0000 7fcbf532a700 1 -- 172.21.15.84:0/1407015819 shutdown_connections 2023-10-06T03:27:45.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:45.970+0000 7fcbf532a700 1 -- 172.21.15.84:0/1407015819 wait complete. 2023-10-06T03:27:45.973 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T03:27:45.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:27:45.988 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:27:46.028 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2023-10-06T03:27:46.028 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2023-10-06T03:27:46.028 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:27:46.028 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2023-10-06T03:27:46.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2023-10-06T03:27:46.030 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:27:46.031 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2023-10-06T03:27:46.031 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:27:46.031 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:27:46.031 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2023-10-06T03:27:46.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.031 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:27:46.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.031 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2023-10-06T03:27:46.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.031 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2023-10-06T03:27:46.033 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.033 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2023-10-06T03:27:46.033 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2023-10-06T03:27:46.033 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2023-10-06T03:27:46.033 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-10-06T03:27:46.033 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on skipped message = False 2023-10-06T03:27:46.033 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 3eb6b236-a9b2-4c6a-bc84-749d824186bc 2023-10-06T03:27:46.033 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.033 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2023-10-06T03:27:46.033 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2023-10-06T03:27:46.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2023-10-06T03:27:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:27:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2023-10-06T03:27:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:27:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = "" 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-10-06T03:27:46.040 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2023-10-06T03:27:46.041 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2023-10-06T03:27:46.042 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2023-10-06T03:27:46.042 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-10-06T03:27:46.042 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-10-06T03:27:46.042 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-10-06T03:27:46.042 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2023-10-06T03:27:46.043 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2023-10-06T03:27:46.044 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.045 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.84,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on skipped message = False 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 3eb6b236-a9b2-4c6a-bc84-749d824186bc 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.046 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2023-10-06T03:27:46.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2023-10-06T03:27:46.048 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 20 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 20 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 10 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2023-10-06T03:27:46.049 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2023-10-06T03:27:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:27:46.051 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2023-10-06T03:27:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = "" 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2023-10-06T03:27:46.053 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-10-06T03:27:46.054 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-10-06T03:27:46.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:27:46.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.209+0000 7fa604c44700 1 Processor -- start 2023-10-06T03:27:46.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.210+0000 7fa604c44700 1 -- start start 2023-10-06T03:27:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.210+0000 7fa604c44700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6000ae0a0 0x7fa600162480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.210+0000 7fa604c44700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6000c6e20 con 0x7fa600157c30 2023-10-06T03:27:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.210+0000 7fa604c44700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6000c7080 con 0x7fa60006d650 2023-10-06T03:27:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.210+0000 7fa604c44700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6000c7360 con 0x7fa6000ae0a0 2023-10-06T03:27:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.210+0000 7fa5f5d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa600157c30 0x7fa6000ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54554/0 (socket says 172.21.15.84:54554) 2023-10-06T03:27:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.210+0000 7fa5f5d9b700 1 -- 172.21.15.84:0/1715149767 learned_addr learned my addr 172.21.15.84:0/1715149767 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fed9d700 1 --2- 172.21.15.84:0/1715149767 >> v2:172.21.15.131:3300/0 conn(0x7fa6000ae0a0 0x7fa600162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626163489 0 0) 0x7fa6000c6e20 con 0x7fa600157c30 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ec003570 con 0x7fa600157c30 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2681471804 0 0) 0x7fa5ec003570 con 0x7fa600157c30 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 >> v2:172.21.15.131:3300/0 conn(0x7fa6000ae0a0 msgr2=0x7fa600162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 --2- 172.21.15.84:0/1715149767 >> v2:172.21.15.131:3300/0 conn(0x7fa6000ae0a0 0x7fa600162480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 >> v1:172.21.15.131:6789/0 conn(0x7fa60006d650 legacy=0x7fa6000c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6000c7640 con 0x7fa600157c30 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7fa5e8001470 con 0x7fa600157c30 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 >> v1:172.21.15.84:6789/0 conn(0x7fa600157c30 legacy=0x7fa6000ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa5ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5ec004810 0x7fa5ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5ec0051c0 0x7fa5ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000c7360 con 0x7fa5ec003a60 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec00c0d0 con 0x7fa5ec0051c0 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec00c290 con 0x7fa5ec004810 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fe59c700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa5ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fed9d700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5ec0051c0 0x7fa5ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5f5d9b700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5ec004810 0x7fa5ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fe59c700 1 -- 172.21.15.84:0/1715149767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5ec004810 msgr2=0x7fa5ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fe59c700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5ec004810 0x7fa5ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fe59c700 1 -- 172.21.15.84:0/1715149767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5ec0051c0 msgr2=0x7fa5ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fe59c700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5ec0051c0 0x7fa5ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fed9d700 1 -- 172.21.15.84:0/1715149767 reap_dead start 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5fe59c700 1 -- 172.21.15.84:0/1715149767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec003570 con 0x7fa5ec003a60 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.211+0000 7fa5f5d9b700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5ec004810 0x7fa5ec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa5fe59c700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa5ec003e70 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00018b0 tx=0x7fa5f0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7955dc5f829856cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0012420 con 0x7fa5ec003a60 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f00125a0 con 0x7fa5ec003a60 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa5fdd9b700 1 -- 172.21.15.84:0/1715149767 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0012960 con 0x7fa5ec003a60 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa604c44700 1 -- 172.21.15.84:0/1715149767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 msgr2=0x7fa5ec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa604c44700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa5ec003e70 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00018b0 tx=0x7fa5f0007d30 comp rx=0 tx=0).stop 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa604c44700 1 -- 172.21.15.84:0/1715149767 shutdown_connections 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa604c44700 1 --2- 172.21.15.84:0/1715149767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa5ec003e70 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa604c44700 1 -- 172.21.15.84:0/1715149767 >> 172.21.15.84:0/1715149767 conn(0x7fa6000cc0d0 msgr2=0x7fa6000cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa604c44700 1 -- 172.21.15.84:0/1715149767 shutdown_connections 2023-10-06T03:27:46.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.212+0000 7fa604c44700 1 -- 172.21.15.84:0/1715149767 wait complete. 2023-10-06T03:27:46.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.213+0000 7fa604c44700 1 Processor -- start 2023-10-06T03:27:46.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.213+0000 7fa604c44700 1 -- start start 2023-10-06T03:27:46.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa604c44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa6000a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa604c44700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6000a5a10 0x7fa6000ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa604c44700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6000ca7f0 0x7fa6000cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa604c44700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000a5e80 con 0x7fa5ec003a60 2023-10-06T03:27:46.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa604c44700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60016e340 con 0x7fa6000ca7f0 2023-10-06T03:27:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa604c44700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000af740 con 0x7fa6000a5a10 2023-10-06T03:27:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa5fe59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa6000a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa5fe59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa6000a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44716/0 (socket says 172.21.15.84:44716) 2023-10-06T03:27:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa5fe59c700 1 -- 172.21.15.84:0/1685867756 learned_addr learned my addr 172.21.15.84:0/1685867756 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa5f5d9b700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6000a5a10 0x7fa6000ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.214+0000 7fa5fed9d700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6000ca7f0 0x7fa6000cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa5fe59c700 1 -- 172.21.15.84:0/1685867756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6000a5a10 msgr2=0x7fa6000ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa5fe59c700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6000a5a10 0x7fa6000ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa5fe59c700 1 -- 172.21.15.84:0/1685867756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6000ca7f0 msgr2=0x7fa6000cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa5fe59c700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6000ca7f0 0x7fa6000cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa5fe59c700 1 -- 172.21.15.84:0/1685867756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6000afa00 con 0x7fa5ec003a60 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa5fed9d700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6000ca7f0 0x7fa6000cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa5fe59c700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa6000a54d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000c3f0 tx=0x7fa5f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa5f6ffd700 1 -- 172.21.15.84:0/1685867756 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0001200 con 0x7fa5ec003a60 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa5f6ffd700 1 -- 172.21.15.84:0/1685867756 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f0012cd0 con 0x7fa5ec003a60 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa604c44700 1 -- 172.21.15.84:0/1685867756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6000afce0 con 0x7fa5ec003a60 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa5f6ffd700 1 -- 172.21.15.84:0/1685867756 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0012940 con 0x7fa5ec003a60 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.215+0000 7fa604c44700 1 -- 172.21.15.84:0/1685867756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6000b02a0 con 0x7fa5ec003a60 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.216+0000 7fa604c44700 1 -- 172.21.15.84:0/1685867756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6000b04c0 con 0x7fa5ec003a60 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.216+0000 7fa5f6ffd700 1 -- 172.21.15.84:0/1685867756 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5f001f620 con 0x7fa5ec003a60 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.217+0000 7fa5f6ffd700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa5e0066f60 0x7fa5e0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.217+0000 7fa5f6ffd700 1 -- 172.21.15.84:0/1685867756 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fa5f0085fe0 con 0x7fa5ec003a60 2023-10-06T03:27:46.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.217+0000 7fa5f5d9b700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa5e0066f60 0x7fa5e0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.217+0000 7fa5f5d9b700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa5e0066f60 0x7fa5e0069410 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80015a0 tx=0x7fa5e8007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:46.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.221+0000 7fa5f6ffd700 1 -- 172.21.15.84:0/1685867756 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5f00531b0 con 0x7fa5ec003a60 2023-10-06T03:27:46.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.406+0000 7fa604c44700 1 -- 172.21.15.84:0/1685867756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa600064ad0 con 0x7fa5ec003a60 2023-10-06T03:27:46.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.409+0000 7fa5f6ffd700 1 -- 172.21.15.84:0/1685867756 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa5f00170a0 con 0x7fa5ec003a60 2023-10-06T03:27:46.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 -- 172.21.15.84:0/1685867756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa5e0066f60 msgr2=0x7fa5e0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa5e0066f60 0x7fa5e0069410 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80015a0 tx=0x7fa5e8007040 comp rx=0 tx=0).stop 2023-10-06T03:27:46.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 -- 172.21.15.84:0/1685867756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 msgr2=0x7fa6000a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa6000a54d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000c3f0 tx=0x7fa5f0015000 comp rx=0 tx=0).stop 2023-10-06T03:27:46.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 -- 172.21.15.84:0/1685867756 shutdown_connections 2023-10-06T03:27:46.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa5e0066f60 0x7fa5e0069410 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6000ca7f0 0x7fa6000cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5ec003a60 0x7fa6000a54d0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 --2- 172.21.15.84:0/1685867756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6000a5a10 0x7fa6000ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 -- 172.21.15.84:0/1685867756 >> 172.21.15.84:0/1685867756 conn(0x7fa6000cc0d0 msgr2=0x7fa6001590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 -- 172.21.15.84:0/1685867756 shutdown_connections 2023-10-06T03:27:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.411+0000 7fa604c44700 1 -- 172.21.15.84:0/1685867756 wait complete. 2023-10-06T03:27:46.425 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2023-10-06T03:27:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.542+0000 7f29b1c78700 1 Processor -- start 2023-10-06T03:27:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.542+0000 7f29b1c78700 1 -- start start 2023-10-06T03:27:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29b1c78700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29ac159480 0x7f29ac0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29b1c78700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29ac0b3610 0x7f29ac0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29b1c78700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac0cb7e0 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29b1c78700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac0b08a0 con 0x7f29ac0b3610 2023-10-06T03:27:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29b1c78700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0cb190 con 0x7f29ac159480 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29abfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29ac0b3610 0x7f29ac0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29abfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29ac0b3610 0x7f29ac0cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44726/0 (socket says 172.21.15.84:44726) 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29abfff700 1 -- 172.21.15.84:0/197550717 learned_addr learned my addr 172.21.15.84:0/197550717 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29b0c76700 1 --2- 172.21.15.84:0/197550717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29ac159480 0x7f29ac0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29abfff700 1 -- 172.21.15.84:0/197550717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29ac159480 msgr2=0x7f29ac0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29abfff700 1 --2- 172.21.15.84:0/197550717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29ac159480 0x7f29ac0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29abfff700 1 -- 172.21.15.84:0/197550717 >> v1:172.21.15.131:6789/0 conn(0x7f29ac0cc1b0 legacy=0x7f29ac0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.543+0000 7f29abfff700 1 -- 172.21.15.84:0/197550717 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0cb470 con 0x7f29ac0b3610 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29abfff700 1 --2- 172.21.15.84:0/197550717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0b3610 0x7f29ac0cbc70 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f29a00099b0 tx=0x7f29a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3855ae0220d0514f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29ab7fe700 1 -- 172.21.15.84:0/197550717 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0009ea0 con 0x7f29ac0b3610 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29ab7fe700 1 -- 172.21.15.84:0/197550717 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a000b860 con 0x7f29ac0b3610 2023-10-06T03:27:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29ab7fe700 1 -- 172.21.15.84:0/197550717 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000bc00 con 0x7f29ac0b3610 2023-10-06T03:27:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29b1c78700 1 -- 172.21.15.84:0/197550717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0b3610 msgr2=0x7f29ac0cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29b1c78700 1 --2- 172.21.15.84:0/197550717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0b3610 0x7f29ac0cbc70 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f29a00099b0 tx=0x7f29a0009250 comp rx=0 tx=0).stop 2023-10-06T03:27:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29b1c78700 1 -- 172.21.15.84:0/197550717 shutdown_connections 2023-10-06T03:27:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29b1c78700 1 --2- 172.21.15.84:0/197550717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29ac159480 0x7f29ac0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29b1c78700 1 --2- 172.21.15.84:0/197550717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0b3610 0x7f29ac0cbc70 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29b1c78700 1 -- 172.21.15.84:0/197550717 >> 172.21.15.84:0/197550717 conn(0x7f29ac06ed20 msgr2=0x7f29ac06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29b1c78700 1 -- 172.21.15.84:0/197550717 shutdown_connections 2023-10-06T03:27:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.544+0000 7f29b1c78700 1 -- 172.21.15.84:0/197550717 wait complete. 2023-10-06T03:27:46.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.545+0000 7f29b1c78700 1 Processor -- start 2023-10-06T03:27:46.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.546+0000 7f29b1c78700 1 -- start start 2023-10-06T03:27:46.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.546+0000 7f29b1c78700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29ac0b3610 0x7f29ac0cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.546+0000 7f29b1c78700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0cc1b0 0x7f29ac151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.546+0000 7f29b1c78700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29ac159480 0x7f29ac0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.546+0000 7f29b1c78700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0c7ce0 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.546+0000 7f29b1c78700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0d01b0 con 0x7f29ac159480 2023-10-06T03:27:46.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.546+0000 7f29b1c78700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0c73b0 con 0x7f29ac0b3610 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.546+0000 7f29abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0cc1b0 0x7f29ac151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.546+0000 7f29abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0cc1b0 0x7f29ac151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44736/0 (socket says 172.21.15.84:44736) 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.546+0000 7f29abfff700 1 -- 172.21.15.84:0/838846246 learned_addr learned my addr 172.21.15.84:0/838846246 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29b0c76700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29ac0b3610 0x7f29ac0cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29b1477700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29ac159480 0x7f29ac0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29abfff700 1 -- 172.21.15.84:0/838846246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29ac0b3610 msgr2=0x7f29ac0cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29abfff700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29ac0b3610 0x7f29ac0cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29abfff700 1 -- 172.21.15.84:0/838846246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29ac159480 msgr2=0x7f29ac0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29abfff700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29ac159480 0x7f29ac0cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29abfff700 1 -- 172.21.15.84:0/838846246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a00094f0 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29abfff700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0cc1b0 0x7f29ac151b50 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f29ac069190 tx=0x7f29a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29a8ff9700 1 -- 172.21.15.84:0/838846246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000bbe0 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29a8ff9700 1 -- 172.21.15.84:0/838846246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a0011420 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29b1c78700 1 -- 172.21.15.84:0/838846246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac0c7690 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29a8ff9700 1 -- 172.21.15.84:0/838846246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00117c0 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.547+0000 7f29b1c78700 1 -- 172.21.15.84:0/838846246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac0cfe70 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.548+0000 7f29b1c78700 1 -- 172.21.15.84:0/838846246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac05f270 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.548+0000 7f29a8ff9700 1 -- 172.21.15.84:0/838846246 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29a0011bf0 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.549+0000 7f29a8ff9700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2998066f30 0x7f29980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.549+0000 7f29a8ff9700 1 -- 172.21.15.84:0/838846246 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f29a0085f10 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.549+0000 7f29b0c76700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2998066f30 0x7f29980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.549+0000 7f29b0c76700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2998066f30 0x7f29980693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f299c007600 tx=0x7f299c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:46.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.553+0000 7f29a8ff9700 1 -- 172.21.15.84:0/838846246 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29a00530e0 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.809+0000 7f29b1c78700 1 -- 172.21.15.84:0/838846246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) v1 -- 0x7f29ac159850 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.962+0000 7f29a8ff9700 1 -- 172.21.15.84:0/838846246 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v240) v1 ==== 145+0+0 (secure 0 0 0) 0x7f29a0056700 con 0x7f29ac0cc1b0 2023-10-06T03:27:46.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 -- 172.21.15.84:0/838846246 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2998066f30 msgr2=0x7f29980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2998066f30 0x7f29980693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f299c007600 tx=0x7f299c00b040 comp rx=0 tx=0).stop 2023-10-06T03:27:46.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 -- 172.21.15.84:0/838846246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0cc1b0 msgr2=0x7f29ac151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:46.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0cc1b0 0x7f29ac151b50 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f29ac069190 tx=0x7f29a0017000 comp rx=0 tx=0).stop 2023-10-06T03:27:46.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 -- 172.21.15.84:0/838846246 shutdown_connections 2023-10-06T03:27:46.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2998066f30 0x7f29980693e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29ac159480 0x7f29ac0cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29ac0b3610 0x7f29ac0cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 --2- 172.21.15.84:0/838846246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0cc1b0 0x7f29ac151b50 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:46.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 -- 172.21.15.84:0/838846246 >> 172.21.15.84:0/838846246 conn(0x7f29ac06ed20 msgr2=0x7f29ac1553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:46.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 -- 172.21.15.84:0/838846246 shutdown_connections 2023-10-06T03:27:46.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:46.964+0000 7f29b1c78700 1 -- 172.21.15.84:0/838846246 wait complete. 2023-10-06T03:27:46.977 INFO:tasks.cephfs_test_runner:That when many sessions are updated, they are correctly ... ok 2023-10-06T03:27:46.978 INFO:tasks.cephfs_test_runner: 2023-10-06T03:27:46.978 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T03:27:46.978 INFO:tasks.cephfs_test_runner:Ran 6 tests in 196.477s 2023-10-06T03:27:46.978 INFO:tasks.cephfs_test_runner: 2023-10-06T03:27:46.978 INFO:tasks.cephfs_test_runner:OK (skipped=2) 2023-10-06T03:27:46.978 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T03:27:46.988 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T03:27:47.011 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T03:27:47.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.011 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:27:47.026 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:27:47.026 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:27:47.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.026 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:27:47.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.107 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:27:47.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.186 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-10-06T03:27:47.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.280 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:27:47.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.295 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-10-06T03:27:47.363 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2023-10-06T03:27:47.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:27:47.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.365 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:27:47.384 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:27:47.384 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:27:47.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.384 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:27:47.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:27:47.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.544 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2023-10-06T03:27:47.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.646 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:27:47.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:27:47.661 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2023-10-06T03:27:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2023-10-06T03:27:47.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:27:47.731 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T03:27:47.740 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T03:27:47.740 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:27:47.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.854+0000 7f3c8e6f7700 1 Processor -- start 2023-10-06T03:27:47.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.854+0000 7f3c8e6f7700 1 -- start start 2023-10-06T03:27:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.854+0000 7f3c8e6f7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 0x7f3c880ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.854+0000 7f3c8e6f7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3c8806e280 0x7f3c8806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.854+0000 7f3c8e6f7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c880c7370 con 0x7f3c88069560 2023-10-06T03:27:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.854+0000 7f3c8e6f7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c88156150 con 0x7f3c8806e280 2023-10-06T03:27:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.854+0000 7f3c8e6f7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880ac580 con 0x7f3c880adf60 2023-10-06T03:27:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 0x7f3c880ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c877fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3c8806e280 0x7f3c8806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c877fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3c8806e280 0x7f3c8806e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:59862/0 (socket says 172.21.15.84:59862) 2023-10-06T03:27:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 0x7f3c880ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:48492/0 (socket says 172.21.15.84:48492) 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c8cc94700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3c88069560 0x7f3c880c7800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:42350/0 (socket says 172.21.15.84:42350) 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c877fe700 1 -- 172.21.15.84:0/1047927623 learned_addr learned my addr 172.21.15.84:0/1047927623 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c87fff700 1 -- 172.21.15.84:0/1047927623 >> v2:172.21.15.131:3300/0 conn(0x7f3c8806e280 msgr2=0x7f3c8806e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c87fff700 1 --2- 172.21.15.84:0/1047927623 >> v2:172.21.15.131:3300/0 conn(0x7f3c8806e280 0x7f3c8806e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c87fff700 1 -- 172.21.15.84:0/1047927623 >> v1:172.21.15.131:6789/0 conn(0x7f3c88069560 legacy=0x7f3c880c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c87fff700 1 -- 172.21.15.84:0/1047927623 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c880c6760 con 0x7f3c880adf60 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c877fe700 1 --2- 172.21.15.84:0/1047927623 >> v2:172.21.15.131:3300/0 conn(0x7f3c8806e280 0x7f3c8806e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c87fff700 1 --2- 172.21.15.84:0/1047927623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 0x7f3c880ac040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c780098e0 tx=0x7f3c780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fd1053ea81c2a18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c86ffd700 1 -- 172.21.15.84:0/1047927623 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800b640 con 0x7f3c880adf60 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c86ffd700 1 -- 172.21.15.84:0/1047927623 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7800b7a0 con 0x7f3c880adf60 2023-10-06T03:27:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.855+0000 7f3c86ffd700 1 -- 172.21.15.84:0/1047927623 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800bb40 con 0x7f3c880adf60 2023-10-06T03:27:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.856+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/1047927623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 msgr2=0x7f3c880ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.856+0000 7f3c8e6f7700 1 --2- 172.21.15.84:0/1047927623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 0x7f3c880ac040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c780098e0 tx=0x7f3c780091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.856+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/1047927623 shutdown_connections 2023-10-06T03:27:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.856+0000 7f3c8e6f7700 1 --2- 172.21.15.84:0/1047927623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 0x7f3c880ac040 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.856+0000 7f3c8e6f7700 1 --2- 172.21.15.84:0/1047927623 >> v2:172.21.15.131:3300/0 conn(0x7f3c8806e280 0x7f3c8806e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.856+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/1047927623 >> 172.21.15.84:0/1047927623 conn(0x7f3c880680c0 msgr2=0x7f3c880cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.856+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/1047927623 shutdown_connections 2023-10-06T03:27:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.856+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/1047927623 wait complete. 2023-10-06T03:27:47.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.857+0000 7f3c8e6f7700 1 Processor -- start 2023-10-06T03:27:47.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.857+0000 7f3c8e6f7700 1 -- start start 2023-10-06T03:27:47.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c8e6f7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88069560 0x7f3c8814a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:47.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c8e6f7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c8806e280 0x7f3c880b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:47.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c8e6f7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 0x7f3c880c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:47.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c8e6f7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880b0f80 con 0x7f3c88069560 2023-10-06T03:27:47.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c8e6f7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880ab5c0 con 0x7f3c8806e280 2023-10-06T03:27:47.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c8e6f7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88154be0 con 0x7f3c880adf60 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88069560 0x7f3c8814a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88069560 0x7f3c8814a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44748/0 (socket says 172.21.15.84:44748) 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c87fff700 1 -- 172.21.15.84:0/3608542152 learned_addr learned my addr 172.21.15.84:0/3608542152 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c8cc94700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 0x7f3c880c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c877fe700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c8806e280 0x7f3c880b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c87fff700 1 -- 172.21.15.84:0/3608542152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 msgr2=0x7f3c880c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c87fff700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 0x7f3c880c1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c87fff700 1 -- 172.21.15.84:0/3608542152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c8806e280 msgr2=0x7f3c880b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c87fff700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c8806e280 0x7f3c880b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.858+0000 7f3c87fff700 1 -- 172.21.15.84:0/3608542152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c0094f0 con 0x7f3c88069560 2023-10-06T03:27:47.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.859+0000 7f3c87fff700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88069560 0x7f3c8814a6c0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800a010 tx=0x7f3c78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.859+0000 7f3c6ffff700 1 -- 172.21.15.84:0/3608542152 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7801bc80 con 0x7f3c88069560 2023-10-06T03:27:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.859+0000 7f3c6ffff700 1 -- 172.21.15.84:0/3608542152 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7801be20 con 0x7f3c88069560 2023-10-06T03:27:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.859+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/3608542152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c78009420 con 0x7f3c88069560 2023-10-06T03:27:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.859+0000 7f3c6ffff700 1 -- 172.21.15.84:0/3608542152 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78011670 con 0x7f3c88069560 2023-10-06T03:27:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.859+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/3608542152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c880ab290 con 0x7f3c88069560 2023-10-06T03:27:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.860+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/3608542152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c88064ad0 con 0x7f3c88069560 2023-10-06T03:27:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.860+0000 7f3c6ffff700 1 -- 172.21.15.84:0/3608542152 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c78011aa0 con 0x7f3c88069560 2023-10-06T03:27:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.860+0000 7f3c6ffff700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c74066f30 0x7f3c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.860+0000 7f3c6ffff700 1 -- 172.21.15.84:0/3608542152 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f3c78085d60 con 0x7f3c88069560 2023-10-06T03:27:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.861+0000 7f3c877fe700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c74066f30 0x7f3c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:47.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.861+0000 7f3c877fe700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c74066f30 0x7f3c740693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3c8806d590 tx=0x7f3c7c009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:47.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:47.865+0000 7f3c6ffff700 1 -- 172.21.15.84:0/3608542152 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c78052f30 con 0x7f3c88069560 2023-10-06T03:27:48.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.050+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/3608542152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c880c6a40 con 0x7f3c88069560 2023-10-06T03:27:48.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.051+0000 7f3c6ffff700 1 -- 172.21.15.84:0/3608542152 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+14373 (secure 0 0 0) 0x7f3c78056550 con 0x7f3c88069560 2023-10-06T03:27:48.053 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:48.053 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":107,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:27:45.954634+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6837/573778757":"2023-10-07T03:27:42.945817+0000","172.21.15.84:6836/573778757":"2023-10-07T03:27:42.945817+0000","172.21.15.84:6836/632169803":"2023-10-07T03:27:15.500473+0000","172.21.15.131:6832/169780123":"2023-10-07T03:27:16.359327+0000","172.21.15.84:6834/3193918731":"2023-10-07T03:27:42.945803+0000","172.21.15.84:6837/632169803":"2023-10-07T03:27:15.500473+0000","172.21.15.131:6834/169780123":"2023-10-07T03:27:16.359327+0000","172.21.15.84:6835/3193918731":"2023-10-07T03:27:42.945803+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:27:48.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/3608542152 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c74066f30 msgr2=0x7f3c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c74066f30 0x7f3c740693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3c8806d590 tx=0x7f3c7c009250 comp rx=0 tx=0).stop 2023-10-06T03:27:48.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/3608542152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88069560 msgr2=0x7f3c8814a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88069560 0x7f3c8814a6c0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800a010 tx=0x7f3c78017000 comp rx=0 tx=0).stop 2023-10-06T03:27:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/3608542152 shutdown_connections 2023-10-06T03:27:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3c74066f30 0x7f3c740693e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c880adf60 0x7f3c880c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88069560 0x7f3c8814a6c0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 --2- 172.21.15.84:0/3608542152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c8806e280 0x7f3c880b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/3608542152 >> 172.21.15.84:0/3608542152 conn(0x7f3c880680c0 msgr2=0x7f3c880ad0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/3608542152 shutdown_connections 2023-10-06T03:27:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.053+0000 7f3c8e6f7700 1 -- 172.21.15.84:0/3608542152 wait complete. 2023-10-06T03:27:48.067 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:27:48.067 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:27:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.180+0000 7f3393c5c700 1 Processor -- start 2023-10-06T03:27:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.181+0000 7f3393c5c700 1 -- start start 2023-10-06T03:27:48.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.181+0000 7f3393c5c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f338c0b2620 0x7f338c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.181+0000 7f3393c5c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 0x7f338c159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.181+0000 7f3393c5c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f338c1596a0 0x7f338c068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.181+0000 7f3393c5c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c0cbfe0 con 0x7f338c1596a0 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.181+0000 7f3393c5c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c0cb3d0 con 0x7f338c0b2620 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.181+0000 7f3393c5c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0cb6b0 con 0x7f338c0b29f0 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.181+0000 7f33921f9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f338c1596a0 0x7f338c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.181+0000 7f33921f9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f338c1596a0 0x7f338c068580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44754/0 (socket says 172.21.15.84:44754) 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.181+0000 7f33921f9700 1 -- 172.21.15.84:0/2517248883 learned_addr learned my addr 172.21.15.84:0/2517248883 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33911f7700 1 --2- 172.21.15.84:0/2517248883 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 0x7f338c159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33919f8700 1 --2- 172.21.15.84:0/2517248883 >> v2:172.21.15.131:3300/0 conn(0x7f338c0b2620 0x7f338c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33921f9700 1 -- 172.21.15.84:0/2517248883 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 msgr2=0x7f338c159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33921f9700 1 --2- 172.21.15.84:0/2517248883 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 0x7f338c159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33921f9700 1 -- 172.21.15.84:0/2517248883 >> v2:172.21.15.131:3300/0 conn(0x7f338c0b2620 msgr2=0x7f338c0b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33921f9700 1 --2- 172.21.15.84:0/2517248883 >> v2:172.21.15.131:3300/0 conn(0x7f338c0b2620 0x7f338c0b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33921f9700 1 -- 172.21.15.84:0/2517248883 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0cb990 con 0x7f338c1596a0 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33921f9700 1 --2- 172.21.15.84:0/2517248883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c1596a0 0x7f338c068580 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f338c0d0460 tx=0x7f3384009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5b81a16fc9cf02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33909f6700 1 -- 172.21.15.84:0/2517248883 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338400b640 con 0x7f338c1596a0 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33909f6700 1 -- 172.21.15.84:0/2517248883 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338400b7a0 con 0x7f338c1596a0 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.182+0000 7f33909f6700 1 -- 172.21.15.84:0/2517248883 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338400bb60 con 0x7f338c1596a0 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.183+0000 7f3393c5c700 1 -- 172.21.15.84:0/2517248883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c1596a0 msgr2=0x7f338c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.183+0000 7f3393c5c700 1 --2- 172.21.15.84:0/2517248883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c1596a0 0x7f338c068580 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f338c0d0460 tx=0x7f3384009250 comp rx=0 tx=0).stop 2023-10-06T03:27:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.183+0000 7f3393c5c700 1 -- 172.21.15.84:0/2517248883 shutdown_connections 2023-10-06T03:27:48.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.183+0000 7f3393c5c700 1 --2- 172.21.15.84:0/2517248883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c1596a0 0x7f338c068580 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.183+0000 7f3393c5c700 1 --2- 172.21.15.84:0/2517248883 >> v2:172.21.15.131:3300/0 conn(0x7f338c0b2620 0x7f338c0b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.183+0000 7f3393c5c700 1 --2- 172.21.15.84:0/2517248883 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 0x7f338c159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.183+0000 7f3393c5c700 1 -- 172.21.15.84:0/2517248883 >> 172.21.15.84:0/2517248883 conn(0x7f338c06ed20 msgr2=0x7f338c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:48.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.183+0000 7f3393c5c700 1 -- 172.21.15.84:0/2517248883 shutdown_connections 2023-10-06T03:27:48.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.183+0000 7f3393c5c700 1 -- 172.21.15.84:0/2517248883 wait complete. 2023-10-06T03:27:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.184+0000 7f3393c5c700 1 Processor -- start 2023-10-06T03:27:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.184+0000 7f3393c5c700 1 -- start start 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3393c5c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c0b2620 0x7f338c15e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3393c5c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 0x7f338c0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3393c5c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f338c1596a0 0x7f338c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3393c5c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0c9020 con 0x7f338c0b2620 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3393c5c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0c7f40 con 0x7f338c1596a0 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3393c5c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0c8220 con 0x7f338c0b29f0 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33919f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c0b2620 0x7f338c15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33919f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c0b2620 0x7f338c15e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44768/0 (socket says 172.21.15.84:44768) 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33919f8700 1 -- 172.21.15.84:0/1660202127 learned_addr learned my addr 172.21.15.84:0/1660202127 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33911f7700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 0x7f338c0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33921f9700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f338c1596a0 0x7f338c0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33919f8700 1 -- 172.21.15.84:0/1660202127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 msgr2=0x7f338c0c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33919f8700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 0x7f338c0c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33919f8700 1 -- 172.21.15.84:0/1660202127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f338c1596a0 msgr2=0x7f338c0cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33919f8700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f338c1596a0 0x7f338c0cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33919f8700 1 -- 172.21.15.84:0/1660202127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840094f0 con 0x7f338c0b2620 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33911f7700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 0x7f338c0c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f33919f8700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c0b2620 0x7f338c15e760 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f3388009f40 tx=0x7f338800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3381ffb700 1 -- 172.21.15.84:0/1660202127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800ccd0 con 0x7f338c0b2620 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3381ffb700 1 -- 172.21.15.84:0/1660202127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338800f040 con 0x7f338c0b2620 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3381ffb700 1 -- 172.21.15.84:0/1660202127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880146b0 con 0x7f338c0b2620 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3393c5c700 1 -- 172.21.15.84:0/1660202127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c0c8500 con 0x7f338c0b2620 2023-10-06T03:27:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.185+0000 7f3393c5c700 1 -- 172.21.15.84:0/1660202127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c153ab0 con 0x7f338c0b2620 2023-10-06T03:27:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.186+0000 7f3393c5c700 1 -- 172.21.15.84:0/1660202127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c0c9300 con 0x7f338c0b2620 2023-10-06T03:27:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.187+0000 7f3381ffb700 1 -- 172.21.15.84:0/1660202127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3388014a20 con 0x7f338c0b2620 2023-10-06T03:27:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.187+0000 7f3381ffb700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3370066f30 0x7f33700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.187+0000 7f3381ffb700 1 -- 172.21.15.84:0/1660202127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f3388085470 con 0x7f338c0b2620 2023-10-06T03:27:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.187+0000 7f33911f7700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3370066f30 0x7f33700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.188+0000 7f33911f7700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3370066f30 0x7f33700693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f338c145970 tx=0x7f337c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:48.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.191+0000 7f3381ffb700 1 -- 172.21.15.84:0/1660202127 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3388052640 con 0x7f338c0b2620 2023-10-06T03:27:48.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.369+0000 7f3393c5c700 1 -- 172.21.15.84:0/1660202127 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f338c064ad0 con 0x7f3370066f30 2023-10-06T03:27:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.372+0000 7f3381ffb700 1 -- 172.21.15.84:0/1660202127 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73379 (secure 0 0 0) 0x7f338c064ad0 con 0x7f3370066f30 2023-10-06T03:27:48.375 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 -- 172.21.15.84:0/1660202127 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3370066f30 msgr2=0x7f33700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3370066f30 0x7f33700693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f338c145970 tx=0x7f337c008040 comp rx=0 tx=0).stop 2023-10-06T03:27:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 -- 172.21.15.84:0/1660202127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c0b2620 msgr2=0x7f338c15e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c0b2620 0x7f338c15e760 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f3388009f40 tx=0x7f338800b040 comp rx=0 tx=0).stop 2023-10-06T03:27:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 -- 172.21.15.84:0/1660202127 shutdown_connections 2023-10-06T03:27:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3370066f30 0x7f33700693e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f338c1596a0 0x7f338c0cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f338c0b2620 0x7f338c15e760 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 --2- 172.21.15.84:0/1660202127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f338c0b29f0 0x7f338c0c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 -- 172.21.15.84:0/1660202127 >> 172.21.15.84:0/1660202127 conn(0x7f338c06ed20 msgr2=0x7f338c157780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 -- 172.21.15.84:0/1660202127 shutdown_connections 2023-10-06T03:27:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.374+0000 7f3393c5c700 1 -- 172.21.15.84:0/1660202127 wait complete. 2023-10-06T03:27:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:27:48.387 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-10-06T03:27:47.089160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389684,"kb_used_data":11380,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752585036,"statfs":{"total":773094113280,"available":770647076864,"internally_reserved":0,"allocated":11653120,"data_stored":6176381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19530,"num_objects":-41,"num_object_clones":0,"num_object_copies":-82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41,"num_whiteouts":0,"num_read":-62,"num_read_kb":-56,"num_write":-140,"num_write_kb":-66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000920"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.560114+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:27:38.560114+0000","last_peered":"2023-10-06T03:27:38.560114+0000","last_clean":"2023-10-06T03:27:38.560114+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:27:38.560114+0000","last_undegraded":"2023-10-06T03:27:38.560114+0000","last_fullsized":"2023-10-06T03:27:38.560114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:27:39.867830+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:27:39.867830+0000","last_peered":"2023-10-06T03:27:39.867830+0000","last_clean":"2023-10-06T03:27:39.867830+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:27:39.867830+0000","last_undegraded":"2023-10-06T03:27:39.867830+0000","last_fullsized":"2023-10-06T03:27:39.867830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.655639+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:27:38.655639+0000","last_peered":"2023-10-06T03:27:38.655639+0000","last_clean":"2023-10-06T03:27:38.655639+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:27:38.655639+0000","last_undegraded":"2023-10-06T03:27:38.655639+0000","last_fullsized":"2023-10-06T03:27:38.655639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":247,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.560421+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:27:38.560421+0000","last_peered":"2023-10-06T03:27:38.560421+0000","last_clean":"2023-10-06T03:27:38.560421+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:27:38.560421+0000","last_undegraded":"2023-10-06T03:27:38.560421+0000","last_fullsized":"2023-10-06T03:27:38.560421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":97,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.559859+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:27:38.559859+0000","last_peered":"2023-10-06T03:27:38.559859+0000","last_clean":"2023-10-06T03:27:38.559859+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:27:38.559859+0000","last_undegraded":"2023-10-06T03:27:38.559859+0000","last_fullsized":"2023-10-06T03:27:38.559859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.560473+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:27:38.560473+0000","last_peered":"2023-10-06T03:27:38.560473+0000","last_clean":"2023-10-06T03:27:38.560473+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:27:38.560473+0000","last_undegraded":"2023-10-06T03:27:38.560473+0000","last_fullsized":"2023-10-06T03:27:38.560473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.567181+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:27:38.567181+0000","last_peered":"2023-10-06T03:27:38.567181+0000","last_clean":"2023-10-06T03:27:38.567181+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:27:38.567181+0000","last_undegraded":"2023-10-06T03:27:38.567181+0000","last_fullsized":"2023-10-06T03:27:38.567181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.567515+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:27:38.567515+0000","last_peered":"2023-10-06T03:27:38.567515+0000","last_clean":"2023-10-06T03:27:38.567515+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:27:38.567515+0000","last_undegraded":"2023-10-06T03:27:38.567515+0000","last_fullsized":"2023-10-06T03:27:38.567515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":77,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.567406+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:27:38.567406+0000","last_peered":"2023-10-06T03:27:38.567406+0000","last_clean":"2023-10-06T03:27:38.567406+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:27:38.567406+0000","last_undegraded":"2023-10-06T03:27:38.567406+0000","last_fullsized":"2023-10-06T03:27:38.567406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":1209589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.38900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.68100000000000005,"15min":0.747},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68799999999999994,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82599999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0720000000000001,"5min":1.103,"15min":1.103},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78400000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.379}]},{"osd":6,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.441},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.501}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298556,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073284,"statfs":{"total":96636764160,"available":96331042816,"internally_reserved":0,"allocated":1298432,"data_stored":618709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77900000000000003,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71999999999999997,"5min":1.343,"15min":1.343},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.72699999999999998,"15min":0.80200000000000005},"min":{"1min":0.41899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84699999999999998,"5min":1.329,"15min":1.329},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.70299999999999996,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.745,"15min":0.82099999999999995},"min":{"1min":0.371,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.40899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.752,"15min":0.82399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.627}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.79600000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.752,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.624},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299160,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072680,"statfs":{"total":96636764160,"available":96330424320,"internally_reserved":0,"allocated":1916928,"data_stored":1216590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.376,"15min":0.39900000000000002},"min":{"1min":0.255,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48299999999999998,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41199999999999998,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60999999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.247}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32100000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.50700000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39200000000000002,"15min":0.41199999999999998},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.504,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.26100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.433,"15min":0.46700000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52600000000000002,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.307},{"interface":"front","average":{"1min":0.372,"5min":0.42599999999999999,"15min":0.45600000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58299999999999996,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.101,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64200000000000002,"15min":0.67000000000000004},"min":{"1min":0.42199999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.79000000000000004,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91600000000000004,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298584,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073256,"statfs":{"total":96636764160,"available":96331014144,"internally_reserved":0,"allocated":1327104,"data_stored":633710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.64000000000000001,"15min":0.78600000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39100000000000001,"5min":12.19,"15min":12.19},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.56799999999999995,"15min":0.66400000000000003},"min":{"1min":0.28000000000000003,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.432,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.246,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.40799999999999997,"5min":1.357,"15min":1.357},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34300000000000003,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.40400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.312}]},{"osd":3,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.77300000000000002,"15min":0.97099999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41299999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.42299999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.96099999999999997,"15min":1.137},"min":{"1min":0.44500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76700000000000002,"5min":16.919,"15min":16.919},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.42699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.96999999999999997,"15min":1.1499999999999999},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":16.948,"15min":16.948},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.98699999999999999,"15min":1.1619999999999999},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83799999999999997,"5min":16.881,"15min":16.881},"last":0.63700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298556,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073284,"statfs":{"total":96636764160,"available":96331042816,"internally_reserved":0,"allocated":1298432,"data_stored":618797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.32600000000000001,"15min":0.33600000000000002},"min":{"1min":0.21299999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.42999999999999999,"5min":0.62,"15min":0.62},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.37,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.34799999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33800000000000002,"15min":0.34300000000000003},"min":{"1min":0.25800000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.255},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39300000000000002},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53100000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.49099999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72999999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73399999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":634445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33300000000000002,"15min":0.34100000000000003},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.46300000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34300000000000003,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45000000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.20799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.435,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34699999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36499999999999999,"15min":0.374},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.49099999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.311},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.45400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.745,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.505},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72499999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59999999999999998,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73199999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.878,"15min":0.878},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79100000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.49199999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81100000000000005,"5min":0.997,"15min":0.997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073292,"statfs":{"total":96636764160,"available":96331051008,"internally_reserved":0,"allocated":1290240,"data_stored":618617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.67800000000000005,"15min":0.72999999999999998},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":4.758,"15min":4.758},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.67000000000000004,"15min":0.73399999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88700000000000001,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.79800000000000004,"15min":0.92300000000000004},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90600000000000003,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.82399999999999995,"15min":0.95299999999999996},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79600000000000004,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.873,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53400000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70399999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67600000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42799999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84599999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.439},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.41399999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.64500000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94799999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298568,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073272,"statfs":{"total":96636764160,"available":96331030528,"internally_reserved":0,"allocated":1310720,"data_stored":625924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65600000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.629,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.503,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.999,"15min":0.999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67800000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.746,"15min":0.746},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.43099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77300000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":1.04,"15min":1.04},"last":0.81299999999999994}]},{"osd":7,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.72099999999999997,"5min":1.284,"15min":1.284},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:27:48.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:27:48.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.502+0000 7f970d1ce700 1 Processor -- start 2023-10-06T03:27:48.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.502+0000 7f970d1ce700 1 -- start start 2023-10-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f970d1ce700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f97080cbc70 0x7f97080cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f970d1ce700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f97080b2140 0x7f97080b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f970d1ce700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97080cb7e0 con 0x7f9708159480 2023-10-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f970d1ce700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97080b08a0 con 0x7f97080cbc70 2023-10-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f970d1ce700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97080cb190 con 0x7f97080b2140 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f97077fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f97080cbc70 0x7f97080cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f97077fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f97080cbc70 0x7f97080cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44774/0 (socket says 172.21.15.84:44774) 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f97077fe700 1 -- 172.21.15.84:0/2478743304 learned_addr learned my addr 172.21.15.84:0/2478743304 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f97077fe700 1 -- 172.21.15.84:0/2478743304 >> v2:172.21.15.131:3300/0 conn(0x7f97080b2140 msgr2=0x7f97080b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f970c9cd700 1 --2- 172.21.15.84:0/2478743304 >> v2:172.21.15.131:3300/0 conn(0x7f97080b2140 0x7f97080b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f97077fe700 1 --2- 172.21.15.84:0/2478743304 >> v2:172.21.15.131:3300/0 conn(0x7f97080b2140 0x7f97080b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f97077fe700 1 -- 172.21.15.84:0/2478743304 >> v1:172.21.15.131:6789/0 conn(0x7f9708159480 legacy=0x7f97080b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.503+0000 7f97077fe700 1 -- 172.21.15.84:0/2478743304 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97080cb470 con 0x7f97080cbc70 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f97077fe700 1 --2- 172.21.15.84:0/2478743304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 0x7f97080cc0c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f97080ca830 tx=0x7f96fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec1a1a0f9af8355 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f9706ffd700 1 -- 172.21.15.84:0/2478743304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc00b820 con 0x7f97080cbc70 2023-10-06T03:27:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f9706ffd700 1 -- 172.21.15.84:0/2478743304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc00b980 con 0x7f97080cbc70 2023-10-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f9706ffd700 1 -- 172.21.15.84:0/2478743304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc00bd20 con 0x7f97080cbc70 2023-10-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f970d1ce700 1 -- 172.21.15.84:0/2478743304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 msgr2=0x7f97080cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f970d1ce700 1 --2- 172.21.15.84:0/2478743304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 0x7f97080cc0c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f97080ca830 tx=0x7f96fc009250 comp rx=0 tx=0).stop 2023-10-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f970d1ce700 1 -- 172.21.15.84:0/2478743304 shutdown_connections 2023-10-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f970d1ce700 1 --2- 172.21.15.84:0/2478743304 >> v2:172.21.15.131:3300/0 conn(0x7f97080b2140 0x7f97080b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f970d1ce700 1 --2- 172.21.15.84:0/2478743304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 0x7f97080cc0c0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f970d1ce700 1 -- 172.21.15.84:0/2478743304 >> 172.21.15.84:0/2478743304 conn(0x7f970806ed20 msgr2=0x7f970806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f970d1ce700 1 -- 172.21.15.84:0/2478743304 shutdown_connections 2023-10-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.504+0000 7f970d1ce700 1 -- 172.21.15.84:0/2478743304 wait complete. 2023-10-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.505+0000 7f970d1ce700 1 Processor -- start 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.506+0000 7f970d1ce700 1 -- start start 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.506+0000 7f970d1ce700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97080b2140 0x7f97080cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.506+0000 7f970d1ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 0x7f970816c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.506+0000 7f970d1ce700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9708159480 0x7f970816cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f970d1ce700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97080cde30 con 0x7f97080cbc70 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f970d1ce700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97080ce080 con 0x7f97080b2140 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f970d1ce700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97080ce360 con 0x7f9708159480 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f97077fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 0x7f970816c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f97077fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 0x7f970816c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44788/0 (socket says 172.21.15.84:44788) 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f97077fe700 1 -- 172.21.15.84:0/1220767022 learned_addr learned my addr 172.21.15.84:0/1220767022 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f970c9cd700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9708159480 0x7f970816cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f9707fff700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97080b2140 0x7f97080cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f97077fe700 1 -- 172.21.15.84:0/1220767022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9708159480 msgr2=0x7f970816cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f97077fe700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9708159480 0x7f970816cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f97077fe700 1 -- 172.21.15.84:0/1220767022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97080b2140 msgr2=0x7f97080cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f97077fe700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97080b2140 0x7f97080cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f97077fe700 1 -- 172.21.15.84:0/1220767022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc0094f0 con 0x7f97080cbc70 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f9707fff700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97080b2140 0x7f97080cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f97077fe700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 0x7f970816c8b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0030c0 tx=0x7f96fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f96effff700 1 -- 172.21.15.84:0/1220767022 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc011e60 con 0x7f97080cbc70 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f96effff700 1 -- 172.21.15.84:0/1220767022 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc020070 con 0x7f97080cbc70 2023-10-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f96effff700 1 -- 172.21.15.84:0/1220767022 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc01b6a0 con 0x7f97080cbc70 2023-10-06T03:27:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f970d1ce700 1 -- 172.21.15.84:0/1220767022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97080ce640 con 0x7f97080cbc70 2023-10-06T03:27:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.507+0000 7f970d1ce700 1 -- 172.21.15.84:0/1220767022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97080cec00 con 0x7f97080cbc70 2023-10-06T03:27:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.508+0000 7f970d1ce700 1 -- 172.21.15.84:0/1220767022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97080cedf0 con 0x7f97080cbc70 2023-10-06T03:27:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.509+0000 7f96effff700 1 -- 172.21.15.84:0/1220767022 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96fc022030 con 0x7f97080cbc70 2023-10-06T03:27:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.509+0000 7f96effff700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96f4066f30 0x7f96f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.509+0000 7f96effff700 1 -- 172.21.15.84:0/1220767022 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f96fc0865a0 con 0x7f97080cbc70 2023-10-06T03:27:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.509+0000 7f9707fff700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96f4066f30 0x7f96f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.509+0000 7f9707fff700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96f4066f30 0x7f96f40693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f96f8006fd0 tx=0x7f96f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:48.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.513+0000 7f96effff700 1 -- 172.21.15.84:0/1220767022 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96fc053770 con 0x7f97080cbc70 2023-10-06T03:27:48.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.691+0000 7f970d1ce700 1 -- 172.21.15.84:0/1220767022 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97080cedf0 con 0x7f96f4066f30 2023-10-06T03:27:48.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.694+0000 7f96effff700 1 -- 172.21.15.84:0/1220767022 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73379 (secure 0 0 0) 0x7f97080cedf0 con 0x7f96f4066f30 2023-10-06T03:27:48.697 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:48.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 -- 172.21.15.84:0/1220767022 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96f4066f30 msgr2=0x7f96f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96f4066f30 0x7f96f40693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f96f8006fd0 tx=0x7f96f8008040 comp rx=0 tx=0).stop 2023-10-06T03:27:48.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 -- 172.21.15.84:0/1220767022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 msgr2=0x7f970816c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 0x7f970816c8b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0030c0 tx=0x7f96fc016000 comp rx=0 tx=0).stop 2023-10-06T03:27:48.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 -- 172.21.15.84:0/1220767022 shutdown_connections 2023-10-06T03:27:48.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f96f4066f30 0x7f96f40693e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97080b2140 0x7f97080cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9708159480 0x7f970816cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 --2- 172.21.15.84:0/1220767022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97080cbc70 0x7f970816c8b0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 -- 172.21.15.84:0/1220767022 >> 172.21.15.84:0/1220767022 conn(0x7f970806ed20 msgr2=0x7f970815bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:48.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 -- 172.21.15.84:0/1220767022 shutdown_connections 2023-10-06T03:27:48.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.696+0000 7f970d1ce700 1 -- 172.21.15.84:0/1220767022 wait complete. 2023-10-06T03:27:48.699 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:27:48.710 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-10-06T03:27:47.089160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389684,"kb_used_data":11380,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752585036,"statfs":{"total":773094113280,"available":770647076864,"internally_reserved":0,"allocated":11653120,"data_stored":6176381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19530,"num_objects":-41,"num_object_clones":0,"num_object_copies":-82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41,"num_whiteouts":0,"num_read":-62,"num_read_kb":-56,"num_write":-140,"num_write_kb":-66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000920"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.560114+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:27:38.560114+0000","last_peered":"2023-10-06T03:27:38.560114+0000","last_clean":"2023-10-06T03:27:38.560114+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:27:38.560114+0000","last_undegraded":"2023-10-06T03:27:38.560114+0000","last_fullsized":"2023-10-06T03:27:38.560114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:27:39.867830+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:27:39.867830+0000","last_peered":"2023-10-06T03:27:39.867830+0000","last_clean":"2023-10-06T03:27:39.867830+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:27:39.867830+0000","last_undegraded":"2023-10-06T03:27:39.867830+0000","last_fullsized":"2023-10-06T03:27:39.867830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.655639+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:27:38.655639+0000","last_peered":"2023-10-06T03:27:38.655639+0000","last_clean":"2023-10-06T03:27:38.655639+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:27:38.655639+0000","last_undegraded":"2023-10-06T03:27:38.655639+0000","last_fullsized":"2023-10-06T03:27:38.655639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":247,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.560421+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:27:38.560421+0000","last_peered":"2023-10-06T03:27:38.560421+0000","last_clean":"2023-10-06T03:27:38.560421+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:27:38.560421+0000","last_undegraded":"2023-10-06T03:27:38.560421+0000","last_fullsized":"2023-10-06T03:27:38.560421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":97,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.559859+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:27:38.559859+0000","last_peered":"2023-10-06T03:27:38.559859+0000","last_clean":"2023-10-06T03:27:38.559859+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:27:38.559859+0000","last_undegraded":"2023-10-06T03:27:38.559859+0000","last_fullsized":"2023-10-06T03:27:38.559859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.560473+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:27:38.560473+0000","last_peered":"2023-10-06T03:27:38.560473+0000","last_clean":"2023-10-06T03:27:38.560473+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:27:38.560473+0000","last_undegraded":"2023-10-06T03:27:38.560473+0000","last_fullsized":"2023-10-06T03:27:38.560473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.567181+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:27:38.567181+0000","last_peered":"2023-10-06T03:27:38.567181+0000","last_clean":"2023-10-06T03:27:38.567181+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:27:38.567181+0000","last_undegraded":"2023-10-06T03:27:38.567181+0000","last_fullsized":"2023-10-06T03:27:38.567181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.567515+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:27:38.567515+0000","last_peered":"2023-10-06T03:27:38.567515+0000","last_clean":"2023-10-06T03:27:38.567515+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:27:38.567515+0000","last_undegraded":"2023-10-06T03:27:38.567515+0000","last_fullsized":"2023-10-06T03:27:38.567515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":77,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.567406+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:27:38.567406+0000","last_peered":"2023-10-06T03:27:38.567406+0000","last_clean":"2023-10-06T03:27:38.567406+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:27:38.567406+0000","last_undegraded":"2023-10-06T03:27:38.567406+0000","last_fullsized":"2023-10-06T03:27:38.567406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":1209589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.38900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.68100000000000005,"15min":0.747},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68799999999999994,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82599999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0720000000000001,"5min":1.103,"15min":1.103},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78400000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.379}]},{"osd":6,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.441},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.501}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298556,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073284,"statfs":{"total":96636764160,"available":96331042816,"internally_reserved":0,"allocated":1298432,"data_stored":618709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77900000000000003,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71999999999999997,"5min":1.343,"15min":1.343},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.72699999999999998,"15min":0.80200000000000005},"min":{"1min":0.41899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84699999999999998,"5min":1.329,"15min":1.329},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.70299999999999996,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.745,"15min":0.82099999999999995},"min":{"1min":0.371,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.40899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.752,"15min":0.82399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.627}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.79600000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.752,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.624},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299160,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072680,"statfs":{"total":96636764160,"available":96330424320,"internally_reserved":0,"allocated":1916928,"data_stored":1216590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.376,"15min":0.39900000000000002},"min":{"1min":0.255,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48299999999999998,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41199999999999998,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60999999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.247}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32100000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.50700000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39200000000000002,"15min":0.41199999999999998},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.504,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.26100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.433,"15min":0.46700000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52600000000000002,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.307},{"interface":"front","average":{"1min":0.372,"5min":0.42599999999999999,"15min":0.45600000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58299999999999996,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.101,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64200000000000002,"15min":0.67000000000000004},"min":{"1min":0.42199999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.79000000000000004,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91600000000000004,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298584,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073256,"statfs":{"total":96636764160,"available":96331014144,"internally_reserved":0,"allocated":1327104,"data_stored":633710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.64000000000000001,"15min":0.78600000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39100000000000001,"5min":12.19,"15min":12.19},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.56799999999999995,"15min":0.66400000000000003},"min":{"1min":0.28000000000000003,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.432,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.246,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.40799999999999997,"5min":1.357,"15min":1.357},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34300000000000003,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.40400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.312}]},{"osd":3,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.77300000000000002,"15min":0.97099999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41299999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.42299999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.96099999999999997,"15min":1.137},"min":{"1min":0.44500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76700000000000002,"5min":16.919,"15min":16.919},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.42699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.96999999999999997,"15min":1.1499999999999999},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":16.948,"15min":16.948},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.98699999999999999,"15min":1.1619999999999999},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83799999999999997,"5min":16.881,"15min":16.881},"last":0.63700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298556,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073284,"statfs":{"total":96636764160,"available":96331042816,"internally_reserved":0,"allocated":1298432,"data_stored":618797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.32600000000000001,"15min":0.33600000000000002},"min":{"1min":0.21299999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.42999999999999999,"5min":0.62,"15min":0.62},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.37,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.34799999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33800000000000002,"15min":0.34300000000000003},"min":{"1min":0.25800000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.255},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39300000000000002},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53100000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.49099999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72999999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73399999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":634445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33300000000000002,"15min":0.34100000000000003},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.46300000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34300000000000003,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45000000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.20799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.435,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34699999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36499999999999999,"15min":0.374},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.49099999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.311},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.45400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.745,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.505},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72499999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59999999999999998,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73199999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.878,"15min":0.878},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79100000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.49199999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81100000000000005,"5min":0.997,"15min":0.997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073292,"statfs":{"total":96636764160,"available":96331051008,"internally_reserved":0,"allocated":1290240,"data_stored":618617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.67800000000000005,"15min":0.72999999999999998},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":4.758,"15min":4.758},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.67000000000000004,"15min":0.73399999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88700000000000001,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.79800000000000004,"15min":0.92300000000000004},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90600000000000003,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.82399999999999995,"15min":0.95299999999999996},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79600000000000004,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.873,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53400000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70399999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67600000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42799999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84599999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.439},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.41399999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.64500000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94799999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298568,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073272,"statfs":{"total":96636764160,"available":96331030528,"internally_reserved":0,"allocated":1310720,"data_stored":625924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65600000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.629,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.503,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.999,"15min":0.999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67800000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.746,"15min":0.746},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.43099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77300000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":1.04,"15min":1.04},"last":0.81299999999999994}]},{"osd":7,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.72099999999999997,"5min":1.284,"15min":1.284},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:27:48.712 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:27:48.712 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:27:48.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.824+0000 7fa3cdfc5700 1 Processor -- start 2023-10-06T03:27:48.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.824+0000 7fa3cdfc5700 1 -- start start 2023-10-06T03:27:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cdfc5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa3c8159480 0x7fa3c80b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cdfc5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3c80b3610 0x7fa3c80cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cdfc5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3c80cc1b0 0x7fa3c80b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cdfc5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c80cb7e0 con 0x7fa3c80cc1b0 2023-10-06T03:27:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cdfc5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c80b08a0 con 0x7fa3c8159480 2023-10-06T03:27:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cdfc5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c80cb190 con 0x7fa3c80b3610 2023-10-06T03:27:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cd7c4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3c80cc1b0 0x7fa3c80b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cd7c4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3c80cc1b0 0x7fa3c80b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44792/0 (socket says 172.21.15.84:44792) 2023-10-06T03:27:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cd7c4700 1 -- 172.21.15.84:0/2003169091 learned_addr learned my addr 172.21.15.84:0/2003169091 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3c7fff700 1 --2- 172.21.15.84:0/2003169091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3c80b3610 0x7fa3c80cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3ccfc3700 1 --2- 172.21.15.84:0/2003169091 >> v2:172.21.15.131:3300/0 conn(0x7fa3c8159480 0x7fa3c80b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cd7c4700 1 -- 172.21.15.84:0/2003169091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3c80b3610 msgr2=0x7fa3c80cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cd7c4700 1 --2- 172.21.15.84:0/2003169091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3c80b3610 0x7fa3c80cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cd7c4700 1 -- 172.21.15.84:0/2003169091 >> v2:172.21.15.131:3300/0 conn(0x7fa3c8159480 msgr2=0x7fa3c80b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cd7c4700 1 --2- 172.21.15.84:0/2003169091 >> v2:172.21.15.131:3300/0 conn(0x7fa3c8159480 0x7fa3c80b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cd7c4700 1 -- 172.21.15.84:0/2003169091 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c80cb470 con 0x7fa3c80cc1b0 2023-10-06T03:27:48.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3ccfc3700 1 --2- 172.21.15.84:0/2003169091 >> v2:172.21.15.131:3300/0 conn(0x7fa3c8159480 0x7fa3c80b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:48.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.825+0000 7fa3cd7c4700 1 --2- 172.21.15.84:0/2003169091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80cc1b0 0x7fa3c80b2140 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fa3c806fa30 tx=0x7fa3b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3488df61b9e07184 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:48.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3c77fe700 1 -- 172.21.15.84:0/2003169091 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800b860 con 0x7fa3c80cc1b0 2023-10-06T03:27:48.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3c77fe700 1 -- 172.21.15.84:0/2003169091 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b800b9c0 con 0x7fa3c80cc1b0 2023-10-06T03:27:48.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3c77fe700 1 -- 172.21.15.84:0/2003169091 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800bd60 con 0x7fa3c80cc1b0 2023-10-06T03:27:48.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/2003169091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80cc1b0 msgr2=0x7fa3c80b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3cdfc5700 1 --2- 172.21.15.84:0/2003169091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80cc1b0 0x7fa3c80b2140 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fa3c806fa30 tx=0x7fa3b8009250 comp rx=0 tx=0).stop 2023-10-06T03:27:48.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/2003169091 shutdown_connections 2023-10-06T03:27:48.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3cdfc5700 1 --2- 172.21.15.84:0/2003169091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80cc1b0 0x7fa3c80b2140 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3cdfc5700 1 --2- 172.21.15.84:0/2003169091 >> v2:172.21.15.131:3300/0 conn(0x7fa3c8159480 0x7fa3c80b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3cdfc5700 1 --2- 172.21.15.84:0/2003169091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3c80b3610 0x7fa3c80cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/2003169091 >> 172.21.15.84:0/2003169091 conn(0x7fa3c806ed20 msgr2=0x7fa3c806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:48.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/2003169091 shutdown_connections 2023-10-06T03:27:48.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.826+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/2003169091 wait complete. 2023-10-06T03:27:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.827+0000 7fa3cdfc5700 1 Processor -- start 2023-10-06T03:27:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.828+0000 7fa3cdfc5700 1 -- start start 2023-10-06T03:27:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.828+0000 7fa3cdfc5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80b3610 0x7fa3c8168760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.828+0000 7fa3cdfc5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3c80cc1b0 0x7fa3c80cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.828+0000 7fa3cdfc5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c8159480 0x7fa3c80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.828+0000 7fa3cdfc5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c816cee0 con 0x7fa3c80b3610 2023-10-06T03:27:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.828+0000 7fa3cdfc5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c816d370 con 0x7fa3c8159480 2023-10-06T03:27:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.828+0000 7fa3cdfc5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c8169d90 con 0x7fa3c80cc1b0 2023-10-06T03:27:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3ccfc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80b3610 0x7fa3c8168760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3ccfc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80b3610 0x7fa3c8168760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44800/0 (socket says 172.21.15.84:44800) 2023-10-06T03:27:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3ccfc3700 1 -- 172.21.15.84:0/178701778 learned_addr learned my addr 172.21.15.84:0/178701778 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3c7fff700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3c80cc1b0 0x7fa3c80cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3ccfc3700 1 -- 172.21.15.84:0/178701778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3c80cc1b0 msgr2=0x7fa3c80cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3ccfc3700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3c80cc1b0 0x7fa3c80cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3cd7c4700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c8159480 0x7fa3c80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3ccfc3700 1 -- 172.21.15.84:0/178701778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c8159480 msgr2=0x7fa3c80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3ccfc3700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c8159480 0x7fa3c80d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3ccfc3700 1 -- 172.21.15.84:0/178701778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b80094f0 con 0x7fa3c80b3610 2023-10-06T03:27:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3ccfc3700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80b3610 0x7fa3c8168760 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000cfb0 tx=0x7fa3c0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3c4ff9700 1 -- 172.21.15.84:0/178701778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0016420 con 0x7fa3c80b3610 2023-10-06T03:27:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3c4ff9700 1 -- 172.21.15.84:0/178701778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c0016580 con 0x7fa3c80b3610 2023-10-06T03:27:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3c4ff9700 1 -- 172.21.15.84:0/178701778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0016940 con 0x7fa3c80b3610 2023-10-06T03:27:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/178701778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c816c5b0 con 0x7fa3c80b3610 2023-10-06T03:27:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.829+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/178701778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c816cb70 con 0x7fa3c80b3610 2023-10-06T03:27:48.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.830+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/178701778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c816d1c0 con 0x7fa3c80b3610 2023-10-06T03:27:48.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.831+0000 7fa3c4ff9700 1 -- 172.21.15.84:0/178701778 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3c0016d30 con 0x7fa3c80b3610 2023-10-06T03:27:48.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.831+0000 7fa3c4ff9700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa3b4066f30 0x7fa3b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:48.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.831+0000 7fa3c4ff9700 1 -- 172.21.15.84:0/178701778 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fa3c0012070 con 0x7fa3c80b3610 2023-10-06T03:27:48.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.831+0000 7fa3c7fff700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa3b4066f30 0x7fa3b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:48.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.831+0000 7fa3c7fff700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa3b4066f30 0x7fa3b40693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80b6240 tx=0x7fa3bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:48.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:48.835+0000 7fa3c4ff9700 1 -- 172.21.15.84:0/178701778 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3c004e5a0 con 0x7fa3c80b3610 2023-10-06T03:27:49.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.015+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/178701778 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3c816d020 con 0x7fa3b4066f30 2023-10-06T03:27:49.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.018+0000 7fa3c4ff9700 1 -- 172.21.15.84:0/178701778 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73379 (secure 0 0 0) 0x7fa3bc009710 con 0x7fa3b4066f30 2023-10-06T03:27:49.086 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:49.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.020+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/178701778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa3b4066f30 msgr2=0x7fa3b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:49.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.020+0000 7fa3cdfc5700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa3b4066f30 0x7fa3b40693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80b6240 tx=0x7fa3bc008040 comp rx=0 tx=0).stop 2023-10-06T03:27:49.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.020+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/178701778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80b3610 msgr2=0x7fa3c8168760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:49.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.020+0000 7fa3cdfc5700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80b3610 0x7fa3c8168760 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000cfb0 tx=0x7fa3c0007870 comp rx=0 tx=0).stop 2023-10-06T03:27:49.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.020+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/178701778 shutdown_connections 2023-10-06T03:27:49.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.020+0000 7fa3cdfc5700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fa3b4066f30 0x7fa3b40693e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.020+0000 7fa3cdfc5700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c8159480 0x7fa3c80d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.020+0000 7fa3cdfc5700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80b3610 0x7fa3c8168760 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.020+0000 7fa3cdfc5700 1 --2- 172.21.15.84:0/178701778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3c80cc1b0 0x7fa3c80cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.020+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/178701778 >> 172.21.15.84:0/178701778 conn(0x7fa3c806ed20 msgr2=0x7fa3c8155010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:49.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.021+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/178701778 shutdown_connections 2023-10-06T03:27:49.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.021+0000 7fa3cdfc5700 1 -- 172.21.15.84:0/178701778 wait complete. 2023-10-06T03:27:49.089 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:27:49.089 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-10-06T03:27:47.089160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389684,"kb_used_data":11380,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752585036,"statfs":{"total":773094113280,"available":770647076864,"internally_reserved":0,"allocated":11653120,"data_stored":6176381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19530,"num_objects":-41,"num_object_clones":0,"num_object_copies":-82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41,"num_whiteouts":0,"num_read":-62,"num_read_kb":-56,"num_write":-140,"num_write_kb":-66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000920"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.560114+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:27:38.560114+0000","last_peered":"2023-10-06T03:27:38.560114+0000","last_clean":"2023-10-06T03:27:38.560114+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:27:38.560114+0000","last_undegraded":"2023-10-06T03:27:38.560114+0000","last_fullsized":"2023-10-06T03:27:38.560114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:27:39.867830+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:27:39.867830+0000","last_peered":"2023-10-06T03:27:39.867830+0000","last_clean":"2023-10-06T03:27:39.867830+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:27:39.867830+0000","last_undegraded":"2023-10-06T03:27:39.867830+0000","last_fullsized":"2023-10-06T03:27:39.867830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.655639+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:27:38.655639+0000","last_peered":"2023-10-06T03:27:38.655639+0000","last_clean":"2023-10-06T03:27:38.655639+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:27:38.655639+0000","last_undegraded":"2023-10-06T03:27:38.655639+0000","last_fullsized":"2023-10-06T03:27:38.655639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":247,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.560421+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:27:38.560421+0000","last_peered":"2023-10-06T03:27:38.560421+0000","last_clean":"2023-10-06T03:27:38.560421+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:27:38.560421+0000","last_undegraded":"2023-10-06T03:27:38.560421+0000","last_fullsized":"2023-10-06T03:27:38.560421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":97,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.559859+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:27:38.559859+0000","last_peered":"2023-10-06T03:27:38.559859+0000","last_clean":"2023-10-06T03:27:38.559859+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:27:38.559859+0000","last_undegraded":"2023-10-06T03:27:38.559859+0000","last_fullsized":"2023-10-06T03:27:38.559859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.560473+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:27:38.560473+0000","last_peered":"2023-10-06T03:27:38.560473+0000","last_clean":"2023-10-06T03:27:38.560473+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:27:38.560473+0000","last_undegraded":"2023-10-06T03:27:38.560473+0000","last_fullsized":"2023-10-06T03:27:38.560473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.567181+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:27:38.567181+0000","last_peered":"2023-10-06T03:27:38.567181+0000","last_clean":"2023-10-06T03:27:38.567181+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:27:38.567181+0000","last_undegraded":"2023-10-06T03:27:38.567181+0000","last_fullsized":"2023-10-06T03:27:38.567181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.567515+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:27:38.567515+0000","last_peered":"2023-10-06T03:27:38.567515+0000","last_clean":"2023-10-06T03:27:38.567515+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:27:38.567515+0000","last_undegraded":"2023-10-06T03:27:38.567515+0000","last_fullsized":"2023-10-06T03:27:38.567515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":77,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T03:27:38.567406+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:27:38.567406+0000","last_peered":"2023-10-06T03:27:38.567406+0000","last_clean":"2023-10-06T03:27:38.567406+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:27:38.567406+0000","last_undegraded":"2023-10-06T03:27:38.567406+0000","last_fullsized":"2023-10-06T03:27:38.567406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":1209589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.38900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.68100000000000005,"15min":0.747},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68799999999999994,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82599999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0720000000000001,"5min":1.103,"15min":1.103},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78400000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.379}]},{"osd":6,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.441},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.501}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298556,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073284,"statfs":{"total":96636764160,"available":96331042816,"internally_reserved":0,"allocated":1298432,"data_stored":618709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77900000000000003,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71999999999999997,"5min":1.343,"15min":1.343},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.72699999999999998,"15min":0.80200000000000005},"min":{"1min":0.41899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84699999999999998,"5min":1.329,"15min":1.329},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.70299999999999996,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.745,"15min":0.82099999999999995},"min":{"1min":0.371,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.40899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.752,"15min":0.82399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.627}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.79600000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.752,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.624},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299160,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072680,"statfs":{"total":96636764160,"available":96330424320,"internally_reserved":0,"allocated":1916928,"data_stored":1216590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.376,"15min":0.39900000000000002},"min":{"1min":0.255,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48299999999999998,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41199999999999998,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60999999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.247}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32100000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.50700000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39200000000000002,"15min":0.41199999999999998},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.504,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.26100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.433,"15min":0.46700000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52600000000000002,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.307},{"interface":"front","average":{"1min":0.372,"5min":0.42599999999999999,"15min":0.45600000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58299999999999996,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.101,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64200000000000002,"15min":0.67000000000000004},"min":{"1min":0.42199999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.79000000000000004,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91600000000000004,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298584,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073256,"statfs":{"total":96636764160,"available":96331014144,"internally_reserved":0,"allocated":1327104,"data_stored":633710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.64000000000000001,"15min":0.78600000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39100000000000001,"5min":12.19,"15min":12.19},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.56799999999999995,"15min":0.66400000000000003},"min":{"1min":0.28000000000000003,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.432,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.246,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.40799999999999997,"5min":1.357,"15min":1.357},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34300000000000003,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.40400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.312}]},{"osd":3,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.77300000000000002,"15min":0.97099999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41299999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.42299999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.96099999999999997,"15min":1.137},"min":{"1min":0.44500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76700000000000002,"5min":16.919,"15min":16.919},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.42699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.96999999999999997,"15min":1.1499999999999999},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":16.948,"15min":16.948},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.98699999999999999,"15min":1.1619999999999999},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83799999999999997,"5min":16.881,"15min":16.881},"last":0.63700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298556,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073284,"statfs":{"total":96636764160,"available":96331042816,"internally_reserved":0,"allocated":1298432,"data_stored":618797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.32600000000000001,"15min":0.33600000000000002},"min":{"1min":0.21299999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.42999999999999999,"5min":0.62,"15min":0.62},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.37,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.34799999999999998},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33800000000000002,"15min":0.34300000000000003},"min":{"1min":0.25800000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.255},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39300000000000002},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53100000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.49099999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72999999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73399999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":634445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33300000000000002,"15min":0.34100000000000003},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.46300000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34300000000000003,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45000000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.20799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.435,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34699999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36499999999999999,"15min":0.374},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.49099999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.311},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.45400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.745,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.505},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72499999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59999999999999998,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73199999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.878,"15min":0.878},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79100000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.49199999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81100000000000005,"5min":0.997,"15min":0.997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073292,"statfs":{"total":96636764160,"available":96331051008,"internally_reserved":0,"allocated":1290240,"data_stored":618617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.67800000000000005,"15min":0.72999999999999998},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":4.758,"15min":4.758},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.67000000000000004,"15min":0.73399999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88700000000000001,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.79800000000000004,"15min":0.92300000000000004},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90600000000000003,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.82399999999999995,"15min":0.95299999999999996},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79600000000000004,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.873,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53400000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70399999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67600000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42799999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84599999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.439},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.41399999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.64500000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94799999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298568,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073272,"statfs":{"total":96636764160,"available":96331030528,"internally_reserved":0,"allocated":1310720,"data_stored":625924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65600000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.629,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.503,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.999,"15min":0.999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67800000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.746,"15min":0.746},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.43099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77300000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":1.04,"15min":1.04},"last":0.81299999999999994}]},{"osd":7,"last update":"Fri Oct 6 03:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.72099999999999997,"5min":1.284,"15min":1.284},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:27:49.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:27:49.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.305+0000 7f3aaffff700 1 Processor -- start 2023-10-06T03:27:49.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.305+0000 7f3aaffff700 1 -- start start 2023-10-06T03:27:49.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.306+0000 7f3aaffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ab00b2850 0x7f3ab00cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:49.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.306+0000 7f3aaffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab00cb7e0 con 0x7f3ab0159480 2023-10-06T03:27:49.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.306+0000 7f3aaffff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab00b08a0 con 0x7f3ab00cbc70 2023-10-06T03:27:49.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.306+0000 7f3aaffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00cb190 con 0x7f3ab00b2850 2023-10-06T03:27:49.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.306+0000 7f3aaeffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3ab0159480 0x7f3ab00b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54556/0 (socket says 172.21.15.84:54556) 2023-10-06T03:27:49.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.306+0000 7f3aaeffd700 1 -- 172.21.15.84:0/3689717344 learned_addr learned my addr 172.21.15.84:0/3689717344 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:49.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.306+0000 7f3aaf7fe700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ab00b2850 0x7f3ab00cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:49.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.306+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905514677 0 0) 0x7f3ab00cb7e0 con 0x7f3ab0159480 2023-10-06T03:27:49.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.306+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a9c003570 con 0x7f3ab0159480 2023-10-06T03:27:49.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4139601835 0 0) 0x7f3a9c003570 con 0x7f3ab0159480 2023-10-06T03:27:49.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ab00b2850 msgr2=0x7f3ab00cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:49.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ab00b2850 0x7f3ab00cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 >> v1:172.21.15.131:6789/0 conn(0x7f3ab00cbc70 legacy=0x7f3ab00b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:49.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00cb470 con 0x7f3ab0159480 2023-10-06T03:27:49.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f3aa00017f0 con 0x7f3ab0159480 2023-10-06T03:27:49.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 >> v1:172.21.15.84:6789/0 conn(0x7f3ab0159480 legacy=0x7f3ab00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:49.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a9c003a90 0x7f3a9c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a9c004810 0x7f3a9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ab00b2850 0x7f3a9c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00cb190 con 0x7f3a9c003a90 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c00bb60 con 0x7f3a9c004810 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c00bd20 con 0x7f3ab00b2850 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aaeffd700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a9c003a90 0x7f3a9c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aa67fc700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a9c004810 0x7f3a9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aaf7fe700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ab00b2850 0x7f3a9c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aaeffd700 1 -- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ab00b2850 msgr2=0x7f3a9c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aaeffd700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ab00b2850 0x7f3a9c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aaeffd700 1 -- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a9c004810 msgr2=0x7f3a9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aaeffd700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a9c004810 0x7f3a9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aaeffd700 1 -- 172.21.15.84:0/3689717344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c003570 con 0x7f3a9c003a90 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aaeffd700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a9c003a90 0x7f3a9c003ea0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000a930 tx=0x7f3aa00021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8233bd379cca69a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa00070d0 con 0x7f3a9c003a90 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0007270 con 0x7f3a9c003a90 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.307+0000 7f3aae7fc700 1 -- 172.21.15.84:0/3689717344 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0007630 con 0x7f3a9c003a90 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.308+0000 7f3aaffff700 1 -- 172.21.15.84:0/3689717344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a9c003a90 msgr2=0x7f3a9c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.308+0000 7f3aaffff700 1 --2- 172.21.15.84:0/3689717344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a9c003a90 0x7f3a9c003ea0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000a930 tx=0x7f3aa00021d0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.308+0000 7f3aaf7fe700 1 -- 172.21.15.84:0/3689717344 reap_dead start 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.308+0000 7f3aaffff700 1 -- 172.21.15.84:0/3689717344 shutdown_connections 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.308+0000 7f3aaffff700 1 -- 172.21.15.84:0/3689717344 >> 172.21.15.84:0/3689717344 conn(0x7f3ab006ed20 msgr2=0x7f3ab006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.308+0000 7f3aaffff700 1 -- 172.21.15.84:0/3689717344 shutdown_connections 2023-10-06T03:27:49.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.308+0000 7f3aaffff700 1 -- 172.21.15.84:0/3689717344 wait complete. 2023-10-06T03:27:49.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.309+0000 7f3aaffff700 1 Processor -- start 2023-10-06T03:27:49.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.309+0000 7f3aaffff700 1 -- start start 2023-10-06T03:27:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a9c003a90 0x7f3ab00ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ab00c84e0 0x7f3ab0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ab015a030 0x7f3ab0153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00cfe10 con 0x7f3ab015a030 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00cf4e0 con 0x7f3ab00c84e0 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00cf7c0 con 0x7f3a9c003a90 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ab015a030 0x7f3ab0153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ab015a030 0x7f3ab0153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44818/0 (socket says 172.21.15.84:44818) 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaf7fe700 1 -- 172.21.15.84:0/2583718957 learned_addr learned my addr 172.21.15.84:0/2583718957 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaeffd700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a9c003a90 0x7f3ab00ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aa67fc700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ab00c84e0 0x7f3ab0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaf7fe700 1 -- 172.21.15.84:0/2583718957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a9c003a90 msgr2=0x7f3ab00ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaf7fe700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a9c003a90 0x7f3ab00ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaf7fe700 1 -- 172.21.15.84:0/2583718957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ab00c84e0 msgr2=0x7f3ab0159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaf7fe700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ab00c84e0 0x7f3ab0159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaf7fe700 1 -- 172.21.15.84:0/2583718957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00cfaa0 con 0x7f3ab015a030 2023-10-06T03:27:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aa67fc700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ab00c84e0 0x7f3ab0159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.310+0000 7f3aaf7fe700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ab015a030 0x7f3ab0153f00 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00c3ad0 tx=0x7f3aa8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.311+0000 7f3aa77fe700 1 -- 172.21.15.84:0/2583718957 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8015670 con 0x7f3ab015a030 2023-10-06T03:27:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.311+0000 7f3aa77fe700 1 -- 172.21.15.84:0/2583718957 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa80157d0 con 0x7f3ab015a030 2023-10-06T03:27:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.311+0000 7f3aaffff700 1 -- 172.21.15.84:0/2583718957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab00c8950 con 0x7f3ab015a030 2023-10-06T03:27:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.311+0000 7f3aa77fe700 1 -- 172.21.15.84:0/2583718957 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8015bd0 con 0x7f3ab015a030 2023-10-06T03:27:49.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.311+0000 7f3aaffff700 1 -- 172.21.15.84:0/2583718957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab0154680 con 0x7f3ab015a030 2023-10-06T03:27:49.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.312+0000 7f3aaffff700 1 -- 172.21.15.84:0/2583718957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab005f270 con 0x7f3ab015a030 2023-10-06T03:27:49.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.312+0000 7f3aa77fe700 1 -- 172.21.15.84:0/2583718957 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3aa801e400 con 0x7f3ab015a030 2023-10-06T03:27:49.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.312+0000 7f3aa77fe700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3a90066f30 0x7f3a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:49.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.313+0000 7f3aa77fe700 1 -- 172.21.15.84:0/2583718957 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f3aa8084a50 con 0x7f3ab015a030 2023-10-06T03:27:49.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.313+0000 7f3aaeffd700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3a90066f30 0x7f3a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:49.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.313+0000 7f3aaeffd700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3a90066f30 0x7f3a900693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000a930 tx=0x7f3aa0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:49.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.317+0000 7f3aa77fe700 1 -- 172.21.15.84:0/2583718957 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3aa8051b80 con 0x7f3ab015a030 2023-10-06T03:27:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.501+0000 7f3aaffff700 1 -- 172.21.15.84:0/2583718957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ab0159850 con 0x7f3ab015a030 2023-10-06T03:27:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.502+0000 7f3aa77fe700 1 -- 172.21.15.84:0/2583718957 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+14373 (secure 0 0 0) 0x7f3aa806be60 con 0x7f3ab015a030 2023-10-06T03:27:49.503 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:49.504 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":107,"fsid":"3eb6b236-a9b2-4c6a-bc84-749d824186bc","created":"2023-10-06T03:23:31.551245+0000","modified":"2023-10-06T03:27:45.954634+0000","last_up_change":"2023-10-06T03:23:42.323203+0000","last_in_change":"2023-10-06T03:23:33.956714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:42.683917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:43.082697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ed32e6d1-173a-43d7-9678-c27d62b49b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90665},{"type":"v1","addr":"172.21.15.84:6818","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90665},{"type":"v1","addr":"172.21.15.84:6822","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90665},{"type":"v1","addr":"172.21.15.84:6830","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90665},{"type":"v1","addr":"172.21.15.84:6826","nonce":90665}]},"public_addr":"172.21.15.84:6818/90665","cluster_addr":"172.21.15.84:6822/90665","heartbeat_back_addr":"172.21.15.84:6830/90665","heartbeat_front_addr":"172.21.15.84:6826/90665","state":["exists","up"]},{"osd":1,"uuid":"5d218451-7186-4ae0-b3be-602a19ca5197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90663},{"type":"v1","addr":"172.21.15.84:6809","nonce":90663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90663},{"type":"v1","addr":"172.21.15.84:6811","nonce":90663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90663},{"type":"v1","addr":"172.21.15.84:6815","nonce":90663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90663},{"type":"v1","addr":"172.21.15.84:6813","nonce":90663}]},"public_addr":"172.21.15.84:6809/90663","cluster_addr":"172.21.15.84:6811/90663","heartbeat_back_addr":"172.21.15.84:6815/90663","heartbeat_front_addr":"172.21.15.84:6813/90663","state":["exists","up"]},{"osd":2,"uuid":"d169e18c-082c-4110-a7a1-2a831dcb27df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":90666},{"type":"v1","addr":"172.21.15.84:6819","nonce":90666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6821","nonce":90666},{"type":"v1","addr":"172.21.15.84:6823","nonce":90666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6829","nonce":90666},{"type":"v1","addr":"172.21.15.84:6831","nonce":90666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6825","nonce":90666},{"type":"v1","addr":"172.21.15.84:6827","nonce":90666}]},"public_addr":"172.21.15.84:6819/90666","cluster_addr":"172.21.15.84:6823/90666","heartbeat_back_addr":"172.21.15.84:6831/90666","heartbeat_front_addr":"172.21.15.84:6827/90666","state":["exists","up"]},{"osd":3,"uuid":"304b2650-3d07-4149-a997-640d8bb6ab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90664},{"type":"v1","addr":"172.21.15.84:6801","nonce":90664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90664},{"type":"v1","addr":"172.21.15.84:6803","nonce":90664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90664},{"type":"v1","addr":"172.21.15.84:6807","nonce":90664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90664},{"type":"v1","addr":"172.21.15.84:6805","nonce":90664}]},"public_addr":"172.21.15.84:6801/90664","cluster_addr":"172.21.15.84:6803/90664","heartbeat_back_addr":"172.21.15.84:6807/90664","heartbeat_front_addr":"172.21.15.84:6805/90664","state":["exists","up"]},{"osd":4,"uuid":"1f73b3ae-0080-4619-9296-e989f4d4980f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90816},{"type":"v1","addr":"172.21.15.131:6801","nonce":90816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90816},{"type":"v1","addr":"172.21.15.131:6803","nonce":90816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90816},{"type":"v1","addr":"172.21.15.131:6807","nonce":90816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90816},{"type":"v1","addr":"172.21.15.131:6805","nonce":90816}]},"public_addr":"172.21.15.131:6801/90816","cluster_addr":"172.21.15.131:6803/90816","heartbeat_back_addr":"172.21.15.131:6807/90816","heartbeat_front_addr":"172.21.15.131:6805/90816","state":["exists","up"]},{"osd":5,"uuid":"1830956c-00c4-4992-af84-7472db118490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90846},{"type":"v1","addr":"172.21.15.131:6817","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90846},{"type":"v1","addr":"172.21.15.131:6819","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90846},{"type":"v1","addr":"172.21.15.131:6823","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90846},{"type":"v1","addr":"172.21.15.131:6821","nonce":90846}]},"public_addr":"172.21.15.131:6817/90846","cluster_addr":"172.21.15.131:6819/90846","heartbeat_back_addr":"172.21.15.131:6823/90846","heartbeat_front_addr":"172.21.15.131:6821/90846","state":["exists","up"]},{"osd":6,"uuid":"16dd47a4-ee93-4ac1-b8d5-12761767b047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90817},{"type":"v1","addr":"172.21.15.131:6809","nonce":90817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90817},{"type":"v1","addr":"172.21.15.131:6811","nonce":90817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90817},{"type":"v1","addr":"172.21.15.131:6815","nonce":90817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90817},{"type":"v1","addr":"172.21.15.131:6813","nonce":90817}]},"public_addr":"172.21.15.131:6809/90817","cluster_addr":"172.21.15.131:6811/90817","heartbeat_back_addr":"172.21.15.131:6815/90817","heartbeat_front_addr":"172.21.15.131:6813/90817","state":["exists","up"]},{"osd":7,"uuid":"12050f82-8d6e-4afd-97d2-6ee7290c9416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90847},{"type":"v1","addr":"172.21.15.131:6825","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90847},{"type":"v1","addr":"172.21.15.131:6827","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90847},{"type":"v1","addr":"172.21.15.131:6831","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90847},{"type":"v1","addr":"172.21.15.131:6829","nonce":90847}]},"public_addr":"172.21.15.131:6825/90847","cluster_addr":"172.21.15.131:6827/90847","heartbeat_back_addr":"172.21.15.131:6831/90847","heartbeat_front_addr":"172.21.15.131:6829/90847","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.139008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.091206+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.089916+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.135487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:38.832088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.152191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.066388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:39.109979+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6837/573778757":"2023-10-07T03:27:42.945817+0000","172.21.15.84:6836/573778757":"2023-10-07T03:27:42.945817+0000","172.21.15.84:6836/632169803":"2023-10-07T03:27:15.500473+0000","172.21.15.131:6832/169780123":"2023-10-07T03:27:16.359327+0000","172.21.15.84:6834/3193918731":"2023-10-07T03:27:42.945803+0000","172.21.15.84:6837/632169803":"2023-10-07T03:27:15.500473+0000","172.21.15.131:6834/169780123":"2023-10-07T03:27:16.359327+0000","172.21.15.84:6835/3193918731":"2023-10-07T03:27:42.945803+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:27:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 -- 172.21.15.84:0/2583718957 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3a90066f30 msgr2=0x7f3a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3a90066f30 0x7f3a900693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000a930 tx=0x7f3aa0016000 comp rx=0 tx=0).stop 2023-10-06T03:27:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 -- 172.21.15.84:0/2583718957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ab015a030 msgr2=0x7f3ab0153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ab015a030 0x7f3ab0153f00 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00c3ad0 tx=0x7f3aa8008040 comp rx=0 tx=0).stop 2023-10-06T03:27:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 -- 172.21.15.84:0/2583718957 shutdown_connections 2023-10-06T03:27:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f3a90066f30 0x7f3a900693e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ab015a030 0x7f3ab0153f00 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a9c003a90 0x7f3ab00ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 --2- 172.21.15.84:0/2583718957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ab00c84e0 0x7f3ab0159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 -- 172.21.15.84:0/2583718957 >> 172.21.15.84:0/2583718957 conn(0x7f3ab006ed20 msgr2=0x7f3ab00b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 -- 172.21.15.84:0/2583718957 shutdown_connections 2023-10-06T03:27:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:49.504+0000 7f3aaffff700 1 -- 172.21.15.84:0/2583718957 wait complete. 2023-10-06T03:27:50.518 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T03:27:50.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:27:50.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.678+0000 7f28a2195700 1 Processor -- start 2023-10-06T03:27:50.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.678+0000 7f28a2195700 1 -- start start 2023-10-06T03:27:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.678+0000 7f28a2195700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0b0760 0x7f289c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.678+0000 7f28a2195700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c0c4170 con 0x7f289c0c4d10 2023-10-06T03:27:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.678+0000 7f28a2195700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c0c3560 con 0x7f289c0c30d0 2023-10-06T03:27:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.678+0000 7f28a2195700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0c3840 con 0x7f289c0b0760 2023-10-06T03:27:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f289c0c4d10 0x7f289c0cc1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38202/0 (socket says 172.21.15.84:38202) 2023-10-06T03:27:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289bfff700 1 -- 172.21.15.84:0/32445541 learned_addr learned my addr 172.21.15.84:0/32445541 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289b7fe700 1 --2- 172.21.15.84:0/32445541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0b0760 0x7f289c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289a7fc700 1 -- 172.21.15.84:0/32445541 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923859869 0 0) 0x7f289c0c4170 con 0x7f289c0c4d10 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289a7fc700 1 -- 172.21.15.84:0/32445541 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2884003570 con 0x7f289c0c4d10 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289a7fc700 1 -- 172.21.15.84:0/32445541 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511993103 0 0) 0x7f289c0c3560 con 0x7f289c0c30d0 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289a7fc700 1 -- 172.21.15.84:0/32445541 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f289c0c4170 con 0x7f289c0c30d0 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289b7fe700 1 -- 172.21.15.84:0/32445541 >> v1:172.21.15.131:6789/0 conn(0x7f289c0c30d0 legacy=0x7f289c0c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289b7fe700 1 -- 172.21.15.84:0/32445541 >> v1:172.21.15.84:6789/0 conn(0x7f289c0c4d10 legacy=0x7f289c0cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289b7fe700 1 -- 172.21.15.84:0/32445541 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c0c3b20 con 0x7f289c0b0760 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289b7fe700 1 --2- 172.21.15.84:0/32445541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0b0760 0x7f289c0b10f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f288c009900 tx=0x7f288c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ee13c91cf1bf22f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.679+0000 7f289a7fc700 1 -- 172.21.15.84:0/32445541 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c005c10 con 0x7f289c0b0760 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.680+0000 7f289a7fc700 1 -- 172.21.15.84:0/32445541 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c005d70 con 0x7f289c0b0760 2023-10-06T03:27:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.680+0000 7f289a7fc700 1 -- 172.21.15.84:0/32445541 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c006260 con 0x7f289c0b0760 2023-10-06T03:27:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.680+0000 7f28a2195700 1 -- 172.21.15.84:0/32445541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0b0760 msgr2=0x7f289c0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.680+0000 7f28a2195700 1 --2- 172.21.15.84:0/32445541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0b0760 0x7f289c0b10f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f288c009900 tx=0x7f288c009120 comp rx=0 tx=0).stop 2023-10-06T03:27:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.680+0000 7f28a2195700 1 -- 172.21.15.84:0/32445541 shutdown_connections 2023-10-06T03:27:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.680+0000 7f28a2195700 1 --2- 172.21.15.84:0/32445541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0b0760 0x7f289c0b10f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.680+0000 7f28a2195700 1 -- 172.21.15.84:0/32445541 >> 172.21.15.84:0/32445541 conn(0x7f289c088000 msgr2=0x7f289c0ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.680+0000 7f28a2195700 1 -- 172.21.15.84:0/32445541 shutdown_connections 2023-10-06T03:27:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.680+0000 7f28a2195700 1 -- 172.21.15.84:0/32445541 wait complete. 2023-10-06T03:27:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.681+0000 7f28a2195700 1 Processor -- start 2023-10-06T03:27:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.681+0000 7f28a2195700 1 -- start start 2023-10-06T03:27:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f28a2195700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f289c0b0760 0x7f289c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f28a2195700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0c30d0 0x7f289c0af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f28a2195700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f289c0c4d10 0x7f289c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f28a2195700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c06a4c0 con 0x7f289c0c4d10 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f28a2195700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0698b0 con 0x7f289c0b0760 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f28a2195700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c069b90 con 0x7f289c0c30d0 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f289bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f289c0c4d10 0x7f289c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f289affd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0c30d0 0x7f289c0af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f289b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f289c0b0760 0x7f289c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f289affd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0c30d0 0x7f289c0af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:59672/0 (socket says 172.21.15.84:59672) 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.682+0000 7f289affd700 1 -- 172.21.15.84:0/1895417713 learned_addr learned my addr 172.21.15.84:0/1895417713 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f289bfff700 1 -- 172.21.15.84:0/1895417713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0c30d0 msgr2=0x7f289c0af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f289bfff700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f289c0c30d0 0x7f289c0af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f289bfff700 1 -- 172.21.15.84:0/1895417713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f289c0b0760 msgr2=0x7f289c15cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f289bfff700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f289c0b0760 0x7f289c15cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f289bfff700 1 -- 172.21.15.84:0/1895417713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c0093c0 con 0x7f289c0c4d10 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f289bfff700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f289c0c4d10 0x7f289c0af7d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2894001460 tx=0x7f2894001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f28837fe700 1 -- 172.21.15.84:0/1895417713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400a840 con 0x7f289c0c4d10 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f28837fe700 1 -- 172.21.15.84:0/1895417713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289400a9a0 con 0x7f289c0c4d10 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c069e70 con 0x7f289c0c4d10 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f28837fe700 1 -- 172.21.15.84:0/1895417713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400ad60 con 0x7f289c0c4d10 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.683+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c068ba0 con 0x7f289c0c4d10 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.684+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f289c064ad0 con 0x7f289c0c4d10 2023-10-06T03:27:50.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.684+0000 7f28837fe700 1 -- 172.21.15.84:0/1895417713 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2894007300 con 0x7f289c0c4d10 2023-10-06T03:27:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.684+0000 7f28837fe700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2888066f30 0x7f28880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.685+0000 7f28837fe700 1 -- 172.21.15.84:0/1895417713 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f28940848c0 con 0x7f289c0c4d10 2023-10-06T03:27:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.685+0000 7f289b7fe700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2888066f30 0x7f28880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.685+0000 7f28837fe700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] conn(0x7f288806dac0 0x7f288806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.685+0000 7f28837fe700 1 -- 172.21.15.84:0/1895417713 --> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28880705c0 con 0x7f288806dac0 2023-10-06T03:27:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.685+0000 7f28837fe700 1 -- 172.21.15.84:0/1895417713 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2894089220 con 0x7f289c0c4d10 2023-10-06T03:27:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.685+0000 7f289affd700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] conn(0x7f288806dac0 0x7f288806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.685+0000 7f289b7fe700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2888066f30 0x7f28880693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f288c009390 tx=0x7f288c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.685+0000 7f289affd700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] conn(0x7f288806dac0 0x7f288806fef0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.686+0000 7f28837fe700 1 -- 172.21.15.84:0/1895417713 <== osd.0 v2:172.21.15.84:6816/90665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f28880705c0 con 0x7f288806dac0 2023-10-06T03:27:50.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.699+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 --> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f289c0c3e00 con 0x7f288806dac0 2023-10-06T03:27:50.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28837fe700 1 -- 172.21.15.84:0/1895417713 <== osd.0 v2:172.21.15.84:6816/90665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f289c0c3e00 con 0x7f288806dac0 2023-10-06T03:27:50.735 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:50.735 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:27:50.735 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:50.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] conn(0x7f288806dac0 msgr2=0x7f288806fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28a2195700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:6816/90665,v1:172.21.15.84:6818/90665] conn(0x7f288806dac0 0x7f288806fef0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:50.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2888066f30 msgr2=0x7f28880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28a2195700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2888066f30 0x7f28880693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f288c009390 tx=0x7f288c016000 comp rx=0 tx=0).stop 2023-10-06T03:27:50.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f289c0c4d10 msgr2=0x7f289c0af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28a2195700 1 --2- 172.21.15.84:0/1895417713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f289c0c4d10 0x7f289c0af7d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2894001460 tx=0x7f2894001a40 comp rx=0 tx=0).stop 2023-10-06T03:27:50.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f289bfff700 1 -- 172.21.15.84:0/1895417713 reap_dead start 2023-10-06T03:27:50.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 shutdown_connections 2023-10-06T03:27:50.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 >> 172.21.15.84:0/1895417713 conn(0x7f289c088000 msgr2=0x7f289c156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:50.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 shutdown_connections 2023-10-06T03:27:50.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.700+0000 7f28a2195700 1 -- 172.21.15.84:0/1895417713 wait complete. 2023-10-06T03:27:50.740 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T03:27:50.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.853+0000 7f4489e9d700 1 Processor -- start 2023-10-06T03:27:50.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.853+0000 7f4489e9d700 1 -- start start 2023-10-06T03:27:50.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.854+0000 7f4489e9d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f44840ac040 0x7f4484069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.854+0000 7f4489e9d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4484069f00 con 0x7f44840adf60 2023-10-06T03:27:50.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.854+0000 7f4489e9d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44840c7370 con 0x7f4484069aa0 2023-10-06T03:27:50.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.854+0000 7f4489e9d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4484156150 con 0x7f44840ac040 2023-10-06T03:27:50.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.854+0000 7f44837fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f44840adf60 0x7f448406e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38216/0 (socket says 172.21.15.84:38216) 2023-10-06T03:27:50.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.854+0000 7f44837fe700 1 -- 172.21.15.84:0/3886095882 learned_addr learned my addr 172.21.15.84:0/3886095882 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:50.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f4482ffd700 1 --2- 172.21.15.84:0/3886095882 >> v2:172.21.15.131:3300/0 conn(0x7f44840ac040 0x7f4484069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f44827fc700 1 -- 172.21.15.84:0/3886095882 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540883422 0 0) 0x7f4474001110 con 0x7f44840adf60 2023-10-06T03:27:50.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f44827fc700 1 -- 172.21.15.84:0/3886095882 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f446c003570 con 0x7f44840adf60 2023-10-06T03:27:50.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f4482ffd700 1 -- 172.21.15.84:0/3886095882 >> v1:172.21.15.131:6789/0 conn(0x7f4484069aa0 legacy=0x7f44840c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f44827fc700 1 -- 172.21.15.84:0/3886095882 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938395466 0 0) 0x7f44840c7370 con 0x7f4484069aa0 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f4482ffd700 1 -- 172.21.15.84:0/3886095882 >> v1:172.21.15.84:6789/0 conn(0x7f44840adf60 legacy=0x7f448406e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f4482ffd700 1 -- 172.21.15.84:0/3886095882 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840c6760 con 0x7f44840ac040 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f4482ffd700 1 --2- 172.21.15.84:0/3886095882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44840ac040 0x7f4484069560 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f44780098e0 tx=0x7f44780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e67cc8277a81d07a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f44827fc700 1 -- 172.21.15.84:0/3886095882 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474001600 con 0x7f44840ac040 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f44827fc700 1 -- 172.21.15.84:0/3886095882 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4478011420 con 0x7f44840ac040 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.855+0000 7f44827fc700 1 -- 172.21.15.84:0/3886095882 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44780117c0 con 0x7f44840ac040 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.856+0000 7f4489e9d700 1 -- 172.21.15.84:0/3886095882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44840ac040 msgr2=0x7f4484069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.856+0000 7f4489e9d700 1 --2- 172.21.15.84:0/3886095882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44840ac040 0x7f4484069560 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f44780098e0 tx=0x7f44780091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.856+0000 7f4489e9d700 1 -- 172.21.15.84:0/3886095882 shutdown_connections 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.856+0000 7f4489e9d700 1 --2- 172.21.15.84:0/3886095882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44840ac040 0x7f4484069560 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.856+0000 7f4489e9d700 1 -- 172.21.15.84:0/3886095882 >> 172.21.15.84:0/3886095882 conn(0x7f44840680c0 msgr2=0x7f44840cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:50.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.856+0000 7f4489e9d700 1 -- 172.21.15.84:0/3886095882 shutdown_connections 2023-10-06T03:27:50.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.856+0000 7f4489e9d700 1 -- 172.21.15.84:0/3886095882 wait complete. 2023-10-06T03:27:50.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.857+0000 7f4489e9d700 1 Processor -- start 2023-10-06T03:27:50.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.857+0000 7f4489e9d700 1 -- start start 2023-10-06T03:27:50.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4489e9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4484069aa0 0x7f448414af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4489e9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44840ac040 0x7f448416a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4489e9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44840adf60 0x7f44840c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4489e9d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44840afae0 con 0x7f44840adf60 2023-10-06T03:27:50.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4489e9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4484169c80 con 0x7f44840ac040 2023-10-06T03:27:50.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4489e9d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44840c5b70 con 0x7f4484069aa0 2023-10-06T03:27:50.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4483fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44840adf60 0x7f44840c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4483fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44840adf60 0x7f44840c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44324/0 (socket says 172.21.15.84:44324) 2023-10-06T03:27:50.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4483fff700 1 -- 172.21.15.84:0/4101085333 learned_addr learned my addr 172.21.15.84:0/4101085333 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:50.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f44837fe700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4484069aa0 0x7f448414af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4482ffd700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44840ac040 0x7f448416a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4483fff700 1 -- 172.21.15.84:0/4101085333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4484069aa0 msgr2=0x7f448414af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4483fff700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4484069aa0 0x7f448414af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4483fff700 1 -- 172.21.15.84:0/4101085333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44840ac040 msgr2=0x7f448416a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4483fff700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44840ac040 0x7f448416a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4483fff700 1 -- 172.21.15.84:0/4101085333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478009420 con 0x7f44840adf60 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f44837fe700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4484069aa0 0x7f448414af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4483fff700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44840adf60 0x7f44840c3ad0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f447c001560 tx=0x7f447c001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f446b7fe700 1 -- 172.21.15.84:0/4101085333 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00a780 con 0x7f44840adf60 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f446b7fe700 1 -- 172.21.15.84:0/4101085333 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00a8e0 con 0x7f44840adf60 2023-10-06T03:27:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.858+0000 7f4489e9d700 1 -- 172.21.15.84:0/4101085333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44840c5e50 con 0x7f44840adf60 2023-10-06T03:27:50.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.859+0000 7f446b7fe700 1 -- 172.21.15.84:0/4101085333 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00aca0 con 0x7f44840adf60 2023-10-06T03:27:50.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.859+0000 7f4489e9d700 1 -- 172.21.15.84:0/4101085333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448414b440 con 0x7f44840adf60 2023-10-06T03:27:50.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.859+0000 7f4489e9d700 1 -- 172.21.15.84:0/4101085333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4484169e10 con 0x7f44840adf60 2023-10-06T03:27:50.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.860+0000 7f446b7fe700 1 -- 172.21.15.84:0/4101085333 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f447c012630 con 0x7f44840adf60 2023-10-06T03:27:50.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.860+0000 7f446b7fe700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4470066f30 0x7f44700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:50.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.860+0000 7f44837fe700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4470066f30 0x7f44700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:50.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.860+0000 7f446b7fe700 1 -- 172.21.15.84:0/4101085333 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f447c084980 con 0x7f44840adf60 2023-10-06T03:27:50.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.861+0000 7f44837fe700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4470066f30 0x7f44700693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4474007d00 tx=0x7f4474009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:50.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:50.864+0000 7f446b7fe700 1 -- 172.21.15.84:0/4101085333 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f447c051b50 con 0x7f44840adf60 2023-10-06T03:27:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.048+0000 7f4489e9d700 1 -- 172.21.15.84:0/4101085333 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f4484064ad0 con 0x7f4470066f30 2023-10-06T03:27:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.048+0000 7f446b7fe700 1 -- 172.21.15.84:0/4101085333 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4484064ad0 con 0x7f4470066f30 2023-10-06T03:27:51.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.050+0000 7f4489e9d700 1 -- 172.21.15.84:0/4101085333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4470066f30 msgr2=0x7f44700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.050+0000 7f4489e9d700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4470066f30 0x7f44700693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4474007d00 tx=0x7f4474009040 comp rx=0 tx=0).stop 2023-10-06T03:27:51.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.050+0000 7f4489e9d700 1 -- 172.21.15.84:0/4101085333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44840adf60 msgr2=0x7f44840c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.050+0000 7f4489e9d700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44840adf60 0x7f44840c3ad0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f447c001560 tx=0x7f447c001770 comp rx=0 tx=0).stop 2023-10-06T03:27:51.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.051+0000 7f4489e9d700 1 -- 172.21.15.84:0/4101085333 shutdown_connections 2023-10-06T03:27:51.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.051+0000 7f4489e9d700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f4470066f30 0x7f44700693e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.051+0000 7f4489e9d700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44840adf60 0x7f44840c3ad0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.051+0000 7f4489e9d700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4484069aa0 0x7f448414af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.051+0000 7f4489e9d700 1 --2- 172.21.15.84:0/4101085333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44840ac040 0x7f448416a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.051+0000 7f4489e9d700 1 -- 172.21.15.84:0/4101085333 >> 172.21.15.84:0/4101085333 conn(0x7f44840680c0 msgr2=0x7f44840c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.051+0000 7f4489e9d700 1 -- 172.21.15.84:0/4101085333 shutdown_connections 2023-10-06T03:27:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.051+0000 7f4489e9d700 1 -- 172.21.15.84:0/4101085333 wait complete. 2023-10-06T03:27:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T03:27:51.064 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T03:27:51.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:27:51.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.181+0000 7f37e933d700 1 Processor -- start 2023-10-06T03:27:51.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.181+0000 7f37e933d700 1 -- start start 2023-10-06T03:27:51.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.182+0000 7f37e933d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e41590b0 0x7f37e4159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.182+0000 7f37e933d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f37e40c6d00 0x7f37e406e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.182+0000 7f37e933d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f37e4068600 0x7f37e4068a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.182+0000 7f37e933d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e4068fc0 con 0x7f37e4068600 2023-10-06T03:27:51.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.182+0000 7f37e933d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e406a970 con 0x7f37e40c6d00 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.182+0000 7f37e933d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4069ac0 con 0x7f37e41590b0 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.182+0000 7f37e8b3c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f37e4068600 0x7f37e4068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.182+0000 7f37e8b3c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f37e4068600 0x7f37e4068a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44330/0 (socket says 172.21.15.84:44330) 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.182+0000 7f37e8b3c700 1 -- 172.21.15.84:0/3329522657 learned_addr learned my addr 172.21.15.84:0/3329522657 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e3fff700 1 --2- 172.21.15.84:0/3329522657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e41590b0 0x7f37e4159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e37fe700 1 --2- 172.21.15.84:0/3329522657 >> v2:172.21.15.131:3300/0 conn(0x7f37e40c6d00 0x7f37e406e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e8b3c700 1 -- 172.21.15.84:0/3329522657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e41590b0 msgr2=0x7f37e4159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e8b3c700 1 --2- 172.21.15.84:0/3329522657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e41590b0 0x7f37e4159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e8b3c700 1 -- 172.21.15.84:0/3329522657 >> v2:172.21.15.131:3300/0 conn(0x7f37e40c6d00 msgr2=0x7f37e406e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e8b3c700 1 --2- 172.21.15.84:0/3329522657 >> v2:172.21.15.131:3300/0 conn(0x7f37e40c6d00 0x7f37e406e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e8b3c700 1 -- 172.21.15.84:0/3329522657 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4069d60 con 0x7f37e4068600 2023-10-06T03:27:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e37fe700 1 --2- 172.21.15.84:0/3329522657 >> v2:172.21.15.131:3300/0 conn(0x7f37e40c6d00 0x7f37e406e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e8b3c700 1 --2- 172.21.15.84:0/3329522657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37e4068600 0x7f37e4068a80 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f37e406d1e0 tx=0x7f37dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7d83344c6e4620 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e2ffd700 1 -- 172.21.15.84:0/3329522657 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00e070 con 0x7f37e4068600 2023-10-06T03:27:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e2ffd700 1 -- 172.21.15.84:0/3329522657 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc00ba50 con 0x7f37e4068600 2023-10-06T03:27:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.183+0000 7f37e2ffd700 1 -- 172.21.15.84:0/3329522657 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0092e0 con 0x7f37e4068600 2023-10-06T03:27:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.184+0000 7f37e933d700 1 -- 172.21.15.84:0/3329522657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37e4068600 msgr2=0x7f37e4068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.184+0000 7f37e933d700 1 --2- 172.21.15.84:0/3329522657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37e4068600 0x7f37e4068a80 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f37e406d1e0 tx=0x7f37dc009840 comp rx=0 tx=0).stop 2023-10-06T03:27:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.184+0000 7f37e933d700 1 -- 172.21.15.84:0/3329522657 shutdown_connections 2023-10-06T03:27:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.184+0000 7f37e933d700 1 --2- 172.21.15.84:0/3329522657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37e4068600 0x7f37e4068a80 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.184+0000 7f37e933d700 1 --2- 172.21.15.84:0/3329522657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e41590b0 0x7f37e4159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.184+0000 7f37e933d700 1 --2- 172.21.15.84:0/3329522657 >> v2:172.21.15.131:3300/0 conn(0x7f37e40c6d00 0x7f37e406e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.184+0000 7f37e933d700 1 -- 172.21.15.84:0/3329522657 >> 172.21.15.84:0/3329522657 conn(0x7f37e40c9ca0 msgr2=0x7f37e406da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.184+0000 7f37e933d700 1 -- 172.21.15.84:0/3329522657 shutdown_connections 2023-10-06T03:27:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.184+0000 7f37e933d700 1 -- 172.21.15.84:0/3329522657 wait complete. 2023-10-06T03:27:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.185+0000 7f37e933d700 1 Processor -- start 2023-10-06T03:27:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.185+0000 7f37e933d700 1 -- start start 2023-10-06T03:27:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e933d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37e4068600 0x7f37e415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e933d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e40c6d00 0x7f37e4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e933d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37e41590b0 0x7f37e40c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e933d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e415ead0 con 0x7f37e41590b0 2023-10-06T03:27:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e933d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4169690 con 0x7f37e4068600 2023-10-06T03:27:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e933d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e415e820 con 0x7f37e40c6d00 2023-10-06T03:27:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e8b3c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37e41590b0 0x7f37e40c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e8b3c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37e41590b0 0x7f37e40c4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44336/0 (socket says 172.21.15.84:44336) 2023-10-06T03:27:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e8b3c700 1 -- 172.21.15.84:0/3573559412 learned_addr learned my addr 172.21.15.84:0/3573559412 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e37fe700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e40c6d00 0x7f37e4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e3fff700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37e4068600 0x7f37e415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e8b3c700 1 -- 172.21.15.84:0/3573559412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e40c6d00 msgr2=0x7f37e4158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e8b3c700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e40c6d00 0x7f37e4158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e8b3c700 1 -- 172.21.15.84:0/3573559412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37e4068600 msgr2=0x7f37e415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e8b3c700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37e4068600 0x7f37e415e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e8b3c700 1 -- 172.21.15.84:0/3573559412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc009ae0 con 0x7f37e41590b0 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e8b3c700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37e41590b0 0x7f37e40c4d10 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f37e406ccf0 tx=0x7f37dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37cbfff700 1 -- 172.21.15.84:0/3573559412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0032f0 con 0x7f37e41590b0 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37cbfff700 1 -- 172.21.15.84:0/3573559412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc008e80 con 0x7f37e41590b0 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e415c220 con 0x7f37e41590b0 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37cbfff700 1 -- 172.21.15.84:0/3573559412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0266b0 con 0x7f37e41590b0 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.186+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e415c7e0 con 0x7f37e41590b0 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.187+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37e405f270 con 0x7f37e41590b0 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.188+0000 7f37cbfff700 1 -- 172.21.15.84:0/3573559412 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37dc003040 con 0x7f37e41590b0 2023-10-06T03:27:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.188+0000 7f37cbfff700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37d0066f30 0x7f37d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.188+0000 7f37cbfff700 1 -- 172.21.15.84:0/3573559412 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f37dc086100 con 0x7f37e41590b0 2023-10-06T03:27:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.188+0000 7f37e3fff700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37d0066f30 0x7f37d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.188+0000 7f37cbfff700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x7f37d006da40 0x7f37d006fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.188+0000 7f37cbfff700 1 -- 172.21.15.84:0/3573559412 --> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37d0070540 con 0x7f37d006da40 2023-10-06T03:27:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.188+0000 7f37cbfff700 1 -- 172.21.15.84:0/3573559412 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37dc088740 con 0x7f37e41590b0 2023-10-06T03:27:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.188+0000 7f37e37fe700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x7f37d006da40 0x7f37d006fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.188+0000 7f37e3fff700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37d0066f30 0x7f37d00693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f37d4006fd0 tx=0x7f37d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.188+0000 7f37e37fe700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x7f37d006da40 0x7f37d006fe70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.189+0000 7f37cbfff700 1 -- 172.21.15.84:0/3573559412 <== osd.1 v2:172.21.15.84:6808/90663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f37d0070540 con 0x7f37d006da40 2023-10-06T03:27:51.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 --> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f37e406a040 con 0x7f37d006da40 2023-10-06T03:27:51.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37cbfff700 1 -- 172.21.15.84:0/3573559412 <== osd.1 v2:172.21.15.84:6808/90663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f37e406a040 con 0x7f37d006da40 2023-10-06T03:27:51.205 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:51.205 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:27:51.205 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:51.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x7f37d006da40 msgr2=0x7f37d006fe70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:6808/90663,v1:172.21.15.84:6809/90663] conn(0x7f37d006da40 0x7f37d006fe70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37d0066f30 msgr2=0x7f37d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f37d0066f30 0x7f37d00693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f37d4006fd0 tx=0x7f37d4008040 comp rx=0 tx=0).stop 2023-10-06T03:27:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37e41590b0 msgr2=0x7f37e40c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 --2- 172.21.15.84:0/3573559412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37e41590b0 0x7f37e40c4d10 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f37e406ccf0 tx=0x7f37dc018000 comp rx=0 tx=0).stop 2023-10-06T03:27:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e8b3c700 1 -- 172.21.15.84:0/3573559412 reap_dead start 2023-10-06T03:27:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 shutdown_connections 2023-10-06T03:27:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 >> 172.21.15.84:0/3573559412 conn(0x7f37e40c9ca0 msgr2=0x7f37e406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 shutdown_connections 2023-10-06T03:27:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.203+0000 7f37e933d700 1 -- 172.21.15.84:0/3573559412 wait complete. 2023-10-06T03:27:51.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T03:27:51.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.330+0000 7fb63e74c700 1 Processor -- start 2023-10-06T03:27:51.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.330+0000 7fb63e74c700 1 -- start start 2023-10-06T03:27:51.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.331+0000 7fb63e74c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb638159480 0x7fb6380b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.331+0000 7fb63e74c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6380b2140 0x7fb6380b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.331+0000 7fb63e74c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6380cb7e0 con 0x7fb6380b3610 2023-10-06T03:27:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.331+0000 7fb63e74c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6380b08a0 con 0x7fb638159480 2023-10-06T03:27:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.331+0000 7fb63e74c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380cb190 con 0x7fb6380b2140 2023-10-06T03:27:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.331+0000 7fb63df4b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6380b2140 0x7fb6380b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.331+0000 7fb63d74a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb638159480 0x7fb6380b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb63df4b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6380b2140 0x7fb6380b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:59710/0 (socket says 172.21.15.84:59710) 2023-10-06T03:27:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb63cf49700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb6380b3610 0x7fb6380cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:56320/0 (socket says 172.21.15.84:56320) 2023-10-06T03:27:51.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb63d74a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb638159480 0x7fb6380b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:45316/0 (socket says 172.21.15.84:45316) 2023-10-06T03:27:51.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb63df4b700 1 -- 172.21.15.84:0/2697319487 learned_addr learned my addr 172.21.15.84:0/2697319487 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:51.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb63df4b700 1 -- 172.21.15.84:0/2697319487 >> v2:172.21.15.131:3300/0 conn(0x7fb638159480 msgr2=0x7fb6380b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:51.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb63df4b700 1 --2- 172.21.15.84:0/2697319487 >> v2:172.21.15.131:3300/0 conn(0x7fb638159480 0x7fb6380b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb63df4b700 1 -- 172.21.15.84:0/2697319487 >> v1:172.21.15.131:6789/0 conn(0x7fb6380b3610 legacy=0x7fb6380cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb63df4b700 1 -- 172.21.15.84:0/2697319487 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380cb470 con 0x7fb6380b2140 2023-10-06T03:27:51.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb63df4b700 1 --2- 172.21.15.84:0/2697319487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6380b2140 0x7fb6380b25a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb630009f20 tx=0x7fb630009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9cd33d896db8172 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb62ffff700 1 -- 172.21.15.84:0/2697319487 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000e070 con 0x7fb6380b2140 2023-10-06T03:27:51.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb62ffff700 1 -- 172.21.15.84:0/2697319487 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63000b9d0 con 0x7fb6380b2140 2023-10-06T03:27:51.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.332+0000 7fb62ffff700 1 -- 172.21.15.84:0/2697319487 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300092e0 con 0x7fb6380b2140 2023-10-06T03:27:51.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.333+0000 7fb63e74c700 1 -- 172.21.15.84:0/2697319487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6380b2140 msgr2=0x7fb6380b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.333+0000 7fb63e74c700 1 --2- 172.21.15.84:0/2697319487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6380b2140 0x7fb6380b25a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb630009f20 tx=0x7fb630009840 comp rx=0 tx=0).stop 2023-10-06T03:27:51.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.333+0000 7fb63e74c700 1 -- 172.21.15.84:0/2697319487 shutdown_connections 2023-10-06T03:27:51.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.333+0000 7fb63e74c700 1 --2- 172.21.15.84:0/2697319487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6380b2140 0x7fb6380b25a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.333+0000 7fb63e74c700 1 --2- 172.21.15.84:0/2697319487 >> v2:172.21.15.131:3300/0 conn(0x7fb638159480 0x7fb6380b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.333+0000 7fb63e74c700 1 -- 172.21.15.84:0/2697319487 >> 172.21.15.84:0/2697319487 conn(0x7fb63806ed20 msgr2=0x7fb63806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:51.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.333+0000 7fb63e74c700 1 -- 172.21.15.84:0/2697319487 shutdown_connections 2023-10-06T03:27:51.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.333+0000 7fb63e74c700 1 -- 172.21.15.84:0/2697319487 wait complete. 2023-10-06T03:27:51.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.334+0000 7fb63e74c700 1 Processor -- start 2023-10-06T03:27:51.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.334+0000 7fb63e74c700 1 -- start start 2023-10-06T03:27:51.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63e74c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6380b2140 0x7fb6380c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63e74c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6380b3610 0x7fb638169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63e74c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb638159480 0x7fb6380c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63e74c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380c9d30 con 0x7fb6380b3610 2023-10-06T03:27:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63e74c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380c68a0 con 0x7fb6380b2140 2023-10-06T03:27:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63e74c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63816a300 con 0x7fb638159480 2023-10-06T03:27:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63cf49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6380b3610 0x7fb638169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63cf49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6380b3610 0x7fb638169dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44342/0 (socket says 172.21.15.84:44342) 2023-10-06T03:27:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63cf49700 1 -- 172.21.15.84:0/1082213235 learned_addr learned my addr 172.21.15.84:0/1082213235 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63df4b700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb638159480 0x7fb6380c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63d74a700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6380b2140 0x7fb6380c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63cf49700 1 -- 172.21.15.84:0/1082213235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb638159480 msgr2=0x7fb6380c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63cf49700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb638159480 0x7fb6380c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63cf49700 1 -- 172.21.15.84:0/1082213235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6380b2140 msgr2=0x7fb6380c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63cf49700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6380b2140 0x7fb6380c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63cf49700 1 -- 172.21.15.84:0/1082213235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630009ae0 con 0x7fb6380b3610 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.335+0000 7fb63cf49700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6380b3610 0x7fb638169dc0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c7c0 tx=0x7fb628007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.336+0000 7fb62d7fa700 1 -- 172.21.15.84:0/1082213235 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628005a70 con 0x7fb6380b3610 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.336+0000 7fb62d7fa700 1 -- 172.21.15.84:0/1082213235 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628005bd0 con 0x7fb6380b3610 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.336+0000 7fb63e74c700 1 -- 172.21.15.84:0/1082213235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63815de20 con 0x7fb6380b3610 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.336+0000 7fb62d7fa700 1 -- 172.21.15.84:0/1082213235 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280070d0 con 0x7fb6380b3610 2023-10-06T03:27:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.336+0000 7fb63e74c700 1 -- 172.21.15.84:0/1082213235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6380c6300 con 0x7fb6380b3610 2023-10-06T03:27:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.336+0000 7fb63e74c700 1 -- 172.21.15.84:0/1082213235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6380c6a30 con 0x7fb6380b3610 2023-10-06T03:27:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.337+0000 7fb62d7fa700 1 -- 172.21.15.84:0/1082213235 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb628007480 con 0x7fb6380b3610 2023-10-06T03:27:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.338+0000 7fb62d7fa700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb61c066f30 0x7fb61c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.338+0000 7fb62d7fa700 1 -- 172.21.15.84:0/1082213235 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fb628083e50 con 0x7fb6380b3610 2023-10-06T03:27:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.338+0000 7fb63d74a700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb61c066f30 0x7fb61c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.338+0000 7fb63d74a700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb61c066f30 0x7fb61c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb6380b0280 tx=0x7fb6340091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.341+0000 7fb62d7fa700 1 -- 172.21.15.84:0/1082213235 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6280510a0 con 0x7fb6380b3610 2023-10-06T03:27:51.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.523+0000 7fb63e74c700 1 -- 172.21.15.84:0/1082213235 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6380b2b50 con 0x7fb61c066f30 2023-10-06T03:27:51.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.523+0000 7fb62d7fa700 1 -- 172.21.15.84:0/1082213235 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb6380b2b50 con 0x7fb61c066f30 2023-10-06T03:27:51.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 -- 172.21.15.84:0/1082213235 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb61c066f30 msgr2=0x7fb61c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb61c066f30 0x7fb61c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb6380b0280 tx=0x7fb6340091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 -- 172.21.15.84:0/1082213235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6380b3610 msgr2=0x7fb638169dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6380b3610 0x7fb638169dc0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c7c0 tx=0x7fb628007f70 comp rx=0 tx=0).stop 2023-10-06T03:27:51.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 -- 172.21.15.84:0/1082213235 shutdown_connections 2023-10-06T03:27:51.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb61c066f30 0x7fb61c0693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6380b2140 0x7fb6380c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb638159480 0x7fb6380c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 --2- 172.21.15.84:0/1082213235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6380b3610 0x7fb638169dc0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 -- 172.21.15.84:0/1082213235 >> 172.21.15.84:0/1082213235 conn(0x7fb63806ed20 msgr2=0x7fb6380cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:51.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 -- 172.21.15.84:0/1082213235 shutdown_connections 2023-10-06T03:27:51.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.525+0000 7fb63e74c700 1 -- 172.21.15.84:0/1082213235 wait complete. 2023-10-06T03:27:51.528 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T03:27:51.539 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T03:27:51.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:27:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.655+0000 7f0886161700 1 Processor -- start 2023-10-06T03:27:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.655+0000 7f0886161700 1 -- start start 2023-10-06T03:27:51.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f0886161700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f088006ed20 0x7f08800b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f0886161700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08800b2d20 con 0x7f088006f0f0 2023-10-06T03:27:51.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f0886161700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08800b0450 con 0x7f08800aee20 2023-10-06T03:27:51.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f0886161700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088006fb80 con 0x7f088006ed20 2023-10-06T03:27:51.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f087f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f088006ed20 0x7f08800b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f087effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f088006f0f0 0x7f08800b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38226/0 (socket says 172.21.15.84:38226) 2023-10-06T03:27:51.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f087effd700 1 -- 172.21.15.84:0/765949360 learned_addr learned my addr 172.21.15.84:0/765949360 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:51.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f087f7fe700 1 -- 172.21.15.84:0/765949360 >> v1:172.21.15.131:6789/0 conn(0x7f08800aee20 legacy=0x7f08800af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f087f7fe700 1 -- 172.21.15.84:0/765949360 >> v1:172.21.15.84:6789/0 conn(0x7f088006f0f0 legacy=0x7f08800b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f087f7fe700 1 -- 172.21.15.84:0/765949360 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08800b2a40 con 0x7f088006ed20 2023-10-06T03:27:51.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.656+0000 7f087e7fc700 1 -- 172.21.15.84:0/765949360 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004071813 0 0) 0x7f08800b2d20 con 0x7f088006f0f0 2023-10-06T03:27:51.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f087f7fe700 1 --2- 172.21.15.84:0/765949360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f088006ed20 0x7f08800b23a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0870009e90 tx=0x7f0870009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c837cbca6d83b8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f087e7fc700 1 -- 172.21.15.84:0/765949360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000e070 con 0x7f088006ed20 2023-10-06T03:27:51.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f087e7fc700 1 -- 172.21.15.84:0/765949360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087000bbf0 con 0x7f088006ed20 2023-10-06T03:27:51.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f087e7fc700 1 -- 172.21.15.84:0/765949360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870012430 con 0x7f088006ed20 2023-10-06T03:27:51.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f0886161700 1 -- 172.21.15.84:0/765949360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f088006ed20 msgr2=0x7f08800b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f0886161700 1 --2- 172.21.15.84:0/765949360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f088006ed20 0x7f08800b23a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0870009e90 tx=0x7f0870009780 comp rx=0 tx=0).stop 2023-10-06T03:27:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f0886161700 1 -- 172.21.15.84:0/765949360 shutdown_connections 2023-10-06T03:27:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f0886161700 1 --2- 172.21.15.84:0/765949360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f088006ed20 0x7f08800b23a0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f0886161700 1 -- 172.21.15.84:0/765949360 >> 172.21.15.84:0/765949360 conn(0x7f0880068330 msgr2=0x7f0880068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f0886161700 1 -- 172.21.15.84:0/765949360 shutdown_connections 2023-10-06T03:27:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.657+0000 7f0886161700 1 -- 172.21.15.84:0/765949360 wait complete. 2023-10-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.658+0000 7f0886161700 1 Processor -- start 2023-10-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f0886161700 1 -- start start 2023-10-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f0886161700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f088006ed20 0x7f08800a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f0886161700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f088006f0f0 0x7f0880156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f0886161700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08800aee20 0x7f088016a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f0886161700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08800a9980 con 0x7f088006f0f0 2023-10-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f0886161700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0880156ab0 con 0x7f088006ed20 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f0886161700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08800ab7a0 con 0x7f08800aee20 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f087effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f088006f0f0 0x7f0880156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f087effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f088006f0f0 0x7f0880156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44350/0 (socket says 172.21.15.84:44350) 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f087effd700 1 -- 172.21.15.84:0/2512239949 learned_addr learned my addr 172.21.15.84:0/2512239949 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f087f7fe700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f088006ed20 0x7f08800a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.659+0000 7f087ffff700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08800aee20 0x7f088016a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f087effd700 1 -- 172.21.15.84:0/2512239949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08800aee20 msgr2=0x7f088016a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f087effd700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08800aee20 0x7f088016a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f087effd700 1 -- 172.21.15.84:0/2512239949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f088006ed20 msgr2=0x7f08800a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f087effd700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f088006ed20 0x7f08800a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f087effd700 1 -- 172.21.15.84:0/2512239949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0870009a20 con 0x7f088006f0f0 2023-10-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f087effd700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f088006f0f0 0x7f0880156570 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f087400c840 tx=0x7f0874007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f08677fe700 1 -- 172.21.15.84:0/2512239949 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874005c00 con 0x7f088006f0f0 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f08677fe700 1 -- 172.21.15.84:0/2512239949 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0874005d80 con 0x7f088006f0f0 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088016a5f0 con 0x7f088006f0f0 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f08677fe700 1 -- 172.21.15.84:0/2512239949 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874007320 con 0x7f088006f0f0 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.660+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08800a86e0 con 0x7f088006f0f0 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.661+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0880064ad0 con 0x7f088006f0f0 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.661+0000 7f08677fe700 1 -- 172.21.15.84:0/2512239949 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f087401b3b0 con 0x7f088006f0f0 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.662+0000 7f08677fe700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f086c066f30 0x7f086c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.662+0000 7f08677fe700 1 -- 172.21.15.84:0/2512239949 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f0874083c60 con 0x7f088006f0f0 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.662+0000 7f087f7fe700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f086c066f30 0x7f086c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.662+0000 7f08677fe700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] conn(0x7f086c06dac0 0x7f086c06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.662+0000 7f08677fe700 1 -- 172.21.15.84:0/2512239949 --> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f086c0705c0 con 0x7f086c06dac0 2023-10-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.662+0000 7f08677fe700 1 -- 172.21.15.84:0/2512239949 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0874088220 con 0x7f088006f0f0 2023-10-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.662+0000 7f087ffff700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] conn(0x7f086c06dac0 0x7f086c06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.662+0000 7f087f7fe700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f086c066f30 0x7f086c0693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0870009fd0 tx=0x7f0870019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.662+0000 7f087ffff700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] conn(0x7f086c06dac0 0x7f086c06fef0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.663+0000 7f08677fe700 1 -- 172.21.15.84:0/2512239949 <== osd.2 v2:172.21.15.84:6817/90666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f086c0705c0 con 0x7f086c06dac0 2023-10-06T03:27:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.676+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 --> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f088004bb80 con 0x7f086c06dac0 2023-10-06T03:27:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f08677fe700 1 -- 172.21.15.84:0/2512239949 <== osd.2 v2:172.21.15.84:6817/90666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f088004bb80 con 0x7f086c06dac0 2023-10-06T03:27:51.679 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:51.679 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:27:51.679 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:51.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] conn(0x7f086c06dac0 msgr2=0x7f086c06fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f0886161700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:6817/90666,v1:172.21.15.84:6819/90666] conn(0x7f086c06dac0 0x7f086c06fef0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f086c066f30 msgr2=0x7f086c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f0886161700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f086c066f30 0x7f086c0693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0870009fd0 tx=0x7f0870019000 comp rx=0 tx=0).stop 2023-10-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f088006f0f0 msgr2=0x7f0880156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f0886161700 1 --2- 172.21.15.84:0/2512239949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f088006f0f0 0x7f0880156570 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f087400c840 tx=0x7f0874007d90 comp rx=0 tx=0).stop 2023-10-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f087ffff700 1 -- 172.21.15.84:0/2512239949 reap_dead start 2023-10-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 shutdown_connections 2023-10-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 >> 172.21.15.84:0/2512239949 conn(0x7f0880068330 msgr2=0x7f0880068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 shutdown_connections 2023-10-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.677+0000 7f0886161700 1 -- 172.21.15.84:0/2512239949 wait complete. 2023-10-06T03:27:51.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T03:27:51.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.803+0000 7faa5b680700 1 Processor -- start 2023-10-06T03:27:51.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.803+0000 7faa5b680700 1 -- start start 2023-10-06T03:27:51.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.804+0000 7faa5b680700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa540b49e0 0x7faa540aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.804+0000 7faa5b680700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa540b0ca0 con 0x7faa541595a0 2023-10-06T03:27:51.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.804+0000 7faa5b680700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa540b0f80 con 0x7faa540b07a0 2023-10-06T03:27:51.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.804+0000 7faa5b680700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa540b1260 con 0x7faa540b49e0 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.804+0000 7faa58c1b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa540b49e0 0x7faa540aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.804+0000 7faa5941c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faa541595a0 0x7faa540aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38230/0 (socket says 172.21.15.84:38230) 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.804+0000 7faa5941c700 1 -- 172.21.15.84:0/3519825522 learned_addr learned my addr 172.21.15.84:0/3519825522 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa58c1b700 1 -- 172.21.15.84:0/3519825522 >> v1:172.21.15.131:6789/0 conn(0x7faa540b07a0 legacy=0x7faa540b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa58c1b700 1 -- 172.21.15.84:0/3519825522 >> v1:172.21.15.84:6789/0 conn(0x7faa541595a0 legacy=0x7faa540aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa58c1b700 1 -- 172.21.15.84:0/3519825522 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540b1540 con 0x7faa540b49e0 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa4bfff700 1 -- 172.21.15.84:0/3519825522 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516106837 0 0) 0x7faa540b0ca0 con 0x7faa541595a0 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa58c1b700 1 --2- 172.21.15.84:0/3519825522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b49e0 0x7faa540aac80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7faa44009910 tx=0x7faa440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef02dbf18d63ef9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa4bfff700 1 -- 172.21.15.84:0/3519825522 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4400b7e0 con 0x7faa540b49e0 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa4bfff700 1 -- 172.21.15.84:0/3519825522 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4400b940 con 0x7faa540b49e0 2023-10-06T03:27:51.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa4bfff700 1 -- 172.21.15.84:0/3519825522 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4400bce0 con 0x7faa540b49e0 2023-10-06T03:27:51.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa5b680700 1 -- 172.21.15.84:0/3519825522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b49e0 msgr2=0x7faa540aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa5b680700 1 --2- 172.21.15.84:0/3519825522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b49e0 0x7faa540aac80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7faa44009910 tx=0x7faa440091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa5b680700 1 -- 172.21.15.84:0/3519825522 shutdown_connections 2023-10-06T03:27:51.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa5b680700 1 --2- 172.21.15.84:0/3519825522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b49e0 0x7faa540aac80 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa5b680700 1 -- 172.21.15.84:0/3519825522 >> 172.21.15.84:0/3519825522 conn(0x7faa54099830 msgr2=0x7faa5406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:51.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa5b680700 1 -- 172.21.15.84:0/3519825522 shutdown_connections 2023-10-06T03:27:51.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.805+0000 7faa5b680700 1 -- 172.21.15.84:0/3519825522 wait complete. 2023-10-06T03:27:51.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.807+0000 7faa5b680700 1 Processor -- start 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.807+0000 7faa5b680700 1 -- start start 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.807+0000 7faa5b680700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b07a0 0x7faa5409aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.807+0000 7faa5b680700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa540b49e0 0x7faa54156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.807+0000 7faa5b680700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa541595a0 0x7faa5409d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.807+0000 7faa5b680700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5409aa60 con 0x7faa540b07a0 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.807+0000 7faa5b680700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5409dfb0 con 0x7faa541595a0 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.807+0000 7faa5b680700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5409a130 con 0x7faa540b49e0 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5941c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b07a0 0x7faa5409aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5941c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b07a0 0x7faa5409aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44364/0 (socket says 172.21.15.84:44364) 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5941c700 1 -- 172.21.15.84:0/3288712002 learned_addr learned my addr 172.21.15.84:0/3288712002 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5941c700 1 -- 172.21.15.84:0/3288712002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa540b49e0 msgr2=0x7faa54156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa58c1b700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa540b49e0 0x7faa54156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa59c1d700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa541595a0 0x7faa5409d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5941c700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa540b49e0 0x7faa54156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5941c700 1 -- 172.21.15.84:0/3288712002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa541595a0 msgr2=0x7faa5409d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5941c700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa541595a0 0x7faa5409d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5941c700 1 -- 172.21.15.84:0/3288712002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44009420 con 0x7faa540b07a0 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5941c700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b07a0 0x7faa5409aef0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7faa5000c930 tx=0x7faa500016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa497fa700 1 -- 172.21.15.84:0/3288712002 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50005d80 con 0x7faa540b07a0 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa497fa700 1 -- 172.21.15.84:0/3288712002 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5000a5d0 con 0x7faa540b07a0 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5b680700 1 -- 172.21.15.84:0/3288712002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5409a410 con 0x7faa540b07a0 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa497fa700 1 -- 172.21.15.84:0/3288712002 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5000a990 con 0x7faa540b07a0 2023-10-06T03:27:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.808+0000 7faa5b680700 1 -- 172.21.15.84:0/3288712002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa54156fb0 con 0x7faa540b07a0 2023-10-06T03:27:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.809+0000 7faa5b680700 1 -- 172.21.15.84:0/3288712002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5409b430 con 0x7faa540b07a0 2023-10-06T03:27:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.809+0000 7faa497fa700 1 -- 172.21.15.84:0/3288712002 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa500070f0 con 0x7faa540b07a0 2023-10-06T03:27:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.810+0000 7faa497fa700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa38066f60 0x7faa38069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.810+0000 7faa497fa700 1 -- 172.21.15.84:0/3288712002 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7faa500843d0 con 0x7faa540b07a0 2023-10-06T03:27:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.810+0000 7faa58c1b700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa38066f60 0x7faa38069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.810+0000 7faa58c1b700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa38066f60 0x7faa38069410 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7faa44009910 tx=0x7faa44016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.814+0000 7faa497fa700 1 -- 172.21.15.84:0/3288712002 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa500515a0 con 0x7faa540b07a0 2023-10-06T03:27:51.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.996+0000 7faa5b680700 1 -- 172.21.15.84:0/3288712002 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7faa54064ad0 con 0x7faa38066f60 2023-10-06T03:27:51.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.997+0000 7faa497fa700 1 -- 172.21.15.84:0/3288712002 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faa54064ad0 con 0x7faa38066f60 2023-10-06T03:27:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.998+0000 7faa5b680700 1 -- 172.21.15.84:0/3288712002 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa38066f60 msgr2=0x7faa38069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.998+0000 7faa5b680700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa38066f60 0x7faa38069410 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7faa44009910 tx=0x7faa44016000 comp rx=0 tx=0).stop 2023-10-06T03:27:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.998+0000 7faa5b680700 1 -- 172.21.15.84:0/3288712002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b07a0 msgr2=0x7faa5409aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.998+0000 7faa5b680700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b07a0 0x7faa5409aef0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7faa5000c930 tx=0x7faa500016f0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.999+0000 7faa5b680700 1 -- 172.21.15.84:0/3288712002 shutdown_connections 2023-10-06T03:27:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.999+0000 7faa5b680700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa38066f60 0x7faa38069410 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.999+0000 7faa5b680700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa541595a0 0x7faa5409d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.999+0000 7faa5b680700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa540b07a0 0x7faa5409aef0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.999+0000 7faa5b680700 1 --2- 172.21.15.84:0/3288712002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa540b49e0 0x7faa54156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.999+0000 7faa5b680700 1 -- 172.21.15.84:0/3288712002 >> 172.21.15.84:0/3288712002 conn(0x7faa54099830 msgr2=0x7faa54158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.999+0000 7faa5b680700 1 -- 172.21.15.84:0/3288712002 shutdown_connections 2023-10-06T03:27:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:51.999+0000 7faa5b680700 1 -- 172.21.15.84:0/3288712002 wait complete. 2023-10-06T03:27:52.002 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T03:27:52.012 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T03:27:52.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:27:52.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.128+0000 7f388f8d7700 1 Processor -- start 2023-10-06T03:27:52.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.128+0000 7f388f8d7700 1 -- start start 2023-10-06T03:27:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.129+0000 7f388f8d7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f38880ccdb0 0x7f38880a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.129+0000 7f388f8d7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 0x7f38880abff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.129+0000 7f388f8d7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38880ac530 con 0x7f38880abc20 2023-10-06T03:27:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.129+0000 7f388f8d7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38880ad370 con 0x7f38880ccdb0 2023-10-06T03:27:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.129+0000 7f388f8d7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38880695d0 con 0x7f388806ad20 2023-10-06T03:27:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388de74700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 0x7f38880abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388ce72700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f38880ccdb0 0x7f38880a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388de74700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 0x7f38880abff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:59740/0 (socket says 172.21.15.84:59740) 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388d673700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f38880abc20 0x7f38880a63f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:56350/0 (socket says 172.21.15.84:56350) 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388ce72700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f38880ccdb0 0x7f38880a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:45348/0 (socket says 172.21.15.84:45348) 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388de74700 1 -- 172.21.15.84:0/216166646 learned_addr learned my addr 172.21.15.84:0/216166646 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388de74700 1 -- 172.21.15.84:0/216166646 >> v2:172.21.15.131:3300/0 conn(0x7f38880ccdb0 msgr2=0x7f38880a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388de74700 1 --2- 172.21.15.84:0/216166646 >> v2:172.21.15.131:3300/0 conn(0x7f38880ccdb0 0x7f38880a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388de74700 1 -- 172.21.15.84:0/216166646 >> v1:172.21.15.131:6789/0 conn(0x7f38880abc20 legacy=0x7f38880a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388de74700 1 -- 172.21.15.84:0/216166646 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38880ac760 con 0x7f388806ad20 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388ce72700 1 --2- 172.21.15.84:0/216166646 >> v2:172.21.15.131:3300/0 conn(0x7f38880ccdb0 0x7f38880a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f388de74700 1 --2- 172.21.15.84:0/216166646 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 0x7f38880abff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38800099b0 tx=0x7f3880009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bae42f1fca15cc25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f387ffff700 1 -- 172.21.15.84:0/216166646 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880009ea0 con 0x7f388806ad20 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f387ffff700 1 -- 172.21.15.84:0/216166646 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388000b860 con 0x7f388806ad20 2023-10-06T03:27:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.130+0000 7f387ffff700 1 -- 172.21.15.84:0/216166646 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388000bc00 con 0x7f388806ad20 2023-10-06T03:27:52.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.131+0000 7f388f8d7700 1 -- 172.21.15.84:0/216166646 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 msgr2=0x7f38880abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.131+0000 7f388f8d7700 1 --2- 172.21.15.84:0/216166646 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 0x7f38880abff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38800099b0 tx=0x7f3880009250 comp rx=0 tx=0).stop 2023-10-06T03:27:52.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.131+0000 7f388f8d7700 1 -- 172.21.15.84:0/216166646 shutdown_connections 2023-10-06T03:27:52.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.131+0000 7f388f8d7700 1 --2- 172.21.15.84:0/216166646 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 0x7f38880abff0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.131+0000 7f388f8d7700 1 --2- 172.21.15.84:0/216166646 >> v2:172.21.15.131:3300/0 conn(0x7f38880ccdb0 0x7f38880a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.131+0000 7f388f8d7700 1 -- 172.21.15.84:0/216166646 >> 172.21.15.84:0/216166646 conn(0x7f38880cc110 msgr2=0x7f38880cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:52.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.131+0000 7f388f8d7700 1 -- 172.21.15.84:0/216166646 shutdown_connections 2023-10-06T03:27:52.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.131+0000 7f388f8d7700 1 -- 172.21.15.84:0/216166646 wait complete. 2023-10-06T03:27:52.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.132+0000 7f388f8d7700 1 Processor -- start 2023-10-06T03:27:52.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.132+0000 7f388f8d7700 1 -- start start 2023-10-06T03:27:52.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388f8d7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 0x7f3888159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388f8d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38880abc20 0x7f38881646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388f8d7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38880ccdb0 0x7f3888156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388f8d7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38881598b0 con 0x7f38880abc20 2023-10-06T03:27:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388f8d7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3888158f80 con 0x7f38880ccdb0 2023-10-06T03:27:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388f8d7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3888159260 con 0x7f388806ad20 2023-10-06T03:27:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388ce72700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38880abc20 0x7f38881646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388ce72700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38880abc20 0x7f38881646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44378/0 (socket says 172.21.15.84:44378) 2023-10-06T03:27:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388ce72700 1 -- 172.21.15.84:0/4186808713 learned_addr learned my addr 172.21.15.84:0/4186808713 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388d673700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 0x7f3888159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388de74700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38880ccdb0 0x7f3888156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388ce72700 1 -- 172.21.15.84:0/4186808713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 msgr2=0x7f3888159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388ce72700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f388806ad20 0x7f3888159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388ce72700 1 -- 172.21.15.84:0/4186808713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38880ccdb0 msgr2=0x7f3888156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388ce72700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38880ccdb0 0x7f3888156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388ce72700 1 -- 172.21.15.84:0/4186808713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387800b6d0 con 0x7f38880abc20 2023-10-06T03:27:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.133+0000 7f388de74700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38880ccdb0 0x7f3888156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.134+0000 7f388ce72700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38880abc20 0x7f38881646a0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f3878010f70 tx=0x7f387800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.134+0000 7f387d7fa700 1 -- 172.21.15.84:0/4186808713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878011450 con 0x7f38880abc20 2023-10-06T03:27:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.134+0000 7f387d7fa700 1 -- 172.21.15.84:0/4186808713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38780115b0 con 0x7f38880abc20 2023-10-06T03:27:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.134+0000 7f387d7fa700 1 -- 172.21.15.84:0/4186808713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878011950 con 0x7f38880abc20 2023-10-06T03:27:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.134+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38800094f0 con 0x7f38880abc20 2023-10-06T03:27:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.134+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38880a7fb0 con 0x7f38880abc20 2023-10-06T03:27:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.135+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3888064ad0 con 0x7f38880abc20 2023-10-06T03:27:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.135+0000 7f387d7fa700 1 -- 172.21.15.84:0/4186808713 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3878011cc0 con 0x7f38880abc20 2023-10-06T03:27:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.136+0000 7f387d7fa700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f386c066f30 0x7f386c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.136+0000 7f387d7fa700 1 -- 172.21.15.84:0/4186808713 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f3878087ae0 con 0x7f38880abc20 2023-10-06T03:27:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.136+0000 7f388d673700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f386c066f30 0x7f386c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.136+0000 7f387d7fa700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] conn(0x7f386c06dac0 0x7f386c06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.136+0000 7f387d7fa700 1 -- 172.21.15.84:0/4186808713 --> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f386c0705c0 con 0x7f386c06dac0 2023-10-06T03:27:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.136+0000 7f387d7fa700 1 -- 172.21.15.84:0/4186808713 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3878087eb0 con 0x7f38880abc20 2023-10-06T03:27:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.136+0000 7f388de74700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] conn(0x7f386c06dac0 0x7f386c06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.136+0000 7f388d673700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f386c066f30 0x7f386c0693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3884001f80 tx=0x7f3884005cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.136+0000 7f388de74700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] conn(0x7f386c06dac0 0x7f386c06fef0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.137+0000 7f387d7fa700 1 -- 172.21.15.84:0/4186808713 <== osd.3 v2:172.21.15.84:6800/90664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f386c0705c0 con 0x7f386c06dac0 2023-10-06T03:27:52.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.150+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 --> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3888159700 con 0x7f386c06dac0 2023-10-06T03:27:52.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.150+0000 7f387d7fa700 1 -- 172.21.15.84:0/4186808713 <== osd.3 v2:172.21.15.84:6800/90664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3888159700 con 0x7f386c06dac0 2023-10-06T03:27:52.152 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:52.152 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:27:52.152 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:52.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] conn(0x7f386c06dac0 msgr2=0x7f386c06fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388f8d7700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:6800/90664,v1:172.21.15.84:6801/90664] conn(0x7f386c06dac0 0x7f386c06fef0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f386c066f30 msgr2=0x7f386c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388f8d7700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f386c066f30 0x7f386c0693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3884001f80 tx=0x7f3884005cd0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38880abc20 msgr2=0x7f38881646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388f8d7700 1 --2- 172.21.15.84:0/4186808713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38880abc20 0x7f38881646a0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f3878010f70 tx=0x7f387800b430 comp rx=0 tx=0).stop 2023-10-06T03:27:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388de74700 1 -- 172.21.15.84:0/4186808713 reap_dead start 2023-10-06T03:27:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 shutdown_connections 2023-10-06T03:27:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 >> 172.21.15.84:0/4186808713 conn(0x7f38880cc110 msgr2=0x7f388806eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 shutdown_connections 2023-10-06T03:27:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.151+0000 7f388f8d7700 1 -- 172.21.15.84:0/4186808713 wait complete. 2023-10-06T03:27:52.164 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T03:27:52.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.285+0000 7faa81c8c700 1 Processor -- start 2023-10-06T03:27:52.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.285+0000 7faa81c8c700 1 -- start start 2023-10-06T03:27:52.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.286+0000 7faa81c8c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa7c1595a0 0x7faa7c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.286+0000 7faa81c8c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa7c0b49e0 0x7faa7c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.286+0000 7faa81c8c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c0b0ca0 con 0x7faa7c0b07a0 2023-10-06T03:27:52.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.286+0000 7faa81c8c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c0b0f80 con 0x7faa7c0b49e0 2023-10-06T03:27:52.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.286+0000 7faa81c8c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c0b1260 con 0x7faa7c1595a0 2023-10-06T03:27:52.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.286+0000 7faa7affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa7c0b49e0 0x7faa7c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.286+0000 7faa7affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa7c0b49e0 0x7faa7c0aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44394/0 (socket says 172.21.15.84:44394) 2023-10-06T03:27:52.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.286+0000 7faa7affd700 1 -- 172.21.15.84:0/170511331 learned_addr learned my addr 172.21.15.84:0/170511331 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:52.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.286+0000 7faa7b7fe700 1 --2- 172.21.15.84:0/170511331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa7c1595a0 0x7faa7c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa7affd700 1 -- 172.21.15.84:0/170511331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa7c1595a0 msgr2=0x7faa7c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:52.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa7affd700 1 --2- 172.21.15.84:0/170511331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa7c1595a0 0x7faa7c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa7affd700 1 -- 172.21.15.84:0/170511331 >> v1:172.21.15.131:6789/0 conn(0x7faa7c0b07a0 legacy=0x7faa7c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa7affd700 1 -- 172.21.15.84:0/170511331 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c0b1540 con 0x7faa7c0b49e0 2023-10-06T03:27:52.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa7affd700 1 --2- 172.21.15.84:0/170511331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c0b49e0 0x7faa7c0aaab0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7faa700099b0 tx=0x7faa70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b661f772dc590d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa7a7fc700 1 -- 172.21.15.84:0/170511331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70009ea0 con 0x7faa7c0b49e0 2023-10-06T03:27:52.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa7a7fc700 1 -- 172.21.15.84:0/170511331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7000b860 con 0x7faa7c0b49e0 2023-10-06T03:27:52.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa7a7fc700 1 -- 172.21.15.84:0/170511331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000bc00 con 0x7faa7c0b49e0 2023-10-06T03:27:52.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa81c8c700 1 -- 172.21.15.84:0/170511331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c0b49e0 msgr2=0x7faa7c0aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa81c8c700 1 --2- 172.21.15.84:0/170511331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c0b49e0 0x7faa7c0aaab0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7faa700099b0 tx=0x7faa70009250 comp rx=0 tx=0).stop 2023-10-06T03:27:52.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa81c8c700 1 -- 172.21.15.84:0/170511331 shutdown_connections 2023-10-06T03:27:52.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa81c8c700 1 --2- 172.21.15.84:0/170511331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa7c1595a0 0x7faa7c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa81c8c700 1 --2- 172.21.15.84:0/170511331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c0b49e0 0x7faa7c0aaab0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa81c8c700 1 -- 172.21.15.84:0/170511331 >> 172.21.15.84:0/170511331 conn(0x7faa7c099830 msgr2=0x7faa7c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:52.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa81c8c700 1 -- 172.21.15.84:0/170511331 shutdown_connections 2023-10-06T03:27:52.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.287+0000 7faa81c8c700 1 -- 172.21.15.84:0/170511331 wait complete. 2023-10-06T03:27:52.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa81c8c700 1 Processor -- start 2023-10-06T03:27:52.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa81c8c700 1 -- start start 2023-10-06T03:27:52.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa81c8c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa7c0b07a0 0x7faa7c15b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa81c8c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c1595a0 0x7faa7c1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa81c8c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa7c147a50 0x7faa7c144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa81c8c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c146330 con 0x7faa7c1595a0 2023-10-06T03:27:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa81c8c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c147eb0 con 0x7faa7c0b07a0 2023-10-06T03:27:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa81c8c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c145470 con 0x7faa7c147a50 2023-10-06T03:27:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa7affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c1595a0 0x7faa7c1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa7affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c1595a0 0x7faa7c1575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44396/0 (socket says 172.21.15.84:44396) 2023-10-06T03:27:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.289+0000 7faa7affd700 1 -- 172.21.15.84:0/3526395223 learned_addr learned my addr 172.21.15.84:0/3526395223 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa7affd700 1 -- 172.21.15.84:0/3526395223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa7c147a50 msgr2=0x7faa7c144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa7affd700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa7c147a50 0x7faa7c144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa7affd700 1 -- 172.21.15.84:0/3526395223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa7c0b07a0 msgr2=0x7faa7c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa7affd700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa7c0b07a0 0x7faa7c15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa7affd700 1 -- 172.21.15.84:0/3526395223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa700094f0 con 0x7faa7c1595a0 2023-10-06T03:27:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa7affd700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c1595a0 0x7faa7c1575c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7faa7c067c60 tx=0x7faa70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa637fe700 1 -- 172.21.15.84:0/3526395223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000bbe0 con 0x7faa7c1595a0 2023-10-06T03:27:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa637fe700 1 -- 172.21.15.84:0/3526395223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa70011420 con 0x7faa7c1595a0 2023-10-06T03:27:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa81c8c700 1 -- 172.21.15.84:0/3526395223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c145720 con 0x7faa7c1595a0 2023-10-06T03:27:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa637fe700 1 -- 172.21.15.84:0/3526395223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700117a0 con 0x7faa7c1595a0 2023-10-06T03:27:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.290+0000 7faa81c8c700 1 -- 172.21.15.84:0/3526395223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c145ce0 con 0x7faa7c1595a0 2023-10-06T03:27:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.291+0000 7faa81c8c700 1 -- 172.21.15.84:0/3526395223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c064ad0 con 0x7faa7c1595a0 2023-10-06T03:27:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.291+0000 7faa637fe700 1 -- 172.21.15.84:0/3526395223 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa70011bd0 con 0x7faa7c1595a0 2023-10-06T03:27:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.292+0000 7faa637fe700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa68066f30 0x7faa680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.292+0000 7faa637fe700 1 -- 172.21.15.84:0/3526395223 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7faa70085fc0 con 0x7faa7c1595a0 2023-10-06T03:27:52.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.292+0000 7faa7b7fe700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa68066f30 0x7faa680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.292+0000 7faa7b7fe700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa68066f30 0x7faa680693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009b00 tx=0x7faa6c009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.296+0000 7faa637fe700 1 -- 172.21.15.84:0/3526395223 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa70053190 con 0x7faa7c1595a0 2023-10-06T03:27:52.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.483+0000 7faa81c8c700 1 -- 172.21.15.84:0/3526395223 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7faa7c146470 con 0x7faa68066f30 2023-10-06T03:27:52.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.484+0000 7faa637fe700 1 -- 172.21.15.84:0/3526395223 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faa7c146470 con 0x7faa68066f30 2023-10-06T03:27:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 -- 172.21.15.84:0/3526395223 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa68066f30 msgr2=0x7faa680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa68066f30 0x7faa680693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009b00 tx=0x7faa6c009120 comp rx=0 tx=0).stop 2023-10-06T03:27:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 -- 172.21.15.84:0/3526395223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c1595a0 msgr2=0x7faa7c1575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c1595a0 0x7faa7c1575c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7faa7c067c60 tx=0x7faa70017000 comp rx=0 tx=0).stop 2023-10-06T03:27:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 -- 172.21.15.84:0/3526395223 shutdown_connections 2023-10-06T03:27:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7faa68066f30 0x7faa680693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa7c0b07a0 0x7faa7c15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa7c147a50 0x7faa7c144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 --2- 172.21.15.84:0/3526395223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa7c1595a0 0x7faa7c1575c0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 -- 172.21.15.84:0/3526395223 >> 172.21.15.84:0/3526395223 conn(0x7faa7c099830 msgr2=0x7faa7c0cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 -- 172.21.15.84:0/3526395223 shutdown_connections 2023-10-06T03:27:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.486+0000 7faa81c8c700 1 -- 172.21.15.84:0/3526395223 wait complete. 2023-10-06T03:27:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T03:27:52.499 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T03:27:52.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:27:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.616+0000 7f86b0b8b700 1 Processor -- start 2023-10-06T03:27:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.616+0000 7f86b0b8b700 1 -- start start 2023-10-06T03:27:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.617+0000 7f86b0b8b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86ac1539d0 0x7f86ac15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.617+0000 7f86b0b8b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac0cdc30 con 0x7f86ac0d0a00 2023-10-06T03:27:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.617+0000 7f86b0b8b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac0cb500 con 0x7f86ac0ccab0 2023-10-06T03:27:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.617+0000 7f86b0b8b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac15a8f0 con 0x7f86ac1539d0 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.617+0000 7f86ab7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86ac1539d0 0x7f86ac15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.617+0000 7f86abfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f86ac0d0a00 0x7f86ac0ce8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38240/0 (socket says 172.21.15.84:38240) 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.617+0000 7f86abfff700 1 -- 172.21.15.84:0/774682205 learned_addr learned my addr 172.21.15.84:0/774682205 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.617+0000 7f86ab7fe700 1 -- 172.21.15.84:0/774682205 >> v1:172.21.15.131:6789/0 conn(0x7f86ac0ccab0 legacy=0x7f86ac0d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.617+0000 7f86ab7fe700 1 -- 172.21.15.84:0/774682205 >> v1:172.21.15.84:6789/0 conn(0x7f86ac0d0a00 legacy=0x7f86ac0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.617+0000 7f86ab7fe700 1 -- 172.21.15.84:0/774682205 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac0cd020 con 0x7f86ac1539d0 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86ab7fe700 1 --2- 172.21.15.84:0/774682205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac1539d0 0x7f86ac15a3b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009e60 tx=0x7f86a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3efc51f156e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86aa7fc700 1 -- 172.21.15.84:0/774682205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a400e070 con 0x7f86ac1539d0 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86aa7fc700 1 -- 172.21.15.84:0/774682205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a400bbf0 con 0x7f86ac1539d0 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86aa7fc700 1 -- 172.21.15.84:0/774682205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4012430 con 0x7f86ac1539d0 2023-10-06T03:27:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86b0b8b700 1 -- 172.21.15.84:0/774682205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac1539d0 msgr2=0x7f86ac15a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86b0b8b700 1 --2- 172.21.15.84:0/774682205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac1539d0 0x7f86ac15a3b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009e60 tx=0x7f86a4009780 comp rx=0 tx=0).stop 2023-10-06T03:27:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86b0b8b700 1 -- 172.21.15.84:0/774682205 shutdown_connections 2023-10-06T03:27:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86b0b8b700 1 --2- 172.21.15.84:0/774682205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac1539d0 0x7f86ac15a3b0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86b0b8b700 1 -- 172.21.15.84:0/774682205 >> 172.21.15.84:0/774682205 conn(0x7f86ac068100 msgr2=0x7f86ac0684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86b0b8b700 1 -- 172.21.15.84:0/774682205 shutdown_connections 2023-10-06T03:27:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.618+0000 7f86b0b8b700 1 -- 172.21.15.84:0/774682205 wait complete. 2023-10-06T03:27:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.619+0000 7f86b0b8b700 1 Processor -- start 2023-10-06T03:27:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86b0b8b700 1 -- start start 2023-10-06T03:27:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86b0b8b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86ac0ccab0 0x7f86ac150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86b0b8b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0d0a00 0x7f86ac0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86b0b8b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ac1539d0 0x7f86ac15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86b0b8b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac1508b0 con 0x7f86ac0d0a00 2023-10-06T03:27:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86b0b8b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0c8270 con 0x7f86ac1539d0 2023-10-06T03:27:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86b0b8b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0b2330 con 0x7f86ac0ccab0 2023-10-06T03:27:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86aaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0d0a00 0x7f86ac0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86aaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0d0a00 0x7f86ac0b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44428/0 (socket says 172.21.15.84:44428) 2023-10-06T03:27:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86aaffd700 1 -- 172.21.15.84:0/3953448278 learned_addr learned my addr 172.21.15.84:0/3953448278 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86abfff700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ac1539d0 0x7f86ac15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.620+0000 7f86ab7fe700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86ac0ccab0 0x7f86ac150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86aaffd700 1 -- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86ac0ccab0 msgr2=0x7f86ac150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86aaffd700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86ac0ccab0 0x7f86ac150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86aaffd700 1 -- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ac1539d0 msgr2=0x7f86ac15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86aaffd700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ac1539d0 0x7f86ac15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86aaffd700 1 -- 172.21.15.84:0/3953448278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4009a20 con 0x7f86ac0d0a00 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86aaffd700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0d0a00 0x7f86ac0b1df0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f869400b5e0 tx=0x7f8694009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86a37fe700 1 -- 172.21.15.84:0/3953448278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400f510 con 0x7f86ac0d0a00 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86a37fe700 1 -- 172.21.15.84:0/3953448278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869400f670 con 0x7f86ac0d0a00 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac0b0370 con 0x7f86ac0d0a00 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86a37fe700 1 -- 172.21.15.84:0/3953448278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400fa30 con 0x7f86ac0d0a00 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.621+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac0b0930 con 0x7f86ac0d0a00 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.622+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86ac05f270 con 0x7f86ac0d0a00 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.622+0000 7f86a37fe700 1 -- 172.21.15.84:0/3953448278 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8694024430 con 0x7f86ac0d0a00 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.623+0000 7f86a37fe700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f868c066f30 0x7f868c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.623+0000 7f86a37fe700 1 -- 172.21.15.84:0/3953448278 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f8694084a90 con 0x7f86ac0d0a00 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.623+0000 7f86ab7fe700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f868c066f30 0x7f868c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.623+0000 7f86a37fe700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] conn(0x7f868c06dac0 0x7f868c06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.623+0000 7f86a37fe700 1 -- 172.21.15.84:0/3953448278 --> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f868c0705c0 con 0x7f868c06dac0 2023-10-06T03:27:52.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.623+0000 7f86a37fe700 1 -- 172.21.15.84:0/3953448278 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8694084e60 con 0x7f86ac0d0a00 2023-10-06T03:27:52.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.623+0000 7f86abfff700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] conn(0x7f868c06dac0 0x7f868c06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.623+0000 7f86ab7fe700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f868c066f30 0x7f868c0693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f86a40097c0 tx=0x7f86a4018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.624+0000 7f86abfff700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] conn(0x7f868c06dac0 0x7f868c06fef0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.624+0000 7f86a37fe700 1 -- 172.21.15.84:0/3953448278 <== osd.4 v2:172.21.15.131:6800/90816 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f868c0705c0 con 0x7f868c06dac0 2023-10-06T03:27:52.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.638+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 --> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86ac0cd300 con 0x7f868c06dac0 2023-10-06T03:27:52.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.638+0000 7f86a37fe700 1 -- 172.21.15.84:0/3953448278 <== osd.4 v2:172.21.15.131:6800/90816 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f86ac0cd300 con 0x7f868c06dac0 2023-10-06T03:27:52.640 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:52.640 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:27:52.640 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:52.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] conn(0x7f868c06dac0 msgr2=0x7f868c06fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86b0b8b700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.131:6800/90816,v1:172.21.15.131:6801/90816] conn(0x7f868c06dac0 0x7f868c06fef0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f868c066f30 msgr2=0x7f868c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86b0b8b700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f868c066f30 0x7f868c0693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f86a40097c0 tx=0x7f86a4018000 comp rx=0 tx=0).stop 2023-10-06T03:27:52.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0d0a00 msgr2=0x7f86ac0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86b0b8b700 1 --2- 172.21.15.84:0/3953448278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86ac0d0a00 0x7f86ac0b1df0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f869400b5e0 tx=0x7f8694009120 comp rx=0 tx=0).stop 2023-10-06T03:27:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86abfff700 1 -- 172.21.15.84:0/3953448278 reap_dead start 2023-10-06T03:27:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 shutdown_connections 2023-10-06T03:27:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 >> 172.21.15.84:0/3953448278 conn(0x7f86ac068100 msgr2=0x7f86ac157590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 shutdown_connections 2023-10-06T03:27:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.639+0000 7f86b0b8b700 1 -- 172.21.15.84:0/3953448278 wait complete. 2023-10-06T03:27:52.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T03:27:52.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.768+0000 7f8a89735700 1 Processor -- start 2023-10-06T03:27:52.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.768+0000 7f8a89735700 1 -- start start 2023-10-06T03:27:52.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.769+0000 7f8a89735700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a840cbc70 0x7f8a840cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.769+0000 7f8a89735700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a840b2140 0x7f8a840b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.769+0000 7f8a89735700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a840cb7e0 con 0x7f8a84159480 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.769+0000 7f8a89735700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a840b08a0 con 0x7f8a840cbc70 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.769+0000 7f8a89735700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840cb190 con 0x7f8a840b2140 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.769+0000 7f8a837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a840cbc70 0x7f8a840cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.769+0000 7f8a83fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8a84159480 0x7f8a840b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38256/0 (socket says 172.21.15.84:38256) 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.769+0000 7f8a83fff700 1 -- 172.21.15.84:0/417853404 learned_addr learned my addr 172.21.15.84:0/417853404 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.769+0000 7f8a88f34700 1 --2- 172.21.15.84:0/417853404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a840b2140 0x7f8a840b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.770+0000 7f8a837fe700 1 -- 172.21.15.84:0/417853404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a840b2140 msgr2=0x7f8a840b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.770+0000 7f8a837fe700 1 --2- 172.21.15.84:0/417853404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a840b2140 0x7f8a840b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.770+0000 7f8a837fe700 1 -- 172.21.15.84:0/417853404 >> v1:172.21.15.84:6789/0 conn(0x7f8a84159480 legacy=0x7f8a840b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.770+0000 7f8a82ffd700 1 -- 172.21.15.84:0/417853404 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280370872 0 0) 0x7f8a840cb7e0 con 0x7f8a84159480 2023-10-06T03:27:52.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.770+0000 7f8a837fe700 1 -- 172.21.15.84:0/417853404 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a840cb470 con 0x7f8a840cbc70 2023-10-06T03:27:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.770+0000 7f8a837fe700 1 --2- 172.21.15.84:0/417853404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 0x7f8a840cc0c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f8a780098e0 tx=0x7f8a780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761bd112603f8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.770+0000 7f8a82ffd700 1 -- 172.21.15.84:0/417853404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7800b640 con 0x7f8a840cbc70 2023-10-06T03:27:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.770+0000 7f8a82ffd700 1 -- 172.21.15.84:0/417853404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7800b7a0 con 0x7f8a840cbc70 2023-10-06T03:27:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.770+0000 7f8a82ffd700 1 -- 172.21.15.84:0/417853404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7800bb40 con 0x7f8a840cbc70 2023-10-06T03:27:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.771+0000 7f8a89735700 1 -- 172.21.15.84:0/417853404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 msgr2=0x7f8a840cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.771+0000 7f8a89735700 1 --2- 172.21.15.84:0/417853404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 0x7f8a840cc0c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f8a780098e0 tx=0x7f8a780091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.771+0000 7f8a89735700 1 -- 172.21.15.84:0/417853404 shutdown_connections 2023-10-06T03:27:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.771+0000 7f8a89735700 1 --2- 172.21.15.84:0/417853404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a840b2140 0x7f8a840b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.771+0000 7f8a89735700 1 --2- 172.21.15.84:0/417853404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 0x7f8a840cc0c0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.771+0000 7f8a89735700 1 -- 172.21.15.84:0/417853404 >> 172.21.15.84:0/417853404 conn(0x7f8a8406ed20 msgr2=0x7f8a8406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:52.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.771+0000 7f8a89735700 1 -- 172.21.15.84:0/417853404 shutdown_connections 2023-10-06T03:27:52.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.771+0000 7f8a89735700 1 -- 172.21.15.84:0/417853404 wait complete. 2023-10-06T03:27:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.772+0000 7f8a89735700 1 Processor -- start 2023-10-06T03:27:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.772+0000 7f8a89735700 1 -- start start 2023-10-06T03:27:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a89735700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a840b2140 0x7f8a840d0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a89735700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 0x7f8a840cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a89735700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a84159480 0x7f8a840ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a89735700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840c7c60 con 0x7f8a840cbc70 2023-10-06T03:27:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a89735700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840cea00 con 0x7f8a840b2140 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a89735700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840cecb0 con 0x7f8a84159480 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 0x7f8a840cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 0x7f8a840cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44446/0 (socket says 172.21.15.84:44446) 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a837fe700 1 -- 172.21.15.84:0/342015734 learned_addr learned my addr 172.21.15.84:0/342015734 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a88f34700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a84159480 0x7f8a840ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a83fff700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a840b2140 0x7f8a840d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a837fe700 1 -- 172.21.15.84:0/342015734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a84159480 msgr2=0x7f8a840ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a837fe700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a84159480 0x7f8a840ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a837fe700 1 -- 172.21.15.84:0/342015734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a840b2140 msgr2=0x7f8a840d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a837fe700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a840b2140 0x7f8a840d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a837fe700 1 -- 172.21.15.84:0/342015734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a78009420 con 0x7f8a840cbc70 2023-10-06T03:27:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a88f34700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a84159480 0x7f8a840ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a837fe700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 0x7f8a840cdf80 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f8a84069190 tx=0x7f8a78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a6bfff700 1 -- 172.21.15.84:0/342015734 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7800bb20 con 0x7f8a840cbc70 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a6bfff700 1 -- 172.21.15.84:0/342015734 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a78011420 con 0x7f8a840cbc70 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a6bfff700 1 -- 172.21.15.84:0/342015734 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a780117a0 con 0x7f8a840cbc70 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a89735700 1 -- 172.21.15.84:0/342015734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a840cef90 con 0x7f8a840cbc70 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.773+0000 7f8a89735700 1 -- 172.21.15.84:0/342015734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a840cf550 con 0x7f8a840cbc70 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.774+0000 7f8a89735700 1 -- 172.21.15.84:0/342015734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a840c7df0 con 0x7f8a840cbc70 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.775+0000 7f8a6bfff700 1 -- 172.21.15.84:0/342015734 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a78011b50 con 0x7f8a840cbc70 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.775+0000 7f8a6bfff700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a70066f30 0x7f8a700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.775+0000 7f8a6bfff700 1 -- 172.21.15.84:0/342015734 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f8a78085d00 con 0x7f8a840cbc70 2023-10-06T03:27:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.775+0000 7f8a83fff700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a70066f30 0x7f8a700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:52.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.776+0000 7f8a83fff700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a70066f30 0x7f8a700693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8a74001750 tx=0x7f8a74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:52.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.779+0000 7f8a6bfff700 1 -- 172.21.15.84:0/342015734 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a840c7df0 con 0x7f8a840cbc70 2023-10-06T03:27:52.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.960+0000 7f8a89735700 1 -- 172.21.15.84:0/342015734 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a840c7df0 con 0x7f8a70066f30 2023-10-06T03:27:52.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.961+0000 7f8a6bfff700 1 -- 172.21.15.84:0/342015734 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8a840c7df0 con 0x7f8a70066f30 2023-10-06T03:27:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 -- 172.21.15.84:0/342015734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a70066f30 msgr2=0x7f8a700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a70066f30 0x7f8a700693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8a74001750 tx=0x7f8a74009040 comp rx=0 tx=0).stop 2023-10-06T03:27:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 -- 172.21.15.84:0/342015734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 msgr2=0x7f8a840cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 0x7f8a840cdf80 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f8a84069190 tx=0x7f8a78017000 comp rx=0 tx=0).stop 2023-10-06T03:27:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 -- 172.21.15.84:0/342015734 shutdown_connections 2023-10-06T03:27:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8a70066f30 0x7f8a700693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a840b2140 0x7f8a840d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a84159480 0x7f8a840ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 --2- 172.21.15.84:0/342015734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a840cbc70 0x7f8a840cdf80 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:52.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 -- 172.21.15.84:0/342015734 >> 172.21.15.84:0/342015734 conn(0x7f8a8406ed20 msgr2=0x7f8a84155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:52.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 -- 172.21.15.84:0/342015734 shutdown_connections 2023-10-06T03:27:52.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:52.963+0000 7f8a89735700 1 -- 172.21.15.84:0/342015734 wait complete. 2023-10-06T03:27:52.966 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T03:27:52.976 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T03:27:52.977 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:27:53.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.092+0000 7fc992f8c700 1 Processor -- start 2023-10-06T03:27:53.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.092+0000 7fc992f8c700 1 -- start start 2023-10-06T03:27:53.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.093+0000 7fc992f8c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc98c0ccab0 0x7fc98c0d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.093+0000 7fc992f8c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc98c0d0830 0x7fc98c0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.093+0000 7fc992f8c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98c0cdc30 con 0x7fc98c1539d0 2023-10-06T03:27:53.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.093+0000 7fc992f8c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c0cb500 con 0x7fc98c0ccab0 2023-10-06T03:27:53.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.093+0000 7fc992f8c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c0d0c50 con 0x7fc98c0d0830 2023-10-06T03:27:53.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.093+0000 7fc991789700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc98c0ccab0 0x7fc98c0d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.093+0000 7fc991f8a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc98c1539d0 0x7fc98c15a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38270/0 (socket says 172.21.15.84:38270) 2023-10-06T03:27:53.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.093+0000 7fc991f8a700 1 -- 172.21.15.84:0/1056685917 learned_addr learned my addr 172.21.15.84:0/1056685917 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:53.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.093+0000 7fc99278b700 1 --2- 172.21.15.84:0/1056685917 >> v2:172.21.15.131:3300/0 conn(0x7fc98c0d0830 0x7fc98c0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc991789700 1 -- 172.21.15.84:0/1056685917 >> v2:172.21.15.131:3300/0 conn(0x7fc98c0d0830 msgr2=0x7fc98c0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:53.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc991789700 1 --2- 172.21.15.84:0/1056685917 >> v2:172.21.15.131:3300/0 conn(0x7fc98c0d0830 0x7fc98c0ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc991789700 1 -- 172.21.15.84:0/1056685917 >> v1:172.21.15.84:6789/0 conn(0x7fc98c1539d0 legacy=0x7fc98c15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc991789700 1 -- 172.21.15.84:0/1056685917 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0cd020 con 0x7fc98c0ccab0 2023-10-06T03:27:53.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc990f88700 1 -- 172.21.15.84:0/1056685917 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761215202 0 0) 0x7fc98c0cdc30 con 0x7fc98c1539d0 2023-10-06T03:27:53.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc991789700 1 --2- 172.21.15.84:0/1056685917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c0ccab0 0x7fc98c0d02f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0cae90 tx=0x7fc97c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11834b0e3f5c714f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc990f88700 1 -- 172.21.15.84:0/1056685917 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00b6b0 con 0x7fc98c0ccab0 2023-10-06T03:27:53.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc990f88700 1 -- 172.21.15.84:0/1056685917 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c00b810 con 0x7fc98c0ccab0 2023-10-06T03:27:53.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc990f88700 1 -- 172.21.15.84:0/1056685917 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00bbb0 con 0x7fc98c0ccab0 2023-10-06T03:27:53.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc992f8c700 1 -- 172.21.15.84:0/1056685917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c0ccab0 msgr2=0x7fc98c0d02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc992f8c700 1 --2- 172.21.15.84:0/1056685917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c0ccab0 0x7fc98c0d02f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0cae90 tx=0x7fc97c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc992f8c700 1 -- 172.21.15.84:0/1056685917 shutdown_connections 2023-10-06T03:27:53.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc992f8c700 1 --2- 172.21.15.84:0/1056685917 >> v2:172.21.15.131:3300/0 conn(0x7fc98c0d0830 0x7fc98c0ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc992f8c700 1 --2- 172.21.15.84:0/1056685917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c0ccab0 0x7fc98c0d02f0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.094+0000 7fc992f8c700 1 -- 172.21.15.84:0/1056685917 >> 172.21.15.84:0/1056685917 conn(0x7fc98c068100 msgr2=0x7fc98c0684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:53.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.095+0000 7fc992f8c700 1 -- 172.21.15.84:0/1056685917 shutdown_connections 2023-10-06T03:27:53.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.095+0000 7fc992f8c700 1 -- 172.21.15.84:0/1056685917 wait complete. 2023-10-06T03:27:53.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc992f8c700 1 Processor -- start 2023-10-06T03:27:53.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc992f8c700 1 -- start start 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc992f8c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98c0ccab0 0x7fc98c0c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc992f8c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c0d0830 0x7fc98c0c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc992f8c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c1539d0 0x7fc98c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc992f8c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c16dba0 con 0x7fc98c0d0830 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc992f8c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c1519b0 con 0x7fc98c1539d0 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc992f8c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c16cf90 con 0x7fc98c0ccab0 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc991789700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c0d0830 0x7fc98c0c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc991789700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c0d0830 0x7fc98c0c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44456/0 (socket says 172.21.15.84:44456) 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.096+0000 7fc991789700 1 -- 172.21.15.84:0/1088609228 learned_addr learned my addr 172.21.15.84:0/1088609228 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc991f8a700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98c0ccab0 0x7fc98c0c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc99278b700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c1539d0 0x7fc98c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc991789700 1 -- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98c0ccab0 msgr2=0x7fc98c0c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc991789700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98c0ccab0 0x7fc98c0c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc991789700 1 -- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c1539d0 msgr2=0x7fc98c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc991789700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c1539d0 0x7fc98c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc991789700 1 -- 172.21.15.84:0/1088609228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c009420 con 0x7fc98c0d0830 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc991789700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c0d0830 0x7fc98c0c9d60 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0890f0 tx=0x7fc97c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc981ffb700 1 -- 172.21.15.84:0/1088609228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00bb90 con 0x7fc98c0d0830 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc981ffb700 1 -- 172.21.15.84:0/1088609228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c011420 con 0x7fc98c0d0830 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc981ffb700 1 -- 172.21.15.84:0/1088609228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c0117e0 con 0x7fc98c0d0830 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c16d270 con 0x7fc98c0d0830 2023-10-06T03:27:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.097+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c16d830 con 0x7fc98c0d0830 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.098+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc98c05f270 con 0x7fc98c0d0830 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.099+0000 7fc981ffb700 1 -- 172.21.15.84:0/1088609228 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc97c011bd0 con 0x7fc98c0d0830 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.099+0000 7fc981ffb700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc970066f30 0x7fc9700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.099+0000 7fc981ffb700 1 -- 172.21.15.84:0/1088609228 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fc97c086280 con 0x7fc98c0d0830 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.099+0000 7fc991f8a700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc970066f30 0x7fc9700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.099+0000 7fc981ffb700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] conn(0x7fc97006dac0 0x7fc97006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.099+0000 7fc981ffb700 1 -- 172.21.15.84:0/1088609228 --> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9700705c0 con 0x7fc97006dac0 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.099+0000 7fc981ffb700 1 -- 172.21.15.84:0/1088609228 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc97c086650 con 0x7fc98c0d0830 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.100+0000 7fc991f8a700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc970066f30 0x7fc9700693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc988007fd0 tx=0x7fc988007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.100+0000 7fc99278b700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] conn(0x7fc97006dac0 0x7fc97006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.100+0000 7fc99278b700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] conn(0x7fc97006dac0 0x7fc97006fef0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.101+0000 7fc981ffb700 1 -- 172.21.15.84:0/1088609228 <== osd.5 v2:172.21.15.131:6816/90846 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc9700705c0 con 0x7fc97006dac0 2023-10-06T03:27:53.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.114+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 --> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc98c0cd300 con 0x7fc97006dac0 2023-10-06T03:27:53.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.115+0000 7fc981ffb700 1 -- 172.21.15.84:0/1088609228 <== osd.5 v2:172.21.15.131:6816/90846 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc98c0cd300 con 0x7fc97006dac0 2023-10-06T03:27:53.117 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:53.117 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:27:53.117 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:53.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.115+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] conn(0x7fc97006dac0 msgr2=0x7fc97006fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.115+0000 7fc992f8c700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.131:6816/90846,v1:172.21.15.131:6817/90846] conn(0x7fc97006dac0 0x7fc97006fef0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.116+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc970066f30 msgr2=0x7fc9700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.116+0000 7fc992f8c700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fc970066f30 0x7fc9700693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc988007fd0 tx=0x7fc988007d30 comp rx=0 tx=0).stop 2023-10-06T03:27:53.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.116+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c0d0830 msgr2=0x7fc98c0c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.116+0000 7fc992f8c700 1 --2- 172.21.15.84:0/1088609228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c0d0830 0x7fc98c0c9d60 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0890f0 tx=0x7fc97c017000 comp rx=0 tx=0).stop 2023-10-06T03:27:53.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.116+0000 7fc99278b700 1 -- 172.21.15.84:0/1088609228 reap_dead start 2023-10-06T03:27:53.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.116+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 shutdown_connections 2023-10-06T03:27:53.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.116+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 >> 172.21.15.84:0/1088609228 conn(0x7fc98c068100 msgr2=0x7fc98c153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:53.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.116+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 shutdown_connections 2023-10-06T03:27:53.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.116+0000 7fc992f8c700 1 -- 172.21.15.84:0/1088609228 wait complete. 2023-10-06T03:27:53.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T03:27:53.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.242+0000 7f2603610700 1 Processor -- start 2023-10-06T03:27:53.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.242+0000 7f2603610700 1 -- start start 2023-10-06T03:27:53.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f2603610700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25fc068c20 0x7f25fc155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f2603610700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25fc0af150 con 0x7f25fc0ac480 2023-10-06T03:27:53.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f2603610700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25fc0ac910 con 0x7f25fc068850 2023-10-06T03:27:53.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f2603610700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc0acbf0 con 0x7f25fc068c20 2023-10-06T03:27:53.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f2600bab700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f25fc0ac480 0x7f25fc155640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38286/0 (socket says 172.21.15.84:38286) 2023-10-06T03:27:53.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f2600bab700 1 -- 172.21.15.84:0/3261501276 learned_addr learned my addr 172.21.15.84:0/3261501276 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:53.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f2601bad700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25fc068c20 0x7f25fc155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243694409 0 0) 0x7f25fc0af150 con 0x7f25fc0ac480 2023-10-06T03:27:53.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e8003570 con 0x7f25fc0ac480 2023-10-06T03:27:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 625462695 0 0) 0x7f25e8003570 con 0x7f25fc0ac480 2023-10-06T03:27:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25fc068c20 msgr2=0x7f25fc155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.243+0000 7f25f3fff700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25fc068c20 0x7f25fc155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 >> v1:172.21.15.131:6789/0 conn(0x7f25fc068850 legacy=0x7f25fc0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc0aced0 con 0x7f25fc0ac480 2023-10-06T03:27:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f25ec001470 con 0x7f25fc0ac480 2023-10-06T03:27:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 >> v1:172.21.15.84:6789/0 conn(0x7f25fc0ac480 legacy=0x7f25fc155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25e8003a90 0x7f25e8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25fc068c20 0x7f25e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25e8004d50 0x7f25e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc0acbf0 con 0x7f25e8003a90 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e800bb70 con 0x7f25e8004d50 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e800bd30 con 0x7f25fc068c20 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f26013ac700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25e8003a90 0x7f25e8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f2600bab700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25fc068c20 0x7f25e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f2601bad700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25e8004d50 0x7f25e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f26013ac700 1 -- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25fc068c20 msgr2=0x7f25e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f26013ac700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25fc068c20 0x7f25e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f26013ac700 1 -- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25e8004d50 msgr2=0x7f25e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f26013ac700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25e8004d50 0x7f25e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f26013ac700 1 -- 172.21.15.84:0/3261501276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e8003570 con 0x7f25e8003a90 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f2601bad700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25e8004d50 0x7f25e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f2600bab700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25fc068c20 0x7f25e8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f26013ac700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25e8003a90 0x7f25e8003ea0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c2d0 tx=0x7f25f8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efaae96bbd02b44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8001d80 con 0x7f25e8003a90 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f800cba0 con 0x7f25e8003a90 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.244+0000 7f25f3fff700 1 -- 172.21.15.84:0/3261501276 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8012400 con 0x7f25e8003a90 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.245+0000 7f2603610700 1 -- 172.21.15.84:0/3261501276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25e8003a90 msgr2=0x7f25e8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.245+0000 7f2603610700 1 --2- 172.21.15.84:0/3261501276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25e8003a90 0x7f25e8003ea0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c2d0 tx=0x7f25f8001a70 comp rx=0 tx=0).stop 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.245+0000 7f2601bad700 1 -- 172.21.15.84:0/3261501276 reap_dead start 2023-10-06T03:27:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.245+0000 7f2603610700 1 -- 172.21.15.84:0/3261501276 shutdown_connections 2023-10-06T03:27:53.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.245+0000 7f2603610700 1 -- 172.21.15.84:0/3261501276 >> 172.21.15.84:0/3261501276 conn(0x7f25fc06de80 msgr2=0x7f25fc06e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:53.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.245+0000 7f2603610700 1 -- 172.21.15.84:0/3261501276 shutdown_connections 2023-10-06T03:27:53.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.245+0000 7f2603610700 1 -- 172.21.15.84:0/3261501276 wait complete. 2023-10-06T03:27:53.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.246+0000 7f2603610700 1 Processor -- start 2023-10-06T03:27:53.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.246+0000 7f2603610700 1 -- start start 2023-10-06T03:27:53.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2603610700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25e8003a90 0x7f25fc1660f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2603610700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25fc168da0 0x7f25fc0a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2603610700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25fc169210 0x7f25fc0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2603610700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc150b60 con 0x7f25fc168da0 2023-10-06T03:27:53.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2603610700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc0a54d0 con 0x7f25fc169210 2023-10-06T03:27:53.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2603610700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc0a57b0 con 0x7f25e8003a90 2023-10-06T03:27:53.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2600bab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25fc168da0 0x7f25fc0a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2600bab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25fc168da0 0x7f25fc0a7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44486/0 (socket says 172.21.15.84:44486) 2023-10-06T03:27:53.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2600bab700 1 -- 172.21.15.84:0/862873620 learned_addr learned my addr 172.21.15.84:0/862873620 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:53.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f26013ac700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25e8003a90 0x7f25fc1660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2601bad700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25fc169210 0x7f25fc0a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2600bab700 1 -- 172.21.15.84:0/862873620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25e8003a90 msgr2=0x7f25fc1660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2600bab700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25e8003a90 0x7f25fc1660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2600bab700 1 -- 172.21.15.84:0/862873620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25fc169210 msgr2=0x7f25fc0a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2600bab700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25fc169210 0x7f25fc0a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2600bab700 1 -- 172.21.15.84:0/862873620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc0a5a90 con 0x7f25fc168da0 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2601bad700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25fc169210 0x7f25fc0a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f2600bab700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25fc168da0 0x7f25fc0a7ca0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00ebc0 tx=0x7f25ec0014c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f25f17fa700 1 -- 172.21.15.84:0/862873620 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00c760 con 0x7f25fc168da0 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.247+0000 7f25f17fa700 1 -- 172.21.15.84:0/862873620 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec00c8c0 con 0x7f25fc168da0 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.248+0000 7f25f17fa700 1 -- 172.21.15.84:0/862873620 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00cc40 con 0x7f25fc168da0 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.248+0000 7f2603610700 1 -- 172.21.15.84:0/862873620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25fc0a5d70 con 0x7f25fc168da0 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.248+0000 7f2603610700 1 -- 172.21.15.84:0/862873620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25fc150040 con 0x7f25fc168da0 2023-10-06T03:27:53.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.249+0000 7f2603610700 1 -- 172.21.15.84:0/862873620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25fc0a5fb0 con 0x7f25fc168da0 2023-10-06T03:27:53.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.249+0000 7f25f17fa700 1 -- 172.21.15.84:0/862873620 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25ec01d460 con 0x7f25fc168da0 2023-10-06T03:27:53.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.249+0000 7f25f17fa700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f25e006b340 0x7f25e006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.249+0000 7f25f17fa700 1 -- 172.21.15.84:0/862873620 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f25ec0847d0 con 0x7f25fc168da0 2023-10-06T03:27:53.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.249+0000 7f26013ac700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f25e006b340 0x7f25e006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.250+0000 7f26013ac700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f25e006b340 0x7f25e006d7f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f25f80013e0 tx=0x7f25f8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.254+0000 7f25f17fa700 1 -- 172.21.15.84:0/862873620 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25fc0a5fb0 con 0x7f25fc168da0 2023-10-06T03:27:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.437+0000 7f2603610700 1 -- 172.21.15.84:0/862873620 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f25fc0a5640 con 0x7f25e006b340 2023-10-06T03:27:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.438+0000 7f25f17fa700 1 -- 172.21.15.84:0/862873620 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f25fc0a5640 con 0x7f25e006b340 2023-10-06T03:27:53.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.439+0000 7f2603610700 1 -- 172.21.15.84:0/862873620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f25e006b340 msgr2=0x7f25e006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.439+0000 7f2603610700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f25e006b340 0x7f25e006d7f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f25f80013e0 tx=0x7f25f8016000 comp rx=0 tx=0).stop 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.439+0000 7f2603610700 1 -- 172.21.15.84:0/862873620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25fc168da0 msgr2=0x7f25fc0a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.439+0000 7f2603610700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25fc168da0 0x7f25fc0a7ca0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00ebc0 tx=0x7f25ec0014c0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.440+0000 7f2603610700 1 -- 172.21.15.84:0/862873620 shutdown_connections 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.440+0000 7f2603610700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f25e006b340 0x7f25e006d7f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.440+0000 7f2603610700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25fc169210 0x7f25fc0a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.440+0000 7f2603610700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25e8003a90 0x7f25fc1660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.440+0000 7f2603610700 1 --2- 172.21.15.84:0/862873620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25fc168da0 0x7f25fc0a7ca0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.440+0000 7f2603610700 1 -- 172.21.15.84:0/862873620 >> 172.21.15.84:0/862873620 conn(0x7f25fc06de80 msgr2=0x7f25fc0cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.440+0000 7f2603610700 1 -- 172.21.15.84:0/862873620 shutdown_connections 2023-10-06T03:27:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.440+0000 7f2603610700 1 -- 172.21.15.84:0/862873620 wait complete. 2023-10-06T03:27:53.443 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T03:27:53.453 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T03:27:53.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:27:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.569+0000 7f84b2bc8700 1 Processor -- start 2023-10-06T03:27:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.569+0000 7f84b2bc8700 1 -- start start 2023-10-06T03:27:53.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.570+0000 7f84b2bc8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0b23a0 0x7f84ac0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.570+0000 7f84b2bc8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac0b2810 con 0x7f84ac06ed20 2023-10-06T03:27:53.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.570+0000 7f84b2bc8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac0b2d20 con 0x7f84ac0aee20 2023-10-06T03:27:53.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.570+0000 7f84b2bc8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac06fb80 con 0x7f84ac0b23a0 2023-10-06T03:27:53.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.570+0000 7f84b0964700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f84ac06ed20 0x7f84ac06f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38288/0 (socket says 172.21.15.84:38288) 2023-10-06T03:27:53.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.570+0000 7f84b0964700 1 -- 172.21.15.84:0/1920436232 learned_addr learned my addr 172.21.15.84:0/1920436232 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:53.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.570+0000 7f84a3fff700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0b23a0 0x7f84ac0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.570+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266273444 0 0) 0x7f84ac0b2810 con 0x7f84ac06ed20 2023-10-06T03:27:53.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.570+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8494003570 con 0x7f84ac06ed20 2023-10-06T03:27:53.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 407393414 0 0) 0x7f8494003570 con 0x7f84ac06ed20 2023-10-06T03:27:53.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0b23a0 msgr2=0x7f84ac0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:53.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0b23a0 0x7f84ac0b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 >> v1:172.21.15.131:6789/0 conn(0x7f84ac0aee20 legacy=0x7f84ac0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac0b0450 con 0x7f84ac06ed20 2023-10-06T03:27:53.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f84a8001470 con 0x7f84ac06ed20 2023-10-06T03:27:53.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 >> v1:172.21.15.84:6789/0 conn(0x7f84ac06ed20 legacy=0x7f84ac06f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8494003a90 0x7f8494003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0b23a0 0x7f8494004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494004d50 0x7f84940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849400bb70 con 0x7f8494003a90 2023-10-06T03:27:53.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849400bce0 con 0x7f8494004d50 2023-10-06T03:27:53.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849400bea0 con 0x7f84ac0b23a0 2023-10-06T03:27:53.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84b0964700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8494003a90 0x7f8494003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a3fff700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0b23a0 0x7f8494004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84b1165700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494004d50 0x7f84940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84b0964700 1 -- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0b23a0 msgr2=0x7f8494004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:53.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84b0964700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0b23a0 0x7f8494004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84b0964700 1 -- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494004d50 msgr2=0x7f84940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:53.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84b0964700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494004d50 0x7f84940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84b0964700 1 -- 172.21.15.84:0/1920436232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494003570 con 0x7f8494003a90 2023-10-06T03:27:53.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84b0964700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8494003a90 0x7f8494003ea0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f84a800c3c0 tx=0x7f84a8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c543540c79a13b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a800cc90 con 0x7f8494003a90 2023-10-06T03:27:53.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a800cdf0 con 0x7f8494003a90 2023-10-06T03:27:53.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.571+0000 7f84a37fe700 1 -- 172.21.15.84:0/1920436232 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8005b50 con 0x7f8494003a90 2023-10-06T03:27:53.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.572+0000 7f84b2bc8700 1 -- 172.21.15.84:0/1920436232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8494003a90 msgr2=0x7f8494003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.572+0000 7f84b2bc8700 1 --2- 172.21.15.84:0/1920436232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8494003a90 0x7f8494003ea0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f84a800c3c0 tx=0x7f84a8001e50 comp rx=0 tx=0).stop 2023-10-06T03:27:53.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.572+0000 7f84b1165700 1 -- 172.21.15.84:0/1920436232 reap_dead start 2023-10-06T03:27:53.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.572+0000 7f84b2bc8700 1 -- 172.21.15.84:0/1920436232 shutdown_connections 2023-10-06T03:27:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.572+0000 7f84b2bc8700 1 -- 172.21.15.84:0/1920436232 >> 172.21.15.84:0/1920436232 conn(0x7f84ac068330 msgr2=0x7f84ac068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.572+0000 7f84b2bc8700 1 -- 172.21.15.84:0/1920436232 shutdown_connections 2023-10-06T03:27:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.572+0000 7f84b2bc8700 1 -- 172.21.15.84:0/1920436232 wait complete. 2023-10-06T03:27:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.573+0000 7f84b2bc8700 1 Processor -- start 2023-10-06T03:27:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.573+0000 7f84b2bc8700 1 -- start start 2023-10-06T03:27:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b2bc8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494003a90 0x7f84ac0c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b2bc8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0ae4e0 0x7f84ac1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b2bc8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84ac16ab50 0x7f84ac0ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b2bc8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac16a6c0 con 0x7f84ac16ab50 2023-10-06T03:27:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b2bc8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac0aec50 con 0x7f8494003a90 2023-10-06T03:27:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b2bc8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac156ce0 con 0x7f84ac0ae4e0 2023-10-06T03:27:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b1165700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84ac16ab50 0x7f84ac0ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b1165700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84ac16ab50 0x7f84ac0ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44508/0 (socket says 172.21.15.84:44508) 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b1165700 1 -- 172.21.15.84:0/551690847 learned_addr learned my addr 172.21.15.84:0/551690847 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b0964700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494003a90 0x7f84ac0c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84a3fff700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0ae4e0 0x7f84ac1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b1165700 1 -- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0ae4e0 msgr2=0x7f84ac1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b1165700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac0ae4e0 0x7f84ac1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b1165700 1 -- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494003a90 msgr2=0x7f84ac0c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b1165700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494003a90 0x7f84ac0c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b1165700 1 -- 172.21.15.84:0/551690847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac0ae970 con 0x7f84ac16ab50 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84b1165700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84ac16ab50 0x7f84ac0ce000 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0cdfb0 tx=0x7f84a4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.574+0000 7f84a0ff9700 1 -- 172.21.15.84:0/551690847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a40032e0 con 0x7f84ac16ab50 2023-10-06T03:27:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.575+0000 7f84a0ff9700 1 -- 172.21.15.84:0/551690847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4003440 con 0x7f84ac16ab50 2023-10-06T03:27:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.575+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac16a070 con 0x7f84ac16ab50 2023-10-06T03:27:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.575+0000 7f84a0ff9700 1 -- 172.21.15.84:0/551690847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a40017d0 con 0x7f84ac16ab50 2023-10-06T03:27:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.575+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac0cf370 con 0x7f84ac16ab50 2023-10-06T03:27:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.575+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84ac169ef0 con 0x7f84ac16ab50 2023-10-06T03:27:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.576+0000 7f84a0ff9700 1 -- 172.21.15.84:0/551690847 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84a4001c00 con 0x7f84ac16ab50 2023-10-06T03:27:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.576+0000 7f84a0ff9700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8498066f30 0x7f84980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.576+0000 7f84a0ff9700 1 -- 172.21.15.84:0/551690847 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f84a4083f70 con 0x7f84ac16ab50 2023-10-06T03:27:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.576+0000 7f84b0964700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8498066f30 0x7f84980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.576+0000 7f84a0ff9700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] conn(0x7f849806dac0 0x7f849806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.576+0000 7f84a0ff9700 1 -- 172.21.15.84:0/551690847 --> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84980705c0 con 0x7f849806dac0 2023-10-06T03:27:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.576+0000 7f84a0ff9700 1 -- 172.21.15.84:0/551690847 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84a40864d0 con 0x7f84ac16ab50 2023-10-06T03:27:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.577+0000 7f84b0964700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8498066f30 0x7f84980693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f84a8007cd0 tx=0x7f84a8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.577+0000 7f84a3fff700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] conn(0x7f849806dac0 0x7f849806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.577+0000 7f84a3fff700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] conn(0x7f849806dac0 0x7f849806fef0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.578+0000 7f84a0ff9700 1 -- 172.21.15.84:0/551690847 <== osd.6 v2:172.21.15.131:6808/90817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f84980705c0 con 0x7f849806dac0 2023-10-06T03:27:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.591+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 --> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84ac16a510 con 0x7f849806dac0 2023-10-06T03:27:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.591+0000 7f84a0ff9700 1 -- 172.21.15.84:0/551690847 <== osd.6 v2:172.21.15.131:6808/90817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f84ac16a510 con 0x7f849806dac0 2023-10-06T03:27:53.593 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:53.593 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:27:53.594 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] conn(0x7f849806dac0 msgr2=0x7f849806fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b2bc8700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.131:6808/90817,v1:172.21.15.131:6809/90817] conn(0x7f849806dac0 0x7f849806fef0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8498066f30 msgr2=0x7f84980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b2bc8700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f8498066f30 0x7f84980693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f84a8007cd0 tx=0x7f84a8015000 comp rx=0 tx=0).stop 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84ac16ab50 msgr2=0x7f84ac0ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b2bc8700 1 --2- 172.21.15.84:0/551690847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84ac16ab50 0x7f84ac0ce000 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0cdfb0 tx=0x7f84a4009040 comp rx=0 tx=0).stop 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b1165700 1 -- 172.21.15.84:0/551690847 reap_dead start 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 shutdown_connections 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 >> 172.21.15.84:0/551690847 conn(0x7f84ac068330 msgr2=0x7f84ac158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 shutdown_connections 2023-10-06T03:27:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.592+0000 7f84b2bc8700 1 -- 172.21.15.84:0/551690847 wait complete. 2023-10-06T03:27:53.605 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T03:27:53.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.717+0000 7f2dde69b700 1 Processor -- start 2023-10-06T03:27:53.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.718+0000 7f2dde69b700 1 -- start start 2023-10-06T03:27:53.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.718+0000 7f2dde69b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2dd806f2b0 0x7f2dd80adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.718+0000 7f2dde69b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd806e710 con 0x7f2dd8069af0 2023-10-06T03:27:53.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.718+0000 7f2dde69b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd806db00 con 0x7f2dd8069720 2023-10-06T03:27:53.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.718+0000 7f2dde69b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd80cd040 con 0x7f2dd806f2b0 2023-10-06T03:27:53.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.718+0000 7f2ddcc38700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2dd806f2b0 0x7f2dd80adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.718+0000 7f2dd77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2dd8069af0 0x7f2dd806eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38290/0 (socket says 172.21.15.84:38290) 2023-10-06T03:27:53.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.718+0000 7f2dd77fe700 1 -- 172.21.15.84:0/146694205 learned_addr learned my addr 172.21.15.84:0/146694205 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:53.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.719+0000 7f2ddcc38700 1 -- 172.21.15.84:0/146694205 >> v1:172.21.15.131:6789/0 conn(0x7f2dd8069720 legacy=0x7f2dd80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:53.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.719+0000 7f2ddcc38700 1 -- 172.21.15.84:0/146694205 >> v1:172.21.15.84:6789/0 conn(0x7f2dd8069af0 legacy=0x7f2dd806eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.719+0000 7f2ddcc38700 1 -- 172.21.15.84:0/146694205 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd806dde0 con 0x7f2dd806f2b0 2023-10-06T03:27:53.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.719+0000 7f2dd6ffd700 1 -- 172.21.15.84:0/146694205 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521471636 0 0) 0x7f2dd806e710 con 0x7f2dd8069af0 2023-10-06T03:27:53.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.719+0000 7f2ddcc38700 1 --2- 172.21.15.84:0/146694205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 0x7f2dd80adaa0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009e60 tx=0x7f2dd0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cd76e75b3d3edf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.719+0000 7f2dd6ffd700 1 -- 172.21.15.84:0/146694205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000e070 con 0x7f2dd806f2b0 2023-10-06T03:27:53.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.719+0000 7f2dd6ffd700 1 -- 172.21.15.84:0/146694205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd000bbf0 con 0x7f2dd806f2b0 2023-10-06T03:27:53.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.719+0000 7f2dd6ffd700 1 -- 172.21.15.84:0/146694205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0012430 con 0x7f2dd806f2b0 2023-10-06T03:27:53.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.719+0000 7f2dde69b700 1 -- 172.21.15.84:0/146694205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 msgr2=0x7f2dd80adaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.719+0000 7f2dde69b700 1 --2- 172.21.15.84:0/146694205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 0x7f2dd80adaa0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009e60 tx=0x7f2dd0009780 comp rx=0 tx=0).stop 2023-10-06T03:27:53.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.720+0000 7f2dde69b700 1 -- 172.21.15.84:0/146694205 shutdown_connections 2023-10-06T03:27:53.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.720+0000 7f2dde69b700 1 --2- 172.21.15.84:0/146694205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 0x7f2dd80adaa0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.720+0000 7f2dde69b700 1 -- 172.21.15.84:0/146694205 >> 172.21.15.84:0/146694205 conn(0x7f2dd80680c0 msgr2=0x7f2dd80cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:53.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.720+0000 7f2dde69b700 1 -- 172.21.15.84:0/146694205 shutdown_connections 2023-10-06T03:27:53.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.720+0000 7f2dde69b700 1 -- 172.21.15.84:0/146694205 wait complete. 2023-10-06T03:27:53.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.721+0000 7f2dde69b700 1 Processor -- start 2023-10-06T03:27:53.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.721+0000 7f2dde69b700 1 -- start start 2023-10-06T03:27:53.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dde69b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dd8069720 0x7f2dd814c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dde69b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2dd8069af0 0x7f2dd8167c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dde69b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 0x7f2dd80c2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dde69b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80c0910 con 0x7f2dd806f2b0 2023-10-06T03:27:53.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dde69b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80bfd40 con 0x7f2dd8069720 2023-10-06T03:27:53.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dde69b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80bffe0 con 0x7f2dd8069af0 2023-10-06T03:27:53.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2ddcc38700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 0x7f2dd80c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2ddcc38700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 0x7f2dd80c2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44520/0 (socket says 172.21.15.84:44520) 2023-10-06T03:27:53.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2ddcc38700 1 -- 172.21.15.84:0/547914659 learned_addr learned my addr 172.21.15.84:0/547914659 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:53.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dd77fe700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2dd8069af0 0x7f2dd8167c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dd7fff700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dd8069720 0x7f2dd814c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2ddcc38700 1 -- 172.21.15.84:0/547914659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2dd8069af0 msgr2=0x7f2dd8167c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2ddcc38700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2dd8069af0 0x7f2dd8167c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2ddcc38700 1 -- 172.21.15.84:0/547914659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dd8069720 msgr2=0x7f2dd814c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2ddcc38700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dd8069720 0x7f2dd814c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2ddcc38700 1 -- 172.21.15.84:0/547914659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0009a20 con 0x7f2dd806f2b0 2023-10-06T03:27:53.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dd77fe700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2dd8069af0 0x7f2dd8167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:53.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2ddcc38700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 0x7f2dd80c2160 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f2dd806fdb0 tx=0x7f2dd0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dbffff700 1 -- 172.21.15.84:0/547914659 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd001e710 con 0x7f2dd806f2b0 2023-10-06T03:27:53.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dbffff700 1 -- 172.21.15.84:0/547914659 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd001e870 con 0x7f2dd806f2b0 2023-10-06T03:27:53.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dde69b700 1 -- 172.21.15.84:0/547914659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd80c02c0 con 0x7f2dd806f2b0 2023-10-06T03:27:53.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dbffff700 1 -- 172.21.15.84:0/547914659 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd001ec30 con 0x7f2dd806f2b0 2023-10-06T03:27:53.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.722+0000 7f2dde69b700 1 -- 172.21.15.84:0/547914659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd814ca90 con 0x7f2dd806f2b0 2023-10-06T03:27:53.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.723+0000 7f2dde69b700 1 -- 172.21.15.84:0/547914659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd80c0a80 con 0x7f2dd806f2b0 2023-10-06T03:27:53.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.724+0000 7f2dbffff700 1 -- 172.21.15.84:0/547914659 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2dd0024070 con 0x7f2dd806f2b0 2023-10-06T03:27:53.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.724+0000 7f2dbffff700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2dc4066f30 0x7f2dc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:53.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.724+0000 7f2dbffff700 1 -- 172.21.15.84:0/547914659 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f2dd0087080 con 0x7f2dd806f2b0 2023-10-06T03:27:53.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.724+0000 7f2dd7fff700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2dc4066f30 0x7f2dc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:53.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.724+0000 7f2dd7fff700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2dc4066f30 0x7f2dc40693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8006fd0 tx=0x7f2dc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:53.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.728+0000 7f2dbffff700 1 -- 172.21.15.84:0/547914659 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2dd0054250 con 0x7f2dd806f2b0 2023-10-06T03:27:53.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.913+0000 7f2dde69b700 1 -- 172.21.15.84:0/547914659 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dd8064ad0 con 0x7f2dc4066f30 2023-10-06T03:27:53.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.913+0000 7f2dbffff700 1 -- 172.21.15.84:0/547914659 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2dd8064ad0 con 0x7f2dc4066f30 2023-10-06T03:27:53.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 -- 172.21.15.84:0/547914659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2dc4066f30 msgr2=0x7f2dc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2dc4066f30 0x7f2dc40693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8006fd0 tx=0x7f2dc8008040 comp rx=0 tx=0).stop 2023-10-06T03:27:53.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 -- 172.21.15.84:0/547914659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 msgr2=0x7f2dd80c2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:53.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 0x7f2dd80c2160 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f2dd806fdb0 tx=0x7f2dd0018000 comp rx=0 tx=0).stop 2023-10-06T03:27:53.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 -- 172.21.15.84:0/547914659 shutdown_connections 2023-10-06T03:27:53.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2dc4066f30 0x7f2dc40693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dd8069720 0x7f2dd814c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dd806f2b0 0x7f2dd80c2160 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 --2- 172.21.15.84:0/547914659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2dd8069af0 0x7f2dd8167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:53.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 -- 172.21.15.84:0/547914659 >> 172.21.15.84:0/547914659 conn(0x7f2dd80680c0 msgr2=0x7f2dd80c4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:53.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 -- 172.21.15.84:0/547914659 shutdown_connections 2023-10-06T03:27:53.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:53.915+0000 7f2dde69b700 1 -- 172.21.15.84:0/547914659 wait complete. 2023-10-06T03:27:53.918 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T03:27:53.929 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T03:27:53.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:27:54.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.047+0000 7fe0e6f26700 1 Processor -- start 2023-10-06T03:27:54.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.047+0000 7fe0e6f26700 1 -- start start 2023-10-06T03:27:54.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6f26700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0e00ccab0 0x7fe0e00d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6f26700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe0e00d0830 0x7fe0e00ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6f26700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e00cdc30 con 0x7fe0e01539d0 2023-10-06T03:27:54.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6f26700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e00d0cb0 con 0x7fe0e00d0830 2023-10-06T03:27:54.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6f26700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e00cb500 con 0x7fe0e00ccab0 2023-10-06T03:27:54.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e5f24700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe0e01539d0 0x7fe0e015a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38306/0 (socket says 172.21.15.84:38306) 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e5f24700 1 -- 172.21.15.84:0/616567396 learned_addr learned my addr 172.21.15.84:0/616567396 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6725700 1 --2- 172.21.15.84:0/616567396 >> v2:172.21.15.84:3300/0 conn(0x7fe0e00d0830 0x7fe0e00ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e5723700 1 --2- 172.21.15.84:0/616567396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0e00ccab0 0x7fe0e00d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6725700 1 -- 172.21.15.84:0/616567396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0e00ccab0 msgr2=0x7fe0e00d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6725700 1 --2- 172.21.15.84:0/616567396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0e00ccab0 0x7fe0e00d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6725700 1 -- 172.21.15.84:0/616567396 >> v1:172.21.15.84:6789/0 conn(0x7fe0e01539d0 legacy=0x7fe0e015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e4f22700 1 -- 172.21.15.84:0/616567396 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954395593 0 0) 0x7fe0e00cdc30 con 0x7fe0e01539d0 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6725700 1 -- 172.21.15.84:0/616567396 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e00cd020 con 0x7fe0e00d0830 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.048+0000 7fe0e6725700 1 --2- 172.21.15.84:0/616567396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00d0830 0x7fe0e00ce8a0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009e60 tx=0x7fe0d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df11094532aeb3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e4f22700 1 -- 172.21.15.84:0/616567396 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800e070 con 0x7fe0e00d0830 2023-10-06T03:27:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e4f22700 1 -- 172.21.15.84:0/616567396 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d800bc30 con 0x7fe0e00d0830 2023-10-06T03:27:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e4f22700 1 -- 172.21.15.84:0/616567396 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8012430 con 0x7fe0e00d0830 2023-10-06T03:27:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e6f26700 1 -- 172.21.15.84:0/616567396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00d0830 msgr2=0x7fe0e00ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e6f26700 1 --2- 172.21.15.84:0/616567396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00d0830 0x7fe0e00ce8a0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009e60 tx=0x7fe0d8009780 comp rx=0 tx=0).stop 2023-10-06T03:27:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e6f26700 1 -- 172.21.15.84:0/616567396 shutdown_connections 2023-10-06T03:27:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e6f26700 1 --2- 172.21.15.84:0/616567396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00d0830 0x7fe0e00ce8a0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e6f26700 1 --2- 172.21.15.84:0/616567396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0e00ccab0 0x7fe0e00d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e6f26700 1 -- 172.21.15.84:0/616567396 >> 172.21.15.84:0/616567396 conn(0x7fe0e0068100 msgr2=0x7fe0e00684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e6f26700 1 -- 172.21.15.84:0/616567396 shutdown_connections 2023-10-06T03:27:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.049+0000 7fe0e6f26700 1 -- 172.21.15.84:0/616567396 wait complete. 2023-10-06T03:27:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.050+0000 7fe0e6f26700 1 Processor -- start 2023-10-06T03:27:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.050+0000 7fe0e6f26700 1 -- start start 2023-10-06T03:27:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6f26700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0e00ccab0 0x7fe0e0150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6f26700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e00d0830 0x7fe0e0169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6f26700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e01539d0 0x7fe0e00b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6f26700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e00b5020 con 0x7fe0e01539d0 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6f26700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e016a410 con 0x7fe0e00d0830 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6f26700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e00b16c0 con 0x7fe0e00ccab0 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6725700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e01539d0 0x7fe0e00b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6725700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e01539d0 0x7fe0e00b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44544/0 (socket says 172.21.15.84:44544) 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6725700 1 -- 172.21.15.84:0/2906574934 learned_addr learned my addr 172.21.15.84:0/2906574934 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e5f24700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0e00ccab0 0x7fe0e0150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e5723700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e00d0830 0x7fe0e0169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6725700 1 -- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0e00ccab0 msgr2=0x7fe0e0150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6725700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0e00ccab0 0x7fe0e0150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6725700 1 -- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e00d0830 msgr2=0x7fe0e0169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6725700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e00d0830 0x7fe0e0169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e6725700 1 -- 172.21.15.84:0/2906574934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8009a20 con 0x7fe0e01539d0 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.051+0000 7fe0e5f24700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0e00ccab0 0x7fe0e0150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.052+0000 7fe0e6725700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e01539d0 0x7fe0e00b18e0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00890f0 tx=0x7fe0d8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.052+0000 7fe0d5ffb700 1 -- 172.21.15.84:0/2906574934 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d801d630 con 0x7fe0e01539d0 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.052+0000 7fe0d5ffb700 1 -- 172.21.15.84:0/2906574934 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d801d7b0 con 0x7fe0e01539d0 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.052+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e00c5670 con 0x7fe0e01539d0 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.052+0000 7fe0d5ffb700 1 -- 172.21.15.84:0/2906574934 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d801db70 con 0x7fe0e01539d0 2023-10-06T03:27:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.052+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e00c5910 con 0x7fe0e01539d0 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.053+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0e015b360 con 0x7fe0e01539d0 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.053+0000 7fe0d5ffb700 1 -- 172.21.15.84:0/2906574934 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0d8024070 con 0x7fe0e01539d0 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.054+0000 7fe0d5ffb700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe0c4066f60 0x7fe0c4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.054+0000 7fe0d5ffb700 1 -- 172.21.15.84:0/2906574934 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fe0d8086e70 con 0x7fe0e01539d0 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.054+0000 7fe0e5f24700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe0c4066f60 0x7fe0c4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.054+0000 7fe0d5ffb700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] conn(0x7fe0c406daf0 0x7fe0c406ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.054+0000 7fe0d5ffb700 1 -- 172.21.15.84:0/2906574934 --> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0c40705f0 con 0x7fe0c406daf0 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.054+0000 7fe0d5ffb700 1 -- 172.21.15.84:0/2906574934 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0d8089450 con 0x7fe0e01539d0 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.054+0000 7fe0e5f24700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe0c4066f60 0x7fe0c4069410 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc001890 tx=0x7fe0dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.054+0000 7fe0e5723700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] conn(0x7fe0c406daf0 0x7fe0c406ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.055+0000 7fe0e5723700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] conn(0x7fe0c406daf0 0x7fe0c406ff20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:54.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.055+0000 7fe0d5ffb700 1 -- 172.21.15.84:0/2906574934 <== osd.7 v2:172.21.15.131:6824/90847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe0c40705f0 con 0x7fe0c406daf0 2023-10-06T03:27:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.069+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 --> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe0e005f270 con 0x7fe0c406daf0 2023-10-06T03:27:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.070+0000 7fe0d5ffb700 1 -- 172.21.15.84:0/2906574934 <== osd.7 v2:172.21.15.131:6824/90847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe0e005f270 con 0x7fe0c406daf0 2023-10-06T03:27:54.072 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:27:54.072 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:27:54.072 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:27:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.070+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] conn(0x7fe0c406daf0 msgr2=0x7fe0c406ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.070+0000 7fe0e6f26700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.131:6824/90847,v1:172.21.15.131:6825/90847] conn(0x7fe0c406daf0 0x7fe0c406ff20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.070+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe0c4066f60 msgr2=0x7fe0c4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.070+0000 7fe0e6f26700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fe0c4066f60 0x7fe0c4069410 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc001890 tx=0x7fe0dc009040 comp rx=0 tx=0).stop 2023-10-06T03:27:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.070+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e01539d0 msgr2=0x7fe0e00b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.070+0000 7fe0e6f26700 1 --2- 172.21.15.84:0/2906574934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e01539d0 0x7fe0e00b18e0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00890f0 tx=0x7fe0d8019000 comp rx=0 tx=0).stop 2023-10-06T03:27:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.071+0000 7fe0e6725700 1 -- 172.21.15.84:0/2906574934 reap_dead start 2023-10-06T03:27:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.071+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 shutdown_connections 2023-10-06T03:27:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.071+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 >> 172.21.15.84:0/2906574934 conn(0x7fe0e0068100 msgr2=0x7fe0e0152f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.071+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 shutdown_connections 2023-10-06T03:27:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.071+0000 7fe0e6f26700 1 -- 172.21.15.84:0/2906574934 wait complete. 2023-10-06T03:27:54.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T03:27:54.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.198+0000 7f5e0cee4700 1 Processor -- start 2023-10-06T03:27:54.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.198+0000 7f5e0cee4700 1 -- start start 2023-10-06T03:27:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e0cee4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5e08068d10 0x7f5e0815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e0cee4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e08156690 0x7f5e080abb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e0cee4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e080c9740 con 0x7f5e081562c0 2023-10-06T03:27:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e0cee4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0815b040 con 0x7f5e08068d10 2023-10-06T03:27:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e0cee4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080ad850 con 0x7f5e08156690 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e0659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5e081562c0 0x7f5e08068600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38316/0 (socket says 172.21.15.84:38316) 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e0659c700 1 -- 172.21.15.84:0/4020911420 learned_addr learned my addr 172.21.15.84:0/4020911420 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784748481 0 0) 0x7f5e080c9740 con 0x7f5e081562c0 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e08156690 0x7f5e080abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5dfffff700 1 --2- 172.21.15.84:0/4020911420 >> v2:172.21.15.131:3300/0 conn(0x7f5e08068d10 0x7f5e0815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df4003570 con 0x7f5e081562c0 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3359346526 0 0) 0x7f5df4003570 con 0x7f5e081562c0 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e08156690 msgr2=0x7f5e080abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e05d9b700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e08156690 0x7f5e080abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 >> v2:172.21.15.131:3300/0 conn(0x7f5e08068d10 msgr2=0x7f5e0815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e05d9b700 1 --2- 172.21.15.84:0/4020911420 >> v2:172.21.15.131:3300/0 conn(0x7f5e08068d10 0x7f5e0815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0815a7a0 con 0x7f5e081562c0 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.199+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1275032339 0 0) 0x7f5df80015f0 con 0x7f5e081562c0 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5dfffff700 1 --2- 172.21.15.84:0/4020911420 >> v2:172.21.15.131:3300/0 conn(0x7f5e08068d10 0x7f5e0815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 >> v1:172.21.15.84:6789/0 conn(0x7f5e081562c0 legacy=0x7f5e08068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e05d9b700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5df4003a60 0x7f5df4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e05d9b700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e08156690 0x7f5df4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e05d9b700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df4004d50 0x7f5df40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0815b040 con 0x7f5df4004d50 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080ad850 con 0x7f5df4003a60 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df4009ad0 con 0x7f5e08156690 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df4004d50 0x7f5df40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e0659c700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5df4003a60 0x7f5df4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5dfffff700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e08156690 0x7f5df4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e06d9d700 1 -- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e08156690 msgr2=0x7f5df4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e08156690 0x7f5df4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e06d9d700 1 -- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5df4003a60 msgr2=0x7f5df4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5df4003a60 0x7f5df4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e06d9d700 1 -- 172.21.15.84:0/4020911420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4003570 con 0x7f5df4004d50 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df4004d50 0x7f5df40051c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000e210 tx=0x7f5e0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df99c4985210536e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0000eac0 con 0x7f5df4004d50 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0000f040 con 0x7f5df4004d50 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.200+0000 7f5e05d9b700 1 -- 172.21.15.84:0/4020911420 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0000ee70 con 0x7f5df4004d50 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.201+0000 7f5e0cee4700 1 -- 172.21.15.84:0/4020911420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df4004d50 msgr2=0x7f5df40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.201+0000 7f5e0cee4700 1 --2- 172.21.15.84:0/4020911420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df4004d50 0x7f5df40051c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000e210 tx=0x7f5e0000b040 comp rx=0 tx=0).stop 2023-10-06T03:27:54.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.201+0000 7f5e06d9d700 1 -- 172.21.15.84:0/4020911420 reap_dead start 2023-10-06T03:27:54.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.201+0000 7f5e0cee4700 1 -- 172.21.15.84:0/4020911420 shutdown_connections 2023-10-06T03:27:54.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.201+0000 7f5e0cee4700 1 -- 172.21.15.84:0/4020911420 >> 172.21.15.84:0/4020911420 conn(0x7f5e0806de80 msgr2=0x7f5e0806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:54.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.201+0000 7f5e0cee4700 1 -- 172.21.15.84:0/4020911420 shutdown_connections 2023-10-06T03:27:54.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.201+0000 7f5e0cee4700 1 -- 172.21.15.84:0/4020911420 wait complete. 2023-10-06T03:27:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.202+0000 7f5e0cee4700 1 Processor -- start 2023-10-06T03:27:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.202+0000 7f5e0cee4700 1 -- start start 2023-10-06T03:27:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e0cee4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5df4004d50 0x7f5e0813d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e0cee4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e080cac30 0x7f5e080cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e0cee4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e080c9860 0x7f5e080c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e0cee4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080cb5e0 con 0x7f5e080c9860 2023-10-06T03:27:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e0cee4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e08151d60 con 0x7f5e080cac30 2023-10-06T03:27:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e0cee4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e08152320 con 0x7f5df4004d50 2023-10-06T03:27:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e06d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e080c9860 0x7f5e080c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e06d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e080c9860 0x7f5e080c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44570/0 (socket says 172.21.15.84:44570) 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e06d9d700 1 -- 172.21.15.84:0/2156862316 learned_addr learned my addr 172.21.15.84:0/2156862316 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e0659c700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5df4004d50 0x7f5e0813d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5dfffff700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e080cac30 0x7f5e080cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e06d9d700 1 -- 172.21.15.84:0/2156862316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5df4004d50 msgr2=0x7f5e0813d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5df4004d50 0x7f5e0813d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e06d9d700 1 -- 172.21.15.84:0/2156862316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e080cac30 msgr2=0x7f5e080cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e080cac30 0x7f5e080cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e06d9d700 1 -- 172.21.15.84:0/2156862316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080ca5c0 con 0x7f5e080c9860 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e080c9860 0x7f5e080c9d00 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f5e00016000 tx=0x7f5e0001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5dfe7fc700 1 -- 172.21.15.84:0/2156862316 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0000eec0 con 0x7f5e080c9860 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.203+0000 7f5dfe7fc700 1 -- 172.21.15.84:0/2156862316 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e00022070 con 0x7f5e080c9860 2023-10-06T03:27:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.204+0000 7f5dfe7fc700 1 -- 172.21.15.84:0/2156862316 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00027660 con 0x7f5e080c9860 2023-10-06T03:27:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.204+0000 7f5e0cee4700 1 -- 172.21.15.84:0/2156862316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e080ca8a0 con 0x7f5e080c9860 2023-10-06T03:27:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.204+0000 7f5e0cee4700 1 -- 172.21.15.84:0/2156862316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e080ca240 con 0x7f5e080c9860 2023-10-06T03:27:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.204+0000 7f5e0cee4700 1 -- 172.21.15.84:0/2156862316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e08064ad0 con 0x7f5e080c9860 2023-10-06T03:27:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.205+0000 7f5dfe7fc700 1 -- 172.21.15.84:0/2156862316 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e00024030 con 0x7f5e080c9860 2023-10-06T03:27:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.205+0000 7f5dfe7fc700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5de8066f30 0x7f5de80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.205+0000 7f5dfe7fc700 1 -- 172.21.15.84:0/2156862316 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f5e00085cf0 con 0x7f5e080c9860 2023-10-06T03:27:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.205+0000 7f5e0659c700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5de8066f30 0x7f5de80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.206+0000 7f5e0659c700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5de8066f30 0x7f5de80693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5df8007a30 tx=0x7f5df8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:54.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.209+0000 7f5dfe7fc700 1 -- 172.21.15.84:0/2156862316 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e00052ec0 con 0x7f5e080c9860 2023-10-06T03:27:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.396+0000 7f5e0cee4700 1 -- 172.21.15.84:0/2156862316 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e08152460 con 0x7f5de8066f30 2023-10-06T03:27:54.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.396+0000 7f5dfe7fc700 1 -- 172.21.15.84:0/2156862316 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5e08152460 con 0x7f5de8066f30 2023-10-06T03:27:54.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 -- 172.21.15.84:0/2156862316 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5de8066f30 msgr2=0x7f5de80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5de8066f30 0x7f5de80693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5df8007a30 tx=0x7f5df8009040 comp rx=0 tx=0).stop 2023-10-06T03:27:54.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 -- 172.21.15.84:0/2156862316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e080c9860 msgr2=0x7f5e080c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e080c9860 0x7f5e080c9d00 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f5e00016000 tx=0x7f5e0001a000 comp rx=0 tx=0).stop 2023-10-06T03:27:54.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 -- 172.21.15.84:0/2156862316 shutdown_connections 2023-10-06T03:27:54.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f5de8066f30 0x7f5de80693e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e080c9860 0x7f5e080c9d00 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5df4004d50 0x7f5e0813d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 --2- 172.21.15.84:0/2156862316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e080cac30 0x7f5e080cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 -- 172.21.15.84:0/2156862316 >> 172.21.15.84:0/2156862316 conn(0x7f5e0806de80 msgr2=0x7f5e0814e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 -- 172.21.15.84:0/2156862316 shutdown_connections 2023-10-06T03:27:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.398+0000 7f5e0cee4700 1 -- 172.21.15.84:0/2156862316 wait complete. 2023-10-06T03:27:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T03:27:54.412 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:27:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.524+0000 7f1a7f59e700 1 Processor -- start 2023-10-06T03:27:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.524+0000 7f1a7f59e700 1 -- start start 2023-10-06T03:27:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7f59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a800cbc70 0x7f1a800cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7f59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a800cb7e0 con 0x7f1a800b2140 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7f59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a800b08a0 con 0x7f1a80159480 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7f59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800cb190 con 0x7f1a800cbc70 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1a800b2140 0x7f1a800b25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38326/0 (socket says 172.21.15.84:38326) 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7ed9d700 1 -- 172.21.15.84:0/3645751453 learned_addr learned my addr 172.21.15.84:0/3645751453 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7dd9b700 1 --2- 172.21.15.84:0/3645751453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a800cbc70 0x7f1a800cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7d59a700 1 -- 172.21.15.84:0/3645751453 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928893770 0 0) 0x7f1a800cb7e0 con 0x7f1a800b2140 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7d59a700 1 -- 172.21.15.84:0/3645751453 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a68003570 con 0x7f1a800b2140 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7d59a700 1 -- 172.21.15.84:0/3645751453 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2569194936 0 0) 0x7f1a68003570 con 0x7f1a800b2140 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7dd9b700 1 -- 172.21.15.84:0/3645751453 >> v1:172.21.15.131:6789/0 conn(0x7f1a80159480 legacy=0x7f1a800b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7dd9b700 1 -- 172.21.15.84:0/3645751453 >> v1:172.21.15.84:6789/0 conn(0x7f1a800b2140 legacy=0x7f1a800b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.525+0000 7f1a7dd9b700 1 -- 172.21.15.84:0/3645751453 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a800cb470 con 0x7f1a800cbc70 2023-10-06T03:27:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7dd9b700 1 --2- 172.21.15.84:0/3645751453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a800cbc70 0x7f1a800cc0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009910 tx=0x7f1a740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17428ca647363524 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7d59a700 1 -- 172.21.15.84:0/3645751453 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a780017f0 con 0x7f1a800cbc70 2023-10-06T03:27:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7d59a700 1 -- 172.21.15.84:0/3645751453 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74011420 con 0x7f1a800cbc70 2023-10-06T03:27:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7d59a700 1 -- 172.21.15.84:0/3645751453 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740117c0 con 0x7f1a800cbc70 2023-10-06T03:27:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7f59e700 1 -- 172.21.15.84:0/3645751453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a800cbc70 msgr2=0x7f1a800cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7f59e700 1 --2- 172.21.15.84:0/3645751453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a800cbc70 0x7f1a800cc0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009910 tx=0x7f1a740091a0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7f59e700 1 -- 172.21.15.84:0/3645751453 shutdown_connections 2023-10-06T03:27:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7f59e700 1 --2- 172.21.15.84:0/3645751453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a800cbc70 0x7f1a800cc0c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7f59e700 1 -- 172.21.15.84:0/3645751453 >> 172.21.15.84:0/3645751453 conn(0x7f1a8006ed20 msgr2=0x7f1a8006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7f59e700 1 -- 172.21.15.84:0/3645751453 shutdown_connections 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.526+0000 7f1a7f59e700 1 -- 172.21.15.84:0/3645751453 wait complete. 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.527+0000 7f1a7f59e700 1 Processor -- start 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7f59e700 1 -- start start 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7f59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a800b2140 0x7f1a800ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7f59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a800cbc70 0x7f1a800cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7f59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a80159480 0x7f1a8015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7f59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800cf600 con 0x7f1a800cbc70 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7f59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800cf8e0 con 0x7f1a800b2140 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7f59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800c3ce0 con 0x7f1a80159480 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a800cbc70 0x7f1a800cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a800cbc70 0x7f1a800cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44582/0 (socket says 172.21.15.84:44582) 2023-10-06T03:27:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7dd9b700 1 -- 172.21.15.84:0/2571376275 learned_addr learned my addr 172.21.15.84:0/2571376275 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.528+0000 7f1a7ed9d700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a80159480 0x7f1a8015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a7e59c700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a800b2140 0x7f1a800ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a7dd9b700 1 -- 172.21.15.84:0/2571376275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a80159480 msgr2=0x7f1a8015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a7dd9b700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a80159480 0x7f1a8015dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a7dd9b700 1 -- 172.21.15.84:0/2571376275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a800b2140 msgr2=0x7f1a800ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a7dd9b700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a800b2140 0x7f1a800ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a7dd9b700 1 -- 172.21.15.84:0/2571376275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74009420 con 0x7f1a800cbc70 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a7dd9b700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a800cbc70 0x7f1a800cedc0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1a740093f0 tx=0x7f1a74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a6e7fc700 1 -- 172.21.15.84:0/2571376275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74000d10 con 0x7f1a800cbc70 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a6e7fc700 1 -- 172.21.15.84:0/2571376275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74010c20 con 0x7f1a800cbc70 2023-10-06T03:27:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a7f59e700 1 -- 172.21.15.84:0/2571376275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a800c3fc0 con 0x7f1a800cbc70 2023-10-06T03:27:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a6e7fc700 1 -- 172.21.15.84:0/2571376275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7401d430 con 0x7f1a800cbc70 2023-10-06T03:27:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.529+0000 7f1a7f59e700 1 -- 172.21.15.84:0/2571376275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a800c67a0 con 0x7f1a800cbc70 2023-10-06T03:27:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.530+0000 7f1a7f59e700 1 -- 172.21.15.84:0/2571376275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8005f270 con 0x7f1a800cbc70 2023-10-06T03:27:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.530+0000 7f1a6e7fc700 1 -- 172.21.15.84:0/2571376275 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a7401d7a0 con 0x7f1a800cbc70 2023-10-06T03:27:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.531+0000 7f1a6e7fc700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a60066f60 0x7f1a60069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:27:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.531+0000 7f1a7e59c700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a60066f60 0x7f1a60069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:27:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.531+0000 7f1a6e7fc700 1 -- 172.21.15.84:0/2571376275 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f1a74086310 con 0x7f1a800cbc70 2023-10-06T03:27:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.531+0000 7f1a7e59c700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a60066f60 0x7f1a60069410 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1a700038c0 tx=0x7f1a70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:27:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.535+0000 7f1a6e7fc700 1 -- 172.21.15.84:0/2571376275 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a740534e0 con 0x7f1a800cbc70 2023-10-06T03:27:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.714+0000 7f1a7f59e700 1 -- 172.21.15.84:0/2571376275 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a80159850 con 0x7f1a60066f60 2023-10-06T03:27:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.716+0000 7f1a6e7fc700 1 -- 172.21.15.84:0/2571376275 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73324 (secure 0 0 0) 0x7f1a80159850 con 0x7f1a60066f60 2023-10-06T03:27:54.719 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:27:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.718+0000 7f1a7f59e700 1 -- 172.21.15.84:0/2571376275 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a60066f60 msgr2=0x7f1a60069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.718+0000 7f1a7f59e700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a60066f60 0x7f1a60069410 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1a700038c0 tx=0x7f1a70009040 comp rx=0 tx=0).stop 2023-10-06T03:27:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.718+0000 7f1a7f59e700 1 -- 172.21.15.84:0/2571376275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a800cbc70 msgr2=0x7f1a800cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:27:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.718+0000 7f1a7f59e700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a800cbc70 0x7f1a800cedc0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1a740093f0 tx=0x7f1a74017000 comp rx=0 tx=0).stop 2023-10-06T03:27:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.718+0000 7f1a7f59e700 1 -- 172.21.15.84:0/2571376275 shutdown_connections 2023-10-06T03:27:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.718+0000 7f1a7f59e700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f1a60066f60 0x7f1a60069410 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.719+0000 7f1a7f59e700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a800b2140 0x7f1a800ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.719+0000 7f1a7f59e700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a80159480 0x7f1a8015dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.719+0000 7f1a7f59e700 1 --2- 172.21.15.84:0/2571376275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a800cbc70 0x7f1a800cedc0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:27:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.719+0000 7f1a7f59e700 1 -- 172.21.15.84:0/2571376275 >> 172.21.15.84:0/2571376275 conn(0x7f1a8006ed20 msgr2=0x7f1a800cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:27:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.719+0000 7f1a7f59e700 1 -- 172.21.15.84:0/2571376275 shutdown_connections 2023-10-06T03:27:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:27:54.719+0000 7f1a7f59e700 1 -- 172.21.15.84:0/2571376275 wait complete. 2023-10-06T03:27:54.722 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:27:54.732 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2023-10-06T03:27:53.090327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389892,"kb_used_data":11588,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752584828,"statfs":{"total":773094113280,"available":770646863872,"internally_reserved":0,"allocated":11866112,"data_stored":6293455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.133316"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":90,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-06T03:27:45.394832+0000","last_change":"2023-10-06T03:23:44.530297+0000","last_active":"2023-10-06T03:27:45.394832+0000","last_peered":"2023-10-06T03:27:45.394832+0000","last_clean":"2023-10-06T03:27:45.394832+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:27:45.394832+0000","last_undegraded":"2023-10-06T03:27:45.394832+0000","last_fullsized":"2023-10-06T03:27:45.394832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-06T03:27:44.963241+0000","last_change":"2023-10-06T03:23:44.507408+0000","last_active":"2023-10-06T03:27:44.963241+0000","last_peered":"2023-10-06T03:27:44.963241+0000","last_clean":"2023-10-06T03:27:44.963241+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:27:44.963241+0000","last_undegraded":"2023-10-06T03:27:44.963241+0000","last_fullsized":"2023-10-06T03:27:44.963241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:16.702040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:27:45.964845+0000","last_change":"2023-10-06T03:23:44.512522+0000","last_active":"2023-10-06T03:27:45.964845+0000","last_peered":"2023-10-06T03:27:45.964845+0000","last_clean":"2023-10-06T03:27:45.964845+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:27:45.964845+0000","last_undegraded":"2023-10-06T03:27:45.964845+0000","last_fullsized":"2023-10-06T03:27:45.964845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":250,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-06T03:27:44.956723+0000","last_change":"2023-10-06T03:23:44.512224+0000","last_active":"2023-10-06T03:27:44.956723+0000","last_peered":"2023-10-06T03:27:44.956723+0000","last_clean":"2023-10-06T03:27:44.956723+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:27:44.956723+0000","last_undegraded":"2023-10-06T03:27:44.956723+0000","last_fullsized":"2023-10-06T03:27:44.956723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:12.910122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":100,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-06T03:27:44.956923+0000","last_change":"2023-10-06T03:23:44.532722+0000","last_active":"2023-10-06T03:27:44.956923+0000","last_peered":"2023-10-06T03:27:44.956923+0000","last_clean":"2023-10-06T03:27:44.956923+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:27:44.956923+0000","last_undegraded":"2023-10-06T03:27:44.956923+0000","last_fullsized":"2023-10-06T03:27:44.956923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.220482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-06T03:27:44.956901+0000","last_change":"2023-10-06T03:23:44.533391+0000","last_active":"2023-10-06T03:27:44.956901+0000","last_peered":"2023-10-06T03:27:44.956901+0000","last_clean":"2023-10-06T03:27:44.956901+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:27:44.956901+0000","last_undegraded":"2023-10-06T03:27:44.956901+0000","last_fullsized":"2023-10-06T03:27:44.956901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":81,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-06T03:27:45.470011+0000","last_change":"2023-10-06T03:23:44.532697+0000","last_active":"2023-10-06T03:27:45.470011+0000","last_peered":"2023-10-06T03:27:45.470011+0000","last_clean":"2023-10-06T03:27:45.470011+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:27:45.470011+0000","last_undegraded":"2023-10-06T03:27:45.470011+0000","last_fullsized":"2023-10-06T03:27:45.470011+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:42.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":81,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-06T03:27:45.471136+0000","last_change":"2023-10-06T03:23:44.533555+0000","last_active":"2023-10-06T03:27:45.471136+0000","last_peered":"2023-10-06T03:27:45.471136+0000","last_clean":"2023-10-06T03:27:45.471136+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:27:45.471136+0000","last_undegraded":"2023-10-06T03:27:45.471136+0000","last_fullsized":"2023-10-06T03:27:45.471136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:41.719770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":80,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-06T03:27:45.470319+0000","last_change":"2023-10-06T03:23:44.513338+0000","last_active":"2023-10-06T03:27:45.470319+0000","last_peered":"2023-10-06T03:27:45.470319+0000","last_clean":"2023-10-06T03:27:45.470319+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:27:45.470319+0000","last_undegraded":"2023-10-06T03:27:45.470319+0000","last_fullsized":"2023-10-06T03:27:45.470319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.487805+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.487805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:21.203787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299172,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072668,"statfs":{"total":96636764160,"available":96330412032,"internally_reserved":0,"allocated":1929216,"data_stored":1229627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.38900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.68100000000000005,"15min":0.747},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68799999999999994,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82599999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.438},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0720000000000001,"5min":1.103,"15min":1.103},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78400000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Oct 6 03:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.498}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":639259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77900000000000003,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71999999999999997,"5min":1.343,"15min":1.343},"last":0.53100000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.72699999999999998,"15min":0.80200000000000005},"min":{"1min":0.41899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84699999999999998,"5min":1.329,"15min":1.329},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.70299999999999996,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68400000000000005,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.502},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.745,"15min":0.82099999999999995},"min":{"1min":0.371,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73699999999999999,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.40899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.752,"15min":0.82399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.42199999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.376},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.79600000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.752,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.624},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.54300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299172,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072668,"statfs":{"total":96636764160,"available":96330412032,"internally_reserved":0,"allocated":1929216,"data_stored":1229627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.35699999999999998,"15min":0.39300000000000002},"min":{"1min":0.216,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46400000000000002,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.42299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57599999999999996,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32000000000000001,"15min":0.32300000000000001},"min":{"1min":0.23499999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.372,"15min":0.40600000000000003},"min":{"1min":0.24399999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41199999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.40699999999999997,"15min":0.45800000000000002},"min":{"1min":0.27600000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56899999999999995,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.39800000000000002,"15min":0.44600000000000001},"min":{"1min":0.25800000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.622,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.74299999999999999,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60599999999999998,"15min":0.64600000000000002},"min":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77600000000000002,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73099999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.435}]},{"osd":6,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.60999999999999999,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.622,"15min":0.67400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79100000000000004,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.64800000000000002,"15min":0.70399999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.76100000000000001,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78600000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.504}]}]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":637906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.64000000000000001,"15min":0.78600000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39100000000000001,"5min":12.19,"15min":12.19},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.56799999999999995,"15min":0.66400000000000003},"min":{"1min":0.28000000000000003,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.432,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.246,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.40799999999999997,"5min":1.357,"15min":1.357},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34300000000000003,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.40400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.77300000000000002,"15min":0.97099999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41299999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.42299999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.435}]},{"osd":4,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.96099999999999997,"15min":1.137},"min":{"1min":0.44500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76700000000000002,"5min":16.919,"15min":16.919},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.42699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.96999999999999997,"15min":1.1499999999999999},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":16.948,"15min":16.948},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.98699999999999999,"15min":1.1619999999999999},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83799999999999997,"5min":16.881,"15min":16.881},"last":0.65200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":639259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.33500000000000002},"min":{"1min":0.22500000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.45100000000000001,"5min":0.62,"15min":0.62},"last":0.253},{"interface":"front","average":{"1min":0.371,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52100000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.34100000000000003,"15min":0.34499999999999997},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.434,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.316}]},{"osd":3,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33500000000000002,"15min":0.34200000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.44700000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.38400000000000001,"15min":0.39200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.48999999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56999999999999995,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.753,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.44900000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76300000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.53200000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78700000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.627,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.59299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":639259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33300000000000002,"15min":0.34100000000000003},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.46300000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34300000000000003,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45000000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.27100000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.20799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.435,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34699999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51100000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.30199999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36499999999999999,"15min":0.374},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.49099999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.45400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.745,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72499999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.34399999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.378},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59999999999999998,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73199999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.878,"15min":0.878},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79100000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.441}]},{"osd":7,"last update":"Fri Oct 6 03:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81100000000000005,"5min":0.997,"15min":0.997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.5}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":639259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.67800000000000005,"15min":0.72999999999999998},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":4.758,"15min":4.758},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.67000000000000004,"15min":0.73399999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88700000000000001,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.373}]},{"osd":1,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.79800000000000004,"15min":0.92300000000000004},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90600000000000003,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.82399999999999995,"15min":0.95299999999999996},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79600000000000004,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.497}]},{"osd":2,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.873,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.441}]},{"osd":5,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70399999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67600000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84599999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46300000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.64500000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94799999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.628}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":639259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.40999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91600000000000004,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95799999999999996,"5min":0.999,"15min":0.999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94599999999999995,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.40600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88900000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.625}]},{"osd":4,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.32700000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.439},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.33300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.39000000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78900000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.378,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82399999999999995,"5min":1.04,"15min":1.04},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.371,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":1.284,"15min":1.284},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:27:54.736 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T03:23:43.487805+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=27, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:27:54.736 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T03:23:43.487805+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=27, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:27:54.737 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-06T03:23:43.487805+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=27, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:27:54.737 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T03:23:43.487805+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=27, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:27:54.737 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T03:23:43.487805+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=27, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:27:54.737 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T03:23:43.487805+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=27, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:27:54.737 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T03:23:43.487805+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=27, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:27:54.738 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T03:23:43.487805+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=27, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:27:54.738 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T03:23:43.487805+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=27, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:27:54.738 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:27:56.428 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:27:56.431 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:28:14.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:28:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb80d48f700 1 Processor -- start 2023-10-06T03:28:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb80d48f700 1 -- start start 2023-10-06T03:28:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb80d48f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8081595a0 0x7fb8080aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb80d48f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb8080b49e0 0x7fb8080aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb80d48f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 0x7fb8080b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb80d48f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8080b0ca0 con 0x7fb8081595a0 2023-10-06T03:28:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb80d48f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8080b0f80 con 0x7fb8080b49e0 2023-10-06T03:28:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb80d48f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080b1260 con 0x7fb8080b07a0 2023-10-06T03:28:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb806ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8081595a0 0x7fb8080aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb806ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8081595a0 0x7fb8080aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40876/0 (socket says 172.21.15.84:40876) 2023-10-06T03:28:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb806ffd700 1 -- 172.21.15.84:0/3894557996 learned_addr learned my addr 172.21.15.84:0/3894557996 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:28:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb8077fe700 1 --2- 172.21.15.84:0/3894557996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 0x7fb8080b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb8067fc700 1 --2- 172.21.15.84:0/3894557996 >> v2:172.21.15.131:3300/0 conn(0x7fb8080b49e0 0x7fb8080aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb806ffd700 1 -- 172.21.15.84:0/3894557996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 msgr2=0x7fb8080b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:28:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb806ffd700 1 --2- 172.21.15.84:0/3894557996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 0x7fb8080b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb806ffd700 1 -- 172.21.15.84:0/3894557996 >> v2:172.21.15.131:3300/0 conn(0x7fb8080b49e0 msgr2=0x7fb8080aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:28:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb806ffd700 1 --2- 172.21.15.84:0/3894557996 >> v2:172.21.15.131:3300/0 conn(0x7fb8080b49e0 0x7fb8080aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb806ffd700 1 -- 172.21.15.84:0/3894557996 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8080b1540 con 0x7fb8081595a0 2023-10-06T03:28:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb8077fe700 1 --2- 172.21.15.84:0/3894557996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 0x7fb8080b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:28:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb806ffd700 1 --2- 172.21.15.84:0/3894557996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8081595a0 0x7fb8080aa570 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb800009f70 tx=0x7fb800009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc51ed56fc3f271 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:28:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb805ffb700 1 -- 172.21.15.84:0/3894557996 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80000e070 con 0x7fb8081595a0 2023-10-06T03:28:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb805ffb700 1 -- 172.21.15.84:0/3894557996 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80000ba90 con 0x7fb8081595a0 2023-10-06T03:28:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.865+0000 7fb805ffb700 1 -- 172.21.15.84:0/3894557996 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8000092e0 con 0x7fb8081595a0 2023-10-06T03:28:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.866+0000 7fb80d48f700 1 -- 172.21.15.84:0/3894557996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8081595a0 msgr2=0x7fb8080aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.866+0000 7fb80d48f700 1 --2- 172.21.15.84:0/3894557996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8081595a0 0x7fb8080aa570 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb800009f70 tx=0x7fb800009840 comp rx=0 tx=0).stop 2023-10-06T03:28:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.866+0000 7fb80d48f700 1 -- 172.21.15.84:0/3894557996 shutdown_connections 2023-10-06T03:28:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.866+0000 7fb80d48f700 1 --2- 172.21.15.84:0/3894557996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 0x7fb8080b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.866+0000 7fb80d48f700 1 --2- 172.21.15.84:0/3894557996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8081595a0 0x7fb8080aa570 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.866+0000 7fb80d48f700 1 --2- 172.21.15.84:0/3894557996 >> v2:172.21.15.131:3300/0 conn(0x7fb8080b49e0 0x7fb8080aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.866+0000 7fb80d48f700 1 -- 172.21.15.84:0/3894557996 >> 172.21.15.84:0/3894557996 conn(0x7fb808099830 msgr2=0x7fb80806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:28:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.866+0000 7fb80d48f700 1 -- 172.21.15.84:0/3894557996 shutdown_connections 2023-10-06T03:28:14.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.866+0000 7fb80d48f700 1 -- 172.21.15.84:0/3894557996 wait complete. 2023-10-06T03:28:14.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.867+0000 7fb80d48f700 1 Processor -- start 2023-10-06T03:28:14.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.867+0000 7fb80d48f700 1 -- start start 2023-10-06T03:28:14.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.868+0000 7fb80d48f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 0x7fb80816cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:14.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.868+0000 7fb80d48f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8080b49e0 0x7fb808169ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:14.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.868+0000 7fb80d48f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081595a0 0x7fb80809c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:14.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.868+0000 7fb80d48f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80816d260 con 0x7fb8080b49e0 2023-10-06T03:28:14.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.868+0000 7fb80d48f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80816a400 con 0x7fb8081595a0 2023-10-06T03:28:14.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.868+0000 7fb80d48f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80809cc30 con 0x7fb8080b07a0 2023-10-06T03:28:14.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.868+0000 7fb8067fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8080b49e0 0x7fb808169ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:14.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.868+0000 7fb8067fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8080b49e0 0x7fb808169ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40888/0 (socket says 172.21.15.84:40888) 2023-10-06T03:28:14.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.868+0000 7fb8067fc700 1 -- 172.21.15.84:0/2379426834 learned_addr learned my addr 172.21.15.84:0/2379426834 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:28:14.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb806ffd700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 0x7fb80816cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:14.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb8077fe700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081595a0 0x7fb80809c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb8067fc700 1 -- 172.21.15.84:0/2379426834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 msgr2=0x7fb80816cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb8067fc700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 0x7fb80816cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb8067fc700 1 -- 172.21.15.84:0/2379426834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081595a0 msgr2=0x7fb80809c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb8067fc700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081595a0 0x7fb80809c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb8067fc700 1 -- 172.21.15.84:0/2379426834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800009ae0 con 0x7fb8080b49e0 2023-10-06T03:28:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb8067fc700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8080b49e0 0x7fb808169ec0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000d890 tx=0x7fb7f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:28:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb7feffd700 1 -- 172.21.15.84:0/2379426834 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0012630 con 0x7fb8080b49e0 2023-10-06T03:28:14.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb7feffd700 1 -- 172.21.15.84:0/2379426834 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f0012790 con 0x7fb8080b49e0 2023-10-06T03:28:14.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb80d48f700 1 -- 172.21.15.84:0/2379426834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80809c950 con 0x7fb8080b49e0 2023-10-06T03:28:14.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb7feffd700 1 -- 172.21.15.84:0/2379426834 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0012b50 con 0x7fb8080b49e0 2023-10-06T03:28:14.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.869+0000 7fb80d48f700 1 -- 172.21.15.84:0/2379426834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb808159e70 con 0x7fb8080b49e0 2023-10-06T03:28:14.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.870+0000 7fb80d48f700 1 -- 172.21.15.84:0/2379426834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb808064ad0 con 0x7fb8080b49e0 2023-10-06T03:28:14.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.870+0000 7fb7feffd700 1 -- 172.21.15.84:0/2379426834 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7f001d400 con 0x7fb8080b49e0 2023-10-06T03:28:14.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.871+0000 7fb7feffd700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb7e8066f30 0x7fb7e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:14.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.871+0000 7fb7feffd700 1 -- 172.21.15.84:0/2379426834 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fb7f0084930 con 0x7fb8080b49e0 2023-10-06T03:28:14.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.871+0000 7fb806ffd700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb7e8066f30 0x7fb7e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:14.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.871+0000 7fb806ffd700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb7e8066f30 0x7fb7e80693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb800009880 tx=0x7fb800018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:28:14.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:14.876+0000 7fb7feffd700 1 -- 172.21.15.84:0/2379426834 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7f0055590 con 0x7fb8080b49e0 2023-10-06T03:28:15.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.054+0000 7fb80d48f700 1 -- 172.21.15.84:0/2379426834 --> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8080b1820 con 0x7fb7e8066f30 2023-10-06T03:28:15.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.057+0000 7fb7feffd700 1 -- 172.21.15.84:0/2379426834 <== mgr.4104 v2:172.21.15.84:6832/90431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73494 (secure 0 0 0) 0x7fb8080b1820 con 0x7fb7e8066f30 2023-10-06T03:28:15.058 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:28:15.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.058+0000 7fb80d48f700 1 -- 172.21.15.84:0/2379426834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb7e8066f30 msgr2=0x7fb7e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.058+0000 7fb80d48f700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb7e8066f30 0x7fb7e80693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb800009880 tx=0x7fb800018000 comp rx=0 tx=0).stop 2023-10-06T03:28:15.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.058+0000 7fb80d48f700 1 -- 172.21.15.84:0/2379426834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8080b49e0 msgr2=0x7fb808169ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.058+0000 7fb80d48f700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8080b49e0 0x7fb808169ec0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000d890 tx=0x7fb7f0008040 comp rx=0 tx=0).stop 2023-10-06T03:28:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.058+0000 7fb80d48f700 1 -- 172.21.15.84:0/2379426834 shutdown_connections 2023-10-06T03:28:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.058+0000 7fb80d48f700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fb7e8066f30 0x7fb7e80693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.059+0000 7fb80d48f700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081595a0 0x7fb80809c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.059+0000 7fb80d48f700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8080b07a0 0x7fb80816cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.059+0000 7fb80d48f700 1 --2- 172.21.15.84:0/2379426834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8080b49e0 0x7fb808169ec0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.059+0000 7fb80d48f700 1 -- 172.21.15.84:0/2379426834 >> 172.21.15.84:0/2379426834 conn(0x7fb808099830 msgr2=0x7fb8080ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:28:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.059+0000 7fb80d48f700 1 -- 172.21.15.84:0/2379426834 shutdown_connections 2023-10-06T03:28:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.059+0000 7fb80d48f700 1 -- 172.21.15.84:0/2379426834 wait complete. 2023-10-06T03:28:15.061 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:28:15.071 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2023-10-06T03:28:13.094529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389892,"kb_used_data":11588,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752584828,"statfs":{"total":773094113280,"available":770646863872,"internally_reserved":0,"allocated":11866112,"data_stored":6293455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002615"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":101,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:27:53.007633+0000","last_change":"2023-10-06T03:27:53.007604+0000","last_active":"2023-10-06T03:27:53.007633+0000","last_peered":"2023-10-06T03:27:53.007633+0000","last_clean":"2023-10-06T03:27:53.007633+0000","last_became_active":"2023-10-06T03:23:44.529955+0000","last_became_peered":"2023-10-06T03:23:44.529955+0000","last_unstale":"2023-10-06T03:27:53.007633+0000","last_undegraded":"2023-10-06T03:27:53.007633+0000","last_fullsized":"2023-10-06T03:27:53.007633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:53.007493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:53.007493+0000","last_clean_scrub_stamp":"2023-10-06T03:27:53.007493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:45.444843+0000","scrub_duration":0.0016935979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":96,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:27:54.010706+0000","last_change":"2023-10-06T03:27:54.010686+0000","last_active":"2023-10-06T03:27:54.010706+0000","last_peered":"2023-10-06T03:27:54.010706+0000","last_clean":"2023-10-06T03:27:54.010706+0000","last_became_active":"2023-10-06T03:23:44.507118+0000","last_became_peered":"2023-10-06T03:23:44.507118+0000","last_unstale":"2023-10-06T03:27:54.010706+0000","last_undegraded":"2023-10-06T03:27:54.010706+0000","last_fullsized":"2023-10-06T03:27:54.010706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:54.010595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:54.010595+0000","last_clean_scrub_stamp":"2023-10-06T03:27:54.010595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:14.053876+0000","scrub_duration":0.001687727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":95,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:27:53.282389+0000","last_change":"2023-10-06T03:27:53.282367+0000","last_active":"2023-10-06T03:27:53.282389+0000","last_peered":"2023-10-06T03:27:53.282389+0000","last_clean":"2023-10-06T03:27:53.282389+0000","last_became_active":"2023-10-06T03:23:44.512337+0000","last_became_peered":"2023-10-06T03:23:44.512337+0000","last_unstale":"2023-10-06T03:27:53.282389+0000","last_undegraded":"2023-10-06T03:27:53.282389+0000","last_fullsized":"2023-10-06T03:27:53.282389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:53.282293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:53.282293+0000","last_clean_scrub_stamp":"2023-10-06T03:27:53.282293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:37.987870+0000","scrub_duration":0.0020290270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"107'119","reported_seq":263,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:27:58.311605+0000","last_change":"2023-10-06T03:27:58.311565+0000","last_active":"2023-10-06T03:27:58.311605+0000","last_peered":"2023-10-06T03:27:58.311605+0000","last_clean":"2023-10-06T03:27:58.311605+0000","last_became_active":"2023-10-06T03:23:44.511254+0000","last_became_peered":"2023-10-06T03:23:44.511254+0000","last_unstale":"2023-10-06T03:27:58.311605+0000","last_undegraded":"2023-10-06T03:27:58.311605+0000","last_fullsized":"2023-10-06T03:27:58.311605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'119","last_scrub_stamp":"2023-10-06T03:27:58.311474+0000","last_deep_scrub":"107'119","last_deep_scrub_stamp":"2023-10-06T03:27:58.311474+0000","last_clean_scrub_stamp":"2023-10-06T03:27:58.311474+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:17.522160+0000","scrub_duration":0.0052900789999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":111,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:27:56.305279+0000","last_change":"2023-10-06T03:27:56.305253+0000","last_active":"2023-10-06T03:27:56.305279+0000","last_peered":"2023-10-06T03:27:56.305279+0000","last_clean":"2023-10-06T03:27:56.305279+0000","last_became_active":"2023-10-06T03:23:44.532436+0000","last_became_peered":"2023-10-06T03:23:44.532436+0000","last_unstale":"2023-10-06T03:27:56.305279+0000","last_undegraded":"2023-10-06T03:27:56.305279+0000","last_fullsized":"2023-10-06T03:27:56.305279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:56.305164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:56.305164+0000","last_clean_scrub_stamp":"2023-10-06T03:27:56.305164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:40.823474+0000","scrub_duration":0.0015378810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":111,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:27:55.264320+0000","last_change":"2023-10-06T03:27:55.264279+0000","last_active":"2023-10-06T03:27:55.264320+0000","last_peered":"2023-10-06T03:27:55.264320+0000","last_clean":"2023-10-06T03:27:55.264320+0000","last_became_active":"2023-10-06T03:23:44.533158+0000","last_became_peered":"2023-10-06T03:23:44.533158+0000","last_unstale":"2023-10-06T03:27:55.264320+0000","last_undegraded":"2023-10-06T03:27:55.264320+0000","last_fullsized":"2023-10-06T03:27:55.264320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:55.264172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:55.264172+0000","last_clean_scrub_stamp":"2023-10-06T03:27:55.264172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:44:39.846960+0000","scrub_duration":0.001800025,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":92,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:27:53.786195+0000","last_change":"2023-10-06T03:27:53.786170+0000","last_active":"2023-10-06T03:27:53.786195+0000","last_peered":"2023-10-06T03:27:53.786195+0000","last_clean":"2023-10-06T03:27:53.786195+0000","last_became_active":"2023-10-06T03:23:44.532411+0000","last_became_peered":"2023-10-06T03:23:44.532411+0000","last_unstale":"2023-10-06T03:27:53.786195+0000","last_undegraded":"2023-10-06T03:27:53.786195+0000","last_fullsized":"2023-10-06T03:27:53.786195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:53.786083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:53.786083+0000","last_clean_scrub_stamp":"2023-10-06T03:27:53.786083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:57.748721+0000","scrub_duration":0.0017294400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:27:55.960533+0000","last_change":"2023-10-06T03:27:55.960506+0000","last_active":"2023-10-06T03:27:55.960533+0000","last_peered":"2023-10-06T03:27:55.960533+0000","last_clean":"2023-10-06T03:27:55.960533+0000","last_became_active":"2023-10-06T03:23:44.533327+0000","last_became_peered":"2023-10-06T03:23:44.533327+0000","last_unstale":"2023-10-06T03:27:55.960533+0000","last_undegraded":"2023-10-06T03:27:55.960533+0000","last_fullsized":"2023-10-06T03:27:55.960533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:55.960413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:55.960413+0000","last_clean_scrub_stamp":"2023-10-06T03:27:55.960413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:16.003694+0000","scrub_duration":0.0017980509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":91,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:27:55.005964+0000","last_change":"2023-10-06T03:27:55.005923+0000","last_active":"2023-10-06T03:27:55.005964+0000","last_peered":"2023-10-06T03:27:55.005964+0000","last_clean":"2023-10-06T03:27:55.005964+0000","last_became_active":"2023-10-06T03:23:44.513118+0000","last_became_peered":"2023-10-06T03:23:44.513118+0000","last_unstale":"2023-10-06T03:27:55.005964+0000","last_undegraded":"2023-10-06T03:27:55.005964+0000","last_fullsized":"2023-10-06T03:27:55.005964+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:27:55.005816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:27:55.005816+0000","last_clean_scrub_stamp":"2023-10-06T03:27:55.005816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:59.334449+0000","scrub_duration":0.0022329189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299172,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072668,"statfs":{"total":96636764160,"available":96330412032,"internally_reserved":0,"allocated":1929216,"data_stored":1229627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.50900000000000001},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.871,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64000000000000001,"15min":0.73299999999999998},"min":{"1min":0.376,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0089999999999999,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63100000000000001,"15min":0.71199999999999997},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92400000000000004,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.68799999999999994}]},{"osd":2,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.38800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.95599999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.39800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.99099999999999999,"5min":1.103,"15min":1.103},"last":0.62},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96999999999999997,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.498,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.0820000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.43099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.052,"5min":1.169,"15min":1.169},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":639259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70499999999999996,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78100000000000003,"5min":1.343,"15min":1.343},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.66500000000000004,"15min":0.78100000000000003},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79800000000000004,"5min":6.3680000000000003,"15min":6.3680000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76400000000000001,"5min":1.329,"15min":1.329},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.64700000000000002,"15min":0.76200000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86199999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.68999999999999995,"15min":0.80200000000000005},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80200000000000005,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.61299999999999999},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89400000000000002,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.69899999999999995,"15min":0.80600000000000005},"min":{"1min":0.43099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89600000000000002,"5min":6.4359999999999999,"15min":6.4359999999999999},"last":0.748}]},{"osd":4,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.28999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93500000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.30499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81499999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.39800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.31900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.82599999999999996,"5min":1.53,"15min":1.53},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.378,"5min":0.317,"15min":0.317},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.435}]},{"osd":7,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78700000000000003,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.88200000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.47499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299172,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072668,"statfs":{"total":96636764160,"available":96330412032,"internally_reserved":0,"allocated":1929216,"data_stored":1229627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.35699999999999998,"15min":0.39300000000000002},"min":{"1min":0.216,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46400000000000002,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.42299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57599999999999996,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32000000000000001,"15min":0.32300000000000001},"min":{"1min":0.23499999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.372,"15min":0.40600000000000003},"min":{"1min":0.24399999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41199999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.36799999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.40699999999999997,"15min":0.45800000000000002},"min":{"1min":0.27600000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56899999999999995,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.39800000000000002,"15min":0.44600000000000001},"min":{"1min":0.25800000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.622,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.74299999999999999,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60599999999999998,"15min":0.64600000000000002},"min":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77600000000000002,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73099999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41499999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.60999999999999999,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.499},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.622,"15min":0.67400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79100000000000004,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.64800000000000002,"15min":0.70399999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.76100000000000001,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78600000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":637906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.53500000000000003,"15min":0.751},"min":{"1min":0.22600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.45000000000000001,"5min":12.19,"15min":12.19},"last":0.315},{"interface":"front","average":{"1min":0.38,"5min":0.501,"15min":0.64200000000000002},"min":{"1min":0.28100000000000003,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.53100000000000003,"5min":8.3900000000000006,"15min":8.3900000000000006},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.36399999999999999,"15min":0.39400000000000002},"min":{"1min":0.23499999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55800000000000005,"5min":1.357,"15min":1.357},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.436}]},{"osd":3,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.63,"15min":0.92300000000000004},"min":{"1min":0.23999999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.60499999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39300000000000002,"15min":0.41299999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58999999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.83999999999999997,"15min":1.0960000000000001},"min":{"1min":0.436,"5min":0.312,"15min":0.312},"max":{"1min":0.97799999999999998,"5min":16.919,"15min":16.919},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58099999999999996,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.91800000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57599999999999996,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.84299999999999997,"15min":1.107},"min":{"1min":0.40999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0029999999999999,"5min":16.948,"15min":16.948},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94899999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.40400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.62},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.86299999999999999,"15min":1.121},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":16.881,"15min":16.881},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":639259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.33500000000000002},"min":{"1min":0.22500000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.45100000000000001,"5min":0.62,"15min":0.62},"last":0.307},{"interface":"front","average":{"1min":0.371,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52100000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.38600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.34100000000000003,"15min":0.34499999999999997},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.434,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33500000000000002,"15min":0.34200000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.44700000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.38400000000000001,"15min":0.39200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.48999999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56999999999999995,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.753,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76300000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78700000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.627,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.55400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":639259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.34300000000000003},"min":{"1min":0.20799999999999999,"5min":0.187,"15min":0.187},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.35299999999999998},"min":{"1min":0.22800000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.23499999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34799999999999998,"15min":0.35799999999999998},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.373},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38100000000000001,"15min":0.39900000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59299999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56999999999999995,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76600000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.96399999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58099999999999996,"15min":0.61799999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83699999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80400000000000005,"5min":0.878,"15min":0.878},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.44400000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90500000000000003,"5min":0.997,"15min":0.997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.432,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91800000000000004,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":639259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63900000000000001,"15min":0.71699999999999997},"min":{"1min":0.42499999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71099999999999997,"5min":4.758,"15min":4.758},"last":0.441},{"interface":"front","average":{"1min":0.497,"5min":0.61599999999999999,"15min":0.71599999999999997},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67000000000000004,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.70499999999999996,"15min":0.89200000000000002},"min":{"1min":0.38,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.72699999999999998,"15min":0.92100000000000004},"min":{"1min":0.38800000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68600000000000005,"5min":9.7690000000000001,"15min":9.7690000000000001},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.45600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73599999999999999,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":0.66500000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.65300000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56899999999999995,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.52100000000000002,"15min":0.55600000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.497},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.53300000000000003,"15min":0.55100000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.66900000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.54800000000000004,"15min":0.57999999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61199999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.58099999999999996,"15min":0.60699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64000000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.375}]},{"osd":7,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56100000000000005,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.621,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.60799999999999998,"15min":0.63800000000000001},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.69999999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":639259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.40999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91600000000000004,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95799999999999996,"5min":0.999,"15min":0.999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94599999999999995,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.40600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88900000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.32700000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.33300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78900000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.378,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82399999999999995,"5min":1.04,"15min":1.04},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.371,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":1.284,"15min":1.284},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:28:15.074 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T03:28:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.187+0000 7f2f5f7b5700 1 Processor -- start 2023-10-06T03:28:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.187+0000 7f2f5f7b5700 1 -- start start 2023-10-06T03:28:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5f7b5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f581558e0 0x7f2f5806b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5f7b5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2f58159570 0x7f2f58069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5f7b5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f58159ae0 con 0x7f2f5806a330 2023-10-06T03:28:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5f7b5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5806a7b0 con 0x7f2f58159570 2023-10-06T03:28:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5f7b5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58069c70 con 0x7f2f581558e0 2023-10-06T03:28:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5d551700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f581558e0 0x7f2f5806b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5cd50700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2f58159570 0x7f2f58069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5d551700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f581558e0 0x7f2f5806b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:42580/0 (socket says 172.21.15.84:42580) 2023-10-06T03:28:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5cd50700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2f58159570 0x7f2f58069df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:33558/0 (socket says 172.21.15.84:33558) 2023-10-06T03:28:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5d551700 1 -- 172.21.15.84:0/1282509337 learned_addr learned my addr 172.21.15.84:0/1282509337 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:28:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.188+0000 7f2f5dd52700 1 --1- 172.21.15.84:0/1282509337 >> v1:172.21.15.131:6789/0 conn(0x7f2f5806a330 0x7f2f58069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:45486/0 (socket says 172.21.15.84:45486) 2023-10-06T03:28:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.189+0000 7f2f5d551700 1 -- 172.21.15.84:0/1282509337 >> v2:172.21.15.131:3300/0 conn(0x7f2f58159570 msgr2=0x7f2f58069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:28:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.189+0000 7f2f5d551700 1 --2- 172.21.15.84:0/1282509337 >> v2:172.21.15.131:3300/0 conn(0x7f2f58159570 0x7f2f58069df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.189+0000 7f2f5d551700 1 -- 172.21.15.84:0/1282509337 >> v1:172.21.15.131:6789/0 conn(0x7f2f5806a330 legacy=0x7f2f58069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.189+0000 7f2f5d551700 1 -- 172.21.15.84:0/1282509337 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58159dc0 con 0x7f2f581558e0 2023-10-06T03:28:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.189+0000 7f2f5d551700 1 --2- 172.21.15.84:0/1282509337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f581558e0 0x7f2f5806b130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009f20 tx=0x7f2f54009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12bce805955636f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:28:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.189+0000 7f2f4ffff700 1 -- 172.21.15.84:0/1282509337 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400e070 con 0x7f2f581558e0 2023-10-06T03:28:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.189+0000 7f2f4ffff700 1 -- 172.21.15.84:0/1282509337 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400b9d0 con 0x7f2f581558e0 2023-10-06T03:28:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.189+0000 7f2f4ffff700 1 -- 172.21.15.84:0/1282509337 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540092e0 con 0x7f2f581558e0 2023-10-06T03:28:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.190+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/1282509337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f581558e0 msgr2=0x7f2f5806b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.190+0000 7f2f5f7b5700 1 --2- 172.21.15.84:0/1282509337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f581558e0 0x7f2f5806b130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009f20 tx=0x7f2f54009840 comp rx=0 tx=0).stop 2023-10-06T03:28:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.190+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/1282509337 shutdown_connections 2023-10-06T03:28:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.190+0000 7f2f5f7b5700 1 --2- 172.21.15.84:0/1282509337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f581558e0 0x7f2f5806b130 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.190+0000 7f2f5f7b5700 1 --2- 172.21.15.84:0/1282509337 >> v2:172.21.15.131:3300/0 conn(0x7f2f58159570 0x7f2f58069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.190+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/1282509337 >> 172.21.15.84:0/1282509337 conn(0x7f2f580cc0e0 msgr2=0x7f2f580cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:28:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.190+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/1282509337 shutdown_connections 2023-10-06T03:28:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.190+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/1282509337 wait complete. 2023-10-06T03:28:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.191+0000 7f2f5f7b5700 1 Processor -- start 2023-10-06T03:28:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.191+0000 7f2f5f7b5700 1 -- start start 2023-10-06T03:28:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5f7b5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f5806a330 0x7f2f580c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5f7b5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f581558e0 0x7f2f58167f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5f7b5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f58159570 0x7f2f58168480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5f7b5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58155260 con 0x7f2f581558e0 2023-10-06T03:28:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5f7b5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580c4a90 con 0x7f2f5806a330 2023-10-06T03:28:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5f7b5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580c41f0 con 0x7f2f58159570 2023-10-06T03:28:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5cd50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f581558e0 0x7f2f58167f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5cd50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f581558e0 0x7f2f58167f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40898/0 (socket says 172.21.15.84:40898) 2023-10-06T03:28:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5cd50700 1 -- 172.21.15.84:0/3383468 learned_addr learned my addr 172.21.15.84:0/3383468 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:28:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5dd52700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f58159570 0x7f2f58168480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5d551700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f5806a330 0x7f2f580c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5cd50700 1 -- 172.21.15.84:0/3383468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f58159570 msgr2=0x7f2f58168480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5cd50700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f58159570 0x7f2f58168480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5cd50700 1 -- 172.21.15.84:0/3383468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f5806a330 msgr2=0x7f2f580c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5cd50700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f5806a330 0x7f2f580c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5cd50700 1 -- 172.21.15.84:0/3383468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009ae0 con 0x7f2f581558e0 2023-10-06T03:28:15.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5d551700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f5806a330 0x7f2f580c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:28:15.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5cd50700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f581558e0 0x7f2f58167f40 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800e930 tx=0x7f2f480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:28:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f4d7fa700 1 -- 172.21.15.84:0/3383468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800eed0 con 0x7f2f581558e0 2023-10-06T03:28:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f4d7fa700 1 -- 172.21.15.84:0/3383468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4800c850 con 0x7f2f581558e0 2023-10-06T03:28:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/3383468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f580c44d0 con 0x7f2f581558e0 2023-10-06T03:28:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f4d7fa700 1 -- 172.21.15.84:0/3383468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800cbf0 con 0x7f2f581558e0 2023-10-06T03:28:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.192+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/3383468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f58167a20 con 0x7f2f581558e0 2023-10-06T03:28:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.193+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/3383468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f58167c40 con 0x7f2f581558e0 2023-10-06T03:28:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.194+0000 7f2f4d7fa700 1 -- 172.21.15.84:0/3383468 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f48013470 con 0x7f2f581558e0 2023-10-06T03:28:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.194+0000 7f2f4d7fa700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2f3c066f30 0x7f2f3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.194+0000 7f2f4d7fa700 1 -- 172.21.15.84:0/3383468 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f2f480847f0 con 0x7f2f581558e0 2023-10-06T03:28:15.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.194+0000 7f2f5d551700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2f3c066f30 0x7f2f3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.194+0000 7f2f5d551700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2f3c066f30 0x7f2f3c0693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009880 tx=0x7f2f54018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:28:15.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.198+0000 7f2f4d7fa700 1 -- 172.21.15.84:0/3383468 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f480519c0 con 0x7f2f581558e0 2023-10-06T03:28:15.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.382+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/3383468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2f58064ad0 con 0x7f2f581558e0 2023-10-06T03:28:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.387+0000 7f2f4d7fa700 1 -- 172.21.15.84:0/3383468 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2f480519c0 con 0x7f2f581558e0 2023-10-06T03:28:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.387+0000 7f2f4d7fa700 1 -- 172.21.15.84:0/3383468 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v26)=0 v26) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2f480170c0 con 0x7f2f581558e0 2023-10-06T03:28:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/3383468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2f3c066f30 msgr2=0x7f2f3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2f3c066f30 0x7f2f3c0693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009880 tx=0x7f2f54018000 comp rx=0 tx=0).stop 2023-10-06T03:28:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/3383468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f581558e0 msgr2=0x7f2f58167f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f581558e0 0x7f2f58167f40 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800e930 tx=0x7f2f480091a0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/3383468 shutdown_connections 2023-10-06T03:28:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7f2f3c066f30 0x7f2f3c0693e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f5806a330 0x7f2f580c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f58159570 0x7f2f58168480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 --2- 172.21.15.84:0/3383468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f581558e0 0x7f2f58167f40 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/3383468 >> 172.21.15.84:0/3383468 conn(0x7f2f580cc0e0 msgr2=0x7f2f580cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:28:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/3383468 shutdown_connections 2023-10-06T03:28:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.389+0000 7f2f5f7b5700 1 -- 172.21.15.84:0/3383468 wait complete. 2023-10-06T03:28:15.401 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:28:15.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:28:15.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.514+0000 7fdc47e37700 1 Processor -- start 2023-10-06T03:28:15.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.514+0000 7fdc47e37700 1 -- start start 2023-10-06T03:28:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc47e37700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc40156540 0x7fdc400c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc47e37700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc400c75b0 0x7fdc4006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc47e37700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc4006ebd0 0x7fdc4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc47e37700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4006f470 con 0x7fdc40156540 2023-10-06T03:28:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc47e37700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4006f050 con 0x7fdc400c75b0 2023-10-06T03:28:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc47e37700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400acd60 con 0x7fdc4006ebd0 2023-10-06T03:28:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc45bd3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc40156540 0x7fdc400c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc45bd3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc40156540 0x7fdc400c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40914/0 (socket says 172.21.15.84:40914) 2023-10-06T03:28:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc45bd3700 1 -- 172.21.15.84:0/3280660886 learned_addr learned my addr 172.21.15.84:0/3280660886 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:28:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc463d4700 1 --2- 172.21.15.84:0/3280660886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc4006ebd0 0x7fdc4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc45bd3700 1 -- 172.21.15.84:0/3280660886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc4006ebd0 msgr2=0x7fdc4006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:28:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc45bd3700 1 --2- 172.21.15.84:0/3280660886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc4006ebd0 0x7fdc4006d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc45bd3700 1 -- 172.21.15.84:0/3280660886 >> v2:172.21.15.131:3300/0 conn(0x7fdc400c75b0 msgr2=0x7fdc4006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:28:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc45bd3700 1 --2- 172.21.15.84:0/3280660886 >> v2:172.21.15.131:3300/0 conn(0x7fdc400c75b0 0x7fdc4006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc45bd3700 1 -- 172.21.15.84:0/3280660886 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40156910 con 0x7fdc40156540 2023-10-06T03:28:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc45bd3700 1 --2- 172.21.15.84:0/3280660886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc40156540 0x7fdc400c7070 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdc40159fc0 tx=0x7fdc3800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721c5af4febf671d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:28:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc44bd1700 1 -- 172.21.15.84:0/3280660886 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38010070 con 0x7fdc40156540 2023-10-06T03:28:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc44bd1700 1 -- 172.21.15.84:0/3280660886 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdc3800de80 con 0x7fdc40156540 2023-10-06T03:28:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.515+0000 7fdc44bd1700 1 -- 172.21.15.84:0/3280660886 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800b340 con 0x7fdc40156540 2023-10-06T03:28:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.516+0000 7fdc47e37700 1 -- 172.21.15.84:0/3280660886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc40156540 msgr2=0x7fdc400c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.516+0000 7fdc47e37700 1 --2- 172.21.15.84:0/3280660886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc40156540 0x7fdc400c7070 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdc40159fc0 tx=0x7fdc3800ba50 comp rx=0 tx=0).stop 2023-10-06T03:28:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.516+0000 7fdc47e37700 1 -- 172.21.15.84:0/3280660886 shutdown_connections 2023-10-06T03:28:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.516+0000 7fdc47e37700 1 --2- 172.21.15.84:0/3280660886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc4006ebd0 0x7fdc4006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.516+0000 7fdc47e37700 1 --2- 172.21.15.84:0/3280660886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc40156540 0x7fdc400c7070 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.516+0000 7fdc47e37700 1 --2- 172.21.15.84:0/3280660886 >> v2:172.21.15.131:3300/0 conn(0x7fdc400c75b0 0x7fdc4006e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.516+0000 7fdc47e37700 1 -- 172.21.15.84:0/3280660886 >> 172.21.15.84:0/3280660886 conn(0x7fdc400680c0 msgr2=0x7fdc400cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:28:15.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.516+0000 7fdc47e37700 1 -- 172.21.15.84:0/3280660886 shutdown_connections 2023-10-06T03:28:15.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.516+0000 7fdc47e37700 1 -- 172.21.15.84:0/3280660886 wait complete. 2023-10-06T03:28:15.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.517+0000 7fdc47e37700 1 Processor -- start 2023-10-06T03:28:15.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.517+0000 7fdc47e37700 1 -- start start 2023-10-06T03:28:15.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc47e37700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006ebd0 0x7fdc400cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc47e37700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc400c75b0 0x7fdc40169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc47e37700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc40156540 0x7fdc400c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc47e37700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc40166e00 con 0x7fdc4006ebd0 2023-10-06T03:28:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc47e37700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4016a360 con 0x7fdc40156540 2023-10-06T03:28:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc47e37700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc401661f0 con 0x7fdc400c75b0 2023-10-06T03:28:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc45bd3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006ebd0 0x7fdc400cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc45bd3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006ebd0 0x7fdc400cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40924/0 (socket says 172.21.15.84:40924) 2023-10-06T03:28:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc45bd3700 1 -- 172.21.15.84:0/1099204985 learned_addr learned my addr 172.21.15.84:0/1099204985 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:28:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc463d4700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc40156540 0x7fdc400c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc453d2700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc400c75b0 0x7fdc40169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc45bd3700 1 -- 172.21.15.84:0/1099204985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc400c75b0 msgr2=0x7fdc40169e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc45bd3700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc400c75b0 0x7fdc40169e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc45bd3700 1 -- 172.21.15.84:0/1099204985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc40156540 msgr2=0x7fdc400c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc45bd3700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc40156540 0x7fdc400c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc45bd3700 1 -- 172.21.15.84:0/1099204985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3800bcf0 con 0x7fdc4006ebd0 2023-10-06T03:28:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc463d4700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc40156540 0x7fdc400c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:28:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc45bd3700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006ebd0 0x7fdc400cb680 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdc38014000 tx=0x7fdc3800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:28:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc35ffb700 1 -- 172.21.15.84:0/1099204985 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800abc0 con 0x7fdc4006ebd0 2023-10-06T03:28:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.518+0000 7fdc35ffb700 1 -- 172.21.15.84:0/1099204985 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdc3800ad60 con 0x7fdc4006ebd0 2023-10-06T03:28:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.519+0000 7fdc47e37700 1 -- 172.21.15.84:0/1099204985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc401664d0 con 0x7fdc4006ebd0 2023-10-06T03:28:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.519+0000 7fdc35ffb700 1 -- 172.21.15.84:0/1099204985 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc380286d0 con 0x7fdc4006ebd0 2023-10-06T03:28:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.519+0000 7fdc47e37700 1 -- 172.21.15.84:0/1099204985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc40166a90 con 0x7fdc4006ebd0 2023-10-06T03:28:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.520+0000 7fdc47e37700 1 -- 172.21.15.84:0/1099204985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc40064ad0 con 0x7fdc4006ebd0 2023-10-06T03:28:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.520+0000 7fdc35ffb700 1 -- 172.21.15.84:0/1099204985 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc38003040 con 0x7fdc4006ebd0 2023-10-06T03:28:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.520+0000 7fdc35ffb700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc24066f30 0x7fdc240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:28:15.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.520+0000 7fdc35ffb700 1 -- 172.21.15.84:0/1099204985 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fdc38088510 con 0x7fdc4006ebd0 2023-10-06T03:28:15.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.520+0000 7fdc453d2700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc24066f30 0x7fdc240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:28:15.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.521+0000 7fdc453d2700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc24066f30 0x7fdc240693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdc400ccf70 tx=0x7fdc300090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:28:15.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.525+0000 7fdc35ffb700 1 -- 172.21.15.84:0/1099204985 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc380556c0 con 0x7fdc4006ebd0 2023-10-06T03:28:15.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.748+0000 7fdc47e37700 1 -- 172.21.15.84:0/1099204985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc400c7b70 con 0x7fdc4006ebd0 2023-10-06T03:28:15.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.748+0000 7fdc35ffb700 1 -- 172.21.15.84:0/1099204985 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fdc38023de0 con 0x7fdc4006ebd0 2023-10-06T03:28:15.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:28:15.749 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3912722771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3912722771},{"type":"v1","addr":"172.21.15.131:6833","nonce":3912722771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6382,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4017009844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4017009844},{"type":"v1","addr":"172.21.15.131:6835","nonce":4017009844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1667361798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1667361798},{"type":"v1","addr":"172.21.15.84:6835","nonce":1667361798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2217211372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2217211372},{"type":"v1","addr":"172.21.15.84:6837","nonce":2217211372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[]} 2023-10-06T03:28:15.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 -- 172.21.15.84:0/1099204985 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc24066f30 msgr2=0x7fdc240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc24066f30 0x7fdc240693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdc400ccf70 tx=0x7fdc300090f0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 -- 172.21.15.84:0/1099204985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006ebd0 msgr2=0x7fdc400cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:28:15.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006ebd0 0x7fdc400cb680 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdc38014000 tx=0x7fdc3800ba50 comp rx=0 tx=0).stop 2023-10-06T03:28:15.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 -- 172.21.15.84:0/1099204985 shutdown_connections 2023-10-06T03:28:15.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.84:6832/90431,v1:172.21.15.84:6833/90431] conn(0x7fdc24066f30 0x7fdc240693e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc40156540 0x7fdc400c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006ebd0 0x7fdc400cb680 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 --2- 172.21.15.84:0/1099204985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc400c75b0 0x7fdc40169e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:28:15.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 -- 172.21.15.84:0/1099204985 >> 172.21.15.84:0/1099204985 conn(0x7fdc400680c0 msgr2=0x7fdc40155490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:28:15.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 -- 172.21.15.84:0/1099204985 shutdown_connections 2023-10-06T03:28:15.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:28:15.750+0000 7fdc47e37700 1 -- 172.21.15.84:0/1099204985 wait complete. 2023-10-06T03:28:15.752 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 68 2023-10-06T03:28:15.763 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T03:28:15.763 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T03:28:15.763 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:28:15.763 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:15.771 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:28:15.772 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:28:15.772 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:15.820 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:28:15.821 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:28:15.821 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:15.832 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:28:15.832 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:28:15.832 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:15.883 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:28:15.883 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T03:28:15.883 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T03:28:15.884 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:15.916 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T03:28:15.916 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T03:28:15.917 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:15.981 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T03:28:15.981 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T03:28:15.981 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.047 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T03:28:16.047 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T03:28:16.047 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.115 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T03:28:16.116 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T03:28:16.116 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.149 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T03:28:16.149 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T03:28:16.149 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.221 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T03:28:16.222 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T03:28:16.222 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.299 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T03:28:16.300 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T03:28:16.300 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.365 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T03:28:16.365 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T03:28:16.366 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T03:28:16.366 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.391 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T03:28:16.391 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T03:28:16.391 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.431 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T03:28:16.431 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T03:28:16.431 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T03:28:16.432 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.442 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T03:28:16.443 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T03:28:16.443 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.483 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T03:28:16.483 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T03:28:16.483 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:28:16.535 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T03:28:16.535 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T03:28:16.535 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'client session with non-allowable root' | head -n 1 2023-10-06T03:28:16.563 INFO:teuthology.orchestra.run.smithi084.stdout:1696562629.5237803 mon.a (mon.0) 212 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:28:16.564 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T03:28:16.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'client session with non-allowable root' | head -n 1 2023-10-06T03:28:16.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'client session with non-allowable root' | head -n 1 2023-10-06T03:28:16.699 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'client session with non-allowable root' | head -n 1 2023-10-06T03:28:16.767 INFO:teuthology.orchestra.run.smithi084.stdout:1696562629.5237803 mon.a (mon.0) 212 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:28:16.767 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:28:16.767 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T03:28:17.032 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:28:17.032 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T03:28:17.119 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:28:17.119 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T03:28:17.176 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:28:17.178 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T03:28:17.233 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:28:17.234 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T03:28:17.442 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:28:17.442 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T03:28:17.583 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:28:17.584 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T03:28:17.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:28:17.643 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T03:28:17.698 INFO:tasks.ceph:Archiving mon data... 2023-10-06T03:28:17.699 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196/data/mon.a.tgz 2023-10-06T03:28:17.699 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-10-06T03:28:17.714 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.89N2uE9tZ3 2023-10-06T03:28:17.715 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.89N2uE9tZ3 2023-10-06T03:28:17.897 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.89N2uE9tZ3 2023-10-06T03:28:17.979 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.89N2uE9tZ3 is 488KB 2023-10-06T03:28:18.076 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.89N2uE9tZ3 2023-10-06T03:28:18.090 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196/data/mon.b.tgz 2023-10-06T03:28:18.090 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-10-06T03:28:18.106 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.6ZGjrxY86R 2023-10-06T03:28:18.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6ZGjrxY86R 2023-10-06T03:28:18.315 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.6ZGjrxY86R 2023-10-06T03:28:18.396 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.6ZGjrxY86R is 623KB 2023-10-06T03:28:18.495 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.6ZGjrxY86R 2023-10-06T03:28:18.509 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196/data/mon.c.tgz 2023-10-06T03:28:18.509 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-10-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.MYccwkGpBi 2023-10-06T03:28:18.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MYccwkGpBi 2023-10-06T03:28:18.746 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.MYccwkGpBi 2023-10-06T03:28:18.827 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.MYccwkGpBi is 623KB 2023-10-06T03:28:18.926 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.MYccwkGpBi 2023-10-06T03:28:18.940 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T03:28:18.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:28:18.943 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:28:19.006 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T03:28:19.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:28:19.011 DEBUG:teuthology.orchestra.run.smithi131:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:28:19.037 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:28:19.070 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:28:19.076 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T03:28:19.078 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196/remote/smithi084/crash 2023-10-06T03:28:19.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:28:19.110 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196/remote/smithi131/crash 2023-10-06T03:28:19.111 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:28:19.140 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T03:28:19.141 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:28:19.155 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:28:19.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:28:19.268 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:28:19.292 INFO:tasks.ceph:Compressing logs... 2023-10-06T03:28:19.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:28:19.311 DEBUG:teuthology.orchestra.run.smithi131:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:28:24.131 INFO:tasks.ceph:Archiving logs... 2023-10-06T03:28:24.131 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196/remote/smithi084/log 2023-10-06T03:28:24.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:28:25.145 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196/remote/smithi131/log 2023-10-06T03:28:25.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:28:25.744 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T03:28:25.753 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T03:28:25.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:28:25.756 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:28:25.844 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T03:28:25.860 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T03:28:25.860 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:28:25.863 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:28:25.877 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2023-10-06T03:28:25.877 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2023-10-06T03:28:25.881 INFO:teuthology.orchestra.run.smithi084.stdout:210 Number of sources = 4 2023-10-06T03:28:25.881 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:28:25.881 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-10-06T03:28:25.881 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 58 -172us[ -172us] +/- 92ms 2023-10-06T03:28:25.881 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv02.front.sepia.ceph.com 3 6 377 59 -325us[ -321us] +/- 64ms 2023-10-06T03:28:25.881 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +516us[ +516us] +/- 71ms 2023-10-06T03:28:25.881 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:28:25.882 INFO:teuthology.orchestra.run.smithi131.stdout:210 Number of sources = 4 2023-10-06T03:28:25.882 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:28:25.882 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-10-06T03:28:25.882 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 -169us[ -169us] +/- 92ms 2023-10-06T03:28:25.883 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 -325us[ -291us] +/- 64ms 2023-10-06T03:28:25.883 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 +516us[ +550us] +/- 71ms 2023-10-06T03:28:25.883 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:28:25.883 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T03:28:25.892 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T03:28:25.893 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T03:28:25.902 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T03:28:26.033 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T03:28:26.125 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:28:26.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:28:26.158 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:28:26.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:28:26.188 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T03:28:26.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T03:28:26.210 INFO:teuthology.task.internal:Duration was 939.888896 seconds 2023-10-06T03:28:26.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T03:28:26.220 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T03:28:26.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:28:26.222 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:28:26.264 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:28:26.271 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:28:26.525 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T03:28:26.525 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:28:26.526 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:28:26.585 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:28:26.585 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:28:26.605 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T03:28:26.605 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:28:26.628 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:28:26.683 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T03:28:26.683 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:28:26.712 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:28:26.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T03:28:26.808 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T03:28:26.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:28:26.832 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:28:26.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T03:28:26.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:28:26.875 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:28:26.896 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2023-10-06T03:28:26.921 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2023-10-06T03:28:26.935 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:28:26.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:28:26.964 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:28:26.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:28:26.989 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T03:28:26.999 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T03:28:27.000 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196/remote/smithi084 2023-10-06T03:28:27.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:28:27.041 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196/remote/smithi131 2023-10-06T03:28:27.042 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:28:27.077 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T03:28:27.077 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:28:27.079 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:28:27.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T03:28:27.137 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T03:28:27.137 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T03:28:27.146 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T03:28:27.146 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:28:27.149 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:28:27.161 INFO:teuthology.orchestra.run.smithi084.stdout: 263007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:28 /home/ubuntu/cephtest 2023-10-06T03:28:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: 262184 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:28 /home/ubuntu/cephtest 2023-10-06T03:28:27.180 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T03:28:27.190 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T03:28:27.211 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T03:28:27.240 DEBUG:teuthology.nuke:shortname: smithi084 2023-10-06T03:28:27.240 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:28:27.263 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:05:37.955068', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxm0D7OhTqMdrf1cqN/QMtrJIuB/luPw9ZIvMy3rzgMSTQ780jYjpbYeXAqiBMgs4ja1v0vOnnlH7mqlPXJ/Gg='} 2023-10-06T03:28:27.267 DEBUG:teuthology.nuke:shortname: smithi131 2023-10-06T03:28:27.267 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:28:27.292 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412196', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:05:37.956807', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1tlBzZ9Y6G7MiwYE6zznDV/7zzdZ1vz0jw3dy/ZO2zaf5BB8+LaJ3tn14YVd/hWo5VJCG6dhluTklwKA/Y6dA='} 2023-10-06T03:28:27.325 INFO:teuthology.orchestra.console.smithi084:Power off 2023-10-06T03:28:27.326 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:28:27.353 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-10-06T03:28:27.353 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:28:27.374 INFO:teuthology.orchestra.console.smithi131:Power off 2023-10-06T03:28:27.374 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:28:27.386 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-10-06T03:28:27.400 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-10-06T03:28:27.400 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:28:27.423 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-06T03:28:31.387 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:28:31.424 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:28:31.498 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-10-06T03:28:31.535 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-06T03:28:35.500 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:28:35.536 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:28:35.612 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-10-06T03:28:35.647 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-06T03:28:39.614 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:28:39.647 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:28:39.725 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-10-06T03:28:39.757 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-06T03:28:39.826 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-10-06T03:28:39.858 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-10-06T03:28:39.963 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} duration: 939.8888964653015 failure_reason: '"1696562629.5237803 mon.a (mon.0) 212 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T03:28:39.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:28:40.046 INFO:teuthology.run:FAIL